How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care
Open accessPublished version of a preprint
The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Abstract
Background: Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms—such as provider knowledge, skills, and attitudes—is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services. Methods: A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge). Results: There was a significant linear effect of BOLT+PTC over time on standardized assessment use ( b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use ( b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage. Conclusions: Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices. Trial registration: ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current literature also reflects an increasing number of studies testing the effectiveness of implementation strategies and the mechanisms that explain how these strategies may influence implementation outcomes [25–31].”
From Ten years of implementation outcomes research: a scoping review (2023) · cites this paper as [29]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · cited 1×
“Current study The current study was designed to better understand the impact of a brief online training (BOLT) and posttraining consultation (PTC) on putative implementation mechanisms as well as MBC penetration, an indicator of the number of service recipients receiving MBC out of the total number possible [66].”
BackgroundPowell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963 · cited 2×
“Implementation mechanisms: provider knowledge, skill, and attitudes Despite increasingly precise identification of implementation strategies [13], there is little information available about how implementation strategies exert their influence.”
Background(2005) · Cited by 3,748
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · cited 1×
“Ongoing, posttraining consultation refers to practice-specific coaching by one or more experts in the intervention strategy [14].”
BackgroundBeidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085 · cited 1×
“Initial training generally refers to a combination of didactic content covering intervention materials or protocols and active or experiential learning such as in vivo demonstration or role plays to apply skills and receive feedback [2].”
BackgroundScale up services for mental disorders: a call for action
(2007) · The Lancet · doi:10.1016/s0140-6736(07)61242-2 · Cited by 835
Weisz, J. R. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.147 · Cited by 827
Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775 · cited 1×
“Whether in schools or other healthcare delivery sectors, there is growing recognition that implementation strategy optimization will be greatly facilitated by clear identification and testing of the mechanisms through which implementation outcomes are improved [29, 32, 33].”
BackgroundHandbook of Advanced Multilevel Analysis
(2011) · Routledge eBooks · doi:10.4324/9780203848852 · Cited by 743
Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.02.005 · Cited by 713
Research works printed but not linked: 1
- Lyon A, Liu FF, Coifman JI, Cook H, King K, Ludwig K, et al. Randomized trial to optimize a brief online training and consultation strategy for measurement-based care in school mental health. In: Proceedings of the Fifth Biennial Conference of the Society for Implementation Research Collaboration (SIRC) 2019. BMC Campus, 4 Crinan St, London N1 9XW, England; 2020.
Cited by
Ten years of implementation outcomes research: a scoping review
Proctor, E. K., Bunger, A. C., Lengnick-Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023) · Implementation Science · doi:10.1186/s13012-023-01286-z · Cited by 424
Lyon, A. R., Connors, E. H., Lawson, G. M., Nadeem, E., & Owens, J. S. (2024) · School Mental Health · doi:10.1007/s12310-024-09731-0 · Cited by 58
“…al., 2018; Fabiano et al., 2018; Owens et al., 2020; Reinke et al., 2008; Shernoff et al., 2018; Sutherland et al., 2015) and classroom climate (e.g., Allen et al., 2015; Reinke et al., 2008), as well as to promote school mental health clinician’s use of EBP (Lyon et al., 2022; Meyer et al., 2022).”
Self-citationA Brief Online Implicit Bias Intervention for School Mental Health Clinicians
Liu, F. F., Coifman, J., McRee, E., Stone, J., Law, A., Gaias, L. M., Reyes, R., Lai, C. K., Blair, I. V., Yu, C.-L., et al. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19020679 · Cited by 28
Self-citationSichel, C. E., & Connors, E. H. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00356-5 · Cited by 18
Self-citationLewis, C. C., Boyd, M. R., Marti, C. N., & ALBRIGHT, K. J. (2022) · Implementation Science · doi:10.1186/s13012-022-01244-1 · Cited by 15
“Consultation has been shown to be a promising strategy for supporting clinician skill acquisition and implementation of new practices [45].”
Background
Metadata
- Authors
- Lyon, A. R., Liu, F. F., Connors, E. H., King, K. M., Coifman, J. I., Cook, H., McRee, E., Ludwig, K., Law, A., Dorsey, S., & McCauley, E.
- Affiliations
- University of Washington (US)
- Yale University (US)
- Corresponding author
- Lyon, Aaron R.
- ORCID
- Venue
- Implementation Science Communications
- Published
- 2022-07-22
- Volume
- 3
- Issue
- 1
- Pages
- 79-79
- ISSN
- 2662-2211 (ISSN-L)
- PMC
- PMC9306246
- OpenAlex
- W4286697645
- Semantic Scholar
- b5483d6f608c6e174ad42611208f1b36c35a4737
- Cited by
- 28
- References
- 84
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 10 · 2023: 9 · 2022: 4
- FWCI
- 7.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Implementation Science Communications (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute of Mental Health (R34MH109605, K08MH116119, P50MH115837)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- measurement-based care, online training, implementation strategies, implementation mechanisms, standardized assessment, individualized assessment, treatment modification, school-based mental health services, child and adolescent mental health, clinician knowledge and skills
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care. https://app.cochat.ai/papers/10.1186/s43058-022-00325-y
- The paper
- Lyon, A. R., Liu, F. F., Connors, E. H., King, K. M., Coifman, J. I., Cook, H., McRee, E., Ludwig, K., Law, A., Dorsey, S., & McCauley, E. (2022). How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care. Implementation Science Communications. https://doi.org/10.1186/s43058-022-00325-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
