Advancing implementation frameworks with a mixed methods case study in child behavioral health
Open accessThe DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Abstract
Despite a growing policy push for the provision of services based on evidence, evidence-based treatments for children and youth with mental health challenges have poor uptake, yielding limited benefit. With a view to improving implementation in child behavioral health, we investigated a complementary implementation approach informed by three implementation frameworks in the context of implementing motivational interviewing in four child and youth behavioral health agencies: the Active Implementation Frameworks (AIF) (process), the Consolidated Framework for Implementation Research (factors), and the Implementation Outcomes Framework (evaluation). The study design was mixed methods with embedded interrupted time series and motivational interviewing (MI) fidelity was the primary outcome. Focus groups and field notes informed perspectives on the implementation approach, and a questionnaire explored the salience of Consolidated Framework for Implementation Research (CFIR) factors. Findings validate the process guidance provided by the AIF and highlight CIFR factors related to implementation success. Novel CFIR factors, not elsewhere reported in the literature, are identified that could potentially extend the framework if validated in future research. Introducing fidelity measurement in practice proved challenging and was not sustained beyond the study. A complementary implementation approach was successful in implementing MI in child behavioral health agencies. In contrast with the typical train and hope approach to implementation, practice change did not occur immediately post-training but emerged over a 7 month period of consultation and practice following a discrete interactive training period. The saliency of CFIR constructs aligned with findings from studies conducted in other contexts, demonstrating external validity and highlighting common factors that can focus planning and measurement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Many users felt the CFIR did not provide “sufficient individual-level constructs” [45] and were unclear about which individuals were included [45–47, 56–59].”
From The updated consolidated framework for implementation research based on user feedback (2022) · cites this paper as [58]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Motivational interviewing: preparing people for change.
Miller, W. R., & Rollnick, S. (2002) · Guilford Press eBooks · Cited by 7,768
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
(1990) · Cited by 3,957
Schafer, J. L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800102 · Cited by 3,949
(2005) · Cited by 3,748
Student achievement through staff development
Joyce, B. R., & Showers, B. (1988) · Cited by 2,100
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894
Research works printed but not linked: 9
- Institute of Medicine, 2001, Crossing the Quality Chasm: A New Health System for the Twenty-first Century
- Government of Canada, 2006, Out of the Shadows at Last: Transforming Mental Health, Mental Illness, and Addiction Services in Canada. Final Report of the Standing Senate Committee on Social Affairs, Science and Technology
- Moyers, 2004, The Motivational Interviewing Treatment Integrity [MITI] Code [coding manual]
- Smart, 1979, The Teaching-Family Consultant’s Handbook
- Lane, 2002, The Behavior Change Counselling Index [BECCI]: Manual for Coding Behaviour Change Counselling
- Thorne, 2008, Interpretive Description
- Barac, 2018, Examining consultation to support implementation of motivational interviewing in community-based child and youth mental health, J Evid-Based Soc Work., 8, 10.1080/23761407.2018.1480988 · DOI
- Mihalic, 2004, The importance of implementation fidelity, Emot Behav Disord Youth., 4, 99
- Hayes, 1998, President’s message: dissemination research now, Behav Ther, 21, 166
Cited by
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
Clarity out of chaos: Use of theory in implementation research
Damschroder, L. J. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.036 · Cited by 422
Peters‐Corbett, A., Parke, S., Bear, H. A., & Clarke, T. (2023) · Child and Adolescent Mental Health · doi:10.1111/camh.12672 · Cited by 100
Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review
Hooley, C., Amano, T., Markovitz, L., Yaeger, L., & Proctor, E. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00965-8 · Cited by 42
Kimber, M., McTavish, J. R., Vanstone, M. G., Stewart, D. E., & MacMillan, H. L. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104743 · Cited by 41
Self-citationFactors Associated with Effective Implementation: Research and Practical Implications
Barwick, M. A., Dubrowski, R., & Damschroder, L. J. (2020) · Springer eBooks · doi:10.1007/978-3-030-03874-8_4 · Cited by 36
Self-citationImplementation of Interventions for the Control of Typhoid Fever in Low- and Middle-Income Countries
Barac, R., Als, D., Radhakrishnan, A., Gaffey, M. F., Bhutta, Z. A., & Barwick, M. A. (2018) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.18-0110 · Cited by 25
Self-citationHickey, G., McGilloway, S., Leckey, Y., Stokes, A., Bywater, T., & Donnelly, M. (2021) · Prevention Science · doi:10.1007/s11121-020-01170-y · Cited by 15
“…recent growth in the field of implementation science, there remains a critical dearth of realworld examples of theory-driven implementation research in relation to parenting interventions and child and family service innovation (Akin et al. 2017; Barwick et al. 2019; Williams and Beidas 2019).”
BackgroundInfluentialDorsey, C. N., Mettert, K. D., Puspitasari, A. J., Damschroder, L. J., & Lewis, C. C. (2021) · Implementation Research and Practice · doi:10.1177/26334895211002474 · Cited by 15
“…research reveals how changes in group differentiation negatively impact implementation, specifically how merging organizations, addition and/or elimination of roles, and shift changes create isolation from support structures and increase pressures from new responsibilities (Barwick et al., 2020).”
BackgroundCouturier, J. L., Kimber, M., Barwick, M. A., Woodford, T., McVey, G. L., Findlay, S. M., Webb, C., Niccols, A., & Lock, J. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz160 · Cited by 17
“They note that some practitioners found audiotaping therapy sessions for fidelity assessment to be the most challenging aspect of the study [7], findings similar to our own.”
BackgroundMethodResultInfluentialSelf-citationSombié, I., Degroote, S., Somé, P. A., & Ridde, V. (2020) · Implementation Science · doi:10.1186/s13012-020-00989-x · Cited by 21
“Like other authors [48], the use of a measurement scale for the CFIR constructs by participants to guide, without measuring, the continuation of qualitative data collection has been fruitful.”
BackgroundWillging, C. E., Sklar, M., Eckstrand, K., Sturm, R., Davies, S., & Kano, M. A. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.901440 · Cited by 22
“, coaching/consultation, practice opportunities) to advance needed practice changes in clinic milieus (51, 52).”
BackgroundBarwick, M. A., Brown, J., Petricca, K., Stevens, B., Powell, B. J., Jaouich, A., Shakespeare, J., & Seto, E. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00402-w · Cited by 15
“CFIR has been extensively studied in various contexts [85–88], including the study of eHealth technology implementation [89].”
BackgroundSelf-citationHitch, D., Leech, K., Neale, S., & Malcolm, A. (2020) · PLoS ONE · doi:10.1371/journal.pone.0235055 · Cited by 20
“This mitigates against finding the most commonly reported CFIR constructs that influence implementation, which has been suggested as a potential avenue for exploration [36].”
BackgroundResultCouturier, J. L., Pellegrini, D., Miller, C., Agar, P., Webb, C., Anderson, K. E., Barwick, M. A., Dimitropoulos, G., Findlay, S. M., Kimber, M., et al. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00143-8 · Cited by 17
“programs [28] and in research by team members with other child and youth mental health organizations [34].”
BackgroundSelf-citationCouturier, J. L., Kimber, M., Barwick, M. A., McVey, G. L., Findlay, S. M., Webb, C., Niccols, A., & Lock, J. (2021) · Journal of Eating Disorders · doi:10.1186/s40337-020-00366-5 · Cited by 14
“Page 10/16 important caveat to our ndings is that even when a pragmatic measure of treatment delity is identi ed, some authors have found that it is di cult for practitioners to sustain delity assessment in the longterm, unless an organizational culture is present that recognizes delity assessment as essential for opt…”
BackgroundSelf-citationHarnessing Implementation Science in Clinical Psychology: Past, Present, and Future
Beidas, R. S., Boyd, M. R., Casline, E. P., Scott, K., Patel, Z. S., Mills, C., Mustanski, B. S., Schriger, S. H., Williams, F. S., Waller, C., et al. (2025) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081423-021727 · Cited by 14
“In recent years, the CFIR has been used to plan for the implementation of EBTs for specialty mental health promotion (Van Deinse et al. 2019), child behavioral health (Barwick et al. 2020), and community-based interventions for depression and anxiety globally (Petersen et al. 2021).”
Lu, K. D., Cooper, D. M., Dubrowski, R., Barwick, M. A., & Radom‐Aizik, S. (2021) · Pediatric Exercise Science · doi:10.1123/pes.2020-0214 · Cited by 10
“These studies have identified several factors strongly associated with implementation effectiveness and distinguished between high and low implementers, including relative advantage, tension for change, and patient needs and resources; relative priority; available resources; and planning (2,15,31,35).”
BackgroundMethodSelf-citationUsing Implementation Teams to Inform a More Effective Response to Future Pandemics
Aijaz, M., Fixsen, D. L., Schultes, M.-T., & Dyke, M. K. V. (2021) · Public Health Reports · doi:10.1177/0033354920988613 · Cited by 11
Clarke, T., & Barwick, M. A. (2021) · Child and Adolescent Mental Health · doi:10.1111/camh.12447 · Cited by 11
“mented in a timely fashion (Barwick et al., 2020) and the uptake of evidence-based treatments is not always prioritised (McGorry, 2017).”
BackgroundSelf-citationThe Early Implementation of FFT-CW®, MST-Psychiatric®, and SafeCare® in Australia
Albers, B., Hateley-Browne, J., Steele, T., Rose, V. K., Shlonsky, A., & Mildon, R. L. (2020) · Research on Social Work Practice · doi:10.1177/1049731520908326 · Cited by 11
“…as an implementation planning tool (Flynn et al., 2018; Henderson et al., 2017), an instrument to organize and analyze data (Marques et al., 2016; Ordway et al., 2018), and an object of research in itself in that the CFIR is examined in light of empirical research findings (Barwick et al., 2019).”
MethodZhao, X., Kuo, F., Chen, X., Li, D., & Duan, H. (2025) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-025-06845-5 · Cited by 9
“Future research can draw on certain promising study designs and implementation science frameworks to guide the effective delivery of PMIs (Barwick et al., 2020; Drmic et al., 2023; Kasari et al., 2014; Mazurek et al., 2020; Sridhar et al., 2022), it is important to explore the potential application…”
Kimber, M., Vanstone, M. G., Dimitropoulos, G., Collin‐Vézina, D., & Stewart, D. E. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01096-y · Cited by 9
Self-citationKerns, S. E. U., Perrine, C. M., Sedlar, G. R., Peterson, R. S., & Monroe‐DeVita, M. (2021) · Global Implementation Research and Applications · doi:10.1007/s43477-021-00012-5 · Cited by 7
Williams, T. S., Deotto, A., Greenblatt, A., Fabiano, G. F., Green, R. R., Linga-Easwaran, J., Anagnostou, E. A., Crosbie, J., Kelley, E. A., Miller, S. P., et al. (2025) · Implementation Research and Practice · doi:10.1177/26334895251346816 · Cited by 6
“This generally relates to successfully adopting family-centred care and the utility of parents and caregivers as implementation drivers and champions (Barwick et al., 2020; O ’ Brien et al., 2015).”
Self-citationSchraeder, K. E., Reid, G. J., & Brown, J. B. (2019) · Journal of Pediatric Nursing · doi:10.1016/j.pedn.2019.08.015 · Cited by 7
Vurrabindi, D., Hilderley, A. J., Kirton, A., Andersen, J. C., Cassidy, C. E., Kingsnorth, S., Munce, S., Agnew, B., Cambridge, L., Herrero, M., et al. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12621-z · Cited by 8
“Similar research has used the CFIR in cross-sectional survey designs to systematically capture potential facilitators and barriers to implementing evidence-based interventions [17, 18].”
Abbas, S. A., Yusifzada, I., & Athar, S. (2025) · Cureus · doi:10.7759/cureus.80935 · Cited by 12
Noble, E., Adenikinju, D., Ruan, C., Zuniga, S., Thakkar, D., Malburg, C., Gyamfi, J., Ojo, T., Islam, F., Cohen, A., et al. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20116006
“The case exemplars as presented in Table 1 describe in detail how these EBIs possess strong advantages for different populations and care levels within the scope of CFIR have been successfully implemented in varying contexts and yield improvements in health outcomes [7,8,11].”
InfluentialPapaz, T., Seto, E., Anthony, S. J., Pol, S. J., Hayeems, R. Z., Barwick, M. A., & Mital, S. R. (2024) · CJC Open · doi:10.1016/j.cjco.2024.10.002
Self-citationCouturier, J. L., Pellegrini, D., Miller, C., Agar, P., Webb, C., Anderson, K., Barwick, M. A., Dimitropoulos, G., Findlay, S. M., Kimber, M., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14391192
Self-citationCouturier, J. L., Pellegrini, D., Miller, C., Agar, P., Webb, C., Anderson, K., Barwick, M. A., Dimitropoulos, G., Findlay, S. M., Kimber, M., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14391189
Self-citationTeruel, G., Maldonado, J. H., Peters-Castilla, M., & Enríquez, M. T. (2025) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2025.102746
Metadata
- Authors
- Barwick, M., Barac, R., Kimber, M., Akrong, L., Johnson, S. N., Cunningham, C. E., Bennett, K., Ashbourne, G., & Godden, T.
- Affiliations
- University of Toronto (CA)
- Memorial University of Newfoundland (CA)
- McMaster University (CA)
- York University (CA)
- McMaster Children's Hospital (CA)
- Craigwood Youth Services, London, Canada
- Centre for Addiction and Mental Health (CA)
- Corresponding author
- Barwick, Melanie
- ORCID
- Venue
- Translational Behavioral Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-01-30
- Volume
- 10
- Issue
- 3
- Pages
- 685-704
- ISSN
- 1613-9860 (ISSN-L)
- 1869-6716
- PMC
- PMC7413184
- OpenAlex
- W3021532713
- Cited by
- 33
- References
- 64
- Citations by year
- 2025: 6 · 2024: 1 · 2023: 3 · 2022: 3 · 2021: 9 · 2020: 6 · 2019: 4
- FWCI
- 7.49
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Translational Behavioral Medicine (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research (TMF-88575)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- implementation framework, child behavioral health, motivational interviewing, Consolidated Framework for Implementation Research, intervention fidelity, child and adolescent mental health services, practice change
- MeSH terms
- Child Health, Adolescent, Child, Humans, Mental Health, Research Design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.