Common Elements Approaches to Implementation Research and Practice: Methods and Integration with Intervention Science
Open accessAbstract
We propose that common elements approaches can advance implementation research and practice and facilitate pragmatic use of intervention and implementation evidence. Common elements are practices or processes frequently shared by interventions or implementations. Traditional common elements methodologies use synthesis, distillation, and statistics to describe and evaluate the merit of common ingredients in effective interventions. Recent developments include identifying and testing common configurations of elements, processes, and context variables across the literature of effective interventions and implementations. While common elements thinking has grown popular in intervention science, it has rarely been utilized in implementation science, and specifically, combined with the intervention literature. The goals of this conceptual methodology paper are to (1) provide an overview of the common elements concept and how it may advance implementation research and usability for practice, (2) give a step-by-step guide to systematic common elements reviews that synthesizes and distills the intervention and implementation literature together, and (3) offer recommendations for advancing element-level evidence in implementation science. A narrative review of the common elements literature was conducted with attention to applications to implementation research. A six-step guide to using an advanced common elements methodology was provided. Examples of potential results are presented, along with a review of the implications for implementation research and practice. Finally, we reviewed methodological limitations in current common elements approaches, and identified steps towards realizing their potential. Common elements methodologies can (a) synthesize and distill the implementation science literature into practical applications, (b) generate evidence-informed hypotheses about key elements and determinants in implementation and intervention processes and mechanisms, and (c) promote evidence-informed precision tailoring of intervention and implementation to context. To realize this potential, common elements approaches need improved reporting of details from both successful and unsuccessful intervention and implementation research, more data availability, and more testing and investigation of causal processes and mechanisms of change from diverse theories.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Significant heterogeneity in the ways in which implementation outcomes are operationalized and reported is a substantial barrier to conducting large-scale meta-analytic approaches to synthesizing evidence for implementation strategies.
“Further, the significant heterogeneity in the ways in which implementation outcomes are operationalized and reported is a substantial barrier to conducting large-scale meta-analytic approaches to synthesizing evidence for implementation strategies [67].”
From A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022 (2024) · cites this paper as [67]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048 · see citing works
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · see citing works
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629 · see citing works
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · see citing works
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485 · cited 2× · see citing works
“As noted in Table 1, in terms of evidence for implementation strategies, audit and feedback is an empirically supported and relatively more “unpacked” implementation strategy to date (Brown et al., 2019; Ivers et al., 2012; Tuti et al., 2017).”
BackgroundPowell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963 · see citing works
Cane, J., O’Connor, D., & Michie, S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-37 · Cited by 4,888 · see citing works
(2005) · Cited by 3,748 · see citing works
Clinical Psychology: Science and Practice
(2021) · Clinical Psychology Science and Practice · doi:10.1111/(issn)1468-2850 · Cited by 3,683 · see citing works
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · see citing works
How important are the common factors in psychotherapy? An update
Wampold, B. E. (2015) · World Psychiatry · doi:10.1002/wps.20238 · Cited by 1,728 · cited 2× · see citing works
“…techniques (e.g., discrete practice elements; McLeod et al., 2017), common factors (e.g., therapeutic alliance, empathy, and expectations; Wampold, 2015), therapist skills (e.g., interpersonal capacities, cognitive processing, self-assessment; Heinonen & Nissen-Lie, 2020; Hill et al.,…”
BackgroundMethodSystem Dynamics: Systems Thinking and Modeling for a Complex World
Sterman, J. D. (2002) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 1,726 · see citing works
Standards for Reporting Implementation Studies (StaRI) Statement
Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., Rycroft-Malone, J., Meissner, P., Murray, E., Patel, A., et al. (2017) · BMJ · doi:10.1136/bmj.i6795 · Cited by 1,446 · see citing works
Fitting three-level meta-analytic models in R: A step-by-step tutorial
Assink, M., & Wibbelink, C. J. M. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p154 · Cited by 1,330 · see citing works
Complex interventions: how “out of control” can a randomised controlled trial be?
Hawe, P., Shiell, A., & Riley, T. (2004) · BMJ · doi:10.1136/bmj.328.7455.1561 · Cited by 1,244 · see citing works
Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223 · see citing works
Self-citationWaltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0295-0 · Cited by 1,108 · see citing works
Nilsen, P., & Bernhardsson, S. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4015-3 · Cited by 1,014 · see citing works
The Future of Intervention Science: Process-Based Therapy
Hofmann, S. G., & Hayes, S. C. (2019) · Clinical Psychological Science · doi:10.1177/2167702618772296 · Cited by 888 · see citing works
Braithwaite, J., Churruca, K., Long, J. C., Ellis, L. A., & Herkes, J. (2018) · BMC Medicine · doi:10.1186/s12916-018-1057-z · Cited by 845 · see citing works
Weisz, J. R. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.147 · Cited by 827 · see citing works
Understanding how and why psychotherapy leads to change
Kazdin, A. E. (2009) · Psychotherapy Research · doi:10.1080/10503300802448899 · Cited by 728 · cited 2× · see citing works
“, 2020a) and lacking understanding of how intervention practices work (e.g., active ingredients and mechanisms of change; Huibers et al., 2021; Kazdin, 2009), early accommodation of advanced common elements approaches may help address and avoid these limitations.”
BackgroundChorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005) · Mental Health Services Research · doi:10.1007/s11020-005-1962-6 · Cited by 717 · see citing works
Chorpita, B. F., & Daleiden, E. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0014565 · Cited by 687 · see citing works
Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., Walsh-Bailey, C., & Weiner, B. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00136 · Cited by 588 · see citing works
The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare
Miller, C. J., Barnett, M. L., Baumann, A. A., Gutner, C. A., & Wiltsey-Stirman, S. (2021) · Implementation Science · doi:10.1186/s13012-021-01105-3 · Cited by 490 · see citing works
Self-citationAction, actor, context, target, time (AACTT): a framework for specifying behaviour
Presseau, J., McCleary, N., Lorencatto, F., Patey, A. M., Grimshaw, J. M., & Francis, J. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0951-x · Cited by 411 · see citing works
Evidence-based Kernels: Fundamental Units of Behavioral Influence
Embry, D. D., & Biglan, A. (2008) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-008-0036-x · Cited by 396 · see citing works
Brown, B. C., Gude, W. T., Blakeman, T., van der Veer, S. N., Ivers, N. M., Francis, J., Lorencatto, F., Presseau, J., Peek, N. B., & Daker‐White, G. (2019) · Implementation Science · doi:10.1186/s13012-019-0883-5 · Cited by 394 · see citing works
GARLAND, A. F., HAWLEY, K. M., BROOKMAN-FRAZEE, L., & HURLBURT, M. S. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31816765c2 · Cited by 389 · see citing works
Bolton, P., Lee, C., Haroz, E. E., Murray, L., Dorsey, S., Robinson, C., Ugueto, A. M., & Bass, J. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001757 · Cited by 319 · see citing works
Meta-Analyses: Key Parenting Program Components for Disruptive Child Behavior
Leijten, P. H. O., Gardner, F. E. M., Meléndez‐Torres, G. J., van Aar, J., Hutchings, J., Schulz, S., Knerr, W., & Overbeek, G. J. (2018) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.07.900 · Cited by 316 · see citing works
Data-driven materials research enabled by natural language processing and information extraction
Olivetti, E. A., Cole, J. M., Kim, E., Kononova, O., Ceder, G., Han, T. Y.-J., & Hiszpanski, A. M. (2020) · Applied Physics Reviews · doi:10.1063/5.0021106 · Cited by 302 · see citing works
The professional and personal characteristics of effective psychotherapists: a systematic review
Heinonen, E., & Nissen-Lie, H. A. (2020) · Psychotherapy Research · doi:10.1080/10503307.2019.1620366 · Cited by 292 · see citing works
Understanding the Common Elements of Evidence-Based Practice
Chorpita, B. F., Becker, K. D., & Daleiden, E. L. (2007) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e318033ff71 · Cited by 292 · see citing works
Implementation science made too simple: a teaching tool
Curran, G. M. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00001-z · Cited by 285 · see citing works
Furukawa, T. A., Suganuma, A., Ostinelli, E. G., Andersson, G., Beevers, C. G., Shumake, J., Berger, T., Boele, F. W., Buntrock, C., Carlbring, P., et al. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00077-8 · Cited by 255 · see citing works
Parts, wholes, and part-whole relations: The prospects of mereotopology
Varzi, A. C. (1996) · Data & Knowledge Engineering · doi:10.1016/s0169-023x(96)00017-1 · Cited by 251 · see citing works
Pompoli, A., Furukawa, T. A., Efthimiou, O., Imai, H., Tajika, A., & Salanti, G. (2018) · Psychological Medicine · doi:10.1017/s0033291717003919 · Cited by 249 · see citing works
Annual Research Review: Ecological momentary assessment studies in child psychology and psychiatry
Russell, M. A., & Gajos, J. M. (2020) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13204 · Cited by 236 · see citing works
Implementation of Implementation Science Knowledge: The Research‐Practice Gap Paradox
Westerlund, A., Nilsen, P., & Sundberg, L. (2019) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12403 · Cited by 225 · see citing works
Weiss, W. M., Murray, L. K., Zangana, G. A. S., Mahmooth, Z., Kaysen, D., Dorsey, S., Lindgren, K., Gross, A., Murray, S. M., Bass, J. K., et al. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0622-7 · Cited by 206 · see citing works
Common versus specific factors in psychotherapy: opening the black box
Mulder, R., Murray, G., & Rucklidge, J. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30100-1 · Cited by 198 · see citing works
van Roekel, E., Keijsers, L., & Chung, J. M. (2019) · Journal of Research on Adolescence · doi:10.1111/jora.12471 · Cited by 191 · see citing works
Periodic reflections: a method of guided discussions for documenting implementation phenomena
Finley, E. P., Huynh, A. K., Farmer, M. M., Bean‐Mayberry, B., Moin, T., Oishi, S., Moreau, J. L., Dyer, K. E., Lanham, H. J., Leykum, L. K., et al. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0610-y · Cited by 184 · see citing works
Nadeem, E., Gleacher, A. A., & Beidas, R. S. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0502-8 · Cited by 184 · see citing works
Tuti, T., Nzinga, J., Njoroge, M. W., Brown, B. C., Peek, N. B., English, M., Paton, C., & van der Veer, S. N. (2017) · Implementation Science · doi:10.1186/s13012-017-0590-z · Cited by 159 · see citing works
Rudd, B. N., Davis, M., & Beidas, R. S. (2020) · Implementation Science · doi:10.1186/s13012-020-01060-5 · Cited by 157 · see citing works
Lyon, A. R., Brewer, S. K., & Areán, P. A. (2020) · American Psychologist · doi:10.1037/amp0000652 · Cited by 152 · see citing works
Digital Technologies for Emotion-Regulation Assessment and Intervention: A Conceptual Review
Bettis, A. H., Burke, T. A., Nesi, J. L., & Liu, R. T. (2021) · Clinical Psychological Science · doi:10.1177/21677026211011982 · Cited by 147 · see citing works
Therapist Expertise in Psychotherapy Revisited
Hill, C. E., Spiegel, S. B., Hoffman, M. A., Kivlighan, D. M., & Gelso, C. J. (2017) · The Counseling Psychologist · doi:10.1177/0011000016641192 · Cited by 144 · see citing works
McLeod, B. D., Sutherland, K. S., Martinez, R. G., Conroy, M. A., Snyder, P. A., & Southam-Gerow, M. A. (2017) · Prevention Science · doi:10.1007/s11121-016-0703-y · Cited by 143 · see citing works
Huibers, M. J. H., Lorenzo‐Luaces, L., Cuijpers, P. J., & Kazantzis, N. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.607508 · Cited by 125 · see citing works
Structuring the Collaboration of Science and Service in Pursuit of a Shared Vision
Chorpita, B. F., & Daleiden, E. L. (2013) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2013.828297 · Cited by 115 · see citing works
Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients
Abry, T., Hulleman, C. S., & Rimm‐Kaufman, S. E. (2014) · American Journal of Evaluation · doi:10.1177/1098214014557009 · Cited by 106 · see citing works
Automated evaluation of psychotherapy skills using speech and language technologies
Flemotomos, N., Martínez, V. R., Chen, Z., Singla, K., Ardulov, V., Peri, R., Caperton, D. D., Gibson, J., Tanana, M., Georgiou, P., et al. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01623-4 · Cited by 104 · see citing works
Imel, Z. E., Pace, B. T., Soma, C. S., Tanana, M., Hirsch, T., Gibson, J., Georgiou, P., Narayanan, S. S., & Atkins, D. C. (2019) · Psychotherapy · doi:10.1037/pst0000221 · Cited by 96 · see citing works
Wagner, A. (1999) · Biology & Philosophy · doi:10.1023/a:1006580900476 · Cited by 91 · see citing works
Metz, A. J. R., Albers, B., Burke, K., Bartley, L., Louison, L., Ward, C. S., & Farley, A. B. (2021) · Human Services Organizations Management Leadership & Governance · doi:10.1080/23303131.2021.1895401 · Cited by 91 · see citing works
Navegando en aguas abiertas: tensiones y agentes en la conservación marina en la Patagonia chilena
Araos, F. (2018) · Revista de Estudios Sociales · doi:10.7440/res64.2018.03 · Cited by 90 · see citing works
Implementation Support Skills: Findings From a Systematic Integrative Review
Albers, B., Metz, A. J. R., Burke, K., Bührmann, L., Bartley, L., Driessen, P., & Varsi, C. (2020) · Research on Social Work Practice · doi:10.1177/1049731520967419 · Cited by 89 · see citing works
What Tends to Be: The Philosophy of Dispositional Modality
Anjum, R. L., & Mumford, S. D. (2018) · Cited by 87 · see citing works
Seide, S., Jensen, K., & Kieser, M. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1397 · Cited by 86 · see citing works
Causal modeling with multi-value and fuzzy-set Coincidence Analysis
Baumgärtner, M., & Ambühl, M. (2018) · Political Science Research and Methods · doi:10.1017/psrm.2018.45 · Cited by 86 · see citing works
Michie, S., Thomas, J., Aonghusa, P. M., West, R., Johnston, M., Kelly, M. P., Shawe-Taylor, J. S., Hastings, J., Bonin, F., & O’Mara-Eves, A. (2020) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15900.1 · Cited by 58 · see citing works
Conroy, M. A., Sutherland, K. S., Algina, J. J., Ladwig, C. N., Werch, B. L., Martínez, J. R., Jessee, G., & Gyure, M. E. (2019) · School Psychology Review · doi:10.17105/spr-2018-0003.v48-1 · Cited by 56 · see citing works
Research strategies to discern active psychological therapy components: A scoping review
Leijten, P., Weisz, J. R., & Gardner, F. (2021) · Clinical Psychological Science · doi:10.1177/2167702620978615 · Cited by 55 · see citing works
Closing the Science–Practice Gap in Implementation Before It Widens
Lyon, A. R., Comtois, K. A., Kerns, S. E. U., Landes, S. J., & Lewis, C. C. (2020) · Springer eBooks · doi:10.1007/978-3-030-03874-8_12 · Cited by 55 · see citing works
Hogue, A., Bobek, M., Dauber, S., Henderson, C. E., McLeod, B. D., & Southam-Gerow, M. A. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2018.1555762 · Cited by 53 · see citing works
Chorpita, B. F., Rotheram-Borus, M. J., Daleiden, E. L., Bernstein, A., Cromley, T., Swendeman, D., & Regan, J. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611418240 · Cited by 49 · see citing works
Helland, S. S., Mellblom, A. V., Kjøbli, J., Wentzel‐Larsen, T., Espenes, K., Engell, T., & Kirkøen, B. (2022) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01213-2 · Cited by 47 · see citing works
Self-citationBarth, R. P., Kolivoski, K. M., Lindsey, M. A., Lee, B. R., & Collins, K. S. (2013) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2013.848771 · Cited by 46 · see citing works
Leveraging Data Science for Global Health
Celi, L. A., Majumder, M. S., Ordóñez, P., Osorio, J. S., Paik, K., & Somai, M. M. (2020) · Springer eBooks · doi:10.1007/978-3-030-47994-7 · Cited by 44 · see citing works
Barth, R. P., Rozeff, L. J., Kerns, S. E. U., & Baldwin, M. J. (2019) · Children and Youth Services Review · doi:10.1016/j.childyouth.2019.104663 · Cited by 39 · see citing works
Coordinated strategic action: Aspiring to wisdom in mental health service systems.
Chorpita, B. F., & Daleiden, E. L. (2018) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12264 · Cited by 31 · see citing works
Murray, L. K., Haroz, E. E., Dorsey, S., Kane, J. C., Bolton, P. A., & Pullmann, M. D. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103430 · Cited by 30 · see citing works
Strategies for Incorporating Culture into Psychosocial Interventions for Youth of Color
Park, A. L., Rith‐Najarian, L., Saifan, D., Gellatly, R., Huey, S. J., & Chorpita, B. F. (2022) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2022.2025629 · Cited by 30 · see citing works
What is the evidence for supervision best practices?
Tugendrajch, S. K., Sheerin, K. M., Andrews, J. H., Reimers, R., Marriott, B. R., Cho, E., & Hawley, K. M. (2021) · The Clinical Supervisor · doi:10.1080/07325223.2021.1887785 · Cited by 30 · see citing works
Machine Learning for Clinical Predictive Analytics
Weng, W. (2020) · Springer eBooks · doi:10.1007/978-3-030-47994-7_12 · Cited by 30 · see citing works
Engell, T., Kirkøen, B., Hammerstrøm, K. T., Kornør, H., Ludvigsen, K. H., & Hagen, K. A. (2020) · Prevention Science · doi:10.1007/s11121-020-01091-w · Cited by 28 · see citing works
Self-citationSaran, A., White, H., Albright, K., & Adona, J. (2020) · Campbell Systematic Reviews · doi:10.1002/cl2.1116 · Cited by 25 · see citing works
Gallo, C. G., Pantin, H. M., Villamar, J. A., Prado, G. J., Tapia, M. I., Ogihara, M., Cruden, G., & Brown, C. H. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0538-4 · Cited by 24 · see citing works
van der Pol, T. M., van Domburgh, L., van Widenfelt, B. M., Hurlburt, M. S., Garland, A. F., & Vermeiren, R. R. J. M. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30085-9 · Cited by 23 · see citing works
Engell, T., Løvstad, A. M., Kirkøen, B., Ogden, T., & Hagen, K. A. (2021) · Children and Youth Services Review · doi:10.1016/j.childyouth.2021.106180 · Cited by 20 · see citing works
Self-citationKvamme, L. S., Keleş, S., Nes, R. B., Vaskinn, L., Waaler, P. M., Wentzel‐Larsen, T., & Kjøbli, J. (2022) · Residential Treatment for Children & Youth · doi:10.1080/0886571x.2022.2111397 · Cited by 19 · see citing works
Okamura, K. H., Orimoto, T. E., Nakamura, B. J., Chang, B., Chorpita, B. F., & Beidas, R. S. (2019) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-019-09659-3 · Cited by 17 · see citing works
Chen, C., Sutherland, K. S., Kunemund, R. L., Sterrett, B. I., Wilkinson, S., Brown, C., & Maggin, D. M. (2020) · Journal of Emotional and Behavioral Disorders · doi:10.1177/1063426620953086 · Cited by 15 · see citing works
Creating a prepared mental health workforce: comparative illustrations of implementation strategies
Chorpita, B. F., Daleiden, E. L., Vera, J. D., & Guan, K. (2020) · Evidence-Based Mental Health · doi:10.1136/ebmental-2020-300203 · Cited by 11 · see citing works
Cashin, A. G., McAuley, J. H., & Lee, H. (2022) · Implementation Research and Practice · doi:10.1177/26334895221105568 · Cited by 11 · see citing works
Stirman, S. W., & Comer, J. S. (2018) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12269 · Cited by 8 · see citing works
Flagged first, then by citations
1 of the 92 references couldn’t be matched to a known paper.
Research works printed but not linked: 5
- Bækken, M. (2021). What seems to be working here? Identifying common elements in brief emotion regulation interventions for children and adolescents–a systematic review (Master’s thesis). University of Oslo, Norway. Retrieved from http://urn.nb.no/URN:NBN:no-90376
- Engell, T. (2021). Co-design and implementation of common elements-based academic support in Norwegian Child Welfare Services. Dissertation. Retrieved from http://urn.nb.no/URN:NBN:no-89115
- Higgins JP Green S Cochrane handbook for systematic reviews of interventions 2011 John Wiley & Sons
- Mellblom, A. V., Helland, S.S., Engell, T., Bergseth, J., Solheim Kvamme, L., Mørk, A. S., Bækken, M., Kjøbli, J. (2023). Common elements in brief interventions on emotion regulation in adolescents: A systematic review and meta-analysis. Submitted for publication 03.01.2023
- Winje, H. N. (2019). Identifisering av felleselementer fra relasjonelle intervensjoner for omsorgssvikt og mishandling (Master’s thesis). Univeristy of Oslo. Retrieved from http://urn.nb.no/URN:NBN:no-73472
Cited by
Sorted by citations
Ashcraft, L. E., Goodrich, D. E., Hero, J., Phares, A., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Implementation Science · doi:10.1186/s13012-024-01369-5 · Cited by 89 · see citing works
Terrana, A., Viglione, C., Rhee, K., Rabin, B., Godino, J., Aarons, G. A., Chapman, J., Melendrez, B., Holguin, M., Osorio, L., et al. (2024) · Frontiers in Health Services · doi:10.3389/frhs.2023.1281690 · Cited by 24 · see citing works
Self-citationSmith, J. L., Ritchie, M. J., Kim, B., Miller, C. J., Chinman, M., Kelly, P. A., Landes, S. J., & Kirchner, J. E. (2024) · Global Implementation Research and Applications · doi:10.1007/s43477-024-00119-5 · Cited by 22 · see citing works
Sagatun, Å., Engell, T., Brekke, M., Sjølie, H., Ekornes, S. M., Waldum-Grevbo, K. S., Pape, K., Kvaløy, K., Jeneson, A., Trøan, A. S., et al. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-10179-2 · Cited by 10 · see citing works
Self-citationGhahramani, S., Larson, S. C., L’Hotta, A. J., Harris, K. M., Lipsey, K. L., Geng, E. H., Juckett, L., & Hoyt, C. R. (2025) · Implementation Science Communications · doi:10.1186/s43058-024-00690-w · Cited by 7 · see citing works
The ART of Readiness: A Practical Tool for Implementation Tailoring at the Activity Level
Scott, V. C., LaMarca, T. K., Hamm, D. W., Tolley, A. J., Rachel, S. A., & Wandersman, A. (2024) · Global Implementation Research and Applications · doi:10.1007/s43477-023-00115-1 · Cited by 5 · see citing works
Oddo, L. E., McLeod, B. D., Sutherland, K. S., Chow, J. C., Ledford, J. R., & Li, G. W. (2025) · Prevention Science · doi:10.1007/s11121-025-01766-2 · Cited by 4 · see citing works
Process and Implementation Elements of Measurement Feedback Systems: A Systematic Review
Rognstad, K., Engell, T., Fjermestad, K. W., Wentzel‐Larsen, T., & Kjøbli, J. (2023) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-023-01325-3 · Cited by 4 · see citing works
Self-citationHaga, S. M., Jacobsen, H., & Engell, T. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12937-w · Cited by 3 · see citing works
Self-citationImplementation Research in Refugee Resettlement: A Rapid Scoping Review
Potocky, M. (2023) · Global Implementation Research and Applications · doi:10.1007/s43477-023-00104-4 · Cited by 3 · see citing works
Smith, S., Paull, S., Iwanowski, K. M., Harris, T., Moullin, J. C., Jane, M., Bill, J., Kerr, D. A., Pollard, C. M., Pearson, G., et al. (2025) · Frontiers in Health Services · doi:10.3389/frhs.2025.1604809 · Cited by 3 · see citing works
Abundo, M. F., & Sav, A. (2025) · Healthcare · doi:10.3390/healthcare13172113 · Cited by 3 · see citing works
Engell, T., Helland, S. S., Vira, E. G., Berg, S., Kvamme, L. S., Kjøbli, J., Bergseth, J., Brenne, I., Nes, R. B., Røysamb, E., et al. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12661-5 · Cited by 3 · see citing works
Self-citationTelerehabilitation of patients with stroke: Initial program theories for successful implementation
Hasan, M. M., Rafferty, M. R., Roth, E. J., Abunaser, S., Smith, J. D., Hirschhorn, L. R., & Woods, D. M. (2025) · PM&R · doi:10.1002/pmrj.13322 · Cited by 2 · see citing works
Proceedings from the Fourth Annual Conference of the Norwegian Network for Implementation Research
Thøgersen, D. M., Rasmussen, L. P., Rømuld, I. W., & Engell, T. (2025) · Global Implementation Research and Applications · doi:10.1007/s43477-025-00147-9 · Cited by 1 · see citing works
Self-citationSavolainen, O., Rouvinen, H., & Barry, M. M. (2026) · Journal of Advanced Nursing · doi:10.1111/jan.70494 · Cited by 1 · see citing works
A novel methodology to develop low‐intensity psychological treatments
Davey, E., Bennett, S. D., Bryant‐Waugh, R., Micali, N., & Shafran, R. (2024) · Mental Health Science · doi:10.1002/mhs2.91 · Cited by 1 · see citing works
Duties and Tasks Associated with Translation: Implications for Implementation
Julian, D. A., Correia, A., Fergus, K., Moser, J., Lepicki, T. L., Johnson, G., Ross, M., Boone, B., Hickey, S., McHugh, B. C., et al. (2025) · Global Implementation Research and Applications · doi:10.1007/s43477-025-00167-5
Ashcraft, L. E., Goodrich, D. E., Hero, J. O., Phares, A. D., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26738325
Ashcraft, L. E., Goodrich, D. E., Hero, J. O., Phares, A. D., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26738319
Ashcraft, L. E., Goodrich, D. E., Hero, J. O., Phares, A. D., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26738313
Sagatun, Å., Engell, T., Brekke, M., Sjølie, H., Ekornes, S. M., Waldum-Grevbo, K. S., Pape, K., Kvaløy, K., Jeneson, A., Trøan, A. S., et al. (2024) · Figshare · doi:10.6084/m9.figshare.24572246
Self-citationAshcraft, L. E., Goodrich, D. E., Hero, J. O., Phares, A. D., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26738304
Ashcraft, L. E., Goodrich, D. E., Hero, J. O., Phares, A. D., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26738322
Ashcraft, L. E., Goodrich, D. E., Hero, J. O., Phares, A. D., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26738310
Ashcraft, L. E., Goodrich, D. E., Hero, J. O., Phares, A. D., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26738316
Sagatun, Å., Engell, T., Brekke, M., Sjølie, H., Ekornes, S. M., Waldum-Grevbo, K. S., Pape, K., Kvaløy, K., Jeneson, A., Trøan, A. S., et al. (2023) · Figshare · doi:10.6084/m9.figshare.24571708
Self-citationAshcraft, L. E., Goodrich, D. E., Hero, J. O., Phares, A. D., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26738307
Bertram, R. M., & Carey, T. A. (2026) · Global Implementation Research and Applications · doi:10.1007/s43477-026-00216-7
PELATIHAN PERAN INFORMASI TEKNOLOGI DALAM PERBAIKAN DAN PENGISIAN MESIN ATM
Chinta, M., Erlina, & Hermawati, A. (2025) · KONEKTIVITAS Jurnal Pengabdian kepada Masyarakat · doi:10.65818/konektivitas.v1i2.226
Driving Support Interventions for Autistic People: Systematic Review and Participatory Synthesis
Arthur, T., Harris, D., Robinson, S., Brosnan, M., Sheppard, E., Vine, S., Buckingham, G., Wilson, M., Ordovás-Montañés, M., Meléndez‐Torres, G. J., et al. (2026) · Autism in Adulthood · doi:10.1177/25739581261434228
Sagatun, Å., Brekke, M., Lisøy, C., Wentzel‐Larsen, T., Waldum-Grevbo, K. S., Holen, S., Askeland, A. L., Sjølie, H., Ekornes, S. M., & Engell, T. (2026) · Research Square · doi:10.21203/rs.3.rs-9198555/v1
Self-citationWhat classroom practices could teachers use to support children with anxiety? A Delphi study
Johnson, C. L., Quach, J., Jorm, A. F., Gregg, K. J., Luke, M. A., Dougall, R., & Hart, L. (2026) · Mental Health & Prevention · doi:10.1016/j.mhp.2026.200513
Johnson, B. J., Morgillo, S., Hunter, S. C., Perimal‐Lewis, L., Middleton, G., Anderson, J. E., Perry, R. A., Eley, S., Nori, A., Wightman, L., et al. (2026) · Health Promotion Journal of Australia · doi:10.1002/hpja.70230
Advancing School Behavioral Health Implementation: A Critical Review Using ISF 2.0
Litvitskiy, N. S., Figas, K., Hall, M. D., Resnick, M., Wandersman, A., & Flaspohler, P. D. (2026) · Behavioral Sciences · doi:10.3390/bs16091663
Anand, P. K., Raika, G. R., Gautam, J., & Bhardwaj, P. (2026) · Clinical Epidemiology and Global Health · doi:10.1016/j.cegh.2026.102488
Leiva, L., Zavala‐Villalón, G., & Sánchez-Vilaró, F. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1895117
- Authors
- Engell, T., Stadnick, N. A., Aarons, G. A., & Barnett, M. L.
- Affiliations
- Center for Child and Adolescent Mental Health, Eastern and Southern Norway (NO)
- University of California San Diego (US)
- University of California, Santa Barbara (US)
- Corresponding author
- Engell, Thomas
- Venue
- Global Implementation Research and Applications
- Published
- 2023-03-22
- Volume
- 3
- Issue
- 1
- Pages
- 1-15
- ISSN
- 2662-9275 (ISSN-L)
- PMC
- PMC10063479
- OpenAlex
- W4353041354
- Cited by
- 37
- References
- 92
- Citations by year
- 2026: 9 · 2025: 9 · 2024: 14 · 2023: 5
- FWCI
- 13.06
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Global Implementation Research and Applications (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Funders
- National Institute of Mental Health and Neurosciences (R03MH117493, P50MH126231, K01MH110608)
- National Institutes of Health (R34 MH120190, R01MD017222, U01MD018308, P50MH126231)
- Borchard Foundation
- Wedel Jarlsberg Fond
- National Institute on Drug Abuse (R01DA049891, R01DA038466)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- common elements, implementation research, intervention research, distillation, implementation context
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review