The stages of implementation completion for evidence-based practice: protocol for a mixed methods study
Open accessAbstract
BACKGROUND: This protocol describes the 'development of outcome measures and suitable methodologies for dissemination and implementation approaches,' a priority for implementation research. Although many evidence-based practices (EBPs) have been developed, large knowledge gaps remain regarding how to routinely move EBPs into usual care. The lack of understanding of 'what it takes' to install EBPs has costly public health consequences, including a lack of availability of the most beneficial services, wasted efforts and resources on failed implementation attempts, and the potential for engendering reluctance to try implementing new EBPs after failed attempts.The Stages of Implementation Completion (SIC) is an eight-stage tool of implementation process and milestones, with stages spanning three implementation phases (pre-implementation, implementation, sustainability). Items delineate the date that a site completes implementation activities, yielding an assessment of duration (time to complete a stage), proportion (of stage activities completed), and a general measure of how far a site moved in the implementation process. METHODS/DESIGN: We propose to extend the SIC to EBPs operating in child service sectors (juvenile justice, schools, substance use, child welfare). Both successful and failed implementation attempts will be scrutinized using a mixed methods design. Stage costs will be measured and examined. Both retrospective data (from previous site implementation efforts) and prospective data (from newly adopting sites) will be analyzed. The influence of pre-implementation on implementation and sustainability outcomes will be examined (Aim 1). Mixed methods procedures will focus on increasing understanding of the process of implementation failure in an effort to determine if the SIC can provide early detection of sites that are unlikely to succeed (Aim 2). Study activities will include cost mapping of SIC stages and an examination of the relationship between implementation costs and implementation performance (Aim 3). DISCUSSION: This project fills a gap in the field of implementation science by addressing the measurement gap between the implementation process and the associated costs. The goal of this project is to provide tools that will help increase the uptake of EBPs, thereby increasing the availability of services to youth and decreasing wasted resources from failed implementation efforts.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A primary outcome for most of these designs can be a composite process and output score based on speed, quality, and quantity.
“a primary outcome for most of these designs can be constructed as a composite process and output score, using dimensions of speed, quality and quantity (11, 25, 101).”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [101]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420 · see citing works
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,470 · see citing works
(1998) · Sage eBooks · Cited by 38,631 · see citing works
Designing and Conducting Mixed Methods Research
Robinson, P. M. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2007.00096.x · Cited by 23,297 · see citing works
(1998) · Cited by 13,501 · see citing works
Designing and Conducting Mixed Methods Research
นิลพันธุ์, ม. (2010) · Silpakorn Educational Research Journal · Cited by 9,350 · see citing works
Focus Groups as Qualitative Research
Morgan, D. (1997) · doi:10.4135/9781412984287 · Cited by 8,863 · see citing works
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · see citing works
Probabilistic Models for Some Intelligence and Attainment Tests
Psychology, M. (1961) · Information and Control · doi:10.1016/s0019-9958(61)80061-2 · Cited by 6,936 · see citing works
The Discovery of Grounded Theory: Strategies for Qualitative Research
Brodsky, C. (1968) · Psychosomatics · doi:10.1016/s0033-3182(68)71872-7 · Cited by 6,727 · see citing works
Bryan, H., Carpenter, C., & Hoult, S. (2010) · SAGE Publications Ltd eBooks · doi:10.4135/9781446251607.n8 · Cited by 4,174 · see citing works
(2005) · Cited by 3,748 · see citing works
Sufficient Sample Sizes for Multilevel Modeling
Maas, C. J. M., & Hox, J. J. (2005) · Methodology · doi:10.1027/1614-2241.1.3.86 · Cited by 3,582 · see citing works
Focus Groups as Qualitative Research
Kawamura, H., & Morgan, D. L. (1998) · Modern Language Journal · doi:10.2307/330238 · Cited by 2,822 · see citing works
Probabilistic Models for some Intelligence and Attainment Tests.
Wolins, L., Wright, B. D., & Rasch, G. (1982) · Journal of the American Statistical Association · doi:10.2307/2287805 · Cited by 2,009 · see citing works
Applying the Rasch Model: Fundamental Measurement in the Human Sciences
Espejo, M. R. (2004) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2004.t01-2-.x · Cited by 2,001 · see citing works
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · see citing works
Treating anxiety disorders in children: Results of a randomized clinical trial.
Kendall, P. C. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.1.100 · Cited by 1,376 · see citing works
Krueger, R. A. (1998) · Sage eBooks · doi:10.4135/9781483328133 · Cited by 732 · see citing works
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0148-5 · Cited by 608 · see citing works
Full-Information Item Bi-Factor Analysis
Gibbons, R. D., & Hedeker, D. (1992) · Psychometrika · doi:10.1007/bf02295430 · Cited by 599 · see citing works
Multisystemic therapy for antisocial behavior in children and adolescents
Henggeler, S. W. (2009) · Cited by 533 · see citing works
Blueprints for Violence Prevention
Mihalic, S. W., Irwin, K., Elliott, D. S., Fagan, A. A., & Hansen, D. C. (2001) · PsycEXTRA Dataset · doi:10.1037/e304162003-001 · Cited by 498 · see citing works
Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010) · School Mental Health · doi:10.1007/s12310-010-9038-1 · Cited by 477 · see citing works
Implementation of Evidence-based Practice in Child Welfare: Service Provider Perspectives
Aarons, G. A., & Palinkas, L. A. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0121-3 · Cited by 450 · see citing works
Toward the Effective and Efficient Measurement of Implementation Fidelity
Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam‐Gerow, M. A. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0321-0 · Cited by 422 · see citing works
Gilchrist, V. J. (1992) · Cited by 336 · see citing works
A systematic approach for using qualitative methods in primary prevention research
Willms, D. G., Best, J. A., Taylor, D. W., Gilbert, J. R., Wilson, D. M. C., Lindsay, E. A., & Singer, J. (1990) · Medical Anthropology Quarterly · doi:10.1525/maq.1990.4.4.02a00020 · Cited by 310 · see citing works
DESIGNING AND CONDUCTING MIXED METHODS RESEARCH (2nd Edition)
ภู่พันธ์, ศ. (2015) · วารสารวิธีวิทยาการวิจัย (Journal of Research Methodology: JRM) · Cited by 302 · see citing works
Chamberlain, P., Brown, C. H., & Saldana, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-116 · Cited by 262 · see citing works
Self-citationMixed-Methods Designs in Mental Health Services Research: A Review
Palinkas, L. A., Horwitz, S. M., Chamberlain, P., Hurlburt, M. S., & Landsverk, J. A. (2011) · Psychiatric Services · doi:10.1176/ps.62.3.pss6203_0255 · Cited by 195 · see citing works
Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2013.10.006 · Cited by 175 · see citing works
Self-citationWright, B. D., & Mok, M. M. C. (2000) · PubMed · Cited by 161 · see citing works
Predicting program start-up using the stages of implementation measure
Saldana, L., Chamberlain, P., Wang, W., & Hendricks Brown, C. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0363-y · Cited by 148 · see citing works
Self-citationCosting behavioral interventions: a practical guide to enhance translation
Ritzwoller, D. P., Sukhanova, A., Gaglio, B., & Glasgow, R. E. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9088-5 · Cited by 130 · see citing works
Blueprints for Violence Prevention
Mihalic, S. W., Fagan, A. A., Irwin, K., Ballard, D., & Elliott, D. S. (2004) · PsycEXTRA Dataset · doi:10.1037/e302992005-001 · Cited by 108 · see citing works
Chamberlain, P. (2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195134575.003.0006 · Cited by 83 · see citing works
What's Next for Translation Research?
Ginexi, E. M., & Hilton, T. F. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278706290409 · Cited by 76 · see citing works
Measuring organizational readiness for knowledge translation in chronic care
Gagnon, M., Labarthe, J., Légaré, F., Ouimet, M., Estabrooks, C. A., Roch, G., Ghandour, E. K., & Grimshaw, J. (2011) · Implementation Science · doi:10.1186/1748-5908-6-72 · Cited by 60 · see citing works
Equating and item banking with the Rasch model.
Wolfe, E. W. (2000) · PubMed · Cited by 51 · see citing works
Wang, W., Saldana, L., Brown, C. H., & Chamberlain, P. (2010) · Implementation Science · doi:10.1186/1748-5908-5-72 · Cited by 43 · see citing works
Self-citationThe Eye of the Beholder: Youths and Parents Differ on What Matters in Mental Health Services
Aarons, G. A., Covert, J., Skriner, L. C., Green, A. C., Marto, D., Garland, A. F., & Landsverk, J. A. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0276-1 · Cited by 41 · see citing works
Kolb, B. M. (2018) · Routledge eBooks · doi:10.4324/9781315173900-7 · Cited by 40 · see citing works
Palinkas, L. A., & Aarons, G. A. (2009) · International journal of child health and human development · Cited by 40 · see citing works
Methodological Issues in Child Welfare and Children’s Mental Health Implementation Research
Horwitz, S. M., & Landsverk, J. A. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0316-x · Cited by 14 · see citing works
Glisson, C. A., Landsverk, J. A., Schoenwald, S. K., Kelleher, K. J., Hoagwood, K., Mayberg, S. W., & Green, P. W. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · Cited by 9 · see citing works
Flagged first, then by citations
2 of the 49 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Proctor EK Landsverk J Challenges of Translating Evidence-Based Treatments into Practice Contexts and Service Sectors. Presentation 2005 Washington, DC: Mental Health Services Research Conference
- Liddle HA Multidimensional Family Therapy Treatment (MDFT) for Adolescent Cannabis Users: Vol. 5 Cannabis Youth Treatment (CYT) Manual Series 2002 Rockville, MD: Center for Substance Abuse Treatment, Substance Abuse and Mental Health Services Administration
- Linacre JM Sample size and item calibrations stability Rasch Measurement Transactions 1994 7 328
Cited by
Sorted by citations
An Overview of Research and Evaluation Designs for Dissemination and Implementation
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., Collins, L. M., Duan, N., Mittman, B. S., Wallace, A., et al. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044215 · Cited by 509 · see citing works
Standards for Reporting Implementation Studies (StaRI): explanation and elaboration document
Pinnock, H., Barwick, M. A., Carpenter, C. R., Eldridge, S. M., Grandes, G., Griffiths, C., Rycroft‐Malone, J., Meißner, P., Murray, E., Patel, A. K., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013318 · Cited by 342 · see citing works
Tracking implementation strategies: a description of a practical approach and early findings
Bunger, A. C., Powell, B. J., Robertson, H. A., MacDowell, H., Birken, S. A., & Shea, C. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0175-y · Cited by 208 · see citing works
Aarons, G. A., Ehrhart, M. G., Moullin, J. C., Torres, E. M., & Green, A. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0562-3 · Cited by 159 · see citing works
Al‐Ubaydli, O., List, J. A., & Suskind, D. L. (2017) · American Economic Review · doi:10.1257/aer.p20171115 · Cited by 156 · see citing works
Shelton, R. C., Lee, M., Brotzman, L., Wolfenden, L., Nathan, N., & Wainberg, M. L. (2020) · International Journal of Behavioral Medicine · doi:10.1007/s12529-020-09848-x · Cited by 143 · see citing works
Brown, C. H., Chamberlain, P., Saldana, L., Padgett, C., Wang, W., & Cruden, G. (2014) · Implementation Science · doi:10.1186/s13012-014-0134-8 · Cited by 89 · see citing works
Self-citationSix practical recommendations for improved implementation outcomes reporting
Lengnick-Hall, R., Gerke, D. R., Proctor, E. K., Bunger, A. C., Phillips, R. J., Martin, J. K., & Swanson, J. C. (2022) · Implementation Science · doi:10.1186/s13012-021-01183-3 · Cited by 86 · see citing works
Alley, Z. M., Chapman, J. E., Schaper, H., & Saldana, L. (2023) · Implementation Science · doi:10.1186/s13012-023-01285-0 · Cited by 86 · see citing works
Self-citationHall, A., Shoesmith, A., Doherty, E., McEvoy, B., Mettert, K., Lewis, C. C., Wolfenden, L., Yoong, S., Kingsland, M., Shelton, R. C., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01252-1 · Cited by 81 · see citing works
Hoagwood, K., Purtle, J., Spandorfer, J., Peth-Pierce, R., & Horwitz, S. M. (2020) · American Psychologist · doi:10.1037/amp0000706 · Cited by 81 · see citing works
Saldana, L., Ritzwoller, D. P., Campbell, M. R., & Block, E. P. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00295-1 · Cited by 79 · see citing works
Self-citationGhate, D. (2015) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2015.1077449 · Cited by 77 · see citing works
Kim, J. S., Gu, M. O., & Chang, H. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1501-6 · Cited by 73 · see citing works
Nadeem, E., Saldana, L., Chapman, J. E., & Schaper, H. (2017) · Behavior Therapy · doi:10.1016/j.beth.2017.12.004 · Cited by 66 · see citing works
Self-citationPowell, B. J., Patel, S. V., Haley, A. D., Haines, E. R., Knocke, K., Chandler, S., Katz, C. C., Seifert, H. T. P., Ake, G. S., Amaya-Jackson, L. M., et al. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-01003-3 · Cited by 63 · see citing works
Bowser, D. M., Henry, B. F., & McCollister, K. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01094-3 · Cited by 61 · see citing works
Edwards, J., Coward, M., & Carey, N. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-052227 · Cited by 61 · see citing works
Moullin, J. C., Ehrhart, M. G., & Aarons, G. A. (2018) · Implementation Science · doi:10.1186/s13012-018-0782-1 · Cited by 50 · see citing works
Powell, B. J., Haley, A. D., Patel, S. V., Amaya-Jackson, L. M., Glienke, B., Blythe, M., Lengnick‐Hall, R., McCrary, S., Beidas, R. S., Lewis, C. C., et al. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00009-5 · Cited by 50 · see citing works
Self-citationEisman, A. B., Hutton, D. W., Prosser, L. A., Smith, S. N., & Kilbourne, A. M. (2020) · Implementation Science · doi:10.1186/s13012-020-01069-w · Cited by 50 · see citing works
Øvretveit, J., Mittman, B. S., Rubenstein, L. V., & Ganz, D. A. (2017) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa-01-2017-0019 · Cited by 46 · see citing works
Nevedal, A. L., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B., Gifford, A. L., Orvek, E., DeLaughter, K., White, L., King, H. A., et al. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00053-1 · Cited by 44 · see citing works
Conceptualizing and measuring sustainability of prevention programs, policies, and practices
Palinkas, L. A., Spear, S. E., Mendon, S. J., Villamar, J., Reynolds, C., Green, C. D., Olson, C., Adade, A., & Brown, C. H. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz170 · Cited by 66 · see citing works
Saldana, L., Bennett, I. M., Powers, D., Vredevoogd, M., Grover, T., Schaper, H., & Campbell, M. R. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00944-z · Cited by 42 · see citing works
Self-citationMeasuring Costs to Community-Based Agencies for Implementation of an Evidence-Based Practice
Lang, J. M., & Connell, C. M. (2017) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-016-9541-8 · Cited by 41 · see citing works
Derman, R. J., & Jaeger, F. J. (2018) · Reproductive Health · doi:10.1186/s12978-018-0538-z · Cited by 41 · see citing works
Rates of sustainment in the Universal Stages of Implementation Completion
Wong, D. R., Schaper, H., & Saldana, L. (2022) · Implementation Science Communications · doi:10.1186/s43058-021-00250-6 · Cited by 40 · see citing works
Self-citationSalloum, R. G., D’Angelo, H., Theis, R. P., Rolland, B., Hohl, S. D., Pauk, D., LeLaurin, J. H., Asvat, Y., Chen, L., Day, A. T., et al. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00144-7 · Cited by 38 · see citing works
Ma, S., Lawpoolsri, S., Soonthornworasiri, N., Khamsiriwatchara, A., Jandee, K., Taweeseneepitch, K., Pawarana, R., Jaiklaew, S., Kijsanayotin, B., & Kaewkungwal, J. (2016) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.5347 · Cited by 32 · see citing works
Locke, J. J., Wolk, C. B., Harker, C. M., Olsen, A., Shingledecker, T., Barg, F. K., Mandell, D. S., & Beidas, R. S. (2016) · Autism · doi:10.1177/1362361316664474 · Cited by 35 · see citing works
Hoeft, T. J., Wilcox, H., Hinton, L., & Unützer, J. (2019) · Implementation Science · doi:10.1186/s13012-019-0882-6 · Cited by 34 · see citing works
Lamming, L., Montague, J., Crosswaite, K., Faisal, M., McDonach, E., Mohammed, M. A., Cracknell, A. L., Lovatt, A., & Slater, B. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-07080-1 · Cited by 33 · see citing works
Malhotra, A., Thompson, R. R., Kagoya, F., Masiye, F., Mbewe, P., Mosepele, M., Phiri, J., Sambo, J., Barker, A. R., Cameron, D., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01248-x · Cited by 33 · see citing works
Implementing Teledermatology for Rural Veterans: An Evaluation Using the RE-AIM Framework
Peracca, S. B., Jackson, G. L., Lamkin, R. P., Mohr, D. C., Zhao, M., Lachica, O., Prentice, J. C., Grenga, A. M., Gifford, A. L., Chapman, J. G., et al. (2020) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2020.0013 · Cited by 32 · see citing works
Donenberg, G. R., Cohen, M. H., Ingabire, C., Fabri, M. R., Emerson, E. M., Kendall, A. D., Remera, E., Manzi, O., & Nsanzimana, S. (2019) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000002204 · Cited by 31 · see citing works
Implementation and evaluation of linked parenting models in a large urban child welfare system
Chamberlain, P., Feldman, S. W., Wulczyn, F., Saldana, L., & Forgatch, M. S. (2015) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.09.013 · Cited by 30 · see citing works
Self-citationThe implementation of a team training intervention for school mental health: Lessons learned.
Wolk, C. B., Stewart, R. E., Eiraldi, R. B., Cronholm, P. F., Salas, E., & Mandell, D. S. (2018) · Psychotherapy · doi:10.1037/pst0000179 · Cited by 30 · see citing works
Westgard, C. M., & Fleming, W. O. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00411 · Cited by 27 · see citing works
Nevedal, A., Widerquist, M. A. O., Reardon, C. M., Arasim, M. E., Jackson, G. L., White, B. S., Burns, M., Fix, G. M., DeLaughter, K. L., Cutrona, S. L., et al. (2024) · Implementation Science · doi:10.1186/s13012-024-01361-z · Cited by 25 · see citing works
Palinkas, L. A., Campbell, M. R., & Saldana, L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00161 · Cited by 25 · see citing works
Self-citationAustralian midwives' experiences of implementing practice change
Bayes, S. J., Juggins, E., Whitehead, L., & Leo, A. D. (2018) · Midwifery · doi:10.1016/j.midw.2018.12.012 · Cited by 25 · see citing works
Implementation of Teledermatology: Theory and Practice
Peracca, S. B., Jackson, G. L., Weinstock, M. A., & Oh, D. H. (2019) · Current Dermatology Reports · doi:10.1007/s13671-019-0252-2 · Cited by 22 · see citing works
Sigmarsdóttir, M., Forgatch, M. S., Guðmundsdóttir, E. V., Thorlacius, Ö., Svendsen, G. T., Tjaden, J., & Gewirtz, A. H. (2018) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2018.1466305 · Cited by 22 · see citing works
Spoelstra, S. L., Schueller, M., & Sikorskii, A. (2019) · Implementation Science · doi:10.1186/s13012-019-0907-1 · Cited by 21 · see citing works
Aalsma, M. C., Dir, A. L., Zapolski, T. C. B., Hulvershorn, L. A., Monahan, P. O., Saldana, L., & Adams, Z. W. (2019) · Addiction Science & Clinical Practice · doi:10.1186/s13722-019-0161-5 · Cited by 21 · see citing works
Self-citationSimione, M., Frost, H. M., Cournoyer, R. N., Mini, F. N., Cassidy, J., Craddock, C., Moreland, J., Wallace, J., Metlay, J. P., Kistin, C. J., et al. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00047-z · Cited by 20 · see citing works
Harper, K. D., Loper, A. C., Louison, L., & Morse, J. E. (2019) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2019.11.1273 · Cited by 19 · see citing works
Automatic classification of communication logs into implementation stages via text analysis
Wang, D., Ogihara, M., Gallo, C., Villamar, J. A., Smith, J. D., Vermeer, W., Cruden, G., Benbow, N., & Brown, C. H. (2015) · Implementation Science · doi:10.1186/s13012-016-0483-6 · Cited by 17 · see citing works
Locke, J. J., Hassrick, E. M., Stahmer, A. C., Iadarola, S., Boyd, B. A., Mandell, D. S., Shih, W., Hund, L. M., Kasari, C. L., & AIR-B Network (2022) · BMC Psychiatry · doi:10.1186/s12888-022-04105-9 · Cited by 17 · see citing works
Aalsma, M. C., Aarons, G. A., Adams, Z. W., Alton, M., Boustani, M. A., Dir, A. L., Embí, P. J., Grannis, S. J., Hulvershorn, L. A., Huntsinger, D., et al. (2021) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2021.108368 · Cited by 17 · see citing works
Self-citationGarneau, H. C., Assefa, M. T., Jo, B., Ford, J. H., Saldana, L., & McGovern, M. P. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000293 · Cited by 16 · see citing works
Self-citationEn Route to Implementation Science 3.0
Albers, B., Shlonsky, A., & Mildon, R. L. (2020) · Springer eBooks · doi:10.1007/978-3-030-03874-8_1 · Cited by 15 · see citing works
Ford, J. H., Cheng, H. L., Gassman, M., Fontaine, H., Garneau, H. C., Keith, R., Michael, E., & McGovern, M. P. (2022) · Implementation Science · doi:10.1186/s13012-022-01239-y · Cited by 14 · see citing works
Beyond Effectiveness: Implementation Science 101 for Clinicians and Clinical Researchers
Ramly, E., & Brown, H. W. (2023) · Urogynecology · doi:10.1097/spv.0000000000001322 · Cited by 14 · see citing works
Donovan, T., Abell, B., McPhail, S., & Carter, H. E. (2025) · Implementation Science · doi:10.1186/s13012-025-01423-w · Cited by 14 · see citing works
Pho, M. T., Erzouki, F., Boodram, B., Jimenez, A. D., Piñeros, J., Shuman, V., Claypool, E., Bouris, A. M., Gastala, N., Reichert, J., et al. (2021) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2021.108348 · Cited by 14 · see citing works
Ford, J. H., Kaur, A., Rao, D., Gilson, A. M., Bolt, D. M., Garneau, H. C., Saldana, L., & McGovern, M. P. (2021) · Implementation Research and Practice · doi:10.1177/26334895211033659 · Cited by 13 · see citing works
Self-citationHyzak, K. A., Bunger, A. C., Herrmann, S. A., Kerlek, A. J., Lauden, S. M., Dudley, S., Underwood, A. L., & Berlan, E. D. (2023) · Global Implementation Research and Applications · doi:10.1007/s43477-023-00082-7 · Cited by 13 · see citing works
Bonakdeh, E. S., Sohal, A. S., Rajabkhah, K., Prajogo, D. I., Melder, A., Nguyen, D. Q., Bingham, G., & Tong, E. (2024) · Industrial Management & Data Systems · doi:10.1108/imds-08-2022-0484 · Cited by 13 · see citing works
Byhoff, E., Marchis, E. H. D., Gottlieb, L. M., Halperin-Goldstein, S., Nokes, K., & LeClair, A. M. (2020) · Journal of Immigrant and Minority Health · doi:10.1007/s10903-020-01005-6 · Cited by 13 · see citing works
Watson, D. P., Snow‐Hill, N. L., Saldana, L., Walden, A. L., Staton, M. D., Kong, A., & Donenberg, G. R. (2020) · Implementation Research and Practice · doi:10.1177/2633489520974974 · Cited by 13 · see citing works
Self-citationSöling, S., Pfaff, H., Karbach, U., Ansmann, L., Köberlein–Neu, J., AdAM-Study Group, Kellermann-Mühlhoff, P., Düvel, L., Beckmann, T., Hammerschmidt, R., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08434-z · Cited by 12 · see citing works
Moore, S. A., Cooper, J. M., Malloy, J. M., & Lyon, A. R. (2023) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-023-01320-8 · Cited by 13 · see citing works
Hendrawensi, Hidayati, A., Yeni, F., & Zurwina (2024) · Jurnal Penelitian Pendidikan IPA · doi:10.29303/jppipa.v10i6.6796 · Cited by 12 · see citing works
Elkington, K. S., Nunes, E. V., Schachar, A., Ryan, M. E., García, A., DeVelde, K. V., Reilly, D. M., O’Grady, M. A., Williams, A. R., Tross, S., et al. (2021) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2021.108277 · Cited by 12 · see citing works
Matson, T. E., Hermes, E. D. A., Lyon, A. R., Quanbeck, A., Schueller, S. M., Wilson, S. M., & Glass, J. E. (2025) · Annals of Epidemiology · doi:10.1016/j.annepidem.2025.02.007 · Cited by 11 · see citing works
Kearney, C. A., Fensken, M., & Dupont, R. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1553528 · Cited by 11 · see citing works
Yuliyanti, S., Utarini, A., & Trisnantoro, L. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05769-3 · Cited by 11 · see citing works
Reardon, C. M., Damschroder, L. J., Widerquist, M. A. O., Arasim, M. E., Jackson, G. L., White, B. S., Cutrona, S. L., Fix, G. M., Gifford, A. L., DeLaughter, K. L., et al. (2023) · Implementation Science Communications · doi:10.1186/s43058-022-00386-z · Cited by 11 · see citing works
Jaramillo, E. T., Willging, C. E., Saldana, L., Self‐Brown, S., Weeks, E. A., & Whitaker, D. J. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-09079-2 · Cited by 11 · see citing works
Self-citationThe Multiphase Optimization Strategy (MOST) in Child Maltreatment Prevention Research
Guastaferro, K., Strayhorn, J. C., & Collins, L. M. (2021) · Journal of Child and Family Studies · doi:10.1007/s10826-021-02062-7 · Cited by 10 · see citing works
Hamilton, A. B., Finley, E. P., Bean‐Mayberry, B., Lang, A. J., Haskell, S. G., Moin, T., Farmer, M. M., & the EMPOWER QUERI Team (2023) · Implementation Science Communications · doi:10.1186/s43058-022-00389-w · Cited by 10 · see citing works
Frank, H. E., Saldana, L., Kendall, P. C., Schaper, H., & Norris, L. A. (2021) · Child & Youth Services · doi:10.1080/0145935x.2021.1894920 · Cited by 10 · see citing works
Self-citationSupporting Evidence-Based Practices: What Implementation Activities Are Needed When for Success?
Ward, C. S., Kittelman, A., & Rowe, D. A. (2021) · Teaching Exceptional Children · doi:10.1177/00400599211010176 · Cited by 10 · see citing works
Spoelstra, S., Schueller, M., Basso, V., & Sikorskii, A. E. (2022) · Implementation Science · doi:10.1186/s13012-022-01232-5 · Cited by 10 · see citing works
Massey, O. T., Vroom, E. B., & Weston, A. (2021) · School Mental Health · doi:10.1007/s12310-020-09407-5 · Cited by 10 · see citing works
Caton, L., Shen, H., Miele, G. M., Darfler, K., Sandoval, J. R., Urada, D. I., & McGovern, M. P. (2021) · Implementation Research and Practice · doi:10.1177/26334895211005809 · Cited by 9 · see citing works
Goodarzi, H., Teymourzadeh, E., Rahimi, S., & Nasiri, T. (2021) · BMC Research Notes · doi:10.1186/s13104-021-05732-3 · Cited by 8 · see citing works
Implementation of Direct-to-Patient Mobile Teledermatology in VA
Peracca, S. B., Lachica, O., Lamkin, R. P., Jackson, G. L., Mohr, D. C., King, H. A., Whited, J. D., Fonseca, A. S., Morris, I. J., Gifford, A. L., et al. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-023-08480-1 · Cited by 8 · see citing works
Donovan, T., Carter, H. E., McPhail, S., & Abell, B. (2024) · Implementation Science Communications · doi:10.1186/s43058-024-00648-y · Cited by 8 · see citing works
Wingood, M., Gell, N., Vincenzo, J. L., & Peters, D. M. (2022) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2022.2100849 · Cited by 8 · see citing works
McLeman, B. M., Gauthier, P. R., Lester, L. S., Homsted, F. A. E., Gardner, V. T., Moore, S. K., Joudrey, P. J., Saldana, L., Cochran, G., Harris, J. P., et al. (2024) · Addiction Science & Clinical Practice · doi:10.1186/s13722-024-00452-y · Cited by 7 · see citing works
Self-citationSelove, R., Neil‐Sztramko, S., Leng, J. C. F., Walker, P. D., Salloum, R. G., Ginossar, T., Heckman, C. J., Scheuermann, T. S., Combs, T., Qualls-Hampton, R. Y., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038617 · Cited by 7 · see citing works
Translational Formative Evaluation before Scale-up of a Physical Activity Intervention for Older Men
McKay, H. A., Mackey, D. C., Gray, S. M., Hoy, C. L., Ahn, R., Perkins, A., Bauman, A. E., & Sims‐Gould, J. (2019) · Translational Journal of the American College of Sports Medicine · doi:10.1249/tjx.0000000000000090 · Cited by 7 · see citing works
A pragmatic approach to estimating the cost to deliver and participate in implementation strategies
Cheng, H. L., Magid, M. A., McGovern, M. P., Ford, J. H., Manja, V., Garneau, H. C., & Wagner, T. H. (2025) · Implementation Science · doi:10.1186/s13012-025-01459-y · Cited by 6 · see citing works
Tandon, U., & Ertz, M. (2025) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2025.104543 · Cited by 6 · see citing works
Snow‐Hill, N. L., Donenberg, G. R., Feil, E. G., Smith, D. R., Floyd, B., & Leve, C. S. (2021) · JMIR Formative Research · doi:10.2196/31185 · Cited by 6 · see citing works
Implementation Science: Translating Research into Practice for Sustained Impact
Aarons, G. A., Sklar, M., & Sevdalis, N. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_18 · Cited by 6 · see citing works
The Role of Implementation Science in Behavioral Health
Massey, O. T., & Vroom, E. B. (2019) · Springer eBooks · doi:10.1007/978-3-030-18435-3_5 · Cited by 6 · see citing works
Special Issue Overview: Optimizing Mixed Methods for Implementation Research in Large Systems
Hoagwood, K., Olin, S.-C. S., & Horwitz, S. M. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0616-7 · Cited by 6 · see citing works
Optimized segmented regression models for the transition period of intervention effects
Zhang, X., Wu, K., Pan, Y., Yin, R. H., Zhang, Y., Kong, D., Wang, Q., & Chen, W. L. (2023) · Global Health Research and Policy · doi:10.1186/s41256-023-00312-3 · Cited by 5 · see citing works
McGinty, E. E., Thompson, D., Murphy, K. A., Stuart, E. A., Wang, N., Dalcin, A., Mace, E., Gennusa, J. V., & Daumit, G. L. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00129-6 · Cited by 5 · see citing works
Evaluating the Implementation of the Connect for Health Pediatric Weight Management Program
Simione, M., Frost, H. M., Farrar-Muir, H., Luo, M., Granadeño, J., Torres, C. G., Boudreau, A. A., Moreland, J., Wallace, J., Young, J., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.52648 · Cited by 5 · see citing works
Meyers, K. A., Lane, B., Zucker, J. E., Wu, Y., Carnevale, C., Burnside, H., Rowan, S. E., Mayes, E., Narcisse, G., Gold, M. A., et al. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12670-4 · Cited by 5 · see citing works
Self-citationWolk, C. B., & Beidas, R. S. (2018) · Behavior Therapy · doi:10.1016/j.beth.2018.03.004 · Cited by 5 · see citing works
Finley, E. P., Hamilton, A. B., Canelo, I. A., Jackson, L., Lesser, R., Oberman, R. S., Yosef, J., Chrystal, J. G., Fletcher, E. H., Bean‐Mayberry, B., et al. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12871-x · Cited by 4 · see citing works
Naar, S., Fernandez, M. I., Todd, L., Green, S. K. S., Henna Budhwani, P., Carcone, A. I., Coyle, K. K., Aarons, G. A., MacDonell, K. K., & Harper, G. W. (2023) · Implementation Research and Practice · doi:10.1177/26334895231164585 · Cited by 4 · see citing works
How hospitals select their patient safety priorities
George, J., Parker, V. A., Sullivan, J. L., Greenan, M. A., Chan, J., Shin, M. H., Chen, Q., Shwartz, M., & Rosen, A. K. (2019) · Health Care Management Review · doi:10.1097/hmr.0000000000000260 · Cited by 4 · see citing works
Eisman, A. B., Palinkas, L. A., Koffkey, C., Herrenkohl, T. I., Abbasi, U., Fridline, J., Lundahl, L. H., & Kilbourne, A. M. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01145-6 · Cited by 4 · see citing works
- Authors
- Saldana, L.
- Affiliations
- Oregon Social Learning Center (US)
- Corresponding author
- Saldana, Lisa
- ORCID
- Saldana, Lisa
- Venue
- Implementation Science
- Published
- 2014-04-05
- Volume
- 9
- Issue
- 1
- Pages
- 43-43
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC4234147
- OpenAlex
- W2135938538
- Cited by
- 188
- References
- 49
- Citations by year
- 2026: 11 · 2025: 21 · 2024: 30 · 2023: 18 · 2022: 19 · 2021: 25 · 2020: 22 · 2019: 15 · 2018: 8 · 2017: 9 · 2016: 4 · 2015: 4 · 2014: 2
- FWCI
- 11.44
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (MH080916, R01MH097748, R25MH080916)
- National Institute on Drug Abuse (P50DA035763)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- evidence-based practice, implementation process, implementation costs, implementation failure, sustainability, pre-implementation, child and youth services, juvenile justice, child welfare, schools, substance use services, cost mapping
- MeSH terms
- Child, Child Welfare, Humans, Outcome and Process Assessment, Health Care, Prospective Studies, Retrospective Studies, Program Development, Evidence-Based Practice, Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review