CoChat
Sign Up
Cited by 230Health Policy Implementation ScienceHealth Sciences Research and EducationClinical practice guidelines implementation

Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem

Open access
Beidas, Rinad S., Dorsey, Shannon, Lewis, Cara C., Lyon, Aaron R., Powell, Byron J., Purtle, Jonathan, Saldana, Lisa, Shelton, Rachel C. +2 more·2022·Implementation Science
DOI 10.1186/s13012-022-01226-3PMC PMC9375077
Open this paper in CoChat — free accountOpen PDF

Abstract

Background: Implementation science is at a sufficiently advanced stage that it is appropriate for the field to reflect on progress thus far in achieving its vision, with a goal of charting a path forward. In this debate, we offer such reflections and report on potential threats that might stymie progress, as well as opportunities to enhance the success and impact of the field, from the perspective of a group of US-based researchers. Main body: Ten mid-career extramurally funded US-based researchers completed a “pre-mortem” or a group brainstorming exercise that leverages prospective hindsight to imagine that an event has already occurred and to generate an explanation for it — to reduce the likelihood of a poor outcome. We came to consensus on six key themes related to threats and opportunities for the field: (1) insufficient impact, (2) too much emphasis on being a “legitimate science,” (3) re-creation of the evidence-to-practice gap, (4) difficulty balancing accessibility and field coherence, (5) inability to align timelines and priorities with partners, and (6) overly complex implementation strategies and approaches. Conclusion: We submit this debate piece to generate further discussion with other implementation partners as our field continues to develop and evolve. We hope the key opportunities identified will enhance the future of implementation research in the USA and spark discussion across international groups. We will continue to learn with humility about how best to implement with the goal of achieving equitable population health impact at scale.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13012-022-01226-3

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The field has yet to empirically demonstrate the value of implementation science for improving health and healthcare quality.

    “This finding echoes recent reflections on the promises and pitfalls of implementation science [54] and suggests that our field has yet to empirically demonstrate the value of implementation science for improving health and healthcare quality.”

    From Ten years of implementation outcomes research: a scoping review (2023) · cites this paper as [54]

    In Theme 1 (page not provided), the paper says the literature has only a few examples of broad impact and calls for more empirical evidence linking implementation outcomes to health outcomes. That supports the concern about insufficient demonstration of value, but “has yet to empirically demonstrate” overstates the paper’s position by implying there are no examples. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • Implementation theory often assumes the availability of adequate resources such as finances, which may not be the case in child protection, where funding is often constrained.

    “It often assumes the availability of adequate resources such finances, which may not be the case in child protection, where funding is often constrained.”

    From Financial Resource Availability and Implementation of Child Protection and Safeguarding Programs in Kwale County, Kenya (2024) · cites this paper as Beidas et al., 2022

    Theme 3 says implementation strategies designed for maximal theoretical effect can lack affordability, and Theme 5 says some care settings are chronically underfunded and under-resourced. The paper does not say that implementation theory generally assumes adequate finances or identify child protection as a funding-constrained setting. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 127 · Cited by 230

Research works printed but not linked: 106

  1. [1]Estabrooks PA Brownson RC Pronk NP Dissemination and implementation science for public health professionals: an overview and call to action Prev Chronic Dis 2018 15 E162 10.5888/pcd15.180525 30576272 PMC6307829 · DOI
  2. [2]Braveman P What are health disparities and health equity? We need to be clear Public Health Rep 2014 129 Suppl 2 Suppl 2 5 8 10.1177/00333549141291S203 24385658 PMC3863701 · DOI · Paper page
  3. [3]Damschroder LJ Knighton AJ Griese E Greene SM Lozano P Kilbourne AM Recommendations for strengthening the role of embedded researchers to accelerate implementation in health systems: findings from a state-of-the-art (SOTA) conference workgroup Healthc (Amst) 2021 8 Suppl 1 Suppl 1 100455 10.1016/j.hjdsi.2020.100455 34175093 PMC8243415 · DOI
  4. [4]Wensing M Grol R Knowledge translation in health: how implementation science could contribute more BMC Med 2019 17 1 88 10.1186/s12916-019-1322-9 31064388 PMC6505277 · DOI
  5. [5]Rapport F, Smith J, Hutchinson K, Clay-Williams R, Churruca K, Bierbaum M, et al. Too much theory and not enough practice? The challenge of implementation science application in healthcare practice. J Eval Clin Pract. 2021. 10.1111/jep.13600. 34268832 · DOI
  6. [6]Grimshaw JM Ivers N Linklater S Foy R Francis JJ Gude WT Reinvigorating stagnant science: implementation laboratories and a meta-laboratory to efficiently advance the science of audit and feedback BMJ Qual Saf 2019 28 5 416 423 10.1136/bmjqs-2018-008355 30852557 PMC6559780 · DOI
  7. [7]Wensing M Sales A Armstrong R Wilson P Implementation science in times of Covid-19 Implement Sci 2020 15 1 42 10.1186/s13012-020-01006-x 32513292 PMC7276954 · DOI
  8. [8]Stange KC Commentary: RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review Front Public Health 2020 8 245 10.3389/fpubh.2020.00245 32719761 PMC7347750 · DOI
  9. [9]Boulton R Sandall J Sevdalis N The cultural politics of ‘Implementation Science’ J Med Humanit 2020 41 3 379 394 10.1007/s10912-020-09607-9 31965463 PMC7343725 · DOI
  10. [10]Mitchell DJ Edward Russo J Pennington N Back to the future: temporal perspective in the explanation of events J Behav Decis Mak 1989 2 1 25 38 10.1002/bdm.3960020103 · DOI
  11. [12]Luke DA Sarli CC Suiter AM Carothers BJ Combs TB Allen JL The translational science benefits model: a new framework for assessing the health and societal benefits of clinical and translational sciences Clin Transl Sci 2018 11 1 77 84 10.1111/cts.12495 28887873 PMC5759746 · DOI · Paper page
  12. [13]Brownson RC Chriqui JF Stamatakis KA Understanding evidence-based public health policy Am J Public Health 2009 99 9 1576 1583 10.2105/AJPH.2008.156224 19608941 PMC2724448 · DOI
  13. [15]Ellinger AD Ellinger AE Yang B Howton SW The relationship between the learning organization concept and firms’ financial performance: an empirical assessment Hum Resour Dev Q 2002 13 1 5 22 10.1002/hrdq.1010 · DOI
  14. [16]Powell BJ Fernandez ME Williams NJ Aarons GA Beidas RS Lewis CC Enhancing the impact of implementation strategies in healthcare: a research agenda Front Public Health 2019 7 3 10.3389/fpubh.2019.00003 30723713 PMC6350272 · DOI · Paper page
  15. [17]Beidas RS Buttenheim AM Mandell DS Transforming mental health care delivery through implementation science and behavioral economics JAMA Psychiatry 2021 78 9 941 942 10.1001/jamapsychiatry.2021.1120 34076686 PMC8744069 · DOI
  16. [18]Glisson C Williams NJ Assessing and changing organizational social contexts for effective mental health services Annu Rev Public Health 2015 36 507 523 10.1146/annurev-publhealth-031914-122435 25785894 · DOI
  17. [19]Hoagwood KE Purtle J Spandorfer J Peth-Pierce R Horwitz SM Aligning dissemination and implementation science with health policies to improve children’s mental health Am Psychol 2020 75 8 1130 10.1037/amp0000706 33252950 PMC8034490 · DOI
  18. [20]Shelton RC Adsul P Oh A Recommendations for addressing structural racism in implementation science: a call to the field Ethn Dis 2021 31 Suppl 1 357 364 10.18865/ed.31.S1.357 34045837 PMC8143847 · DOI
  19. [21]Baumann AA Cabassa LJ Reframing implementation science to address inequities in healthcare delivery BMC Health Serv Res 2020 20 1 190 10.1186/s12913-020-4975-3 32164706 PMC7069050 · DOI
  20. [22]Brownson RC Kumanyika SK Kreuter MW Haire-Joshu D Implementation science should give higher priority to health equity Implement Sci 2021 16 1 28 10.1186/s13012-021-01097-0 33740999 PMC7977499 · DOI
  21. [23]Woodward EN Matthieu MM Uchendu US Rogal S Kirchner JE The health equity implementation framework: proposal and preliminary study of hepatitis C virus treatment Implement Sci 2019 14 1 1 18 10.1186/s13012-019-0861-y 30866982 PMC6417278 · DOI
  22. [25]Lewis CC Powell BJ Brewer SK Nguyen AM Schriger SH Vejnoska SF Advancing mechanisms of implementation to accelerate sustainable evidence-based practice integration: protocol for generating a research agenda BMJ Open 2021 11 10 e053474 10.1136/bmjopen-2021-053474 34663668 PMC8524292 · DOI
  23. [26]Lewis CC Klasnja P Powell BJ Lyon AR Tuzzio L Jones S From classification to causality: advancing understanding of mechanisms of change in implementation science Front Public Health 2018 6 136 10.3389/fpubh.2018.00136 29868544 PMC5949843 · DOI · Paper page
  24. [27]Committee on the Science of Team Science, Board on Behavioral C, and Sensory Sciences,, Division of Behavioral and Social Sciences and Education, National Research Council Enhancing the effectiveness of team science 2015 Washington, DC National Academies Press (US) 26247083
  25. [28]Shelton RC, Adsul P, Oh A, Moise N, Griffith D. Application of an anti-racism lens in the field of implementation science: recommendations for reframing implementation research with a focus on justice and racial equity. Implement Res Pract. 2021. 10.1177/26334895211049482. PMC9978668 37089985 · DOI
  26. [29]Emmons KM Chambers DA Policy implementation science - an unexplored strategy to address social determinants of health Ethn Dis 2021 31 1 133 138 10.18865/ed.31.1.133 33519163 PMC7843047 · DOI
  27. [30]Bailey ZD Krieger N Agénor M Graves J Linos N Bassett MT Structural racism and health inequities in the USA: evidence and interventions Lancet 2017 389 10077 1453 1463 10.1016/s0140-6736(17)30569-x 28402827 · DOI · Paper page
  28. [31]Garner BR Patel SV Kirk MA Priority domains, aims, and testable hypotheses for implementation research: protocol for a scoping review and evidence map Syst Rev 2020 9 1 277 10.1186/s13643-020-01535-y 33272313 PMC7716483 · DOI
  29. [34]Noe MH Shin DB Wan MT Gelfand JM Objective measures of psoriasis severity predict mortality: a prospective population-based cohort study J Invest Dermatol 2018 138 1 228 230 10.1016/j.jid.2017.07.841 28843488 PMC6748628 · DOI
  30. [35]Paltiel AD Schwartz JL Zheng A Walensky RP Clinical outcomes of a COVID-19 vaccine: implementation over efficacy Health Aff (Millwood) 2021 40 1 42 52 10.1377/hlthaff.2020.02054 33211536 PMC7931245 · DOI
  31. [36]Neta G Glasgow RE Carpenter CR Grimshaw JM Rabin BA Fernandez ME A framework for enhancing the value of research for dissemination and implementation Am J Public Health 2015 105 1 49 57 10.2105/AJPH.2014.302206 25393182 PMC4265905 · DOI · Paper page
  32. [37]Bennett GG Shelton RC Extending our reach for greater impact Health Educ Behav 2017 44 6 835 838 10.1177/1090198117736354 29025265 · DOI
  33. [39]Hacking I Kuhn TS Introduction The structure of scientific revolutions: 50th anniversary 2012 4 University of Chicago Press
  34. [42]Chambers DA. Considering the intersection between implementation science and COVID-19. Implement Res Pract. 2020;1. 10.1177/0020764020925994. PMC9981883 36915854 · DOI
  35. [43]Taylor SP Kowalkowski MA Beidas RS Where is the implementation science? An opportunity to apply principles during the COVID-19 pandemic Clin Infect Dis 2020 71 11 2993 2995 10.1093/cid/ciaa622 32436576 PMC7314225 · DOI
  36. [44]Shelton RC Brotzman LE Johnson D Erwin D Trust and mistrust in shaping adaptation and de-implementation in the context of changing screening guidelines Ethn Dis 2021 31 1 119 132 10.18865/ed.31.1.119 33519162 PMC7843040 · DOI
  37. [45]Zhuang H, Acuna DE. The effect of novelty on the future impact of scientific grants. Arxiv. 2019. 10.48550/arXiv.1911.02712. · DOI
  38. [46]Kislov R Pope C Martin GP Wilson PM Harnessing the power of theorising in implementation science Implement Sci. 2019 14 1 1 8 10.1186/s13012-019-0957-4 31823787 PMC6905028 · DOI · Paper page
  39. [47]Glasgow RE Harden SM Gaglio B Rabin B Smith ML Porter GC RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review Front Public Health 2019 7 64 10.3389/fpubh.2019.00064 30984733 PMC6450067 · DOI · Paper page
  40. [49]Allen M Wilhelm A Ortega LE Pergament S Bates N Cunningham B Applying a race (ism)-conscious adaptation of the CFIR Framework to understand implementation of a school-based equity-oriented intervention Ethn Dis 2021 31 Suppl 1 375 388 10.18865/ed.31.S1.375 34045839 PMC8143857 · DOI
  41. [50]Shelton RC Chambers DA Glasgow RE An extension of RE-AIM to enhance sustainability: addressing dynamic context and promoting health equity over time Front Public Health 2020 8 134 10.3389/fpubh.2020.00134 32478025 PMC7235159 · DOI · Paper page
  42. [51]Etherington N Rodrigues IB Giangregorio L Graham ID Hoens AM Kasperavicius D Applying an intersectionality lens to the theoretical domains framework: a tool for thinking about how intersecting social identities and structures of power influence behaviour BMC Med Res Methodol 2020 20 1 169 10.1186/s12874-020-01056-1 32590940 PMC7318508 · DOI
  43. [52]Snell-Rood C Jaramillo ET Hamilton AB Raskin SE Nicosia FM Willging C Advancing health equity through a theoretically critical implementation science Transl Behav Med 2021 11 8 1617 1625 10.1093/tbm/ibab008 33904908 PMC8367016 · DOI
  44. [54]Green LW Making research relevant: if it is an evidence-based practice, where’s the practice-based evidence? Fam Pract 2008 25 Suppl 1 i20 i24 10.1093/fampra/cmn055 18794201 · DOI
  45. [55]Lyon AR Coifman J Cook H McRee E Liu FF Ludwig K The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability Implement Sci Commun 2021 2 1 1 16 10.1186/s43058-021-00183-0 34274027 PMC8285864 · DOI
  46. [56]Dopp AR Parisi KE Munson SA Lyon AR Aligning implementation and user-centered design strategies to enhance the impact of health services: results from a concept mapping study Implement Sci Commun 2020 1 1 17 10.1186/s43058-020-00020-w 32885179 PMC7427975 · DOI
  47. [57]Williams NJ Beidas RS Annual research review: the state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field J Child Psychol Psychiatry 2019 60 4 430 450 10.1111/jcpp.12960 30144077 PMC6389440 · DOI · Paper page
  48. [58]Kemp CG Wagenaar BH Haroz EE Expanding hybrid studies for implementation research: intervention, implementation strategy, and context Front Public Health 2019 7 325 10.3389/fpubh.2019.00325 31781528 PMC6857476 · DOI
  49. [59]Safaeinili N Brown-Johnson C Shaw JG Mahoney M Winget M CFIR simplified: pragmatic application of and adaptations to the Consolidated Framework for Implementation Research (CFIR) for evaluation of a patient-centered care transformation within a learning health system Learn Health Syst 2020 4 1 e10201 31989028 PMC6971122
  50. [60]Lyon AR Comtois KA Kerns SEU Landes SJ Lewis CC Closing the science–practice gap in implementation before it widens Implement Sci 2020 3.0 295 313 10.1007/978-3-030-03874-8_12 · DOI
  51. [61]Davis R D’Lima D Building capacity in dissemination and implementation science: a systematic review of the academic literature on teaching and training initiatives Implement Sci 2020 15 1 1 26 10.1186/s13012-020-01051-6 33126909 PMC7597006 · DOI
  52. [62]Herrera M Roberts DC Gulbahce N Mapping the evolution of scientific fields PLoS One 2010 5 5 e10355 10.1371/journal.pone.0010355 20463949 PMC2864309 · DOI
  53. [63]Coccia M The evolution of scientific disciplines in applied sciences: dynamics and empirical properties of experimental physics Scientometrics 2020 124 1 451 487 10.1007/s11192-020-03464-y · DOI
  54. [64]Koczwara B Stover AM Davies L Davis MM Fleisher L Ramanadhan S Harnessing the synergy between improvement science and implementation science in cancer: a call to action J Oncol 2018 14 6 335 PMC6075851 29750579
  55. [66]Gould MK Sharp AL Nguyen HQ Hahn EE Mittman BS Shen E Embedded research in the learning healthcare system: ongoing challenges and recommendations for researchers, clinicians, and health system leaders J Gen Intern Med 2020 35 12 3675 3680 10.1007/s11606-020-05865-4 32472492 PMC7728937 · DOI
  56. [67]Cheetham M Wiseman A Khazaeli B Gibson E Gray P Van der Graaf P Embedded research: a promising way to create evidence-informed impact in public health? J Public Health (Oxf) 2018 40 Suppl 1 i64 i70 10.1093/pubmed/fdx125 29538721 · DOI
  57. [68]English M Irimu G Agweyu A Gathara D Oliwa J Ayieko P Building learning health systems to accelerate research and improve outcomes of clinical care in low- and middle-income countries PLoS Med 2016 13 4 e1001991 10.1371/journal.pmed.1001991 27070913 PMC4829240 · DOI
  58. [69]Sheikh K Agyepong I Jhalani M Ammar W Hafeez A Pyakuryal S Learning health systems: an empowering agenda for low-income and middle-income countries Lancet 2020 395 10223 476 477 10.1016/s0140-6736(19)33134-4 32061280 · DOI
  59. [70]Proctor EK Chambers DA Training in dissemination and implementation research: a field-wide perspective Transl Behav Med 2017 7 3 624 635 10.1007/s13142-016-0406-8 27142266 PMC5645271 · DOI
  60. [71]Leppin AL Baumann AA Fernandez ME Rudd BN Stevens KR Warner DO Teaching for implementation: a framework for building implementation research and practice capacity within the translational science workforce J Clin Transl Sci 2021 5 1 e147 10.1017/cts.2021.809 34527287 PMC8411269 · DOI
  61. [72]Leppin AL Mahoney JE Stevens KR Bartels SJ Baldwin LM Dolor RJ Situating dissemination and implementation sciences within and across the translational research spectrum J Clin Transl Sci 2019 4 3 152 158 10.1017/cts.2019.392 32695482 PMC7348034 · DOI
  62. [73]Tabak RG Bauman AA Holtrop JS Roles dissemination and implementation scientists can play in supporting research teams Implement Sci Commun 2021 2 1 9 10.1186/s43058-020-00107-4 33451364 PMC7811259 · DOI
  63. [74]Lee KJ Moreno-Betancur M Kasza J Marschner IC Barnett AG Carlin JB Biostatistics: a fundamental discipline at the core of modern health data science Med J Aust 2019 211 10 444 10.5694/mja2.50372 31656046 PMC6899583 · DOI
  64. [75]Brimacombe MB Biostatistical and medical statistics graduate education BMC Med Educ 2014 14 1 1 5 10.1186/1472-6920-14-18 24472088 PMC3907662 · DOI
  65. [76]Mehta TG Mahoney J Leppin AL Stevens KR Yousefi-Nooraie R Pollock BH Integrating dissemination and implementation sciences within Clinical and Translational Science Award programs to advance translational research: recommendations to national and local leaders J Clin Transl Sci 2021 5 1 e151 10.1017/cts.2021.815 34527291 PMC8411263 · DOI
  66. [77]Tabak RG Padek MM Kerner JF Stange KC Proctor EK Dobbins MJ Dissemination and implementation science training needs: insights from practitioners and researchers Am J Prev Med 2017 52 Suppl 3 S322 SS29 10.1016/j.amepre.2016.10.005 28215389 PMC5321656 · DOI
  67. [78]Jones L Wells K Norris K Meade B Koegel P The vision, valley, and victory of community engagement Ethn Dis 2009 19 4 Suppl 6 S6-3-7 20088076 PMC4841676
  68. [79]Ramanadhan S Davis MM Armstrong R Baquero B Ko LK Leng JC Participatory implementation science to increase the impact of evidence-based cancer prevention and control Cancer Causes Control 2018 29 3 363 369 10.1007/s10552-018-1008-1 29417296 PMC5858707 · DOI
  69. [80]Chambers DA Azrin ST Research and services partnerships: a fundamental component of dissemination and implementation research Psychiatr Serv 2013 64 6 509 511 10.1176/appi.ps.201300032 23728600 · DOI
  70. [81]Pellecchia M Mandell DS Nuske HJ Azad G Benjamin Wolk C Maddox BB Community–academic partnerships in implementation research J Community Psychol 2018 46 7 941 952 10.1002/jcop.21981 30565736 · DOI · Paper page
  71. [82]Wallerstein N Duran B Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity Am J Public Health 2010 100 Suppl 1 Suppl 1 S40 S46 10.2105/AJPH.2009.184036 20147663 PMC2837458 · DOI · Paper page
  72. [83]Khan S Chambers D Neta G Revisiting time to translation: implementation of evidence-based practices (EBPs) in cancer control Cancer Causes Control 2021 32 3 221 230 10.1007/s10552-020-01376-z 33392908 · DOI
  73. [84]Calleson DC Jordan C Seifer SD Community-engaged scholarship: is faculty work in communities a true academic enterprise? Acad Med 2005 80 4 317 321 10.1097/00001888-200504000-00002 15793012 · DOI
  74. [85]Ghaffar A Langlois EV Rasanathan K Peterson S Adedokun L Tran NT Strengthening health systems through embedded research Bull World Health Organ 2017 95 2 87 10.2471/BLT.16.189126 28250505 PMC5327943 · DOI
  75. [86]Wolfenden L Yoong SL Williams CM Grimshaw J Durrheim DN Gillham K Embedding researchers in health service organizations improves research translation and health service performance: the Australian Hunter New England Population Health example J Clin Epidemiol 2017 85 3 11 10.1016/j.jclinepi.2017.03.007 28341367 · DOI
  76. [87]Oh A Vinson CA Chambers DA Future directions for implementation science at the National Cancer Institute: implementation science centers in cancer control Transl Behav Med 2020 11 2 669 675 10.1093/tbm/ibaa018 PMC8135092 32145023 · DOI
  77. [88]Frazier SL Formoso D Birman D Atkins MS Closing the research to practice gap: redefining feasibility Clin Psychol 2008 15 2 125 10.1111/j.1468-2850.2008.00120.x · DOI
  78. [89]Fernandez ME Ten Hoor GA van Lieshout S Rodriguez SA Beidas RS Parcel G Implementation mapping: using intervention mapping to develop implementation strategies Front Public Health 2019 7 158 10.3389/fpubh.2019.00158 31275915 PMC6592155 · DOI · Paper page
  79. [90]Klaiman T Silvestri JA Srinivasan T Szymanski S Tran T Oredeko F Improving prone positioning for severe acute respiratory distress syndrome during the COVID-19 pandemic. An implementation-mapping approach Ann Am Thorac Soc 2021 18 2 300 307 10.1513/AnnalsATS.202005-571OC 33522870 PMC7869786 · DOI
  80. [91]Glasgow RE Battaglia C McCreight M Ayele RA Rabin BA Making implementation science more rapid: use of the RE-AIM framework for mid-course adaptations across five health services research projects in the veterans health administration Front Public Health 2020 8 194 10.3389/fpubh.2020.00194 32528921 PMC7266866 · DOI
  81. [92]Smith J Rapport F O’Brien TA Smith S Tyrrell VJ Mould EV The rise of rapid implementation: a worked example of solving an existing problem with a new method by combining concept analysis with a systematic integrative review BMC Health Serv Res 2020 20 1 449 10.1186/s12913-020-05289-0 32438909 PMC7240003 · DOI
  82. [93]Øvretveit J Implementation researchers can improve the responses of services to the COVID-19 pandemic Implement Res Pract 2020 1 2633489520949151 34192265 PMC7468666
  83. [95]Ramanadhan S Revette AC Lee RM Aveling EL Pragmatic approaches to analyzing qualitative data for implementation science: an introduction Implement Sci Commun 2021 2 1 70 10.1186/s43058-021-00174-1 34187595 PMC8243847 · DOI
  84. [96]Slaughter SE Zimmermann GL Nuspl M Hanson HM Albrecht L Esmail R Classification schemes for knowledge translation interventions: a practical resource for researchers BMC Med Res Methodol 2017 17 1 1 11 10.1186/s12874-017-0441-2 29207955 PMC5718087 · DOI
  85. [98]Waltz TJ Powell BJ Matthieu MM Damschroder LJ Chinman MJ Smith JL Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study Implement Sci 2015 10 109 10.1186/s13012-015-0295-0 26249843 PMC4527340 · DOI · Paper page
  86. [101]Bragge P Grimshaw JM Lokker C Colquhoun H AIMD - a validated, simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies BMC Med Res Methodol 2017 17 1 1 11 10.1186/s12874-017-0314-8 28259155 PMC5336675 · DOI · Paper page
  87. [102]Pinnock H Barwick M Carpenter CR Eldridge S Grandes G Griffiths CJ Standards for Reporting Implementation Studies (StaRI) statement BMJ 2017 356 i6795 10.1136/bmj.i6795 28264797 PMC5421438 · DOI · Paper page
  88. [103]Wolfenden L Foy R Presseau J Grimshaw JM Ivers NM Powell BJ Designing and undertaking randomised implementation trials: guide for researchers BMJ 2021 372 m3721 10.1136/bmj.m3721 33461967 PMC7812444 · DOI
  89. [106]Burke JG Lich KH Neal JW Meissner HI Yonas M Mabry PL Enhancing dissemination and implementation research using systems science methods Int J Behav Med 2015 22 3 283 291 10.1007/s12529-014-9417-3 24852184 PMC4363012 · DOI
  90. [108]Bosch M Van Der Weijden T Wensing M Grol R Tailoring quality improvement interventions to identified barriers: a multiple case analysis J Eval Clin Pract 2007 13 2 161 168 10.1111/j.1365-2753.2006.00660.x 17378860 · DOI · Paper page
  91. [109]French SD Green SE O’Connor DA McKenzie JE Francis JJ Michie S Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework Implement Sci 2012 7 1 1 8 10.1186/1748-5908-7-38 PMC3443064 22531013 · DOI · Paper page
  92. [111]Williams NJ Multilevel mechanisms of implementation strategies in mental health: integrating theory, research, and practice Adm Policy Ment Health 2016 43 5 783 798 10.1007/s10488-015-0693-2 26474761 PMC4834058 · DOI · Paper page
  93. [112]Powell BJ Beidas RS Lewis CC Aarons GA McMillen JC Proctor EK Methods to improve the selection and tailoring of implementation strategies J Behav Health Serv Res 2017 44 2 177 194 10.1007/s11414-015-9475-6 26289563 PMC4761530 · DOI · Paper page
  94. [113]Powell BJ Haley AD Patel SV Amaya-Jackson L Glienke B Blythe M Improving the implementation and sustainment of evidence-based practices in community mental health organizations: a study protocol for a matched-pair cluster randomized pilot study of the Collaborative Organizational Approach to Selecting and Tailoring Implementation Strategies (COAST-IS). Implement Sci Commun 2020 1 9 1 13 PMC7207049 32391524
  95. [114]Finley EP Huynh AK Farmer MM Bean-Mayberry B Moin T Oishi SM Periodic reflections: a method of guided discussions for documenting implementation phenomena BMC Med Res Methodol 2018 18 1 153 10.1186/s12874-018-0610-y 30482159 PMC6258449 · DOI
  96. [115]Hamilton AB Finley EP Qualitative methods in implementation research: an introduction Psychiatry Res 2019 280 112516 10.1016/j.psychres.2019.112516 31437661 PMC7023962 · DOI
  97. [116]Lewis CC Hannon PA Klasnja P Baldwin LM Hawkes R Blackmer J Optimizing Implementation in Cancer Control (OPTICC): protocol for an implementation science center Implement Sci Commun 2021 2 1 44 10.1186/s43058-021-00117-w 33892822 PMC8062945 · DOI
  98. [117]Cook CR Lyon AR Locke J Waltz T Powell BJ Adapting a compilation of implementation strategies to advance school-based implementation research and practice Prev Sci 2019 20 6 914 935 10.1007/s11121-019-01017-1 31152328 PMC8943907 · DOI
  99. [118]Lyon AR Cook CR Locke J Davis C Powell BJ Waltz TJ Importance and feasibility of an adapted set of implementation strategies in schools J Sch Psychol 2019 76 66 77 10.1016/j.jsp.2019.07.014 31759470 PMC6876555 · DOI
  100. [119]Leeman J Birken SA Powell BJ Rohweder C Shea CM Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice Implement Sci 2017 12 1 125 10.1186/s13012-017-0657-x 29100551 PMC5670723 · DOI · Paper page
  101. [121]Ritchie MJ Kirchner JE Parker LE Curran GM Fortney JC Pitcock JA Evaluation of an implementation facilitation strategy for settings that experience significant implementation barriers Implement Sci 2015 10 1 1 3 10.1186/s13012-015-0228-y 25567289 PMC4302070 · DOI
  102. [123]Collins LM Baker TB Mermelstein RJ Piper ME Jorenby DE Smith SS The multiphase optimization strategy for engineering effective tobacco use interventions Ann Behav Med 2011 41 2 208 226 10.1007/s12160-010-9253-x 21132416 PMC3053423 · DOI · Paper page
  103. [125]Collins LM Murphy SA Strecher V The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions Am J Prev Med 2007 32 Suppl 5 S112 S118 10.1016/j.amepre.2007.01.022 17466815 PMC2062525 · DOI · Paper page
  104. [126]Beidas RS Williams NJ Becker-Haimes EM Aarons GA Barg FK Evans AC A repeated cross-sectional study of clinicians’ use of psychotherapy techniques during 5 years of a system-wide effort to implement evidence-based practices in Philadelphia Implement Sci 2019 14 1 67 10.1186/s13012-019-0912-4 31226992 PMC6588873 · DOI
  105. [127]Daniel N Judith JL Spiegelman D Analysis of “learn-as-you-go” (LAGO) studies Ann Stat 2019 49 2 793 819 10.1214/20-AOS1978 PMC9067111 35510045 · DOI
  106. [129]Engell T Kirkøen B Hammerstrøm KT Kornør H Ludvigsen KH Hagen KA Common elements of practice, process and implementation in out-of-school-time academic interventions for at-risk children: a systematic review Prev Sci 2020 21 4 545 556 10.1007/s11121-020-01091-w 32020489 PMC7162823 · DOI

Authors
Beidas, R. S., Dorsey, S., Lewis, C. C., Lyon, A. R., Powell, B. J., Purtle, J., Saldana, L., Shelton, R. C., Stirman, S. W., & Lane-Fall, M. B.
Affiliations
University of Pennsylvania (US)
Corresponding author
Beidas, Rinad S.
ORCID
Venue
Implementation Science
Publisher
Springer Science and Business Media LLC
Published
2022-08-13
Volume
17
Issue
1
Pages
55-55
ISSN
1748-5908 (ISSN-L)
DOI
10.1186/s13012-022-01226-3
PMC
PMC9375077
OpenAlex
W4291168596
Cited by
230
References
127
Citations by year
2026: 47 · 2025: 65 · 2024: 72 · 2023: 39 · 2022: 7
FWCI
52.44
Type
journal article
Language
en
Open access
Licence
Locations
  • Implementation Science (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • National Cancer Institute (P50CA244690)
  • National Institute of Mental Health (P50113840)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
Keywords
knowledge-practice gap, research impact, stakeholder alignment, implementation strategies, research collaboration
MeSH terms
Professional Practice Gaps, Implementation Science, Humans, Prospective Studies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review