Cited by 205Health Policy Implementation ScienceHealth Sciences Research and EducationMeta-analysis and systematic reviews

A Framework for Enhancing the Value of Research for Dissemination and Implementation

Open access
Neta, Gila, Glasgow, Russell E., Carpenter, Christopher R., Grimshaw, Jeremy M., Rabin, Borsika A., Fernandez, Maria E., Brownson, Ross C.·2015·American Journal of Public Health

Abstract

A comprehensive guide that identifies critical evaluation and reporting elements necessary to move research into practice is needed. We propose a framework that highlights the domains required to enhance the value of dissemination and implementation research for end users. We emphasize the importance of transparent reporting on the planning phase of research in addition to delivery, evaluation, and long-term outcomes. We highlight key topics for which well-established reporting and assessment tools are underused (e.g., cost of intervention, implementation strategy, adoption) and where such tools are inadequate or lacking (e.g., context, sustainability, evolution) within the context of existing reporting guidelines. Consistent evaluation of and reporting on these issues with standardized approaches would enhance the value of research for practitioners and decision-makers.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2105/ajph.2014.302206

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The Standards for Reporting Implementation Studies and Neta et al. reporting framework emphasize how critical it is to report on the multilevel context of implementation.

    “Though not specific to the reporting of implementation strategies, the Standards for Reporting Implementation Studies (101) and Neta et al. (102) reporting framework emphasizes how critical it is to report on the multilevel context of implementation.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 119 · Cited by 205

Research works printed but not linked: 75

  1. [1]Riley WT, Glasgow RE, Etheredge L, Abernethy AP. Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise. Clin Transl Med. 2013;2(1):10. doi: 10.1186/2001-1326-2-10. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI · Paper page
  2. [2]Balas EA, Boren SA. Managing Clinical Knowledge for Health Care Improvement: Yearbook of Medical Informatics. Stuttgart, Germany: Schattauer; 2000. [PubMed] [Google Scholar]
  3. [3]Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007;28:413–433. doi: 10.1146/annurev.publhealth.28.021406.144145. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  4. [4]Washington, DC: Institute of Medicine; 2012. How far have we come in reducing health disparities?: progress since 2000—workshop summary. [PubMed] [Google Scholar]
  5. [5]Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753. doi: 10.1136/bmj.f6753. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  6. [6]Brownson RC, Colditz GA, Proctor EK. Dissemination and Implementation Research in Health: Translating Science to Practice. 1st ed. New York, NY: Oxford University Press; 2012. [Google Scholar]
  7. [8]Kolko DJ, Hoagwood KE, Springgate B. Treatment research for children and youth exposed to traumatic events: moving beyond efficacy to amp up public health impact. Gen Hosp Psychiatry. 2010;32(5):465–476. doi: 10.1016/j.genhosppsych.2010.05.003. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  8. [9]Rothwell PM. External validity of randomised controlled trials: “to whom do the results of this trial apply? Lancet. 2005;365(9453):82–93. doi: 10.1016/S0140-6736(04)17670-8. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  9. [10]Pinnock H, Epiphaniou E, Taylor SJ. Phase IV implementation studies. The forgotten finale to the complex intervention methodology framework. Ann Am Thorac Soc. 2014;11(suppl 2):S118–S122. doi: 10.1513/AnnalsATS.201308-259RM. [DOI] [PubMed] [Google Scholar] · DOI
  10. [12]Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–350. doi: 10.1016/j.amepre.2012.05.024. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI · Paper page
  11. [14]Sales A, Smith J, Curran G, Kochevar L. Models, strategies, and tools. Theory in implementing evidence-based findings into health care practice. J Gen Intern Med. 2006;21(suppl 2):S43–S49. doi: 10.1111/j.1525-1497.2006.00362.x. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  12. [15]Mitchell SA, Fisher CA, Hastings CE, Silverman LB, Wallen GR. A thematic analysis of theoretical models for translational science in nursing: mapping the field. Nurs Outlook. 2010;58(6):287–300. doi: 10.1016/j.outlook.2010.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI · Paper page
  13. [16]Khoury MJ, Gwinn M, Ioannidis JP. The emergence of translational epidemiology: from scientific discovery to population health impact. Am J Epidemiol. 2010;172(5):517–524. doi: 10.1093/aje/kwq211. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  14. [17]Klesges LM, Estabrooks PA, Dzewaltowski DA, Bull SS, Glasgow RE. Beginning with the application in mind: designing and planning health behavior change interventions to enhance dissemination. Ann Behav Med. 2005;29(suppl):66–75. doi: 10.1207/s15324796abm2902s_10. [DOI] [PubMed] [Google Scholar] · DOI
  15. [18]Brownson RC, Jacobs JA, Tabak RG, Hoehner CM, Stamatakis KA. Designing for dissemination among public health researchers: findings from a national survey in the United States. Am J Public Health. 2013;103(9):1693–1699. doi: 10.2105/AJPH.2012.301165. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI · Paper page
  16. [19]Rogers EM. Diffusion of Innovations. 5th ed. New York, NY: Free Press; 2003. [Google Scholar]
  17. [22]Stokols D. Social ecology and behavioral medicine: implications for training, practice, and policy. Behav Med. 2000;26(3):129–138. doi: 10.1080/08964280009595760. [DOI] [PubMed] [Google Scholar] · DOI
  18. [23]Glasgow RE, Green LW, Klesges LM et al. External validity: we need to do more. Ann Behav Med. 2006;31(2):105–108. doi: 10.1207/s15324796abm3102_1. [DOI] [PubMed] [Google Scholar] · DOI
  19. [24]Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval Health Prof. 2006;29(1):126–153. doi: 10.1177/0163278705284445. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  20. [25]Stange KC, Breslau ES, Dietrich AJ, Glasgow RE. State-of-the-art and future directions in multilevel interventions across the cancer control continuum. J Natl Cancer Inst Monogr. 2012;2012(44):20–31. doi: 10.1093/jncimonographs/lgs006. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  21. [26]McDonald KM. Considering context in quality improvement interventions and implementation: concepts, frameworks, and application. Acad Pediatr. 2013;13(6, suppl):S45–S53. doi: 10.1016/j.acap.2013.04.013. [DOI] [PubMed] [Google Scholar] · DOI
  22. [27]McKinlay JB. Paradigmatic obstacles to improving the health of populations—implications for health policy. Salud Publica Mex. 1998;40(4):369–379. doi: 10.1590/s0036-36341998000400010. [DOI] [PubMed] [Google Scholar] · DOI
  23. [29]Tomoaia-Cotisel A, Scammon DL, Waitzman NJ et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013;11(suppl 1):S115–S123. doi: 10.1370/afm.1549. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  24. [30]Stange KC, Glasgow RE. Rockville, MD: Agency for Healthcare Research and Quality; 2013. Considering and reporting important contextual factors in research on the patient-centered medical home. [Google Scholar]
  25. [32]Klassen AC, Creswell J, Plano Clark VL, Smith KC, Meissner HI. Best practices in mixed methods for quality of life research. Qual Life Res. 2012;21(3):377–380. doi: 10.1007/s11136-012-0122-x. [DOI] [PubMed] [Google Scholar] · DOI
  26. [34]Fleurence R, Selby JV, Odom-Walker K et al. How the Patient-Centered Outcomes Research Institute is engaging patients and others in shaping its research agenda. Health Aff (Millwood) 2013;32(2):393–400. doi: 10.1377/hlthaff.2012.1176. [DOI] [PubMed] [Google Scholar] · DOI
  27. [35]Krumholz HM, Selby JV Patient-Centered Outcomes Research Institute. Seeing through the eyes of patients: the Patient-Centered Outcomes Research Institute funding announcements. Ann Intern Med. 2012;157(6):446–447. doi: 10.7326/0003-4819-157-6-201209180-00519. [DOI] [PubMed] [Google Scholar] · DOI
  28. [36]Selby JV. The Patient-Centered Outcomes Research Institute: a 2013 agenda for “research done differently.”. Popul Health Manag. 2013;16(2):69–70. doi: 10.1089/pop.2013.1621. [DOI] [PubMed] [Google Scholar] · DOI
  29. [37]Selby JV, Beal AC, Frank L. The Patient-Centered Outcomes Research Institute (PCORI) national priorities for research and initial research agenda. JAMA. 2012;307(15):1583–1584. doi: 10.1001/jama.2012.500. [DOI] [PubMed] [Google Scholar] · DOI
  30. [38]Ritzwoller DP, Sukhanova A, Gaglio B, Glasgow RE. Costing behavioral interventions: a practical guide to enhance translation. Ann Behav Med. 2009;37(2):218–227. doi: 10.1007/s12160-009-9088-5. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  31. [39]O’Keeffe-Rosetti MC, Hornbrook MC, Fishman PA et al. A standardized relative resource cost model for medical care: application to cancer control programs. J Natl Cancer Inst Monogr. 2013;2013(46):106–116. doi: 10.1093/jncimonographs/lgt002. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  32. [40]Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-Effectiveness in Health and Medicine. New York, NY: Oxford University Press; 2003. [Google Scholar]
  33. [41]Bartholomew LK, Parcel GS, Kok G, Gottlieb NH, Fernández ME. Planning Health Promotion Programs: An Intervention Mapping Approach. 3rd ed. San Francisco, CA: Jossey-Bass; 2011. [Google Scholar]
  34. [43]French SD, Green SE, O’Connor DA et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7:38. doi: 10.1186/1748-5908-7-38. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI · Paper page
  35. [45]Leviton LC, Khan LK, Rog D, Dawkins N, Cotton D. Evaluability assessment to improve public health policies, programs, and practices. Annu Rev Public Health. 2010;31:213–233. doi: 10.1146/annurev.publhealth.012809.103625. [DOI] [PubMed] [Google Scholar] · DOI
  36. [46]Wholey J. Assessing the feasibility and likely usefulness of evaluation. In: Wholey J, Hatry H, Newcomer K, editors. Handbook of Practical Program Evaluation. 2nd ed. San Francisco, CA: Jossey-Bass; 2004. pp. 33–62. [Google Scholar]
  37. [47]Lomas J. Diffusion, dissemination, and implementation: who should do what? Ann N Y Acad Sci. 1993;703:226–235. doi: 10.1111/j.1749-6632.1993.tb26351.x. discussion 235–227. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  38. [48]Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomised controlled trial be? BMJ. 2004;328(7455):1561–1563. doi: 10.1136/bmj.328.7455.1561. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI · Paper page
  39. [49]Allen JD, Linnan LA, Emmons KM. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In: Brownson RC, Colditz G, Proctor E, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. New York, NY: Oxford University Press; 2012. pp. 281–304. [Google Scholar]
  40. [50]Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8:65. doi: 10.1186/1748-5908-8-65. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI · Paper page
  41. [51]Bellg AJ, Borrelli B, Resnick B et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23(5):443–451. doi: 10.1037/0278-6133.23.5.443. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  42. [52]Squires JE, Valentine JC, Grimshaw JM. Systematic reviews of complex interventions: framing the review question. J Clin Epidemiol. 2013;66(11):1215–1222. doi: 10.1016/j.jclinepi.2013.05.013. [DOI] [PubMed] [Google Scholar] · DOI
  43. [54]Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Benkeser RM, Peek CJ. What does it mean to “employ” the RE-AIM model? Eval Health Prof. 2013;36(1):44–66. doi: 10.1177/0163278712446066. [DOI] [PubMed] [Google Scholar] · DOI
  44. [55]Powell AA, White KM, Partin MR et al. Unintended consequences of implementing a national performance measurement system into local practice. J Gen Intern Med. 2012;27(4):405–412. doi: 10.1007/s11606-011-1906-3. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  45. [56]Naylor MD, Kurtzman ET, Grabowski DC, Harrington C, McClellan M, Reinhard SC. Unintended consequences of steps to cut readmissions and reform payment may threaten care of vulnerable older adults. Health Aff (Millwood) 2012;31(7):1623–1632. doi: 10.1377/hlthaff.2012.0110. [DOI] [PubMed] [Google Scholar] · DOI
  46. [57]Peters E, Klein W, Kaufman A, Meilleur L, Dixon A. More is not always better: intuitions about effective public policy can lead to unintended consequences. Soc Issues Policy Rev. 2013;7(1):114–148. doi: 10.1111/j.1751-2409.2012.01045.x. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  47. [58]Lehmann U, Gilson L. Actor interfaces and practices of power in a community health worker programme: a South African study of unintended policy outcomes. Health Policy Plan. 2013;28(4):358–366. doi: 10.1093/heapol/czs066. [DOI] [PubMed] [Google Scholar] · DOI
  48. [59]Kaplan RM, Bush JW. Health-related quality of life measurement for evaluation research and policy analysis. Health Psychol. 1982;1(1):61–80. [Google Scholar]
  49. [60]Kaplan RM. Quality of life measurement. In: Karoly P, editor. Measurement Strategies in Health Psychology. New York, NY: Wiley & Sons; 1985. [Google Scholar]
  50. [61]Collins CD, Purohit S, Podolsky RH et al. The application of genomic and proteomic technologies in predictive, preventive and personalized medicine. Vascul Pharmacol. 2006;45(5):258–267. doi: 10.1016/j.vph.2006.08.003. [DOI] [PubMed] [Google Scholar] · DOI
  51. [62]Kaiser J. Francis Collins interview. Departing U.S. Genome Institute director takes stock of personalized medicine. Science. 2008;320(5881):1272. doi: 10.1126/science.320.5881.1272. [DOI] [PubMed] [Google Scholar] · DOI
  52. [63]Hamburg MA, Collins FS. The path to personalized medicine. N Engl J Med. 2010;363(4):301–304. doi: 10.1056/NEJMp1006304. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  53. [65]Thorpe KE, Zwarenstein M, Oxman AD et al. A Pragmatic-Explanatory Continuum Indicator Summary (PRECIS): a tool to help trial designers. CMAJ. 2009;180(10):E47–E57. doi: 10.1503/cmaj.090523. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  54. [68]Hartzler B, Lash SJ, Roll JM. Contingency management in substance abuse treatment: a structured review of the evidence for its transportability. Drug Alcohol Depend. 2012;122(1-2):1–10. doi: 10.1016/j.drugalcdep.2011.11.011. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  55. [69]Bernstein E, Topp D, Shaw E et al. A preliminary report of knowledge translation: lessons from taking screening and brief intervention techniques from the research setting into regional systems of care. Acad Emerg Med. 2009;16(11):1225–1233. doi: 10.1111/j.1553-2712.2009.00516.x. [DOI] [PubMed] [Google Scholar] · DOI
  56. [70]Schoenwald SK, Sheidow AJ, Letourneau EJ, Liao JG. Transportability of multisystemic therapy: evidence for multilevel influences. Ment Health Serv Res. 2003;5(4):223–239. doi: 10.1023/a:1026229102151. [DOI] [PubMed] [Google Scholar] · DOI
  57. [75]Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006;21(5):688–694. doi: 10.1093/her/cyl081. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  58. [76]Haug NA, Shopshire M, Tajima B, Gruber V, Guydish J. Adoption of evidence-based practices among substance abuse treatment providers. J Drug Educ. 2008;38(2):181–192. doi: 10.2190/DE.38.2.f. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  59. [77]Henggeler SW, Chapman JE, Rowland MD et al. Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. J Consult Clin Psychol. 2008;76(4):556–567. doi: 10.1037/0022-006X.76.4.556. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  60. [78]Greenhalgh T. Role of routines in collaborative work in healthcare organisations. BMJ. 2008;337:a2448. doi: 10.1136/bmj.a2448. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  61. [79]Cochrane A. Effectiveness and Efficiency: Random Reflections on Health Services. London, England: Nuffield Provincial Hospital Trust; 1972. [Google Scholar]
  62. [80]Chambers D. Foreword. In: Brownson R, Colditz G, Proctor E, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. New York, NY: Oxford University Press; 2012. pp. vii–x. [Google Scholar]
  63. [81]Altman DG, Simera I, Hoey J, Moher D, Schulz K. EQUATOR: reporting guidelines for health research. Open Med. 2008;2(2):e49–e50. [PMC free article] [PubMed] [Google Scholar]
  64. [84]Bossuyt PM, Reitsma JB, Bruns DE et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med. 2003;138(1):W1–W12. doi: 10.7326/0003-4819-138-1-200301070-00012-w1. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  65. [86]Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney S SQUIRE Development Group. Publication guidelines for improvement studies in health care: evolution of the SQUIRE Project. Ann Intern Med. 2008;149(9):670–676. doi: 10.7326/0003-4819-149-9-200811040-00009. [DOI] [PubMed] [Google Scholar] · DOI
  66. [87]Husereau D, Drummond M, Petrou S et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. BMJ. 2013;346:f1049. doi: 10.1136/bmj.f1049. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  67. [88]Gagnier JJ, Kienle G, Altman DG et al. The CARE guidelines: consensus-based clinical case report guideline development. J Clin Epidemiol. 2014;67(1):46–51. doi: 10.1016/j.jclinepi.2013.08.003. [DOI] [PubMed] [Google Scholar] · DOI
  68. [89]Stroup DF, Berlin JA, Morton SC et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283(15):2008–2012. doi: 10.1001/jama.283.15.2008. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  69. [90]Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–269. doi: 10.7326/0003-4819-151-4-200908180-00135. W264. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  70. [91]Ioannidis JP, Evans SJ, Gotzsche PC et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004;141(10):781–788. doi: 10.7326/0003-4819-141-10-200411160-00009. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  71. [95]Gagnier JJ, Boon H, Rochon P et al. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med. 2006;144(5):364–367. doi: 10.7326/0003-4819-144-5-200603070-00013. [DOI] [PubMed] [Google Scholar] · DOI · Paper page
  72. [97]Simera I, Moher D, Hirst A, Hoey J, Schulz KF, Altman DG. Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network. BMC Med. 2010;8:24. doi: 10.1186/1741-7015-8-24. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI · Paper page
  73. [100]Welch V, Petticrew M, Tugwell P et al. PRISMA-Equity 2012 extension: reporting guidelines for systematic reviews with a focus on health equity. PLoS Med. 2012;9(10):e1001333. doi: 10.1371/journal.pmed.1001333. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  74. [102]Loudon K, Zwarenstein M, Sullivan F, Donnan P, Treweek S. Making clinical trials more relevant: improving and validating the PRECIS tool for matching trial design decisions to trial purpose. Trials. 2013;14:115. doi: 10.1186/1745-6215-14-115. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI
  75. [106]Montgomery P, Grant S, Hopewell S et al. Protocol for CONSORT-SPI: an extension for social and psychological interventions. Implement Sci. 2013;8(1):99. doi: 10.1186/1748-5908-8-99. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI

Authors
Neta, G., Glasgow, R. E., Carpenter, C. R., Grimshaw, J. M., Rabin, B. A., Fernandez, M. E., & Brownson, R. C.
Affiliations
  • National Institutes of Health (US)
  • Gila Neta is with Implementation Science, Division of Cancer Control and Population Sciences, National Cancer Institute, National Institutes of Health, Rockville, MD. Russell E. Glasgow is with Department of Family Medicine and Colorado Health Outcomes Research Program University of Colorado, Denver. Christopher R. Carpenter is with Washington University School of Medicine, Division of Emergency Medicine, St Louis, MO. Jeremy M. Grimshaw is with Clinical Epidemiology Program, Ottawa Hospital Research...
Venue
American Journal of Public Health
Published
2015-01
Volume
105
Issue
1
Pages
49-57
ISSN
  • 0090-0036 (ISSN-L)
  • 1541-0048
OpenAlex
W2164180185
Cited by
205
References
119
Citations by year
2026: 7 · 2025: 11 · 2024: 13 · 2023: 18 · 2022: 20 · 2021: 12 · 2020: 20 · 2019: 15 · 2018: 25 · 2017: 27 · 2016: 22 · 2015: 15
FWCI
38.53
Type
journal article
Language
en
Open access
Locations
  • American Journal of Public Health (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Funders
  • National Institutes of Health (UL1TR000371, UL1TR000448)
  • National Cancer Institute (P20CA137219)
  • National Institute of Diabetes and Digestive and Kidney Diseases (P30DK092950)
  • National Center for Advancing Translational Sciences
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
dissemination research, implementation research, research-to-practice translation, reporting guidelines, evaluation framework, intervention costs, implementation strategies, technology adoption, sustainability, context, reporting transparency, public health practice

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review