Evaluating the Relevance, Generalization, and Applicability of Research: Issues in External Validation and Translation Methodology
Abstract
Starting with the proposition that “if we want more evidence-based practice, we need more practice-based evidence,” this article (a) offers questions and guides that practitioners, program planners, and policy makers can use to determine the applicability of evidence to situations and populations other than those in which the evidence was produced (generalizability), (b) suggests criteria that reviewers can use to evaluate external validity and potential for generalization, and (c) recommends procedures that practitioners and program planners can use to adapt evidencebased interventions and integrate them with evidence on the population and setting characteristics, theory, and experience into locally appropriate programs. The development and application in tandem of such questions, guides, criteria, and procedures can be a step toward increasing the relevance of research for decision making and should support the creation and reporting of more practice-based research having high external validity.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Evidence for determining which interventions are evidence based often comes from systematic reviews of controlled trials that prioritize internal validity over external validity.
“Often, this evidence comes from systematic reviews of controlled trials that prioritize internal validity (e.g., does the intervention work?) over external validity (e.g., can the findings be generalized, and among what populations and settings?) (48, 54).”
From The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care (2018) · cites this paper as [54]
D&I research explicitly attends to external validity, whereas most randomized efficacy and effectiveness trials mainly emphasize internal validity.
“Dissemination and implementation research pays explicit (although not exclusive) attention to external validity, in contrast to the main emphasis on internal validity in most randomized efficacy and effectiveness trials (20, 48, 52).”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [52]
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,555 · see citing works
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582 · see citing works
Institute of Medicine (2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,174 · see citing works
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,754 · see citing works
To Err is Human: Building a Safer Health System
Hendee, W. R. (2001) · Journal of Vascular and Interventional Radiology · doi:10.1016/s1051-0443(01)70072-3 · Cited by 10,122 · see citing works
Crossing the Quality Chasm: A New Health System for the 21st Century
Committee on Quality of Health Care in America (2002) · Journal for Healthcare Quality · doi:10.1111/j.1945-1474.2002.tb00463.x · Cited by 8,508 · see citing works
An ecological perspective on health promotion programs
McLeroy, K. R., Bibeau, D., Steckler, A., & Glanz, K. (1988) · Health Education Quarterly · doi:10.1177/109019818801500401 · Cited by 8,502 · see citing works
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,302 · see citing works
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · see citing works
Self-citationUnequal treatment: confronting racial and ethnic disparities in health care
(2003) · Choice Reviews Online · doi:10.5860/choice.40-5843 · Cited by 7,043 · see citing works
The Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974 · see citing works
The quality of health care delivered to adults in the United States
McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., & Kerr, E. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa022615 · Cited by 5,079 · see citing works
Capps, L. (2003) · JAMA · doi:10.1001/jama.290.18.2487-b · Cited by 4,558 · see citing works
International Encyclopedia of the Social Sciences.
Duncan, O. D., & Sills, D. L. (1968) · American Sociological Review · doi:10.2307/2092889 · Cited by 3,486 · see citing works
Health Literacy: A Prescription to End Confusion
Committee on Health Literacy, Board on Neuroscience and Behavioral Health, & Institute of Medicine (2004) · doi:10.17226/10883 · Cited by 3,444 · see citing works
Health behavior and health education
(1990) · Choice Reviews Online · doi:10.5860/choice.28-2173 · Cited by 2,919 · see citing works
Des Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817 · see citing works
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · see citing works
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545 · see citing works
Healthy People 2010: Understanding and Improving Health
UNSPECIFIED (2000) · PsycEXTRA Dataset · doi:10.1037/e319432004-001 · Cited by 2,199 · see citing works
Guide to Clinical Preventive Services
Allen, T. W. (1991) · The Journal of the American Osteopathic Association · doi:10.1515/jom-1991-900515 · Cited by 2,132 · see citing works
Methods For Community - Based Participatory Research For Health
Israel, B. A., & Satcher, D. S. (2013) · Cited by 2,128 · see citing works
Chronic disease management: what will it take to improve care for chronic illness?
Eh, W. (1998) · PubMed · Cited by 2,095 · see citing works
Establishing and maintaining healthy environments: Toward a social ecology of health promotion.
Stokols, D. (1992) · American Psychologist · doi:10.1037/0003-066x.47.1.6 · Cited by 2,018 · see citing works
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836 · see citing works
Self-citationThe Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles
Merrifield, P. R., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974) · American Educational Research Journal · doi:10.2307/1162145 · Cited by 1,819 · see citing works
Tunis (2003) · doi:10.1001/jama.290.12.1624 · Cited by 1,724 · see citing works
(1999) · Cited by 1,648 · see citing works
Experimental and quasi-experimental designs for research on teaching
Campbell, D. T. (1963) · Medical Entomology and Zoology · Cited by 1,524 · see citing works
Health literacy: a prescription to end confusion
(2005) · Choice Reviews Online · doi:10.5860/choice.42-4059 · Cited by 1,437 · see citing works
Health promotion planning: An educational and environmental approach
Lusk, S. L. (1992) · Patient Education and Counseling · doi:10.1016/0738-3991(92)90152-9 · Cited by 1,386 · see citing works
The Cultural Adaptation of Prevention Interventions: Resolving Tensions Between Fidelity and Fit
Castro, F. G., Barrera, M., & Martinez, C. R. (2004) · Prevention Science · doi:10.1023/b:prev.0000013980.12412.cd · Cited by 1,228 · see citing works
Potential pitfalls of disease-specific guidelines for patients with multiple conditions.
Tinetti, M., Bogardus, S., & Agostini, J. V. (2004) · New England Journal of Medicine · doi:10.1056/nejmsb042458 · Cited by 969 · see citing works
Guide to Clinical Preventive Services
&NA; (1997) · The Nurse Practitioner · doi:10.1097/00006205-199705000-00020 · Cited by 918 · see citing works
Flay, B. R. (1986) · Preventive Medicine · doi:10.1016/0091-7435(86)90024-1 · Cited by 723 · see citing works
Glasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2701_2 · Cited by 635 · see citing works
Self-citationCheater, F. (1997) · Clinical Effectiveness in Nursing · doi:10.1016/s1361-9004(97)80066-0 · Cited by 588 · see citing works
Ecological Foundations of Health Promotion
Green, L. W., Richard, L., & Potvin, L. (1996) · American Journal of Health Promotion · doi:10.4278/0890-1171-10.4.270 · Cited by 577 · see citing works
Self-citationInterpreting SF&-36 summary health measures: A response
Ware, J. E., & Kosinski, M. R. (2001) · Quality of Life Research · doi:10.1023/a:1012588218728 · Cited by 569 · see citing works
Glasgow, R. E. (2006) · Health Education Research · doi:10.1093/her/cyl081 · Cited by 565 · see citing works
Self-citationBriss (2000) · doi:10.1016/s0749-3797(99)00119-1 · Cited by 565 · see citing works
Guide to Clinical Preventive Services: An Assessment of the Effectiveness of 169 Interventions
(1990) · Annals of Internal Medicine · doi:10.7326/0003-4819-112-9-720_2 · Cited by 550 · see citing works
The Periodic Health Examination
Frappier-Davignon, L. (1934) · New England Journal of Medicine · doi:10.1056/nejm193401252100413 · Cited by 484 · see citing works
Common purpose: strengthening families and neighborhoods to rebuild America
(1998) · Choice Reviews Online · doi:10.5860/choice.35-3612 · Cited by 456 · see citing works
Does the Chronic Care Model Serve Also as a Template for Improving Prevention?
Glasgow, R. E., Orleans, C. T., Wagner, E. H., Curry, S. J., & Solberg, L. I. (2001) · Milbank Quarterly · doi:10.1111/1468-0009.00222 · Cited by 447 · see citing works
Self-citationGreen, L. W., Kreuter, M. W., & Lefebvre, R. C. (2000) · Social Marketing Quarterly · doi:10.1080/15245004.2000.9961104 · Cited by 428 · see citing works
Self-citationFrom Research to “Best Practices” in Other Settings and Populations
Green, L. W. (2001) · American Journal of Health Behavior · doi:10.5993/ajhb.25.3.2 · Cited by 407 · see citing works
Self-citationIntervention mapping : designing theory- and evidence-based health promotion programs
Kok, G. J., & Parcel, G. S. (2000) · Cited by 396 · see citing works
Multiplying Health Gains: the critical role of capacity-building within health promotion programs
Hawe, P., Noort, M., King, L. A., & Jordens, C. F. C. (1997) · Health Policy · doi:10.1016/s0168-8510(96)00847-0 · Cited by 366 · see citing works
Klesges, L. M., Estabrooks, P. A., Dzewaltowski, D. A., Bull, S. S., & Glasgow, R. E. (2005) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2902s_10 · Cited by 325 · see citing works
Self-citationINTERVENTION MAPPING: DESIGNING THEORY AND EVIDENCE-BASED HEALTH PROMOTION PROGRAMS
Bartholomew, L. K. (2001) · Cited by 312 · see citing works
Prochaska, J. O., Velicer, W. F., Fava, J. L., Rossi, J. S., & Tsoh, J. Y. (2001) · Addictive Behaviors · doi:10.1016/s0306-4603(00)00151-9 · Cited by 307 · see citing works
Settings for Health Promotion: Linking Theory and Practice
Poland, B. D., Green, L., & Rootman, I. (2000) · Sage eBooks · doi:10.4135/9781452232829 · Cited by 288 · see citing works
Self-citationHawe, P., Shiell, A., Riley, T., & Gold, L. H. (2004) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2003.014415 · Cited by 287 · see citing works
Abrams, D. B., Orleans, C. T., NIAURA, R. S., Goldstein, M. G., Prochaska, J. O., & Velicer, W. F. (1996) · Annals of Behavioral Medicine · doi:10.1007/bf02895291 · Cited by 287 · see citing works
Avoiding Type III Errors in Health Education Program Evaluations: A Case Study
Basch, C. E., Sliepcevich, E. M., Gold, R. S., Duncan, D. F., & Kolbe, L. J. (1985) · Health Education Quarterly · doi:10.1177/109019818501200311 · Cited by 244 · see citing works
Efficacy, effectiveness, variations, and quality. Boundary-crossing research.
Brook, R. H., & Lohr, K. N. (1985) · PubMed · doi:10.1097/00005650-198505000-00030 · Cited by 234 · see citing works
Cost Effectiveness in Health and Medicine
Wilde, P. (2017) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2017.04.014 · Cited by 223 · see citing works
Measurement and Evaluation in Health Education and Health Promotion
Green, L. W., Lewis, F. M., Mullen, P. D., & Iverson, D. C. (1986) · Medical Entomology and Zoology · Cited by 221 · see citing works
Self-citationPitfalls of Converting Practice Guidelines Into Quality Measures
Walter, L. C., Davidowitz, N. P., Heineken, P. A., & Covinsky, K. E. (2004) · JAMA · doi:10.1001/jama.291.20.2466 · Cited by 197 · see citing works
Guide to Clinical Preventive Services: An Assessment of the Effectiveness of 169 Interventions
Anderson, C. F. (1989) · Mayo Clinic Proceedings · doi:10.1016/s0025-6196(12)65716-4 · Cited by 191 · see citing works
Gross, C. P., Mallory, R. M., Heiat, A., & Krumholz, H. M. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-137-1-200207020-00007 · Cited by 186 · see citing works
Truman, B. I., Smith-Akin, C. K., Hinman, A. R., Gebbie, K. M., Brownson, R. C., Novick, L. F., Lawrence, R. S., Pappaioanou, M., Fielding, J. E., Evans, C. A., et al. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00124-5 · Cited by 177 · see citing works
Orleans, C. T. (2000) · Health Psychology · doi:10.1037/0278-6133.19.suppl1.76 · Cited by 174 · see citing works
Using RE-AIM Metrics to Evaluate Diabetes Self-Management Support Interventions
Glasgow, R. E., Nelson, C. C., Strycker, L. A., & King, D. K. (2006) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2005.08.037 · Cited by 173 · see citing works
Self-citation(2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-137-1-200207020-00002 · Cited by 172 · see citing works
Dzewaltowski, D. A., Estabrooks, P. A., & Glasgow, R. E. (2004) · Exercise and Sport Sciences Reviews · doi:10.1097/00003677-200404000-00004 · Cited by 145 · see citing works
Self-citationThe significance of quality of life in health care
Kaplan, R. M. (2003) · Quality of Life Research · doi:10.1023/a:1023547632545 · Cited by 140 · see citing works
Eakin, E., Bull, S. S., Glasgow, R. E., & Mason, M. A. (2002) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.266 · Cited by 140 · see citing works
Self-citationStange, K. C., Woolf, S. H., & Gjeltema, K. (2002) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(02)00413-0 · Cited by 138 · see citing works
Handbook of Program Development for Health Behavior Research and Practice
Sussman, S. Y. (2001) · Sage eBooks · doi:10.4135/9781412991445 · Cited by 132 · see citing works
American Journal of Preventive Medicine
(2018) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(18)32034-8 · Cited by 124 · see citing works
(1985) · Health Education · doi:10.1080/00970050.1985.10615844 · Cited by 118 · see citing works
The Weight of Scientific Evidence in Policy and Law
Krimsky, S. (2005) · American Journal of Public Health · doi:10.2105/ajph.2004.044727 · Cited by 113 · see citing works
Evidence Based? Caveat Emptor!
Steinberg, E. P., & Luce, B. R. (2005) · Health Affairs · doi:10.1377/hlthaff.24.1.80 · Cited by 107 · see citing works
Lessons learned from community-based cancer screening intervention research
Pasick, R. J., Hiatt, R. A., & Paskett, E. D. (2004) · Cancer · doi:10.1002/cncr.20508 · Cited by 107 · see citing works
Briss, P. A., Brownson, R. C., Fielding, J. E., & Zaza, S. (2004) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.25.050503.153933 · Cited by 101 · see citing works
Measurement and evaluation in health education and health promotion
Ruzicki, D. A. (1986) · Patient Education and Counseling · doi:10.1016/0738-3991(86)90113-8 · Cited by 95 · see citing works
Health Promotion Interventions for Disadvantaged Women: Overview of the WISEWOMAN Projects
Will, J. C., Farris, R. P., Sanders, C. G., Stockmyer, C. K., & Finkelstein, E. A. (2004) · Journal of Women s Health · doi:10.1089/1540999041281025 · Cited by 89 · see citing works
Community Psychology and Mental Health
Sol, L. G. (2017) · Routledge eBooks · doi:10.4324/9781315081038-14 · Cited by 84 · see citing works
Evaluation in the Health Professions
McGaghie, W. C. (2022) · CRC Press eBooks · doi:10.1201/9781846198557-1 · Cited by 84 · see citing works
Estabrooks, P. A., Dzewaltowski, D. A., Glasgow, R. E., & Klesges, L. M. (2003) · Journal of School Health · doi:10.1111/j.1746-1561.2003.tb06554.x · Cited by 77 · see citing works
Self-citationDaly, J. (2005) · University of California Press eBooks · doi:10.1525/9780520931442-010 · Cited by 77 · see citing works
Trial and Error: The Supreme Court’s Philosophy of Science
Haack, S. (2005) · American Journal of Public Health · doi:10.2105/ajph.2004.044529 · Cited by 68 · see citing works
The challenges of systematically reviewing public health interventions
Jackson, N., Waters, E., & Taskforce, T. G. F. S. R. O. H. P. A. P. H. I. (2004) · Journal of Public Health · doi:10.1093/pubmed/fdh164 · Cited by 64 · see citing works
Implementing organizational changes to promote healthful diet and physical activity at school
Simons-Morton, B. G., Parcel, G. S., & O'Hara, N. M. (1988) · Health Education Quarterly · doi:10.1177/109019818801500110 · Cited by 63 · see citing works
Zaza, S., Lawrence, R. S., Mahan, C. S., Fullilove, M. T., Fleming, D., Isham, G. J., & Pappaioanou, M. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00123-3 · Cited by 55 · see citing works
Green, L. W., & Kreuter, M. W. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00131-2 · Cited by 39 · see citing works
Self-citationNeeds assessment must become more change-focused
Hawe, P. (1996) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1467-842x.1996.tb01624.x · Cited by 35 · see citing works
Fighting back or fighting themselves?
Green, L. W., & Kreuter, M. W. (2002) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(02)00519-6 · Cited by 32 · see citing works
Self-citationTranslation in Tobacco and Drug Abuse Prevention Research
Pentz, M. A., Jasuja, G. K., Rohrbach, L. A., Sussman, S. Y., & Bardo, M. T. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278706287347 · Cited by 29 · see citing works
Martino, L., Stamler, R., Trevisan, M., et al. (1989) · Preventive Medicine · doi:10.1016/0091-7435(89)90052-2 · Cited by 26 · see citing works
Interventions That are CURRES: Cost-Effective, Useful, Realistic, Robust, Evolving, and Sustainable
Rotheram‐Borus, M. J., Flannery, D., & Duan, N. (2004) · Springer eBooks · doi:10.1007/978-3-642-18611-0_17 · Cited by 24 · see citing works
An Ecological Approach to the Prevention of Injuries Due to Drinking and Driving
Simons‐Morton, B. G., Brink, S. G., Simons‐Morton, D. G., McIntyre, R., Chapman, M., Longoria, J., & Parcel, G. S. (1989) · Health Education Quarterly · doi:10.1177/109019818901600308 · Cited by 23 · see citing works
THE JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION
(1917) · JAMA · doi:10.1001/jama.1917.04270060034017 · Cited by 18 · see citing works
TREND: AN IMPORTANT STEP, BUT NOT ENOUGH
Dzewaltowski, D. A., Estabrooks, P. A., Klesges, L. M., & Glasgow, R. E. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.9.1474 · Cited by 15 · see citing works
Self-citationPractice research networks: Promises and pitfalls.
NORQUIST, G. S. (2001) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.8.2.173 · Cited by 11 · see citing works
Leviton, L. C. (2001) · Elsevier eBooks · doi:10.1016/b0-08-043076-7/00731-2 · Cited by 7 · see citing works
Pooling Information About Prior Interventions: A New Program Planning Tool
D’Onofrio, C. N. (2001) · Sage eBooks · doi:10.4135/9781412991445.n12 · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349 · see citing works
How we design feasibility studies
Bowen, D. J., Kreuter, M., Spring, B., Cofta-Woerpel, L., Linnan, L., Weiner, D., Bakken, S., Kaplan, C. P., Squiers, L., Fabrizio, C., et al. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.02.002 · Cited by 3,922 · see citing works
Improving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813 · see citing works
Peters, D. H., Adam, T., Alonge, O., Agyepong, I. A., & Tran, N. (2014) · British Journal of Sports Medicine · doi:10.1136/bmj.f6753 · Cited by 1,109 · see citing works
How Can We Increase Translation of Research into Practice? Types of Evidence Needed
Glasgow, R. E., & Emmons, K. M. (2007) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.28.021406.144145 · Cited by 1,050 · see citing works
Self-citationThe RE-AIM framework: a systematic review of use over time
Gaglio, B., Shoup, J. A., & Glasgow, R. E. (2013) · American Journal of Public Health · doi:10.2105/ajph.2013.301299 · Cited by 1,029 · see citing works
Self-citationFeldstein, A. C., & Glasgow, R. E. (2008) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(08)34030-6 · Cited by 987 · see citing works
Self-citationSpecifying and reporting complex behaviour change interventions: the need for a scientific method
Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-40 · Cited by 976 · see citing works
Diffusion Theory and Knowledge Dissemination, Utilization, and Integration in Public Health
Green, L. W., Ottoson, J. M., García, C., & Hiatt, R. A. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100049 · Cited by 953 · see citing works
Self-citationThe Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806 · see citing works
Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012) · American Journal of Public Health · doi:10.2105/ajph.2012.300755 · Cited by 762 · see citing works
Self-citationKilbourne, A. M., Neumann, M. S., Pincus, H. A., Bauer, M. S., & Stall, R. (2007) · Implementation Science · doi:10.1186/1748-5908-2-42 · Cited by 653 · see citing works
Limitations of the Randomized Controlled Trial in Evaluating Population-Based Health Interventions
Sanson-Fisher, R. W., Bonevski, B., Green, L. W., & D’Este, C. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.007 · Cited by 514 · see citing works
Self-citationAn Overview of Research and Evaluation Designs for Dissemination and Implementation
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., Collins, L. M., Duan, N., Mittman, B. S., Wallace, A., et al. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044215 · Cited by 509 · see citing works
Selecting and Improving Quasi-Experimental Designs in Effectiveness and Implementation Research
Handley, M. A., Lyles, C. R., McCulloch, C., & Cattamanchi, A. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014128 · Cited by 428 · see citing works
A Proposal to Speed Translation of Healthcare Research Into Practice
Kessler, R., & Glasgow, R. E. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.02.023 · Cited by 376 · see citing works
Self-citationCraig, P., Di Ruggiero, E., Frohlich, K. L., Mykhalovskiy, E., White, M., on behalf of the Canadian Institutes of Health Research (CIHR)–National Institute for Health Research (NIHR) Context Guidance Authors Group (listed alphabetically), Campbell, R., Cummins, S., Edwards, N., Hunt, K., et al. (2018) · doi:10.3310/cihr-nihr-01 · Cited by 370 · see citing works
Brownson, R. C., Jacobs, J. A., Tabak, R. G., Hoehner, C. M., & Stamatakis, K. A. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.301165 · Cited by 316 · see citing works
Assessing the generalizability of randomized trial results to target populations
Stuart, E. A., Bradshaw, C. P., & Leaf, P. J. (2015) · Prevention Science · doi:10.1007/s11121-014-0513-z · Cited by 296 · see citing works
Pratt, M., Sarmiento, O. L., Montes, F., Ogilvie, D., Marcus, B. H., Perez, L. G., & Brownson, R. C. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60736-3 · Cited by 295 · see citing works
Developing Robust, Sustainable, Implementation Systems Using Rigorous, Rapid and Relevant Science
Glasgow, R. E., & Chambers, D. (2012) · Clinical and Translational Science · doi:10.1111/j.1752-8062.2011.00383.x · Cited by 278 · see citing works
Self-citationReliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions
Boß, L., Lehr, D., Reis, D., Vis, C., Riper, H., Berking, M., & Ebert, D. D. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5952 · Cited by 251 · see citing works
Bayliss, E. A., Bonds, D. E., Boyd, C. M., Davis, M. M., Finke, B., Fox, M. H., Glasgow, R. E., Goodman, R. A., Heurtin-Roberts, S., Lachenmayr, S., et al. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1643 · Cited by 225 · see citing works
Self-citationStudy Designs for Effectiveness and Translation Research
Mercer, S. L., DeVinney, B. J., Fine, L. J., Green, L. W., & Dougherty, D. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.005 · Cited by 222 · see citing works
Self-citationBugge, C., Williams, B., Hagen, S., Logan, J., Glazener, C., Pringle, S., & Sinclair, L. (2013) · Trials · doi:10.1186/1745-6215-14-353 · Cited by 175 · see citing works
Murphy, S. M., Edwards, R. T., Williams, N., Raisanen, L., Moore, G., Linck, P., Hounsome, N., Din, N. U., & Moore, L. (2012) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2011-200689 · Cited by 182 · see citing works
Dissemination and Implementation Research on Community-Based Cancer Prevention
Rabin, B. A., Glasgow, R. E., Kerner, J. F., Klump, M. P., & Brownson, R. C. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.12.035 · Cited by 172 · see citing works
Self-citationTranslation of a Dementia Caregiver Support Program in a Health Care System—REACH VA
Nichols, L. O., Martindale-Adams, J., Burns, R., Graney, M. J., & Zuber, J. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.548 · Cited by 172 · see citing works
Designing for diffusion: How can we increase uptake of cancer communication innovations?
Dearing, J. W., & Kreuter, M. W. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2010.10.013 · Cited by 147 · see citing works
Kemp, C. G., Jarrett, B. A., Kwon, C.-S., Song, L., Jetté, N., Sapag, J. C., Bass, J., Murray, L., Rao, D., & Baral, S. (2019) · BMC Medicine · doi:10.1186/s12916-018-1237-x · Cited by 138 · see citing works
A thematic analysis of theoretical models for translational science in nursing: Mapping the field
Mitchell, S. A., Fisher, C. A., Hastings, C. E., Silverman, L. B., & Wallen, G. R. (2010) · Nursing Outlook · doi:10.1016/j.outlook.2010.07.001 · Cited by 138 · see citing works
von Thiele Schwarz, U., Aarons, G. A., & Hasson, H. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4668-y · Cited by 134 · see citing works
Reframing the Dissemination Challenge: A Marketing and Distribution Perspective
Kreuter, M. W., & Bernhardt, J. M. (2009) · American Journal of Public Health · doi:10.2105/ajph.2008.155218 · Cited by 125 · see citing works
Horodyska, K., Luszczynska, A., van den Berg, M., Hendriksen, M., Roos, G., De Bourdeaudhuij, I., & Brug, J. (2015) · BMC Public Health · doi:10.1186/s12889-015-1354-9 · Cited by 122 · see citing works
Behavioral Theory in a Diverse Society: Like a Compass on Mars
Pasick, R. J., Burke, N. J., Barker, J. C., Joseph, G., Bird, J. A., Otero-Sabogal, R., Tuason, N., Stewart, S. L., Rakowski, W., Clark, M. A., et al. (2009) · Health Education & Behavior · doi:10.1177/1090198109338917 · Cited by 119 · see citing works
The 5 R's: An Emerging Bold Standard for Conducting Relevant Research in a Changing World
Peek, C. J., Glasgow, R. E., Stange, K. C., Klesges, L. M., Purcell, E. P., & Kessler, R. S. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1688 · Cited by 108 · see citing works
Self-citationRütten, A., Frahsa, A., Abel, T., Bergmann, M., de Leeuw, E., Hunter, D., Jansen, M., King, A., & Potvin, L. (2019) · Health Promotion International · doi:10.1093/heapro/dax053 · Cited by 109 · see citing works
Neta, G., Sanchez, M. A., Chambers, D. A., Phillips, S. M., Leyva, B., Cynkin, L., Farrell, M. M., Heurtin-Roberts, S., & Vinson, C. (2015) · Implementation Science · doi:10.1186/s13012-014-0200-2 · Cited by 99 · see citing works
Implementation science: Relevance in the real world without sacrificing rigor
Geng, E. H., Peiris, D., & Kruk, M. E. (2017) · PLOS Medicine · doi:10.1371/journal.pmed.1002288 · Cited by 106 · see citing works
Montgomery, P., Underhill, K., Gardner, F., Operario, D., & Mayo-Wilson, E. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.03.006 · Cited by 92 · see citing works
Childhood Obesity Policy Research and Practice
Brennan, L. K., Brownson, R. C., & Orleans, C. T. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.08.022 · Cited by 88 · see citing works
Pollet, T. V., & Saxton, T. K. (2019) · Evolutionary Psychological Science · doi:10.1007/s40806-019-00192-2 · Cited by 89 · see citing works
Rowe, H. L., & Trickett, E. J. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9425-3 · Cited by 79 · see citing works
Hilgeman, M. M., Allen, R. S., Snow, A. L., Durkin, D. W., DeCoster, J., & Burgio, L. (2014) · Aging & Mental Health · doi:10.1080/13607863.2013.868403 · Cited by 77 · see citing works
Wagemakers, A., Koelen, M. A., Lezwijn, J., & Vaandrager, L. (2010) · Global Health Promotion · doi:10.1177/1757975910375166 · Cited by 55 · see citing works
The Healthy Primary School of the Future: study protocol of a quasi-experimental study
Willeboordse, M., Jansen, M. W., van den Heijkant, S. N., Simons, A., Winkens, B., de Groot, R. H. M., Bartelink, N., Kremers, S. P., van Assema, P., Savelberg, H. H., et al. (2016) · BMC Public Health · doi:10.1186/s12889-016-3301-9 · Cited by 54 · see citing works
Diffusion theory and knowledge dissemination, utilization and integration
Green, L. W., Ottoson, J. M., García, C., Hiatt, R. A., & Roditis, M. L. (2014) · University of Kentucky · doi:10.13023/fphssr.0301.03 · Cited by 49 · see citing works
Self-citationScope, A., Leaviss, J., Kaltenthaler, E., Parry, G., Sutcliffe, P., Bradburn, M., & Cantrell, A. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-321 · Cited by 38 · see citing works
Komesidou, R., Feller, M. J., Wolter, J. A., Ricketts, J., Rasner, M. G., Putman, C. A., & Hogan, T. P. (2022) · Journal of Research in Reading · doi:10.1111/1467-9817.12381 · Cited by 31 · see citing works
Mookherji, S., & LaFond, A. (2013) · Evaluation · doi:10.1177/1356389013495212 · Cited by 18 · see citing works
A Tool for Rating Chronic Disease Prevention and Public Health Interventions
Kelly, C., Scharff, D., LaRose, J., Dougherty, N. L., Hessel, A. S., & Brownson, R. C. (2013) · Preventing Chronic Disease · doi:10.5888/pcd10.130173 · Cited by 16 · see citing works
Addicted to discovery: Does the quest for new knowledge hinder practice improvement?
Perl, H. I. (2011) · Addictive Behaviors · doi:10.1016/j.addbeh.2011.01.027 · Cited by 15 · see citing works
Hamadi, L., Hilson, R., Lunn, A., Ralph, E., Rodrigues, E., & Sohail, R. (2023) · Eating Disorders · doi:10.1080/10640266.2022.2099606 · Cited by 7 · see citing works
“However, there is a need for studies to be conducted in real-world clinical settings to establish whether interventions fit the populations that are seen in services (Green & Glasgow, 2006).”
Background
- Authors
- Green, L. W., & Glasgow, R. E.
- Affiliations
- University of California, San Francisco (US)
- Kaiser Permanente (US)
- ORCID
- Glasgow, Russell E.
- Venue
- Evaluation & the Health Professions
- Publisher
- SAGE Publications
- Published
- 2006-03
- Volume
- 29
- Issue
- 1
- Pages
- 126-153
- ISSN
- 0163-2787 (ISSN-L)
- 1552-3918
- OpenAlex
- W2167619051
- Cited by
- 922
- References
- 100
- Citations by year
- 2026: 14 · 2025: 24 · 2024: 27 · 2023: 21 · 2022: 29 · 2021: 44 · 2020: 25 · 2019: 45 · 2018: 42 · 2017: 52 · 2016: 67 · 2015: 72 · 2014: 59 · 2013: 65 · 2012: 63
- FWCI
- 99.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Evaluation & the Health Professions (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA 90974-01, R01CA090974)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- practice-based evidence, evidence-based practice, generalizability, research relevance, program planning, research utilization, practice-based research
- MeSH terms
- Diffusion of Innovation, Humans, Research Design, Reproducibility of Results, Program Evaluation, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review