Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Current public health and medical evidence rely heavily on efficacy information to make decisions regarding intervention impact. This evidence base could be enhanced by research studies that evaluate and report multiple indicators of internal and external validity such as Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) as well as their combined impact. However, indices that summarize the combined impact of, and complex interactions among, intervention outcome dimensions are not currently available. We propose and discuss a series of composite metrics that combine two or more RE-AIM dimensions, and can be used to estimate overall intervention impact. Although speculative and, at this point, there have been limited empirical data on these metrics, they extend current methods and are offered to yield more integrated composite outcomes relevant to public health. Such approaches offer potential to help identify interventions most likely to meaningfully impact population health.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Public health evaluation frameworks often guide the choice of outcome measure in feasibility and pilot implementation work and include RE_AIM [60], PRECEDE_PROCEED [61], Proctor and colleagues framework on outcomes for implementation research [62] and more recently, the “Implementation Mapping” framework [63].”
From Guidance for conducting feasibility and pilot studies for implementation trials (2020) · cites this paper as [60]
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
Health Behavior and Health Education: Theory, Research, and Practice
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-4-350_1 · Cited by 13,207
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · cited 1×
“tential public health impact of an intervention [6, 7].”
BackgroundSelf-citationDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · cited 1×
“Interventions are often inconsistently delivered, so this variability needs to be documented [21].”
BackgroundGlasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836
Self-citationMerrifield, P. R., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974) · American Educational Research Journal · doi:10.3102/00028312011001054 · Cited by 1,827
The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles
Merrifield, P. R., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974) · American Educational Research Journal · doi:10.2307/1162145 · Cited by 1,819
Tunis (2003) · doi:10.1001/jama.290.12.1624 · Cited by 1,724
(1999) · Cited by 1,648
Clinical Research to Clinical Practice — Lost in Translation?
Lenfant, C. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa035507 · Cited by 898
Tufte, E. R. (2006) · Cited by 673
Evidence-Based Decision Making in Public Health
Brownson, R. C., Gurney, J. G., & Land, G. H. (1999) · Journal of Public Health Management and Practice · doi:10.1097/00124784-199909000-00012 · Cited by 341
Glasgow, R. E., Magid, D. J., Beck, A., Ritzwoller, D., & Estabrooks, P. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000163645.41407.09 · Cited by 308 · cited 1×
“Most practical clinical trials and dissemination studies assess multiple outcomes rather than a single dependent variable [12, 13].”
BackgroundSelf-citationProchaska, J. O., Velicer, W. F., Fava, J. L., Rossi, J. S., & Tsoh, J. Y. (2001) · Addictive Behaviors · doi:10.1016/s0306-4603(00)00151-9 · Cited by 306
Avoiding Type III Errors in Health Education Program Evaluations: A Case Study
Basch, C. E., Sliepcevich, E. M., Gold, R. S., Duncan, D. F., & Kolbe, L. J. (1985) · Health Education Quarterly · doi:10.1177/109019818501200311 · Cited by 244
Translating Research to Practice
Glasgow, R. E. (2003) · Diabetes Care · doi:10.2337/diacare.26.8.2451 · Cited by 132
Self-citationEnhancing Performance Measurement: NCQA's Road Map for a Health Information Framework
Schneider, E. C., Riehl, V., Courte-Wienecke, S., Eddy, D. M., & Sennett, C. (1999) · JAMA · doi:10.1001/jama.282.12.1184 · Cited by 114
Cost-Effectiveness of a Hospital-Based Smoking Cessation Intervention
Meenan, R. T., Stevens, V. J., Hornbrook, M. C., La Chance, P.-A., Glasgow, R. E., Hollis, J. F., Lichtenstein, E., & Vogt, T. M. (1998) · Medical Care · doi:10.1097/00005650-199805000-00007 · Cited by 100
Self-citationImplementation and Effectiveness of a Brief Smoking-Cessation Intervention for Hospital Patients
Stevens, V. J., Glasgow, R. E., Hollis, J. F., & Mount, K. (2000) · Medical Care · doi:10.1097/00005650-200005000-00002 · Cited by 60
Self-citationThe Prevention Index: Using Technology to Improve Quality Assessment
VOGT, T. M., Aickin, M. G., Ahmed, F., & Schmidt, M. M. (2004) · Health Services Research · doi:10.1111/j.1475-6773.2004.00242.x · Cited by 38
The brave new world of health care
Lamm, R. D. (1991) · The Annals of Thoracic Surgery · doi:10.1016/0003-4975(91)91389-d · Cited by 26
Health behavior and health education: The past, present, and future
Abrams, D. L., Emmons, K. M., & Linnan, L. (1997) · Cited by 25
Data to estimate the similarity of tobacco research samples to intended populations
Hughes, J. (2004) · Nicotine & Tobacco Research · doi:10.1080/14622200310001656993 · Cited by 17
TREND: AN IMPORTANT STEP, BUT NOT ENOUGH
Dzewaltowski, D. A., Estabrooks, P. A., Klesges, L. M., & Glasgow, R. E. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.9.1474 · Cited by 15
Self-citation
Cited by
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
How we design feasibility studies
Bowen, D. J., Kreuter, M., Spring, B., Cofta-Woerpel, L., Linnan, L., Weiner, D., Bakken, S., Kaplan, C. P., Squiers, L., Fabrizio, C., et al. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.02.002 · Cited by 4,021
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
“The RE-AIM model (Glasgow et al. 1999; Glasgow et al. 2006) explicitly identifies the ‘‘maintenance’’ phase of implementation as critical in sustaining effective health interventions.”
MethodGreen, L. W., & Glasgow, R. E. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284445 · Cited by 922
“across population subgroups ( Glasgow, Klesges, et al., in press ), with special reference to groups identified in health disparities research (Institute of Medicine, 2003).”
BackgroundMethodInfluentialSelf-citationDamschroder, L. J., Reardon, C. M., Opra Widerquist, M. A., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-021-01181-5 · Cited by 784
Metadata
- Authors
- Glasgow, R. E.
- Affiliations
- Kaiser Permanente (US)
- Corresponding author
- Glasgow, R. E.
- ORCID
- Glasgow, R. E.
- Venue
- Health Education Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-05-15
- Volume
- 21
- Issue
- 5
- Pages
- 688-694
- ISSN
- 0268-1153 (ISSN-L)
- 1465-3648
- OpenAlex
- W2157754201
- Cited by
- 565
- References
- 25
- Citations by year
- 2026: 21 · 2025: 23 · 2024: 12 · 2023: 41 · 2022: 25 · 2021: 40 · 2020: 43 · 2019: 45 · 2018: 37 · 2017: 33 · 2016: 33 · 2015: 32 · 2014: 37 · 2013: 32 · 2012: 39
- FWCI
- 23.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Health Education Research (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Robert Wood Johnson Foundation
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Public Health Policies and Education
- Keywords
- RE-AIM framework, health promotion programs, intervention impact evaluation, composite measures, REACH regulation, effectiveness, adoption, implementation, maintenance, internal and external validity, decision-making, population health
- MeSH terms
- Decision Making, Health Promotion, Humans, Program Evaluation, Public Health Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.