Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Current public health and medical evidence rely heavily on efficacy information to make decisions regarding intervention impact. This evidence base could be enhanced by research studies that evaluate and report multiple indicators of internal and external validity such as Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) as well as their combined impact. However, indices that summarize the combined impact of, and complex interactions among, intervention outcome dimensions are not currently available. We propose and discuss a series of composite metrics that combine two or more RE-AIM dimensions, and can be used to estimate overall intervention impact. Although speculative and, at this point, there have been limited empirical data on these metrics, they extend current methods and are offered to yield more integrated composite outcomes relevant to public health. Such approaches offer potential to help identify interventions most likely to meaningfully impact population health.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Public health evaluation frameworks often guide the choice of outcome measure in feasibility and pilot implementation work and include RE_AIM [60], PRECEDE_PROCEED [61], Proctor and colleagues framework on outcomes for implementation research [62] and more recently, the “Implementation Mapping” framework [63].”
From Guidance for conducting feasibility and pilot studies for implementation trials (2020) · cites this paper as [60]
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
Health Behavior and Health Education: Theory, Research, and Practice
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-4-350_1 · Cited by 13,207
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · cited 1×
“tential public health impact of an intervention [6, 7].”
BackgroundSelf-citationDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · cited 1×
“Interventions are often inconsistently delivered, so this variability needs to be documented [21].”
BackgroundGlasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836
Self-citationMerrifield, P. R., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974) · American Educational Research Journal · doi:10.3102/00028312011001054 · Cited by 1,827
The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles
Merrifield, P. R., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974) · American Educational Research Journal · doi:10.2307/1162145 · Cited by 1,819
Tunis (2003) · doi:10.1001/jama.290.12.1624 · Cited by 1,724
Cited by
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
How we design feasibility studies
Bowen, D. J., Kreuter, M., Spring, B., Cofta-Woerpel, L., Linnan, L., Weiner, D., Bakken, S., Kaplan, C. P., Squiers, L., Fabrizio, C., et al. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.02.002 · Cited by 4,021
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
“The RE-AIM model (Glasgow et al. 1999; Glasgow et al. 2006) explicitly identifies the ‘‘maintenance’’ phase of implementation as critical in sustaining effective health interventions.”
MethodGreen, L. W., & Glasgow, R. E. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284445 · Cited by 922
“across population subgroups ( Glasgow, Klesges, et al., in press ), with special reference to groups identified in health disparities research (Institute of Medicine, 2003).”
BackgroundMethodInfluentialSelf-citationDamschroder, L. J., Reardon, C. M., Opra Widerquist, M. A., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-021-01181-5 · Cited by 784
Metadata
- Authors
- Glasgow, R. E.
- Affiliations
- Kaiser Permanente (US)
- Corresponding author
- Glasgow, R. E.
- ORCID
- Glasgow, R. E.
- Venue
- Health Education Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-05-15
- Volume
- 21
- Issue
- 5
- Pages
- 688-694
- ISSN
- 0268-1153 (ISSN-L)
- 1465-3648
- OpenAlex
- W2157754201
- Cited by
- 565
- References
- 25
- Citations by year
- 2026: 21 · 2025: 23 · 2024: 12 · 2023: 41 · 2022: 25 · 2021: 40 · 2020: 43 · 2019: 45 · 2018: 37 · 2017: 33 · 2016: 33 · 2015: 32 · 2014: 37 · 2013: 32 · 2012: 39
- FWCI
- 23.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Health Education Research (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Robert Wood Johnson Foundation
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Public Health Policies and Education
- Keywords
- RE-AIM framework, health promotion programs, intervention impact evaluation, composite measures, REACH regulation, effectiveness, adoption, implementation, maintenance, internal and external validity, decision-making, population health
- MeSH terms
- Decision Making, Health Promotion, Humans, Program Evaluation, Public Health Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.