Behavior change intervention research in healthcare settings
Abstract
Background Information to judge both the internal and external validity of health behavior research conducted in healthcare settings is vital to translate research findings to practice. This paper reviews the extent to which this research has reported on elements of internal and external validity, with emphasis on the extent to which research has been conducted in representative settings with representative populations.Methods A comprehensive review was conducted of controlled interventions for dietary change, physical activity, or smoking cessation conducted in healthcare settings and published in 12 leading health behavior journals between 1996 and 2000. Using the RE-AIM (reach, effectiveness, adoption, implementation, maintenance) framework, the characteristics and results of these studies were summarized to document the extent to which intervention reach, adoption, implementation, and maintenance were reported and what has been learned about each of these dimensions.Results A total of 36 studies qualified for review. Participation rates among eligible patients were reported in 69% of studies and were generally quite high; in contrast, only 30% of studies reported on participation rates among either healthcare settings or providers. Implementation data were reported in 77% of the studies and these rates were generally high, with the caveat that intervention was often delivered by paid research staff. Long-term maintenance results were reported very consistently at the individual level, but program continuation was almost never reported at the setting level.Conclusions We conclude that a much stronger emphasis needs to be placed on the representativeness of providers and settings that are studied. Examples of how this can be done and recommendations for future research are provided.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The gap between research and practice reduces the impact that effective behavior change interventions can have on public health.
“This gap between research and practice reduces the impact that effective behavior change interventions can have on public health [12,13].”
From Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research (2014) · cites this paper as [12]
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
(1979) · Medical Entomology and Zoology · Cited by 11,252 · see citing works
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · see citing works
Self-citationMoher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373 · see citing works
Hayward, G. (1984) · Technovation · doi:10.1016/0166-4972(84)90018-x · Cited by 2,771 · see citing works
Handbook of Research Methods in Social and Personality Psychology
West, T., Reis, H. T., Judd, C. M., Banaji, M. R., Crandall, C., Giner-Sorolla, R., Biernat, M., Fiedler, K., Ermark, F., Tepper, S. J., et al. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123 · Cited by 2,133 · see citing works
Physician advice for smoking cessation
Stead, L. F., Buitrago, D., Preciado, N., Sanchez, G., Hartmann-Boyce, J., & Lancaster, T. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000165.pub4 · Cited by 1,955 · see citing works
Handbook of Research Methods in Social and Personality Psychology: Author Index
Reis, H. T., & Judd, C. M. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996481 · Cited by 1,080 · see citing works
Cha, M., Eastwaad, S., Hartan, R., Maher, D., Olkin, I., Pitkin, R., Rennie, D., Schulz, K. F., Simel, D. L., & Straup, D. F. (1996) · Cited by 736 · see citing works
Glasgow, R., Mckay, H., Piette, J. D., & Reynolds, K. (2001) · Patient Education and Counseling · doi:10.1016/s0738-3991(00)00186-5 · Cited by 643 · see citing works
Self-citationResearch Design and Issues of Validity
Brewer, M. B., & Crano, W. D. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996481.005 · Cited by 519 · see citing works
From Research to “Best Practices” in Other Settings and Populations
Green, L. W. (2001) · American Journal of Health Behavior · doi:10.5993/ajhb.25.3.2 · Cited by 407 · see citing works
Words Without Action? The Production, Dissemination, And Impact Of Consensus Recommendations
Lomas, J. (1991) · Annual Review of Public Health · doi:10.1146/annurev.pu.12.050191.000353 · Cited by 358 · see citing works
Abrams, D. B., Orleans, C. T., NIAURA, R. S., Goldstein, M. G., Prochaska, J. O., & Velicer, W. F. (1996) · Annals of Behavioral Medicine · doi:10.1007/bf02895291 · Cited by 287 · see citing works
Words Without Action? The Production, Dissemination, And Impact Of Consensus Recommendations
Lomas, J. (1991) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.12.1.41 · Cited by 274 · see citing works
A model for the institutionalization of health promotion programs
Goodman, R. M., & Steckler, A. (1989) · Family & Community Health · doi:10.1097/00003727-198902000-00009 · Cited by 224 · see citing works
Physician advice for smoking cessation
Silagy, C. A., & Stead, L. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000165 · Cited by 218 · see citing works
Health promotion research and the diffusion and institutionalization of interventions
Oldenburg, B. F. (1999) · Health Education Research · doi:10.1093/her/14.1.121 · Cited by 168 · see citing works
Incorporating physical activity advice into primary care
Albright, C. L., Cohen, S. J., Gibbons, L. W., Miller, S., Marcus, B. H., Sallis, J. F., Imai, K., Jernick, J., & Simons‐Morton, D. G. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00155-5 · Cited by 117 · see citing works
Smoking Cessation Interventions among Hospitalized Patients: What Have We Learned?
France, E. K., Glasgow, R. E., & Marcus, A. C. (2001) · Preventive Medicine · doi:10.1006/pmed.2000.0824 · Cited by 112 · see citing works
Self-citationRating Our Progress in Population Health Promotion: Report Card on Six Behaviors
Orleans, C. T., Gruman, J. C., Ulmer, C. C., Emont, S. L., & Hollendonner, J. K. (1999) · American Journal of Health Promotion · doi:10.4278/0890-1171-14.2.75 · Cited by 71 · see citing works
RICHMOND, R. L., Mendelsohn, C. P., & Kehoe, L. A. (1998) · Preventive Medicine · doi:10.1006/pmed.1997.0240 · Cited by 47 · see citing works
Wakefield, M. A., & JONES, W. R. (1998) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1467-842x.1998.tb01383.x · Cited by 45 · see citing works
Health Behavior Research: The Quality of the Evidence Base
Oldenburg, B. F., Ffrench, M., & Sallis, J. F. (2000) · American Journal of Health Promotion · doi:10.4278/0890-1171-14.4.253 · Cited by 31 · see citing works
Evidence-Based Medicine Meets Cost-effectiveness Analysis
Clancy, C. M. (1996) · JAMA · doi:10.1001/jama.1996.03540040073036 · Cited by 29 · see citing works
Gochman, D. S. (1988) · Springer eBooks · doi:10.1007/978-1-4899-0833-9_23 · Cited by 22 · see citing works
Green, L. W., & Stoto, . A. (1997) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(18)30086-2 · Cited by 17 · see citing works
Implementing a Dietary Intervention in Primary Care Practice: A Process Evaluation
Lazovich, D., Curry, S. J., Beresford, S. A. A., Kristal, A. R., & Wagner, E. H. (2000) · American Journal of Health Promotion · doi:10.4278/0890-1171-15.2.118 · Cited by 16 · see citing works
The agency for healthcare research and quality and the U.S. preventive services task force
Eisenberg, J. M., & Kamerow, D. B. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(01)00270-7 · Cited by 11 · see citing works
Linking Research and Public Health Practice
Institute of Medicine (1997) · National Academies Press eBooks · doi:10.17226/5564 · Cited by 10 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review
Glasgow, R. E., Harden, S. M., Gaglio, B., Rabin, B., Smith, M. L., Porter, G. C., Ory, M. G., & Estabrooks, P. A. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00064 · Cited by 2,528 · see citing works
Self-citationGlasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836 · see citing works
Self-citationGlasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2701_2 · Cited by 635 · see citing works
Self-citationMultiple behavioral risk factor interventions in primary care
Goldstein, M. G., Whitlock, E. P., & DePue, J. (2004) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2004.04.023 · Cited by 467 · see citing works
Huijg, J. M., Gebhardt, W. A., Crone, M. R., Dusseldorp, E., & Presseau, J. (2014) · Implementation Science · doi:10.1186/1748-5908-9-11 · Cited by 385 · see citing works
Glasgow, R. E., Magid, D. J., Beck, A., Ritzwoller, D., & Estabrooks, P. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000163645.41407.09 · Cited by 308 · see citing works
Self-citationGlasgow, R. E., Boles, S. M., McKay, H. G., Feil, E. G., & Barrera, M. (2003) · Preventive Medicine · doi:10.1016/s0091-7435(02)00056-7 · Cited by 287 · see citing works
Self-citationToobert, D. J., Glasgow, R. E., Strycker, L. A., Barrera, M., Ritzwoller, D. P., & Weidner, G. (2007) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-4-1 · Cited by 255 · see citing works
Self-citationLiu, J., Davidson, E., Bhopal, R., White, M., Johnson, M., Netto, G., Deverill, M., & Sheikh, A. (2012) · Health Technology Assessment · doi:10.3310/hta16440 · Cited by 237 · see citing works
A practical randomized trial to improve diabetes care
Glasgow, R. E., Nutting, P. A., King, D. K., Nelson, C. C., Cutter, G., Gaglio, B., Rahm, A. K., Whitesides, H., & Amthauer, H. (2004) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2004.30425.x · Cited by 94 · see citing works
Eakin, E. G., Bull, S. S., Riley, K. M., Reeves, M. M., McLaughlin, P., & Gutierrez, S. (2007) · Health Psychology · doi:10.1037/0278-6133.26.4.392 · Cited by 82 · see citing works
Self-citationEakin, E. G., Reeves, M. M., Lawler, S. P., Oldenburg, B., Del Mar, C., Wilkie, K., Spencer, A., Battistutta, D., & Graves, N. (2008) · Contemporary Clinical Trials · doi:10.1016/j.cct.2007.10.005 · Cited by 70 · see citing works
“Real-World” Practical Evaluation Strategies: A Review of Telehealth Evaluation
Agboola, S., Hale, T. M., Masters, C., Kvedar, J., & Jethwani, K. (2014) · JMIR Research Protocols · doi:10.2196/resprot.3459 · Cited by 49 · see citing works
Themed Review: Clinical Interventions to Promote Physical Activity in Youth
Meriwether, R. A., Lobelo, F., & Pate, R. R. (2008) · American Journal of Lifestyle Medicine · doi:10.1177/1559827607308557 · Cited by 22 · see citing works
(2012) · Psychology & Health · doi:10.1080/08870446.2012.707817 · Cited by 5 · see citing works
- Authors
- Glasgow, R. E., Bull, S. S., Gillette, C., Klesges, L. M., & Dzewaltowski, D. A.
- Affiliations
- University of Tennessee Health Science Center (US)
- Kansas State University (US)
- Corresponding author
- Glasgow, Russell E
- Venue
- American Journal of Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 2002-07
- Volume
- 23
- Issue
- 1
- Pages
- 62-69
- ISSN
- 0749-3797 (ISSN-L)
- OpenAlex
- W2045982732
- Cited by
- 181
- References
- 30
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 2 · 2023: 3 · 2021: 5 · 2020: 7 · 2019: 7 · 2018: 4 · 2017: 2 · 2016: 10 · 2015: 8 · 2014: 10 · 2013: 10 · 2012: 14
- FWCI
- 24.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Preventive Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- behaviour change interventions, healthcare settings, internal validity, generalizability, RE-AIM framework, intervention reach, intervention adoption, intervention implementation, intervention maintenance, dietary change, physical activity, smoking cessation, research generalizability
- MeSH terms
- Physical Exertion, Feeding Behavior, Health Facilities, Humans, Review Literature as Topic, Reproducibility of Results, Health Behavior, Smoking Cessation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
