Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Mobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear. OBJECTIVE: The purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to determine the extent to which mHealth intervention research for promoting PA reports on factors that inform generalizability across settings and populations and to provide recommendations for investigators planning to conduct this type of research. METHODS: Twenty articles reflecting 15 trials published between 2000 and 2012 were identified through a systematic review process (ie, queries of three online databases and reference lists of eligible articles) and met inclusion criteria (ie, implementation of mobile technologies, target physical activity, and provide original data). Two researchers coded each article using a validated RE-AIM data extraction tool (reach, efficacy/effectiveness, adoption, implementation, maintenance). Two members of the study team independently abstracted information from each article (inter-rater reliability >90%) and group meetings were used to gain consensus on discrepancies. RESULTS: The majority of studies were randomized controlled trials (n=14). The average reporting across RE-AIM indicators varied by dimension (reach=53.3%, 2.67/5; effectiveness/efficacy=60.0%, 2.4/4; adoption=11.1%, 0.7/6; implementation=24.4%, 0.7/3; maintenance=0%, 0/3). While most studies described changes in the primary outcome (effectiveness), few addressed the representativeness of participants (reach) or settings (adoption) and few reported on issues related to maintenance and degree of implementation fidelity. CONCLUSIONS: This review suggests that more focus is needed on research designs that highlight and report on both internal and external validity indicators. Specific recommendations are provided to encourage future mHealth interventionists and investigators to report on representativeness, settings, delivery agents for planned interventions, the extent to which protocol is delivered as intended, and maintenance of effects at the individual or organizational level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Physical Activity in the United States Measured by Accelerometer
TROIANO, R. P., BERRIGAN, D., DODD, K. W., MÂSSE, L. C., TILERT, T., & MCDOWELL, M. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31815a51b3 · Cited by 7,638 · cited 1×
“Likewise, it is a concern in the United States where only 6-11% of children [2] and 8.”
BackgroundEvaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · cited 10×
“Useful for replication and comparison of resources needed to resources available in a practice setting [26].”
BackgroundInfluentialHeron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438
Behavior change interventions delivered by mobile telephone short message service
Fjeldsoe, B. S., Marshall, A. L., & Miller, Y. D. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.09.040 · Cited by 1,213 · cited 2×
“Specifically, related to PA, mHealth interventions that deliver information and behavioral strategies through short message service (SMS) via mobile phones have been developed to increase PA [13-17].”
BackgroundPhysical Activity in U.S. Adults
Tucker, J. M., Welk, G. J., & Beyler, N. K. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2010.12.016 · Cited by 977 · cited 1×
“2% of adults meet the national PA guidelines based on objective PA assessments [3].”
BackgroundHealthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882
Glasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2701_2 · Cited by 635
Self-citationMartínez-Pérez, B., de la Torre-Díez, I., & López-Coronado, M. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2600 · Cited by 550 · cited 1×
“This growth in mobile technology ownership has led to the development of a number of mobile health (mHealth) intervention reviews [9-12].”
BackgroundHurling, R., Catt, M., De Boni, M., Fairley, B. W., Hurst, T., Murray, P., Richardson, A., & Sodhi, J. S. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.2.e7 · Cited by 536
Meta-analysis of internet-delivered interventions to increase physical activity levels
Davies, C. A., Spence, J. C., Vandelanotte, C., Caperchione, C. M., & Mummery, W. (2012) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-9-52 · Cited by 488
Cited by
Vandelanotte, C., Müller, A. M., Short, C. E., Hingle, M., Nathan, N., Williams, S. L., Lopez, M. L., Parekh, S., & Maher, C. A. (2016) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2015.12.006 · Cited by 396
A systematic review of just-in-time adaptive interventions (JITAIs) to promote physical activity
Hardeman, W., Houghton, J., Lane, K., Jones, A., & Naughton, F. (2019) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-019-0792-7 · Cited by 396
Methods for knowledge synthesis: An overview
Whittemore, R., Chao, A., Jang, M., Minges, K. E., & Park, C. (2014) · Heart & Lung · doi:10.1016/j.hrtlng.2014.05.014 · Cited by 349
Integrating Physical Activity in Primary Care Practice
AuYoung, M., Linke, S. E., Pagoto, S., Buman, M. P., Craft, L. L., Richardson, C. R., Hutber, A., Marcus, B. H., Estabrooks, P., & Sheinfeld Gorin, S. (2016) · The American Journal of Medicine · doi:10.1016/j.amjmed.2016.02.008 · Cited by 124
Self-citationvan Drongelen, A., Boot, C. R., Hlobil, H., Twisk, J. W., Smid, T., & van der Beek, A. J. (2014) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3447 · Cited by 101
Metadata
- Authors
- Blackman, K. C., Zoellner, J., Berrey, L. M., Alexander, R., Fanning, J., Hill, J. L., & Estabrooks, P. A.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2013-10-04
- Volume
- 15
- Issue
- 10
- Pages
- e224
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2037935612
- Cited by
- 98
- References
- 23
- FWCI
- 1.55
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework. https://app.cochat.ai/papers/10.2196/jmir.2745
- The paper
- Blackman, K. C., Zoellner, J., Berrey, L. M., Alexander, R., Fanning, J., Hill, J. L., & Estabrooks, P. A. (2013). Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework. Journal of Medical Internet Research. https://doi.org/10.2196/jmir.2745
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.