The Effectiveness of Mobile-Health Technologies to Improve Health Care Service Delivery Processes: A Systematic Review and Meta-Analysis
Open accessThe DOI matches its Crossref record; 69 of the 70 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Mobile health interventions could have beneficial effects on health care delivery processes. We aimed to conduct a systematic review of controlled trials of mobile technology interventions to improve health care delivery processes. METHODS AND FINDINGS: We searched for all controlled trials of mobile technology based health interventions using MEDLINE, EMBASE, PsycINFO, Global Health, Web of Science, Cochrane Library, UK NHS HTA (Jan 1990-Sept 2010). Two authors independently extracted data on allocation concealment, allocation sequence, blinding, completeness of follow-up, and measures of effect. We calculated effect estimates and we used random effects meta-analysis to give pooled estimates. We identified 42 trials. None of the trials had low risk of bias. Seven trials of health care provider support reported 25 outcomes regarding appropriate disease management, of which 11 showed statistically significant benefits. One trial reported a statistically significant improvement in nurse/surgeon communication using mobile phones. Two trials reported statistically significant reductions in correct diagnoses using mobile technology photos compared to gold standard. The pooled effect on appointment attendance using text message (short message service or SMS) reminders versus no reminder was increased, with a relative risk (RR) of 1.06 (95% CI 1.05-1.07, I(2) = 6%). The pooled effects on the number of cancelled appointments was not significantly increased RR 1.08 (95% CI 0.89-1.30). There was no difference in attendance using SMS reminders versus other reminders (RR 0.98, 95% CI 0.94-1.02, respectively). To address the limitation of the older search, we also reviewed more recent literature. CONCLUSIONS: The results for health care provider support interventions on diagnosis and management outcomes are generally consistent with modest benefits. Trials using mobile technology-based photos reported reductions in correct diagnoses when compared to the gold standard. SMS appointment reminders have modest benefits and may be appropriate for implementation. High quality trials measuring clinical outcomes are needed. Please see later in the article for the Editors' Summary.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As per our knowledge, there has been no robust impact analysis of the m-health intervention from India [21].”
From Impact of m‐health application used by community health volunteers on improving utilisation of maternal, new‐born and child health care services in a rural area of Uttar Pradesh, India (2017) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although low-cost mobile devices provide new and potentially transformative opportunities for all those working to improve health outcomes, nevertheless, to date, there is little evidence on mHealth interventions that have been implemented in LMICs and assessed in terms of specific outcomes.”
From Assessing the impact of mHealth interventions in low- and middle-income countries – what has been shown to work? (2014) · cites this paper as [7]
Experimental — accuracy not yet measuredIn the citing paper
“Another review, focused on the impact of SMS interventions, found that text messaging increased adherence to antiretroviral treatment with reductions in viral load and biochemically verified smoking cessation, yet these effects were “small and of borderline clinical importance” [9].”
From Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review (2015) · cites this paper as [9]
In the citing paper
“The reported impact of mHealth interventions is mixed, with studies showing modest benefits for some clinical diagnosis and management support outcomes [9,10].”
From Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review (2015) · cites this paper as [9]
In the citing paper
“One of the ways to generate demand is through quality counselling of pregnant women [21] and use of m-health with its associated audio visual support for improving the quality of counselling delivered through ASHAs.”
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pharmacological interventions for somatoform disorders in adults
Kleinstäuber, M., Witthöft, M., Steffanowski, A., van Marwijk, H., Hiller, W., & Lambert, M. J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010628.pub2 · Cited by 11,335
Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1. The Cochrane Collaboration
Higgins, J. P. T., Green, S. R., & Higgins, J. P. T. (2008) · Cited by 7,175
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 1×
“Factors influencing heterogeneity of effect estimates include low trial quality, in particular inadequate allocation concealment [60], participant factors such as demographics or disease status, the setting (hospital, primary care), the intervention features (components, intensity, timing), the…”
Free, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766 · cited 3×
“Other trials identified are reported elsewhere [13].”
InfluentialSelf-citationHealthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882 · cited 3×
“The review expands and updates the findings of earlier systematic reviews that focussed on specific devices, and/or specific functions, and/or specific health topics [8,11,58].”
Research Approaches to Mobile Use in the Developing World: A Review of the Literature
Donner, J. (2008) · The Information Society · doi:10.1080/01972240802019970 · Cited by 743 · cited 1×
“In low-income countries, mobile communication technology is the fastest growing sector of the communications industry and geographical coverage is high [4–7].”
Early Diagnosis of Cutaneous Melanoma: Revisiting the ABCD Criteria
Abbasi, N. R., Shaw, H. M., Rigel, D. S., Friedman, R. J., McCarthy, W. H., Osman, I., Kopf, A. W., & Polsky, D. (2004) · JAMA · doi:10.1001/jama.292.22.2771 · Cited by 668
Mobile phone messaging reminders for attendance at healthcare appointments
Gurol-Urganci, I., de Jongh, T., Vodopivec-Jamsek, V., Atun, R., & Car, J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007458.pub3 · Cited by 594 · cited 1×
“and Car that text messages can reduce missed appointments [8,59].”
Free, C., Phillips, G., Felix, L., Galli, L., Patel, V., & Edwards, P. (2010) · BMC Research Notes · doi:10.1186/1756-0500-3-250 · Cited by 539 · cited 1×
“We adhered to our published plan of investigation as outlined in the study protocol [12].”
Self-citationZurovac, D., Sudoi, R. K., Akhwale, W. S., Ndiritu, M., Hamer, D. H., Rowe, A. K., & Snow, R. W. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60783-6 · Cited by 403 · cited 3×
“One high quality trial published since our literature search was completed shows benefits in adherence to malaria treatment guidelines [61].”
Influential
Research works printed but not linked: 4
- 2010, The world in 2010: ICT facts and figures, International Telecommunication Union
- 2009, The consumer experience: telecoms, internet and digital broadcasting 2009, Evaluation report
- TG McLeod, 2006, Teaching geriatric functional assessment to internal medicine residents: A randomized trial of a personal digital assistant - Based tool, Journal of General Internal Medicine, 21, 134
- India adds 13.45 mn mobile users in Feb: TRAI, The Economic Times India
Cited by
Free, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766
“A cu te d is e a se B o lle 20 09 [1 33 ] U H U L L L L”
Self-citationGlobal health 2035: a world converging within a generation
Jamison, D. T., Summers, L. H., Alleyne, G., Arrow, K. J., Berkley, S., Binagwaho, A., Bustreo, F., Evans, D., Feachem, R. G. A., Frenk, J., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)62105-4 · Cited by 1,220
The impact of mHealth interventions: systematic review of systematic reviews
Marcolino, M. S., Oliveira, J. A. Q., D'Agostino, M., Ribeiro, A. L., Alkmim, M. B. M., & Novillo-Ortiz, D. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8873 · Cited by 1,163
Hamine, S., Gerth-Guyette, E., Faulx, D., Green, B. B., & Ginsburg, A. S. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3951 · Cited by 1,149
“Another review, focused on the impact of SMS interventions, found that text messaging increased adherence to antiretroviral treatment with reductions in viral load and biochemically verified smoking cessation, yet these effects were “small and of borderline clinical importance” [9].”
Mobile phone-based interventions for smoking cessation
Whittaker, R., McRobbie, H., Bullen, C., Rodgers, A., & Gu, Y. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006611.pub4 · Cited by 1,079
Metadata
- Authors
- Free, C., Phillips, G., Watson, L., Galli, L., Felix, L., Edwards, P., Patel, V., & Haines, A.
- Affiliations
- London School of Hygiene & Tropical Medicine (GB)
- University of Warwick (GB)
- Imperial College London (GB)
- Corresponding author
- Free, Caroline
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-01-15
- Volume
- 10
- Issue
- 1
- Pages
- e1001363
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC3566926
- OpenAlex
- W1977977041
- Cited by
- 1,187
- References
- 70
- Citations by year
- 2026: 71 · 2025: 72 · 2024: 91 · 2023: 55 · 2022: 61 · 2021: 97 · 2020: 102 · 2019: 104 · 2018: 125 · 2017: 94 · 2016: 115 · 2015: 87 · 2014: 80 · 2013: 31
- FWCI
- 12.56
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion, other-oa)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Wellcome Trust (091834)
- National Institute for Health and Care Research
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Keywords
- mobile health, health care delivery, healthcare provider support, appointment attendance, appointment cancellation, diagnostic accuracy, disease management
- MeSH terms
- Clinical Trials as Topic, Communication, Health Personnel, Health Services, Humans, Bias, Treatment Outcome, Telemedicine, Disease Management, Biomedical Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Effectiveness of Mobile-Health Technologies to Improve Health Care Service Delivery Processes: A Systematic Review and Meta-Analysis. https://app.cochat.ai/papers/10.1371/journal.pmed.1001363
- The paper
- Free, C., Phillips, G., Watson, L., Galli, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013). The Effectiveness of Mobile-Health Technologies to Improve Health Care Service Delivery Processes: A Systematic Review and Meta-Analysis. PLoS Medicine. https://doi.org/10.1371/journal.pmed.1001363
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.