Scaling Up mHealth: Where Is the Evidence?
Open accessThe DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
CITATION: Tomlinson, M., et al. 2013. Scaling up mHealth : where is the evidence?. PLoS Medicine, 10(2): e1001382, doi: 10.1371/journal.pmed.1001382.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A primary concern has been the lack of evidence of successful scaling up, given that the vast majority of mHealth pilots implemented in LMICs have failed to translate or scale into health systems [29, 30].”
From Situating mobile health: a qualitative study of mHealth expectations in the rural health district of Nouna, Burkina Faso (2017) · cites this paper as [29]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Little is currently known about how to successfully spread and scale up video consulting for sustained use across settings [23-25].”
From Spread, Scale-up, and Sustainability of Video Consulting in Health Care: Systematic Review and Synthesis Guided by the NASSS Framework (2021) · cites this paper as [25]
Experimental — accuracy not yet measuredIn the citing paper
“The reported impact of mHealth interventions is mixed, with studies showing modest benefits for some clinical diagnosis and management support outcomes [9,10].”
From Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review (2015) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research
(1994) · doi:10.17226/2139 · Cited by 2,073
Free, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338 · cited 2×
“Flay and colleagues [29] have adapted the evidentiary standards model published by the Society for Prevention Research [27].”
BackgroundLester, R. T., Ritvo, P., Mills, E. J., Kariri, A., Karanja, S., Chung, M. H., Jack, W., Habyarimana, J., Sadatsafavi, M., Najafzadeh, M., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)61997-6 · Cited by 1,278 · cited 1×
“Three randomized trials studying HIV treatment adherence found benefits [19,20] and one found no impact [21,22].”
BackgroundText messaging as a tool for behavior change in disease prevention and management
Cole-Lewis, H., & Kershaw, T. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq004 · Cited by 1,190 · cited 1×
“Similarly, few randomized trials evaluating the use of text message reminders to improve medication adherence for people with chronic illnesses have been conducted in LAMICs [15–18].”
BackgroundFree, C., Phillips, G., Watson, L., Galli, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001363 · Cited by 1,187 · cited 1×
“Two recent systematic reviews [23,24] found modest and suggestive evidence for the benefits of mHealth technology, and while both reviews recommended implementation, they argued that high quality (and adequately powered) clinical trials that measure clinical outcomes are essential.”
Background(2018) · Routledge eBooks · doi:10.4324/9781315167534 · Cited by 1,139
Pop-Eleches, C., Thirumurthy, H., Habyarimana, J. P., Zivin, J. G., Goldstein, M. P., de Walque, D., MacKeen, L., Haberer, J., Kimaiyo, S., Sidle, J., et al. (2011) · AIDS · doi:10.1097/qad.0b013e32834380c1 · Cited by 982 · cited 1×
“Three randomized trials studying HIV treatment adherence found benefits [19,20] and one found no impact [21,22].”
BackgroundHealthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882
Mobile phone messaging reminders for attendance at healthcare appointments
Gurol-Urganci, I., de Jongh, T., Vodopivec-Jamsek, V., Atun, R., & Car, J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007458.pub3 · Cited by 594 · cited 1×
“Two systematic reviews have described a robust evidence base for the use of text message reminders to improve attendance at health care appointments [13,14].”
BackgroundPrograms for parents of infants and toddlers: recent evidence from randomized trials
Olds, D. L., Sadler, L., & Kitzman, H. (2007) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2006.01702.x · Cited by 548 · cited 1×
“Flay and colleagues [29] have adapted the evidentiary standards model published by the Society for Prevention Research [27].”
BackgroundFactors influencing behavior and behavior change.
Fishbein, M., Triandis, H. C., Kanfer, F. H., Becker, M., & Se, M. (2000) · Cited by 506
Vervloet, M., Linn, A. J., van Weert, J. C. M., de Bakker, D. H., Bouvy, M. L., & van Dijk, L. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000748 · Cited by 455 · cited 1×
“Similarly, few randomized trials evaluating the use of text message reminders to improve medication adherence for people with chronic illnesses have been conducted in LAMICs [15–18].”
BackgroundHorvath, T., Azman, H., Kennedy, G. E., & Rutherford, G. W. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009756 · Cited by 428 · cited 1×
“Similarly, few randomized trials evaluating the use of text message reminders to improve medication adherence for people with chronic illnesses have been conducted in LAMICs [15–18].”
BackgroundZurovac, D., Sudoi, R. K., Akhwale, W. S., Ndiritu, M., Hamer, D. H., Rowe, A. K., & Snow, R. W. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60783-6 · Cited by 403 · cited 1×
“Three randomized trials studying HIV treatment adherence found benefits [19,20] and one found no impact [21,22].”
Open mHealth Architecture: An Engine for Health Care Innovation
Estrin, D., & Sim, I. (2010) · Science · doi:10.1126/science.1196187 · Cited by 351
The use of mobile phones as a data collection tool: A report from a household survey in South Africa
Tomlinson, M., Solomon, W., Singh, Y., Doherty, T., Chopra, M., Ijumba, P., Tsai, A. C., & Jackson, D. (2009) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-9-51 · Cited by 340 · cited 1×
“Interventions categorized under the rubric ‘‘mobile health’’ or ‘‘mHealth’’— broadly defined as medical and public health practice supported by mobile devices [2]—span a variety of applications ranging from the use of mobile phones to improve point of service data collection [3], care delivery [4], and patient communi…”
BackgroundSelf-citationGuy, R., Hocking, J., Wand, H., Stott, S., Ali, H., & Kaldor, J. (2012) · Health Services Research · doi:10.1111/j.1475-6773.2011.01342.x · Cited by 329 · cited 1×
“Two systematic reviews have described a robust evidence base for the use of text message reminders to improve attendance at health care appointments [13,14].”
BackgroundThe Multiphase Optimization Strategy for Engineering Effective Tobacco Use Interventions
Collins, L. M., Baker, T. B., Mermelstein, R. J., Piper, M. E., Jorenby, D. E., Smith, S. S., Christiansen, B. A., Schlam, T. R., Cook, J. W., & Fiore, M. C. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9253-x · Cited by 300 · cited 1×
“It is also time to consider the Multiphase Optimization Strategy (MOST) developed by Collins and colleagues [33].”
BackgroundWeb-Based Smoking-Cessation Programs
Strecher, V. J., McClure, J. B., Alexander, G. L., Chakraborty, B., Nair, V. N., Konkel, J. M., Greene, S. M., Collins, L. M., Carlier, C. C., Wiese, C. J., et al. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.12.024 · Cited by 266 · cited 1×
“[34] for web-based smoking cessation policies.”
Information and communications for development 2012 : maximizing mobile
Kelly, T. B., Friederici, N., Minges, M., & Yamamichi, M. (2012) · Cited by 212
Mobile phone messaging reminders for attendance at healthcare appointments
Car, J., Gurol-Urganci, I., de Jongh, T., Vodopivec-Jamsek, V., & Atun, R. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007458.pub2 · Cited by 203 · cited 1×
“Two systematic reviews have described a robust evidence base for the use of text message reminders to improve attendance at health care appointments [13,14].”
BackgroundPiette, J., Lun, K., Moura, L., Fraser, H., Mechael, P., Powell, J., & Khoja, S. (2012) · Bulletin of the World Health Organization · doi:10.2471/blt.11.099069 · Cited by 188 · cited 1×
“In some ways, mobile technology has a magical appeal for those interested in global public health over and above the advantages that have been proven with good evidence [11].”
BackgroundChallenges to changing health behaviours in developing countries: A critical overview
Aboud, F. E., & Singla, D. R. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.04.009 · Cited by 186 · cited 3×
“Aboud and Singla [30] have shown how programmes that simply provide health information (e.”
BackgroundInfluentialda Costa, T. M., Barbosa, B. J. P., e Costa, D. A. G., Sigulem, D., de Fátima Marin, H., Filho, A. C., & Pisa, I. T. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2011.10.002 · Cited by 186 · cited 1×
“Three randomized trials studying HIV treatment adherence found benefits [19,20] and one found no impact [21,22].”
BackgroundMobile applications for the health sector
Miller, R. J., Qiang, C. Z., Yamamichi, M., & Hausman, V. (2012) · Cited by 182
Briscoe, C., & Aboud, F. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.03.016 · Cited by 180
Rotheram-Borus, M. J., le Roux, I. M., Tomlinson, M., Mbewu, N., Comulada, W. S., le Roux, K., Stewart, J., O’Connor, M. J., Hartley, M., Desmond, K., et al. (2011) · Prevention Science · doi:10.1007/s11121-011-0238-1 · Cited by 169
Self-citationPoint of care in your pocket: a research agenda for the field of m-health
van Heerden, A., Tomlinson, M., & Swartz, L. (2012) · Bulletin of the World Health Organization · doi:10.2471/blt.11.099788 · Cited by 158 · cited 2×
“Interventions categorized under the rubric ‘‘mobile health’’ or ‘‘mHealth’’— broadly defined as medical and public health practice supported by mobile devices [2]—span a variety of applications ranging from the use of mobile phones to improve point of service data collection [3], care delivery [4], and patient communi…”
BackgroundSelf-citationHarnessing experience: exploring the gap between evidence‐based medicine and clinical practice
Hay, M. C., Weisner, T. S., Subramanian, S. K., Duan, N., Niedzinski, E. J., & Kravitz, R. L. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01009.x · Cited by 134 · cited 1×
“sumers [36].”
Siedner, M. J., Haberer, J. E., Bwana, M. B., Ware, N. C., & Bangsberg, D. R. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-56 · Cited by 98 · cited 1×
“Interventions categorized under the rubric ‘‘mobile health’’ or ‘‘mHealth’’— broadly defined as medical and public health practice supported by mobile devices [2]—span a variety of applications ranging from the use of mobile phones to improve point of service data collection [3], care delivery [4], and patient communi…”
BackgroundHaberer, J. E., Robbins, G. K., Ybarra, M., Monk, A., Ragland, K., Weiser, S. D., Johnson, M. O., & Bangsberg, D. R. (2012) · AIDS and Behavior · doi:10.1007/s10461-011-9933-y · Cited by 83 · cited 1×
“Interventions categorized under the rubric ‘‘mobile health’’ or ‘‘mHealth’’— broadly defined as medical and public health practice supported by mobile devices [2]—span a variety of applications ranging from the use of mobile phones to improve point of service data collection [3], care delivery [4], and patient communi…”
BackgroundCollins, L. M., Chakraborty, B., Murphy, S. A., & Strecher, V. (2009) · Clinical Trials · doi:10.1177/1740774508100973 · Cited by 80
Roth, R. B. (1972) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1972.03210090059031 · Cited by 78
The place of implementation science in the translational medicine continuum
Thornicroft, G., Lempp, H., & Tansella, M. (2011) · Psychological Medicine · doi:10.1017/s0033291711000109 · Cited by 78 · cited 1×
“The Institute of Medicine [26] and other communities of researchers [27,28] have established standards for the phases of research that must be conducted in order to be considered efficacious, effective, and disseminated.”
BackgroundDuan, N., Alegria, M., Canino, G., McGuire, T. G., & Takeuchi, D. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2006.00618.x · Cited by 68
Standardized Functions for Smartphone Applications: Examples from Maternal and Child Health
Rotheram-Borus, M. J., Tomlinson, M., Swendeman, D., Lee, A., & Jones, E. (2012) · International Journal of Telemedicine and Applications · doi:10.1155/2012/973237 · Cited by 55
Self-citationHow to Fulfill the True Promise of “mHealth”
Collins, F. S. (2012) · Scientific American · doi:10.1038/scientificamerican0712-16 · Cited by 37
(2018) · Digital Commons@Becker (Washington University School of Medicine) · doi:10.1371/journal
Research works printed but not linked: 1
- C Friedrichs, 2012, Market access & reimbursement strategies, Mobile Health Summit
Cited by
Hamine, S., Gerth-Guyette, E., Faulx, D., Green, B. B., & Ginsburg, A. S. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3951 · Cited by 1,149
“The reported impact of mHealth interventions is mixed, with studies showing modest benefits for some clinical diagnosis and management support outcomes [9,10].”
Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886
“Most research into mobile health has focused on validating single entrepreneurial apps, rather than pursuing rigorous RCTs to validate principles that can guide development of future apps [21].”
Aranda-Jan, C. B., Mohutsiwa-Dibe, N., & Loukanova, S. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-188 · Cited by 644
“cently published a review where they discuss the lack of evidence regarding mHealth effectiveness and efficacy [64].”
BackgroundAgarwal, S., LeFevre, A. E., Lee, J., L’Engle, K., Mehl, G., Sinha, C., & Labrique, A. (2016) · BMJ · doi:10.1136/bmj.i1174 · Cited by 639
m-Health adoption by healthcare professionals: a systematic review
Gagnon, M.-P., Ngangue, P., Payne-Gagnon, J., & Desmartis, M. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv052 · Cited by 622
“Second, m-health interventions can be seen as a patchwork of small-scale pilot projects(11) and most of these interventions work as black boxes with little use of theoretical foundations.(14) Although mobile communication is now part of the everyday life of most human beings, the use of m-health applications to provid…”
Background
Metadata
- Authors
- Tomlinson, M., Rotheram-Borus, M. J., Swartz, L., & Tsai, A. C.
- Affiliations
- Stellenbosch University (ZA)
- Massachusetts General Hospital (US)
- Corresponding author
- Tomlinson, Mark
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-02-12
- Volume
- 10
- Issue
- 2
- Pages
- e1001382
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC3570540
- OpenAlex
- W2037924767
- Cited by
- 673
- References
- 38
- Citations by year
- 2026: 22 · 2025: 27 · 2024: 31 · 2023: 29 · 2022: 50 · 2021: 55 · 2020: 65 · 2019: 58 · 2018: 59 · 2017: 78 · 2016: 67 · 2015: 63 · 2014: 46 · 2013: 23
- FWCI
- 119.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- SUNScholar (Stellenbosch University) (submittedVersion)
- Funders
- National Research Foundation
- Department for International Development
- National Institutes of Health
- National Institute of Mental Health (K23MH096620, P30MH058107)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Keywords
- mobile health, scale-up, evidence base, health technology adoption, digital health interventions
- MeSH terms
- Cooperative Behavior, Delivery of Health Care, Health Services Research, Humans, Interinstitutional Relations, Health Knowledge, Attitudes, Practice, Program Evaluation, Health Behavior, Program Development, Telemedicine, Evidence-Based Medicine, Cell Phone, Text Messaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
![Figure 1 Research stages and standards. Adapted from Olds et al. [29] and Flay et al. [27].](https://figures.cochat.ai/paper-figures/057ace45863c49c4b5e7eac5af7c91b6/scaling-up-mhealth-where-is-the-evidence-figure-1.jpg)