Scaling Up mHealth: Where Is the Evidence?
Open accessThe DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
CITATION: Tomlinson, M., et al. 2013. Scaling up mHealth : where is the evidence?. PLoS Medicine, 10(2): e1001382, doi: 10.1371/journal.pmed.1001382.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A primary concern has been the lack of evidence of successful scaling up, given that the vast majority of mHealth pilots implemented in LMICs have failed to translate or scale into health systems [29, 30].”
From Situating mobile health: a qualitative study of mHealth expectations in the rural health district of Nouna, Burkina Faso (2017) · cites this paper as [29]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Little is currently known about how to successfully spread and scale up video consulting for sustained use across settings [23-25].”
From Spread, Scale-up, and Sustainability of Video Consulting in Health Care: Systematic Review and Synthesis Guided by the NASSS Framework (2021) · cites this paper as [25]
Experimental — accuracy not yet measuredIn the citing paper
“The reported impact of mHealth interventions is mixed, with studies showing modest benefits for some clinical diagnosis and management support outcomes [9,10].”
From Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review (2015) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research
(1994) · doi:10.17226/2139 · Cited by 2,073
Free, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338 · cited 2×
“Flay and colleagues [29] have adapted the evidentiary standards model published by the Society for Prevention Research [27].”
BackgroundLester, R. T., Ritvo, P., Mills, E. J., Kariri, A., Karanja, S., Chung, M. H., Jack, W., Habyarimana, J., Sadatsafavi, M., Najafzadeh, M., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)61997-6 · Cited by 1,278 · cited 1×
“Three randomized trials studying HIV treatment adherence found benefits [19,20] and one found no impact [21,22].”
BackgroundText messaging as a tool for behavior change in disease prevention and management
Cole-Lewis, H., & Kershaw, T. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq004 · Cited by 1,190 · cited 1×
“Similarly, few randomized trials evaluating the use of text message reminders to improve medication adherence for people with chronic illnesses have been conducted in LAMICs [15–18].”
BackgroundFree, C., Phillips, G., Watson, L., Galli, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001363 · Cited by 1,187 · cited 1×
“Two recent systematic reviews [23,24] found modest and suggestive evidence for the benefits of mHealth technology, and while both reviews recommended implementation, they argued that high quality (and adequately powered) clinical trials that measure clinical outcomes are essential.”
Background(2018) · Routledge eBooks · doi:10.4324/9781315167534 · Cited by 1,139
Pop-Eleches, C., Thirumurthy, H., Habyarimana, J. P., Zivin, J. G., Goldstein, M. P., de Walque, D., MacKeen, L., Haberer, J., Kimaiyo, S., Sidle, J., et al. (2011) · AIDS · doi:10.1097/qad.0b013e32834380c1 · Cited by 982 · cited 1×
“Three randomized trials studying HIV treatment adherence found benefits [19,20] and one found no impact [21,22].”
BackgroundHealthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882
Mobile phone messaging reminders for attendance at healthcare appointments
Gurol-Urganci, I., de Jongh, T., Vodopivec-Jamsek, V., Atun, R., & Car, J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007458.pub3 · Cited by 594 · cited 1×
“Two systematic reviews have described a robust evidence base for the use of text message reminders to improve attendance at health care appointments [13,14].”
Background
Research works printed but not linked: 1
- C Friedrichs, 2012, Market access & reimbursement strategies, Mobile Health Summit
Cited by
Items 201–300 of 669
Prieto, J. T., Zuleta, C., & Rodríguez, J. T. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw102 · Cited by 32
Psychological Science and Innovative Strategies for Informing Health Care Redesign: A Policy Brief
Asarnow, J. R., Hoagwood, K., Stancin, T., Lochman, J. E., Hughes, J. L., Miranda, J. M., Wysocki, T., Portwood, S. G., Piacentini, J. C., Tynan, W. D., et al. (2015) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2015.1077451 · Cited by 35
Overcoming the barriers of mobile health that hamper sustainability in low-resource environments
Greve, M., Brendel, B., van Osten, N., & Kolbe, L. M. (2021) · Journal of Public Health · doi:10.1007/s10389-021-01536-8 · Cited by 37
Using automated voice calls to improve adherence to iron supplements during pregnancy: a pilot study
Pai, N., Supe, P., Kore, S. J., Nandanwar, Y. S., Hegde, A., Cutrell, E. B., & Thies, W. (2013) · International Conference on Information and Communication Technologies and Development (ICTD) · doi:10.1145/2516604.2516608 · Cited by 46
“Unfortunately, the research literature up until now has little to offer in the way of rigorous evidence on mHealth interventions, a situation decried by many scholars [59, 60, 61].”
BackgroundEngmann, C., Khan, S., Moyer, C. A., Coffey, P. S., & Bhutta, Z. A. (2016) · PLoS Medicine · doi:10.1371/journal.pmed.1001969 · Cited by 37
“Challenges include an insufficient evidence base for scale-up, issues of compatibility with existing systems, absence of standards for context-specific adoption, and a lack of ownership [61].”
BackgroundInformation and Communication Technologies and Global Health Challenges
Gutierrez, M. A., Moreno, R. A., & Rebelo, M. S. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804591-6.00004-5 · Cited by 45
Shiferaw, S., Workneh, A., Yirgu, R., Dinant, G.-J., & Spigt, M. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0704-9 · Cited by 31
Buis, L. R., Hirzel, L., Turske, S. A., Des Jardins, T. R., Yarandi, H., & Bondurant, P. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2929 · Cited by 31
Govender, K., Beckett, S., Masebo, W. G. B., Braga, C., Zambezi, P., Manhique, M., George, G., & Durevall, D. J. (2019) · AIDS and Behavior · doi:10.1007/s10461-019-02427-6 · Cited by 36
Digital Health: Hope, Hype, and Amara’s Law
Dorn, S. D. (2015) · Gastroenterology · doi:10.1053/j.gastro.2015.07.024 · Cited by 39
“effectiveness of the vast majority of mHealth tools for achieving specific goals.(8) Most have very little functionality, and merely providing or recording health information may not be enough to drive improved health.”
BackgroundKumar, P. A., Paton, C., & Kirigia, D. G. (2016) · Archives of Disease in Childhood · doi:10.1136/archdischild-2015-308556 · Cited by 41
Shan, H., & Li, M. (2017) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-017-1541-z · Cited by 31
“While a large majority of the mHealth pilots and scale-up interventions are being implemented using donor funding [14], we wanted to create a program that would eventually fund itself.”
BackgroundMethodLucas, H. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2014.11.008 · Cited by 35
Hategeka, C., Ruton, H., & Law, M. R. (2019) · Global Health Research and Policy · doi:10.1186/s41256-019-0098-y · Cited by 37
Kurumop, S. F., Bullen, C., Whittaker, R., Betuela, I., Hetzel, M. W., & Pulford, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076578 · Cited by 30
“The ability of a text message reminder service to facilitate a sustained and clinically meaningful change in health worker practice has yet to be demonstrated via rigorous research inquiry [21,23].”
BackgroundGarg, S. K., Lyles, C. R., Ackerman, S., Handley, M. A., Schillinger, D., Gourley, G., Aulakh, V., & Sarkar, U. (2015) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0258-7 · Cited by 34
“calls specifically for major governmental and private investment to build a more robust, standardized, and interoperable health information platform with open architecture that can then facilitate the larger and more complex mHealth research initiatives that are needed to further demonstrate efficacy [27].”
BackgroundBeratarrechea, A. G., Diez‐Canseco, F., Irazola, V. E., Miranda, J. J., Ramírez‐Zea, M., & Rubinstein, A. (2016) · Progress in Cardiovascular Diseases · doi:10.1016/j.pcad.2016.03.003 · Cited by 36
Can mobile phones transform healthcare in low and middle income countries?
Arie, S. (2015) · BMJ · doi:10.1136/bmj.h1975 · Cited by 29
Narrillos-Moraza, Á., Gómez-Martínez-Sagrera, P., García, M. Á. A., Escudero‐Vilaplana, V., Collado‐Borrell, R., Villanueva‐Bueno, C., Gómez-Centurión, I. A., Alonso, A. H., & Sanjurjo‐Sáez, M. (2021) · JMIR mhealth and uhealth · doi:10.2196/32826 · Cited by 33
“The lack of health professional involvement is a constant that has already been highlighted by several authors, expressing their concern about app content and compromising patient safety [33-35].”
BackgroundCampbell, J. I., & Haberer, J. E. (2015) · Current HIV/AIDS Reports · doi:10.1007/s11904-015-0282-8 · Cited by 35
Aschbrenner, K. A., Naslund, J. A., Gill, L. E., Bartels, S. J., & Ben‐Zeev, D. (2016) · Journal of Dual Diagnosis · doi:10.1080/15504263.2016.1145312 · Cited by 34
Innovative Healthcare Applications of ICT for Developing Countries
Ariani, A., Koesoema, A. P., & Soegijoko, S. (2017) · Understanding complex systems · doi:10.1007/978-3-319-55774-8_2 · Cited by 42
“The widespread distribution of cell phones and tablets—collectively known as portable devices—and their ease of use have resulted in the rise of mobile health (“m-health”), in which medical and public health practices are carried out via portable devices (Qiang et al. 2011; Labrique et al. 2013; Tomlinson et al. 2013;…”
BackgroundAppropriation of Mobile Health for Diabetes Self-Management: Lessons From Two Qualitative Studies
Rossmann, C., Riesmeyer, C., Brew‐Sam, N., Karnowski, V., Joeckel, S., Chib, A. I., & Ling, R. (2019) · JMIR Diabetes · doi:10.2196/10271 · Cited by 36
“Up to this point, research has mainly focused on mHealth’s effects, indicating not only promising results overall [13,14] but also contradictory empirical evidence [15-19].”
BackgroundOkello, G. O., Githinji, S., Jones, C. O. H., Snow, R. W., Talisuna, A. O., & Zurovac, D. (2014) · Malaria Journal · doi:10.1186/1475-2875-13-44 · Cited by 32
“They are however higher than in many African countries where the absence of a mobile signal may be the major impediment to effective mHealth interventions [23].”
BackgroundInfluentialHow might global health master deadly sins and strive for greater virtues?
Panter-Brick, C., Eggerman, M., & Tomlinson, M. (2014) · Global Health Action · doi:10.3402/gha.v7.23411 · Cited by 28
“impatience with the many obstacles to disease eradication and lust for technological fame (13).”
BackgroundSelf-citationThe impact of mHealth interventions on health systems: a systematic review protocol
Fortuin, J., Salie, F., Abdullahi, L., & Douglas, T. S. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0387-1 · Cited by 33
Buckee, C. O., Cárdenas, M. I. E., Corpuz, J., Ghosh, A., Haque, F., Karim, J., Mahmud, A. S., Maude, R. J., Mensah, K., Motaze, N. V., et al. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2017-000538 · Cited by 28
Abejirinde, I. O., Zweekhorst, M. B. M., Bardají, A., Abugnaba-Abanga, R., Apentibadek, N., Brouwere, V. D., van Roosmalen, J., & Marchal, B. (2018) · JMIR mhealth and uhealth · doi:10.2196/11468 · Cited by 40
“Evidence on mHealth has been critiqued for being a black box with little knowledge from pilot projects to inform prototype development and scale-up [5].”
Unmet Need: Improving mHealth Evaluation Rigor to Build the Evidence Base
Mookherji, S., Mehl, G., Kaonga, N., & Mechael, P. (2015) · Journal of Health Communication · doi:10.1080/10810730.2015.1018624 · Cited by 27
“Our findings are supported by other studies that also identify that the rigor of mHealth evaluations must be improved to increase both the scientific value and programmatic utility of evaluation results (Bloomfield et al., 2014; Kumar et al., 2013; Nilsen et al., 2012; Tomlinson et al., 2013; WHO, 2011).”
ResultClough, B. A., & Casey, L. M. (2015) · Professional Psychology: Research and Practice · doi:10.1037/pro0000053 · Cited by 27
“Selection may be based on clinician experience, theory, or evidence-based interventions from other delivery formats (Tomlinson et al., 2013).”
Nishimwe, A., Ibisomi, L., Nyssen, M., & Conco, D. N. (2022) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-022-04393-9 · Cited by 30
“Though mHealth interventions are well received by healthcare providers [6, 14, 15] information about their effectiveness with regards to patient outcomes is limited [5, 9, 16].”
BackgroundPatient’s Intention to Use Mobile Health App
Yee, T. S., Lim, C. S., & Chin, W. S. (2019) · Journal of Management Research · doi:10.5296/jmr.v11i3.14776 · Cited by 41
“The use of the mobile health app takes precedence over the traditional health process in terms of aspects of data collection, care delivery, patient engagement, and real-time drug monitoring (Tomlinson et al., 2013).”
BackgroundOpipari‐Arrigan, L., Dykes, D. M. H., Saeed, S. A., Thakkar, S., Burns, L., Chini, B. A., McPhail, G. L., Eslick, I. S., Margolis, P. A., & Kaplan, H. C. (2020) · JMIR mhealth and uhealth · doi:10.2196/11968 · Cited by 26
Consumer Acceptance of mHealth Services: A Comparison of Behavioral Intention Models
Schuster, L., Tossan, V., & Drennan, J. C. (2017) · Services Marketing Quarterly · doi:10.1080/15332969.2017.1289791 · Cited by 29
Health Behavior Theory to Enhance eHealth Intervention Research in HIV: Rationale and Review
Simoni, J. M., Ronen, K., & Aunon, F. M. (2018) · Current HIV/AIDS Reports · doi:10.1007/s11904-018-0418-8 · Cited by 31
Steinhauser, S. (2019) · Schmalenbach Business Review · doi:10.1007/s41464-019-00076-9 · Cited by 34
Bartels, S. L., van Knippenberg, R. J. M., Köhler, S., Ponds, R. W., Myin-Germeys, I., Verhey, F. R. J., & de Vugt, M. E. (2020) · Aging & Mental Health · doi:10.1080/13607863.2019.1647130 · Cited by 25
Berry, E. C. J., Sculthorpe, N. F., Warner, A., Mather, J. D., Sanal‐Hayes, N. E. M., & Hayes, L. D. (2025) · Frontiers in Aging · doi:10.3389/fragi.2025.1516481 · Cited by 28
“In terms of scalability, mHealth would also be superior to videoconferencing, robotics, and DVD-based interventions (Tomlinson et al., 2013), given the potentially automated nature of mHealth.”
Kamal, A. K., Shaikh, Q., Pasha, O., Azam, I., Islam, M. S., Memon, A., Rehman, H., Affan, M., Nazir, S., Aziz, S., et al. (2015) · BMC Neurology · doi:10.1186/s12883-015-0413-2 · Cited by 30
“Moreover SMS to promote health, that are informed by Health Theory and coded by Taxonomy for replicability, are new and in line with developing the science of informed replicable mHealth interventions [37].”
BackgroundGgita, J. M., Ojok, C., Meyer, A. J., Farr, K., Shete, P. B., Ochom, E., Turimumahoro, P., Babirye, D., Mark, D., Dowdy, D. W., et al. (2018) · The International Journal of Tuberculosis and Lung Disease · doi:10.5588/ijtld.17.0521 · Cited by 26
“More, high-quality data is needed for scale-up 10,11 , including information about mobile phone ownership 12 in key populations; access to phone networks and charging facilities 13,14 ; proficiency with phones; expectations about confidentiality; messaging preferences 15,16,17 ; and how these…”
BackgroundHeartMan DSS: A decision support system for self-management of congestive heart failure
Bohanec, M., Tartarisco, G., Marino, F., Pioggia, G., Puddu, P. E., Schiariti, M. S., Baert, A., Pardaens, S., Clays, E., Vodopija, A., et al. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115688 · Cited by 31
Noordam, A. C., George, A. S., Sharkey, A., Jafarli, A., Bakshi, S. S., & Kim, J. C. (2015) · Journal of Health Communication · doi:10.1080/10810730.2014.965363 · Cited by 31
Meyers, D. J., Filkins, M., Harsha Bangura, A., Sharma, R., Baruwal, A., Pande, S., Halliday, S., Schwarz, D., Schwarz, R. K., & Maru, D. S. R. (2017) · BMJ Innovations · doi:10.1136/bmjinnov-2015-000102 · Cited by 24
Mwaisaka, J., Gonsalves, L., Thiongo, M. N., Waithaka, M., Sidha, H., Alfred, O., Mukiira, C., & Gichangi, P. (2021) · JMIR mhealth and uhealth · doi:10.2196/19109 · Cited by 29
Ellington, L. E., Najjingo, I., Rosenfeld, M., Stout, J. W., Farquhar, S. A., Vashistha, A., Nekesa, B., Namiya, Z., Kruse, A. J., Anderson, R., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-049708 · Cited by 27
Aune, A., Vartdal, G., Jiménez-Díaz, G., Gierman, L. M., Bergseng, H., & Darj, E. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/40463 · Cited by 24
Scoping review: exploring the equity impact of current digital health design practices
Evans, L., Evans, J., Pagliari, C., & Källander, K. (2023) · Oxford Open Digital Health · doi:10.1093/oodh/oqad006 · Cited by 31
Ochieng, S., Hariharan, N., Abuya, T., Okondo, C., Ndwiga, C., Warren, C., Wickramanayake, A., & Rajasekharan, S. (2024) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-024-06373-7 · Cited by 34
“Despite the limited empirical evidence [8], it is noteworthy that SMS messaging has demonstrated an impact on the uptake of maternal and neonatal health interventions [8].”
BackgroundRassi, C., Gore‐Langton, G. R., Walimbwa, B. G., Strachan, C. E., King, R., Basharat, S., Christiansen-Jucht, C., Graham, K., & Gudoi, S. S. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203554 · Cited by 26
“It has also been pointed out that there is a lack of programmatic evidence to support scale-up of mHealth interventions in LMICs, with the vast majority of research describing pilot interventions and few well-designed studies providing robust evidence of impact at scale [12,13] or cost effectiveness [14,15].”
BackgroundThe Living the Example Social Media Substance Use Prevention Program: A Pilot Evaluation
Evans, W. D., Andrade, E. L., Goldmeer, S., Smith, M. A., Snider, J. W., & Girardo, G. (2017) · JMIR Mental Health · doi:10.2196/mental.7839 · Cited by 26
“New technologies, including the Internet, social media, and mobile phones, offer tremendous potential to expand the reach and effectiveness of public health programs [17,18].”
Mobile Phone Support for Rural Health Workers in Nepal through ‘Celemedicine’
Morrison, J., Shrestha, N. R., Hayes, B., & Zimmerman, M. (2013) · Journal of Nepal Medical Association · doi:10.31729/jnma.2287 · Cited by 23
Schellong, J., Lorenz, P., & Weidner, K. (2019) · European Journal of Psychotraumatology · doi:10.1080/20008198.2019.1611090 · Cited by 26
Acharya, A., Cunningham, K., Manandhar, S., Shrestha, N., Chen, M., & Weissman, A. (2020) · Journal of Medical Internet Research · doi:10.2196/17659 · Cited by 24
“Understanding target populations’message delivery preferences is important [9] as mHealth interventions are more likely to be effective when message frequency, content, and style are tailored to these needs and preferences [15].”
BackgroundBrown, V., Tran, H. N. Q., Downing, K. L., Hesketh, K. D., & Moodie, M. (2021) · Obesity Reviews · doi:10.1111/obr.13227 · Cited by 27
“Mobile health (mHealth) is a component of eHealth and is broadly defined as medical and public health practices that are supported by mobile devices.(10) Telehealth and eHealth interventions have been highlighted as promising for delivery of interventions aiming to improve obesityrelated behaviors, such as improving p…”
BackgroundMorello, K., Schäfer, S. K., Kunzler, A. M., Priesterroth, L., Tüscher, O., & Kubiak, T. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1253390 · Cited by 28
Quality comparison of websites related to developmental disabilities
Reichow, B., Shefcyk, A., & Bruder, M. B. (2013) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2013.06.013 · Cited by 23
Meyers, D. J., Ozonoff, A., Baruwal, A., Pande, S., Harsha, A. P., Sharma, R., Schwarz, D., Schwarz, R. K., Bista, D., Halliday, S., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0152738 · Cited by 24
“There are limited data, however, that assess the utility of such systems [42].”
BackgroundDoocy, S., Paik, K., Lyles, E., Tam, H. H., Fahed, Z., Winkler, E., Kontunen, K., Mkanna, A., & Burnham, G. M. (2017) · PubMed · doi:10.1371/currents.dis.e98c648aac93797b1996a37de099be74 · Cited by 23
Cockcroft, A., Omer, K., Gidado, Y., Gamawa, A. I., & Andersson, N. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3319-z · Cited by 26
How the smartphone is driving the eye-health imaging revolution
Bolster, N. M., Giardini, M., Livingstone, I. A. T., & Bastawrous, A. (2014) · Expert Review of Ophthalmology · doi:10.1586/17469899.2014.981532 · Cited by 27
“It has, therefore, been noted that it is vital that technologists, clinicians and policy makers work together to develop the common standards and frameworks that are necessary for integration of mHealth in general [90,92].”
BackgroundApproaches to Evaluating Digital Health Technologies: Scoping Review
Rauwerdink, A., Spinazze, P., Gijsbers, H., Molendijk, J., Zwolsman, S. E., Schijven, M. P., Chavannes, N. H., & Kasteleyn, M. J. (2024) · Journal of Medical Internet Research · doi:10.2196/50251 · Cited by 24
Hartzler, A. L., & Wetter, T. C. (2014) · Yearbook of Medical Informatics · doi:10.15265/iy-2014-0022 · Cited by 26
“Insights we uncovered about tailoring messages with motivating content expanded evidence on parameters under which SMS work [5].”
BackgroundInfluentialBurnett, S., Wun, J., Evance, I., Davis, K. M., Smith, G. M., Lussiana, C., Tesha, G., Quao, A., Martin, T., Alombah, F., et al. (2019) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.18-0366 · Cited by 24
Ni, Z., Atluri, N., Shaw, R. J., Tan, J., Khan, K., Merk, H., Ge, Y., Shrestha, S., Shrestha, A., Vasudevan, L., et al. (2019) · JMIR mhealth and uhealth · doi:10.2196/15419 · Cited by 28
“…voice calls or voice messages on their phones Considering the huge cost barrier to improving health outcomes in rural Nepal, both from an individual patient perspective and a governmental perspective, these data suggest a new avenue to deliver care by utilizing mobile health technologies [33,34].”
Atukunda, E. C., Matthews, L. T., Musiimenta, A., Mugyenyi, G. R., Mugisha, S., Ware, N. C., Obua, C., & Siedner, M. J. (2021) · JMIR Formative Research · doi:10.2196/29214 · Cited by 28
“However, despite the successes in pilot studies elsewhere, enthusiasm from the public sector, and nearly ubiquitous availability of mobile phones in Uganda [14], mHealth interventions to motivate improved outcomes among pregnant women have not been adopted on a larger scale [15].”
Pozuelo, J. R., Moffett, B., Davis, M., Stein, A. L., Cohen, H., Craske, M. G., Maritze, M., Makhubela, P., Nabulumba, C., Sikoti, D., et al. (2023) · JMIR Formative Research · doi:10.2196/51423 · Cited by 25
“With the increase in smartphone ownership and access to the internet, digital interventions such as smartphone apps are a promising strategy to reduce these large treatment gaps in LMICs [10,11].”
Backgroundvan Olmen, J., Ku, G. M., van Pelt, M. H., Kalobu, J. C., Heang, H., Darras, C., Acker, K. L. V., Villaraza, B., Schellevis, F., & Kegels, G. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-423 · Cited by 30
“Overall, the evidence on the feasibility and advantages of the use of mobile technology is positive, but many studies are small and evidence on its effectiveness is not very robust [12-16].”
BackgroundBirukila, G., Sufiyan, M. B., Epstein, H., Gugong, V., Anger, R., Corkum, M., Nebanat, A. J., Musoke, F., & Alabi, O. (2016) · Global Public Health · doi:10.1080/17441692.2016.1152283 · Cited by 23
Smart Healthcare in the IoT Era: A Context-Aware Recommendation Example
Casino, F., Patsakis, C., Batista, E., Postolache, O. A., Martínez-Ballesté, A., & Solanas, A. (2018) · International Symposium on Sensing and Instrumentation in 5G and IoT Era (ISSI) · doi:10.1109/issi.2018.8538106 · Cited by 28
“, global monitoring capabilities, immediacy, etc) [9] and leads to the creation of innovative applications [10].”
BackgroundHyatt, A., Lipson‐Smith, R., Morkunas, B., Krishnasamy, M., Jefford, M., Baxter, K., Gough, K., Murphy, D. G., Drosdowsky, A., Phipps‐Nelson, J., et al. (2020) · JMIR mhealth and uhealth · doi:10.2196/15593 · Cited by 23
“Most mHealth interventions fail to be implemented after pilot-testing [19,20] with the term pilotitis created to describe this phenomenon [21,22].”
BackgroundArena, R. A., Sagner, M., Byrne, N. M., Williams, A. D., McNeil, A., Street, S. J., & Hills, A. P. (2017) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2017.53 · Cited by 23
The clinic-level perspective on mHealth implementation: a South African case study
Wolff-Piggott, B., Coleman, J., & Rivett, U. (2018) · Information Technology for Development · doi:10.1080/02681102.2016.1233858 · Cited by 21
“there is sound evidence of improved long-term health outcomes, and whether it can be scaled up effectively and in a financially sustainable way (Aranda-Jan, Mohutsiwa-Dibe, & Loukanova, 2014; Tomlinson et al., 2013).”
BackgroundInfluentialAnyanwu, I. S., & Jenkins, J. (2024) · Oxford Open Digital Health · doi:10.1093/oodh/oqae026 · Cited by 30
Craig, A. T., Lawford, H. L. S., Miller, M., Chen-Cao, L., Woods, L. S., Liaw, S., & Godinho, M. A. (2025) · Journal of Medical Internet Research · doi:10.2196/66288 · Cited by 32
“Consequently, there is limited consensus on the impact that digital interventions may have on health systems and health outcomes at scale [5-7].”
Schramm, Z. A., Leroux, B. G., Radick, A. C., Ventura, A. S., Klein, J. W., Samet, J. H., Saxon, A. J., Kim, T. W., & Tsui, J. I. (2020) · Addiction Science & Clinical Practice · doi:10.1186/s13722-020-00203-9 · Cited by 23
Usmanova, G., Gresh, A., Cohen, M. A., Kim, Y. M., Srivastava, A., Joshi, C. S., Bhatt, D. C., Haws, R. A., Wadhwa, R., Sridhar, P., et al. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17228333 · Cited by 25
“Multiple reviews have shown that mHealth approaches, particularly those that employ e-CDSSs as a central component, can lead to improvements in provider behaviors as well as patient outcomes [7–10], although few have been successfully scaled up [11].”
BackgroundSmit, A., Swartz, L. M., Bantjes, J. R., Roomaney, R., & Coetzee, B. (2020) · Qualitative Health Research · doi:10.1177/1049732320976556 · Cited by 24
“These technologies are exciting and their novelty may make them appealing; because of this, there may be an assumption that the use of new technologies automatically improves the quality of research (Tomlinson et al., 2013).”
BackgroundSelf-citationChoudhury, A., Shahsavar, Y., Sarkar, K., Choudhury, M., & Nimbarte, A. D. (2023) · Nutrients · doi:10.3390/nu15173699 · Cited by 27
The regulatory status of health apps that employ gamification
Freyer, O., Wrona, K. J., de Snoeck, Q., Hofmann, M., Melvin, T., Stratton‐Powell, A. A., Wicks, P. J., Parks, A. C., & Gilbert, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-71808-2 · Cited by 27
“…“(…) medical and public health practice delivered on digital devices, covering the use of mobile phones to improve point of service data collection, care delivery, and patient communication to the use of alternative wireless devices for real-time medication monitoring and adherence support 77,78 .”
BackgroundFarach, N., Faba, G., Julian, S., Mejía, F., Cabieses, B., D'Agostino, M. J., & Cortinois, A. A. (2015) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.4108 · Cited by 23
Lee, Y., Shin, S.-Y., Kim, J.-Y., Kim, J. H., Seo, D., Joo, S., Park, J., Kim, W. S., Lee, J. H., & Bates, D. W. (2015) · Healthcare Informatics Research · doi:10.4258/hir.2015.21.4.299 · Cited by 21
“Whether the use of m-health can improve patient outcomes must be determined [2,3,5,6,8,23].”
BackgroundThe Interactive Mobile App Review Toolkit (IMART): a Clinical Practice-Oriented System
Maheu, M. M., Nicolucci, V., Pulier, M. L., Wall, K. M., Frye, T. J., & Hudlická, E. (2016) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-016-0005-z · Cited by 21
Chu, H., Liu, Y.-M., & Kuo, F.-R. (2018) · JMIR mhealth and uhealth · doi:10.2196/11557 · Cited by 24
“Mobile devices could help with data collection, care delivery, patient communication, and real-time monitoring of health conditions [28].”
Considerations for Improved Mobile Health Evaluation: Retrospective Qualitative Investigation
Dick, S., O’Connor, Y., Thompson, M. J., O’Donoghue, J., Hardy, V., Wu, T.-S. J., O’Sullivan, T., Chirambo, G. B., & Heavin, C. (2020) · JMIR mhealth and uhealth · doi:10.2196/12424 · Cited by 24
“The current evidence for the efficacy of mHealth interventions is sparse [3,6,8-11], which may be because of a lack of high-quality, rigorous evaluations [12], with many mHealth projects explored only at the pilot phase [13].”
BackgroundMagalhães, B. M. B. D. S., Fernandes, C. S., Santos, C., & Martínez‐Galiano, J. M. (2020) · Cancer Nursing · doi:10.1097/ncc.0000000000000823 · Cited by 27
“45 It is in this particular context that CONSORT-EHEALTH emerges, aiming to guide the reporting of studies involving eHealth and mHealth-based interventions.”
BackgroundWallis, L. A., Hasselberg, M., Barkman, C., Bogoch, I. I., Broomhead, S. C., Dumont, G. A., Groenewald, J., Lundin, J. E., Bergendahl, J. N., Nyasulu, P. S., et al. (2017) · Global Health Action · doi:10.1080/16549716.2017.1340254 · Cited by 22
“meticulously conceive the solutions/applications envisaged and come up with solid proof of cost-effectiveness [7].”
BackgroundWright, C. C. J., Schwarzman, J., Dietze, P., Crockett, B., & Lim, M. S. C. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-018-0406-x · Cited by 23
“Further discussion of the practical relevance and genuine scalability of the interventions currently being produced in the research field is warranted [26].”
BackgroundInfluentialHackett, K., Kazemi, M., Lafleur, C., Nyella, P., Godfrey, L., & Sellen, D. (2019) · Health Policy and Planning · doi:10.1093/heapol/czz036 · Cited by 19
Reinecke, F., Dittrich, F., Dudda, M., Stang, A., Polan, C., Müller, R., Beck, P., & Kauther, M. D. (2021) · JMIR mhealth and uhealth · doi:10.2196/23784 · Cited by 19
“Despite the extensive possibilities arising from the use of this evolving technology, the evidence base is currently still limited and there is a need for further studies [10,11].”
BackgroundHowren, M. B., Liew, J. R., & Christensen, A. J. (2013) · Social and Personality Psychology Compass · doi:10.1111/spc3.12033 · Cited by 25
Beyond the Hype: Mobile Technologies and Opportunities to Address Health Disparities
Hswen, Y., & Viswanath, K. (2015) · Journal of Mobile Technology in Medicine · doi:10.7309/jmtm.4.1.9 · Cited by 20
Novel Use of a Smartphone to Measure Standing Balance
Shah, N., Aleong, R., & So, I. (2016) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/rehab.4511 · Cited by 20
The double-edged sword of mobilizing citizens via mobile phone in developing countries
Erlich, A., Jung, D. F., Long, J. D., & McIntosh, C. (2017) · Development Engineering · doi:10.1016/j.deveng.2017.11.001 · Cited by 22
“One critical issue confronting researchers is scaling development interventions to reach as wide a population as possible (Heeks, 2008; Sachs and McArthur, 2005; Tomlinson et al., 2013), while maintaining a stable user base that provides high quality data.”
BackgroundPositive Technologies for Improving Health and Well-Being
Botella, C., Baños, R., & Guillén, V. (2017) · Springer eBooks · doi:10.1007/978-3-319-51787-2_13 · Cited by 24
Evidence-based adaptation and scale-up of a mobile phone health information service
L’Engle, K. L., Plourde, K. F., & Zan, T. (2017) · mHealth · doi:10.21037/mhealth.2017.02.06 · Cited by 21
“Without models of successful mHealth program scaleup, the field remains at risk of ongoing “pilotitis” that has plagued implementers for several years (11,12).”
MethodMathenjwa, M., Khidir, H., Milford, C., Mosery, N., Greener, L. R., Pratt, M. C., O’Neil, K., Harrison, A. D., Bangsberg, D. R., Safren, S. A., et al. (2021) · AIDS and Behavior · doi:10.1007/s10461-021-03278-w · Cited by 19
Wearables, the Marketplace and Efficiency in Healthcare: How Will I Know That You’re Thinking of Me?
Howard, M. (2021) · Philosophy & Technology · doi:10.1007/s13347-021-00473-4 · Cited by 22
“The increasing role of tech companies in promoting large-scale mHealth interventions and wearable device initiatives warrants careful attention (see Tomlinson et al., 2013).”
BackgroundLukkanalikitkul, E., Kongpetch, S., Chotmongkol, W., Morley, M., Anutrakulchai, S., Srichan, C., Thinkhamrop, B., Chunghom, T., Wiangnon, P., Thinkhamrop, W., et al. (2022) · JMIR Formative Research · doi:10.2196/37291 · Cited by 19
Benoit, J. R. A., Louie‐Poon, S., Kauser, S., & Meherali, S. M. (2022) · JMIR Pediatrics and Parenting · doi:10.2196/33826 · Cited by 21
“This finding is unsurprising as the mHealth field has been criticized for producing limited evidence about the efficacy and effectiveness of evidence base information [38-40].”
BackgroundBaptista, S. N., Oldenburg, B. F., & O'Neil, A. E. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.6419 · Cited by 20
“This limits the ability to identify and scale-up successful apps, thereby limiting the population impact of mHealth [3,7].”
Background
Metadata
- Authors
- Tomlinson, M., Rotheram-Borus, M. J., Swartz, L., & Tsai, A. C.
- Affiliations
- Stellenbosch University (ZA)
- Massachusetts General Hospital (US)
- Corresponding author
- Tomlinson, Mark
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-02-12
- Volume
- 10
- Issue
- 2
- Pages
- e1001382
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC3570540
- OpenAlex
- W2037924767
- Cited by
- 673
- References
- 38
- Citations by year
- 2026: 22 · 2025: 27 · 2024: 31 · 2023: 29 · 2022: 50 · 2021: 55 · 2020: 65 · 2019: 58 · 2018: 59 · 2017: 78 · 2016: 67 · 2015: 63 · 2014: 46 · 2013: 23
- FWCI
- 119.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- SUNScholar (Stellenbosch University) (submittedVersion)
- Funders
- National Research Foundation
- Department for International Development
- National Institutes of Health
- National Institute of Mental Health (K23MH096620, P30MH058107)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Keywords
- mobile health, scale-up, evidence base, health technology adoption, digital health interventions
- MeSH terms
- Cooperative Behavior, Delivery of Health Care, Health Services Research, Humans, Interinstitutional Relations, Health Knowledge, Attitudes, Practice, Program Evaluation, Health Behavior, Program Development, Telemedicine, Evidence-Based Medicine, Cell Phone, Text Messaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
![Figure 1 Research stages and standards. Adapted from Olds et al. [29] and Flay et al. [27].](https://figures.cochat.ai/paper-figures/057ace45863c49c4b5e7eac5af7c91b6/scaling-up-mhealth-where-is-the-evidence-figure-1.jpg)