Scaling Up mHealth: Where Is the Evidence?
Open accessThe DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
CITATION: Tomlinson, M., et al. 2013. Scaling up mHealth : where is the evidence?. PLoS Medicine, 10(2): e1001382, doi: 10.1371/journal.pmed.1001382.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A primary concern has been the lack of evidence of successful scaling up, given that the vast majority of mHealth pilots implemented in LMICs have failed to translate or scale into health systems [29, 30].”
From Situating mobile health: a qualitative study of mHealth expectations in the rural health district of Nouna, Burkina Faso (2017) · cites this paper as [29]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Little is currently known about how to successfully spread and scale up video consulting for sustained use across settings [23-25].”
From Spread, Scale-up, and Sustainability of Video Consulting in Health Care: Systematic Review and Synthesis Guided by the NASSS Framework (2021) · cites this paper as [25]
Experimental — accuracy not yet measuredIn the citing paper
“The reported impact of mHealth interventions is mixed, with studies showing modest benefits for some clinical diagnosis and management support outcomes [9,10].”
From Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review (2015) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research
(1994) · doi:10.17226/2139 · Cited by 2,073
Free, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338 · cited 2×
“Flay and colleagues [29] have adapted the evidentiary standards model published by the Society for Prevention Research [27].”
BackgroundLester, R. T., Ritvo, P., Mills, E. J., Kariri, A., Karanja, S., Chung, M. H., Jack, W., Habyarimana, J., Sadatsafavi, M., Najafzadeh, M., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)61997-6 · Cited by 1,278 · cited 1×
“Three randomized trials studying HIV treatment adherence found benefits [19,20] and one found no impact [21,22].”
BackgroundText messaging as a tool for behavior change in disease prevention and management
Cole-Lewis, H., & Kershaw, T. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq004 · Cited by 1,190 · cited 1×
“Similarly, few randomized trials evaluating the use of text message reminders to improve medication adherence for people with chronic illnesses have been conducted in LAMICs [15–18].”
BackgroundFree, C., Phillips, G., Watson, L., Galli, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001363 · Cited by 1,187 · cited 1×
“Two recent systematic reviews [23,24] found modest and suggestive evidence for the benefits of mHealth technology, and while both reviews recommended implementation, they argued that high quality (and adequately powered) clinical trials that measure clinical outcomes are essential.”
Background(2018) · Routledge eBooks · doi:10.4324/9781315167534 · Cited by 1,139
Pop-Eleches, C., Thirumurthy, H., Habyarimana, J. P., Zivin, J. G., Goldstein, M. P., de Walque, D., MacKeen, L., Haberer, J., Kimaiyo, S., Sidle, J., et al. (2011) · AIDS · doi:10.1097/qad.0b013e32834380c1 · Cited by 982 · cited 1×
“Three randomized trials studying HIV treatment adherence found benefits [19,20] and one found no impact [21,22].”
BackgroundHealthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882
Mobile phone messaging reminders for attendance at healthcare appointments
Gurol-Urganci, I., de Jongh, T., Vodopivec-Jamsek, V., Atun, R., & Car, J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007458.pub3 · Cited by 594 · cited 1×
“Two systematic reviews have described a robust evidence base for the use of text message reminders to improve attendance at health care appointments [13,14].”
Background
Research works printed but not linked: 1
- C Friedrichs, 2012, Market access & reimbursement strategies, Mobile Health Summit
Cited by
Hamine, S., Gerth-Guyette, E., Faulx, D., Green, B. B., & Ginsburg, A. S. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3951 · Cited by 1,149
“The reported impact of mHealth interventions is mixed, with studies showing modest benefits for some clinical diagnosis and management support outcomes [9,10].”
Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886
“Most research into mobile health has focused on validating single entrepreneurial apps, rather than pursuing rigorous RCTs to validate principles that can guide development of future apps [21].”
Aranda-Jan, C. B., Mohutsiwa-Dibe, N., & Loukanova, S. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-188 · Cited by 644
“cently published a review where they discuss the lack of evidence regarding mHealth effectiveness and efficacy [64].”
BackgroundAgarwal, S., LeFevre, A. E., Lee, J., L’Engle, K., Mehl, G., Sinha, C., & Labrique, A. (2016) · BMJ · doi:10.1136/bmj.i1174 · Cited by 639
m-Health adoption by healthcare professionals: a systematic review
Gagnon, M.-P., Ngangue, P., Payne-Gagnon, J., & Desmartis, M. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv052 · Cited by 622
“Second, m-health interventions can be seen as a patchwork of small-scale pilot projects(11) and most of these interventions work as black boxes with little use of theoretical foundations.(14) Although mobile communication is now part of the everyday life of most human beings, the use of m-health applications to provid…”
BackgroundKazdin, A. E. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.06.004 · Cited by 554
Health literacy in the eHealth era: A systematic review of the literature
Kim, H., & Xie, B. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.01.015 · Cited by 452
Lee, S. H., Nurmatov, U. B., Nwaru, B. I., Mukherjee, M., Grant, L., & Pagliari, C. (2016) · Journal of Global Health · doi:10.7189/jogh.06.010401 · Cited by 456
Sondaal, S. F. V., Browne, J. L., Amoakoh-Coleman, M., Borgstein, A., Miltenburg, A. S., Verwijs, M., & Klipstein-Grobusch, K. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154664 · Cited by 441
Beratarrechea, A., Lee, A. G., Willner, J. M., Jahangir, E., Ciapponi, A., & Rubinstein, A. (2014) · Telemedicine and e-Health · doi:10.1089/tmj.2012.0328 · Cited by 403
“Actually, controversy still exists for scaling up m-health interventions as they lack a foundation that would permit evidence-based scale-up.(50,52)”
“Scaling-out” evidence-based interventions to new populations or new health care delivery systems
Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017) · Implementation Science · doi:10.1186/s13012-017-0640-6 · Cited by 399
“However, this perspective is not universally shared [8], and there are examples of EBI”
BackgroundAddressing critical gaps in the treatment of eating disorders
Kazdin, A. E., Fitzsimmons‐Craft, E. E., & Wilfley, D. E. (2017) · International Journal of Eating Disorders · doi:10.1002/eat.22670 · Cited by 389
mHealth 2.0: Experiences, Possibilities, and Perspectives
Becker, S., Miron-Shatz, T., Schumacher, N., Krocza, J., Diamantidis, C., & Albrecht, U.-V. (2014) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3328 · Cited by 354
“On setting up a mobile communication intervention, one needs to bear in mind that next to the above-mentioned psychological factors, text messaging is more likely to work under a set of ideal parameters to include [26,42] the presence of follow-up; messages that are highly relevant in frequency, wording, and content;…”
BackgroundThe Continued Use of Mobile Health Apps: Insights From a Longitudinal Study
Vaghefi, I., & Tulu, B. (2019) · JMIR mHealth and uHealth · doi:10.2196/12983 · Cited by 335
“This is a critical question, as research on the use of mHealth beyond the adoption phase is sparse [9] and anecdotal evidence has yielded inconsistent findings showing very minimal or no improvements in individuals’ health because of adoption [6,19-21].”
Ben-Zeev, D., Kaiser, S. M., Brenner, C. J., Begale, M., Duffecy, J., & Mohr, D. C. (2013) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000019 · Cited by 304
“The penetration of mobile technologies among people living with psychotic disorders was approximately 20% lower than in the general population during the time of the study (Smith, 2011).”
BackgroundA Systematic Review of Blockchain in Healthcare: Frameworks, Prototypes, and Implementations
Chukwu, E., & Garg, L. (2020) · IEEE Access · doi:10.1109/access.2020.2969881 · Cited by 277
“Available evidence still suggests the inability of these systems to adequately meet stakeholder needs adequately [7].”
BackgroundOdendaal, W. A., Anstey Watkins, J., Leon, N., Goudge, J., Griffiths, F., Tomlinson, M., & Daniels, K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011942.pub2 · Cited by 289
“…computing power to improve the reach of healthcare delivery (Leon 2012; West 2014), including the capturing, processing, and exchange of information (Gagnon 2009), holding the potential to transform aspects of health service delivery and health systems management (Qiang 2011; Tomlinson 2013).”
BackgroundSelf-citationHuman-centered design for global health equity
Holeman, I., & Kane, D. (2020) · Information Technology for Development · doi:10.1080/02681102.2019.1667289 · Cited by 285
“Nonetheless, iteration bears special reflection for designers in global health because widely accepted models of medical evidence stipulate intervention design, evidence generation, and replication as separate phases (Tomlinson et al., 2013).”
BackgroundKazdin, A. E. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12937 · Cited by 274
Big data in global health: improving health in low- and middle-income countries
Wyber, R., Vaillancourt, S., Perry, W., Mannava, P., Folaranmi, T., & Celi, L. A. (2015) · Bulletin of the World Health Organization · doi:10.2471/blt.14.139022 · Cited by 238
Bogale, B., Mørkrid, K., O’Donnell, B., Ghanem, B., Abu Ward, I., Abu Khader, K., Isbeih, M., Frost, M., Baniode, M., Hijaz, T., et al. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-1002-x · Cited by 234
Text Messaging-Based Interventions for Smoking Cessation: A Systematic Review and Meta-Analysis
Scott-Sheldon, L. A. J., Lantini, R., Jennings, E. G., Thind, H., Rosen, R. K., Salmoirago-Blotcher, E., & Bock, B. C. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5436 · Cited by 231
“For these reasons, the design, development, and evaluation of text message-delivered interventions for health promotion, disease prevention, and disease management has greatly increased over the past decade [12].”
Blockchain Application in Healthcare Systems: A Review
Ghosh, P. K., Chakraborty, A., Hasan, M., Rashid, K., & Siddique, A. H. (2023) · Systems · doi:10.3390/systems11010038 · Cited by 187
Beatty, A. L., Fukuoka, Y., & Whooley, M. A. (2013) · Journal of the American Heart Association · doi:10.1161/jaha.113.000568 · Cited by 202
Anstey Watkins, J. O. T., Goudge, J., Gómez-Olivé, F. X., & Griffiths, F. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.01.011 · Cited by 196
“In response to the insufficient programmatic evidence of implementation and scale-up of mHealth, Tomlinson et al. (2013) recommended that the mHealth component must be guided using behaviour change theory.”
MethodVollmer Dahlke, D., Fair, K., Hong, Y. A., Beaudoin, C. E., Pulczinski, J., & Ory, M. G. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3861 · Cited by 199
“Tomlinson’s article addresses use of mHealth primarily in lesser-developed and under- resourced countries but raises concerns about level of evidence and generalizability of mHealth apps [23].”
BackgroundMobile Health (m-Health) in Retrospect: The Known Unknowns
Istepanian, R. S. H. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19073747 · Cited by 168
“, t li r t t i c s , cli ic l c ic fits r i s f t s - lt a licati s, t l i s ecific ealt care, ell ess a atie t care setti s [1,5–7] e global scaling-up associated ith robust clinical and econo ic evidence on a ider scale, and the sustainability of their usage, are yet to been proven [8].”
BackgroundOlu, O., Muneene, D., Bataringaya, J. E., Nahimana, M.-R., Ba, H., Turgeon, Y., Karamagi, H. C., & Dovlo, D. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00341 · Cited by 179
“…for African countries to realize the potential of DH. Fourth, evaluation of the outcomes, impact and cost-effectiveness, together with sustainable funding models for DH are also required to inform decisions to prioritize DH and determine their feasibility vis-à-vis the context of a country (20, 38).”
BackgroundOdendaal, W. A., Goudge, J., Griffiths, F., Tomlinson, M., Leon, N., & Daniels, K. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011942 · Cited by 173
Self-citationTsai, A. C., Scott, J. A., Hung, K. J., Zhu, J. Q., Matthews, L. T., Psaros, C., & Tomlinson, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082521 · Cited by 169
“The use of ultra-short screening and measurement instruments (defined in one proposal as being limited to 4 items or fewer and requiring less than 2 minutes to administer [64]), perhaps facilitated with mobile technologies [65–67], may expedite a strategy of screening, treatment, and/or treatment response monitoring a…”
Self-citationContinuous Evaluation of Evolving Behavioral Intervention Technologies
Mohr, D. C., Cheung, K., Schueller, S. M., Hendricks Brown, C., & Duan, N. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.06.006 · Cited by 168
“A growing interest globally is in developing robust deployment platforms, which would ideally be able to interact with electronic medical records.(4) For example, in the U.”
BackgroundJames, H. M., Papoutsi, C., Wherton, J., Greenhalgh, T., & Shaw, S. E. (2021) · Journal of Medical Internet Research · doi:10.2196/23775 · Cited by 164
“Little is currently known about how to successfully spread and scale up video consulting for sustained use across settings [23-25].”
BackgroundChen, H., Chai, Y., Dong, L., Niu, W., & Zhang, P. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8998 · Cited by 161
“A large number of RMNCH mobile applications (App), sensors, and wearable devices have been developed recently and are currently on the market, with diverse functions, ranging from bio-data monitoring to decision-making assistance [9-12].”
BackgroundBetjeman, T. J., Soghoian, S. E., & Foran, M. P. (2013) · International Journal of Telemedicine and Applications · doi:10.1155/2013/482324 · Cited by 160
“Further, there is a lack of standardization with regard to mobile device application design, which renders comparative studies looking at specific variables difficult [7].”
BackgroundKamal, A. K., Shaikh, Q., Pasha, O., Azam, I., Islam, M., Memon, A. A., Rehman, H., Akram, M. A., Affan, M., Nazir, S., et al. (2015) · BMC Neurology · doi:10.1186/s12883-015-0471-5 · Cited by 159
“mHealth (mobile Health) is a rapidly developing field whose potential of leverage to improve medically important outcomes is great but is limited by a lack of well-designed randomized controlled trials that measure robust outcomes [31, 32].”
BackgroundDanquah, L. O., Hasham, N., MacFarlane, M., Conteh, F. E., Momoh, F., Tedesco, A. A., Jambai, A., Ross, D. A., & Weiss, H. A. (2019) · BMC Infectious Diseases · doi:10.1186/s12879-019-4354-z · Cited by 155
“Most studies of mHealth applications are small-scale or pilot implementation studies, with few rigorously designed evaluation studies [28 – 30].”
BackgroundBloomfield, G. S., Vedanthan, R., Vasudevan, L., Kithei, A., Were, M., & Velazquez, E. J. (2014) · Globalization and Health · doi:10.1186/1744-8603-10-49 · Cited by 154
“, that despite the calls to scale up mHealth interventions in SSA, there are few current mHealth interventions that meet standards for scale up [15], especially for NCDs.”
BackgroundOdeny, T. A., Bukusi, E. A., Cohen, C. R., Yuhas, K., Camlin, C. S., & McClelland, R. S. (2014) · AIDS · doi:10.1097/qad.0000000000000409 · Cited by 151
Adam, M., McMahon, S. A., Prober, C., & Bärnighausen, T. (2019) · Journal of Medical Internet Research · doi:10.2196/12128 · Cited by 137
“The increasing availability of mobile technology in low- and middle-income countries (LMIC) foretells promising new avenues for the delivery and scaling of mobile health education to communities who need it urgently [3,5,17,21,22].”
Mobile Phone Interventions for Adolescent Sexual and Reproductive Health: A Systematic Review
L’Engle, K. L., Mangone, E. R., Parcesepe, A. M., Agarwal, S., & Ippoliti, N. B. (2016) · Pediatrics · doi:10.1542/peds.2016-0884 · Cited by 144
Wearable motion sensors to continuously measure real-world physical activities
Dobkin, B. H. (2013) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000026 · Cited by 142
Siegel, C., & Dorner, T. E. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.01.012 · Cited by 165
Mobile Phones in Research and Treatment: Ethical Guidelines and Future Directions
Carter, A., Liddle, J., Hall, W., & Chenery, H. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4538 · Cited by 133
“Hence, there is an urgent need to evaluate their effectiveness via randomized controlled trials before the widespread rollout of mHealth apps and associated products (eg, brain or heart monitors) [33].”
BackgroundA Rehabilitation-Internet-of-Things in the Home to Augment Motor Skills and Exercise Training
Dobkin, B. H. (2017) · Neurorehabilitation and Neural Repair · doi:10.1177/1545968316680490 · Cited by 127
mHealthApps: A Repository and Database of Mobile Health Apps
Xu, W., & Liu, Y. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4026 · Cited by 130
“Due to the difference in health conditions and app specialization, Tomlinson et al suggested an open mHealth architecture-based platform to facilitate scalable and sustainable health information systems [7].”
BackgroundSmartphones in the secondary prevention of cardiovascular disease: a systematic review.
Hamilton, S. J., Mills, B., Birch, E. M., & Thompson, S. C. (2018) · BMC Cardiovascular Disorders · doi:10.1186/s12872-018-0764-x · Cited by 128
“Both iterative components to explore discovery, development and evaluation of effectiveness leading to implementation and applied programmes of research for mHealth home-based CR or heart failure management have been reported [33, 34, 48, 49, 51].”
BackgroundLeon, N., Surender, R., Bobrow, K., Muller, J., & Farmer, A. (2015) · BMC Family Practice · doi:10.1186/s12875-015-0289-7 · Cited by 126
“Research is also needed on the up-scalability of such interventions within mainstream health services especially in low and middleincome settings [6–8].”
BackgroundMaulik, P. K., Kallakuri, S., Devarapalli, S., Vadlamani, V. K., Jha, V., & Patel, A. (2017) · Journal of Global Health · doi:10.7189/jogh.07.010408 · Cited by 125
Early, J., Gonzalez, C., Gordon-Dseagu, V., & Robles-Calderon, L. (2019) · Health Promotion Practice · doi:10.1177/1524839919855391 · Cited by 122
Knop, M. R., Hayashi, M., Lin, R., Saing, C. H., Ung, M., Oy, S., Yam, E. L. Y., Zahari, M., & Yi, S. (2024) · BMC Medicine · doi:10.1186/s12916-024-03417-9 · Cited by 157
“…in general, include its potential to improve the quality and coverage of health-care, increase access to health information, services and skills, and promote positive changes in health behaviors to prevent the onset of acute and chronic diseases and improve treatment adherence and outcomes [10–14].”
BackgroundAgile research to complement agile development: A proposal for an mHealth research lifecycle
Wilson, K., Bell, C., Wilson, L., & Witteman, H. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0053-1 · Cited by 118
Determinants of mHealth success: An empirical investigation of the user perspective
Birkmeyer, S., Wirtz, B. W., & Langer, P. F. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102351 · Cited by 115
“The most common application of mHealth is the use of mobile devices for preventive health services such as fitness and nutrition, and mobile-based telehealth approaches to connect users and health professionals (Tomlinson et al., 2013; Van Heerden et al., 2012).”
BackgroundMartin, C. K., Miller, A. C., Thomas, D. M., Champagne, C. M., Han, H., & Church, T. (2015) · Obesity · doi:10.1002/oby.21063 · Cited by 114
“Despite the preponderance of weight management apps and enthusiasm over their promise (13,31), only 15% of 204 apps reviewed included five or more of the evidence-based practices for weight management (32), and evidence of the efficacy of these apps is minimal (33-35).”
BackgroundMtema, Z. J., Changalucha, J. J., Cleaveland, S., Elias, M., Ferguson, H. M., Halliday, J. E. B., Haydon, D. T., Jaswant, G., Kazwala, R. R., Killeen, G. F., et al. (2016) · PLoS Medicine · doi:10.1371/journal.pmed.1002002 · Cited by 126
Sindi, S., Calov, E., Fokkens, J., Ngandu, T., Soininen, H., Tuomilehto, J., & Kivipelto, M. (2015) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2015.06.005 · Cited by 114
“There is also a lack of prevention Apps that are based onvali-dated models and theories of behavior change [24].”
BackgroundMobile Tele-Mental Health: Increasing Applications and a Move to Hybrid Models of Care
Chan, S., Torous, J., Hinton, L., & Yellowlees, P. (2014) · Healthcare · doi:10.3390/healthcare2020220 · Cited by 108
Little, A., Medhanyie, A., Yebyo, H., Spigt, M., Dinant, G.-J., & Blanco, R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0077563 · Cited by 107
Campbell, J. I., Aturinda, I., Mwesigwa, E., Burns, B., Santorino, D., Haberer, J. E., Bangsberg, D. R., Holden, R. J., Ware, N. C., & Siedner, M. J. (2017) · AIDS and Behavior · doi:10.1007/s10461-017-1765-y · Cited by 105
“Despite this growing body of work, most mobile health (mHealth) programs in RLS do not move beyond the pilot testing phase [4].”
BackgroundThe Paradoxes of Telehealth: a Review of the Literature 2000–2015
Standing, C., Standing, S., McDermott, M., Gururajan, R., & Kiani Mavi, R. (2018) · Systems Research and Behavioral Science · doi:10.1002/sres.2442 · Cited by 105
A mobile revolution for healthcare? Setting the agenda for bioethics
Lucivero, F., & Jongsma, K. R. (2018) · Journal of Medical Ethics · doi:10.1136/medethics-2017-104741 · Cited by 115
“…it has been argued that most sensors are unreliable in their signal detections, that it is unclear whether these devices can induce people to change their behaviour towards healthier lifestyles, 13 and that clinical professionals are unaware of how to integrate these systems in their workflow.”
BackgroundNjoroge, M., Zurovac, D., Ogara, E. A. A., Chuma, J., & Kirigia, D. (2017) · BMC Research Notes · doi:10.1186/s13104-017-2416-0 · Cited by 100
“These include inadequate infrastructure and equipment; insufficient human resources and skills; inadequate legislation; insufficient or unreliable power supply; scarce funding for sustainability; lack of government buy-in and ownership and weak evaluation mechanisms leading to the implementation of a myriad of pilot p…”
BackgroundHuynh, A. K., Hamilton, A. B., Farmer, M. M., Bean-Mayberry, B., Stirman, S. W., Moin, T., & Finley, E. P. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00134 · Cited by 100
“Strategies fell into five main categories, primarily related not only to use of evaluative and iterative strategies (6) and development of stakeholder interrelationships (5), but also reflecting efforts to train and educate stakeholders (2), adapt and tailor to context (2), and provide interactive assistance (1).”
BackgroundTriantafyllidis, A., Kondylakis, H., Votis, K., Tzovaras, D., Maglaveras, N., & Rahimi, K. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.103984 · Cited by 98
“In this direction, the use of factorial designs could facilitate insights [61].”
MethodThe value of mHealth for managing chronic conditions
Agnihothri, S., Cui, L., Delasay, M., & Rajan, B. (2020) · Health Care Management Science · doi:10.1007/s10729-018-9458-2 · Cited by 96
Shet, A., Costa, A. D., Kumarasamy, N., Rodrigues, R., Rewari, B. B., Ashorn, P., Eriksson, B., Diwan, V., & and the HIVIND Study Team (2014) · BMJ · doi:10.1136/bmj.g5978 · Cited by 91
Eyles, H. C., McLean, R., Neal, B. C., Jiang, Y., Doughty, R. N., McLean, R. M., & Mhurchú, C. N. (2017) · European Journal of Preventive Cardiology · doi:10.1177/2047487317715713 · Cited by 91
“A growing body of evidence indicates mobile technology can support behaviour change(7, 8), yet robust evidence for the effectiveness of smartphone interventions is lacking(9).”
BackgroundThe MomConnect mHealth initiative in South Africa: Early impact on the supply side of MCH services
Barron, P., Pillay, Y., Fernandes, A., Sebidi, J., & Allen, R. (2016) · Journal of Public Health Policy · doi:10.1057/s41271-016-0015-2 · Cited by 90
Mental Health Apps: Innovations, Risks and Ethical Considerations
Giota, K. G., & Kleftaras, G. (2014) · E-Health Telecommunication Systems and Networks · doi:10.4236/etsn.2014.33003 · Cited by 89
“As apps become rapidly integrated into routine healthcare (e.g. logging data, checking and updating patient status), time seems be of the essence in creating strong guidelines for such technology , as well as certification programs for mHealth apps worldwide [32] [33].”
BackgroundA New Frontier: Integrating Behavioral and Digital Technology to Promote Health Behavior
Dallery, J., Kurti, A., & Erb, P. (2015) · The Behavior Analyst · doi:10.1007/s40614-014-0017-y · Cited by 89
“Tomlinson et al. (2013) noted that one rule of thumb based on the results of text-based interventions is that they work better when behavior is monitored.”
BackgroundLund, S., Boas, I. M., Bedesa, T., Fekede, W., Nielsen, H. S., & Sørensen, B. L. (2016) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2016.0687 · Cited by 85
“26; median [range], 7 [1-500] women per facility)”
BackgroundInfluentialA systematic review of mHealth interventions for the support of eating disorders
Anastasiadou, D., Folkvord, F., & Lupiañez‐Villanueva, F. (2018) · European Eating Disorders Review · doi:10.1002/erv.2609 · Cited by 90
McCarroll, R., Eyles, H. C., & Mhurchú, C. N. (2017) · Preventive Medicine · doi:10.1016/j.ypmed.2017.08.022 · Cited by 97
Lodhia, V., Karanja, S., Lees, S., & Bastawrous, A. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4746 · Cited by 86
Gonzales, A. L., Ems, L., & Suri, V. R. (2016) · New Media & Society · doi:10.1177/1461444814558670 · Cited by 85
“Scholars focusing specifically on improving health among low- and middle-income nations are often more cautious in their optimism for the success of m-Health initiatives (Mechael, 2009; Mechael et al., 2010; Tomlinson et al., 2013).”
BackgroundUse of handheld computers in clinical practice: a systematic review
Mickan, S. M., Atherton, H., Roberts, N. W., Heneghan, C., & Tilson, J. K. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-56 · Cited by 96
“Most published studies to date describe the design, development and implementation of handheld computers using observational study designs [4].”
BackgroundInfluentialBobrow, K., Brennan, T., Springer, D., Levitt, N. S., Rayner, B., Namane, M., Yu, L.-M., Tarassenko, L., & Farmer, A. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-28 · Cited by 83
Wiljer, D., Shi, J., Lo, B., Sanches, M., Hollenberg, E., Johnson, A., Abi-Jaoudé, A., Chaim, G., Cleverley, K., Henderson, J., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/20790 · Cited by 78
“To date, assessments of most mHealth interventions have been limited to case studies, pilot studies, and randomized controlled trials (RCTs) with small sample sizes [22].”
Developing a roadmap for the translation of e-mental health services for depression
Batterham, P. J., Sunderland, M., Calear, A. L., Davey, C. G., Christensen, H., Teesson, M., Kay-Lambkin, F., Andrews, G., Mitchell, P. B., Herrman, H., et al. (2015) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867415582054 · Cited by 77
“The rapid and relevant research paradigm (Glasgow et al., 2014; Tomlinson et al., 2013) incorporates multiple small-scale experiments among diverse users and settings and studies to rapidly test and refine various components of e-health interventions and new technologies.”
BackgroundRaifman, J. R. G., Lanthorn, H. E., Rokicki, S., & Fink, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109032 · Cited by 75
“While few studies have examined the effects of text reminders in developing country settings [13,14], two studies indicate that text reminders improved patient adherence to HIV/ AIDS treatment in Kenya [15,16] and another study indicates that text reminders improve health worker adherence to treatment guidelines for p…”
BackgroundYasmin, F., Banu, B., Zakir, S. M., Sauerborn, R., Ali, L., & Souares, A. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0286-3 · Cited by 77
“[36], SMS is more likely to work if it is personally tailored, and the content are highly relevant.”
BackgroundInfluentialKey Elements of mHealth Interventions to Successfully Increase Physical Activity: Meta-Regression
Eckerstorfer, L. V., Tanzer, N. K., Vogrincic-Haselbacher, C., Kedia, G., Brohmer, H., Dinslaken, I., & Corcoran, K. (2018) · JMIR mHealth and uHealth · doi:10.2196/10076 · Cited by 76
“Tomlinson and colleagues [20] pointed out that there should be a joint effort among researchers to find and refine strategies for successful mHealth interventions.”
BackgroundBervell, B., & Al-Samarraie, H. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.04.024 · Cited by 74
“While health policy makers in Africa have started to recognize the potential of ehealth and m-health systems, their usage have been varied across 53 African countries [14].”
BackgroundHuberty, J. L., Green, J., Puzia, M. E., Larkey, L., Laird, B., Vranceanu, A.-M., Vlisides-Henry, R., & Irwin, M. R. (2021) · PLOS ONE · doi:10.1371/journal.pone.0244717 · Cited by 73
“Furthermore, travel is a common barrier to face-to-face interventions, and the use of mobile apps allows the participant to engage in the comfort and privacy of their home [25].”
BackgroundFord II, J. H., Alagoz, E., Dinauer, S., Johnson, K. A., Pe-Romashko, K., & Gustafson, D. H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3965 · Cited by 73
“The possibilities for use of mHealth technology to address care delivery, patient monitoring, and adherence support have created substantial enthusiasm among developers, providers, policy makers, and researchers to use mHealth tools [3].”
Andrews, G., & Williams, A. D. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.05.006 · Cited by 85
“Tomlinson et al. (2013) provide a schematic account of the steps required to scale-up a new intervention (see Table 3).”
BackgroundInfluentialTofighi, B., Nicholson, J. M., McNeely, J., Muench, F., & Lee, J. D. (2017) · Drug and Alcohol Review · doi:10.1111/dar.12535 · Cited by 71
Distal technologies and type 1 diabetes management
Duke, D. C., Barry, S., Wagner, D. V., Speight, J., Choudhary, P., & Harris, M. A. (2018) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(17)30260-7 · Cited by 70
Trajectory of A ffordances: Insights from a case of telemedicine in Nepal
Thapa, D., & Sein, M. K. (2017) · Information Systems Journal · doi:10.1111/isj.12160 · Cited by 114
Szinay, D., Forbes, C. C., Busse, H., DeSmet, A., Smit, E. S., & König, L. M. (2023) · Obesity Reviews · doi:10.1111/obr.13542 · Cited by 71
“Mobile interventions are especially promising in increasing access to health care for all, as they may solve the structural barriers to access to care.(44) Though many behaviors have shown to impact body weight, we decided to focus on physical activity, diet, and sedentary behavior for this review, as these are common…”
BackgroundBaskerville, N. B., Struik, L. L., Guindon, G. E., Norman, C. D., Whittaker, R., Burns, C., Hammond, D., Dash, D., & Brown, K. S. (2018) · JMIR mHealth and uHealth · doi:10.2196/10893 · Cited by 71
“These findings pave the way to examine specific evidence-informed components that do or do not translate well in the mHealth context that has implications for future research and successful scale-up [47].”
Establishing Standards to Evaluate the Impact of Integrating Digital Health into Health Systems
Labrique, A. B., Vasudevan, L., Weiss, W. M., & Wilson, K. S. (2018) · Global Health Science and Practice · doi:10.9745/ghsp-d-18-00230 · Cited by 77
“Despite the pervasiveness of these digital innovations, there has been rampant criticism of limited evidence to support their effectiveness.(1) Numerous systematic reviews have been conducted with the same conclusion—the available evidence is of low-to-moderate quality and rigorous methodologies are needed to evaluate…”
BackgroundLee, S., Cho, Y.-M., & Kim, S. (2017) · Globalization and Health · doi:10.1186/s12992-017-0286-9 · Cited by 80
“Therefore, strategies to minimize duplicate effort and scale up current initiatives must be implemented [35].”
Bally, E., & Cesuroğlu, T. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00407 · Cited by 75
“These characteristics, together with strong internal and external stakeholder collaboration, are essential to create an “implementation climate” for successful adoption (50, 51).”
BackgroundSkinner, D., Delobelle, P., Pappin, M., Pieterse, D., Esterhuizen, T. M., Barron, P., & Dudley, L. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2017-000561 · Cited by 66
“The gaps in mHealth intervention development stem from the limited scale and scope of mHealth implementation and evaluation,(15) and the current mHealth evidence base comprises mostly evidence from the field of computer science and not health, which is not sufficient to inform and influence stakeholders to invest reso…”
BackgroundNeinstein, A., Wong, J., Look, H., Arbiter, B., Quirk, K., McCanne, S., Sun, Y., Blum, M., & Adi, S. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv104 · Cited by 66
“These more precise insights are currently lacking in most published diabetes mobile app studies,(30) which tend to follow the “black box” model of evaluation.(33) Usability testing methods not typically seen in healthcare might be possible, such as “A/B testing,”(76) where researchers can perform repeated usability te…”
BackgroundSmartphone applications for cancer patients; what we know about them?
Collado‐Borrell, R., Escudero‐Vilaplana, V., Ribed-Sánchez, A., Ibáñez-García, S., Alonso, A. H., & Sanjurjo‐Sáez, M. (2016) · PubMed · doi:10.7399/fh.2016.40.1.8993 · Cited by 66
Smartloss: A Personalized Mobile Health Intervention for Weight Management and Health Promotion
Martin, C. K., Gilmore, L. A., Apolzan, J. W., Myers, C. A., Thomas, D. M., & Redman, L. M. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5027 · Cited by 86
“Also, there is limited evidence for the efficacy of mHealth weight loss interventions [18-20] and the Guidelines for the Management of Overweight and Obesity in Adults [3] conclude that there is a low quality rating in the strength of evidence for mHealth interventions.”
BackgroundAugmented reality in patient education and health literacy: a scoping review protocol
Adapa, K., Jain, S., Kanwar, R., Zaman, T., Taneja, T., Walker, J. S., & Mazur, L. M. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038416 · Cited by 78
The use of mobile phones for the prevention and control of arboviral diseases: a scoping review
Carrillo, M. A., Kroeger, A., Cardenas Sanchez, R., Diaz Monsalve, S., & Runge-Ranzinger, S. (2021) · BMC Public Health · doi:10.1186/s12889-020-10126-4 · Cited by 64
“In low- and middle-income countries (LMICs), the use of the mobile technology has been an innovative solution to overcome health barriers such as challenging areas with di cult access, inadequate workforce and restricted nancial resources [35,36].”
BackgroundA Scalable Framework to Detect Personal Health Mentions on Twitter
Yin, Z., Fabbri, D., Rosenbloom, S. T., & Malin, B. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4305 · Cited by 78
“Recognizing this limitation, investigators have suggested that the data contributed through non-traditional domains, such as mobile apps [9-11] and online forums where patients self-report on their status [12,13], will provide a more complete view of an individual’s health and population-based health trends.”
Background
Metadata
- Authors
- Tomlinson, M., Rotheram-Borus, M. J., Swartz, L., & Tsai, A. C.
- Affiliations
- Stellenbosch University (ZA)
- Massachusetts General Hospital (US)
- Corresponding author
- Tomlinson, Mark
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-02-12
- Volume
- 10
- Issue
- 2
- Pages
- e1001382
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC3570540
- OpenAlex
- W2037924767
- Cited by
- 673
- References
- 38
- Citations by year
- 2026: 22 · 2025: 27 · 2024: 31 · 2023: 29 · 2022: 50 · 2021: 55 · 2020: 65 · 2019: 58 · 2018: 59 · 2017: 78 · 2016: 67 · 2015: 63 · 2014: 46 · 2013: 23
- FWCI
- 119.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- SUNScholar (Stellenbosch University) (submittedVersion)
- Funders
- National Research Foundation
- Department for International Development
- National Institutes of Health
- National Institute of Mental Health (K23MH096620, P30MH058107)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Keywords
- mobile health, scale-up, evidence base, health technology adoption, digital health interventions
- MeSH terms
- Cooperative Behavior, Delivery of Health Care, Health Services Research, Humans, Interinstitutional Relations, Health Knowledge, Attitudes, Practice, Program Evaluation, Health Behavior, Program Development, Telemedicine, Evidence-Based Medicine, Cell Phone, Text Messaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
![Figure 1 Research stages and standards. Adapted from Olds et al. [29] and Flay et al. [27].](https://figures.cochat.ai/paper-figures/057ace45863c49c4b5e7eac5af7c91b6/scaling-up-mhealth-where-is-the-evidence-figure-1.jpg)