Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 245

The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.

Safety concerns with consumer-facing mobile health applications and their consequences: a scoping review

Open access
Akbar, Saba, Coiera,, Enrico, Magrabi, Farah·2020·Journal of the American Medical Informatics Association

Abstract

Objective: To summarize the research literature about safety concerns with consumer-facing health apps and their consequences. Materials and Methods: We searched bibliographic databases including PubMed, Web of Science, Scopus, and Cochrane libraries from January 2013 to May 2019 for articles about health apps. Descriptive information about safety concerns and consequences were extracted and classified into natural categories. The review was conducted in accordance with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) statement. Results: Of the 74 studies identified, the majority were reviews of a single or a group of similar apps (n = 66, 89%), nearly half related to disease management (n = 34, 46%). A total of 80 safety concerns were identified, 67 related to the quality of information presented including incorrect or incomplete information, variation in content, and incorrect or inappropriate response to consumer needs. The remaining 13 related to app functionality including gaps in features, lack of validation for user input, delayed processing, failure to respond to health dangers, and faulty alarms. Of the 52 reports of actual or potential consequences, 5 had potential for patient harm. We also identified 66 reports about gaps in app development, including the lack of expert involvement, poor evidence base, and poor validation. Conclusions: Safety of apps is an emerging public health issue. The available evidence shows that apps pose clinical risks to consumers. Involvement of consumers, regulators, and healthcare professionals in development and testing can improve quality. Additionally, mandatory reporting of safety concerns is needed to improve outcomes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/jamia/ocz175

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 26 references

Research works printed but not linked: 88

  1. Joshi, 2017, Facilitating the feedback process on a clinical clerkship using a smartphone application, Acad Psychiatry, 41, 651, 10.1007/s40596-017-0711-7 · DOI
  2. Wicks, 2015, Trust but verify'–five approaches to ensure safe medical apps, BMC Med, 13, 205., 10.1186/s12916-015-0451-z · DOI
  3. Peng, 2016, A qualitative study of user perceptions of mobile health apps, BMC Public Health, 16, 1158, 10.1186/s12889-016-3808-0 · DOI · Paper page
  4. Pellegrini, 2012, A smartphone-supported weight loss program: design of the ENGAGED randomized controlled trial, BMC Public Health, 12, 1041., 10.1186/1471-2458-12-1041 · DOI
  5. Lewis, 2014, mHealth and mobile medical apps: a framework to assess risk and promote safer use, J Med Internet Res, 16, e210., 10.2196/jmir.3133 · DOI · Paper page
  6. Terry, 2018, Regulating mobile mental health apps, Behav Sci Law, 36, 136, 10.1002/bsl.2339 · DOI
  7. Sun, 2019, Improving glycemic control in adults and children with type 1 diabetes with the use of smartphone-based mobile applications: a systematic review, Can J Diabetes, 43, 51, 10.1016/j.jcjd.2018.03.010 · DOI
  8. Farzandipour, 2017, Patient self-management of asthma using mobile health applications: a systematic review of the functionalities and effects, Appl Clin Inform, 8, 1068, 10.4338/ACI-2017-07-R-0116 · DOI
  9. Albrecht, 2016, mHealth apps and their risks - taking stock, Stud Health Technol Inform, 226, 225
  10. Singh, 2016, Developing a framework for evaluating the patient engagement, quality, and safety of mobile health applications, Issue Brief (Commonw Fund), 5, 1
  11. Eng, 2013, The promise and peril of mobile health applications for diabetes and endocrinology, Pediatr Diabetes, 14, 231, 10.1111/pedi.12034 · DOI · Paper page
  12. Sarwar, 2018, Mobile health applications in cardiovascular research, Int J Cardiol, 269, 265, 10.1016/j.ijcard.2018.06.039 · DOI
  13. Weaver, 2013, Let's get wasted!” and other apps: characteristics, acceptability, and use of alcohol-related smartphone applications, JMIR mHealth Uhealth, 1, e9., 10.2196/mhealth.2709 · DOI
  14. Foley, 2016, PATI: Patient accessed tailored information: a pilot study to evaluate the effect on preoperative breast cancer patients of information delivered via a mobile application, Breast, 30, 54, 10.1016/j.breast.2016.08.012 · DOI · Paper page
  15. Skar, 2018, Women's experiences with using a smartphone app (the Pregnant+ app) to manage gestational diabetes mellitus in a randomised controlled trial, Midwifery, 58, 102, 10.1016/j.midw.2017.12.021 · DOI
  16. Alexander, 2017, Comparison of smartphone application-based vital sign monitors without external hardware versus those used in clinical practice: a prospective trial, J Clin Monit Comput, 31, 825, 10.1007/s10877-016-9889-6 · DOI
  17. Sorkin, 2016, Comparison of Ishihara booklet with color vision smartphone applications, Optom Vis Sci, 93, 667, 10.1097/OPX.0000000000000873 · DOI
  18. Dubad, 2018, A systematic review of the psychometric properties, usability and clinical impacts of mobile mood-monitoring applications in young people, Psychol Med, 48 (2): 208–28
  19. Brouard, 2016, Mobile applications in oncology: is it possible for patients and healthcare professionals to easily identify relevant tools?, Ann Med, 48, 509, 10.1080/07853890.2016.1195010 · DOI
  20. Collado-Borrell, 2016, Smartphone applications for cancer patients; what we know about them?, Farm Hosp, 40, 25
  21. Wilson, 2016, The quality and accuracy of mobile apps to prevent driving after drinking alcohol, JMIR mHealth Uhealth, 4, e98., 10.2196/mhealth.5961 · DOI
  22. Stevens, 2015, Smartphone apps for urolithiasis, Urolithiasis, 43, 13, 10.1007/s00240-014-0738-0 · DOI
  23. Modave, 2015, Low quality of free coaching apps with respect to the American College of Sports Medicine Guidelines: a review of current mobile apps, JMIR mHealth Uhealth, 3, e77., 10.2196/mhealth.4669 · DOI
  24. Robertson, 2016, Smartphone apps for spinal surgery: is technology good or evil?, Eur Spine J, 25, 1355, 10.1007/s00586-015-3932-z · DOI
  25. Lambert, 2017, Should we recommend renal diet–related apps to our patients? An evaluation of the quality and health literacy demand of renal diet–related mobile applications, J Ren Nutr, 27, 430, 10.1053/j.jrn.2017.06.007 · DOI
  26. Soffer, 2019, In search of accurate fetal heart rate monitoring mobile applications, Telemed J E Health, 25, 870, 10.1089/tmj.2018.0104 · DOI
  27. Barnes, 2019, Evaluation of smartphone pelvic floor exercise applications using standardized scoring system, Female Pelvic Med Reconstr Surg, 25, 328, 10.1097/SPV.0000000000000563 · DOI
  28. Daly, 2019, Mobile applications providing guidance about decreased fetal movement: review and content analysis, Women Birth, 32, e289, 10.1016/j.wombi.2018.07.020 · DOI
  29. Guo, 2017, Assessing the quality of mobile exercise apps based on the American College of Sports Medicine Guidelines: a reliable and valid scoring instrument, J Med Internet Res, 19, e67., 10.2196/jmir.6976 · DOI
  30. Huckvale, 2015, Smartphone apps for calculating insulin dose: a systematic assessment, BMC Med, 13, 106, 10.1186/s12916-015-0314-7 · DOI · Paper page
  31. Xiao, 2017, Current status of cardiovascular disease-related smartphone apps downloadable in China, Telemed J E Health, 23, 219, 10.1089/tmj.2016.0083 · DOI
  32. Sullivan, 2016, Smartphone apps for measuring human health and climate change co-benefits: a comparison and quality rating of available apps, JMIR mHealth Uhealth, 4, e135., 10.2196/mhealth.5931 · DOI
  33. Regmi, 2017, Assessment of content, quality and compliance of the STaR mobile application for smoking cessation, Tob Prev Cessation, 3, 120, 10.18332/tpc/75226 · DOI
  34. Flaherty, 2018, Can existing mobile apps support healthier food purchasing behaviour? Content analysis of nutrition content, behaviour change theory and user quality integration, Public Health Nutr, 21, 288, 10.1017/S1368980017002889 · DOI
  35. Choi, 2018, Review of the content and quality of mobile applications about Alzheimer's disease and related dementias, J Appl Gerontol
  36. Jeon, 2014, Analysis of the information quality of Korean obesity-management smartphone applications, Healthc Inform Res, 20, 23, 10.4258/hir.2014.20.1.23 · DOI
  37. Orr, 2015, Validity of smartphone pedometer applications, BMC Res Notes, 8, 733, 10.1186/s13104-015-1705-8 · DOI
  38. Bailey, 2014, The availability, functionality, and quality of mobile applications supporting medication selfmanagement, J Am Med Inform Assoc, 21, 542, 10.1136/amiajnl-2013-002232 · DOI
  39. Lee, 2015, Smartphone and tablet apps for concussion road warriors (team clinicians): a systematic review for practical users, Br J Sports Med, 49, 499, 10.1136/bjsports-2013-092930 · DOI
  40. Gibbs, 2017, Can you recommend any good STI apps?' A review of content, accuracy and comprehensiveness of current mobile medical applications for STIs and related genital infections, Sex Transm Infect, 93, 234.1, 10.1136/sextrans-2016-052690 · DOI
  41. Coppetti, 2017, Accuracy of smartphone apps for heart rate measurement, Eur J Prev Cardiol, 24, 1287, 10.1177/2047487317702044 · DOI
  42. Gray, 2013, Systematic review of the development, implementation and availability of smart-phone applications for assessing type 2 diabetes risk, Diabet Med, 30, 758, 10.1111/dme.12115 · DOI
  43. Baig, 2015, Mobile healthcare applications: system design review, critical issues and challenges, Australas Phys Eng Sci Med, 38, 23, 10.1007/s13246-014-0315-4 · DOI · Paper page
  44. Patel, 2017, Accuracy of a smartphone application in estimating sleep in children, Sleep Breath, 21, 505, 10.1007/s11325-016-1425-x · DOI
  45. Penzenstadler, 2016, Quality of smartphone apps related to alcohol use disorder, Eur Addict Res, 22, 329, 10.1159/000449097 · DOI
  46. Xiao, 2016, Current Status and quality assessment of cardiovascular diseases related smartphone apps in China, Stud Health Technol Inform, 225, 1030
  47. Carter, 2013, Contemporary vascular smartphone medical applications, Ann Vasc Surg, 27, 804, 10.1016/j.avsg.2012.10.013 · DOI
  48. Gajecki, 2014, Mobile phone brief intervention applications for risky alcohol use among university students: a randomized controlled study, Addict Sci Clin Pract, 9, 11., 10.1186/1940-0640-9-11 · DOI · Paper page
  49. Mobasheri, 2014, Smartphone breast applications - what's the evidence?, Breast, 23, 683, 10.1016/j.breast.2014.07.006 · DOI · Paper page
  50. Lee, 2016, Utilization and content evaluation of mobile applications for pregnancy, birth, and child care, Healthc Inform Res, 22, 73, 10.4258/hir.2016.22.2.73 · DOI
  51. Kwan, 2019, A review of smartphone applications for persons with traumatic brain injury: what is available and what is the evidence?, J Head Trauma Rehabil, 34, E45, 10.1097/HTR.0000000000000425 · DOI
  52. Simões, 2018, Features, behavioral change techniques, and quality of the most popular mobile apps to measure physical activity: Systematic search in app stores, JMIR mHealth Uhealth, 6, e11281., 10.2196/11281 · DOI
  53. Jamaladin, 2018, Mobile apps for blood pressure monitoring: systematic search in app stores and content analysis, JMIR mHealth Uhealth, 6, e187., 10.2196/mhealth.9888 · DOI
  54. Paudel, 2018, Smartphone applications for amblyopia treatment: a review of current apps and professional involvement, Telemed J E Health, 24, 797, 10.1089/tmj.2017.0220 · DOI
  55. Pereira-Azevedo, 2015, mHealth in urology: a review of experts' involvement in app development, PLoS One, 10, e0125547., 10.1371/journal.pone.0125547 · DOI
  56. Zhou, 2018, Mobile applications for allergic rhinitis, Ann Otol Rhinol Laryngol, 127, 836, 10.1177/0003489418798385 · DOI
  57. Casale, 2018, Mobile applications in otolaryngology for patients: an update, Laryngoscope Investig Otolaryngol, 3, 434, 10.1002/lio2.201 · DOI
  58. Regmi, 2018, Quality and use of free smoking cessation apps for smartphones, Int J Technol Assess Health Care, 34, 476, 10.1017/S0266462318000521 · DOI
  59. Zhang, 2016, Analysis of the information quality of bariatric surgery smartphone applications using the Silberg scale, Obes Surg, 26, 163, 10.1007/s11695-015-1890-5 · DOI
  60. Van Singer, 2015, Quality of smartphone apps related to panic disorder, Front Psychiatry, 6, 96, 10.3389/fpsyt.2015.00096 · DOI · Paper page
  61. Fougerouse, 2017, A cross-sectional study of prominent US mobile health applications: evaluating the current landscape, AMIA Annu Symp Proc, 2017, 715
  62. Zhang, 2017, Current status of postnatal depression smartphone applications available on application stores: an information quality analysis, BMJ Open, 7, e015655., 10.1136/bmjopen-2016-015655 · DOI
  63. Owens, 2018, Systematic review of commercially available mobile phone applications for prostate cancer education, Am J Mens Health, 13, 1557988318816912.
  64. Richardson, 2019, Evaluation of mobile apps targeted to parents of infants in the neonatal intensive care unit: systematic app review, JMIR mHealth Uhealth, 7, e11620., 10.2196/11620 · DOI
  65. Wong, 2015, Smartphone apps for orthopaedic sports medicine - a smart move?, BMC Sports Sci Med Rehabil, 7, 23, 10.1186/s13102-015-0017-6 · DOI
  66. Lee, 2014, Hype or hope for diabetes mobile health applications?, Diabetes Res Clin Pract, 106, 390, 10.1016/j.diabres.2014.11.001 · DOI
  67. Hundert, 2014, Commercially available mobile phone headache diary apps: a systematic review, JMIR Mhealth Uhealth, 16, e36., 10.2196/mhealth.3452 · DOI
  68. Fraser, 2018, Safety of patient-facing digital symptom checkers, Lancet, 392, 2263, 10.1016/S0140-6736(18)32819-8 · DOI · Paper page
  69. Chen, 2017, Functionality, implementation, impact, and the role of health literacy in mobile phone apps for gestational diabetes: scoping review, JMIR Diabetes, 2, e25., 10.2196/diabetes.8045 · DOI
  70. Schnall, 2016, A user-centered model for designing consumer mobile health (mHealth) applications (apps), J Biomed Inform, 60, 243, 10.1016/j.jbi.2016.02.002 · DOI · Paper page
  71. Stanziola, 2015, User-centered design of health care software development: towards a cultural change, Stud Health Technol Inform, 216, 368
  72. O'Neill, 2012, Colorectal smartphone apps: opportunities and risks, Colorectal Dis, 14, e530, 10.1111/j.1463-1318.2012.03088.x · DOI · Paper page
  73. Coiera, 2015, Guide to Health Informatics, 10.1201/b13617 · DOI · Paper page
  74. Curtis, 2019, A medication adherence app for children with sickle cell disease: qualitative study, JMIR mHealth Uhealth, 7, e8130., 10.2196/mhealth.8130 · DOI
  75. Demidowich, 2012, An evaluation of diabetes self-management applications for android smartphones, J Telemed Telecare, 18, 235, 10.1258/jtt.2012.111002 · DOI
  76. Yasini, 2015, Mobile health applications, in the absence of an authentic regulation, Stud Health Technol Inform, 216, 127
  77. Corrao, 2010, Importance of testing for usability when selecting and implementing an electronic health or medical record system, J Oncol Pract, 6, 120, 10.1200/JOP.200017 · DOI
  78. Berkowitz, 2017, Prescribing an app? Oncology providers' views on mobile health apps for cancer care, JCO Clin Cancer Inform, 1, 10.1200/CCI.17.00107 · DOI
  79. Kessel, 2016, Mobile apps in oncology: a survey on health care professionals' attitude toward telemedicine, mHealth, and oncological apps, J Med Internet Res, 18, e312., 10.2196/jmir.6399 · DOI
  80. Byambasuren, 2019, Current knowledge and adoption of mobile health apps among Australian general practitioners: survey study, JMIR mHealth Uhealth, 7, e13199., 10.2196/13199 · DOI · Paper page
  81. Roper, 2017, Please leave your phone outside: policymakers and medical app providers are encouraging patient participation, but doctors in the consult room are not, BMJ Innov, 3, 65, 10.1136/bmjinnov-2016-000134 · DOI
  82. Kessel, 2017, Mobile health in oncology: a patient survey about app-assisted cancer care, JMIR mHealth Uhealth, 5, e81., 10.2196/mhealth.7689 · DOI
  83. Boudreaux, 2014, Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations, Behav Med Pract Policy Res, 4, 363, 10.1007/s13142-014-0293-9 · DOI · Paper page
  84. van Velthoven, 2017, Do health apps need endorsement? Challenges for giving advice about which health apps are safe and effective to use, Digit Health, 3, 205520761770134., 10.1177/2055207617701342 · DOI
  85. Bates, 2018, Health apps and health policy: what is needed?, JAMA, 320, 1975, 10.1001/jama.2018.14378 · DOI
  86. El-Sayed, 2019, Exploiting mobile edge computing for enhancing vehicular applications in smart cities, Sensors (Basel), 19, E1073, 10.3390/s19051073 · DOI
  87. Eysenbach, 2013, CONSORT-EHEALTH: implementation of a checklist for authors and editors to improve reporting of web-based and mobile randomized controlled trials, Stud Health Technol Inform, 192, 657
  88. Brender, 2013, STARE-HI - statement on reporting of evaluation studies in health informatics: explanation and elaboration, Appl Clin Inform, 4, 331, 10.4338/ACI-2013-04-RA-0024 · DOI

Cited by

See all 245

Metadata

Authors
Akbar, S., Coiera, & Magrabi, F.
Venue
Journal of the American Medical Informatics Association
Published
2019-10-10
Volume
27
Issue
2
Pages
330-340
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W2979989194
Cited by
245
References
26
FWCI
26.26
Type
journal article
Language
en
Open access
hybrid
Funders
Australian National Health and Medical Research Council Centre for Research Excellence in Digital Health (1134919)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Safety concerns with consumer-facing mobile health applications and their consequences: a scoping review. https://app.cochat.ai/papers/10.1093/jamia/ocz175
The paper
Akbar, S., Coiera, & Magrabi, F. (2020). Safety concerns with consumer-facing mobile health applications and their consequences: a scoping review. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocz175

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.