Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 245

The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.

Safety concerns with consumer-facing mobile health applications and their consequences: a scoping review

Open access
Akbar, Saba, Coiera,, Enrico, Magrabi, Farah · 2020 · Journal of the American Medical Informatics Association

Abstract

Objective: To summarize the research literature about safety concerns with consumer-facing health apps and their consequences. Materials and Methods: We searched bibliographic databases including PubMed, Web of Science, Scopus, and Cochrane libraries from January 2013 to May 2019 for articles about health apps. Descriptive information about safety concerns and consequences were extracted and classified into natural categories. The review was conducted in accordance with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) statement. Results: Of the 74 studies identified, the majority were reviews of a single or a group of similar apps (n = 66, 89%), nearly half related to disease management (n = 34, 46%). A total of 80 safety concerns were identified, 67 related to the quality of information presented including incorrect or incomplete information, variation in content, and incorrect or inappropriate response to consumer needs. The remaining 13 related to app functionality including gaps in features, lack of validation for user input, delayed processing, failure to respond to health dangers, and faulty alarms. Of the 52 reports of actual or potential consequences, 5 had potential for patient harm. We also identified 66 reports about gaps in app development, including the lack of expert involvement, poor evidence base, and poor validation. Conclusions: Safety of apps is an emerging public health issue. The available evidence shows that apps pose clinical risks to consumers. Involvement of consumers, regulators, and healthcare professionals in development and testing can improve quality. Additionally, mandatory reporting of safety concerns is needed to improve outcomes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/jamia/ocz175

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 83

  1. Joshi, 2017, Facilitating the feedback process on a clinical clerkship using a smartphone application, Acad Psychiatry, 41, 651, 10.1007/s40596-017-0711-7 · DOI
  2. Wicks, 2015, Trust but verify'–five approaches to ensure safe medical apps, BMC Med, 13, 205., 10.1186/s12916-015-0451-z · DOI
  3. Pellegrini, 2012, A smartphone-supported weight loss program: design of the ENGAGED randomized controlled trial, BMC Public Health, 12, 1041., 10.1186/1471-2458-12-1041 · DOI
  4. Lewis, 2014, mHealth and mobile medical apps: a framework to assess risk and promote safer use, J Med Internet Res, 16, e210., 10.2196/jmir.3133 · DOI · Paper page
  5. Terry, 2018, Regulating mobile mental health apps, Behav Sci Law, 36, 136, 10.1002/bsl.2339 · DOI
  6. Sun, 2019, Improving glycemic control in adults and children with type 1 diabetes with the use of smartphone-based mobile applications: a systematic review, Can J Diabetes, 43, 51, 10.1016/j.jcjd.2018.03.010 · DOI
  7. Farzandipour, 2017, Patient self-management of asthma using mobile health applications: a systematic review of the functionalities and effects, Appl Clin Inform, 8, 1068, 10.4338/ACI-2017-07-R-0116 · DOI
  8. Albrecht, 2016, mHealth apps and their risks - taking stock, Stud Health Technol Inform, 226, 225
  9. Singh, 2016, Developing a framework for evaluating the patient engagement, quality, and safety of mobile health applications, Issue Brief (Commonw Fund), 5, 1
  10. Eng, 2013, The promise and peril of mobile health applications for diabetes and endocrinology, Pediatr Diabetes, 14, 231, 10.1111/pedi.12034 · DOI · Paper page
  11. Sarwar, 2018, Mobile health applications in cardiovascular research, Int J Cardiol, 269, 265, 10.1016/j.ijcard.2018.06.039 · DOI
  12. Weaver, 2013, Let's get wasted!” and other apps: characteristics, acceptability, and use of alcohol-related smartphone applications, JMIR mHealth Uhealth, 1, e9., 10.2196/mhealth.2709 · DOI
  13. Skar, 2018, Women's experiences with using a smartphone app (the Pregnant+ app) to manage gestational diabetes mellitus in a randomised controlled trial, Midwifery, 58, 102, 10.1016/j.midw.2017.12.021 · DOI
  14. Alexander, 2017, Comparison of smartphone application-based vital sign monitors without external hardware versus those used in clinical practice: a prospective trial, J Clin Monit Comput, 31, 825, 10.1007/s10877-016-9889-6 · DOI
  15. Sorkin, 2016, Comparison of Ishihara booklet with color vision smartphone applications, Optom Vis Sci, 93, 667, 10.1097/OPX.0000000000000873 · DOI
  16. Dubad, 2018, A systematic review of the psychometric properties, usability and clinical impacts of mobile mood-monitoring applications in young people, Psychol Med, 48 (2): 208–28
  17. Brouard, 2016, Mobile applications in oncology: is it possible for patients and healthcare professionals to easily identify relevant tools?, Ann Med, 48, 509, 10.1080/07853890.2016.1195010 · DOI
  18. Collado-Borrell, 2016, Smartphone applications for cancer patients; what we know about them?, Farm Hosp, 40, 25
  19. Wilson, 2016, The quality and accuracy of mobile apps to prevent driving after drinking alcohol, JMIR mHealth Uhealth, 4, e98., 10.2196/mhealth.5961 · DOI
  20. Stevens, 2015, Smartphone apps for urolithiasis, Urolithiasis, 43, 13, 10.1007/s00240-014-0738-0 · DOI
  21. Modave, 2015, Low quality of free coaching apps with respect to the American College of Sports Medicine Guidelines: a review of current mobile apps, JMIR mHealth Uhealth, 3, e77., 10.2196/mhealth.4669 · DOI
  22. Robertson, 2016, Smartphone apps for spinal surgery: is technology good or evil?, Eur Spine J, 25, 1355, 10.1007/s00586-015-3932-z · DOI
  23. Lambert, 2017, Should we recommend renal diet–related apps to our patients? An evaluation of the quality and health literacy demand of renal diet–related mobile applications, J Ren Nutr, 27, 430, 10.1053/j.jrn.2017.06.007 · DOI
  24. Soffer, 2019, In search of accurate fetal heart rate monitoring mobile applications, Telemed J E Health, 25, 870, 10.1089/tmj.2018.0104 · DOI
  25. Barnes, 2019, Evaluation of smartphone pelvic floor exercise applications using standardized scoring system, Female Pelvic Med Reconstr Surg, 25, 328, 10.1097/SPV.0000000000000563 · DOI
  26. Daly, 2019, Mobile applications providing guidance about decreased fetal movement: review and content analysis, Women Birth, 32, e289, 10.1016/j.wombi.2018.07.020 · DOI
  27. Guo, 2017, Assessing the quality of mobile exercise apps based on the American College of Sports Medicine Guidelines: a reliable and valid scoring instrument, J Med Internet Res, 19, e67., 10.2196/jmir.6976 · DOI
  28. Huckvale, 2015, Smartphone apps for calculating insulin dose: a systematic assessment, BMC Med, 13, 106, 10.1186/s12916-015-0314-7 · DOI · Paper page
  29. Xiao, 2017, Current status of cardiovascular disease-related smartphone apps downloadable in China, Telemed J E Health, 23, 219, 10.1089/tmj.2016.0083 · DOI
  30. Sullivan, 2016, Smartphone apps for measuring human health and climate change co-benefits: a comparison and quality rating of available apps, JMIR mHealth Uhealth, 4, e135., 10.2196/mhealth.5931 · DOI
  31. Regmi, 2017, Assessment of content, quality and compliance of the STaR mobile application for smoking cessation, Tob Prev Cessation, 3, 120, 10.18332/tpc/75226 · DOI
  32. Flaherty, 2018, Can existing mobile apps support healthier food purchasing behaviour? Content analysis of nutrition content, behaviour change theory and user quality integration, Public Health Nutr, 21, 288, 10.1017/S1368980017002889 · DOI
  33. Choi, 2018, Review of the content and quality of mobile applications about Alzheimer's disease and related dementias, J Appl Gerontol
  34. Jeon, 2014, Analysis of the information quality of Korean obesity-management smartphone applications, Healthc Inform Res, 20, 23, 10.4258/hir.2014.20.1.23 · DOI
  35. Orr, 2015, Validity of smartphone pedometer applications, BMC Res Notes, 8, 733, 10.1186/s13104-015-1705-8 · DOI
  36. Bailey, 2014, The availability, functionality, and quality of mobile applications supporting medication selfmanagement, J Am Med Inform Assoc, 21, 542, 10.1136/amiajnl-2013-002232 · DOI
  37. Lee, 2015, Smartphone and tablet apps for concussion road warriors (team clinicians): a systematic review for practical users, Br J Sports Med, 49, 499, 10.1136/bjsports-2013-092930 · DOI
  38. Gibbs, 2017, Can you recommend any good STI apps?' A review of content, accuracy and comprehensiveness of current mobile medical applications for STIs and related genital infections, Sex Transm Infect, 93, 234.1, 10.1136/sextrans-2016-052690 · DOI
  39. Coppetti, 2017, Accuracy of smartphone apps for heart rate measurement, Eur J Prev Cardiol, 24, 1287, 10.1177/2047487317702044 · DOI
  40. Gray, 2013, Systematic review of the development, implementation and availability of smart-phone applications for assessing type 2 diabetes risk, Diabet Med, 30, 758, 10.1111/dme.12115 · DOI
  41. Baig, 2015, Mobile healthcare applications: system design review, critical issues and challenges, Australas Phys Eng Sci Med, 38, 23, 10.1007/s13246-014-0315-4 · DOI · Paper page
  42. Patel, 2017, Accuracy of a smartphone application in estimating sleep in children, Sleep Breath, 21, 505, 10.1007/s11325-016-1425-x · DOI
  43. Penzenstadler, 2016, Quality of smartphone apps related to alcohol use disorder, Eur Addict Res, 22, 329, 10.1159/000449097 · DOI
  44. Xiao, 2016, Current Status and quality assessment of cardiovascular diseases related smartphone apps in China, Stud Health Technol Inform, 225, 1030
  45. Carter, 2013, Contemporary vascular smartphone medical applications, Ann Vasc Surg, 27, 804, 10.1016/j.avsg.2012.10.013 · DOI
  46. Lee, 2016, Utilization and content evaluation of mobile applications for pregnancy, birth, and child care, Healthc Inform Res, 22, 73, 10.4258/hir.2016.22.2.73 · DOI
  47. Kwan, 2019, A review of smartphone applications for persons with traumatic brain injury: what is available and what is the evidence?, J Head Trauma Rehabil, 34, E45, 10.1097/HTR.0000000000000425 · DOI
  48. Simões, 2018, Features, behavioral change techniques, and quality of the most popular mobile apps to measure physical activity: Systematic search in app stores, JMIR mHealth Uhealth, 6, e11281., 10.2196/11281 · DOI
  49. Jamaladin, 2018, Mobile apps for blood pressure monitoring: systematic search in app stores and content analysis, JMIR mHealth Uhealth, 6, e187., 10.2196/mhealth.9888 · DOI
  50. Paudel, 2018, Smartphone applications for amblyopia treatment: a review of current apps and professional involvement, Telemed J E Health, 24, 797, 10.1089/tmj.2017.0220 · DOI
  51. Pereira-Azevedo, 2015, mHealth in urology: a review of experts' involvement in app development, PLoS One, 10, e0125547., 10.1371/journal.pone.0125547 · DOI
  52. Zhou, 2018, Mobile applications for allergic rhinitis, Ann Otol Rhinol Laryngol, 127, 836, 10.1177/0003489418798385 · DOI
  53. Casale, 2018, Mobile applications in otolaryngology for patients: an update, Laryngoscope Investig Otolaryngol, 3, 434, 10.1002/lio2.201 · DOI
  54. Regmi, 2018, Quality and use of free smoking cessation apps for smartphones, Int J Technol Assess Health Care, 34, 476, 10.1017/S0266462318000521 · DOI
  55. Zhang, 2016, Analysis of the information quality of bariatric surgery smartphone applications using the Silberg scale, Obes Surg, 26, 163, 10.1007/s11695-015-1890-5 · DOI
  56. Fougerouse, 2017, A cross-sectional study of prominent US mobile health applications: evaluating the current landscape, AMIA Annu Symp Proc, 2017, 715
  57. Zhang, 2017, Current status of postnatal depression smartphone applications available on application stores: an information quality analysis, BMJ Open, 7, e015655., 10.1136/bmjopen-2016-015655 · DOI
  58. Owens, 2018, Systematic review of commercially available mobile phone applications for prostate cancer education, Am J Mens Health, 13, 1557988318816912.
  59. Richardson, 2019, Evaluation of mobile apps targeted to parents of infants in the neonatal intensive care unit: systematic app review, JMIR mHealth Uhealth, 7, e11620., 10.2196/11620 · DOI
  60. Wong, 2015, Smartphone apps for orthopaedic sports medicine - a smart move?, BMC Sports Sci Med Rehabil, 7, 23, 10.1186/s13102-015-0017-6 · DOI
  61. Lee, 2014, Hype or hope for diabetes mobile health applications?, Diabetes Res Clin Pract, 106, 390, 10.1016/j.diabres.2014.11.001 · DOI
  62. Hundert, 2014, Commercially available mobile phone headache diary apps: a systematic review, JMIR Mhealth Uhealth, 16, e36., 10.2196/mhealth.3452 · DOI
  63. Fraser, 2018, Safety of patient-facing digital symptom checkers, Lancet, 392, 2263, 10.1016/S0140-6736(18)32819-8 · DOI · Paper page
  64. Chen, 2017, Functionality, implementation, impact, and the role of health literacy in mobile phone apps for gestational diabetes: scoping review, JMIR Diabetes, 2, e25., 10.2196/diabetes.8045 · DOI
  65. Schnall, 2016, A user-centered model for designing consumer mobile health (mHealth) applications (apps), J Biomed Inform, 60, 243, 10.1016/j.jbi.2016.02.002 · DOI · Paper page
  66. Stanziola, 2015, User-centered design of health care software development: towards a cultural change, Stud Health Technol Inform, 216, 368
  67. O'Neill, 2012, Colorectal smartphone apps: opportunities and risks, Colorectal Dis, 14, e530, 10.1111/j.1463-1318.2012.03088.x · DOI · Paper page
  68. Coiera, 2015, Guide to Health Informatics, 10.1201/b13617 · DOI · Paper page
  69. Curtis, 2019, A medication adherence app for children with sickle cell disease: qualitative study, JMIR mHealth Uhealth, 7, e8130., 10.2196/mhealth.8130 · DOI
  70. Demidowich, 2012, An evaluation of diabetes self-management applications for android smartphones, J Telemed Telecare, 18, 235, 10.1258/jtt.2012.111002 · DOI
  71. Yasini, 2015, Mobile health applications, in the absence of an authentic regulation, Stud Health Technol Inform, 216, 127
  72. Corrao, 2010, Importance of testing for usability when selecting and implementing an electronic health or medical record system, J Oncol Pract, 6, 120, 10.1200/JOP.200017 · DOI
  73. Berkowitz, 2017, Prescribing an app? Oncology providers' views on mobile health apps for cancer care, JCO Clin Cancer Inform, 1, 10.1200/CCI.17.00107 · DOI
  74. Kessel, 2016, Mobile apps in oncology: a survey on health care professionals' attitude toward telemedicine, mHealth, and oncological apps, J Med Internet Res, 18, e312., 10.2196/jmir.6399 · DOI
  75. Byambasuren, 2019, Current knowledge and adoption of mobile health apps among Australian general practitioners: survey study, JMIR mHealth Uhealth, 7, e13199., 10.2196/13199 · DOI · Paper page
  76. Roper, 2017, Please leave your phone outside: policymakers and medical app providers are encouraging patient participation, but doctors in the consult room are not, BMJ Innov, 3, 65, 10.1136/bmjinnov-2016-000134 · DOI
  77. Kessel, 2017, Mobile health in oncology: a patient survey about app-assisted cancer care, JMIR mHealth Uhealth, 5, e81., 10.2196/mhealth.7689 · DOI
  78. Boudreaux, 2014, Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations, Behav Med Pract Policy Res, 4, 363, 10.1007/s13142-014-0293-9 · DOI · Paper page
  79. van Velthoven, 2017, Do health apps need endorsement? Challenges for giving advice about which health apps are safe and effective to use, Digit Health, 3, 205520761770134., 10.1177/2055207617701342 · DOI
  80. Bates, 2018, Health apps and health policy: what is needed?, JAMA, 320, 1975, 10.1001/jama.2018.14378 · DOI
  81. El-Sayed, 2019, Exploiting mobile edge computing for enhancing vehicular applications in smart cities, Sensors (Basel), 19, E1073, 10.3390/s19051073 · DOI
  82. Eysenbach, 2013, CONSORT-EHEALTH: implementation of a checklist for authors and editors to improve reporting of web-based and mobile randomized controlled trials, Stud Health Technol Inform, 192, 657
  83. Brender, 2013, STARE-HI - statement on reporting of evaluation studies in health informatics: explanation and elaboration, Appl Clin Inform, 4, 331, 10.4338/ACI-2013-04-RA-0024 · DOI

Cited by

See all 245

Metadata

Authors
Akbar, S., Coiera, & Magrabi, F.
Venue
Journal of the American Medical Informatics Association
Published
2019-10-10
Volume
27
Issue
2
Pages
330-340
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W2979989194
Cited by
245
References
31
FWCI
26.26
Type
journal article
Language
en
Open access
hybrid
Funders
Australian National Health and Medical Research Council Centre for Research Excellence in Digital Health (1134919)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.