Privacy Assessment in Mobile Health Apps: Scoping Review
Open accessPublished version of a preprint
Abstract
Background: Privacy has always been a concern, especially in the health domain. The proliferation of mobile health (mHealth) apps has led to a large amount of sensitive data being generated. Some authors have performed privacy assessments of mHealth apps. They have evaluated diverse privacy components; however, different authors have used different criteria for their assessments. Objective: This scoping review aims to understand how privacy is assessed for mHealth apps, focusing on the components, scales, criteria, and scoring methods used. A simple taxonomy to categorize the privacy assessments of mHealth apps based on component evaluation is also proposed. Methods: We followed the methodology defined by Arksey and O’Malley to conduct a scoping review. Included studies were categorized based on the privacy component, which was assessed using the proposed taxonomy. Results: The database searches retrieved a total of 710 citations—24 of them met the defined selection criteria, and data were extracted from them. Even though the inclusion criteria considered articles published since 2009, all the studies that were ultimately included were published from 2014 onward. Although 12 papers out of 24 (50%) analyzed only privacy, 8 (33%) analyzed both privacy and security. Moreover, 4 papers (17%) analyzed full apps, with privacy being just part of the assessment. The evaluation criteria used by authors were heterogeneous and were based on their experience, the literature, and/or existing legal frameworks. Regarding the set of items used for the assessments, each article defined a different one. Items included app permissions, analysis of the destination, analysis of the content of communications, study of the privacy policy, use of remote storage, and existence of a password to access the app, among many others. Most of the included studies provided a scoring method that enables the comparison of privacy among apps. Conclusions: The privacy assessment of mHealth apps is a complex task, as the criteria used by different authors for their evaluations are very heterogeneous. Although some studies about privacy assessment have been conducted, a very large set of items to evaluate privacy has been used up until now. In-app information and privacy policies are primarily utilized by the scientific community to extract privacy information from mHealth apps. The creation of a scale based on more objective criteria is a desirable step forward for privacy assessment in the future.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Data security concerns were rarely mentioned as potential barriers to app use.
“In comparison to previous findings, data security concerns were rarely mentioned as potential barriers to app use [63].”
From Barriers to and Facilitators of a Blended Cognitive Behavioral Therapy Program for Depression and Anxiety Based on Experiences of University Students: Qualitative Interview Study (2023) · cites this paper as [63]
The Introduction (page unavailable) says some smartphone users do not download mHealth apps because they are concerned about apps collecting their data, supporting the barrier-to-use point. It does not say such concerns were rarely mentioned or measure how often users mentioned them; it instead calls data privacy a recurrent topic in qualitative studies. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · see citing works
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · see citing works
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877 · see citing works
Health App Use Among US Mobile Phone Owners: A National Survey
Krebs, P., & Duncan, D. T. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4924 · Cited by 1,274 · see citing works
Huckvale, K., Prieto, J. T., Tilney, M., Benghozi, P.-J., & Car, J. (2015) · BMC Medicine · doi:10.1186/s12916-015-0444-y · Cited by 376 · see citing works
Availability and quality of mobile health app privacy policies
Sunyaev, A., Dehling, T., Taylor, P. L., & Mandl, K. D. (2015) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002605 · Cited by 360 · see citing works
Consumer Mobile Health Apps: Current State, Barriers, and Future Directions
Kao, C., & Liebovitz, D. M. (2017) · PM&R · doi:10.1016/j.pmrj.2017.02.018 · Cited by 350 · see citing works
Huckvale, K., Torous, J., & Larsen, M. E. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.2542 · Cited by 312 · see citing works
Dehling, T., Gao, F., Schneider, S., & Sunyaev, A. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3672 · Cited by 243 · see citing works
Security and Privacy Analysis of Mobile Health Applications: The Alarming State of Practice
Papageorgiou, A., Strigkos, M., Politou, E., Alepis, E., Solanas, A., & Patsakis, C. (2018) · IEEE Access · doi:10.1109/access.2018.2799522 · Cited by 236 · see citing works
Baumel, A., Faber, K., Mathur, N., Kane, J. M., & Muench, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7270 · Cited by 206 · cited 6× · see citing works
“[25,26,29,34] it was not clear whether it was the app or the privacy policy that was examined.”
BackgroundMethodInfluentialReviewing the data security and privacy policies of mobile apps for depression
O'Loughlin, K., Neary, M., Adkins, E. C., & Schueller, S. M. (2019) · Internet Interventions · doi:10.1016/j.invent.2018.12.001 · Cited by 179 · see citing works
Quality of Publicly Available Physical Activity Apps: Review and Content Analysis
Bondaronek, P., Alkhaldi, G., Slee, A., Hamilton, F. L., & Murray, E. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9069 · Cited by 156 · see citing works
Zheng, X., Sun, S., Mukkamala, R. R., Vatrapu, R., & Ordieres-Meré, J. (2019) · Journal of Medical Internet Research · doi:10.2196/13583 · Cited by 137 · see citing works
Robillard, J. M., Feng, T. L., Sporn, A. B., Lai, J.-A., Lo, C., Ta, M., & Nadler, R. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100243 · Cited by 111 · see citing works
Giunti, G., Kool, J., Rivera-Romero, O., & Zubiete, E. D. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.8996 · Cited by 107 · see citing works
Self-citationSecurity Concerns in Android mHealth Apps.
He, D., Naveed, M., Gunter, C. A., & Nahrstedt, K. (2014) · PubMed Central · Cited by 101 · see citing works
Assessing the Privacy of mHealth Apps for Self-Tracking: Heuristic Evaluation Approach
Hutton, L., Price, B. A., Kelly, R., McCormick, C., Bandara, A. K., Hatzakis, T., Meadows, M., & Nuseibeh, B. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9217 · Cited by 79 · see citing works
The Complexity of Mental Health App Privacy Policies: A Potential Barrier to Privacy
Powell, A., Singh, P., & Torous, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9871 · Cited by 65 · see citing works
Mobile phone applications for diabetes management: A systematic review
Quevedo-Rodríguez, A., & Wägner, A. M. (2019) · Endocrinología Diabetes y Nutrición · doi:10.1016/j.endinu.2018.11.005 · Cited by 54 · see citing works
Leigh, S., Ouyang, J., & Mimnagh, C. (2017) · Evidence Based Mental Health · doi:10.1136/eb-2017-102751 · Cited by 46 · see citing works
Privacy Issues in Smartphone Applications: An Analysis of Headache/Migraine Applications
Minen, M. T., Stieglitz, E. J., Sciortino, R. K., & Torous, J. B. (2018) · Headache The Journal of Head and Face Pain · doi:10.1111/head.13341 · Cited by 46 · see citing works
Demetzou, K. (2019) · Computer law & security review · doi:10.1016/j.clsr.2019.105342 · Cited by 39 · see citing works
Health-related smartphone apps: regulations, safety, privacy and quality
BinDhim, N. F., & Trevena, L. J. (2015) · BMJ Innovations · doi:10.1136/bmjinnov-2014-000019 · Cited by 38 · see citing works
Storing and Using Health Data in a Virtual Private Cloud
Regola, N., & Chawla, N. V. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2076 · Cited by 37 · see citing works
Evaluating the Privacy Policies of Mobile Personal Health Records for Pregnancy Monitoring
Bachiri, M., Idri, A., Fernández-Alemán, J. L., & Toval, A. (2018) · Journal of Medical Systems · doi:10.1007/s10916-018-1002-x · Cited by 36 · see citing works
A Review and Comparative Analysis of Security Risks and Safety Measures of Mobile Health Apps
Scott, K. M., Richards, D., & Adhikari, R. (2015) · Australasian Journal of Information Systems · doi:10.3127/ajis.v19i0.1210 · Cited by 35 · see citing works
High Quantity But Limited Quality in Healthcare Applications Intended for HIV-Infected Patients
Cortés, M. D. L. A. R., Cuenca, M. R. C., Verdugo, R. M., & Cidoncha, E. C. (2014) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2013.0262 · Cited by 26 · see citing works
Integrating Technical and Legal Concepts of Privacy
Sokolovska, A., & Kocarev, L. (2018) · IEEE Access · doi:10.1109/access.2018.2836184 · Cited by 24 · see citing works
On the Privacy, Security and Safety of Blood Pressure and Diabetes Apps
Knorr, K., Aspinall, D., & Wolters, M. K. (2015) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-18467-8_38 · Cited by 23 · see citing works
Assessing the privacy policies in mobile personal health records
Zapata, B. C., Niñirola, A. H., Fernández‐Alemán, J. L., & Toval, A. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6944736 · Cited by 23 · see citing works
Security Vulnerabilities in Mobile Health Applications
Aliasgari, M., Black, M. D., & Yadav, N. (2018) · IEEE Conference on Application, Information and Network Security (AINS) · doi:10.1109/ains.2018.8631464 · Cited by 23 · see citing works
The Challenges of Institutional Distance: Data Privacy Issues in Cloud Computing
Abed, Y., & Chavan, M. (2018) · Science Technology and Society · doi:10.1177/0971721818806088 · Cited by 19 · see citing works
Analyzing Privacy Risks of mHealth Applications
Mense, A., Steger, S., Sulek, M., Jukic-Sunaric, D., & András, M. (2016) · Studies in health technology and informatics · doi:10.3233/978-1-61499-633-0-41 · Cited by 16 · see citing works
Mobile phone applications for diabetes management: A systematic review
Quevedo-Rodríguez, A., & Wägner, A. M. (2019) · Endocrinología Diabetes y Nutrición (English ed ) · doi:10.1016/j.endien.2019.05.001 · Cited by 15 · see citing works
An Information Privacy Risk Index for mHealth Apps
Brüggemann, T., Hansen, J., Dehling, T., & Sunyaev, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-44760-5_12 · Cited by 12 · see citing works
Simulation environment for testing security and privacy of mobile health apps
(2016) · Modeling and Simulation in Medicine Symposium (MSM 2016) · doi:10.22360/springsim.2016.msm.008 · Cited by 6 · see citing works
Seguridad y Privacidad en Carpetas Personales de Salud para Android e iOS
Zapata, B. C., Niñirola, A. H., Fernández‐Alemán, J. L., & Toval, A. (2014) · RISTI - Revista Ibérica de Sistemas e Tecnologias de Informação · doi:10.4304/risti.13.35-50 · Cited by 5 · see citing works
Thorarensen, B. (2017) · Health and Technology · doi:10.1007/s12553-017-0184-4 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [9]mHealth App Economics 2017: Current Status and Future Trends in Mobile Health. 7th edition 2017 11 2020-03-24 Berlin, Germany Research2Guidance https://research2guidance.com/product/mhealth-economics-2017-current-status-and-future-trends-in-mobile-health/
- [34]Adhikari R Richards D Scott K Security and privacy issues related to the use of mobile health apps Proceedings of the 25th Australasian Conference on Information Systems 2014 12 25th Australasian Conference on Information Systems December 8-10, 2014 Auckland, New Zealand 1 11
Cited by
Sorted by citations
A Comprehensive Picture of Factors Affecting User Willingness to Use Mobile Health Applications
Fan, S., Jain, R. C., & Kankanhalli, M. S. (2024) · ACM Transactions on Computing for Healthcare · doi:10.1145/3626962 · Cited by 40 · see citing works
Braun, P., Atik, E., Guthardt, L., Apolinário-Hagen, J., & Schückes, M. (2023) · JMIR Formative Research · doi:10.2196/45970 · Cited by 17 · see citing works
“In comparison to previous findings, data security concerns were rarely mentioned as potential barriers to app use [63].”
Result
- Authors
- Benjumea, J., Ropero, J., Rivera-Romero, O., Dorronzoro-Zubiete, E., & Carrasco, A.
- Affiliations
- Universidad de Sevilla (ES)
- Corresponding author
- Benjumea, Jaime
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2020-07-02
- Volume
- 8
- Issue
- 7
- Pages
- e18868
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC7367524
- OpenAlex
- W3024846856
- Cited by
- 69
- References
- 39
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 11 · 2023: 17 · 2022: 9 · 2021: 11 · 2020: 7
- FWCI
- 2.10
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- idUS (Universidad de Sevilla) (submittedVersion, cc-by-nc-nd)
- Funders
- Universidad de Sevilla
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
- Physical Sciences › Computer Science › Information Systems › Thoreau and American Literature
- Keywords
- mobile health apps, privacy analysis, privacy policies, application permissions, privacy and security, sensitive health data
- MeSH terms
- Communication, Humans, Research Design, Telemedicine, Privacy, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review