The DOI matches its Crossref record; 59 of the 62 references it cites were found in a registry or an index.
Criteria for assessing the quality of mHealth apps: a systematic review
Open accessAbstract
Objective: Review the existing studies including an assessment tool/method to assess the quality of mHealth apps; extract their criteria; and provide a classification of the collected criteria. Methods: In accordance with the PRISMA statement, a literature search was conducted in MEDLINE, EMBase, ISI and Scopus for English language citations published from January 1, 2008 to December 22, 2016 for studies including tools or methods for quality assessment of mHealth apps. Two researchers screened the titles and abstracts of all retrieved citations against the inclusion and exclusion criteria. The full text of relevant papers was then individually examined by the same researchers. A senior researcher resolved eventual disagreements and confirmed the relevance of all included papers. The authors, date of publication, subject fields of target mHealth apps, development method, and assessment criteria were extracted from each paper. The extracted assessment criteria were then reviewed, compared, and classified by an expert panel of two medical informatics specialists and two health information management specialists. Results: Twenty-three papers were included in the review. Thirty-eight main classes of assessment criteria were identified. These were reorganized by expert panel into 7 main classes (Design, Information/Content, Usability, Functionality, Ethical Issues, Security and Privacy, and User-perceived value) with 37 sub-classes of criteria. Conclusions: There is a wide heterogeneity in assessment criteria for mHealth apps. It is necessary to define the exact meanings and degree of distinctness of each criterion. This will help to improve the existing tools and may lead to achieve a better comprehensive mHealth app assessment tool.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A recent systematic review identified 23 different published criteria for assessment of mHealth apps.”
From What is the clinical value of mHealth for patients? (2020) · cites this paper as [38]
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233
Mobile-health: A review of current state in 2015
Silva, B. M. C., Rodrigues, J. J. P. C., Díez, I. D. L. T., López-Coronado, M., & Saleem, K. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.06.003 · Cited by 922
Development and validation of the user version of the Mobile application rating scale (uMARS)
Stoyanov, S. R., Hides, L., Kavanagh, D. J., & Wilson, H. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5849 · Cited by 872 · cited 3×
““Design” was found in 9 different articles(30,31,33,34,36,38,48,49,52) “Information/ Content” (using different terms) observed in 15 studies (38,41,42,44,45,47,49,51,52)“Usability” in 14 articles, 49,52 “Functionality” in 7 studies,(31,33,34,38,43,49,50) “Ethical Issues” in 1 study,(42) “Security and Privacy” in 8 art…”
Mobile devices and apps for health care professionals: uses and benefits.
Ventola, C. L. (2014) · PubMed Central · doi:10.57945/manara.23966214 · Cited by 847
Improving a human-computer dialogue
Molich, R., & Nielsen, J. (1990) · Communications of the ACM · doi:10.1145/77481.77486 · Cited by 821
The Smartphone in Medicine: A Review of Current and Potential Use Among Physicians and Students
Ozdalga, E., Ozdalga, A., & Ahuja, N. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1994 · Cited by 654
Empirical Studies on Usability of mHealth Apps: A Systematic Literature Review
Zapata, B. C., Fernández-Alemán, J. L., Idri, A., & Toval, A. (2015) · Journal of Medical Systems · doi:10.1007/s10916-014-0182-2 · Cited by 585
Flagged first, then by citations
3 of the 62 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Bertini, 2008, Int J Mob Hum Comput Interact, 20
- Aitken, 2013, Patient Apps for Improved Healthcare: from Novelty to Mainstream
Cited by
Sorted by citations
Items 201–230 of 230
Burke, C., Reidy, K., Ryan, P., & Jennings, A. (2024) · BJGP Open · doi:10.3399/bjgpo.2024.0038
Ahmed, S., Trimmer, C., Khan, W., Tuck, A. C., Rodak, T., Agic, B., Kavic, K., Wadhawan, S., Abbott, M., Husain, M. O., et al. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1196491
Francis, B. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-22270-2.00011-3
User Experience and Security in Digital Health Applications: Results from a Rapid Review
Cassieri, P., Cirillo, F., Esposito, C., & Scanniello, G. (2024) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa64295.2024.00053
Didyk, C., Lewis, L. K., & Lange, B. S. (2025) · Disability and Rehabilitation · doi:10.1080/09638288.2025.2459895
Martínez‐Sánchez, M. E., Martín-Vicario, L., & Ibáñez, D. G. (2025) · Review of Managerial Science · doi:10.1007/s11846-025-00854-5
Torriani‐Pasin, C., Palma, G. C. D. S., da Silva, L. V. T. T., & Geed, S. (2024) · Springer eBooks · doi:10.1007/978-3-031-74123-4_33
Una aplicación mHealth para autoinforme de síntomas de disfonía: e-VoiSS
Nicolás, A. P. V., Villazala, M. P., Roca, M. J. S., Garrido, E. N., Luque, F. C., & Gómez, J. Á. (2025) · Revista de Logopedia Foniatría y Audiología · doi:10.1016/j.rlfa.2025.100516
Xiong, Y., & Cai, Y. (2025) · International Conference on Artificial Intelligence and Machine Learning Research (CAIMLR) · doi:10.1117/12.3058103
Zhao, Q., Cooke, A., Tang, Y., Huang, L., & Dowding, D. (2025) · doi:10.2196/preprints.76862
Mobile health apps for QT interval measurement: A systematic review
Chavez-Ecos, F. A., Uribe-Cavero, L. J., Chavez-Ecos, R., Arias-Arias, S., Chavez-Gutarra, M. A., Montesinos‐Segura, R., & Camacho-Caballero, K. (2025) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2025.154041
Yi, Z., & Romainoor, N. H. (2023) · Journal of Advanced Computing Technology and Application (JACTA) · doi:10.54554/jacta.2023.05.01.003
Carazas, J. D. C., & Tinco, M. J. P. (2024) · Universidad Peruana de Ciencias Aplicadas (UPC) · doi:10.19083/tesis/684327
Orellano-Colón, E. M., Colón-Peña, F. E., Fernández-Morales, K., Jesús, Y. M. V.-D., Hugger-Olavarrieta, J. J., Palleja-Valentín, E. M., & Roche-Lima, A. (2025) · Physical & Occupational Therapy In Geriatrics · doi:10.1080/02703181.2025.2581271
Quality and Multifunctionality in Mobile Apps for Gestational Diabetes: Systematic App Review
Zhao, Q., Cooke, A., Huang, L., Tang, Y., & Dowding, D. (2025) · JMIR mhealth and uhealth · doi:10.2196/76862
Raeesi, A., Khajouei, R., & Ahmadian, L. (2022) · Figshare · doi:10.6084/m9.figshare.21435551
Smartphone applications for heart failure self-management and the role of the district nurse
Milne, A., & Derham, L. (2025) · British Journal of Community Nursing · doi:10.12968/bjcn.2025.0081
What Users Want: Insights from Indonesian Mobile Health Applications Reviews
Karolita, D., Ripani, I. F., Lestari, A., Sylviana, F., & Toemon, A. N. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-6304-3_26
Scheer, E. R., Arora, J., Patel, H., Lee, Y., Potluri, A., Rogers, C. C., Wellbeloved-Stone, C. A., Collins, M., & Valdez, R. S. (2026) · doi:10.2196/preprints.103417
Shammari, M. A. A. (2026) · Frontiers in Reproductive Health · doi:10.3389/frph.2026.1841414
Ong, Q. C., Pienkowska, A., Obarcanin, E., Stona, A., Khong, A. W. H., Car, J., & Ho, A. H. Y. (2026) · JMIR mhealth and uhealth · doi:10.2196/83442
Massenon, R., Gambo, I., & Khan, J. A. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.113003
Molee, P., Kositsukjaroen, J., & Somjit, N. (2026) · JMIR Formative Research · doi:10.2196/92230
Lubis, S., Ahmad, J., Razak, M. R. R., Nonci, N., & Younus, M. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1016208
Altun, A., Lim, X. Y., Ng, H., Kadwadkar, M., Alfayadh, N., D’Souza, L., & Boyle, J. (2026) · Research Square · doi:10.21203/rs.3.rs-10440902/v1
Mapping quality-related evaluation domains of digital health services: A scoping review
Zaboli, R., Bahadori, M., & Mohamadi, S. (2026) · Health Policy and Technology · doi:10.1016/j.hlpt.2026.101320
Salvatori, M. G., Patel, D., von Hippel, C. D., Somaratne, G., Presser, M. J., Texada, M., & Sammann, A. (2026) · JMIR Formative Research · doi:10.2196/101895
Manhas, R., Kapoor, A., Kaur, J., Rush, K. L., Li, E. P. H., Seaton, C. L., Kaur, D. H., Chawla, V., & Kapoor, A. (2026) · Indian Journal of Community Medicine · doi:10.4103/ijcm.ijcm_159_26
Physical Health, Readiness, and Recovery Monitoring
Clemente, F. M. (2026) · Springer eBooks · doi:10.1007/978-3-032-30441-4_7
Metadata
- Authors
- Nouri, R., R Niakan Kalhori, S., Ghazisaeedi, M., Marchand, G., & Yasini, M.
- Affiliations
- Tehran University of Medical Sciences (IR)
- Health Information Management Department, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran
- Research and Development Department, DMD Santé, Paris, France
- Corresponding author
- Ghazisaeedi, Marjan
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-05-16
- Volume
- 25
- Issue
- 8
- Pages
- 1089-1098
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7646896
- OpenAlex
- W2803669305
- Cited by
- 231
- References
- 62
- Citations by year
- 2026: 14 · 2025: 25 · 2024: 37 · 2023: 35 · 2022: 37 · 2021: 37 · 2020: 30 · 2019: 14 · 2018: 2
- FWCI
- 3.75
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Deputy of Education of Tehran University of Medical Sciences
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Keywords
- mobile health apps, quality assessment, evaluation criteria, quality assessment tools, usability, privacy and security, ethical considerations, mobile application design, app functionality, content quality
- MeSH terms
- Evaluation Studies as Topic, Humans, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review