A Systematic Review of Quality Assessment Methods for Smartphone Health Apps
Abstract
Introduction: There are large numbers of health-related applications (apps) available in various app stores for many smartphone devices. Consequently, increasing numbers of articles are attempting to evaluate the content and the quality of health-related smartphone apps for specific health conditions. The aim of this article is to describe and summarize the methodologies used to determine the quality of health-related apps targeting health consumers and to propose a set of criteria for evaluating the quality of smartphone health-related apps. Materials and Methods: In 2013, literature searches were performed using Medline and CINAHL, and we included all articles that had the aim of assessing the quality of health-related smartphone apps. The assessment method used in these studies was summarized and scored using a set of quality criteria developed for this study. Results: From 606 articles generated by the search, only 10 met the inclusion criteria. Based on our quality criteria, the mean score was 5.05 out of 8 (range, 2–7). Eighty percent of the studies did not identify the app store country in which the apps were found. Forty percent of the studies did not clearly mention whether they only had assessed the app description or had downloaded the app content for evaluation. Sixty percent of the studies did not provide a list of the apps they had evaluated. Overall, we identified six evaluation methodologies used to assess the quality of health-related apps described in Results. Conclusions: This article provides a summary of currently used methods for assessing the quality of smartphone health-related apps and proposes a set of criteria to enable future studies to consistently review health-related app quality in a standardized manner.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Popularity metrics may be biased by developers paying for downloads/positive reviews.
“popularity metrics may be biased by developers paying for downloads/positive reviews (BinDhim et al. 2015).”
From Evaluating the quality, safety, and functionality of commonly used smartphone apps for bipolar disorder mood and sleep self-management (2022) · cites this paper as BinDhim et al. 2015
Cites
Gagliardi, A. R. (2002) · BMJ · doi:10.1136/bmj.324.7337.569 · Cited by 378 · see citing works
iPhone Apps for Smoking Cessation
Abroms, L. C., Padmanabhan, N., Thaweethai, L., & Phillips, T. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2010.10.032 · Cited by 365 · see citing works
Smartphone applications for pain management
Rosser, B. A., & Eccleston, C. (2011) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2011.101102 · Cited by 364 · see citing works
Muessig, K., Pike, E. C., Legrand, S., & Hightow-Weidman, L. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2301 · Cited by 300 · see citing works
Apps for asthma self-management: a systematic assessment of content and tools
Huckvale, K., Car, M., Morrison, C. P., & Car, J. (2012) · BMC Medicine · doi:10.1186/1741-7015-10-144 · Cited by 252 · see citing works
Review Of Internet Health Information Quality Initiatives
Risk, A., & Dzenowagis, J. (2001) · Journal of Medical Internet Research · doi:10.2196/jmir.3.4.e28 · Cited by 237 · see citing works
Pandey, A., Hasan, S., Dubey, D., & Sarangi, S. (2013) · Journal of Cancer Education · doi:10.1007/s13187-012-0446-9 · Cited by 213 · see citing works
Colorectal smartphone apps: opportunities and risks
O’Neill, S., & Brady, R. R. W. (2012) · Colorectal Disease · doi:10.1111/j.1463-1318.2012.03088.x · Cited by 165 · see citing works
An evaluation of diabetes self-management applications for Android smartphones
Demidowich, A. P., Lu, K., Tamler, R., & Bloomgarden, Z. T. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.111002 · Cited by 154 · see citing works
Mobile personal health records: An evaluation of features and functionality
Kharrazi, H. H. K., Chisholm, R., VanNasdale, D. A., & Thompson, B. S. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.04.007 · Cited by 147 · see citing works
Smoking cessation treatment on the Internet: Content, quality, and usability
Bock, B., Graham, A., Sciamanna, C., Ph.D, J. K., Whiteley, J., Carmona-Barros, R., Niaura, R., & Abrams, D. (2004) · Nicotine & Tobacco Research · doi:10.1080/14622200410001676332 · Cited by 137 · see citing works
Who Uses Smoking Cessation Apps? A Feasibility Study Across Three Countries via Smartphones
BinDhim, N. F., McGeechan, K., & Trevena, L. J. (2014) · JMIR mhealth and uhealth · doi:10.2196/mhealth.2841 · Cited by 79 · see citing works
Self-citationObesity Surgery Smartphone Apps: a Review
Stevens, D. J., Jackson, J. A., Howes, N., & Morgan, J. (2013) · Obesity Surgery · doi:10.1007/s11695-013-1010-3 · Cited by 62 · see citing works
Pro-smoking apps for smartphones: the latest vehicle for the tobacco industry?
BinDhim, N. F., Freeman, B., & Trevena, L. J. (2012) · Tobacco Control · doi:10.1136/tobaccocontrol-2012-050598 · Cited by 59 · see citing works
Self-citationContemporary hernia smartphone applications (apps)
Connor, K. L., Brady, R. R. W., de Beaux, A., & Tulloh, B. R. (2013) · Hernia · doi:10.1007/s10029-013-1130-7 · Cited by 31 · see citing works
Apps Promoting Illicit Drugs—A Need for Tighter Regulation?
BinDhim, N. F., Naicker, S., Freeman, B., McGeechan, K., & Trevena, L. J. (2014) · Journal of Consumer Health on the Internet · doi:10.1080/15398285.2014.869166 · Cited by 22 · see citing works
Self-citationPro-smoking apps: where, how and who are most at risk: Table 1
BinDhim, N. F., Freeman, B., & Trevena, L. J. (2013) · Tobacco Control · doi:10.1136/tobaccocontrol-2013-051189 · Cited by 17 · see citing works
Self-citationDoarn, C. R., & Merrell, R. C. (2013) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2013.9983 · Cited by 10 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality
Nicholas, J., Larsen, M. E., Proudfoot, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4581 · Cited by 438 · see citing works
The WPA-Lancet psychiatry commission on the future of psychiatry
Bhugra, D., Tasman, A., Pathare, S., Priebe, S., Smith, S., Torous, J., Arbuckle, M. R., Langford, A., Alarcón, R. D., Chiu, H. F. K., et al. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30333-4 · Cited by 392 · see citing works
A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression
Huguet, A., Rao, S., McGrath, P. J., Wozney, L., Wheaton, M., Conrod, J., & Rozario, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154248 · Cited by 328 · see citing works
State of the Field of Mental Health Apps
Neary, M., & Schueller, S. M. (2018) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2018.01.002 · Cited by 247 · see citing works
Criteria for assessing the quality of mHealth apps: a systematic review
Nouri, R., R Niakan Kalhori, S., Ghazisaeedi, M., Marchand, G., & Yasini, M. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy050 · Cited by 231 · see citing works
The Most Popular Smartphone Apps for Weight Loss: A Quality Assessment
Chen, J., Cade, J. E., & Allman-Farinelli, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4334 · Cited by 219 · see citing works
Smartphone apps for calculating insulin dose: a systematic assessment
Huckvale, K., Adomaviciute, S., Prieto, J. T., Leow, M. K., & Car, J. (2015) · BMC Medicine · doi:10.1186/s12916-015-0314-7 · Cited by 200 · see citing works
Liew, M. S., Zhang, J., See, J., & Ong, Y. L. (2019) · JMIR mHealth and uHealth · doi:10.2196/12160 · Cited by 179 · see citing works
Smartphone Apps to Support Self-Management of Hypertension: Review and Content Analysis
Alessa, T., Hawley, M. S., Hock, E. S., & de Witte, L. (2019) · JMIR mHealth and uHealth · doi:10.2196/13645 · Cited by 170 · see citing works
Predictors of mortality in patients with COVID-19–a systematic review
Mehraeen, E., Karimi, A., Barzegary, A., Vahedi, F., Afsahi, A. M., Dadras, O., Badie, B. M., SeyedAlinaghi, S., & Jahanfar, S. (2020) · European Journal of Integrative Medicine · doi:10.1016/j.eujim.2020.101226 · Cited by 170 · see citing works
Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps
Jake-Schoffman, D. E., Silfee, V. J., Waring, M. E., Boudreaux, E. D., Sadasivam, R. S., Mullen, S. P., Carey, J. L., Hayes, R. B., Ding, E. Y., Bennett, G. G., et al. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8758 · Cited by 165 · see citing works
Quality of Publicly Available Physical Activity Apps: Review and Content Analysis
Bondaronek, P., Alkhaldi, G., Slee, A., Hamilton, F. L., & Murray, E. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9069 · Cited by 156 · see citing works
Challenges in Assessing Mobile Health App Quality
Grundy, Q. H., Wang, Z., & Bero, L. A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.07.009 · Cited by 154 · see citing works
Baumel, A., & Kane, J. M. (2018) · Journal of Medical Internet Research · doi:10.2196/11491 · Cited by 131 · see citing works
A Systematic, Multi-domain Review of Mobile Smartphone Apps for Evidence-Based Stress Management
Coulon, S. M., Monroe, C. M., & West, D. S. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.01.026 · Cited by 128 · see citing works
Tofighi, B., Chemi, C., Ruiz-Valcarcel, J., Hein, P. N., & Hu, L. (2018) · JMIR mhealth and uhealth · doi:10.2196/11831 · Cited by 129 · see citing works
Scott, I. A., Scuffham, P., Gupta, D., Harch, T. M., Borchi, J., & Richards, B. (2018) · Australian Health Review · doi:10.1071/ah18064 · Cited by 120 · see citing works
Mobile health app usability and quality rating scales: a systematic review
Azad‐Khaneghah, P., Neubauer, N., Cruz, A. M., & Liu, L. (2020) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2019.1701103 · Cited by 119 · see citing works
Powell, A. C., Torous, J. B., Chan, S. R., Raynor, G., Shwarts, E., Shanahan, M. E., & Landman, A. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5176 · Cited by 103 · see citing works
Shen, L., Xiong, B., Li, W., Lan, F., Evans, R. D., & Zhang, W. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9581 · Cited by 98 · see citing works
Yellowlees, P., Chan, S. R., & Parish, M. B. (2015) · International Review of Psychiatry · doi:10.3109/09540261.2015.1082987 · Cited by 76 · see citing works
Muro-Culebras, A., Escriche-Escuder, A., Martín‐Martín, J., Roldán‐Jiménez, C., De-Torres, I., Ruiz‐Muñoz, M., González‐Sánchez, M., Mayoral, F., Biró, A., Tang, W. J., et al. (2020) · JMIR mhealth and uhealth · doi:10.2196/15433 · Cited by 82 · see citing works
Connolly, S. L., Hogan, T. P., Shimada, S. L., & Miller, C. J. (2020) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00165-4 · Cited by 78 · see citing works
Assessing the quality of mobile applications in chronic disease management: a scoping review
Agarwal, P., Gordon, D., Griffith, J., Kithulegoda, N., Witteman, H. O., Bhatia, R. S., Kushniruk, A. W., Borycki, E. M., Lamothe, L., Springall, E., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00410-x · Cited by 80 · see citing works
An overview on the emerging area of identification, characterization, and assessment of health apps
Paglialonga, A., Lugo, A., & Santoro, E. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.05.017 · Cited by 77 · see citing works
Mobile Apps for Individuals With Rheumatoid Arthritis
Luo, D., Wang, P., Lu, F., Elias, J. S., Sparks, J. A., & Lee, Y. (2018) · JCR Journal of Clinical Rheumatology · doi:10.1097/rhu.0000000000000800 · Cited by 76 · see citing works
Moshi, M. R., Tooher, R. L., & Merlin, T. (2018) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646231800051x · Cited by 74 · see citing works
Smartphone Applications to Support Tuberculosis Prevention and Treatment: Review and Evaluation
Iribarren, S., Schnall, R., Stone, P. W., & Carballo‐Diéguez, A. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5022 · Cited by 72 · see citing works
Loeckx, M., Rabinovich, R., Demeyer, H., Louvaris, Z., Tanner, R., Rubio, N., Frei, A. L., de Jong, C., Gimeno‐Santos, E., Rodrigues, F. M. M., et al. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9774 · Cited by 72 · see citing works
A Critical Appraisal of Fertility and Menstrual Tracking Apps for the iPhone
Zwingerman, R., Chaikof, M., & Jones, C. A. (2019) · Journal of Obstetrics and Gynaecology Canada · doi:10.1016/j.jogc.2019.09.023 · Cited by 68 · see citing works
BinDhim, N. F., & Trevena, L. J. (2015) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v7i2.5522 · Cited by 62 · see citing works
Self-citationBos, F. M., von Klipstein, L., Emerencia, A. C., Veermans, E., Verhage, T., Snippe, E., Doornbos, B., Hadders-Prins, G., Wichers, M., & Riese, H. (2022) · JMIR Mental Health · doi:10.2196/36430 · Cited by 62 · see citing works
Trawley, S. L., Baptista, S. N., Browne, J. L., Pouwer, F., & Speight, J. (2017) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2017.0235 · Cited by 58 · see citing works
Digital Technology and Mobile Health in Behavioral Migraine Therapy: a Narrative Review
Stubberud, A., & Linde, M. (2018) · Current Pain and Headache Reports · doi:10.1007/s11916-018-0718-0 · Cited by 49 · see citing works
Apps for Hearing Science and Care
Paglialonga, A., Tognola, G., & Pinciroli, F. (2015) · American Journal of Audiology · doi:10.1044/2015_aja-14-0093 · Cited by 49 · see citing works
Jacob, C., Lindeque, J. P., Klein, A., Ivory, C. J., Heuss, S., & Peter, M. K. (2023) · JMIR Human Factors · doi:10.2196/45143 · Cited by 43 · see citing works
Rating Pregnancy Wheel Applications Using the APPLICATIONS Scoring System
Chyjek, K., Farag, S., & Chen, K. T. (2015) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000000842 · Cited by 47 · see citing works
The Arabic Version of the Mobile App Rating Scale: Development and Validation Study
Bardus, M., Awada, N., Ghandour, L. A., Fares, E.-J., Gherbal, T., Al-Zanati, T., & Stoyanov, S. R. (2019) · JMIR mhealth and uhealth · doi:10.2196/16956 · Cited by 46 · see citing works
Kong, F. W., Horsham, C., Ngoo, A., Soyer, H. P., & Janda, M. (2020) · International Journal of Dermatology · doi:10.1111/ijd.15132 · Cited by 46 · see citing works
Smartphone and mobile health apps for tinnitus: Systematic identification, analysis, and assessment
Mehdi, M., Stach, M., Riha, C., Neff, P., Dode, A., Pryss, R., Schlee, W., Reichert, M., & Hauck, F. J. (2020) · JMIR mHealth and uHealth · doi:10.2196/21767 · Cited by 40 · see citing works
“Several mobile health (mHealth) app assessment tools and models are available [26-29], yet they either are focused on a particular health domain or are too time consuming and complex to employ in research.”
BackgroundMobile applications providing guidance about decreased fetal movement: Review and content analysis
Daly, L. M., Boyle, F. M., GIBBONS, K. S., Le, H., Roberts, J., & Flenady, V. (2018) · Women and Birth · doi:10.1016/j.wombi.2018.07.020 · Cited by 45 · see citing works
Bardus, M., Ali, A., Demachkieh, F., & Hamadeh, G. (2019) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9836 · Cited by 44 · see citing works
DiFilippo, K. N., Huang, W. D., & Chapman‐Novakofski, K. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.7441 · Cited by 43 · see citing works
Continuing Care For Critically Ill Children Beyond Hospital Discharge: Current State of Follow-up
Williams, C. N., Hall, T. A., Francoeur, C., Kurz, J. E., Rasmussen, L., Hartman, M. E., O’Meara, A. I., Ferguson, N. M., Fink, E. L., Walker, T. C., et al. (2022) · Hospital Pediatrics · doi:10.1542/hpeds.2021-006464 · Cited by 43 · see citing works
Ngoo, A., Finnane, A. R., McMeniman, E., Soyer, H. P., & Janda, M. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.08.004 · Cited by 42 · see citing works
Self-Management Apps for People With Epilepsy: Systematic Analysis
Alzamanan, M. Z., Lim, K. S., Ismail, M. A., & Ghani, N. B. A. (2021) · JMIR mhealth and uhealth · doi:10.2196/22489 · Cited by 40 · see citing works
Health-related smartphone apps: regulations, safety, privacy and quality
BinDhim, N. F., & Trevena, L. J. (2015) · BMJ Innovations · doi:10.1136/bmjinnov-2014-000019 · Cited by 38 · see citing works
Self-citationDevelopment of a Healthy Lifestyle Mobile App for Overweight Pregnant Women: Qualitative Study
Lau, Y., Cheng, L. J., Chi, C., Tsai, C., Ong, K. W., Ho‐Lim, S. S. T., Wang, W., & Tan, K. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9718 · Cited by 39 · see citing works
Supportive Care in Radiotherapy Based on a Mobile App: Prospective Multicenter Survey
Shafie, R. A. E., Weber, D., Bougatf, N., Sprave, T., Oetzel, D., Huber, P., Debus, J., & Nicolay, N. H. (2018) · JMIR mhealth and uhealth · doi:10.2196/10916 · Cited by 38 · see citing works
Social Support for Breastfeeding in the Era of mHealth: A Content Analysis
Schindler-Ruwisch, J. M., Roess, A., Robert, R. C., Napolitano, M. A., & Chiang, S. C. (2018) · Journal of Human Lactation · doi:10.1177/0890334418773302 · Cited by 37 · see citing works
Mobile Application User Experience Checklist: A Tool to Assess Attention to Core UX Principles
Richardson, B., Campbell-Yeo, M. L., & Smit, M. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1876361 · Cited by 36 · see citing works
Chinese Mobile Health APPs for Hypertension Management: A Systematic Evaluation of Usefulness
Liang, J., He, X., Jia, Y., Zhu, W., & Lei, J. (2018) · Journal of Healthcare Engineering · doi:10.1155/2018/7328274 · Cited by 35 · see citing works
A Review of Mindfulness-Based Apps for Children
Nunes, A., Castro, S. L., & Limpo, T. (2020) · Mindfulness · doi:10.1007/s12671-020-01410-w · Cited by 29 · see citing works
Prioritization of Quality Principles for Health Apps Using the Kano Model: Survey Study
Malinka, C., von Jan, U., & Albrecht, U. (2022) · JMIR mhealth and uhealth · doi:10.2196/26563 · Cited by 28 · see citing works
Issues in reporting of systematic review methods in health app-focused reviews: A scoping review
Grainger, R., Devan, H., Sangelaji, B., & Hay-Smith, J. E. (2020) · Health Informatics Journal · doi:10.1177/1460458220952917 · Cited by 27 · see citing works
Lobos, K., Sáez-Delgado, F., Bruna, D., Cobo‐Rendón, R., & Mújica, A. D. (2021) · Education Sciences · doi:10.3390/educsci11080449 · Cited by 34 · see citing works
A process for reviewing mental health apps: Using the One Mind PsyberGuide Credibility Rating System
Neary, M., Bunyi, J., Palomares, K., Mohr, D. C., Powell, A. C., Ruzek, J. I., Williams, L. M., Wykes, T., & Schueller, S. M. (2021) · Digital Health · doi:10.1177/20552076211053690 · Cited by 26 · see citing works
Factors Influencing Uptake and Use of a New Health Information App for Young People
Russell, E., Lloyd-Houldey, A., Memon, A., & Yarker, J. (2018) · Journal of Technology in Human Services · doi:10.1080/15228835.2018.1536911 · Cited by 25 · see citing works
Francis, J., CROSS, D. S., Schultz, A., Armstrong, D., Nguyen, R. L., & Branch‐Smith, C. (2020) · Journal of Cystic Fibrosis · doi:10.1016/j.jcf.2019.12.011 · Cited by 25 · see citing works
Albrecht, U., Malinka, C., Long, S., Raupach, T., Hasenfuss, G. P., & von Jan, U. (2019) · JMIR mhealth and uhealth · doi:10.2196/13375 · Cited by 25 · see citing works
Electronic monitoring of self-reported mood: the return of the subjective?
Ortiz, A., & Grof, P. (2016) · International Journal of Bipolar Disorders · doi:10.1186/s40345-016-0069-x · Cited by 24 · see citing works
Barzegari, S., Kia, A. S., Bardus, M., Stoyanov, S. R., Ghazisaeedi, M., & Rafizadeh, M. (2022) · JMIR Formative Research · doi:10.2196/42225 · Cited by 23 · see citing works
A Comprehensive Evaluation of Tinnitus Apps
Deshpande, A. K., & Shimunova, T. (2019) · American Journal of Audiology · doi:10.1044/2019_aja-18-0135 · Cited by 23 · see citing works
An Evaluation of Contraception Education and Health Promotion Applications for Patients
Lunde, B., Perry, R., Sridhar, A., & Chen, K. T. (2016) · Women s Health Issues · doi:10.1016/j.whi.2016.09.012 · Cited by 22 · see citing works
Coe-O’Brien, R., Joseph, L., Kuisma, R., Paungmali, A., Sitilertpisan, P., & Pirunsan, U. (2020) · Health Information Science and Systems · doi:10.1007/s13755-019-0097-x · Cited by 22 · see citing works
Psychometric Properties of a Chatbot Version of the PHQ-9 With Adults and Older Adults
Dosovitsky, G., Kim, E., & Bunge, E. L. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.645805 · Cited by 22 · see citing works
Morton, E., Nicholas, J., Yang, L., Lapadat, L., Barnes, S. J., Provencher, M. D., Depp, C., Chan, M., Kulur, R., & Michalak, E. E. (2022) · International Journal of Bipolar Disorders · doi:10.1186/s40345-022-00256-6 · Cited by 20 · see citing works
The use of deep learning for smartphone-based human activity recognition
Stampfler, T., Elgendi, M., Fletcher, R., & Menon, C. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1086671 · Cited by 21 · see citing works
The Interactive Mobile App Review Toolkit (IMART): a Clinical Practice-Oriented System
Maheu, M. M., Nicolucci, V., Pulier, M. L., Wall, K. M., Frye, T. J., & Hudlická, E. (2016) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-016-0005-z · Cited by 21 · see citing works
Identifying Evidence-Informed Physical Activity Apps: Content Analysis
Kebede, M. M., Steenbock, B., Helmer, S. M., Sill, J., Möllers, T., & Pischke, C. R. (2018) · JMIR mhealth and uhealth · doi:10.2196/10314 · Cited by 20 · see citing works
Parenting: There is an app for that. A systematic review of parenting interventions apps
David, D., Iuga, I. A., & Miron, I. S. (2023) · Children and Youth Services Review · doi:10.1016/j.childyouth.2023.107385 · Cited by 20 · see citing works
Mobile Apps for the Dietary Approaches to Stop Hypertension (DASH): App Quality Evaluation
DiFilippo, K. N., Huang, W. D., & Chapman‐Novakofski, K. (2018) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2018.02.002 · Cited by 19 · see citing works
Evaluation Criteria for Weight Management Apps: Validation Using a Modified Delphi Process
Robles, N., Puigdomènech, E., Gómez-Calderón, C., Saigí-Rubió, F., Cuatrecasas, G., Zamora, A., Moharra, M., Paluzié, G., Balfegó, M., & Carrión, C. (2020) · JMIR mhealth and uhealth · doi:10.2196/16899 · Cited by 19 · see citing works
Baptista, S. N., Oldenburg, B. F., & O'Neil, A. E. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.6419 · Cited by 18 · see citing works
Digital skin imaging applications, part I: Assessment of image acquisition technique features
Sun, M., Kentley, J., Wilson, B. N., Soyer, H. P., Curiel‐Lewandrowski, C. N., Rotemberg, V. M., Halpern, A. C., & ISIC Technique Working Group (2022) · Skin Research and Technology · doi:10.1111/srt.13163 · Cited by 17 · see citing works
Lazarevic, N., Lecoq, M., Bœhm, C., & Caillaud, C. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20021012 · Cited by 20 · see citing works
Clinician's Guide to Evaluating and Developing eHealth Interventions for Mental Health
Ondersma, S. J., & Walters, S. T. (2020) · Psychiatric Research and Clinical Practice · doi:10.1176/appi.prcp.2020.20190036 · Cited by 16 · see citing works
McAleese, D., Linardakis, M. K., & Papadaki, A. (2022) · Nutrients · doi:10.3390/nu14061290 · Cited by 15 · see citing works
Quality evaluation of smartphone applications for laboratory medicine
Jovičić, S. Ž., Siódmiak, J., & Watson, I. D. (2018) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2018-0710 · Cited by 15 · see citing works
Identification and Rating of Gynecologic Oncology Applications Using the APPLICATIONS Scoring System
Farag, S., Fields, J. C., Pereira, E. B., Chyjek, K., & Chen, K. T. (2016) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2016.0040 · Cited by 15 · see citing works
Policy, practice and regulatory issues in mobile technology treatment for forensic clients
Ross, S. (2018) · European Journal of Probation · doi:10.1177/2066220318761382 · Cited by 15 · see citing works
Alnooh, G., Alessa, T., Noorwali, E. A., Albar, S. A., Williams, E. A., de Witte, L., & Hawley, M. (2023) · Nutrients · doi:10.3390/nu15153476 · Cited by 14 · see citing works
Greek validation of the user version of the Mobile Application Rating Scale (uMARS)
Chasiotis, G., Stoyanov, S. R., Karatzas, A. D., & Gravas, S. (2023) · Journal of International Medical Research · doi:10.1177/03000605231161213 · Cited by 13 · see citing works
Zhou, T., Salman, D., & McGregor, A. H. (2024) · JMIR mhealth and uhealth · doi:10.2196/53262 · Cited by 14 · see citing works
Una Revisión sistemática de instrumentos que evalúan la calidad de aplicaciones móviles de salud
Morales, C. D., & Hueros, A. M. D. (2023) · Pixel-Bit Revista de Medios y Educación · doi:10.12795/pixelbit.97867 · Cited by 13 · see citing works
Development of a Multidimensional App-Quality Assessment Tool for Health-Related Apps (AQUA)
O’Rourke, T., Pryss, R. C., Schlee, W., & Probst, T. (2020) · Digital Psychology · doi:10.24989/dp.v1i2.1816 · Cited by 13 · see citing works
Paglialonga, A., Pinciroli, F., & Tognola, G. (2017) · American Journal of Audiology · doi:10.1044/2017_aja-16-0132 · Cited by 12 · see citing works
Perera, A. G., Jiménez, M. D. A. J., & Sancha, P. (2020) · Journal of Open Innovation Technology Market and Complexity · doi:10.3390/joitmc6040130 · Cited by 12 · see citing works
Quality Assessment Criteria for Mobile Health Apps: A Systematic Review
HONGSANUN, W., & Insuk, S. (2020) · Walailak Journal of Science and Technology (WJST) · doi:10.48048/wjst.2020.6482 · Cited by 14 · see citing works
Varshney, U., Singh, N., Bourgeois, A. G., & Dube, S. R. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab277 · Cited by 12 · see citing works
Evaluation of Breastfeeding App Features: Content Analysis Study
Dinour, L. M., & Pole, A. (2022) · JMIR Pediatrics and Parenting · doi:10.2196/37581 · Cited by 11 · see citing works
Paglialonga, A., Pinciroli, F., Tognola, G., Barbieri, R., Caiani, E. G., & Riboldi, M. (2017) · IEEE International Forum on Research and Technology for Society and Industry (RTSI) · doi:10.1109/rtsi.2017.8065915 · Cited by 10 · see citing works
Singh, S., Sharma, P., Ghimire, P., Shrestha, R., & Gnanavel, S. (2023) · Indian Journal of Psychological Medicine · doi:10.1177/02537176221142046 · Cited by 11 · see citing works
Nagar, R., Quirk, H. D., & Anderson, P. L. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100676 · Cited by 12 · see citing works
Yadav, S., Sethi, R., Pradhan, A. K., Vishwakarma, P., Bhandari, M., Gattani, R., Chandra, S., Chaudhary, G. K., SHARMA, A. K., Dwivedi, S. K., et al. (2021) · IJC Heart & Vasculature · doi:10.1016/j.ijcha.2021.100832 · Cited by 10 · see citing works
Paglialonga, A., Mastropietro, A., Scalco, E., & Rizzo, G. (2019) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-030-02182-5_2 · Cited by 10 · see citing works
Sun, M., Kentley, J., Wilson, B. N., Soyer, H. P., Curiel‐Lewandrowski, C. N., Rotemberg, V. M., Halpern, A. C., & the ISIC Technique Working Group (2022) · Skin Research and Technology · doi:10.1111/srt.13195 · Cited by 10 · see citing works
Quality Evaluation of Online Health Information Related to Young Child
Son, H., Je, M., & Sohn, Y.-S. (2018) · Child Health Nursing Research · doi:10.4094/chnr.2018.24.1.91 · Cited by 10 · see citing works
HIV/HTLV-1 co-infection: a systematic review of current evidence
Shahmohamadi, E., SeyedAlinaghi, S., Karimi, A., Behnezhad, F., Mehraeen, E., & Dadras, O. (2021) · HIV & AIDS Review · doi:10.5114/hivar.2021.108835 · Cited by 9 · see citing works
Privacy Apps for Smartphones: An Assessment of Users’ Preferences and Limitations
Sharma, T., & Bashir, M. N. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50309-3_35 · Cited by 8 · see citing works
- Authors
- BinDhim, N. F., Hawkey, A., & Trevena, L.
- Affiliations
- Saudi Electronic University (SA)
- Western Sydney University (AU)
- The University of Sydney (AU)
- Corresponding author
- BinDhim, Nasser F.
- Venue
- Telemedicine and e-Health
- Publisher
- SAGE Publications
- Published
- 2015-02
- Volume
- 21
- Issue
- 2
- Pages
- 97-104
- ISSN
- 1530-5627 (ISSN-L)
- 1556-3669
- OpenAlex
- W2133455974
- Cited by
- 142
- References
- 18
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 4 · 2023: 9 · 2022: 14 · 2021: 15 · 2020: 24 · 2019: 12 · 2018: 28 · 2017: 9 · 2016: 11 · 2015: 8
- FWCI
- 1.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Telemedicine Journal and e-Health (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- mobile health apps, app quality assessment, quality standards, evaluation methodology, App Store, health care consumers, mobile health
- MeSH terms
- Smartphone, Humans, Quality Assurance, Health Care, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review