Measuring the Quality of Mobile Apps for the Management of Pain: Systematic Search and Evaluation Using the Mobile App Rating Scale
Open accessPublished version of a preprint
Abstract
BACKGROUND: Chronic pain is a major health issue requiring an approach that not only considers medication, but also many other factors included in the biopsychosocial model of pain. New technologies, such as mobile apps, are tools to address these factors, although in many cases they lack proven quality or are not based on scientific evidence, so it is necessary to review and measure their quality. OBJECTIVE: The aim is to evaluate and measure the quality of mobile apps for the management of pain using the Mobile App Rating Scale (MARS). METHODS: This study included 18 pain-related mobile apps from the App Store and Play Store. The MARS was administered to measure their quality. We list the scores (of each section and the final score) of every app and we report the mean score (and standard deviation) for an overall vision of the quality of the pain-related apps. We compare the section scores between the groups defined according to the tertiles via analysis of variance (ANOVA) or Kruskal-Wallis test, depending on the normality of the distribution (Shapiro-Wilk test). RESULTS: The global quality ranged from 1.74 (worst app) to 4.35 (best app). Overall, the 18 apps obtained a mean score of 3.17 (SD 0.75). The best-rated sections were functionality (mean 3.92, SD 0.72), esthetics (mean 3.29, SD 1.05), and engagement (mean 2.87, SD 1.14), whereas the worst rated were app specific (mean 2.48, SD 1.00), information (mean 2.52, SD 0.82), and app subjective quality (mean 2.68, SD 1.22). The main differences between tertiles were found on app subjective quality, engagement, esthetics, and app specific. CONCLUSIONS: Current pain-related apps are of a certain quality mainly regarding their technical aspects, although they fail to offer information and have an impact on the user. Most apps are not based on scientific evidence, have not been rigorously tested, and the confidentiality of the information collected is not guaranteed. Future apps would need to improve these aspects and exploit the capabilities of current devices.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
MARS has been diversely and widely used in evaluating smartphone-based health apps, including pain management, weight management, diabetes management, and rheumatology apps.
“In addition, MARS has been diversely and widely used in evaluating smartphone-based health apps, for instance, pain management apps [31], weight management apps [32], diabetes management apps [33], and rheumatology apps [34,35].”
From Smartphone and mobile health apps for tinnitus: Systematic identification, analysis, and assessment (2020) · cites this paper as [31]
Very few pain-related eHealth programs are developed with the involvement of health-care professionals and actual end users (patients with chronic pain).
“systematic literature reviews examining the development and use of pain-related eHealth apps indicate that very few of these programs are developed with the involvement of health-care professionals and actual end users (ie, patients with chronic pain), and only a few existing pain-related apps appear to be based on a theoretical and evidence-based rationale [31,32].”
From Digital Self-Management in Support of Patients Living With Chronic Pain: Feasibility Pilot Study (2020) · cites this paper as [31]
Only a few existing pain-related apps appear to be based on a theoretical and evidence-based rationale.
“systematic literature reviews examining the development and use of pain-related eHealth apps indicate that very few of these programs are developed with the involvement of health-care professionals and actual end users (ie, patients with chronic pain), and only a few existing pain-related apps appear to be based on a theoretical and evidence-based rationale [31,32].”
From Digital Self-Management in Support of Patients Living With Chronic Pain: Feasibility Pilot Study (2020) · cites this paper as [31]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Survey of chronic pain in Europe: Prevalence, impact on daily life, and treatment
Breivik, H., Collett, B., Ventafridda, V., Cohen, R., & Gallacher, D. (2006) · European Journal of Pain · doi:10.1016/j.ejpain.2005.06.009 · Cited by 5,486 · see citing works
The biopsychosocial approach to chronic pain: Scientific advances and future directions.
Gatchel, R. J., Peng, Y. B., Peters, M. L., Fuchs, P. N., & Turk, D. C. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.581 · Cited by 3,392 · cited 1× · see citing works
“The biopsychosocial model states that pain is “a dynamic interaction among and within the biological, psychological, and social factors unique to each individual” [11].”
BackgroundMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · see citing works
Classification of Chronic Pain—Descriptions of Chronic Pain Syndromes and Definitions of Pain Terms
Harvey, A. M. (1995) · Clinical Journal of Pain · doi:10.1097/00002508-199506000-00024 · Cited by 1,787 · see citing works
A review of chronic pain impact on patients, their social environment and the health care system
Duenas, M., Ojeda, B., Salazar, A., Mico, J. A., & Failde, I. (2016) · Journal of Pain Research · doi:10.2147/jpr.s105892 · Cited by 985 · see citing works
Self-citationUpdating the definition of pain
Williams, A. C. D. C., & Craig, K. D. (2016) · Pain · doi:10.1097/j.pain.0000000000000613 · Cited by 754 · see citing works
Comorbidity of Chronic Pain and Mental Health Disorders: The Biopsychosocial Perspective.
Gatchel, R. J. (2004) · American Psychologist · doi:10.1037/0003-066x.59.8.795 · Cited by 488 · see citing works
Smartphone applications for pain management
Rosser, B. A., & Eccleston, C. (2011) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2011.101102 · Cited by 364 · see citing works
Medical apps for smartphones: lack of evidence undermines quality and safety
Buijink, A. W. G., Visser, B. J., & Marshall, L. (2013) · Evidence Based Medicine · doi:10.1136/eb-2012-100885 · Cited by 303 · see citing works
Lee, J.-A., Choi, M., Lee, S. A., & Jiang, N. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0591-0 · Cited by 303 · see citing works
Wu, Y., Yao, X., Vespasiani, G., Nicolucci, A., Dong, Y., Kwong, J., Li, L., Sun, X., Tian, H., & Li, S. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6522 · Cited by 283 · see citing works
Chronic diseases in the European Union: the prevalence and health cost implications of chronic pain
Leadley, R. M., Armstrong, N., Lee, Y. C., Allen, A., & Kleijnen, J. (2012) · Journal of Pain & Palliative Care Pharmacotherapy · doi:10.3109/15360288.2012.736933 · Cited by 282 · see citing works
Azevedo, L. F., Costa-Pereira, A., Mendonça, L., Dias, C. C., & Castro-Lopes, J. M. (2012) · The Journal of Pain · doi:10.1016/j.jpain.2012.05.012 · Cited by 264 · see citing works
Sociodemographic disparities in chronic pain, based on 12-year longitudinal data
Grol-Prokopczyk, H. (2016) · Pain · doi:10.1097/j.pain.0000000000000762 · Cited by 261 · see citing works
Security and Privacy Analysis of Mobile Health Applications: The Alarming State of Practice
Papageorgiou, A., Strigkos, M., Politou, E., Alepis, E., Solanas, A., & Patsakis, C. (2018) · IEEE Access · doi:10.1109/access.2018.2799522 · Cited by 236 · see citing works
Wu, Y., Yao, X., Vespasiani, G., Nicolucci, A., Dong, Y., Kwong, J. S. W., Li, L., Sun, X., Tian, H., & Li, S. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.8789 · Cited by 176 · see citing works
Dueñas, M., Salazar, A., Ojeda, B., Fernández-Palacín, F., Micó, J. A., Torres, L. M., & Failde, I. (2015) · Pain Medicine · doi:10.1111/pme.12640 · Cited by 104 · see citing works
Self-citationA quality review of smartphone applications for the management of pain
Portelli, P., & Eldred, C. (2016) · British Journal of Pain · doi:10.1177/2049463716638700 · Cited by 94 · see citing works
Commercially Available Smartphone Apps to Support Postoperative Pain Self-Management: Scoping Review
Lalloo, C., Shah, U. J., Birnie, K. A., Davies-Chalmers, C., Rivera, J., Stinson, J., & Campbell, F. A. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.8230 · Cited by 89 · see citing works
Birke, H., Kurita, G. P., Sjøgren, P., Højsted, J., Simonsen, M. K., Juel, K., & Ekholm, O. (2016) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.12700 · Cited by 77 · see citing works
Security Recommendations for mHealth Apps: Elaboration of a Developer’s Guide
Morera, E. P., de la Torre Díez, I., Garcia-Zapirain, B., López-Coronado, M., & Arambarri, J. (2016) · Journal of Medical Systems · doi:10.1007/s10916-016-0513-6 · Cited by 66 · see citing works
Covolo, L., Ceretti, E., Moneda, M., Castaldi, S., & Gelatti, U. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.07.032 · Cited by 65 · see citing works
Sola, H. D., Salazar, A., Dueñas, M., Ojeda, B. S., & Failde, I. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012246 · Cited by 64 · see citing works
Self-citationThe impact of chronic pain: The perspective of patients, relatives, and caregivers.
Ojeda, B. S., Salazar, A., Dueñas, M., Torres, L. M., Micó, J. A., & Failde, I. (2014) · Families Systems & Health · doi:10.1037/fsh0000069 · Cited by 63 · see citing works
Self-citationFactors Influencing Cognitive Impairment in Neuropathic and Musculoskeletal Pain and Fibromyalgia
Ojeda, B. S., Dueñas, M., Salazar, A., Micó, J. A., Torres, L. M., & Failde, I. (2017) · Pain Medicine · doi:10.1093/pm/pnx024 · Cited by 57 · see citing works
Self-citationTracing the Potential Flow of Consumer Data: A Network Analysis of Prominent Health and Fitness Apps
Grundy, Q., Held, F. P., & Bero, L. A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7347 · Cited by 47 · see citing works
Jonassaint, C. R., Rao, N., Sciuto, A., Switzer, G. E., Castro, L. M. D., Kato, G. J., Jonassaint, J., Hammal, Z., Shah, N., & Wasan, A. D. (2018) · Journal of Medical Internet Research · doi:10.2196/10056 · Cited by 18 · see citing works
Recent Advances in Cardiovascular Risk Factors
Atiq, M. (2012) · InTech eBooks · doi:10.5772/2495 · Cited by 15 · see citing works
Jonassaint, C. R., Rao, N., Sciuto, A., Switzer, G. E., Castro, L. M. D., Kato, G. J., Jonassaint, J., Hammal, Z., Shah, N., & Wasan, A. D. (2018) · doi:10.2196/preprints.10056 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Fregni, F., El-Hagrassy, M. M., Pacheco‐Barrios, K., Carvalho, S., Leite, J., Simis, M., Brunelin, J., Nakamura-Palacios, E. M., Marangolo, P., Venkatasubramanian, G., et al. (2020) · The International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyaa051 · Cited by 617 · see citing works
Validation of the Mobile Application Rating Scale (MARS)
Terhorst, Y., Philippi, P., Sander, L., Schultchen, D., Paganini, S., Bardus, M., Santo, K., Knitza, J., Machado, G. C., Schöeppe, S., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0241480 · Cited by 276 · see citing works
Knitza, J., Taşçılar, K., Meßner, E.-M., Meyer, M., Vossen, D., Pulla, A., Bösch, P., Kittler, J., Kleyer, A., Sewerin, P., et al. (2019) · JMIR mhealth and uhealth · doi:10.2196/14991 · Cited by 170 · see citing works
The German Version of the Mobile App Rating Scale (MARS-G): Development and Validation Study
Messner, E.-M., Terhorst, Y., Barke, A., Baumeister, H., Stoyanov, S., Hides, L., Kavanagh, D., Pryss, R., Sander, L., & Probst, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/14479 · Cited by 156 · see citing works
Moreno-Ligero, M., Moral-Muñoz, J. A., Salazar, A., & Failde, I. (2023) · JMIR mhealth and uhealth · doi:10.2196/40844 · Cited by 132 · see citing works
Self-citationStandards for Mobile Health–Related Apps: Systematic Review and Development of a Guide
Llorens-Vernet, P., & Miró, J. (2019) · JMIR mhealth and uhealth · doi:10.2196/13057 · Cited by 115 · see citing works
Pfeifer, A.-C., Uddin, R., Schröder‐Pfeifer, P., Holl, F., Swoboda, W. J., & Schiltenwolf, M. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9113557 · Cited by 108 · see citing works
Kaveladze, B. T., Wasil, A. R., Bunyi, J., Ramirez, V., & Schueller, S. M. (2021) · JMIR Human Factors · doi:10.2196/30766 · Cited by 104 · see citing works
Digital interventions to support adolescents and young adults with cancer: systematic review
McCann, L., McMillan, K. A., & Pugh, G. (2019) · JMIR Cancer · doi:10.2196/12071 · Cited by 98 · see citing works
Patients’ Needs and Requirements for eHealth Pain Management Interventions: Qualitative Study
Ledel Solem, I. K., Varsi, C., Eide, H., Kristjansdottir, O. B., Mirkovic, J., Børøsund, E., Haaland-Øverby, M., Heldal, K., Schreurs, K. M., Waxenberg, L. B., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/13205 · Cited by 80 · see citing works
Mandracchia, F., Llauradó, E., Tarro, L., Valls, R. M., & Solà, R. (2020) · JMIR mhealth and uhealth · doi:10.2196/18339 · Cited by 79 · see citing works
ACCU3RATE: A mobile health application rating scale based on user reviews
Biswas, M., Tania, M. H., Kaiser, M., Kabir, R., Mahmud, M., & Kemal, A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0258050 · Cited by 48 · see citing works
Mobile Phone Apps in Australia for Improving Pregnancy Outcomes: Systematic Search on App Stores
Musgrave, L. M., Kizirian, N. V., Homer, C., & Gordon, A. (2020) · JMIR mhealth and uhealth · doi:10.2196/22340 · Cited by 76 · see citing works
Bhatia, A., Kara, J., Janmohamed, T., Prabhu, A., Lebovic, G., Katz, J., & Clarke, H. (2021) · JMIR mHealth and uHealth · doi:10.2196/26528 · Cited by 73 · see citing works
Mobile Apps for Older Adults: Systematic Search and Evaluation Within Online Stores
Portenhauser, A. A., Terhorst, Y., Schultchen, D., Sander, L., Denkinger, M. D., Stach, M., Waldherr, N., Dallmeier, D., Baumeister, H., & Meßner, E.-M. (2021) · JMIR Aging · doi:10.2196/23313 · Cited by 77 · see citing works
Escalona‐Marfil, C., Coda, A., Ruíz-Moreno, J., Gispert, L. M. R., & Gironès, X. (2019) · Journal of Medical Internet Research · doi:10.2196/13468 · Cited by 66 · see citing works
Wang, X., Markert, C., & Sasangohar, F. (2021) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720821998110 · Cited by 61 · see citing works
Amor-García, M. Á., Collado-Borrell, R., Escudero-Vilaplana, V., Melgarejo-Ortuño, A., Herranz-Alonso, A., Arranz Arija, J. Á., & Sanjurjo-Sáez, M. (2020) · JMIR mHealth and uHealth · doi:10.2196/17609 · Cited by 49 · see citing works
Lozano‐Lozano, M., Cantarero‐Villanueva, I., Martín‐Martín, L., Galiano‐Castillo, N., Sánchez, M., Fernández‐Lao, C., Postigo-Martín, P., & Arroyo‐Morales, M. (2019) · JMIR mhealth and uhealth · doi:10.2196/14136 · Cited by 53 · see citing works
Innovations to improve access to musculoskeletal care
Chehade, M. J., Yadav, L., Kopansky-Giles, D. R., Merolli, M., Palmer, E., Jayatilaka, A., & Slater, H. (2020) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2020.101559 · Cited by 53 · see citing works
Escriche-Escuder, A., De-Torres, I., Roldán‐Jiménez, C., Martín‐Martín, J., Muro-Culebras, A., González‐Sánchez, M., Ruiz‐Muñoz, M., Mayoral, F., Biró, A., Tang, W. J., et al. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17249209 · Cited by 48 · see citing works
Varsi, C., Ledel Solem, I. K., Eide, H., Børøsund, E., Kristjansdottir, O. B., Heldal, K., Waxenberg, L. B., Weiss, K. E., Schreurs, K. M. G., Morrison, E. J., et al. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06278-7 · Cited by 53 · see citing works
Domhardt, M., Messner, E.-M., Eder, A.-S., Engler, S., Sander, L. B., Baumeister, H., & Terhorst, Y. (2021) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/s13034-021-00401-6 · Cited by 43 · see citing works
Smartphone and mobile health apps for tinnitus: Systematic identification, analysis, and assessment
Mehdi, M., Stach, M., Riha, C., Neff, P., Dode, A., Pryss, R., Schlee, W., Reichert, M., & Hauck, F. J. (2020) · JMIR mHealth and uHealth · doi:10.2196/21767 · Cited by 40 · see citing works
“In addition, MARS has been diversely and widely used in evaluating smartphone-based health apps, for instance, pain management apps [31], weight management apps [32], diabetes management apps [33], and rheumatology apps [34,35].”
BackgroundTelehealth and Virtual Reality Technologies in Chronic Pain Management: A Narrative Review
Cerda, I. H., Thérond, A., Moreau, S., Studer, K., Donjow, A. R., Crowther, J. E., Mazzolenis, M. E., Lang, M., Tolba, R., Gilligan, C. J., et al. (2024) · Current Pain and Headache Reports · doi:10.1007/s11916-023-01205-3 · Cited by 46 · see citing works
Systematic evaluation of content and quality of English and German pain apps in European app stores
Terhorst, Y., Meßner, E.-M., Schultchen, D., Paganini, S., Portenhauser, A. A., Eder, A.-S., Bauer, M., Papenhoff, M. C., Baumeister, H., & Sander, L. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100376 · Cited by 42 · see citing works
Digital Self-Management in Support of Patients Living With Chronic Pain: Feasibility Pilot Study
Bostrøm, K., Børøsund, E., Varsi, C., Eide, H., Flakk Nordang, E., Schreurs, K. M., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Cvancarova Småstuen, M., et al. (2020) · JMIR Formative Research · doi:10.2196/23893 · Cited by 34 · see citing works
Werner, N. E., Brown, J. C., Loganathar, P., & Holden, R. J. (2022) · JMIR mhealth and uhealth · doi:10.2196/33863 · Cited by 36 · see citing works
Digital manikins to self‐report pain on a smartphone: A systematic review of mobile apps
Ali, S. M., Lau, W. J., McBeth, J., Dixon, W. G., & van der Veer, S. N. (2020) · European Journal of Pain · doi:10.1002/ejp.1688 · Cited by 32 · see citing works
MacPherson, M., Bakker, A. M., Anderson, K., & Holtzman, S. (2022) · Canadian Journal of Pain · doi:10.1080/24740527.2022.2030212 · Cited by 36 · see citing works
Fan, Y., Wang, Z., Deng, S., Lv, H., & Wang, F. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104694 · Cited by 32 · see citing works
Nutrition-Related Mobile Apps in the French App Stores: Assessment of Functionality and Quality
Martinon, P., Saliasi, I., Bourgeois, D. M., Smentek, C., Dussart, C., Fraticelli, L., & Carrouel, F. (2022) · JMIR mhealth and uhealth · doi:10.2196/35879 · Cited by 29 · see citing works
Woulfe, F., Fadahunsi, K. P., Smith, S. D., Chirambo, G. B., Larsson, E. E. C., Henn, P., Mawkin, M., & Donoghue, J. O. (2021) · JMIR mhealth and uhealth · doi:10.2196/28384 · Cited by 30 · see citing works
A Review of Mindfulness-Based Apps for Children
Nunes, A., Castro, S. L., & Limpo, T. (2020) · Mindfulness · doi:10.1007/s12671-020-01410-w · Cited by 29 · see citing works
Narrillos-Moraza, Á., Gómez-Martínez-Sagrera, P., García, M. Á. A., Escudero‐Vilaplana, V., Collado‐Borrell, R., Villanueva‐Bueno, C., Gómez-Centurión, I. A., Alonso, A. H., & Sanjurjo‐Sáez, M. (2021) · JMIR mhealth and uhealth · doi:10.2196/32826 · Cited by 29 · see citing works
Gerner, M., Vuillerme, N., Aubourg, T., Meßner, E.-M., Terhorst, Y., Hörmann, V., Ganzleben, I., Schenker, H., Schett, G. A., Atreya, R. N., et al. (2022) · JMIR mhealth and uhealth · doi:10.2196/31102 · Cited by 28 · see citing works
Cheah, K. J., Manaf, Z. A., Ludin, A. F. M., Razalli, N. H., Mokhtar, N. M., & Ali, S. H. M. (2024) · JMIR mhealth and uhealth · doi:10.2196/49055 · Cited by 27 · see citing works
Dantas, L. O., Carvalho, C., Santos, B. L. D. J., Ferreira, C. H. J., Bø, K., & Driusso, P. (2021) · Brazilian Journal of Physical Therapy · doi:10.1016/j.bjpt.2021.01.001 · Cited by 27 · see citing works
Raeesi, A., Khajouei, R., & Ahmadian, L. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-02029-8 · Cited by 26 · see citing works
Draughon, J. E., Todd, A., Rose, L., Pollitt, E., & Anderson, J. (2022) · JMIR Formative Research · doi:10.2196/28959 · Cited by 25 · see citing works
Assessing Technology Innovation of Mobile Health Apps for Medical Care Providers
Galetsi, P., Katsaliaki, K., & Kumar, S. (2022) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2022.3142619 · Cited by 24 · see citing works
Meßner, E.-M., Sturm, N., Terhorst, Y., Sander, L., Schultchen, D., Portenhauser, A. A., Schmidbaur, S., Stach, M., Klaus, J., Baumeister, H., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/37497 · Cited by 24 · see citing works
Barreveld, A. M., Rosén Klement, M. L., Cheung, S., Axelsson, U., Basem, J. I., Reddy, A. S., Borrebaeck, C. A. K., & Mehta, N. (2023) · Pain Medicine · doi:10.1093/pm/pnad049 · Cited by 22 · see citing works
Evaluation of M-Health Applications Use in Epilepsy: A Systematic Review
Mohammadzadeh, N., Khenarinezhad, S., GhazanfariSavadkoohi, E., Safari, M. S., & Pahlevanynejad, S. (2021) · Iranian Journal of Public Health · doi:10.18502/ijph.v50i3.5586 · Cited by 22 · see citing works
Masiero, M. A., Filipponi, C., Fragale, E., Pizzoli, S. F. M., Munzone, E., Milani, A., Guido, L., Guardamagna, V. A., Marceglia, S. R. F., Prandin, R., et al. (2023) · JMIR Formative Research · doi:10.2196/51021 · Cited by 23 · see citing works
Hoffmann, A., Christmann, C. A., Zolynski, G., & Bleser, G. (2020) · JMIR Formative Research · doi:10.2196/13170 · Cited by 22 · see citing works
Dantas, L. O., Carvalho, C., Prando, B. C., McAlindon, T. E., & Serrão, P. R. M. D. S. (2021) · Clinical Rheumatology · doi:10.1007/s10067-020-05561-y · Cited by 24 · see citing works
Lee, C.-H., Liaw, G.-H., Wu-Chuan, Y., & Yu-Hsin, L. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1159399 · Cited by 21 · see citing works
Mobile applications for the management of chronic physical conditions: a systematic review
Jiménez-Muñoz, L., Gutiérrez-Rojas, L., Porras‐Segovia, A., Courtet, P., & Baca‐García, E. (2020) · Internal Medicine Journal · doi:10.1111/imj.15081 · Cited by 18 · see citing works
Sinclair, R., Nodi, S. S., & Kabir, M. A. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.108527 · Cited by 19 · see citing works
Assessing physical activity and functional fitness level using convolutional neural networks
Galán-Mercant, A., Ortíz, A., Herrera‐Viedma, E., Tomás, M. T., Fernandes, B., & Moral-Muñoz, J. A. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.104939 · Cited by 19 · see citing works
Psychometric evaluation of the Mobile Application Rating Scale (MARS) (Preprint)Preprint
Terhorst, Y., Philippi, P., Sander, L., Schultchen, D., Paganini, S., Bardus, M., Santo, K., Knitza, J., Machado, G. C., Schöeppe, S., et al. (2020) · doi:10.2196/preprints.17689 · Cited by 19 · see citing works
Meddar, J. M., Ponnapalli, A., Azhar, R., Turchioe, M. R., Duran, A. T., & Creber, R. M. (2022) · Journal of Cardiopulmonary Rehabilitation and Prevention · doi:10.1097/hcr.0000000000000667 · Cited by 19 · see citing works
Villegas, F., Martínez‐Borba, V., Suso‐Ribera, C., Castilla, D., Zaragozá, I., García‐Palacios, A., & Albiach, C. F. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18115991 · Cited by 18 · see citing works
Mobile applications for cognitive training: Content analysis and quality review
Bang, M., Jang, C. W., Kim, H. S., Park, J. H., & Cho, H. E. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100632 · Cited by 17 · see citing works
Martín‐Martín, J., Muro-Culebras, A., Roldán‐Jiménez, C., Escriche-Escuder, A., De-Torres, I., González‐Sánchez, M., Ruiz‐Muñoz, M., Mayoral, F., Biró, A., Tang, W. J., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182312505 · Cited by 15 · see citing works
Smartphone Apps for Problem Gambling: a Review of Content and Quality
McCurdy, L. Y., Loya, J. M., Hart-Derrick, V. R., Young, G. C., Kiluk, B. D., & Potenza, M. N. (2023) · Current Addiction Reports · doi:10.1007/s40429-023-00479-2 · Cited by 15 · see citing works
Benoit, J. R. A., Louie‐Poon, S., Kauser, S., & Meherali, S. M. (2022) · JMIR Pediatrics and Parenting · doi:10.2196/33826 · Cited by 15 · see citing works
Jannati, N., Salehinejad, S., Kuenzig, M. E., & Peña-Sánchez, J. N. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105249 · Cited by 13 · see citing works
Carvalho, C., Prando, B. C., Dantas, L. O., & Serrão, P. R. M. D. S. (2022) · Musculoskeletal Science and Practice · doi:10.1016/j.msksp.2022.102562 · Cited by 15 · see citing works
Oral-Hygiene-Related Mobile Apps in the French App Stores: Assessment of Functionality and Quality
Carrouel, F., Bourgeois, D. M., Clément, C., Tardivo, D., Martinon, P., Guiral, S., Lan, R., Viennot, S., Dussart, C., & Fraticelli, L. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19127293 · Cited by 15 · see citing works
Development and validation of the Turkish version of the Mobile App Rating Scale – MARS-TR
Mendi, O., Sarı, M. K., Stoyanov, S. R., & Mendi, B. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104843 · Cited by 14 · see citing works
What affects consumer behavior in mobile health professional diagnosis applications
Galetsi, P., Katsaliaki, K., Kumar, S., & Ferguson, M. E. (2021) · Decision Sciences · doi:10.1111/deci.12550 · Cited by 14 · see citing works
Zhou, T., Salman, D., & McGregor, A. H. (2024) · JMIR mhealth and uhealth · doi:10.2196/53262 · Cited by 14 · see citing works
Breast cancer-related apps in Google Play and App store: evaluate their functionality and quality
Aydın, A., & Gürsoy, A. (2022) · Journal of Cancer Survivorship · doi:10.1007/s11764-022-01290-0 · Cited by 13 · see citing works
Evaluation of Oral Hygiene-Related Mobile Apps for Children in Sub-Saharan Africa
Kanouté, A., Carrouel, F., Gare, J. V., Dieng, S. N., Dieng, A., Diop, M., Faye, D., Fraticelli, L., & Bourgeois, D. M. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191912565 · Cited by 12 · see citing works
Masiero, M. A., Filipponi, C., Pizzoli, S. F. M., Munzone, E., Guido, L., Guardamagna, V. A., Marceglia, S. R. F., Caruso, A., Prandin, R., Prenassi, M., et al. (2023) · JMIR Research Protocols · doi:10.2196/41216 · Cited by 12 · see citing works
The Practicality of Mobile Applications in Healthcare Administration and COVID-19 Pandemic
Zamri, N., & Mohideen, F. B. S. (2021) · Ulum Islamiyyah · doi:10.33102/uij.vol33no1.300 · Cited by 12 · see citing works
Prieto‐Moreno, R., Estévez‐López, F., Molina‐García, P., Mora‐Traverso, M., Deschamps, K., Claeys, K., de Buyser, J., & Ariza‐Vega, P. (2022) · Digital Health · doi:10.1177/20552076221139694 · Cited by 12 · see citing works
Lang, E. V., Jackson, W., Senn, P., Aroni, D. K. K., Finkelman, M., Corino, T. A., Conway, G., & Kulich, R. J. (2021) · International Journal of Clinical and Experimental Hypnosis · doi:10.1080/00207144.2021.1883988 · Cited by 11 · see citing works
Evaluation of Patient-Facing Mobile Apps to Support Physiotherapy Care: Systematic Review
Merolli, M., Francis, J., Vallance, P., Bennell, K. L., Malliaras, P., & Hinman, R. S. (2024) · JMIR mhealth and uhealth · doi:10.2196/55003 · Cited by 11 · see citing works
Eiken, A.-G., Nordanger, D. Ø., Nes, L. S., & Varsi, C. (2022) · JMIR Formative Research · doi:10.2196/34458 · Cited by 11 · see citing works
Characteristics of Acute Childhood Illness Apps for Parents: Environmental Scan
Benoit, J. R. A., Hartling, L., Chan, M. C., & Scott, S. D. (2021) · Journal of Medical Internet Research · doi:10.2196/29441 · Cited by 12 · see citing works
Weight Management Apps in Saudi Arabia: Evaluation of Features and Quality
Alshathri, D., Al-Humaimeedy, A. S., Al-Hudhud, G., AlSaleh, A. F. F., Al-Musharaf, S., & Aljuraiban, G. S. (2020) · JMIR mhealth and uhealth · doi:10.2196/19844 · Cited by 10 · see citing works
Adolescents’ Assessment of Two Mental Health–Promoting Mobile Apps: Results of Two User Surveys
Høgsdal, H., Kaiser, S., & Kyrrestad, H. (2023) · JMIR Formative Research · doi:10.2196/40773 · Cited by 10 · see citing works
Chirambo, G. B., Muula, A. S., Thompson, M. J., Hardy, V., Heavin, C., O’Connor, Y., Mastellos, N., Andersson, B., & O’Donoghue, J. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104323 · Cited by 10 · see citing works
Mobile health applications for pregnancy in Iran: Current state investigation
Shirvanian-Dehkordi, M., Zare‐Farashbandi, F., Samouei, R., & Nouri, R. (2022) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_1126_21 · Cited by 9 · see citing works
A Preliminary Evaluation of Mobile Phone Apps to Curb Alcohol Consumption
Mubin, O., Cai, B., Mahmud, A. A., Kharub, I., Lwin, M., & Khan, A. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19010135 · Cited by 9 · see citing works
Gupta, K., Roy, S., Altameem, A., Kumar, R., Saudagar, A. K. J., & Poonia, R. C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19126999 · Cited by 9 · see citing works
Apps for Covid-19 in Germany: assessment using the German Mobile App Rating Scale
Holl, F., Flemisch, F., Swoboda, W. J., & Schobel, J. (2022) · JAMIA Open · doi:10.1093/jamiaopen/ooac082 · Cited by 8 · see citing works
Stec, M. A., & Arbour, M. W. (2020) · Advances in Family Practice Nursing · doi:10.1016/j.yfpn.2020.01.003 · Cited by 11 · see citing works
Arabkermani, Z., Barzegari, S., Rouhani, A., Nahavandi, N., Gibreel, O., & Arpacı, İ. (2025) · Journal of Medical Internet Research · doi:10.2196/71118 · Cited by 8 · see citing works
Cogan, N., Kirk, A. F., & Graf, C. (2026) · JMIR Research Protocols · doi:10.2196/72250 · Cited by 7 · see citing works
Agnew, J. M. R., Nugent, C., Hanratty, C. E., Martin, E. S., Kerr, D. P., & McVeigh, J. G. (2022) · JMIR Formative Research · doi:10.2196/34339 · Cited by 8 · see citing works
Gómez-González, M. A., Tous, N. C., Sabido, J. D. L. C., Corral, C. S., Carrasco, B. L., López-Vicente, M., & Granados, G. O. (2024) · JMIR Human Factors · doi:10.2196/60160 · Cited by 7 · see citing works
Marques, J., Borges, L., Andias, R., & Silva, A. G. (2021) · Musculoskeletal Care · doi:10.1002/msc.1581 · Cited by 6 · see citing works
Beauvais, C., Pham, T., Montagu, G., Gleizes, S., Madrisotti, F., Lafourcade, A., Vidal, C., Dervin, G., Baudard, P., Desouches, S., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0272235 · Cited by 6 · see citing works
Andreoli, D., Mancin, S., Sguanci, M. E., Ricco, M., Gazineo, D., & Godino, L. (2023) · MethodsX · doi:10.1016/j.mex.2023.102391 · Cited by 6 · see citing works
Evaluation of the quality of oral hygiene mobile apps for children using the mobile app rating scale
Meriç, E. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105612 · Cited by 5 · see citing works
Owrangi, S., Zarifsanaiey, N., & Rezaei, M. S. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110740 · Cited by 5 · see citing works
Gonzales, A., Custodio, R., Lapitan, M. C., & Ladia, M. A. J. (2023) · BMC Digital Health · doi:10.1186/s44247-023-00007-2 · Cited by 5 · see citing works
Nitschke, M., Nwosu, O. B., Grube, L., Knitza, J., Seifer, A.-K., Eskofier, B. M., Schett, G. A., & Morf, H. (2023) · JMIR Formative Research · doi:10.2196/47426 · Cited by 5 · see citing works
App-Mohedo®: A mobile app for the management of chronic pelvic pain. A design and development study
Díaz-Mohedo, E., Carrillo, A., Mateo, A. C., Ptak, M., Romero‐Franco, N., & Fernández‐Domínguez, J. C. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105410 · Cited by 5 · see citing works
Quality evaluation of smartphone applications for physical activity promotion
Lee, J. B., & Woo, H. (2019) · 보건교육·건강증진학회지 · doi:10.14367/kjhep.2019.36.4.67 · Cited by 5 · see citing works
LeBaron, V. T., Horton, B. J., Adhikari, A., Chapagain, S., Dhakal, M., Gongal, R. N., Kattel, R., Koirala, G., Kutcher, A. M., Hass, B., et al. (2022) · Frontiers in Pain Research · doi:10.3389/fpain.2022.910995 · Cited by 5 · see citing works
Standards for mobile health-related apps (Preprint)Preprint
Miró, J., & Llorens-Vernet, P. (2018) · doi:10.2196/preprints.13057 · Cited by 5 · see citing works
Lim, A., Merner, B., Iyer, S. N., & McCullough, M. J. (2025) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzaf024 · Cited by 4 · see citing works
Farzad, M., MacDermid, J. C., Ferreira, L. M., Tutunea-Fatan, R. O., Saeedi, M., Górski, A., Balaji, A., & Cuypers, S. (2025) · Journal of Hand Therapy · doi:10.1016/j.jht.2025.04.019 · Cited by 4 · see citing works
Quality of mobile apps for psychological skills training in sport: A MARS-based study
Bonetti, R., Rod, B., Sabourin, C., & Hauw, D. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100635 · Cited by 4 · see citing works
Moral-Muñoz, J. A., Salazar, A., Dueñas, M., Sola, H. D., & Failde, I. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.15095 · Cited by 4 · see citing works
Self-citation
- Authors
- Salazar, A., de Sola, H., Failde, I., & Moral-Munoz, J. A.
- Affiliations
- Universidad de Cádiz (ES)
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2018-10-25
- Volume
- 6
- Issue
- 10
- Pages
- e10718
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC6231783
- OpenAlex
- W2883454068
- Cited by
- 154
- References
- 29
- Citations by year
- 2026: 5 · 2025: 19 · 2024: 25 · 2023: 14 · 2022: 27 · 2021: 32 · 2020: 20 · 2019: 10 · 2018: 1
- FWCI
- 24.05
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- RODIN (Universidad de Cádiz) (submittedVersion, other-oa)
- RISalud Institutional Health Repository of Andalucía (submittedVersion, cc-by)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- mobile application, chronic pain management, app quality, Mobile App Rating Scale, biopsychosocial model of pain, user engagement, app aesthetics, data privacy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review