The German Version of the Mobile App Rating Scale (MARS-G): Development and Validation Study
Open accessPublished version of a preprint
Abstract
Background: The number of mobile health apps (MHAs), which are developed to promote healthy behaviors, prevent disease onset, manage and cure diseases, or assist with rehabilitation measures, has exploded. App store star ratings and descriptions usually provide insufficient or even false information about app quality, although they are popular among end users. A rigorous systematic approach to establish and evaluate the quality of MHAs is urgently needed. The Mobile App Rating Scale (MARS) is an assessment tool that facilitates the objective and systematic evaluation of the quality of MHAs. However, a German MARS is currently not available. Objective: The aim of this study was to translate and validate a German version of the MARS (MARS-G). Methods: The original 19-item MARS was forward and backward translated twice, and the MARS-G was created. App description items were extended, and 104 MHAs were rated twice by eight independent bilingual researchers, using the MARS-G and MARS. The internal consistency, validity, and reliability of both scales were assessed. Mokken scale analysis was used to investigate the scalability of the overall scores. Results: The retranslated scale showed excellent alignment with the original MARS. Additionally, the properties of the MARS-G were comparable to those of the original MARS. The internal consistency was good for all subscales (ie, omega ranged from 0.72 to 0.91). The correlation coefficients (r) between the dimensions of the MARS-G and MARS ranged from 0.93 to 0.98. The scalability of the MARS (H=0.50) and MARS-G (H=0.48) were good. Conclusions: The MARS-G is a reliable and valid tool for experts and stakeholders to assess the quality of health apps in German-speaking populations. The overall score is a reliable quality indicator. However, further studies are needed to assess the factorial structure of the MARS and MARS-G.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The apps were rated using the German version of the Mobile Application Rating Scale for users (uMARS-G).
“The apps were rated using the German version of the Mobile Application Rating Scale for users (uMARS-G) [53].”
From The BrEasT cancer afTER-CARE (BETTER-CARE) programme to improve breast cancer follow-up: design and feasibility study results of a cluster-randomised complex intervention trial (2024) · cites this paper as [53]
The Methods describe developing and using the German MARS-G, not a German user version. The Discussion’s Future Research section says the user version (uMARS) should still be translated and tested as uMARS-G, so this paper does not identify or validate the instrument named in the citing sentence. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · see citing works
Foundations of Clinical Research: Applications to Practice,
(2002) · Survey of Ophthalmology · doi:10.1016/s0039-6257(02)00362-4 · Cited by 9,485 · see citing works
Dunn, T. J., Baguley, T. S., & Brunsden, V. (2013) · British Journal of Psychology · doi:10.1111/bjop.12046 · Cited by 3,758 · see citing works
Thanks coefficient alpha, we’ll take it from here.
McNeish, D. (2018) · Psychological Methods · doi:10.1037/met0000144 · Cited by 2,533 · see citing works
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · see citing works
Self-citationCoefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma
Revelle, W., & Zinbarg, R. E. (2008) · Psychometrika · doi:10.1007/s11336-008-9102-z · Cited by 1,652 · see citing works
Heron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438 · see citing works
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · see citing works
A Basis for Analyzing Test-Retest Reliability
Guttman, L. (1945) · Psychometrika · doi:10.1007/bf02288892 · Cited by 1,123 · see citing works
A Theory and Procedure of Scale Analysis: With Applications in Political Research
Mokken, R. J. (1971) · doi:10.1515/9783110813203 · Cited by 1,120 · see citing works
Development and validation of the user version of the Mobile application rating scale (uMARS)
Stoyanov, S. R., Hides, L., Kavanagh, D. J., & Wilson, H. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5849 · Cited by 872 · see citing works
Self-citationMobile medical and health apps: state of the art, concerns, regulatory control and certification
Kamel Boulos, M. N., Brewer, A. C., Karimkhani, C., Buller, D. B., & Dellavalle, R. P. (2014) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v5i3.4814 · Cited by 659 · see citing works
Review and evaluation of mindfulness-based iPhone apps
Mani, M., Kavanagh, D. J., Hides, L., & Stoyanov, S. R. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4328 · Cited by 495 · see citing works
Self-citationvan Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H., & Riper, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100674 · Cited by 409 · see citing works
New Developments in Mokken Scale Analysis inR
van der Ark, L. A. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i05 · Cited by 361 · see citing works
Bardus, M., van Beurden, S. B., Smith, J. R., & Abraham, C. (2016) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-016-0359-9 · Cited by 350 · see citing works
Boudreaux, E. D., Waring, M. E., Hayes, R. B., Sadasivam, R. S., Mullen, S. P., & Pagoto, S. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0293-9 · Cited by 281 · see citing works
A tutorial on how to do a Mokken scale analysis on your test and questionnaire data
Sijtsma, K., & van der Ark, L. A. (2016) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12078 · Cited by 261 · see citing works
Creber, R. M., Maurer, M. S., Turchioe, M. R., Hiraldo, G., Hickey, K. T., & Iribarren, S. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5882 · Cited by 250 · see citing works
Criteria for assessing the quality of mHealth apps: a systematic review
Nouri, R., R Niakan Kalhori, S., Ghazisaeedi, M., Marchand, G., & Yasini, M. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy050 · Cited by 231 · see citing works
Baumel, A., Faber, K., Mathur, N., Kane, J. M., & Muench, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7270 · Cited by 206 · cited 2× · see citing works
“Baumel and colleagues [15] developed the Evaluation Tool for Mobile and Web-Based eHealth Interventions (ENLIGHT), according to a comprehensive systematic review of relevant criteria.”
MethodZhang, Z. J., & Yuan, K. (2015) · Educational and Psychological Measurement · doi:10.1177/0013164415594658 · Cited by 186 · see citing works
Smartphone apps for the self-management of low back pain: A systematic review
Machado, G. C., Pinheiro, M. B., Lee, H., Ahmed, O. H., Hendrick, P. A., Williams, C. M., & Kamper, S. J. (2016) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2017.04.002 · Cited by 171 · see citing works
Knitza, J., Taşçılar, K., Meßner, E.-M., Meyer, M., Vossen, D., Pulla, A., Bösch, P., Kittler, J., Kleyer, A., Sewerin, P., et al. (2019) · JMIR mhealth and uhealth · doi:10.2196/14991 · Cited by 170 · see citing works
Salazar, A., de Sola, H., Failde, I., & Moral-Munoz, J. A. (2018) · JMIR mHealth and uHealth · doi:10.2196/10718 · Cited by 154 · see citing works
Grainger, R., Townsley, H., White, B., Langlotz, T., & Taylor, W. J. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.6956 · Cited by 146 · see citing works
Reliability of Test Scores in Nonparametric Item Response Theory
Sijtsma, K., & Molenaar, I. W. (1987) · Psychometrika · doi:10.1007/bf02293957 · Cited by 137 · see citing works
mHealthApps: A Repository and Database of Mobile Health Apps
Xu, W., & Liu, Y. (2015) · JMIR mhealth and uhealth · doi:10.2196/mhealth.4026 · Cited by 130 · see citing works
Baumel, A., & Yom-Tov, E. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/ibx037 · Cited by 128 · see citing works
Free smoking cessation mobile apps available in Australia: a quality review and content analysis
Thornton, L. K., Quinn, C. A., Birrell, L., Guillaumier, A., Shaw, B., Forbes, E., Deady, M., & KAY‐LAMBKIN, F. J. (2017) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.12688 · Cited by 93 · see citing works
The Janus face of monolingualism: a comparison of German and Australian language education policies
Ellis, E. M., Gogolin, I., & Clyne, M. (2010) · Current Issues in Language Planning · doi:10.1080/14664208.2010.550544 · Cited by 86 · see citing works
Terhorst, Y., Rathner, E.-M., Baumeister, H., & Sander, L. (2018) · Verhaltenstherapie · doi:10.1159/000481692 · Cited by 84 · see citing works
Self-citationDomnich, A., Arata, L., Amicizia, D., Signori, A., Patrick, B., Stoyanov, S. R., Hides, L. M., Gasparini, R., & Panatto, D. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0323-2 · Cited by 83 · see citing works
Self-citationA Latent Class Approach to Estimating Test-Score Reliability
van der Ark, L. A., van der Palm, D. W., & Sijtsma, K. (2011) · Applied Psychological Measurement · doi:10.1177/0146621610392911 · Cited by 81 · see citing works
Spanish adaptation and validation of the Mobile Application Rating Scale questionnaire
Martín‐Payo, R., Fernández-Álvarez, M. D. M., Blanco‐Díaz, M., Cuesta, M., Stoyanov, S. R., & Suárez, E. L. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.06.005 · Cited by 64 · see citing works
Self-citationPryss, R. C., Probst, T., Schlee, W., Schobel, J., Langguth, B., Neff, P. K. A., Spiliopoulou, M., & Reichert, M. (2018) · International Journal of Data Science and Analytics · doi:10.1007/s41060-018-0111-4 · Cited by 53 · see citing works
Self-citationMokken Scale Analysis for Dichotomous Items Using Marginal Models
van der Ark, L. A., Croon, M. A., & Sijtsma, K. (2007) · Psychometrika · doi:10.1007/s11336-007-9034-z · Cited by 48 · see citing works
Sander, L., Paganini, S., Lin, J., Schlicker, S., Ebert, D. D., Buntrock, C., & Baumeister, H. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1193-6 · Cited by 44 · see citing works
Self-citationLin, J., Sander, L., Paganini, S., Schlicker, S., Ebert, D., Berking, M., Bengel, J., Nobis, S., Lehr, D., Mittag, O., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015226 · Cited by 27 · see citing works
Self-citationCorrection to Ebert, Van Daele, Nordgren, Karekla, Compare, Zarbo, …, Baumeister, 2018
Ebert, D. D., Daele, T. V., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000346 · Cited by 19 · see citing works
Self-citation
Flagged first, then by citations
1 of the 41 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Validation of the Mobile Application Rating Scale (MARS)
Terhorst, Y., Philippi, P., Sander, L., Schultchen, D., Paganini, S., Bardus, M., Santo, K., Knitza, J., Machado, G. C., Schöeppe, S., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0241480 · Cited by 276 · see citing works
Self-citationSander, L. B., Schorndanner, J., Terhorst, Y., Spanhel, K., Pryss, R., Baumeister, H., & Messner, E.-M. (2020) · European Journal of Psychotraumatology · doi:10.1080/20008198.2019.1701788 · Cited by 102 · see citing works
Self-citationRoberts, A., Davenport, T. A., Wong, T., Moon, H.-W., Hickie, I. B., & LaMonica, H. M. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100379 · Cited by 99 · see citing works
Schultchen, D., Terhorst, Y., Holderied, T., Stach, M., Meßner, E.-M., Baumeister, H., & Sander, L. (2020) · International Journal of Behavioral Medicine · doi:10.1007/s12529-020-09944-y · Cited by 75 · see citing works
Self-citationMobile Apps for Older Adults: Systematic Search and Evaluation Within Online Stores
Portenhauser, A. A., Terhorst, Y., Schultchen, D., Sander, L., Denkinger, M. D., Stach, M., Waldherr, N., Dallmeier, D., Baumeister, H., & Meßner, E.-M. (2021) · JMIR Aging · doi:10.2196/23313 · Cited by 77 · see citing works
Self-citationImpact of mobile health and medical applications on clinical practice in gastroenterology
Kernebeck, S., Busse, T. S., Böttcher, M. D., Weitz, J., Ehlers, J. P., & Bork, U. (2020) · World Journal of Gastroenterology · doi:10.3748/wjg.v26.i29.4182 · Cited by 70 · see citing works
Lambrecht, A., Vuillerme, N., Raab, C., Simón, D., Meßner, E.-M., Hagen, M., Bayat, S., Kleyer, A., Aubourg, T., Schett, G. A., et al. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.715345 · Cited by 58 · see citing works
Mobile Apps for Dental Caries Prevention: Systematic Search and Quality Evaluation
Chen, R., Santo, K., Wong, G. K. M., Sohn, W., Spallek, H., Chow, C. K., & Irving, M. J. (2020) · JMIR mhealth and uhealth · doi:10.2196/19958 · Cited by 60 · see citing works
Kahnbach, L., Lehr, D., Brandenburger, J., Mallwitz, T., Jent, S., Hannibal, S., Funk, B., & Janneck, M. (2021) · Journal of Medical Internet Research · doi:10.2196/27989 · Cited by 51 · see citing works
The Arabic Version of the Mobile App Rating Scale: Development and Validation Study
Bardus, M., Awada, N., Ghandour, L. A., Fares, E.-J., Gherbal, T., Al-Zanati, T., & Stoyanov, S. R. (2019) · JMIR mhealth and uhealth · doi:10.2196/16956 · Cited by 46 · see citing works
Self-citationMobile Health App Database - A Repository for Quality Ratings of mHealth Apps
Stach, M., Kraft, R., Probst, T., Meßner, E.-M., Terhorst, Y., Baumeister, H., Schickler, M., Reichert, M., Sander, L., & Pryss, R. C. (2020) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms49503.2020.00087 · Cited by 45 · see citing works
Self-citationWolf, S., Seiffer, B., Zeibig, J., Frei, A. K., Studnitz, T., Welkerling, J., Meinzinger, E., Bauer, L. L., Baur, J., Rosenstiel, S., et al. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00069-5 · Cited by 45 · see citing works
Systematic evaluation of content and quality of English and German pain apps in European app stores
Terhorst, Y., Meßner, E.-M., Schultchen, D., Paganini, S., Portenhauser, A. A., Eder, A.-S., Bauer, M., Papenhoff, M. C., Baumeister, H., & Sander, L. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100376 · Cited by 42 · see citing works
Self-citationDomhardt, M., Messner, E.-M., Eder, A.-S., Engler, S., Sander, L. B., Baumeister, H., & Terhorst, Y. (2021) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/s13034-021-00401-6 · Cited by 43 · see citing works
Self-citationQuality of Physical Activity Apps: Systematic Search in App Stores and Content Analysis
Paganini, S., Terhorst, Y., Sander, L., Catic, S., Balci, S., Küchler, A., Schultchen, D., Plaumann, K., Sturmbauer, S. C., Krämer, L. V., et al. (2021) · JMIR mhealth and uhealth · doi:10.2196/22587 · Cited by 41 · see citing works
Self-citationSaliasi, I., Martinon, P., Darlington, E., Smentek, C., Tardivo, D., Bourgeois, D. M., Dussart, C., Carrouel, F., & Fraticelli, L. (2021) · JMIR mhealth and uhealth · doi:10.2196/30480 · Cited by 42 · see citing works
Spanish adaptation and validation of the User Version of the Mobile Application Rating Scale (uMARS)
Martín‐Payo, R., Carrasco-Santos, S., Cuesta, M., Stoyan, S., González-Méndez, X., & Fernández-Álvarez, M. D. M. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab216 · Cited by 40 · see citing works
Gasteiger, N., Dowding, D., Norman, G., McGarrigle, L., Eost‐Telling, C., Jones, D. J., Vercell, A., Ali, S. M., & O’Connor, S. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-073283 · Cited by 37 · see citing works
Ajay, K., Azevedo, L. B., Haste, A., Morris, A. J., Giles, E. L., Gopu, B. P., Subramanian, M. K. P., & Zohoori, F. V. (2023) · Frontiers in Oral Health · doi:10.3389/froh.2023.1125070 · Cited by 37 · see citing works
Japanese Version of the Mobile App Rating Scale (MARS): Development and Validation
Yamamoto, K., Ito, M., Sakata, M., Koizumi, S., Hashisako, M., Sato, M., Stoyanov, S. R., & Furukawa, T. A. (2022) · JMIR mhealth and uhealth · doi:10.2196/33725 · Cited by 33 · see citing works
Self-citationBaumeister, H., Bauereiss, N., Zarski, A.-C., Braun, L., Buntrock, C., Hoherz, C., Idrees, A. R., Kraft, R., Meyer, P., Nguyen, T. B. D., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.660534 · Cited by 30 · see citing works
“Anxiety and depression via the four-item version of the Patient Health Questionnaire [PHQ-4; (85)], drive, sleep quality; data on the use and acceptance of mobile sensing; quality of the application from the user’s perspective via the German version of the Mobile Application Rating Scale [MARS-G; (86, 87)].”
MethodSelf-citationSchick, A., Paetzold, I., Rauschenberg, C., Hirjak, D., Banaschewski, T., Meyer-Lindenberg, A., Boehnke, J. R., Boecking, B., & Reininghaus, U. (2021) · JMIR Research Protocols · doi:10.2196/27462 · Cited by 30 · see citing works
Geirhos, A., Stephan, M., Wehrle, M., Mack, C., Meßner, E.-M., SCHMITT, A. J., Baumeister, H., Terhorst, Y., & Sander, L. (2022) · Scientific Reports · doi:10.1038/s41598-022-07544-2 · Cited by 28 · see citing works
Self-citationA Review of Mindfulness-Based Apps for Children
Nunes, A., Castro, S. L., & Limpo, T. (2020) · Mindfulness · doi:10.1007/s12671-020-01410-w · Cited by 29 · see citing works
Ko, K. K. H., Kim, S. K., Lee, Y., Lee, J. Y., & Stoyanov, S. R. (2022) · Health Informatics Journal · doi:10.1177/14604582221091975 · Cited by 29 · see citing works
Self-citationRaeesi, A., Khajouei, R., & Ahmadian, L. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-02029-8 · Cited by 26 · see citing works
Paganini, S., Meier, E. P., Terhorst, Y., Wurst, R., Hohberg, V., Schultchen, D., Strahler, J., Wursthorn, M., Baumeister, H., & Meßner, E.-M. (2023) · JMIR mhealth and uhealth · doi:10.2196/42415 · Cited by 26 · see citing works
Self-citationMobile Apps for Sexual and Reproductive Health Education: a Systematic Review and Quality Assessment
Muehlmann, M., & Tomczyk, S. (2023) · Current Sexual Health Reports · doi:10.1007/s11930-023-00359-w · Cited by 25 · see citing works
Sander, L., Lemor, M.-L., der Sloot, R. J. A. V., Jaegere, E. D., Büscher, R., Meßner, E.-M., Baumeister, H., & Terhorst, Y. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.689692 · Cited by 24 · see citing works
Self-citationSimon, L., Reimann, J., Steubl, L., Stach, M., Spiegelhalder, K., Sander, L., Baumeister, H., Meßner, E.-M., & Terhorst, Y. (2022) · Journal of Sleep Research · doi:10.1111/jsr.13642 · Cited by 24 · see citing works
Self-citationBehavior Change Techniques in Popular Mobile Apps for Smoking Cessation in France: Content Analysis
Perez, L. A. B., Ménard, C. G., Sweerts, S. J., & Romo, L. (2021) · JMIR mhealth and uhealth · doi:10.2196/26082 · Cited by 24 · see citing works
Meßner, E.-M., Sturm, N., Terhorst, Y., Sander, L., Schultchen, D., Portenhauser, A. A., Schmidbaur, S., Stach, M., Klaus, J., Baumeister, H., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/37497 · Cited by 24 · see citing works
Self-citationRohde, J., Marciniak, M. A., Henninger, M., Homan, S., Paersch, C., Egger, S., Seifritz, E., Brown, A. D., & Kleim, B. (2023) · JMIR Formative Research · doi:10.2196/45749 · Cited by 24 · see citing works
Barzegari, S., Kia, A. S., Bardus, M., Stoyanov, S. R., Ghazisaeedi, M., & Rafizadeh, M. (2022) · JMIR Formative Research · doi:10.2196/42225 · Cited by 23 · see citing works
Self-citationMoorthy, P., Weinert, L., Harms, B. C., Anders, C., & Siegel, F. P. (2023) · JMIR Human Factors · doi:10.2196/51090 · Cited by 21 · see citing works
Patient-Centered Chronic Wound Care Mobile Apps: Systematic Identification, Analysis, and Assessment
Dege, T., Glatzel, B., Borst, V., Grän, F., Goller, S. G., Glatzel, C. M., Goebeler, M., & Schmieder, A. (2024) · JMIR mhealth and uhealth · doi:10.2196/51592 · Cited by 22 · see citing works
Rohde, J., Marciniak, M. A., Henninger, M., Homan, S., Ries, A., Paersch, C., Friedman, O. B., Brown, A. D., & Kleim, B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0305103 · Cited by 20 · see citing works
German Mobile Apps for Patients With Psoriasis: Systematic Search and Evaluation
Lull, C., von Ahnen, J. A., Groß, G., Olsavszky, V., Knitza, J., Leipe, J., & Schmieder, A. (2022) · JMIR mhealth and uhealth · doi:10.2196/34017 · Cited by 20 · see citing works
Shinohara, Y., Yamamoto, K., Ito, M., Sakata, M., Koizumi, S., Hashisako, M., Sato, M., Wannous, M., Stoyanov, S. R., Nakajima, J., et al. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104809 · Cited by 19 · see citing works
Self-citationKopka, M., Slagman, A. C., Schorr, C., Krampe, H., Altendorf, M. B., Balzer, F., Bolanaki, M., Kuschick, D., Möckel, M., Napierala, H., et al. (2024) · Smart Health · doi:10.1016/j.smhl.2024.100517 · Cited by 18 · see citing works
Psychometric evaluation of the Mobile Application Rating Scale (MARS) (Preprint)Preprint
Terhorst, Y., Philippi, P., Sander, L., Schultchen, D., Paganini, S., Bardus, M., Santo, K., Knitza, J., Machado, G. C., Schöeppe, S., et al. (2020) · doi:10.2196/preprints.17689 · Cited by 19 · see citing works
Self-citationDederichs, M., Nitsch, F. J., & Apolinário-Hagen, J. (2022) · JMIR Medical Education · doi:10.2196/32017 · Cited by 16 · see citing works
Morselli, S., Sebastianelli, A., Domnich, A., Bucchi, C., Spatafora, P., Liaci, A., Gemma, L., Gravas, S., Panatto, D., Serni, S., et al. (2020) · PubMed Central · doi:10.15167/2421-4248/jpmh2021.62.1.1894 · Cited by 16 · see citing works
What Do People Want in a Smoking Cessation App? An Analysis of User Reviews and App Quality
Bendotti, H., Lawler, S., Ireland, D., GARTNER, C. E., Hides, L. M., & Marshall, H. (2021) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntab174 · Cited by 16 · see citing works
Self-citationZimmermann, J., Morf, H., Scharf, F., Knitza, J., Möller, H., Muehlensiepen, F., Nathrath, M., Orlemann, T., Voelker, T., & Deckers, M. (2024) · JMIR Human Factors · doi:10.2196/57771 · Cited by 15 · see citing works
Development and validation of the Turkish version of the Mobile App Rating Scale – MARS-TR
Mendi, O., Sarı, M. K., Stoyanov, S. R., & Mendi, B. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104843 · Cited by 14 · see citing works
Self-citationGreek validation of the user version of the Mobile Application Rating Scale (uMARS)
Chasiotis, G., Stoyanov, S. R., Karatzas, A. D., & Gravas, S. (2023) · Journal of International Medical Research · doi:10.1177/03000605231161213 · Cited by 13 · see citing works
Self-citationEhrmann, D., Eichinger, V., Vesper, I., Kober, J., Kraus, M., Schäfer, V., Hermanns, N., Kulzer, B., & Silbermann, S. (2022) · Trials · doi:10.1186/s13063-022-06248-2 · Cited by 14 · see citing works
Una Revisión sistemática de instrumentos que evalúan la calidad de aplicaciones móviles de salud
Morales, C. D., & Hueros, A. M. D. (2023) · Pixel-Bit Revista de Medios y Educación · doi:10.12795/pixelbit.97867 · Cited by 13 · see citing works
Tacke, T., Nohl-Deryk, P., Lingwal, N., Reimer, L. M., Starnecker, F., Güthlin, C., Gerlach, F. M., Schunkert, H., Jonas, S., & Müller, A. (2024) · Digital Health · doi:10.1177/20552076231225168 · Cited by 14 · see citing works
Low-Intensity Interventions and EMDR Therapy
Maxfield, L. (2021) · Journal of EMDR Practice and Research · doi:10.1891/emdr-d-21-00009 · Cited by 12 · see citing works
Dittrich, F., Back, D. A., Harren, A. K., Jäger, M., Landgraeber, S., Reinecke, F., & Beck, S. (2019) · JMIR mhealth and uhealth · doi:10.2196/16403 · Cited by 11 · see citing works
Faessen, J. P. M., Lucassen, D. A., Buso, M. E. C., Camps, G., Feskens, E. J. M., & Brouwer-Brolsma, E. M. (2022) · Current Developments in Nutrition · doi:10.1093/cdn/nzac087 · Cited by 11 · see citing works
Dittrich, F., Beck, S., Harren, A. K., Reinecke, F., Serong, S., Jung, J., Back, D. A., Wolf, M. A., & Landgraeber, S. (2020) · JMIR mhealth and uhealth · doi:10.2196/17085 · Cited by 11 · see citing works
Franzmair, J., Diesner, S. C., Voitl, J. J. M., & Voitl, P. (2021) · JMIR mhealth and uhealth · doi:10.2196/24907 · Cited by 11 · see citing works
Faqar-Uz-Zaman, S. F., Sliwinski, S., Detemble, C., Filmann, N., Zmuc, D., Mohr, L., Dreilich, J., Bechstein, W. O., Fleckenstein, J., & Schnitzbauer, A. A. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-069394 · Cited by 11 · see citing works
Baumgartner, M., Kuhn, C., Nakas, C. T., Herzig, D., & Bally, L. (2024) · Journal of Diabetes Science and Technology · doi:10.1177/19322968241264744 · Cited by 10 · see citing works
Turkish Validation of the User Version of the Mobile Application Rating Scale
Çalık, G., Kartal, B. B., Stoyanov, S. R., Othman, L., de la Rosette, J. J. M. C. H., Albayrak, S., Laguna, M. P., & Gravas, S. (2022) · Urology Research and Practice · doi:10.5152/tud.2022.21324 · Cited by 9 · see citing works
Self-citationGralha, S. R., & Bittencourt, O. N. D. S. (2023) · Research Society and Development · doi:10.33448/rsd-v12i6.42056 · Cited by 9 · see citing works
Krokos, O., Brandhorst, I., Seizer, L., Gawrilow, C., & Löchner, J. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100733 · Cited by 11 · see citing works
Ehrmann, D., Hermanns, N., Finke-Gröne, K., Roos, T., Kober, J., Schäfer, V., Krichbaum, M., Haak, T., Ziegler, R., Heinemann, L., et al. (2024) · Journal of Diabetes Science and Technology · doi:10.1177/19322968241239870 · Cited by 10 · see citing works
Apps for Covid-19 in Germany: assessment using the German Mobile App Rating Scale
Holl, F., Flemisch, F., Swoboda, W. J., & Schobel, J. (2022) · JAMIA Open · doi:10.1093/jamiaopen/ooac082 · Cited by 8 · see citing works
Stapelfeldt, P. M., Müller, S. A. M., & Kerkemeyer, L. (2024) · Frontiers in Health Services · doi:10.3389/frhs.2024.1393714 · Cited by 8 · see citing works
Mack, C., Terhorst, Y., Stephan, M., Baumeister, H., Stach, M., Meßner, E.-M., Bengel, J., & Sander, L. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph181910323 · Cited by 8 · see citing works
Self-citationA systematic quality rating of available mobile health apps for borderline personality disorder
Steubl, L., Reimann, J., Simon, L., Terhorst, Y., Stach, M., Baumeister, H., Sander, L., & Meßner, E.-M. (2022) · Borderline Personality Disorder and Emotion Dysregulation · doi:10.1186/s40479-022-00186-w · Cited by 7 · see citing works
Self-citationProposal of a New Rating Concept for Digital Health Applications in Orthopedics and Traumatology
Scherer, J. N., Youssef, Y., Dittrich, F., Albrecht, U., Tsitsilonis, S., Jung, J., Pförringer, D., Landgraeber, S., Beck, S., & Back, D. A. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192214952 · Cited by 7 · see citing works
Fiedler, D. V., Rosenstiel, S., Zeibig, J., Seiffer, B., Welkerling, J., Frei, A. K., Studnitz, T., Baur, J., Helmhold, F., Ray, A. M., et al. (2023) · Trials · doi:10.1186/s13063-023-07331-y · Cited by 7 · see citing works
An Overview of the Mobile App Rating Scale (MARS) in Health Care Application Assessment
Klug, B. (2023) · Journal of Hospital Librarianship · doi:10.1080/15323269.2023.2289804 · Cited by 6 · see citing works
Mobile Apps for COVID-19: A Systematic Review of Reviews
Holl, F., Schobel, J., & Swoboda, W. J. (2024) · Healthcare · doi:10.3390/healthcare12020139 · Cited by 6 · see citing works
Andreoli, D., Mancin, S., Sguanci, M. E., Ricco, M., Gazineo, D., & Godino, L. (2023) · MethodsX · doi:10.1016/j.mex.2023.102391 · Cited by 6 · see citing works
Zeiler, M., Chmelirsch, C., Dietzel, N., & Kolominsky‐Rabas, P. L. (2023) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2023.01.003 · Cited by 5 · see citing works
Lam, L. T.-M., & Lam, M. K. (2024) · JMIR Mental Health · doi:10.2196/51791 · Cited by 5 · see citing works
Digitale Technik für ambulante Pflege und Therapie
Weber, K., Haug, S., Lauer, N., Meussling-Sentpali, A., Mohr, C., Pfingsten, A., Raptis, G., & Bahr, G. (2022) · Regensburger Beiträge zur Digitalisierung des Gesundheitswesens · doi:10.1515/9783839462355 · Cited by 6 · see citing works
Gould, M. J., Lin, C., & Walsh, C. M. (2023) · Gastro Hep Advances · doi:10.1016/j.gastha.2023.03.001 · Cited by 5 · see citing works
Nitschke, M., Nwosu, O. B., Grube, L., Knitza, J., Seifer, A.-K., Eskofier, B. M., Schett, G. A., & Morf, H. (2023) · JMIR Formative Research · doi:10.2196/47426 · Cited by 5 · see citing works
Karthan, M., Hieber, D., Pryss, R. C., & Schobel, J. (2023) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms58004.2023.00211 · Cited by 5 · see citing works
Self-citationEmbracing change: Navigating menopause with the help of mobile health apps in Germany
Greffin, K., Muehlmann, M., Pauleikhoff, A., Stelling, B., Muehlan, H., Stach, M., Schmidt, S., & Tomczyk, S. (2025) · Comprehensive Psychoneuroendocrinology · doi:10.1016/j.cpnec.2025.100320 · Cited by 4 · see citing works
Muehlmann, M., Lienert, A., Muehlan, H., Stach, M., Terhorst, Y., & Meßner, E.-M. (2021) · Zeitschrift für Sexualforschung · doi:10.1055/a-1669-7626 · Cited by 4 · see citing works
Self-citationAltweck, L., Schmidt, S., & Tomczyk, S. (2024) · JMIR Research Protocols · doi:10.2196/54728 · Cited by 4 · see citing works
Schäfer, A., Wendel, J., Franke, I., Bauer, A., Baumeister, H., Bendig, E., Brucker, S. Y., Deutsch, T. M., Garatva, P., Haas, K., et al. (2024) · Trials · doi:10.1186/s13063-024-08614-8 · Cited by 3 · see citing works
“The apps were rated using the German version of the Mobile Application Rating Scale for users (uMARS-G) [53].”
Self-citationSchnitzbauer, A. A., Detemble, C., Faqar-Uz-Zaman, S. F., Dreilich, J., Mohr, L., Sliwinski, S., Zmuc, D., Siller, M., & Fleckenstein, J. (2024) · JMIR Formative Research · doi:10.2196/59513 · Cited by 3 · see citing works
Altweck, L., & Tomczyk, S. (2025) · JMIR Formative Research · doi:10.2196/67451 · Cited by 3 · see citing works
German Mobile Apps for Patients with Psoriatic Arthritis: Systematic App Search and Content Analysis
Groß, G., Lull, C., von Ahnen, J. A., Olsavszky, V., Knitza, J., Schmieder, A., & Leipe, J. (2022) · Health Policy and Technology · doi:10.1016/j.hlpt.2022.100697 · Cited by 3 · see citing works
Leysen, D., Reich, B., Carrozzo, E., Crutzen, R., Grote, V., Kumar, D., Mayr, B., Niebauer, J., Pfannerstill, F., Propst, E. M., et al. (2025) · JMIR Research Protocols · doi:10.2196/73704 · Cited by 3 · see citing works
Kermani, F., Mahmoodi, M., Nasiri, M. R., & Orooji, A. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105842 · Cited by 2 · see citing works
Sattar, A., Rehman, H., Naveed, S., Khadim, S., Khan, N., Kazi, A. F., Syed, W., Al-Rawi, M. B. A., & Jamshed, S. Q. (2025) · JMIR mhealth and uhealth · doi:10.2196/59884 · Cited by 2 · see citing works
Ziller, C., Gäumann, S., Lüscher, S., Paulissen, N., Behrendt, F., Suica, Z., Crüts, B., Gamerschlag, L., Parmar, K., Gerth, H. U., et al. (2026) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/77090 · Cited by 2 · see citing works
Características dos aplicativos móveis disponíveis para uso da enfermagem
Domingos, C. S., Toledo, L. V., Moura, C. D. C., Salgado, P. D. O., Boscarol, G. T., Azevedo, C., & Chianca, T. C. M. (2022) · Revista Eletrônica Acervo Saúde · doi:10.25248/reas.e10595.2022 · Cited by 2 · see citing works
Investigating the Validity and Reliability of the Mobile Application Rating Scale
Aydoğdu, Y. Ö., Durak, H. Y., & AKGÜN, E. (2023) · Bartın University Journal of Faculty of Education · doi:10.14686/buefad.1197656 · Cited by 2 · see citing works
Psikolojik Yardım Hizmetlerindeki Mobil Uygulamalarla İlgili Bir İnceleme
Kabadayı, F., & Güven, M. (2023) · Türk Eğitim Bilimleri Dergisi · doi:10.37217/tebd.1291285 · Cited by 2 · see citing works
Rinn, A., Hannibal, S., Goetsch, S., Weise, C., & Lehr, D. (2023) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-023-03805-1 · Cited by 2 · see citing works
Mobile Apps for Vaccination Services: Content Analysis and Quality Assessment
Zhang, C., Guo, X., Zhu, R., Hou, W.-G., Wang, L., Wang, F., Zhang, L., & Luo, D. (2024) · Online Journal of Public Health Informatics · doi:10.2196/50364 · Cited by 2 · see citing works
Mobile Apps und Internetanwendungen zur Unterstützung von Versorgung und Dokumentation bei Epilepsie
von Spiczak, S., Luef, G., & Stephani, U. (2021) · Clinical Epileptology · doi:10.1007/s10309-021-00429-w · Cited by 2 · see citing works
LAMP: a monitoring framework for mHealth application research
Stach, M., Pflüger, F., Reichert, M., & Pryss, R. C. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2021.12.229 · Cited by 2 · see citing works
Self-citationIntroducing the Chronic Disease mHealth App Quality Evaluation Framework (CHRONIQ)
Charlie, C., & Cilliers, L. (2024) · Conference on Information Communications Technology and Society (ICTAS) · doi:10.1109/ictas59620.2024.10507109 · Cited by 2 · see citing works
Gasteiger, N., Dowding, D., Norman, G., McGarrigle, L., Eost‐Telling, C., Jones, D. J., Vercell, A., Ali, S. M., & O’Connor, S. (2023) · Research Square · doi:10.21203/rs.3.rs-2647200/v1 · Cited by 2 · see citing works
Larionov, K., Petrova, E., Demirbuga, N., Werth, O., Breitner, M. H., Gebhardt, P., Caldarone, F., Duncker, D., Westhoff-Bleck, M., Sensenhauser, A., et al. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1138475 · Cited by 1 · see citing works
Análise de questionários de avaliação de aplicativos na área da saúde: Uma Revisão Sistemática
Gralha, S. R., & Bittencourt, O. N. D. S. (2022) · Clinical & Biomedical Research · doi:10.22491/2357-9730.119236 · Cited by 1 · see citing works
Günther, L., Schleberger, S., & Pischke, C. R. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19159474 · Cited by 1 · see citing works
Avaliação da qualidade de aplicativos móveis utilizados no desenvolvimento da força muscular
Gómez, G. D. I., Roa, D. M. O., Valencia, H. G., & Puerchnambut-Cadena, B. S. (2024) · Retos · doi:10.47197/retos.v53.102391 · Cited by 1 · see citing works
- Authors
- Messner, E.-M., Terhorst, Y., Barke, A., Baumeister, H., Stoyanov, S., Hides, L., Kavanagh, D., Pryss, R., Sander, L., & Probst, T.
- Affiliations
- Universität Ulm (DE)
- Catholic University of Eichstätt-Ingolstadt (DE)
- Queensland University of Technology (AU)
- The University of Queensland (AU)
- University of Freiburg (DE)
- Universität für Weiterbildung Krems (AT)
- Corresponding author
- Messner, Eva-Maria
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2020-03-27
- Volume
- 8
- Issue
- 3
- Pages
- e14479
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC7148545
- OpenAlex
- W2975516305
- Cited by
- 156
- References
- 41
- Citations by year
- 2026: 12 · 2025: 24 · 2024: 25 · 2023: 25 · 2022: 33 · 2021: 24 · 2020: 11 · 2019: 2
- FWCI
- 23.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Publication Server of the Catholic University Eichstätt-Ingolstadt (Catholic University of Eichstätt-Ingolstadt) (submittedVersion)
- Publication Server of the Catholic University Eichstätt-Ingolstadt (Catholic University of Eichstätt-Ingolstadt) (submittedVersion, cc-by)
- OPen Access Repositorium der Universität Ulm (OPARU) (Ulm University) (submittedVersion, other-oa)
- Universität Ulm, Kommunikations- und Informationszentrum (kiz) (cc-by)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Social Sciences › Education › Health Education and Validation
- Keywords
- Mobile App Rating Scale, mobile health apps, app quality assessment, cross-cultural adaptation, German translation, scale validation, Mokken scale analysis, scalability, app ratings, quality indicators
- MeSH terms
- Humans, Reproducibility of Results, Health Behavior, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
