Enhancing Digital Health Awareness and mHealth Competencies in Medical Education: Proof-of-Concept Study and Summative Process Evaluation of a Quality Improvement Project
Open accessPublished version of a preprint
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Background: Currently, there is a need to optimize knowledge on digital transformation in mental health care, including digital therapeutics (eg, prescription apps), in medical education. However, in Germany, digital health has not yet been systematically integrated into medical curricula and is taught in a relatively small number of electives. Challenges for lecturers include the dynamic field as well as lacking guidance on how to efficiently apply innovative teaching formats for these new digital competencies. Quality improvement projects provide options to pilot-test novel educational offerings, as little is known about the acceptability of participatory approaches in conventional medical education. Objective: This quality improvement project addressed the gap in medical school electives on digital health literacy by introducing and evaluating an elective scoping study on the systematic development of different health app concepts designed by students to cultivate essential skills for future health care professionals (ie, mobile health [mHealth] competencies). Methods: This proof-of-concept study describes the development, optimization, implementation, and evaluation of a web-based elective on digital (mental) health competencies in medical education. Implemented as part of a quality improvement project, the elective aimed to guide medical students in developing app concepts applying a design thinking approach at a German medical school from January 2021 to January 2024. Topics included defining digital (mental) health, quality criteria for health apps, user perspective, persuasive design, and critical reflection on digitization in medical practice. The elective was offered 6 times within 36 months, with continuous evaluation and iterative optimization using both process and outcome measures, such as web-based questionnaires. We present examples of app concepts designed by students and summarize the quantitative and qualitative evaluation results. Results: In total, 60 students completed the elective and developed 25 health app concepts, most commonly targeting stress management and depression. In addition, disease management and prevention apps were designed for various somatic conditions such as diabetes and chronic pain. The results indicated high overall satisfaction across the 6 courses according to the evaluation questionnaire, with lower scores indicating higher satisfaction on a scale ranging from 1 to 6 (mean 1.70, SD 0.68). Students particularly valued the content, flexibility, support, and structure. While improvements in group work, submissions, and information transfer were suggested, the results underscore the usefulness of the web-based elective. Conclusions: This quality improvement project provides insights into relevant features for the successful user-centered and creative integration of mHealth competencies into medical education. Key factors for the satisfaction of students involved the participatory mindset, focus on competencies, discussions with app providers, and flexibility. Future efforts should define important learning objectives for digital health literacy and provide recommendations for integration rather than debating the need for digital health integration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 A simplified explanation of the 5 stages of design thinking (based on the work by Meinel et al [31]).](https://figures.cochat.ai/paper-figures/1e68668c54a34afa8e527381b510bc01/enhancing-digital-health-awareness-and-mhealth-competencies-in-medical-education-figure-1.jpg)







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Structured educational interventions have proven effective in improving digital health literacy among medical students (28)”
From Health misinformation, digital health literacy, and attitudes toward science among university students: an exploratory cross-sectional survey (2026) · cites this paper as [28]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz
(2013) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/103.1437-1588 · Cited by 11,796
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233
Di Matteo, A., Bathon, J. M., & Emery, P. (2023) · The Lancet · doi:10.1016/s0140-6736(23)01525-8 · Cited by 849
Barriers and facilitators to the implementation of eHealth services: systematic literature analysis
Schreiweis, B., Pobiruchin, M., Strotbaum, V., Suleder, J., Wiesner, M., & Bergh, B. (2019) · Journal of Medical Internet Research · doi:10.2196/14197 · Cited by 354 · cited 1×
“As data security concerns are one of the main barriers to the acceptance and broad implementation of mobile health apps, addressing these issues in the process of the app’s development is essential [42].”
BackgroundValidation of the Mobile Application Rating Scale (MARS)
Terhorst, Y., Philippi, P., Sander, L. B., Schultchen, D., Paganini, S., Bardus, M., Santo, K., Knitza, J., Machado, G. C., Schoeppe, S., et al. (2020) · PLOS ONE · doi:10.1371/journal.pone.0241480 · Cited by 276
Wei, P.-S., & Lu, H.-P. (2014) · Internet Research · doi:10.1108/intr-04-2013-0082 · Cited by 271
(2011) · Springer eBooks · doi:10.1007/978-3-642-13757-0 · Cited by 257
Artificial intelligence for healthcare and medical education: a systematic review.
Li, S., Yin, C., Xu, Q., & Zhao, W. (2023) · PubMed Central · Cited by 253
Philippi, P., Baumeister, H., Apolinário-Hagen, J., Ebert, D. D., Hennemann, S., Kott, L., Lin, J., Messner, E.-M., & Terhorst, Y. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100459 · Cited by 200
Perceptions of Digital Health Education Among European Medical Students: Mixed Methods Survey
Machleid, F., Kaczmarczyk, R., Johann, D., Balčiūnas, J., Atienza-Carbonell, B., von Maltzahn, F., & Mosch, L. (2020) · Journal of Medical Internet Research · doi:10.2196/19827 · Cited by 190 · cited 1×
“A further study examining medical students’ perspectives indicated their desire for a more robust integration of digital health into the curriculum [43].”
Background
Research works printed but not linked: 2
- Sun, L, 2023, Am J Transl Res, 15, 4820
- Radić, M, 2021, Dtsch Arztebl, 118, A286
Cited by
Xie, G., Liao, J., Tang, X., Yang, Y., Han, F., Liu, D., Li, D., Jin, Y., & Wang, T. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08903-7 · Cited by 15
“…MOOCs), specialized training (such as blended training and short-term skills workshops), and digital tool empowerment (including electronic health record simulation systems and S4BE evidence-based tools) can effectively enhance digital literacy across different groups [26, 127, 129, 131, 132, 134].”
InfluentialOnetiu, F., Bratu, M. L., Folescu, R., Bratosin, F., & Bratu, T. (2025) · Healthcare · doi:10.3390/healthcare13090990 · Cited by 16
“…interventions show similar gains: a UAE elective on mHealth design boosted self-rated competence in digital health appraisal by 1.2 Likert points [22], and a Turkish survey linked prior telehealth coursework to higher knowledge scores and more favorable attitudes toward remote care [36].”
InfluentialSahan, F., Gutermuth, A., Müller, J. A., Muth, T., Panitz, K., & Apolinário-Hagen, J. (2026) · BMC Health Services Research · doi:10.1186/s12913-026-14005-3 · Cited by 8
“A greater integration of digital technologies into medical curricula and training programs may contribute to higher acceptance [64].”
Self-citationApolinário-Hagen, J., Schobel, J., Helten, A.-K., Sahan, F., Pryss, R. C., & John, D. T. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1629265 · Cited by 4
Self-citationSahan, F., Panitz, K., Wagenaar, C., Kairies‐Schwarz, N., Vomhof, M., Zinn, M., Guthardt, L., Bau, J., Loerbroks, A., Pischke, C. R., et al. (2025) · BMC Family Practice · doi:10.1186/s12875-025-03115-2 · Cited by 6
“CME programs and medical curricula should integrate DiGA-related content to build digital competencies early on and reduce knowledge gaps [74].”
Self-citationNavigating Uncertainty in Digital Health Education
Liebovitz, D. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.53095 · Cited by 2
Sarcone, A., Pileggi, C., Nobile, C., Simeone, S., & Mercuri, C. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1931903 · Cited by 1
Building Future-Ready Healthcare Systems Through Digital Literacy Training
Firmansyah, F., Ashari, M. R., & Syam, S. (2025) · Medicor Journal of Health Informatics and Health Policy · doi:10.61978/medicor.v3i1.1081
“Sahan et al. (2024) and Shiferaw et al. (2020), for example, reported differing outcomes on the effectiveness of training interventions within similar contexts, likely due to variations in study design, sample selection, and assessment tools.”
InfluentialRen, Y., Liang, S., Wang, R., Dong, S., Wu, Y., & Su, W. (2026) · Advances in Medical Education and Practice · doi:10.2147/amep.s601300
Glinkowski, W., Doniec, R., Cedro, T., Michalak, B., Jankowska, K., & Śliwczyński, A. M. (2026) · Telemedicine Journal and e-Health · doi:10.1177/15305627261462600
Wong, R. J., & Hsu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29178-3_14
Stahn, M., & Osthoff, A.-K. R. (2026) · physioscience · doi:10.1055/a-2918-0143
“This suggests that the skillset required for effective telerehabilitation extends beyond traditional in-person competencies [36], requiring both clinical expertise and digital literacy.”
North, K. L., Hendrix, S. L., Young, M. A., Odunsi, A. O., & Gray, J. A. (2026) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2026.102784
Standal, B., Kenter, R. M. F., Gullslett, M. K., Nordgreen, T., & Teig, I. L. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1955151
“Additionally, embedding digital health into early professional education may promote a more lasting sense of fit and acceptance (90, 91).”
Metadata
- Authors
- Sahan, F., Guthardt, L., Panitz, K., Siegel-Kianer, A., Eichhof, I., Schmitt, B. D., & Apolinario-Hagen, J.
- Affiliations
- Düsseldorf University Hospital (DE)
- ORCID
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2024-09-20
- Volume
- 10
- Pages
- e59454
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC11452754
- OpenAlex
- W4400533532
- Cited by
- 14
- References
- 47
- Citations by year
- 2026: 10 · 2025: 4
- FWCI
- 5.80
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Health Professions › General Health Professions › Health and Medical Education
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- digital health literacy, medical education, elective curriculum, design thinking, digital therapeutics, mental health services, persuasive design, user-centered design, student satisfaction, participatory learning, digital transformation in medicine, quality improvement projects, diabetes apps, medical students
- MeSH terms
- Proof of Concept Study, Digital Health, Clinical Competence, Curriculum, Education, Medical, Germany, Humans, Students, Medical, Telemedicine, Quality Improvement, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.