CoChat

Enhancing Digital Health Awareness and mHealth Competencies in Medical Education: Proof-of-Concept Study and Summative Process Evaluation of a Quality Improvement Project

Open access
Sahan, Fatma, Guthardt, Lisa, Panitz, Karin, Siegel-Kianer, Anna, Eichhof, Isabel, Schmitt, Björn D, Apolinario-Hagen, Jennifer · 2024 · JMIR Medical Education

Published version of a preprint

The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.

Abstract

Background: Currently, there is a need to optimize knowledge on digital transformation in mental health care, including digital therapeutics (eg, prescription apps), in medical education. However, in Germany, digital health has not yet been systematically integrated into medical curricula and is taught in a relatively small number of electives. Challenges for lecturers include the dynamic field as well as lacking guidance on how to efficiently apply innovative teaching formats for these new digital competencies. Quality improvement projects provide options to pilot-test novel educational offerings, as little is known about the acceptability of participatory approaches in conventional medical education. Objective: This quality improvement project addressed the gap in medical school electives on digital health literacy by introducing and evaluating an elective scoping study on the systematic development of different health app concepts designed by students to cultivate essential skills for future health care professionals (ie, mobile health [mHealth] competencies). Methods: This proof-of-concept study describes the development, optimization, implementation, and evaluation of a web-based elective on digital (mental) health competencies in medical education. Implemented as part of a quality improvement project, the elective aimed to guide medical students in developing app concepts applying a design thinking approach at a German medical school from January 2021 to January 2024. Topics included defining digital (mental) health, quality criteria for health apps, user perspective, persuasive design, and critical reflection on digitization in medical practice. The elective was offered 6 times within 36 months, with continuous evaluation and iterative optimization using both process and outcome measures, such as web-based questionnaires. We present examples of app concepts designed by students and summarize the quantitative and qualitative evaluation results. Results: In total, 60 students completed the elective and developed 25 health app concepts, most commonly targeting stress management and depression. In addition, disease management and prevention apps were designed for various somatic conditions such as diabetes and chronic pain. The results indicated high overall satisfaction across the 6 courses according to the evaluation questionnaire, with lower scores indicating higher satisfaction on a scale ranging from 1 to 6 (mean 1.70, SD 0.68). Students particularly valued the content, flexibility, support, and structure. While improvements in group work, submissions, and information transfer were suggested, the results underscore the usefulness of the web-based elective. Conclusions: This quality improvement project provides insights into relevant features for the successful user-centered and creative integration of mHealth competencies into medical education. Key factors for the satisfaction of students involved the participatory mindset, focus on competencies, discussions with app providers, and flexibility. Future efforts should define important learning objectives for digital health literacy and provide recommendations for integration rather than debating the need for digital health integration.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/59454

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 A simplified explanation of the 5 stages of design thinking (based on the work by Meinel et al [31]).
Figure 1 A simplified explanation of the 5 stages of design thinking (based on the work by Meinel et al [31]).CC BY · PubMed Central
Figure 2 Mock-ups of the Morpheus geht schlafen (Morpheus goes to sleep) app. Top left: welcome screen. Top right and bottom left: choice of the customizable companion (animal or human). Bottom right: assessment of individual well-being.
Figure 2 Mock-ups of the Morpheus geht schlafen (Morpheus goes to sleep) app. Top left: welcome screen. Top right and bottom left: choice of the customizable companion (animal or human). Bottom right: assessment of individual well-being.CC BY · PubMed Central
Figure 3 Mock-ups of the Bruhno app. Above: concept mapping for the Bruhno app mock-up as developed by the students. Below: mock-up of the Bruhno app-logo and log-out, log-in, and welcome screens.
Figure 3 Mock-ups of the Bruhno app. Above: concept mapping for the Bruhno app mock-up as developed by the students. Below: mock-up of the Bruhno app-logo and log-out, log-in, and welcome screens.CC BY · PubMed Central
Figure 4 Mock-ups of the MeTime app. Left: one-time log-in screen. Middle: welcome screen. Right: visualization of a stress barometer.
Figure 4 Mock-ups of the MeTime app. Left: one-time log-in screen. Middle: welcome screen. Right: visualization of a stress barometer.CC BY · PubMed Central
Figure 5 Mock-ups of the Dinotherapy app. Left: welcome screen (vivid user interface to create a positive user experience). Middle: options for the individual, customizable avatar or companion. Right: questionnaire to assess the user’s mood.
Figure 5 Mock-ups of the Dinotherapy app. Left: welcome screen (vivid user interface to create a positive user experience). Middle: options for the individual, customizable avatar or companion. Right: questionnaire to assess the user’s mood.CC BY · PubMed Central
Figure 6 Mock-ups of the Companion app. Left: welcome screen, current level, functions, and the customizable pet. Right: selection of tasks and activities for breaks.
Figure 6 Mock-ups of the Companion app. Left: welcome screen, current level, functions, and the customizable pet. Right: selection of tasks and activities for breaks.CC BY · PubMed Central
Figure 7 Assessment of students’ perceived learning gain from the elective conducted at the end of each semester. SS: summer semester; WS: winter semester.
Figure 7 Assessment of students’ perceived learning gain from the elective conducted at the end of each semester. SS: summer semester; WS: winter semester.CC BY · PubMed Central
Figure 8 Overall evaluation of the elective subjects over 6 courses within 5 semesters. The ratings are based on student ratings in accordance with the German grading system (1=completely agree; 6=do not agree at all), with lower values indicating better ratings. The inversion is intended to improve readability, with higher bars now corresponding to higher satisfaction ratings. The dashed line indicates the average rating across all semesters. SS: summer semester; WS: winter semester.
Figure 8 Overall evaluation of the elective subjects over 6 courses within 5 semesters. The ratings are based on student ratings in accordance with the German grading system (1=completely agree; 6=do not agree at all), with lower values indicating better ratings. The inversion is intended to improve readability, with higher bars now corresponding to higher satisfaction ratings. The dashed line indicates the average rating across all semesters. SS: summer semester; WS: winter semester.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 47 references

Research works printed but not linked: 2

  1. Sun, L, 2023, Am J Transl Res, 15, 4820
  2. Radić, M, 2021, Dtsch Arztebl, 118, A286

Cited by

Metadata

Authors
Sahan, F., Guthardt, L., Panitz, K., Siegel-Kianer, A., Eichhof, I., Schmitt, B. D., & Apolinario-Hagen, J.
Affiliations
Düsseldorf University Hospital (DE)
Venue
JMIR Medical Education
Published
2024-09-20
Volume
10
Pages
e59454
ISSN
2369-3762 (ISSN-L)
OpenAlex
W4400533532
Cited by
14
References
47
Citations by year
2026: 10 · 2025: 4
FWCI
5.80
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Medical Education (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Social Sciences › Education › Innovations in Medical Education
  • Health Sciences › Health Professions › General Health Professions › Health and Medical Education
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
digital health literacy, medical education, elective curriculum, design thinking, digital therapeutics, mental health services, persuasive design, user-centered design, student satisfaction, participatory learning, digital transformation in medicine, quality improvement projects, diabetes apps, medical students
MeSH terms
Proof of Concept Study, Digital Health, Clinical Competence, Curriculum, Education, Medical, Germany, Humans, Students, Medical, Telemedicine, Quality Improvement, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.