Digital health training programs for medical students: scoping review
Open accessPublished version of a preprint
Abstract
Background: Medical schools worldwide are accelerating the introduction of digital health courses into their curricula. The COVID-19 pandemic has contributed to this swift and widespread transition to digital health and education. However, the need for digital health competencies goes beyond the COVID-19 pandemic because they are becoming essential for the delivery of effective, efficient, and safe care. Objective: This review aims to collate and analyze studies evaluating digital health education for medical students to inform the development of future courses and identify areas where curricula may need to be strengthened. Methods: We carried out a scoping review by following the guidance of the Joanna Briggs Institute, and the results were reported in accordance with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. We searched 6 major bibliographic databases and gray literature sources for articles published between January 2000 and November 2019. Two authors independently screened the retrieved citations and extracted the data from the included studies. Discrepancies were resolved by consensus discussions between the authors. The findings were analyzed using thematic analysis and presented narratively. Results: A total of 34 studies focusing on different digital courses were included in this review. Most of the studies (22/34, 65%) were published between 2010 and 2019 and originated in the United States (20/34, 59%). The reported digital health courses were mostly elective (20/34, 59%), were integrated into the existing curriculum (24/34, 71%), and focused mainly on medical informatics (17/34, 50%). Most of the courses targeted medical students from the first to third year (17/34, 50%), and the duration of the courses ranged from 1 hour to 3 academic years. Most of the studies (22/34, 65%) reported the use of blended education. A few of the studies (6/34, 18%) delivered courses entirely digitally by using online modules, offline learning, massive open online courses, and virtual patient simulations. The reported courses used various assessment approaches such as paper-based assessments, in-person observations, and online assessments. Most of the studies (30/34, 88%) evaluated courses mostly by using an uncontrolled before-and-after design and generally reported improvements in students’ learning outcomes. Conclusions: Digital health courses reported in literature are mostly elective, focus on a single area of digital health, and lack robust evaluation. They have diverse delivery, development, and assessment approaches. There is an urgent need for high-quality studies that evaluate digital health education.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Seven studies met the ROBIS criteria for low risk, one study was of unclear risk, and three studies were of high risk.
“Seven studies met the ROBIS criteria for low risk [12,13,38,39,40,41,42], one study was of unclear risk [43], and three studies were of high risk [44–46].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [41]
Eleven studies suggest that physicians should understand the role of data science in AI.
“Eleven studies suggest that physicians should understand the role of data science in AI [12,13,16,37,39,41,42,45].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [41]
Three key types of communication were identified: communication for clinical decision-making, communication for implementation, and communication for knowledge dissemination.
“Three key types of communication were identified: communication for clinical decision-making [13], communication for implementation [13,37], and communication for knowledge dissemination [12,13,37,41,42].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [41]
Knowledge related to data stewardship, data preprocessing and acquisition, standardization, data analytics, health data infrastructure, programming, and big data may help physicians appreciate obstacles faced by data scientists and improve multidisciplinary collaboration.
“In particular, knowledge related to data stewardship [12,13,37,41], data preprocessing and acquisition [13], standardization [13], data analytics [13,17,39], health data infrastructure [45], programming [39,41], and big data [13,45], may help physicians appreciate the obstacles faced by data scientists and improve the multidisciplinary collaboration [13,39].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [41]
Four key relationships for communication were identified: data scientist to physician, physician to physician/allied healthcare professional, physician to patient, and physician to payer.
“Furthermore, four key relationships for communication were identified: data scientist to physician [13], physician to physician/allied healthcare professional [12,13,42], physician to patient [12,13,37,41,42], and physician to payer [13,37].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [41]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · see citing works
JBI Manual for Evidence Synthesis
(2020) · JBI eBooks · doi:10.46658/jbimes-20-01 · Cited by 4,165 · see citing works
The impact of artificial intelligence in medicine on the future role of the physician
Ahuja, A. S. (2019) · PeerJ · doi:10.7717/peerj.7702 · Cited by 789 · see citing works
Digital health is a cultural transformation of traditional healthcare
Meskó, B., Drobni, Z. D., Bényei, É., Gergely, B., & Győrffy, Z. (2017) · mHealth · doi:10.21037/mhealth.2017.08.07 · Cited by 734 · see citing works
Telemedicine Training in Undergraduate Medical Education: Mixed-Methods Review
Waseh, S., & Dicker, A. P. (2019) · JMIR Medical Education · doi:10.2196/12515 · Cited by 291 · see citing works
Education and training to support the use of clinical telehealth: A review of the literature
Edirippulige, S., & Armfield, N. R. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16632968 · Cited by 251 · see citing works
Health Information Technology: Laying The Infrastructure For National Health Reform
Buntin, M. B., JAIN, S. H., & Blumenthal, D. (2010) · Health Affairs · doi:10.1377/hlthaff.2010.0503 · Cited by 249 · see citing works
Perceptions of Digital Health Education Among European Medical Students: Mixed Methods Survey
Machleid, F., Kaczmarczyk, R., Johann, D., Balčiūnas, J., Atienza-Carbonell, B., von Maltzahn, F., & Mosch, L. (2020) · Journal of Medical Internet Research · doi:10.2196/19827 · Cited by 190 · see citing works
The Role of Informatics in Promoting Patient-Centered Care
Snyder, C. F., Wu, A. W., Miller, R. S., Jensen, R. E., Bantug, E. T., & Wolff, A. C. (2011) · The Cancer Journal · doi:10.1097/ppo.0b013e318225ff89 · Cited by 166 · see citing works
Main, C., Moxham, T., Wyatt, J. C., Kay, J. D., Anderson, R., & Stein, K. (2010) · Health Technology Assessment · doi:10.3310/hta14480 · Cited by 166 · see citing works
Integration of Telehealth Education into the Health Care Provider Curriculum: A Review
Chike-Harris, K. E., Durham, C., Logan, A., Smith, G. M., & DuBose-Morris, R. (2020) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2019.0261 · Cited by 153 · see citing works
Digital health during COVID-19: lessons from operationalising new models of care in ophthalmology
Gunasekeran, D. V., Tham, Y. C., Ting, D. S. W., Tan, G. S. W., & Wong, T. Y. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30287-9 · Cited by 151 · see citing works
The primary care response to COVID-19 in England's National Health Service
Majeed, A., Maile, E. J., & Bindman, A. B. (2020) · Journal of the Royal Society of Medicine · doi:10.1177/0141076820931452 · Cited by 138 · see citing works
Self-citationAungst, T. D., & Patel, R. (2020) · Journal of Medical Education and Curricular Development · doi:10.1177/2382120519901275 · Cited by 135 · see citing works
Keasberry, J. F. S., Scott, I. A., Sullivan, C. M., Staib, A. N., & Ashby, R. (2017) · Australian Health Review · doi:10.1071/ah16233 · Cited by 134 · see citing works
Edirippulige, S., Brooks, P., Carati, C. J., Wade, V., Smith, A. C., Wickramasinghe, S. I., & Armfield, N. R. (2018) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x18793282 · Cited by 110 · see citing works
Digital Literacy in the Medical Curriculum: A Course With Social Media Tools and Gamification
Meskó, B., Győrffy, Z., & Kollár, J. (2015) · JMIR Medical Education · doi:10.2196/mededu.4411 · Cited by 86 · see citing works
Electronic Health Record Training in Undergraduate Medical Education
Wald, H. S., George, P., Reis, S. P., & Taylor, J. S. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000131 · Cited by 86 · see citing works
Simulated Electronic Health Record (Sim-EHR) Curriculum
Milano, C. E., Hardman, J. A., Plesiu, A., Rdesinski, R. E., & Biagioli, F. E. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000149 · Cited by 83 · see citing works
Yaghobian, S., Ohannessian, R., Iampetro, T., Riom, I., Salles, N., de Bustos, E. M., Moulin, T., & Mathieu-Fritz, A. (2022) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x20926829 · Cited by 76 · see citing works
Remote monitoring and digital health tools in CVD management
Cowie, M., & Lam, C. S. P. (2021) · Nature Reviews Cardiology · doi:10.1038/s41569-021-00548-x · Cited by 74 · see citing works
An Interdisciplinary, Multi-Institution Telehealth Course for Third-Year Medical Students
Jonas, C. E., Durning, S. J., Zebrowski, C. A., & Cimino, F. M. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002701 · Cited by 73 · see citing works
Rajaram, A., Hickey, Z., Patel, N. R., Newbigging, J., & Wolfrom, B. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz178 · Cited by 67 · see citing works
Effects of eHealth on hospital practice: synthesis of the current literature
Eden, R., Burton‐Jones, A., Scott, I. A., Staib, A. N., & Sullivan, C. M. (2018) · Australian Health Review · doi:10.1071/ah17255 · Cited by 61 · see citing works
National survey of telemedicine education and training in medical schools in France
Yaghobian, S., Ohannessian, R., Mathieu-Fritz, A., & Moulin, T. (2019) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x18820374 · Cited by 57 · see citing works
Medical student training in eHealth: scoping review
Echelard, J.-F., Méthot, F., Nguyen, H.-A., & Pomey, M.-P. (2020) · JMIR Medical Education · doi:10.2196/20027 · Cited by 51 · see citing works
Brockes, C., Grischott, T., Dutkiewicz, M., & Schmidt-Weitmann, S. (2017) · Telemedicine and e-Health · doi:10.1089/tmj.2017.0011 · Cited by 46 · see citing works
Bulik, R. J., & Shokar, G. S. (2010) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2010.090910 · Cited by 44 · see citing works
Integration of Information Literacy into a Revised Medical School Curriculum
Brown, J. F., & Nelson, J. L. (2003) · Medical Reference Services Quarterly · doi:10.1300/j115v22n03_07 · Cited by 38 · see citing works
Gibson, K. E., & Silverberg, M. (2000) · PubMed · Cited by 36 · see citing works
Lee, W. W., Alkureishi, M. A., Wroblewski, K., Farnan, J. M., & Arora, V. M. (2017) · Medical Education Online · doi:10.1080/10872981.2017.1396171 · Cited by 34 · see citing works
Computing for Medicine: Can We Prepare Medical Students for the Future?
Law, M., Veinot, P. L., Campbell, J., Craig, M., & Mylopoulos, M. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002521 · Cited by 33 · see citing works
The Evolution of a Novel Biomedical Informatics Curriculum for Medical Students
Silverman, H. D., Cohen, T., & Fridsma, D. B. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31823a599e · Cited by 28 · see citing works
Isolated to Integrated: An Evolving Medical Informatics Curriculum
Geyer, E. M., & Irish, E. (2008) · Medical Reference Services Quarterly · doi:10.1080/02763860802368324 · Cited by 23 · see citing works
Preparing tomorrow's doctors: the impact of a special study module in medical informatics
McGlade, K. J., McKeveney, C. J., Crawford, V. L. S., et al. (2001) · Medical Education · doi:10.1046/j.1365-2923.2001.00840.x · Cited by 22 · see citing works
Teaching of medical informatics in UME-21 medical schools: best practices and useful resources.
Gjerde, C. L., Pipas, C. F., & Russell, M. (2004) · PubMed · Cited by 21 · see citing works
Lessons learned from piloting mHealth informatics practice curriculum into a medical elective
Fernando, J., & Lindley, J. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx076 · Cited by 20 · see citing works
Pereira, A. G., Kim, M. S., Seywerd, M., Nesbitt, B., Pitt, M. B., & Collaborative, O. B. O. T. M. E. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1635096 · Cited by 20 · see citing works
HIT Plants SEEDS in Healthcare Education
Connors, H. R., Warren, J. J., & Weaver, C. A. (2007) · Nursing Administration Quarterly · doi:10.1097/01.naq.0000264861.49217.f0 · Cited by 17 · see citing works
An overview of the medical informatics curriculum in medical schools.
Espino, J. U., & Levine, M. G. (1998) · PubMed · Cited by 16 · see citing works
Emerging eHealth Directions in the Philippines
Fernandez–Marcelo, P. H., Ho, B. L., Faustorilla, J. F., et al. (2012) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1639446 · Cited by 16 · see citing works
Burgun, A., Darmoni, S. J., Duff, F. L., & Weber, J. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.07.014 · Cited by 13 · see citing works
Defining and Assessing Medical Informatics Competencies
Blumenthal, J. L., Mays, B. E., Weinfeld, J. M., et al. (2005) · Medical Reference Services Quarterly · doi:10.1300/j115v24n02_08 · Cited by 12 · see citing works
Strengthening Our Collaborations: Building an Electronic Health Record Educational Module
Gomes, A. W., Linton, A. M., & Abate, L. E. (2013) · Journal of Electronic Resources in Medical Libraries · doi:10.1080/15424065.2012.762202 · Cited by 12 · see citing works
Towards the Integration of Medical Informatics Education for Clinicians into the Medical Curriculum
Lungeanu, D., Tractenberg, R. E., Bersan, O. S., & Mihalas, G. I. (2009) · Studies in health technology and informatics · doi:10.3233/978-1-60750-044-5-936 · Cited by 12 · see citing works
Medical informatics in the curriculum: development and delivery of an online elective
Burnette, P., Groote, S. L. D., & Dorsch, J. L. (2012) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.100.1.011 · Cited by 11 · see citing works
Gray, K. M., Dattakumar, A., Maeder, A. J., et al. (2011) · European Journal for Biomedical Informatics · doi:10.24105/ejbi.2011.07.2.7 · Cited by 10 · see citing works
Learning to consult with computers
Liaw, S., & Marty, J. (2001) · Medical Education · doi:10.1046/j.1365-2923.2001.00968.x · Cited by 10 · see citing works
Are students ready for meaningful use?
Ferenchick, G. S., Solomon, D., Mohmand, A., et al. (2013) · Medical Education Online · doi:10.3402/meo.v18i0.22495 · Cited by 10 · see citing works
Using Clinical Vignette Assignments to Teach Medical Informatics
Connor, E. (2003) · Medical Reference Services Quarterly · doi:10.1300/j115v22n04_04 · Cited by 8 · see citing works
Stephens, M. B., & Williams, P. M. (2010) · PubMed · Cited by 6 · see citing works
Multidisciplinary education in medical informatics--a course for medical and informatics students.
Breil, B., Fritz, F., Thiemann, V., et al. (2010) · PubMed · Cited by 6 · see citing works
Medical Informatics Meets Medical Education: the Croatian Experience
Kern, J., & Fišter, K. (2011) · European Journal for Biomedical Informatics · doi:10.24105/ejbi.2011.07.2.8 · Cited by 6 · see citing works
The Introduction of a Medical Informatics Course into a Medical School Curriculum
Schwartz, B. (2011) · Medical Reference Services Quarterly · doi:10.1080/02763869.2011.540216 · Cited by 6 · see citing works
Seago, B. L., Gyore, R., & Williams, S. (2007) · Medical Reference Services Quarterly · doi:10.1300/j115v26n02_01 · Cited by 4 · see citing works
Teaching Medical Informatics to Medical Students - What are the Challenges in a Model Curriculum?
Behrends, M., von Jan, U., Paulmann, V., et al. (2011) · European Journal for Biomedical Informatics · doi:10.24105/ejbi.2011.07.2.4 · Cited by 3 · see citing works
Tien, W. H., Yang, H. K., & Yunn, S. S. (2016) · Educational Research and Reviews · doi:10.5897/err2016.2853 · Cited by 3 · see citing works
Development and evaluation of a Health Record Online Submission Tool (HOST)
Wagner, D. P., Roskos, S. E., DeMuth, R., et al. (2010) · Medical Education Online · doi:10.3402/meo.v15i0.5350 · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [12]WHO guideline: recommendations on digital interventions for health system strengthening: executive summary World Health Organization 2019 2021-07-03 https://apps.who.int/iris/handle/10665/311977 31162915
- [13]Institute of Medicine (US) Committee on Assuring the Health of the Public in the 21st Century The Future of the Public's Health in the 21st Century 2002 Washington (DC) National Academies Press (US) 25057638
Cited by
Sorted by citations
The Digital Health Competencies in Medical Education Framework
Car, J., Ong, Q. C., Erlikh Fox, T., Leightley, D., Kemp, S. J., Švab, I., Tsoi, K. K. F., Sam, A. H., Kent, F. M., Hertelendy, A. J., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.53131 · Cited by 155 · see citing works
Self-citationDigital health competencies in medical school education: a scoping review and Delphi method study
Khurana, M. P., Raaschou-Pedersen, D. E., Kurtzhals, J., Bardram, J. E., Ostrowski, S. R., & Bundgaard, J. S. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03163-7 · Cited by 129 · see citing works
Digital training for building resilience: systematic review, meta-analysis, and meta-regression
Ang, W. H. D., Chew, H. S. J., Dong, J., Yi, H., Mahendren, R., & Lau, Y. (2022) · Stress and Health · doi:10.1002/smi.3154 · Cited by 83 · see citing works
“The lack of physical presence in an online platform has been found to negatively influence a learner's interest and motivation in active participation (Car et al., 2021; Chen & Jang, 2010).”
BackgroundPupic, N., Ghaffari-zadeh, A., Hu, R., Singla, R., Darras, K., Karwowska, A., & Forster, B. B. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000255 · Cited by 79 · see citing works
van Kessel, R., Kyriopoulos, I., Wong, B. L. H., & Mossialos, E. (2023) · Journal of Medical Internet Research · doi:10.2196/42401 · Cited by 49 · see citing works
Tsopra, R., Peiffer-Smadja, N., Charlier, C., Campeotto, F., Lemogne, C., Ruszniewski, P., Vivien, B., & Burgun, A. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104980 · Cited by 42 · see citing works
Dederichs, M., Nitsch, F. J., & Apolinário-Hagen, J. (2022) · JMIR Medical Education · doi:10.2196/32017 · Cited by 16 · see citing works
Sahan, F., Guthardt, L., Panitz, K., Siegel-Kianer, A., Eichhof, I., Schmitt, B. D., & Apolinario-Hagen, J. (2024) · JMIR Medical Education · doi:10.2196/59454 · Cited by 14 · see citing works
Ringeval, M., Raymond, L., Pomey, M.-P., & Paré, G. (2025) · Journal of Medical Internet Research · doi:10.2196/64804 · Cited by 4 · see citing works
- Authors
- Tudor Car, L., Kyaw, B. M., Nannan Panday, R. S., van der Kleij, R., Chavannes, N., Majeed, A., & Car, J.
- Affiliations
- Nanyang Technological University (SG)
- Leiden University Medical Center (NL)
- Imperial College London (GB)
- ORCID
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2021-07-21
- Volume
- 7
- Issue
- 3
- Pages
- e28275
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC8339984
- OpenAlex
- W3184246982
- Cited by
- 106
- References
- 58
- Citations by year
- 2026: 20 · 2025: 18 · 2024: 29 · 2023: 19 · 2022: 19 · 2021: 1
- FWCI
- 3.16
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Leiden Repository (Leiden University) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Funders
- National Institute for Health and Care Research (NIHR202425)
- Department of Health and Social Care
- Imperial College London
- Nanyang Technological University
- Lee Kong Chian School of Medicine, Nanyang Technological University
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Health Sciences › Health Professions › General Health Professions › Health and Medical Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- digital health education, medical students, medical curriculum, medical informatics, blended learning, online learning, virtual patient simulation, course evaluation, learning outcomes, elective courses, COVID-19 pandemic, digital health competencies, assessment methods, massive open online courses, online modules, offline learning, student satisfaction, student attrition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review