Effectiveness of Digital Education on Communication Skills Among Medical Students: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration
Open accessPublished version of a preprint
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Background: Effective communication skills are essential in diagnosis and treatment processes and in building the doctor-patient relationship. Objective: Our aim was to evaluate the effectiveness of digital education in medical students for communication skills development. Broadly, we assessed whether digital education could improve the quality of future doctors’ communication skills. Methods: We performed a systematic review and searched seven electronic databases and two trial registries for randomized controlled trials (RCTs) and cluster RCTs (cRCTs) published between January 1990 and September 2018. Two reviewers independently screened the citations, extracted data from the included studies, and assessed the risk of bias. We also assessed the quality of evidence using the Grading of Recommendations, Assessment, Development, and Evaluations assessment (GRADE). Results: We included 12 studies with 2101 medical students, of which 10 were RCTs and two were cRCTs. The digital education included online modules, virtual patient simulations, and video-assisted oral feedback. The control groups included didactic lectures, oral feedback, standard curriculum, role play, and no intervention as well as less interactive forms of digital education. The overall risk of bias was high, and the quality of evidence ranged from moderate to very low. For skills outcome, meta-analysis of three studies comparing digital education to traditional learning showed no statistically significant difference in postintervention skills scores between the groups (standardized mean difference [SMD]=–0.19; 95% CI –0.9 to 0.52; I2=86%, N=3 studies [304 students]; small effect size; low-quality evidence). Similarly, a meta-analysis of four studies comparing the effectiveness of blended digital education (ie, online or offline digital education plus traditional learning) and traditional learning showed no statistically significant difference in postintervention skills between the groups (SMD=0.15; 95% CI –0.26 to 0.56; I2=86%; N=4 studies [762 students]; small effect size; low-quality evidence). The additional meta-analysis of four studies comparing more interactive and less interactive forms of digital education also showed little or no difference in postintervention skills scores between the two groups (SMD=0.12; 95% CI: –0.09 to 0.33; I2=40%; N=4 studies [893 students]; small effect size; moderate-quality evidence). For knowledge outcome, two studies comparing the effectiveness of blended online digital education and traditional learning reported no difference in postintervention knowledge scores between the groups (SMD=0.18; 95% CI: –0.2 to 0.55; I2=61%; N=2 studies [292 students]; small effect size; low-quality evidence). The findings on attitudes, satisfaction, and patient-related outcomes were limited or mixed. None of the included studies reported adverse outcomes or economic evaluation of the interventions. Conclusions: We found low-quality evidence showing that digital education is as effective as traditional learning in medical students’ communication skills training. Blended digital education seems to be at least as effective as and potentially more effective than traditional learning for communication skills and knowledge. We also found no difference in postintervention skills between more and less interactive forms of digital education. There is a need for further research to evaluate the effectiveness of other forms of digital education such as virtual reality, serious gaming, and mobile learning on medical students’ attitude, satisfaction, and patient-related outcomes as well as the adverse effects and cost-effectiveness of digital education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous meta-analyses have shown that compared to traditional education (eg, lectures, reading exercises, in-class group discussions, mannequins, SPs), digital education is at least as effective in training medical students’ communication skills [15]”
From Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials (2024) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Compared to conventional simulations (eg, mannequins and SPs), VSs can be undertaken flexibly with no limit of time and space [15]”
From Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials (2024) · cites this paper as [15]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Cook, D. A., Hatala, R., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hamstra, S. J. (2011) · JAMA · doi:10.1001/jama.2011.1234 · Cited by 2,170
Kyaw, B. M., Saxena, N., Posadzki, P., Vseteckova, J., Nikolaou, C. K., George, P. P., Divakar, U., Masiello, I., Kononowicz, A. A., Zary, N., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/12959 · Cited by 859
Self-citation“Best Practice” for Patient-Centered Communication: A Narrative Review
King, A., & Hoppe, R. B. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-13-00072.1 · Cited by 577
The cognitive benefits of interactive videos: learning to tie nautical knots
Schwan, S., & Riempp, R. (2004) · Learning and Instruction · doi:10.1016/j.learninstruc.2004.06.005 · Cited by 483 · cited 1×
““Interactivity” referred to “the degree of control or adaptiveness a user might have with a system, without necessarily having to give a response” [22], and we applied this definition of “interactivity” throughout the review.”
George, P. P., Papachristou, N., Belisario, J. M., Wang, W., Wark, P. A., Cotic, Z., Rasmussen, K., Sluiter, R., Riboli–Sasco, E., Car, L. T., et al. (2014) · Journal of Global Health · doi:10.7189/jogh.04.010406 · Cited by 456
Self-citationPuffer, S., Torgerson, D., & Watson, J. (2003) · BMJ · doi:10.1136/bmj.327.7418.785 · Cited by 351
The use of elearning in medical education: a review of the current situation
Choules, A. P. (2007) · Postgraduate Medical Journal · doi:10.1136/pgmj.2006.054189 · Cited by 306 · cited 1×
“For educators, digital education offers the potential to free up time, save manpower and space resources, automate evaluation and documentation of students’ progress, and receive feedback from the students [19].”
Research works printed but not linked: 6
- Wong, SYS, 2006, Hong Kong Med Diary, 11, 7
- Martínez Otero, JM, 2012, Cuad Bioet, 23, 151
- Strasser, F, 2012, Oncology (Williston Park), 26, 56, 62, 64
- Maeland, JG, 1993, Tidsskr Nor Laegeforen, 113, 47
- Gramma, R, 2013, Rev Med Chir Soc Med Nat Iasi, 117, 172
- Lee, A, 2015, Fam Med, 47, 302
Cited by
Sallam, M., Salim, N., Barakat, M., & Al-Tammemi, A. (2023) · Narra J · doi:10.52225/narra.v3i1.103 · Cited by 331
“The advantages of digital education (e-learning) as well as the benefits of incorporating digital literacy in healthcare education has been advocated for years [32-35].”
BackgroundTudor Car, L., Kyaw, B. M., Dunleavy, G., Smart, N. A., Semwal, M., Rotgans, J. I., Low-Beer, N., & Campbell, J. (2019) · Journal of Medical Internet Research · doi:10.2196/12945 · Cited by 173
Self-citationDigital Education in Health Professions: The Need for Overarching Evidence Synthesis
Car, J., Carlstedt-Duke, J., Tudor Car, L., Posadzki, P., Whiting, P., Zary, N., Atun, R., Majeed, A., Campbell, J., & Digital Health Education Collaboration (2019) · Journal of Medical Internet Research · doi:10.2196/12913 · Cited by 166
Self-citationStamer, T., Steinhäuser, J., & Flägel, K. (2023) · Journal of Medical Internet Research · doi:10.2196/43311 · Cited by 160
Interventions for improving medical students' interpersonal communication in medical consultations
Gilligan, C., Powell, M., Lynagh, M. C., Ward, B. M., Lonsdale, C., Harvey, P., James, E. L., Rich, D., Dewi, S. P., Nepal, S., et al. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012418.pub2 · Cited by 139
Metadata
- Authors
- Kyaw, B. M., Posadzki, P., Paddock, S., Car, J., Campbell, J., & Tudor Car, L.
- Affiliations
- Nanyang Technological University (SG)
- Norfolk and Norwich University Hospital (GB)
- World Health Organization (CH)
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-08-27
- Volume
- 21
- Issue
- 8
- Pages
- e12967
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6764329
- OpenAlex
- W2958402157
- Cited by
- 257
- References
- 38
- Citations by year
- 2026: 31 · 2025: 25 · 2024: 59 · 2023: 46 · 2022: 37 · 2021: 42 · 2020: 14 · 2019: 3
- FWCI
- 3.91
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
- Funders
- World Health Organization
- Nanyang Technological University
- Karolinska Institutet
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Simulation-Based Education in Healthcare
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Keywords
- digital health education, communication skills, medical students, physician-patient communication, virtual patient simulation, online modules, blended learning, verbal feedback, medical education, physician-patient relationship, knowledge outcomes, risk of bias, quality of evidence, GRADE, confidence intervals, heterogeneous effects, risk of bias assessment
- MeSH terms
- Communication, Female, Humans, Male, Students, Medical, Telemedicine, Education, Distance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.