CoChat

Effectiveness of Digital Education on Communication Skills Among Medical Students: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

Open access
Kyaw, Bhone Myint, Posadzki, Pawel, Paddock, Sophie, Car, Josip, Campbell, James, Tudor Car, Lorainne · 2019 · Journal of Medical Internet Research

Published version of a preprint

The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.

Abstract

Background: Effective communication skills are essential in diagnosis and treatment processes and in building the doctor-patient relationship. Objective: Our aim was to evaluate the effectiveness of digital education in medical students for communication skills development. Broadly, we assessed whether digital education could improve the quality of future doctors’ communication skills. Methods: We performed a systematic review and searched seven electronic databases and two trial registries for randomized controlled trials (RCTs) and cluster RCTs (cRCTs) published between January 1990 and September 2018. Two reviewers independently screened the citations, extracted data from the included studies, and assessed the risk of bias. We also assessed the quality of evidence using the Grading of Recommendations, Assessment, Development, and Evaluations assessment (GRADE). Results: We included 12 studies with 2101 medical students, of which 10 were RCTs and two were cRCTs. The digital education included online modules, virtual patient simulations, and video-assisted oral feedback. The control groups included didactic lectures, oral feedback, standard curriculum, role play, and no intervention as well as less interactive forms of digital education. The overall risk of bias was high, and the quality of evidence ranged from moderate to very low. For skills outcome, meta-analysis of three studies comparing digital education to traditional learning showed no statistically significant difference in postintervention skills scores between the groups (standardized mean difference [SMD]=–0.19; 95% CI –0.9 to 0.52; I2=86%, N=3 studies [304 students]; small effect size; low-quality evidence). Similarly, a meta-analysis of four studies comparing the effectiveness of blended digital education (ie, online or offline digital education plus traditional learning) and traditional learning showed no statistically significant difference in postintervention skills between the groups (SMD=0.15; 95% CI –0.26 to 0.56; I2=86%; N=4 studies [762 students]; small effect size; low-quality evidence). The additional meta-analysis of four studies comparing more interactive and less interactive forms of digital education also showed little or no difference in postintervention skills scores between the two groups (SMD=0.12; 95% CI: –0.09 to 0.33; I2=40%; N=4 studies [893 students]; small effect size; moderate-quality evidence). For knowledge outcome, two studies comparing the effectiveness of blended online digital education and traditional learning reported no difference in postintervention knowledge scores between the groups (SMD=0.18; 95% CI: –0.2 to 0.55; I2=61%; N=2 studies [292 students]; small effect size; low-quality evidence). The findings on attitudes, satisfaction, and patient-related outcomes were limited or mixed. None of the included studies reported adverse outcomes or economic evaluation of the interventions. Conclusions: We found low-quality evidence showing that digital education is as effective as traditional learning in medical students’ communication skills training. Blended digital education seems to be at least as effective as and potentially more effective than traditional learning for communication skills and knowledge. We also found no difference in postintervention skills between more and less interactive forms of digital education. There is a need for further research to evaluate the effectiveness of other forms of digital education such as virtual reality, serious gaming, and mobile learning on medical students’ attitude, satisfaction, and patient-related outcomes as well as the adverse effects and cost-effectiveness of digital education.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/12967

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram. RCT: randomized controlled trial.
Figure 1 Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram. RCT: randomized controlled trial.CC BY · PubMed Central
Figure 2 Risk of bias summary: review authors’ judgements about each risk of bias item for each included study.
Figure 2 Risk of bias summary: review authors’ judgements about each risk of bias item for each included study.CC BY · PubMed Central
Figure 3 Forest plot of studies comparing digital education with traditional learning for postintervenion skill outcome, IV: inverse variance; random: random effect model.
Figure 3 Forest plot of studies comparing digital education with traditional learning for postintervenion skill outcome, IV: inverse variance; random: random effect model.CC BY · PubMed Central
Figure 4 Forest plot of studies comparing blended digital education with traditional learning for postintervention skill outcome. IV: inverse variance; random: random effect model; DE: digital education.
Figure 4 Forest plot of studies comparing blended digital education with traditional learning for postintervention skill outcome. IV: inverse variance; random: random effect model; DE: digital education.CC BY · PubMed Central
Figure 5 Forest plot of studies comparing blended online digital education with traditional learning for postintervenion knowledge outcome. IV: inverse variance; random: random effect model; DE: digital education.
Figure 5 Forest plot of studies comparing blended online digital education with traditional learning for postintervenion knowledge outcome. IV: inverse variance; random: random effect model; DE: digital education.CC BY · PubMed Central
Figure 6 Forest plot of studies comparing digital education (more interactive) with digital education (less interactive) for postintervention skills outcome. IV: inverse variance; random: random effect model; DE: digital education.
Figure 6 Forest plot of studies comparing digital education (more interactive) with digital education (less interactive) for postintervention skills outcome. IV: inverse variance; random: random effect model; DE: digital education.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 39 references

Research works printed but not linked: 6

  1. Wong, SYS, 2006, Hong Kong Med Diary, 11, 7
  2. Martínez Otero, JM, 2012, Cuad Bioet, 23, 151
  3. Strasser, F, 2012, Oncology (Williston Park), 26, 56, 62, 64
  4. Maeland, JG, 1993, Tidsskr Nor Laegeforen, 113, 47
  5. Gramma, R, 2013, Rev Med Chir Soc Med Nat Iasi, 117, 172
  6. Lee, A, 2015, Fam Med, 47, 302

Cited by

See all 257

Metadata

Authors
Kyaw, B. M., Posadzki, P., Paddock, S., Car, J., Campbell, J., & Tudor Car, L.
Affiliations
  • Nanyang Technological University (SG)
  • Norfolk and Norwich University Hospital (GB)
  • World Health Organization (CH)
Venue
Journal of Medical Internet Research
Published
2019-08-27
Volume
21
Issue
8
Pages
e12967
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2958402157
Cited by
257
References
38
Citations by year
2026: 31 · 2025: 25 · 2024: 59 · 2023: 46 · 2022: 37 · 2021: 42 · 2020: 14 · 2019: 3
FWCI
3.91
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
Funders
  • World Health Organization
  • Nanyang Technological University
  • Karolinska Institutet
Topics
  • Social Sciences › Education › Innovations in Medical Education
  • Social Sciences › Education › Simulation-Based Education in Healthcare
  • Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
Keywords
digital health education, communication skills, medical students, physician-patient communication, virtual patient simulation, online modules, blended learning, verbal feedback, medical education, physician-patient relationship, knowledge outcomes, risk of bias, quality of evidence, GRADE, confidence intervals, heterogeneous effects, risk of bias assessment
MeSH terms
Communication, Female, Humans, Male, Students, Medical, Telemedicine, Education, Distance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.