A systematic review and meta-analysis of online versus alternative methods for training licensed health care professionals to deliver clinical interventions
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Online training is growing in popularity and yet its effectiveness for training licensed health professionals (HCPs) in clinical interventions is not clear. We aimed to systematically review the literature on the effectiveness of online versus alternative training methods in clinical interventions for licensed Health Care Professionals (HCPs) on outcomes of knowledge acquisition, practical skills, clinical behaviour, self-efficacy and satisfaction. METHODS: Seven databases were searched for randomised controlled trials (RCTs) from January 2000 to June 2015. Two independent reviewers rated trial quality and extracted trial data. Comparative effects were summarised as standardised mean differences (SMD) and 95% confidence intervals. Pooled effect sizes were calculated using a random-effects model for three contrasts of online versus (i) interactive workshops (ii) taught lectures and (iii) written/electronic manuals. RESULTS: We included 14 studies with a total of 1089 participants. Most trials studied medical professionals, used a workshop or lecture comparison, were of high risk of bias and had small sample sizes (range 21-183). Using the GRADE approach, we found low quality evidence that there was no difference between online training and an interactive workshop for clinical behaviour SMD 0.12 (95% CI -0.13 to 0.37). We found very low quality evidence of no difference between online methods and both a workshop and lecture for knowledge (workshop: SMD 0.04 (95% CI -0.28 to 0.36); lecture: SMD 0.22 (95% CI: -0.08, 0.51)). Lastly, compared to a manual (n = 3/14), we found very low quality evidence that online methods were superior for knowledge SMD 0.99 (95% CI 0.02 to 1.96). There were too few studies to draw any conclusions on the effects of online training for practical skills, self-efficacy, and satisfaction across all contrasts. CONCLUSIONS: It is likely that online methods may be as effective as alternative methods for training HCPs in clinical interventions for the outcomes of knowledge and clinical behaviour. However, the low quality of the evidence precludes drawing firm conclusions on the relative effectiveness of these training methods. Moreover, the confidence intervals around our effect sizes were large and could encompass important differences in effectiveness. More robust, adequately powered RCTs are needed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563 · cited 1×
“Evidence has shown that observational study designs can offer important and unbiased findings in clinical and education research [33, 34].”
BackgroundBeidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.106 · Cited by 628
Cook, D. A., Bordage, G., & Schmidt, H. G. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02974.x · Cited by 472
Web-based learning: pros, cons and controversies
Cook, D. A. (2007) · Clinical Medicine · doi:10.7861/clinmedicine.7-1-37 · Cited by 437
The promise and pitfalls of the internet for cognitive behavioral therapy
Andersson, G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-82 · Cited by 114 · cited 1×
“due to geographical factors and restricted class sizes [3, 4].”
Background
Cited by
Pei, L., & Wu, H. (2019) · Medical Education Online · doi:10.1080/10872981.2019.1666538 · Cited by 852
“[8] then updated the evidence in this rapidly developing field by subdividing different formats of offline learning and comparing these formats to online learning.”
BackgroundLearning and Satisfaction in Webinar, Online, and Face-to-Face Instruction: A Meta-Analysis
Ebner, C., & Gegenfurtner, A. (2019) · Frontiers in Education · doi:10.3389/feduc.2019.00092 · Cited by 213
Surr, C. A., Parveen, S., Smith, S. J., Drury, M., Sass, C., Burden, S., & Oyebode, J. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05382-4 · Cited by 70
Metadata
- Authors
- Richmond, H., Copsey, B., Hall, A. M., Davies, D., & Lamb, S. E.
- Venue
- BMC Medical Education
- Published
- 2017-11-23
- Volume
- 17
- Issue
- 1
- Pages
- 227-227
- ISSN
- 1472-6920 (ISSN-L)
- OpenAlex
- W2770677240
- Cited by
- 138
- References
- 8
- FWCI
- 1.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic review and meta-analysis of online versus alternative methods for training licensed health care professionals to deliver clinical interventions. https://app.cochat.ai/papers/10.1186/s12909-017-1047-4
- The paper
- Richmond, H., Copsey, B., Hall, A. M., Davies, D., & Lamb, S. E. (2017). A systematic review and meta-analysis of online versus alternative methods for training licensed health care professionals to deliver clinical interventions. BMC Medical Education. https://doi.org/10.1186/s12909-017-1047-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.