Effectiveness of the spaced education pedagogy for clinicians’ continuing professional development: a systematic review
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Context: Ensuring clinical practice reflects current evidence is challenging given the rapid proliferation of new knowledge. Changing entrenched clinical behaviours and facilitating the adoption of best practice evidence requires a range of strategies, including affordable, scalable and effective continuing professional development (CPD). Yet, identifying the CPD delivery method most likely to effectively change and improve patient outcomes is difficult given the variability in the evidence for different learning approaches. Although there is moderate level evidence for outreach education, audit and feedback, and face‐to‐face or online learning, little is known about the capacity of spaced education to change ineffective clinical practice(s). Spaced education harnesses the power of spacing, repetition and testing learning content to increase topic‐specific knowledge. Although spaced education is widely used in undergraduate and postgraduate medical programmes, its effectiveness as a CPD delivery method that improves patient outcomes is less certain. Aim: To determine the effectiveness of the spaced education CPD programmes to change targeted clinical knowledge and practice(s) to improve patient outcomes. Method: A systematic review, appraising the spaced education CPD evidence generated from searching six specialist medical and psychosocial databases. Studies published in English peer‐reviewed journals from 1 January, 2000 to 31 August, 2018 were eligible for inclusion. A modified Kirkpatrick four levels of evaluation framework assisted with appraising the effect of spaced education CPD interventions on clinicians and patients. Results: Of the 2396 studies identified, 17 met the inclusion criteria, involving 2701 practising clinicians from multiple disciplines and specialties. Five randomised controlled trials generated level II evidence, with the remaining 12 studies generating lower levels of evidence. The majority of studies ( n = 14) involved the delivery of online spaced education. All studies were evaluated using the modified Kirkpatrick four levels of evaluation framework with: 10 studies demonstrating significant increases in participants’ knowledge; seven studies reporting significant changes in clinician behaviour; four studies showing significant increases in clinician confidence; and three studies identifying significant and sustained increases in participants’ clinical skills. Only two studies reported positive improvements in patient outcomes. Conclusion: Spaced education via an online platform offers a scalable CPD format that can increase clinical knowledge and change practice. However, further adequately powered randomised controlled trials are required to confirm that spaced education CPD can impact positively on patients’ reported outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Cane, J., O’Connor, D., & Michie, S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-37 · Cited by 4,888
From best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Davis, D., O'Brien, M. A. T., Freemantle, N., Wolf, F. M., Mazmanian, P., & Taylor-Vaisey, A. (1999) · JAMA · doi:10.1001/jama.282.9.867 · Cited by 2,364
Forsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Educational outreach visits: effects on professional practice and health care outcomes
O'Brien, M. A., Rogers, S., Jamtvedt, G., Oxman, A. D., Odgaard-Jensen, J., Kristoffersen, D. T., Forsetlund, L., Bainbridge, D., Freemantle, N., Davis, D., et al. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000409.pub2 · Cited by 1,279
Cited by
Pollock, D., Davies, E. L., Peters, M. D. J., Tricco, A. C., Alexander, L., McInerney, P., Godfrey, C. M., Khalil, H., & Munn, Z. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14743 · Cited by 769
“(Phillips et al., 2019, p. 888), ‘What is the nature of the evidence relevant to the provision of mental health interventions by midwives?’”
BackgroundSamuel, A., Cervero, R. M., Durning, S. J., & Maggio, L. A. (2021) · Academic Medicine · doi:10.1097/acm.0000000000003899 · Cited by 147
Conceptualising spaced learning in health professions education: A scoping review
Versteeg, M., Hendriks, R. A., Thomas, A., Ommering, B. W. C., & Steendijk, P. (2020) · Medical Education · doi:10.1111/medu.14025 · Cited by 107
Spaced education and student learning: Results from a medical school
Chugh, P. K., & Tripathi, C. (2020) · The Clinical Teacher · doi:10.1111/tct.13180 · Cited by 23
Gupta, S., Ojeh, N., Sa, B., Majumder, M. A. A., Singh, K., & Adams, O. P. (2020) · Advances in Medical Education and Practice · doi:10.2147/amep.s267834 · Cited by 23
Metadata
- Authors
- Phillips, J. L., Heneka, N., Bhattarai, P., Fraser, C., & Shaw, T.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2019-05-29
- Volume
- 53
- Issue
- 9
- Pages
- 886-902
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2947399126
- Cited by
- 120
- References
- 17
- FWCI
- 2.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.