Interactive Spaced Education to Assess and Improve Knowledge of Clinical Practice Guidelines: A Randomized Controlled Trial
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
In Brief Objective: To determine whether Interactive Spaced Education (ISE) is an effective and acceptable form of graduate and continuing medical education (GME/CME), using clinical practice guideline (CPG) education as an experimental system. Summary Background Data: ISE is a novel form of online education, which combines the pedagogical merits of the spacing and testing effects. Its efficacy for GME and CME is not known. Methods: One-hundred sixty urologists and 320 urology residents were randomized to 1 of 2 cohorts. We developed and validated 48 ISE items (questions and answers) on 5 urology CPGs (hematuria and priapism [HP]; staghorn calculi, infertility, and antibiotic use [SIA]). Physicians were sent 3 emails a week, each containing 2 questions. Content was repeated 3 times over 20 weeks. Cohort A physicians received the 3-cycle ISE course on HP, with 24 control items on SIA in cycle 3. Cohort B physicians received the 3-cycle ISE course on SIA, with 24 control items on HP in cycle 3. Results: The ISE program was completed by 71% urologists and 83% residents. Cohort A scores on HP increased from mean 44.9% in cycle 1% to 75.7% in cycle 3, a 57% relative increase compared with controls (P < 0.001; Cohen effect size, 2.2). Similarly, cohort B scores on SIA increased from 45.2% in cycle 1% to 69.5% in cycle 3, a 56% relative increase compared with controls (P < 0.001; effect size, 2.2). Eighty-four percent of all participants requested to enroll in further ISE programs. Conclusions: ISE is an effective and well-accepted form of GME and CME and is a promising new methodology to improve CPG knowledge. Interactive spaced education is a novel form of online education that combines the pedagogical merits of the spacing and testing effects. In this randomized trial of 480 urology residents and attending physicians, Interactive Spaced Education was demonstrated to be an effective and well-accepted form of graduate and continuing medical education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · cited 1×
“Rather, testing actually alters the learning process itself to significantly improve knowledge retention.(10,11) Although ISE has been shown to be an effective and wellaccepted form of online education for medical students,(2,6) it is not known whether ISE is similarly effective for graduate medical education (GME) or…”
BackgroundEnhancing learning and retarding forgetting: Choices and consequences
Pashler, H., Rohrer, D., Cepeda, N. J., & Carpenter, S. K. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194050 · Cited by 282 · cited 1×
“The time intervals between ISE cycles were established based on psychology research findings to optimize long-term retention of learning.(17)”
MethodSpacing repetitions over 1 week
Glenberg, A. M., & Lehmann, T. S. (1980) · Memory & Cognition · doi:10.3758/bf03213772 · Cited by 151
Cited by
Gamification of health professions education: a systematic review
van Gaalen, A. E. J., Brouwer, J., Schönrock-Adema, J., Bouwkamp-Timmer, T., Jaarsma, A. D. C., & Georgiadis, J. R. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-020-10000-3 · Cited by 625
Effective in-service training design and delivery: evidence from an integrative literature review
Bluestone, J., Johnson, P., Fullerton, J., Carr, C., Alderman, J., & BonTempo, J. (2013) · Human Resources for Health · doi:10.1186/1478-4491-11-51 · Cited by 329
Simulation technology for resuscitation training: A systematic review and meta-analysis
Mundell, W. C., Kennedy, C. C., Szostek, J. H., & Cook, D. A. (2013) · Resuscitation · doi:10.1016/j.resuscitation.2013.04.016 · Cited by 267
Conceptualising spaced learning in health professions education: A scoping review
Versteeg, M., Hendriks, R. A., Thomas, A., Ommering, B. W. C., & Steendijk, P. (2020) · Medical Education · doi:10.1111/medu.14025 · Cited by 107
Adaptive spaced education improves learning efficiency: A randomized controlled trial
Kerfoot, B. P. (2010) · Journal of Urology · doi:10.1016/j.juro.2009.10.005 · Cited by 81
Self-citation
Metadata
- Authors
- Kerfoot, B. P., Kearney, M. C., Connelly, D., & Ritchey, M. L.
- Venue
- Annals of Surgery
- Published
- 2009-05
- Volume
- 249
- Issue
- 5
- Pages
- 744-749
- ISSN
- 0003-4932 (ISSN-L)
- OpenAlex
- W2008458094
- Cited by
- 98
- References
- 4
- FWCI
- 4.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interactive Spaced Education to Assess and Improve Knowledge of Clinical Practice Guidelines: A Randomized Controlled Trial. https://app.cochat.ai/papers/10.1097/sla.0b013e31819f6db8
- The paper
- Kerfoot, B. P., Kearney, M. C., Connelly, D., & Ritchey, M. L. (2009). Interactive Spaced Education to Assess and Improve Knowledge of Clinical Practice Guidelines: A Randomized Controlled Trial. Annals of Surgery. https://doi.org/10.1097/sla.0b013e31819f6db8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.