The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Instructional Design Variations in Internet-Based Learning for Health Professions Education: A Systematic Review and Meta-Analysis
Abstract
PURPOSE: A recent systematic review (2008) described the effectiveness of Internet-based learning (IBL) in health professions education. A comprehensive synthesis of research investigating how to improve IBL is needed. This systematic review sought to provide such a synthesis. METHOD: The authors searched MEDLINE, CINAHL, EMBASE, Web of Science, Scopus, ERIC, TimeLit, and the University of Toronto Research and Development Resource Base for articles published from 1990 through November 2008. They included all studies quantifying the effect of IBL compared with another Internet-based or computer-assisted instructional intervention on practicing and student physicians, nurses, pharmacists, dentists, and other health professionals. Reviewers working independently and in duplicate abstracted information, coded study quality, and grouped studies according to inductively identified themes. RESULTS: From 2,705 articles, the authors identified 51 eligible studies, including 30 randomized trials. The pooled effect size (ES) for learning outcomes in 15 studies investigating high versus low interactivity was 0.27 (95% confidence interval, 0.08-0.46; P = .006). Also associated with higher learning were practice exercises (ES 0.40 [0.08-0.71; P = .01]; 10 studies), feedback (ES 0.68 [0.01-1.35; P = .047]; 2 studies), and repetition of study material (ES 0.19 [0.09-0.30; P < .001]; 2 studies). The ES was 0.26 (-0.62 to 1.13; P = .57) for three studies examining online discussion. Inconsistency was large (I(2) >or=89%) in most analyses. Meta-analyses for other themes generally yielded imprecise results. CONCLUSIONS: Interactivity, practice exercises, repetition, and feedback seem to be associated with improved learning outcomes, although inconsistency across studies tempers conclusions. Evidence for other instructional variations remains inconclusive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
(2014) · Medical Entomology and Zoology · Cited by 17,633
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Self-citationThe Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Reconsidering Research on Learning from Media
Clark, R. E. (1983) · Review of Educational Research · doi:10.3102/00346543053004445 · Cited by 2,715
Research works printed but not linked: 17
- Kirkpatrick, 1996, Training Dev, 50, 54
- Kaplan, 1996, Am J Pharm Educ, 60, 422, 10.1016/S0002-9459(24)04687-4 · doi:10.1016/s0002-9459(24)04687-4
- Chan, 1999, MD Comput, 16, 54
- Jedlicka, 2002, J Allied Health, 31, 247
- Chao, 2003, J Telemed Telecare, 9, S4, 10.1258/135763303322196141 · doi:10.1258/135763303322196141
- Lemaire, 2003, J Telemed Telecare, 9, 17, 10.1258/135763303321159648 · doi:10.1258/135763303321159648
- Spickard, 2004, Med Educ, 38, 787, 10.1111/j.1365-2929.2004.01824.x · doi:10.1111/j.1365-2929.2004.01824.x
- Virvou, 2004, 1, 48
- Becker, 2005, J Allied Health, 34, 169
- Brunetaud, 2005, Int J Med Inform, 74, 209, 10.1016/j.ijmedinf.2004.06.006 · doi:10.1016/j.ijmedinf.2004.06.006
- Schittek Janda, 2005, Eur J Dent Educ, 9, 53, 10.1111/j.1600-0579.2004.00366.x · doi:10.1111/j.1600-0579.2004.00366.x
- Blackmore, 2006, Int J Psychother, 10, 35
- Kerfoot, 2006, Med Educ, 40, 1137, 10.1111/j.1365-2929.2006.02588.x · doi:10.1111/j.1365-2929.2006.02588.x
- Al-Rawi, 2007, Dentomaxillofac Radiol, 36, 459, 10.1259/dmfr/25560514 · doi:10.1259/dmfr/25560514
- Bergeron, 2008, Stud Health Technol Inform, 132, 26
- Walker, 2008, Educ Gerontol, 34, 691, 10.1080/03601270802055778 · doi:10.1080/03601270802055778
- Dillon, 1998, Rev Educ Res, 68, 322, 10.3102/00346543068003322 · doi:10.3102/00346543068003322 · Paper page
Cited by
Cook, D. A., & Reed, D. A. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000786 · Cited by 781
Self-citationRegmi, K., & Jones, L. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02007-6 · Cited by 751
Cook, D. A., Hamstra, S. J., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hatala, R. (2013) · Medical Teacher · doi:10.3109/0142159x.2012.714886 · Cited by 709
Self-citationBaticulon, R. E., Sy, J. J., Alberto, N. R. I., Baron, M. B. C., Mabulay, R. E. C., Rizada, L. G. T., Tiu, C. J. S., Clarion, C. A., & Reyes, J. C. B. (2021) · Medical Science Educator · doi:10.1007/s40670-021-01231-z · Cited by 706
The Effectiveness of Blended Learning in Health Professions: Systematic Review and Meta-Analysis
Liu, Q., Peng, W., Zhang, F., Hu, R., Li, Y., & Yan, W. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4807 · Cited by 691
Metadata
- Authors
- Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M.
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-05
- Volume
- 85
- Issue
- 5
- Pages
- 909-922
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W2085403719
- Cited by
- 547
- References
- 82
- FWCI
- 4.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Instructional Design Variations in Internet-Based Learning for Health Professions Education: A Systematic Review and Meta-Analysis. https://app.cochat.ai/papers/10.1097/acm.0b013e3181d6c319
- The paper
- Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2010). Instructional Design Variations in Internet-Based Learning for Health Professions Education: A Systematic Review and Meta-Analysis. Academic Medicine. https://doi.org/10.1097/acm.0b013e3181d6c319
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.