The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Web-based Learning: Sound Educational Method or Hype? A Review of the Evaluation Literature
Abstract
The first reports of Web-based medical education appear in 1992,1 building on 30 years of computer-assisted instruction. Proponents claimed computer-assisted instruction is superior to text-based, lecture, and traditional educational methods for reasons that include control by the learner over content, time, and place of learning2; enhancement of learning, reasoning, and efficiency3,4; and cost savings.5 Many studies that reported advantages contained methodologic flaws6 and reported advantages unrelated to computer-specific features.7 Web-based learning (WBL) represents a further evolution of computer-assisted instruction. Technical advantages of WBL include universal accessibility, ease in updating content, and hyperlink functions that permit cross-referencing to other resources.8 These technical advances, specifically hyperlink and searching capabilities, fit the constructivist learning theory, where learners search out and create their own knowledge bases. However, as was evident with computer-assisted instruction, potential advantages may not translate into significant improvements in educational outcomes. With the widespread adoption of WBL, it is critical that medical educators have evidence regarding its performance as a learning medium. This paper reviews the medical, dental, and nursing WBL evaluation literature to: (1) identify which facets of WBL have been evaluated, (2) describe the evaluation strategies used, (3) synthesize the findings, and (4) discuss educational implications and future research directions. Method We searched Medline and ERIC for “Computer-assisted Instruction” and “Internet or World Wide Web” and “Education, continuing or Education, dental, or Education, medical, or Education, nursing” from 1966 to January 2002, limited to English language. Having selected articles from their abstracts, two authors independently applied the criteria in Figure 1 to classify each article as descriptive or evaluative. If the abstract was unavailable or lacked sufficient information, the article was reviewed. When the two authors disagreed, the third author broke the tie.Figure 1: Literature review and selection of articles for review.We categorized the WBL articles by evaluation domains. Where possible, we divided studies into those evaluating features specific to the Web medium versus those specific to educational content. We determined percentages of descriptive and evaluative studies, identified evaluation domains, described evaluation strategies, and synthesized the findings. The small number of studies and heterogeneity of study designs and participants precluded combining the data by meta-analysis. Results and Discussion We identified 206 WBL papers between 1992 and 2001 in Medline and ERIC. As shown in Figure 1, 76 met our criteria for inclusion, 41 (59%) being descriptive and 35 (46%) evaluative. The two authors agreed on this classification for 71 of 76 papers (kappa = 0.869, p < .001). In the five case of disagreement, the third author classified one study as descriptive and four as evaluative. From the 35 evaluation papers, we identified four domains: knowledge gains, learner attitudes, learning efficiency, and program cost. We divided studies of learner attitudes into those evaluating Web-specific and content-specific attributes. We could not similarly divide studies measuring knowledge gains due to multiple confounding educational influences in all but two studies.9,10Table 1 depicts the evaluation domains, keywords used to describe the focus of the investigation, and the number of studies in each category.TABLE 1: Keywords and Numbers of Studies in Evaluation Domains of 31 Web-based Learning StudiesDomain 1: Studies Evaluating Knowledge Gains Twenty studies evaluated knowledge gains with WBL interventions. Eighteen measured changes in multiple-choice test scores; one used a written case analysis; and one, a multiple-choice test plus a standardized patient interview. Research methods included pretest/post-test self-controlled studies, self-selected controlled studies, assigned (non-randomized) controlled studies, assigned crossover trials, and randomized controlled trials. The most common research design was a pretest/posttest self-controlled study, but there were several randomized controlled trials (see Appendix Table A). The pretest/posttest studies provided strong evidence that WBL interventions resulted in knowledge gains in medical students, practicing physicians, and dentists.11,12,13,14,15 However, studies without a control group cannot separate Web-specific from content-specific learning gains.Table: APPENDIX TABLE A. Studies Evaluating Knowledge Gains with WBL Interventions, Classified by Study DesignStudies where a WBL group and a control group received identical educational content allowed identification of learning gains attributable specifically to the Web medium. Studies that met this criterion demonstrated no difference in knowledge gains between groups.16,17,18,19
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reconsidering Research on Learning from Media
Clark, R. E. (1983) · Review of Educational Research · doi:10.3102/00346543053004445 · Cited by 2,715
Bell, D. S., Fonarow, G. C., Hays, R. D., & Mangione, C. M. (2000) · Annals of Internal Medicine · doi:10.7326/0003-4819-132-12-200006200-00003 · Cited by 153
Computer-Assisted Learning and Evaluation in Medicine
Piemme, T. E. (1988) · JAMA · doi:10.1001/jama.1988.03410030083033 · Cited by 147
Comparison of internet versus lecture instructional methods for teaching nursing research
Woo, M. A., & Kimmick, J. V. (2000) · Journal of Professional Nursing · doi:10.1053/pn.2000.5919 · Cited by 135
Harris, J. M., Salasche, S. J., & Harris, R. B. (2001) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2001.00615.x · Cited by 98
Kronz, J. D., Silberman, M. A., Allsbrook, W. C., & Epstein, J. I. (2000) · PubMed · Cited by 86
The inadequacy of recent research on computer-assisted instruction
Keane, D. R., Norman, G. R., & Vickers, J. (1991) · Academic Medicine · doi:10.1097/00001888-199108000-00005 · Cited by 86
Curran, V. R., Hoekman, T. B., Gulliver, W. P. F., Landells, I. D. R., & Hatcher, L. (2000) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340200207 · Cited by 85
MedEthEx Online: A Computer-Based Learning Program in Medical Ethics and Communication Skills
Fleetwood, J., Vaught, W., Feldman, D., Gracely, E. J., Kassutto, Z., & Novack, D. H. (2000) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1202_7 · Cited by 83
Technology Is The Tool, Teaching Is The Task: Student Satisfaction In Distance Learning
DeBourgh, G. A. (1999) · Society for Information Technology & Teacher Education International Conference · Cited by 74
Research works printed but not linked: 28
- 1992, Ann NY Acad Sci, 670, 43, 10.1111/j.1749-6632.1992.tb26073.x · doi:10.1111/j.1749-6632.1992.tb26073.x
- Clayden, 1988, Med Educ, 22, 456, 10.1111/j.1365-2923.1988.tb00783.x · doi:10.1111/j.1365-2923.1988.tb00783.x
- Bolwell, 1993, Decubitus, 6, 20
- Haag, 1999, Int J Med Inform, 53, 79, 10.1016/S1386-5056(98)00118-X · doi:10.1016/s1386-5056(98)00118-x
- Engel, 1997, Diabetes Educator, 23, 545, 10.1177/014572179702300505 · doi:10.1177/014572179702300505
- Francis, 2000, J Cont Educ Health Prof, 20, 76, 10.1002/chp.1340200203 · doi:10.1002/chp.1340200203
- Harris, 2001, J Gen Intern Med, 16, 50
- Kronz, 2000, Cancer, 89, 1818, 10.1002/1097-0142(20001015)89:8<1818::AID-CNCR23>3.0.CO;2-J · doi:10.1002/1097-0142(20001015)89:8<1818::aid-cncr23>3.0.co;2-j
- Sakowski, 2001, Acad Med, 76, 547, 10.1097/00001888-200105000-00090 · doi:10.1097/00001888-200105000-00090
- Cho, 1998, Medinfo, 9, t
- Fulkerson, 1999, Acad Med, 74, 576, 10.1097/00001888-199905000-00041 · doi:10.1097/00001888-199905000-00041
- Yucha, 2000, J Nurs Educ, 39, 68, 10.3928/0148-4834-20000201-08 · doi:10.3928/0148-4834-20000201-08
- Balcezak, 1998, J Biocommunication, 25, 2
- Chan, 1999, MD Comput, 16, 54
- Perryer, 2000, Eur J Dent Educ, 4, 118, 10.1034/j.1600-0579.2000.040305.x · doi:10.1034/j.1600-0579.2000.040305.x
- Lipman, 2001, Acad Med, 76, 1060, 10.1097/00001888-200110000-00018 · doi:10.1097/00001888-200110000-00018
- Mehta, 1998, J Cancer Educ, 13, 197
- Agius, 1998, Occup Med, 48, 337, 10.1093/occmed/48.5.337 · doi:10.1093/occmed/48.5.337
- Hashiba, 2000, Med Inform Internet Med, 25, 239, 10.1080/146392300455549 · doi:10.1080/146392300455549
- Sekikawa, 2001, Public Health, 115, 152, 10.1016/S0033-3506(01)00435-8 · doi:10.1016/s0033-3506(01)00435-8
- Horsch, 2000, Int J Med Inform, 58-, 39, 10.1016/S1386-5056(00)00074-5 · doi:10.1016/s1386-5056(00)00074-5
- Rose, 2000, Comput Nurs, 18, 162
- Thornam, 2001, Techtrends, 45, 34, 10.1007/BF02763375 · doi:10.1007/bf02763375
- Thiele, 1999, Nurs Health Care Perspect, 20, 199
- McNulty, 2000, Acad Med, 75, 59, 10.1097/00001888-200001000-00016 · doi:10.1097/00001888-200001000-00016
- Letterie, 1996, Fertil Steril, 65, 883, 10.1016/S0015-0282(16)58234-X · doi:10.1016/s0015-0282(16)58234-x
- Stillman, 1999, Innovations Educ Training Int, 36, 17, 10.1080/1355800990360104 · doi:10.1080/1355800990360104
- Cimino, 1995, ProceedingsAnnual Symposium on Computer Applications in Medical Care, 493-, 7
Cited by
The Impact of E-Learning in Medical Education
Ruiz, J. G., Mintzer, M. J., & Leipzig, R. M. (2006) · Academic Medicine · doi:10.1097/00001888-200603000-00002 · Cited by 2,240
Internet-Based Learning in the Health Professions: A Meta-analysis
Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008) · JAMA · doi:10.1001/jama.300.10.1181 · Cited by 1,498
Regmi, K., & Jones, L. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02007-6 · Cited by 751
Improvements from a Flipped Classroom May Simply Be the Fruits of Active Learning
Jensen, J. L., Kummer, T. A., & Godoy, P. D. D. M. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.14-08-0129 · Cited by 726
Bączek, M., Zagańczyk-Bączek, M., Szpringer, M., Jaroszyński, A., & Wożakowska-Kapłon, B. (2021) · Medicine · doi:10.1097/md.0000000000024821 · Cited by 721
Metadata
- Authors
- CHUMLEY-JONES, H. S., DOBBIE, A., & ALFORD, C. L.
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2002-10
- Volume
- 77
- Issue
- Supplement
- Pages
- S86-S93
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W2085158146
- Cited by
- 508
- References
- 16
- FWCI
- 9.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Web-based Learning: Sound Educational Method or Hype? A Review of the Evaluation Literature. https://app.cochat.ai/papers/10.1097/00001888-200210001-00028
- The paper
- CHUMLEY-JONES, H. S., DOBBIE, A., & ALFORD, C. L. (2002). Web-based Learning: Sound Educational Method or Hype? A Review of the Evaluation Literature. Academic Medicine. https://doi.org/10.1097/00001888-200210001-00028
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.