Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 508

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

Web-based Learning: Sound Educational Method or Hype? A Review of the Evaluation Literature

CHUMLEY-JONES, HEIDI S., DOBBIE, ALISON, ALFORD, CYNTHIA L.·2002·Academic Medicine

Abstract

The first reports of Web-based medical education appear in 1992,1 building on 30 years of computer-assisted instruction. Proponents claimed computer-assisted instruction is superior to text-based, lecture, and traditional educational methods for reasons that include control by the learner over content, time, and place of learning2; enhancement of learning, reasoning, and efficiency3,4; and cost savings.5 Many studies that reported advantages contained methodologic flaws6 and reported advantages unrelated to computer-specific features.7 Web-based learning (WBL) represents a further evolution of computer-assisted instruction. Technical advantages of WBL include universal accessibility, ease in updating content, and hyperlink functions that permit cross-referencing to other resources.8 These technical advances, specifically hyperlink and searching capabilities, fit the constructivist learning theory, where learners search out and create their own knowledge bases. However, as was evident with computer-assisted instruction, potential advantages may not translate into significant improvements in educational outcomes. With the widespread adoption of WBL, it is critical that medical educators have evidence regarding its performance as a learning medium. This paper reviews the medical, dental, and nursing WBL evaluation literature to: (1) identify which facets of WBL have been evaluated, (2) describe the evaluation strategies used, (3) synthesize the findings, and (4) discuss educational implications and future research directions. Method We searched Medline and ERIC for “Computer-assisted Instruction” and “Internet or World Wide Web” and “Education, continuing or Education, dental, or Education, medical, or Education, nursing” from 1966 to January 2002, limited to English language. Having selected articles from their abstracts, two authors independently applied the criteria in Figure 1 to classify each article as descriptive or evaluative. If the abstract was unavailable or lacked sufficient information, the article was reviewed. When the two authors disagreed, the third author broke the tie.Figure 1: Literature review and selection of articles for review.We categorized the WBL articles by evaluation domains. Where possible, we divided studies into those evaluating features specific to the Web medium versus those specific to educational content. We determined percentages of descriptive and evaluative studies, identified evaluation domains, described evaluation strategies, and synthesized the findings. The small number of studies and heterogeneity of study designs and participants precluded combining the data by meta-analysis. Results and Discussion We identified 206 WBL papers between 1992 and 2001 in Medline and ERIC. As shown in Figure 1, 76 met our criteria for inclusion, 41 (59%) being descriptive and 35 (46%) evaluative. The two authors agreed on this classification for 71 of 76 papers (kappa = 0.869, p < .001). In the five case of disagreement, the third author classified one study as descriptive and four as evaluative. From the 35 evaluation papers, we identified four domains: knowledge gains, learner attitudes, learning efficiency, and program cost. We divided studies of learner attitudes into those evaluating Web-specific and content-specific attributes. We could not similarly divide studies measuring knowledge gains due to multiple confounding educational influences in all but two studies.9,10Table 1 depicts the evaluation domains, keywords used to describe the focus of the investigation, and the number of studies in each category.TABLE 1: Keywords and Numbers of Studies in Evaluation Domains of 31 Web-based Learning StudiesDomain 1: Studies Evaluating Knowledge Gains Twenty studies evaluated knowledge gains with WBL interventions. Eighteen measured changes in multiple-choice test scores; one used a written case analysis; and one, a multiple-choice test plus a standardized patient interview. Research methods included pretest/post-test self-controlled studies, self-selected controlled studies, assigned (non-randomized) controlled studies, assigned crossover trials, and randomized controlled trials. The most common research design was a pretest/posttest self-controlled study, but there were several randomized controlled trials (see Appendix Table A). The pretest/posttest studies provided strong evidence that WBL interventions resulted in knowledge gains in medical students, practicing physicians, and dentists.11,12,13,14,15 However, studies without a control group cannot separate Web-specific from content-specific learning gains.Table: APPENDIX TABLE A. Studies Evaluating Knowledge Gains with WBL Interventions, Classified by Study DesignStudies where a WBL group and a control group received identical educational content allowed identification of learning gains attributable specifically to the Web medium. Studies that met this criterion demonstrated no difference in knowledge gains between groups.16,17,18,19

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1097/00001888-200210001-00028

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 16 references

Research works printed but not linked: 28

  1. 1992, Ann NY Acad Sci, 670, 43, 10.1111/j.1749-6632.1992.tb26073.x · doi:10.1111/j.1749-6632.1992.tb26073.x
  2. Clayden, 1988, Med Educ, 22, 456, 10.1111/j.1365-2923.1988.tb00783.x · doi:10.1111/j.1365-2923.1988.tb00783.x
  3. Bolwell, 1993, Decubitus, 6, 20
  4. Haag, 1999, Int J Med Inform, 53, 79, 10.1016/S1386-5056(98)00118-X · doi:10.1016/s1386-5056(98)00118-x
  5. Engel, 1997, Diabetes Educator, 23, 545, 10.1177/014572179702300505 · doi:10.1177/014572179702300505
  6. Francis, 2000, J Cont Educ Health Prof, 20, 76, 10.1002/chp.1340200203 · doi:10.1002/chp.1340200203
  7. Harris, 2001, J Gen Intern Med, 16, 50
  8. Kronz, 2000, Cancer, 89, 1818, 10.1002/1097-0142(20001015)89:8<1818::AID-CNCR23>3.0.CO;2-J · doi:10.1002/1097-0142(20001015)89:8<1818::aid-cncr23>3.0.co;2-j
  9. Sakowski, 2001, Acad Med, 76, 547, 10.1097/00001888-200105000-00090 · doi:10.1097/00001888-200105000-00090
  10. Cho, 1998, Medinfo, 9, t
  11. Fulkerson, 1999, Acad Med, 74, 576, 10.1097/00001888-199905000-00041 · doi:10.1097/00001888-199905000-00041
  12. Yucha, 2000, J Nurs Educ, 39, 68, 10.3928/0148-4834-20000201-08 · doi:10.3928/0148-4834-20000201-08
  13. Balcezak, 1998, J Biocommunication, 25, 2
  14. Chan, 1999, MD Comput, 16, 54
  15. Perryer, 2000, Eur J Dent Educ, 4, 118, 10.1034/j.1600-0579.2000.040305.x · doi:10.1034/j.1600-0579.2000.040305.x
  16. Lipman, 2001, Acad Med, 76, 1060, 10.1097/00001888-200110000-00018 · doi:10.1097/00001888-200110000-00018
  17. Mehta, 1998, J Cancer Educ, 13, 197
  18. Agius, 1998, Occup Med, 48, 337, 10.1093/occmed/48.5.337 · doi:10.1093/occmed/48.5.337
  19. Hashiba, 2000, Med Inform Internet Med, 25, 239, 10.1080/146392300455549 · doi:10.1080/146392300455549
  20. Sekikawa, 2001, Public Health, 115, 152, 10.1016/S0033-3506(01)00435-8 · doi:10.1016/s0033-3506(01)00435-8
  21. Horsch, 2000, Int J Med Inform, 58-, 39, 10.1016/S1386-5056(00)00074-5 · doi:10.1016/s1386-5056(00)00074-5
  22. Rose, 2000, Comput Nurs, 18, 162
  23. Thornam, 2001, Techtrends, 45, 34, 10.1007/BF02763375 · doi:10.1007/bf02763375
  24. Thiele, 1999, Nurs Health Care Perspect, 20, 199
  25. McNulty, 2000, Acad Med, 75, 59, 10.1097/00001888-200001000-00016 · doi:10.1097/00001888-200001000-00016
  26. Letterie, 1996, Fertil Steril, 65, 883, 10.1016/S0015-0282(16)58234-X · doi:10.1016/s0015-0282(16)58234-x
  27. Stillman, 1999, Innovations Educ Training Int, 36, 17, 10.1080/1355800990360104 · doi:10.1080/1355800990360104
  28. Cimino, 1995, ProceedingsAnnual Symposium on Computer Applications in Medical Care, 493-, 7

Cited by

See all 508

Metadata

Authors
CHUMLEY-JONES, H. S., DOBBIE, A., & ALFORD, C. L.
Venue
Academic Medicine
Published
2002-10
Volume
77
Issue
Supplement
Pages
S86-S93
ISSN
1040-2446 (ISSN-L)
OpenAlex
W2085158146
Cited by
508
References
16
FWCI
9.66
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Web-based Learning: Sound Educational Method or Hype? A Review of the Evaluation Literature. https://app.cochat.ai/papers/10.1097/00001888-200210001-00028
The paper
CHUMLEY-JONES, H. S., DOBBIE, A., & ALFORD, C. L. (2002). Web-based Learning: Sound Educational Method or Hype? A Review of the Evaluation Literature. Academic Medicine. https://doi.org/10.1097/00001888-200210001-00028

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.