Problem-Based Learning Outcomes: Ten Years of Experience at the University of Missouri???Columbia School of Medicine
Abstract
PURPOSE: To add to a previous publication from the University of Missouri-Columbia School of Medicine (UMCSOM) on students' improvement in United States Medical Licensing Examination (USMLE) Step 1 and Step 2 scores after the implementation of a problem-based learning (PBL) curriculum by studying the performance of ten PBL class cohorts at the UMCSOM. METHOD: Characteristics of graduating classes matriculating in both traditional and PBL curricula, 1993-2006, were compared for Medical College Admission Test component scores, undergraduate grade point averages, performance on the USMLE Step 1 and Step 2 exams, faculty contact hours, and residency directors' evaluations of UMCSOM graduates' performance in the first year of residency. RESULTS: Mean scores of six of the ten comparisons for USMLE Step 1 and six of nine comparisons for USMLE Step 2 are significantly higher (p < .01) for UMCSOM PBL students than for first-time examinees nationally. These differences cannot be accounted for by preselection of academically advantaged students, increased time on task, or reduced class size. Gains in performance continue into residency, as evidenced by program directors' perceptions of superior performance of UMCSOM PBL graduates. CONCLUSIONS: The PBL curricular changes implemented with the graduating class of 1997 resulted in higher performances on USMLEs and improved evaluations from residency program directors. These changes better prepare graduates with knowledge and skills needed to practice within a complex health care system. Outcomes reported here support the investment of financial and human resources in our PBL curriculum.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
PBL methodology is complex to plan and structure, needs a large number of human and material resources, and requires an immense teacher effort.
“recognizing that PBL methodology is complex to plan and structure, needs a large number of human and material resources, requiring an immense teacher effort [28, 31, 94, 127–133].”
From Effectiveness of problem-based learning methodology in undergraduate medical education: a scoping review (2022) · cites this paper as [31]
Cites
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Petersdorf, R. G. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00012 · Cited by 2,503 · see citing works
Wood, D. F. (2003) · BMJ · doi:10.1136/bmj.326.7384.328 · Cited by 2,140 · see citing works
Toward a design theory of problem solving
Jonassen, D. H. (2000) · Educational Technology Research and Development · doi:10.1007/bf02300500 · Cited by 2,114 · see citing works
Does problem-based learning work? A meta-analysis of evaluative research
Vernon, D. T., & Blake, R. L. (1993) · Academic Medicine · doi:10.1097/00001888-199307000-00015 · Cited by 1,456 · see citing works
Self-citationEffectiveness of Problem-based Learning Curricula: Research and Theory
Colliver, J. A. (2000) · Academic Medicine · doi:10.1097/00001888-200003000-00017 · Cited by 917 · see citing works
Neufeld, V. R., & Barrows, H. S. (1974) · Academic Medicine · doi:10.1097/00001888-197411000-00004 · Cited by 480 · see citing works
Bringing problem-based learning to higher education : theory and practice
Wilkerson, L., & Gijselaers, W. (1996) · Cited by 469 · see citing works
Problem-based learning: have the expectations been met?
Berkson, L. (1993) · Academic Medicine · doi:10.1097/00001888-199310000-00053 · Cited by 430 · see citing works
How to use problem-based learning in the classroom
Delisle, R. G. (1997) · Cited by 409 · see citing works
Maudsley, G. (1999) · Academic Medicine · doi:10.1097/00001888-199902000-00016 · Cited by 367 · see citing works
Problem-Based Learning Applied to Medical Education
Barrows, H. S. (2000) · Cited by 350 · see citing works
Validity of the Medical College Admission Test for predicting medical school performance
Julian, E. R. (2005) · Academic Medicine · doi:10.1097/00001888-200510000-00010 · Cited by 319 · see citing works
Connecting problem‐based practices with educational theory
Gijselaers, W. (1996) · New Directions for Teaching and Learning · doi:10.1002/tl.37219966805 · Cited by 288 · see citing works
The influence of the New Pathway curriculum on Harvard medical students
Moore, G., Block, S. D., Style, C., & Mitchell, R. (1994) · Academic Medicine · doi:10.1097/00001888-199412000-00017 · Cited by 214 · see citing works
Kaufman, A., Mennin, S. P., Waterman, R. E., Duban, S., Hansbarger, C., Silverblatt, H., Obenshain, S. S., Kantrowitz, M. P., Becker, T., & Samet, J. M. (1989) · Academic Medicine · doi:10.1097/00001888-198906000-00001 · Cited by 213 · see citing works
Long-term Outcomes of the New Pathway Program at Harvard Medical School
Peters, A. S., Greenberger-Rosovsky, R., Crowder, C., Block, S. D., & Moore, G. T. (2000) · Academic Medicine · doi:10.1097/00001888-200005000-00018 · Cited by 140 · see citing works
Traditional predictors of performance in medical school
Mitchell, K. J. (1990) · Academic Medicine · doi:10.1097/00001888-199003000-00005 · Cited by 131 · see citing works
Problem-Based Learning Outcomes: The Glass Half-Full
Distlehorst, L. H., Dawson, E. A., ROBBS, R. S., & Barrows, H. S. (2005) · Academic Medicine · doi:10.1097/00001888-200503000-00020 · Cited by 130 · see citing works
Blake, R. L., Hosokawa, M. C., & Riley, S. L. (2000) · Academic Medicine · doi:10.1097/00001888-200001000-00017 · Cited by 128 · see citing works
Self-citationA Snapshot of the Status of Problem-Based Learning in U. S. Medical Schools, 2003???04
Kinkade, S. (2005) · Academic Medicine · doi:10.1097/00001888-200503000-00021 · Cited by 115 · see citing works
Mennin, S. P., Friedman, M., Skipper, B., Kalishman, S., & Snyder, J. (1993) · Academic Medicine · doi:10.1097/00001888-199308000-00012 · Cited by 103 · see citing works
Transforming Nursing Education Through Problem-Based Learning
Rideout, E. M. (2000) · Medical Entomology and Zoology · Cited by 97 · see citing works
Residency performance of graduates from a problem‐based and a conventional curriculum
Santos-Gomez, L., Kalishman, S. G., Rezler, A. G., SKIPPER, B. J., & Mennin, S. P. (1990) · Medical Education · doi:10.1111/j.1365-2923.1990.tb02453.x · Cited by 92 · see citing works
Woodward, C. A., & FERRIER, B. M. (1983) · Medical Education · doi:10.1111/j.1365-2923.1983.tb01094.x · Cited by 80 · see citing works
Self-reported Competency Ratings of Graduates of a Problem-based Medical Curriculum
Schmidt, H. G., & van der Molen, H. T. (2001) · Academic Medicine · doi:10.1097/00001888-200105000-00018 · Cited by 78 · see citing works
Ratings of studentsʼ performances in a third-year internal medicine clerkship
RICHARDS, B. F., Ober, K. P., Cariaga-Lo, L., Camp, M. G., Philp, J. R., McFarlane, M., Rupp, R., & Zaccaro, D. J. (1996) · Academic Medicine · doi:10.1097/00001888-199602000-00028 · Cited by 71 · see citing works
A follow‐up of medical graduates of a problem‐based learning curriculum
Antepohl, W., Domeij, E., Forsberg, P., et al. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01401.x · Cited by 67 · see citing works
A new tool for problem-based, self-directed learning
Distlehorst, L. H., & Barrows, H. S. (1982) · Academic Medicine · doi:10.1097/00001888-198206000-00012 · Cited by 50 · see citing works
Undergraduate Institutional MCAT Scores as Predictors of USMLE Step 1 Performance
Basco, W. T., Way, D. P., Gilbert, G. E., & Hudson, A. E. A. (2002) · Academic Medicine · doi:10.1097/00001888-200210001-00005 · Cited by 49 · see citing works
An experiment in medical education. A critical analysis using traditional criteria
Goodman, L. J. (1991) · JAMA · doi:10.1001/jama.265.18.2373 · Cited by 45 · see citing works
Critical thinking in preclinical course examinations
Miller, D. A. W., Sadler, J. Z., & Mohl, P. C. (1993) · Academic Medicine · doi:10.1097/00001888-199304000-00020 · Cited by 36 · see citing works
More on Competency-Based Education
Whitcomb, M. E. (2004) · Academic Medicine · doi:10.1097/00001888-200406000-00001 · Cited by 34 · see citing works
Are Qualitative Studies of the PBL Tutorial Process Indicated?
Colliver, J. A. (2001) · Academic Medicine · doi:10.1097/00001888-200103000-00001 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Koh, G. C.-H., Khoo, H. E., Wong, M. L., & Koh, D. (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.070565 · Cited by 659 · see citing works
Trullàs, J. C., Blay, C., Sarri, E., & Pujol, R. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03154-8 · Cited by 473 · see citing works
The effect of problem-based learning in nursing education: a meta-analysis
Shin, I.-S., & Kim, J.-H. (2013) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9436-2 · Cited by 149 · see citing works
Assessing the Effectiveness of Problem-Based Learning of Preventive Medicine Education in China
Ding, X., Zhao, L., Chu, H., Tong, N., Ni, C., Hu, Z., Zhang, Z., & Wang, M. (2014) · Scientific Reports · doi:10.1038/srep05126 · Cited by 49 · see citing works
Ma, Y., & Lu, X. (2019) · Medicine · doi:10.1097/md.0000000000014052 · Cited by 43 · see citing works
A knowledge construction methodology to automate case‐based learning using clinical documents
Ali, M., Hussain, J., Lee, S., Kang, B. H., & Sattar, K. (2020) · Expert Systems · doi:10.1111/exsy.12401 · Cited by 4 · see citing works
- Authors
- Hoffman, K., Hosokawa, M., Blake, R., Headrick, L., & Johnson, G.
- Affiliations
- University of Missouri (US)
- Corresponding author
- Hoffman, Kimberly
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-07
- Volume
- 81
- Issue
- 7
- Pages
- 617-625
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W1984927517
- Cited by
- 179
- References
- 34
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 5 · 2023: 5 · 2022: 8 · 2021: 6 · 2020: 13 · 2019: 7 · 2018: 4 · 2017: 13 · 2016: 7 · 2015: 13 · 2014: 15 · 2013: 19 · 2012: 13
- FWCI
- 39.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Academic Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Problem and Project Based Learning
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
- Keywords
- problem-based learning, medical curriculum, USMLE Step 1, USMLE Step 2, medical graduates, curriculum comparison
- MeSH terms
- Academic Medical Centers, Adult, Education, Medical, Educational Measurement, Female, Humans, Licensure, Medical, Male, Missouri, Retrospective Studies, Students, Medical, Problem-Based Learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
