The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
The effects of problem-based learning during medical school on physician competency: a systematic review
Open accessAbstract
BACKGROUND: Systematic reviews on the effects of problem-based learning have been limited to knowledge competency either during medical school or postgraduate training. We conducted a systematic review of evidence of the effects that problem-based learning during medical school had on physician competencies after graduation. METHODS: We searched MEDLINE, EMBASE, CINAHL, PsycINFO, Cochrane Databases, and the tables of contents of 5 major medical education journals from earliest available date through Oct. 31, 2006. We included studies in our review if they met the following criteria: problem-based learning was a teaching method in medical school, physician competencies were assessed after graduation and a control group of graduates of traditional curricula was used. We developed a scoring system to assess the quality of the studies, categorized competencies into 8 thematic dimensions and used a second system to determine the level of evidence for each competency assessed. RESULTS: Our search yielded 102 articles, of which 15 met inclusion criteria after full text review. Only 13 studies entered final systematic analysis because 2 studies reported their findings in 2 articles. According to self-assessments, 8 of 37 competencies had strong evidence in support of problem-based learning. Observed assessments had 7 competencies with strong evidence. In both groups, most of these competencies were in the social and cognitive dimensions. Only 4 competencies had moderate to strong levels of evidence in support of problem-based learning for both self-and observed assessments: coping with uncertainty (strong), appreciation of legal and ethical aspects of health care (strong), communication skills (moderate and strong respectively) and self-directed continuing learning (moderate). INTERPRETATION: Problem-based learning during medical school has positive effects on physician competency after graduation, mainly in social and cognitive dimensions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For this purpose, Koh et al. analyzed the effect that PBL during medical school had on physician competencies after graduation, finding a positive effect mainly in social and cognitive dimensions [138].”
From Effectiveness of problem-based learning methodology in undergraduate medical education: a scoping review (2022) · cites this paper as [138]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Defining and Assessing Professional Competence
Epstein, R. M. (2002) · JAMA · doi:10.1001/jama.287.2.226 · Cited by 3,114
Petersdorf, R. G. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00012 · Cited by 2,503
Davis, D. A., Mazmanian, P. E., Fordis, M., Van Harrison, R., Thorpe, K. E., & Perrier, L. (2006) · JAMA · doi:10.1001/jama.296.9.1094 · Cited by 2,375
Wood, D. F. (2003) · BMJ · doi:10.1136/bmj.326.7384.328 · Cited by 2,140
Effects of problem-based learning: a meta-analysis
Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003) · Learning and Instruction · doi:10.1016/s0959-4752(02)00025-7 · Cited by 1,713
Does problem-based learning work? A meta-analysis of evaluative research
Vernon, D. T., & Blake, R. L. (1993) · Academic Medicine · doi:10.1097/00001888-199307000-00015 · Cited by 1,456
Curriculum development for medical education a six-step approach
Thomas, P. A., Kern, D. E., Hughes, M. T., Tackett, S. A., & Chen, B. Y. (2022) · Cited by 1,239
Effectiveness of Problem-based Learning Curricula: Research and Theory
Colliver, J. A. (2000) · Academic Medicine · doi:10.1097/00001888-200003000-00017 · Cited by 917
Comment: Educational research: The hardest science of all
Berliner, D. C. (2002) · Educational Researcher · doi:10.3102/0013189x031008018 · Cited by 772
Effectiveness of problem‐based learning curricula: theory, practice and paper darts
Norman, G. R., & Schmidt, H. G. (2000) · Medical Education · doi:10.1046/j.1365-2923.2000.00749.x · Cited by 712
Problem-based learning: have the expectations been met?
Berkson, L. (1993) · Academic Medicine · doi:10.1097/00001888-199310000-00053 · Cited by 430
Maudsley, G. (1999) · Academic Medicine · doi:10.1097/00001888-199902000-00016 · Cited by 367
Schmidt, H. G., Vermeulen, L., & van der Molen, H. T. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02483.x · Cited by 313
Problem based learning in continuing medical education: a review of controlled evaluation studies
Smits, P. B. A. (2002) · BMJ · doi:10.1136/bmj.324.7330.153 · Cited by 286
Developments in outcome-based education
Harden, R. M. (2002) · Medical Teacher · doi:10.1080/01421590220120669 · Cited by 276
Curriculum development for medical education a six-step approach
Kern, D. E. (1998) · Cited by 271
Undergraduate medical education: comparison of problem-based learning and conventional teaching.
Nandi, P. L., Chan, J., Chan, C. P., Chan, P., & CHAN, L. P. (2000) · PubMed · Cited by 265
Effect of problem-based, self-directed undergraduate education on life-long learning.
(1993) · Europe PMC (PubMed Central) · Cited by 259
Comparing the effects of problem-based and conventional curricula in an international sample
Schmidt, H. G., Dauphinée, W. D., & Patel, V. L. (1987) · Academic Medicine · doi:10.1097/00001888-198704000-00002 · Cited by 219
RCT = results confounded and trivial: the perils of grand educational experiments
Norman, G. R. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01586.x · Cited by 198
Innovation in Medical Education: An Evaluation of Its Present Status
Korenman, S. G. (1991) · Journal of the Association of American Medical Colleges · doi:10.1097/00001888-199109000-00004 · Cited by 196
Not knowing that they do not know: self‐assessment accuracy of third‐year medical students
Langendyk, V. (2006) · Medical Education · doi:10.1111/j.1365-2929.2005.02372.x · Cited by 184
(2003) · Cited by 183
Hoffman, K., Hosokawa, M., Blake, R., Headrick, L., & Johnson, G. (2006) · Academic Medicine · doi:10.1097/01.acm.0000232411.97399.c6 · Cited by 179
General competencies of problem‐based learning (PBL) and non‐PBL graduates
Prince, K. J. A. H., van Eijs, P., Boshuizen, H. P. A., van der Vleuten, C. P. M., & Scherpbier, A. J. J. A. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02107.x · Cited by 169
Roizen, M. F. (2008) · Yearbook of Anesthesiology and Pain Management · doi:10.1016/s1073-5437(08)70774-5 · Cited by 169
Challenges in Systematic Reviews of Educational Intervention Studies
Reed, D. A., Price‐Haywood, E. G., Windish, D. M., Wright, S. M., Gozu, A., Hsu, E. B., Beach, M. C., Kern, D. E., & Bass, E. B. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-12_part_2-200506211-00008 · Cited by 163
Jones, A., McArdle, P. J., & O'Neill, P. A. (2002) · Medical Education · doi:10.1046/j.1365-2923.2002.01105.x · Cited by 163
Long-term Outcomes of the New Pathway Program at Harvard Medical School
Peters, A. S., Greenberger-Rosovsky, R., Crowder, C., Block, S. D., & Moore, G. T. (2000) · Academic Medicine · doi:10.1097/00001888-200005000-00018 · Cited by 140
A Snapshot of the Status of Problem-Based Learning in U. S. Medical Schools, 2003???04
Kinkade, S. (2005) · Academic Medicine · doi:10.1097/00001888-200503000-00021 · Cited by 115
The continuum of problem-based learning
DAVIS, R. M. H. M. H. (1998) · Medical Teacher · doi:10.1080/01421599880733 · Cited by 110
Residency performance of graduates from a problem‐based and a conventional curriculum
Santos-Gomez, L., Kalishman, S. G., Rezler, A. G., SKIPPER, B. J., & Mennin, S. P. (1990) · Medical Education · doi:10.1111/j.1365-2923.1990.tb02453.x · Cited by 92
Tamblyn, R., Abrahamowicz, M., Dauphinee, D., Girard, N., Bartlett, G., Grand'Maison, P., & Brailovsky, C. (2005) · BMJ · doi:10.1136/bmj.38636.582546.7c · Cited by 91
Williams, G. P., & Lau, A. M. S. (2004) · BMJ · doi:10.1136/bmj.329.7457.92 · Cited by 90
Mennin, S. P., Kalishman, S. G., Friedman, M., Pathak, D., & Snyder, J. H. (1996) · Academic Medicine · doi:10.1097/00001888-199610000-00015 · Cited by 86
Are differences between graduates and undergraduates in a medical course due to age or prior degree?
WILKINSON, T. J., Wells, J. E., & Bushnell, J. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01981.x · Cited by 81
Problem‐based learning: a dissemination success story?
Sanson‐Fisher, R. W., & Lynagh, M. C. (2005) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2005.tb07032.x · Cited by 80
Educational Theory and Medical Education Practice
Colliver, J. A. (2002) · Academic Medicine · doi:10.1097/00001888-200212000-00012 · Cited by 76
Problem-based learning: An assessment of its feasibility and cost
Donner, R. S., & Bickley, H. C. (1990) · Human Pathology · doi:10.1016/0046-8177(90)90170-a · Cited by 72
Clinical competence of interns
Rolfe, I. E., Andren, J., Pearson, S., Hensley, M. J., Gordon, J., Atherton, S., Gordon, J., Smith, A. J., Barnsley, L., Hazell, P., et al. (1995) · Medical Education · doi:10.1111/j.1365-2923.1995.tb02835.x · Cited by 60
The effectiveness of PBL: the debate continues. Is meta‐analysis helpful?
Farrow, R., & Norman, G. R. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01725.x · Cited by 47
The implementation of Tomorrow's Doctors
Christopher, D., Harte, K., & George, C. F. (2002) · Medical Education · doi:10.1046/j.1365-2923.2002.01152.x · Cited by 47
Does melatonin improve sleep?: Efficacy of melatonin
Arendtw, J. (2006) · BMJ · doi:10.1136/bmj.332.7540.550 · Cited by 34
Educational supervisors' views on the competencies of preregistration house officers
Watmough, S., Taylor, D., Garden, A., & Ryland, I. (2006) · British Journal of Hospital Medicine · doi:10.12968/hmed.2006.67.2.20469 · Cited by 30
Tolnai, S. (1991) · Medical Education · doi:10.1111/j.1365-2923.1991.tb00089.x · Cited by 29
Responses to the pilot systematic review of problem‐based learning
Newman, M., den Bossche, P. V., Gijbels, D., McKendree, J., Roberts, T., Rolfe, I., Smucny, J. J., & Virgilio, G. D. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01943.x · Cited by 24
Preregistration house officer skill and competency assessment through questionnaires
Watmough, S., Ryland, I., Taylor, R. D. C., & Garden, A. (2006) · British Journal of Hospital Medicine · doi:10.12968/hmed.2006.67.sup9.22002 · Cited by 18
Problem‐based learning: a dissemination success story?
Batey, R. G. (2006) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00137.x · Cited by 13
Unravelling the meaning of global comparative ratings of interns.
Woodward, C. A., McAuley, R. G., & Ridge, H. (1981) · PubMed · Cited by 13
The Effectiveness of Problem Based Learning 1: A Pilot Systematic Review and Meta-analysis
Newman, M. J. (2004) · UNSPECIFIED (2004) · Cited by 7
Logical debate on problem based learning
Mellon, A. F., & Mellon, J. (2006) · BMJ · doi:10.1136/bmj.332.7540.550-b · Cited by 6
Flagged first, then by citations
Research works printed but not linked: 2
- Dochy F, Segers M. Bossche van den P, Gijbels D. Effects of PBL: a meta-analysis. Learning and Instruction 2003;13:533-68.
- Wood DF. ABC of learning and teaching in medicine: problem based learning. BMJ 2003;326:328-30.
Cited by
Sorted by citations
Systematic review on the effectiveness of augmented reality applications in medical training
Barsom, E. Z., Graafland, M., & Schijven, M. P. (2016) · Surgical Endoscopy · doi:10.1007/s00464-016-4800-6 · Cited by 672
Trullàs, J. C., Blay, C., Sarri, E., & Pujol, R. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03154-8 · Cited by 473
Problem-Based Learning and Medical Education Forty Years On
Neville, A. J. (2008) · Medical Principles and Practice · doi:10.1159/000163038 · Cited by 417
Theory to reality: a few issues in implementing problem-based learning
Hung, W. (2011) · Educational Technology Research and Development · doi:10.1007/s11423-011-9198-1 · Cited by 398
Schmidt, H. G., van der Molen, H. T., Winkel, W. T., & Wijnen, W. (2009) · Educational Psychologist · doi:10.1080/00461520903213592 · Cited by 383
Metadata
- Authors
- Koh, G. C.-H., Khoo, H. E., Wong, M. L., & Koh, D.
- Affiliations
- National University of Singapore (SG)
- Venue
- Canadian Medical Association Journal
- Publisher
- CMA Joule Inc.
- Published
- 2008-01-01
- Volume
- 178
- Issue
- 1
- Pages
- 34-41
- ISSN
- 0820-3946 (ISSN-L)
- 1488-2329
- PMC
- PMC2151117
- OpenAlex
- W2145936815
- Cited by
- 659
- References
- 51
- Citations by year
- 2026: 18 · 2025: 19 · 2024: 22 · 2023: 30 · 2022: 31 · 2021: 30 · 2020: 39 · 2019: 36 · 2018: 32 · 2017: 43 · 2016: 49 · 2015: 43 · 2014: 62 · 2013: 47 · 2012: 35
- FWCI
- 21.14
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Canadian Medical Association Journal (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- National University of Singapore (submittedVersion)
- Funders
- National University of Singapore
- Topics
- Social Sciences › Education › Problem and Project Based Learning
- Social Sciences › Education › Innovations in Medical Education
- Physical Sciences › Engineering › Biomedical Engineering › Biomedical and Engineering Education
- Keywords
- problem-based learning, medical education, physician competence, medical graduates, competency assessment, communication skills, coping with uncertainty, self-directed learning
- MeSH terms
- Clinical Competence, Curriculum, Education, Medical, Undergraduate, Humans, Schools, Medical, Problem-Based Learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review