The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Exploring Clinical Reasoning Strategies and Test-Taking Behaviors During Clinical Vignette Style Multiple-Choice Examinations: A Mixed Methods Study
Open accessAbstract
Background: Clinical vignette multiple-choice questions (MCQs) are widely used in medical education, but clinical reasoning (CR) strategies employed when approaching these questions have not been well described. Objectives: The aims of the study were (1) to identify CR strategies and test-taking (TT) behaviors of physician trainees while solving clinical vignette MCQs; and (2) to examine the relationships between CR strategies and behaviors, and performance on a high-stakes clinical vignette MCQ examination. Methods: Thirteen postgraduate year–1 level trainees completed 6 clinical vignette MCQs using a think-aloud protocol. Thematic analysis employing elements of grounded theory was performed on data transcriptions to identify CR strategies and TT behaviors. Participants' CR strategies and TT behaviors were then compared with their US Medical Licensing Examination Step 2 Clinical Knowledge scores. Results: Twelve CR strategies and TT behaviors were identified. Individuals with low performance on Step 2 Clinical Knowledge demonstrated increased premature closure and increased faulty knowledge, and showed comparatively less ruling out of alternatives or admission of knowledge deficits. High performers on Step 2 Clinical Knowledge demonstrated increased ruling out of alternatives and admission of knowledge deficits, and less premature closure, faulty knowledge, or closure prior to reading the alternatives. Conclusions: Different patterns of CR strategies and TT behaviors may be used by high and low performers during high-stakes clinical vignette MCQ examinations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
When responding to high-quality clinical vignette-based MCQs, examinees engage cognitive processes equivalent to those involved in authentic clinical reasoning.
“Prior research indicates that when responding to high-quality clinical vignette–based MCQs, examinees engage cognitive processes equivalent to those involved in authentic clinical reasoning36,37.”
From Leveraging computerized adaptive testing for cost-effective evaluation of large language models in medical benchmarking (2026) · cites this paper as [36]
Citations
Cites
The Cambridge Handbook of Expertise and Expert Performance
Ericsson, K. A., Charness, N. H., Feltovich, P. J., Hoffman, R. R., Michelene, T. H., Hunt, E., Prietula, M. J., Amirault, R. J., Branson, R. K., Buchanan, B. G., et al. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816796 · Cited by 3,160
(1992) · Cited by 2,855
Diagnostic error in internal medicine
Graber, M. L., Franklin, N., & Gordon, R. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.13.1493 · Cited by 1,549
Overconfidence as a Cause of Diagnostic Error in Medicine
Berner, E. S., & Graber, M. L. (2008) · The American Journal of Medicine · doi:10.1016/j.amjmed.2008.01.001 · Cited by 1,034
Assessment of clinical competence
Wass, V., van der Vleuten, C. P. M., Shatzer, J. H., & Jones, R. F. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04221-5 · Cited by 1,023
What every teacher needs to know about clinical reasoning
Eva, K. W. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01972.x · Cited by 939
Knowledge Based Solution Strategies in Medical Reasoning
Patel, V. L., & Groen, G. J. (1986) · Cognitive Science · doi:10.1016/s0364-0213(86)80010-6 · Cited by 592
Effects of reflective practice on the accuracy of medical diagnoses
Mamede, S., Schmidt, H. G., & Penaforte, J. C. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03030.x · Cited by 382
Diagnostic reasoning strategies and diagnostic success
Coderre, S., Mandin, H., Harasym, P. H., & Fick, G. H. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01577.x · Cited by 359
Improving the fairness of multiple-choice questions: a literature review
McCoubrie, P. (2004) · Medical Teacher · doi:10.1080/01421590400013495 · Cited by 318
Millman, J., Bishop, C. H., & Ebel, R. L. (1965) · Educational and Psychological Measurement · doi:10.1177/001316446502500304 · Cited by 317
Diagnostic Yield of the Autopsy in a University Hospital and a Community Hospital
Landefeld, C. S., Chren, M., Myers, A. M., et al. (1988) · New England Journal of Medicine · doi:10.1056/nejm198805123181906 · Cited by 254
The Non-Analytical Basis of Clinical Reasoning
Norman, G. R., & Brooks, L. R. (1997) · Advances in Health Sciences Education · doi:10.1023/a:1009784330364 · Cited by 161
A Description of What Happens When an Examinee Takes a Multiple‐Choice Reading Comprehension Test
Farr, R., Pritchard, R. H., & Smitten, B. (1990) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1990.tb00744.x · Cited by 135
Methods and theory in the study of medical inquiry
Elstein, A. S., Kagan, N., Shulman, L. S., et al. (1972) · Academic Medicine · doi:10.1097/00001888-197202000-00002 · Cited by 130
What every teacher needs to know about clinical reasoning
Eva Kevin, W. (2005) · Educación Médica · Cited by 113
Coderre, S. P., Harasym, P., Mandin, H., & Fick, G. (2004) · BMC Medical Education · doi:10.1186/1472-6920-4-23 · Cited by 70
Ilgen, J. S., Bowen, J. L., McIntyre, L. A., Banh, K. V., Barnes, D., Coates, W. C., Druck, J., Fix, M., Rimple, D., Yarris, L. M., et al. (2013) · Academic Medicine · doi:10.1097/acm.0b013e3182a31c1e · Cited by 68
Durning, S. J., Artino, A. R., Beckman, T. J., Graner, J. L., van der Vleuten, C. P. M., Holmboe, E. S., & Schuwirth, L. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.801938 · Cited by 63
Self-citationMeasuring Observer Performance in Chest Radiology: Some Experiences
Potchen, E. J. (2006) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2006.02.020 · Cited by 61
Self-monitoring and its relationship to medical knowledge
McConnell, M., Regehr, G., Wood, T. J., & Eva, K. W. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9305-4 · Cited by 53
Swanson, D. B., Holtzman, K. Z., & Allbee, K. (2008) · Academic Medicine · doi:10.1097/acm.0b013e318183e5bb · Cited by 33
Heemskerk, L., Norman, G. R., Chou, S. H., Mintz, M., Mandin, H., & McLaughlin, K. (2007) · Advances in Health Sciences Education · doi:10.1007/s10459-006-9057-8 · Cited by 31
Verification of a Model of Test-Taking Behavior of High School Seniors
Rogers, W. T., & Bateson, D. J. (1991) · The Journal of Experimental Education · doi:10.1080/00220973.1991.10806571 · Cited by 28
Slocum, P. C., & Louder, J. S. (2006) · PubMed · Cited by 24
Background essential to the proper use of results of step 1 and step 2 of the USMLE
OʼDonnell, M. J., Obenshain, S. S., & Erdmann, J. B. (1993) · Academic Medicine · doi:10.1097/00001888-199310000-00002 · Cited by 23
Strategy choices in multiple-choice items
Skakun, E. N., Maguire, T. O., & Cook, D. (1994) · Academic Medicine · doi:10.1097/00001888-199410000-00025 · Cited by 22
Chick, D. A., Friedman, H. P., Young, V. B., et al. (2010) · Teaching and Learning in Medicine · doi:10.1080/10401330903445422 · Cited by 19
Lee, A. S., Chang, L., Feng, E., et al. (2014) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-13-00302.1 · Cited by 18
Flagged first, then by citations
Research works printed but not linked: 2
- Eva KW, Brooks L, Norman GR. Forward reasoning as a hallmark of expertise in medicine: logical, psychological, and phenomenological inconsistencies. Adv Psychol Res. 2002;8:41–69.
- US Medical Licensing Examination. Score and score reporting. http://www.usmle.org/bulletin/scores/. Accessed September 2, 2014.
Cited by
Sorted by citations
Exploring examinee behaviours as validity evidence for multiple‐choice question examinations
Surry, L. T., Torre, D., & Durning, S. J. (2017) · Medical Education · doi:10.1111/medu.13367 · Cited by 40
Self-citationZheng, T., Jiang, Z., Liu, J., & Feng, S. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02671-w · Cited by 3
“Prior research indicates that when responding to high-quality clinical vignette – based MCQs, examinees engage cognitive processes equivalent to those involved in authentic clinical reasoning 36,37 .”
Metadata
- Authors
- Heist, B. S., Gonzalo, J. D., Durning, S., Torre, D., & Elnicki, D. M.
- Venue
- Journal of Graduate Medical Education
- Published
- 2014-12
- Volume
- 6
- Issue
- 4
- Pages
- 709-714
- ISSN
- 1949-8349 (ISSN-L)
- 1949-8357
- PMC
- PMC4477567
- OpenAlex
- W2011992548
- Cited by
- 29
- References
- 29
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 2 · 2023: 7 · 2022: 2 · 2021: 4 · 2020: 1 · 2019: 2 · 2018: 3 · 2017: 1 · 2016: 1 · 2014: 1
- FWCI
- 1.03
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Graduate Medical Education (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Medical Education and Admissions
- Keywords
- test-taking behavior, physician trainees, USMLE Step 2 Clinical Knowledge, high-stakes examinations, think-aloud, premature closure, knowledge deficit, exam performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
