Adjusting Our Lens: Can Developmental Differences in Diagnostic Reasoning Be Harnessed to Improve Health Professional and Trainee Assessment?
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Academic Emergency Medicine 2011; 18:S79–S86 © 2011 by the Society for Academic Emergency Medicine Objectives: Research in cognition has yielded considerable understanding of the diagnostic reasoning process and its evolution during clinical training. This study sought to determine whether or not this literature could be used to improve the assessment of trainees’ diagnostic skill by manipulating testing conditions that encourage different modes of reasoning. Methods: The authors developed an online, vignette‐based instrument with two sets of testing instructions. The “first impression” condition encouraged nonanalytic responses while the “directed search” condition prompted structured analytic responses. Subjects encountered six cases under the first impression condition and then six cases under the directed search condition. Each condition had three straightforward (simple) and three ambiguous (complex) cases. Subjects were stratified by clinical experience: novice (third‐ and fourth‐year medical students), intermediate (postgraduate year [PGY] 1 and 2 residents), and experienced (PGY 3 residents and faculty). Two investigators scored the exams independently. Mean diagnostic accuracies were calculated for each group. Differences in diagnostic accuracy and reliability of the examination as a function of the predictor variables were assessed. Results: The examination was completed by 115 subjects. Diagnostic accuracy was significantly associated with the independent variables of case complexity, clinical experience, and testing condition. Overall, mean diagnostic accuracy and the extent to which the test consistently discriminated between subjects (i.e., yielded reliable scores) was higher when participants were given directed search instructions than when they were given first impression instructions. In addition, the pattern of reliability was found to depend on experience: simple cases offered the best reliability for discriminating between novices, complex cases offered the best reliability for discriminating between intermediate residents, and neither type of case discriminated well between experienced practitioners. Conclusions: These results yield concrete guidance regarding test construction for the purpose of diagnostic skill assessment. The instruction strategy and complexity of cases selected should depend on the experience level and breadth of experience of the subjects one is attempting to assess.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them
Croskerry, P. (2003) · Academic Medicine · doi:10.1097/00001888-200308000-00003 · Cited by 1,675
Diagnostic error in internal medicine
Graber, M. L., Franklin, N., & Gordon, R. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.13.1493 · Cited by 1,549
Research in clinical reasoning: past history and current trends
Norman, G. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02127.x · Cited by 1,018
A Universal Model of Diagnostic Reasoning
Croskerry, P. (2009) · Academic Medicine · doi:10.1097/acm.0b013e3181ace703 · Cited by 1,016 · cited 1×
“Diagnosticians at all levels employ nonanalytic reasoning when they encounter familiar problems.(10,13,21,22) These subconscious processes, such as pattern recognition or heuristics, allow clinicians to recognize clinical presentations and quickly link them to past experiences.”
BackgroundEducational Strategies to Promote Clinical Diagnostic Reasoning
Bowen, J. L. (2006) · New England Journal of Medicine · doi:10.1056/nejmra054782 · Cited by 931
Self-citationHow expertise develops in medicine: knowledge encapsulation and illness script formation
Schmidt, H. G., & Rikers, R. M. J. P. (2007) · Medical Education · doi:10.1111/j.1365-2923.2007.02915.x · Cited by 619
Computerized Virtual Patients in Health Professions Education: A Systematic Review and Meta-Analysis
Cook, D. A., Erwin, P. J., & Triola, M. M. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181edfe13 · Cited by 570
Medical Errors Involving Trainees: A Study of Closed Malpractice Claims From 5 Insurers
Singh, H., Thomas, E. J., Petersen, L. A., & Studdert, D. M. (2007) · Archives of Internal Medicine · doi:10.1001/archinte.167.19.2030 · Cited by 407
Effects of reflective practice on the accuracy of medical diagnoses
Mamede, S., Schmidt, H. G., & Penaforte, J. C. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03030.x · Cited by 382
Diagnostic Errors in Medicine: A Case of Neglect
Graber, M. (2005) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(05)31015-4 · Cited by 259
Cited by
Norman, G. R., Monteiro, S. D., Sherbino, J., Ilgen, J. S., Schmidt, H. G., & Mamede, S. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001421 · Cited by 594
Self-citationDual-process cognitive interventions to enhance diagnostic reasoning: a systematic review
Lambe, K. A., O'Reilly, G., Kelly, B. D., & Curristan, S. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004417 · Cited by 215
Sherbino, J., Kulasegaram, K., Howey, E., & Norman, G. (2014) · CJEM · doi:10.2310/8000.2013.130860 · Cited by 108
Staal, J., Hooftman, J., Gunput, S. T. G., Mamede, S., Frens, M. A., Van den Broek, W. W., Alsma, J., & Zwaan, L. (2022) · BMJ Quality & Safety · doi:10.1136/bmjqs-2022-014865 · Cited by 32
Parsons, A. S., Wijesekera, T. P., Olson, A. P. J., Torre, D., Durning, S. J., & Daniel, M. (2025) · Medical Teacher · doi:10.1080/0142159x.2024.2359963 · Cited by 12
“A significant body of research demonstrates that errors, both in diagnosis and management, occur fairly equally across both information processing pathways (Ilgen et al. 2011, 2013; Sherbino et al. 2012; Norman et al. 2014; Monteiro et al. 2015).”
Metadata
- Authors
- Ilgen, J. S., Bowen, J. L., Yarris, L. M., Fu, R., Lowe, R. A., & Eva, K.
- Venue
- Academic Emergency Medicine
- Publisher
- Wiley
- Published
- 2011-10
- Volume
- 18
- Issue
- s2
- Pages
- S79-86
- ISSN
- 1069-6563 (ISSN-L)
- 1553-2712
- OpenAlex
- W2135415725
- Cited by
- 28
- References
- 10
- FWCI
- 1.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Adjusting Our Lens: Can Developmental Differences in Diagnostic Reasoning Be Harnessed to Improve Health Professional and Trainee Assessment? https://app.cochat.ai/papers/10.1111/j.1553-2712.2011.01182.x
- The paper
- Ilgen, J. S., Bowen, J. L., Yarris, L. M., Fu, R., Lowe, R. A., & Eva, K. (2011). Adjusting Our Lens: Can Developmental Differences in Diagnostic Reasoning Be Harnessed to Improve Health Professional and Trainee Assessment? Academic Emergency Medicine. https://doi.org/10.1111/j.1553-2712.2011.01182.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.