Avoiding premature closure and reaching diagnostic accuracy: some key predictive factors
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Context: Early studies suggested that experienced clinicians simply generate more accurate diagnoses than those less experienced. However, more recent studies indicate that experienced clinicians may be subject to biases in formulating and confirming hypotheses that lead to inaccuracy. Objectives: The goal of this study was to identify factors associated with the ability to process information in ways that overcome premature closure and result in accurate diagnosis using a set of vignettes in which inconsistent information was introduced midway. Methods: Seventy‐five participants (25 Year 3 medical students, 25 internal medicine residents in their second year of residency and 25 internal medicine faculty) were recruited to solve each of four complex clinical vignettes. In each vignette, the first four rounds of information pointed toward a narrowing range of diagnostic possibilities, but patient information presented in and after the fifth round was inconsistent with prior findings. In addition to accuracy, outcome measures were length of differential diagnosis, certainty of diagnosis, persistence in data collection and tendency to switch diagnoses. Results: There were no significant differences in diagnostic accuracy across the three groups, each of which differed in level of training. However, across experience levels, diagnostic accuracy was associated with the mean number of items in the differential, tendency to persist (e.g. to request a greater number of rounds of information), and openness to switch (e.g. to change the most likely diagnosis on receipt of disconfirming information). Conclusions: Level of training (i.e. clinical experience) was not associated with accuracy on this task. As faculty clinicians certainly have more knowledge than their junior counterparts, it is important to identify ways in which cognitive factors can lead to more or less persistence and openness, and to teach clinicians how to overcome tendencies associated with error.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cacioppo, J. T., Petty, R. E., Feinstein, J. A., & Jarvis, W. B. G. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.197 · Cited by 2,517
Motivated closing of the mind: “Seizing” and “freezing”
Kruglanski, A. W., & Webster, D. M. (1996) · Psychological Review · doi:10.1037/0033-295x.103.2.263 · Cited by 2,379
A Universal Model of Diagnostic Reasoning
Croskerry, P. (2009) · Academic Medicine · doi:10.1097/acm.0b013e3181ace703 · Cited by 1,016
Lower level mediation in multilevel models.
Kenny, D. A., Korchmaros, J. D., & Bolger, N. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.115 · Cited by 687
Clinical cognition and diagnostic error: applications of a dual process model of reasoning
Croskerry, P. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9182-2 · Cited by 494
The Script Concordance Test: A Tool to Assess the Reflective Clinician
Charlin, B., Roy, L., Brailovsky, C., Goulet, F., & van der Vleuten, C. (2000) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1204_5 · Cited by 373
Diagnostic reasoning strategies and diagnostic success
Coderre, S., Mandin, H., Harasym, P. H., & Fick, G. H. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01577.x · Cited by 359
Slowing Down to Stay Out of Trouble in the Operating Room: Remaining Attentive in Automaticity
Moulton, C.-A., Regehr, G., Lingard, L., Merritt, C., & MacRae, H. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181f073dd · Cited by 140
Cited by
Clinical Reasoning Assessment Methods: A Scoping Review and Practical Guidance
Daniel, M., Rencic, J., Durning, S. J., Holmboe, E., Santen, S. A., Lang, V., Ratcliffe, T., Gordon, D., Heist, B., Lubarsky, S., et al. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002618 · Cited by 355
Royce, C. S., Hayes, M. M., & Schwartzstein, R. M. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002518 · Cited by 242
Self-citationHirosawa, T., Kawamura, R., Harada, Y., Mizuta, K., Tokumasu, K., Kaji, Y., Suzuki, T., & Shimizu, T. (2023) · JMIR Medical Informatics · doi:10.2196/48808 · Cited by 130
“Conversely, a diagnosis was marked as “0” if it diverged significantly from the actual diagnosis [24].”
BackgroundHarada, Y., Katsukura, S., Kawamura, R., & Shimizu, T. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18042086 · Cited by 44
“An answer was coded as “correct” if it accurately stated the diagnosis and with an acceptable degree of specificity [21].”
BackgroundHirosawa, T., Harada, Y., Mizuta, K., Sakamoto, T., Tokumasu, K., & Shimizu, T. (2024) · JMIR Formative Research · doi:10.2196/59267 · Cited by 38
Overconfidence, Time-on-Task, and Medical Errors: Is There a Relationship?
Al-Maghrabi, M., Mamede, S., Schmidt, H., Omair, A., Al-Nasser, S., Alharbi, N., & Magzoub, M. E. (2024) · Advances in Medical Education and Practice · doi:10.2147/amep.s442689 · Cited by 14
“26 Even a comprehensive review of the relationship between overconfidence and diagnostic error was unable to unearth direct evidence of the causal relationship between overconfidence, premature closure, and diagnostic accuracy.”
Background
Metadata
- Authors
- Krupat, E., Wormwood, J., Schwartzstein, R. M., & Richards, J. B.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2017-08-30
- Volume
- 51
- Issue
- 11
- Pages
- 1127-1137
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2751628114
- Cited by
- 37
- References
- 8
- FWCI
- 1.54
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.