The Effectiveness of Cognitive Forcing Strategies to Decrease Diagnostic Error: An Exploratory Study
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Cognitive forcing strategies, a form of metacognition, have been advocated as a strategy to prevent diagnostic error. Increasingly, curricula are being implemented in medical training to address this error. Yet there is no experimental evidence that these curricula are effective. DESCRIPTION: This was an exploratory, prospective study using consecutive enrollment of 56 senior medical students during their emergency medicine rotation. Students received interactive, standardized cognitive forcing strategy training. EVALUATION: Using a cross-over design to assess transfer between similar (to instructional cases) and novel diagnostic cases, students were evaluated on 6 test cases. Forty-seven students were immediately tested and 9 were tested 2 weeks later. Data were analyzed using descriptive statistics and a McNemar chi-square test. CONCLUSIONS: This is the first study to explore the impact of cognitive forcing strategy training on diagnostic error. Our preliminary findings suggest that application and retention is poor. Further large studies are required to determine if transfer across diagnostic formats occurs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition
Evans, J. S. B. T. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093629 · Cited by 5,137 · cited 1×
“28 Emerging opinion suggests that the conflict between System 1 reasoning and bias may not be as significant as presumed.”
BackgroundConditions for intuitive expertise: A failure to disagree.
Kahneman, D., & Klein, G. (2009) · American Psychologist · doi:10.1037/a0016755 · Cited by 2,443 · cited 1×
“29 Rather, expertise is marked by nonanalytical reasoning, whereas the inappropriate application of heuristics (that inform nonanalytical reasoning) may result in diagnostic bias, particularly among nonexperts.”
BackgroundThe Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them
Croskerry, P. (2003) · Academic Medicine · doi:10.1097/00001888-200308000-00003 · Cited by 1,675 · cited 1×
“20 Although students were instructed to self-monitor during decision making and identify potential risks of bias, they were taught specifically to search for a potential second diagnosis (“Is there anything else to be found?” “Have I been looking in the right place?”) and to guard against undue influence from readily…”
BackgroundDiagnostic error in internal medicine
Graber, M. L., Franklin, N., & Gordon, R. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.13.1493 · Cited by 1,549
Overconfidence as a Cause of Diagnostic Error in Medicine
Berner, E. S., & Graber, M. L. (2008) · The American Journal of Medicine · doi:10.1016/j.amjmed.2008.01.001 · Cited by 1,034
Cognitive forcing strategies in clinical decisionmaking
Croskerry, P. (2003) · Annals of Emergency Medicine · doi:10.1067/mem.2003.22 · Cited by 440 · cited 1×
“14 CFS are defined as forms of self-monitoring during decision making, in which an individual acknowledges the risk of error, identifies potential biases influencing decision making, and actively employs a cognitive process to countermand a potential bias.”
BackgroundHeuristics and biases: selected errors in clinical reasoning
Elstein, A. S. (1999) · Academic Medicine · doi:10.1097/00001888-199907000-00012 · Cited by 285
Understanding diagnostic errors in medicine: a lesson from aviation
Singh, H. (2006) · Quality and Safety in Health Care · doi:10.1136/qshc.2005.016444 · Cited by 156
Metacognitive Training to Reduce Diagnostic Errors: Ready for Prime Time?
Graber, M. (2003) · Academic Medicine · doi:10.1097/00001888-200308000-00004 · Cited by 46
Cited by
Norman, G. R., Monteiro, S. D., Sherbino, J., Ilgen, J. S., Schmidt, H. G., & Mamede, S. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001421 · Cited by 594
Self-citationCognitive interventions to reduce diagnostic error: a narrative review
Graber, M. L., Kissam, S., Payne, V. L., Meyer, A. N. D., Sorensen, A., Lenfestey, N., Tant, E., Henriksen, K., LaBresh, K., & Singh, H. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000149 · Cited by 449
Cognitive debiasing 2: impediments to and strategies for change
Croskerry, P., Singhal, G., & Mamede, S. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001713 · Cited by 419
Cognitive bias in clinical medicine
O'Sullivan, E., & Schofield, S. (2018) · Journal of the Royal College of Physicians of Edinburgh · doi:10.4997/jrcpe.2018.306 · Cited by 334
Royce, C. S., Hayes, M. M., & Schwartzstein, R. M. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002518 · Cited by 242
Dual-process cognitive interventions to enhance diagnostic reasoning: a systematic review
Lambe, K. A., O'Reilly, G., Kelly, B. D., & Curristan, S. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004417 · Cited by 215
Sherbino, J., Kulasegaram, K., Howey, E., & Norman, G. (2014) · CJEM · doi:10.2310/8000.2013.130860 · Cited by 108
Self-citationBelieving in Overcoming Cognitive Biases
(2020) · AMA Journal of Ethics · doi:10.1001/amajethics.2020.773 · Cited by 80
Metadata
- Authors
- Sherbino, J., Dore, K. L., Siu, E., & Norman, G. R.
- Venue
- Teaching and Learning in Medicine
- Publisher
- Informa UK Limited
- Published
- 2011-01-12
- Volume
- 23
- Issue
- 1
- Pages
- 78-84
- ISSN
- 1040-1334 (ISSN-L)
- 1532-8015
- OpenAlex
- W2069741947
- Cited by
- 80
- References
- 9
- FWCI
- 5.10
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.