CoChat

Should electronic differential diagnosis support be used early or late in the diagnostic process? A multicentre experimental study of Isabel

Open access
Sibbald, Matt, Monteiro, Sandra, Sherbino, Jonathan, LoGiudice, Andrew, Friedman, Charles, Norman, Geoffrey · 2022 · BMJ Quality & Safety
Cited by 51

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Abstract

Background: Diagnostic errors unfortunately remain common. Electronic differential diagnostic support (EDS) systems may help, but it is unclear when and how they ought to be integrated into the diagnostic process. Objective: To explore how much EDS improves diagnostic accuracy, and whether EDS should be used early or late in the diagnostic process. Setting: 6 Canadian medical schools. A volunteer sample of 67 medical students, 62 residents in internal medicine or emergency medicine, and 61 practising internists or emergency medicine physicians were recruited in May through June 2020. Intervention: Participants were randomised to make use of EDS either early (after the chief complaint) or late (after the complete history and physical is available) in the diagnostic process while solving each of 16 written cases. For each case, we measured the number of diagnoses proposed in the differential diagnosis and how often the correct diagnosis was present within the differential. Results: EDS increased the number of diagnostic hypotheses by 2.32 (95% CI 2.10 to 2.49) when used early in the process and 0.89 (95% CI 0.69 to 1.10) when used late in the process (both p<0.001). Both early and late use of EDS increased the likelihood of the correct diagnosis being present in the differential (7% and 8%, respectively, both p<0.001). Whereas early use increased the number of diagnostic hypotheses (most notably for students and residents), late use increased the likelihood of the correct diagnosis being present in the differential regardless of one’s experience level. Conclusions and relevance: EDS increased the number of diagnostic hypotheses and the likelihood of the correct diagnosis appearing in the differential, and these effects persisted irrespective of whether EDS was used early or late in the diagnostic process.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmjqs-2021-013493

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Cited by

See all 51

Metadata

Authors
Sibbald, M., Monteiro, S., Sherbino, J., LoGiudice, A., Friedman, C., & Norman, G.
Venue
BMJ Quality & Safety
Publisher
BMJ
Published
2021-10-05
Volume
31
Issue
6
Pages
426-433
ISSN
  • 1475-3898 (ISSN-L)
  • 2044-5415
  • 2044-5423
OpenAlex
W3202293436
Cited by
51
References
8
FWCI
9.14
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Should electronic differential diagnosis support be used early or late in the diagnostic process? A multicentre experimental study of Isabel. https://app.cochat.ai/papers/10.1136/bmjqs-2021-013493
The paper
Sibbald, M., Monteiro, S., Sherbino, J., LoGiudice, A., Friedman, C., & Norman, G. (2022). Should electronic differential diagnosis support be used early or late in the diagnostic process? A multicentre experimental study of Isabel. BMJ Quality & Safety. https://doi.org/10.1136/bmjqs-2021-013493

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.