Communicating accuracy of tests to general practitioners: a controlled study
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Objective: To assess the extent to which different forms of summarising diagnostic test information influence general practitioners' ability to estimate disease probabilities. Design: Controlled questionnaire study. Setting: Three Swiss conferences in continuous medical education. Participants: 263 general practitioners. Intervention: Questionnaire with multiple choice questions about terms of test accuracy and a clinical vignette with the results of a diagnostic test described in three different ways (test result only, test result plus test sensitivity and specificity, test result plus the positive likelihood ratio presented in plain language). Main outcome measures: Doctors' knowledge and application of terms of test accuracy and estimation of disease probability in the clinical vignette. Results: The correct definitions for sensitivity and predictive value were chosen by 76% and 61% of the doctors respectively, but only 22% chose the correct answer for the post-test probability of a positive screening test. In the clinical vignette doctors given the test result only overestimated its diagnostic value (median attributed likelihood ratio (aLR)=9.0, against 2.54 reported in the literature). Providing the scan's sensitivity and specificity reduced the overestimation (median aLR=6.0) but to a lesser extent than simple wording of the likelihood ratio (median aLR=3.0). Conclusion: Most general practitioners recognised the correct definitions for sensitivity and positive predictive value but did not apply them correctly. Conveying test accuracy information in simple, non-technical language improved their ability to estimate disease probabilities accurately. What is already known on this topic: Many doctors confuse the sensitivity of clinical tests and their positive predictive value Doctors tend to overestimate information derived from such tests and underestimate information from a patient's clinical history Most primary research on diagnostic accuracy is reported using sensitivity and specificity or likelihood ratios What this study adds: In a cohort of experienced Swiss general practitioners most were unable to interpret correctly numerical information on the diagnostic accuracy of a screening test When presented with a positive result alone they grossly overestimated its value Adding information on the test's sensitivity and specificity moderated these overestimates, and expressing the same numerical information as a positive likelihood ratio in simple, non-technical language brought the estimates still closer to their true values
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
(2000) · doi:10.1017/cbo9780511803475 · Cited by 2,987
van Walraven, C., & Naylor, C. D. (1998) · JAMA · doi:10.1001/jama.280.6.550 · Cited by 373
Cited by
2019 ESC Guidelines for the diagnosis and management of chronic coronary syndromes
Knuuti, J., Wijns, W., Saraste, A., Capodanno, D., Barbato, E., Funck-Brentano, C., Prescott, E., Storey, R. F., Deaton, C., Cuisset, T., et al. (2020) · European Heart Journal · doi:10.1093/eurheartj/ehz425 · Cited by 7,166
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Systematic Reviews of Diagnostic Test Accuracy
Leeflang, M. M. G., Deeks, J. J., Gatsonis, C., & Bossuyt, P. M. M. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-12-200812160-00008 · Cited by 1,124
Refining clinical diagnosis with likelihood ratios
Grimes, D. A., & Schulz, K. F. (2005) · The Lancet · doi:10.1016/s0140-6736(05)66422-7 · Cited by 828
Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy
(2023) · doi:10.1002/9781119756194 · Cited by 757
Metadata
- Authors
- Steurer, J., Fischer, J. E., Bachmann, L. M., Koller, M., & ter Riet, G.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2002-04-06
- Volume
- 324
- Issue
- 7341
- Pages
- 824-826
- ISSN
- 1756-1833 (ISSN-L)
- 0959-8138
- OpenAlex
- W2117383154
- Cited by
- 147
- References
- 3
- FWCI
- 5.87
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Communicating accuracy of tests to general practitioners: a controlled study. https://app.cochat.ai/papers/10.1136/bmj.324.7341.824
- The paper
- Steurer, J., Fischer, J. E., Bachmann, L. M., Koller, M., & ter Riet, G. (2002). Communicating accuracy of tests to general practitioners: a controlled study. BMJ. https://doi.org/10.1136/bmj.324.7341.824
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.