Cited by 89Electronic Health Records SystemsClinical Reasoning and Diagnostic SkillsArtificial Intelligence in Healthcare and Education

Clinical Decision Support Systems for Diagnosis in Primary Care: A Scoping Review

Open access
Harada, Taku, Miyagami, Taiju, Kunitomo, Kotaro, Shimizu, Taro·2021·International Journal of Environmental Research and Public Health

Abstract

Diagnosis is one of the crucial tasks performed by primary care physicians; however, primary care is at high risk of diagnostic errors due to the characteristics and uncertainties associated with the field. Prevention of diagnostic errors in primary care requires urgent action, and one of the possible methods is the use of health information technology. Its modes such as clinical decision support systems (CDSS) have been demonstrated to improve the quality of care in a variety of medical settings, including hospitals and primary care centers, though its usefulness in the diagnostic domain is still unknown. We conducted a scoping review to confirm the usefulness of the CDSS in the diagnostic domain in primary care and to identify areas that need to be explored. Search terms were chosen to cover the three dimensions of interest: decision support systems, diagnosis, and primary care. A total of 26 studies were included in the review. As a result, we found that the CDSS and reminder tools have significant effects on screening for common chronic diseases; however, the CDSS has not yet been fully validated for the diagnosis of acute and uncommon chronic diseases. Moreover, there were few studies involving non-physicians.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/ijerph18168435

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Some CDSS can generate ranked lists of potential diagnoses for disease differentiation, including disease subtype classification or stages, to guide subsequent treatment planning.

    “Some CDSS can further generate ranked lists of potential diagnoses for disease differentiation [219,220,221], including disease subtype classification or stages, to guide subsequent treatment planning [222].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

References 69 · Cited by 89

Research works printed but not linked: 63

  1. [2]Singh H. Meyer A.N.D. Thomas E.J. The Frequency of Diagnostic Errors in Outpatient Care: Estimations from Three Large Observational Studies Involving US Adult Populations BMJ Qual. Saf. 2014 23 727 731 10.1136/bmjqs-2013-002627 PMC4145460 24742777 · DOI · Paper page
  2. [3]Singh H. Giardina T.D. Meyer A.N.D. Forjuoh S.N. Reis M.D. Thomas E.J. Types and origins of diagnostic errors in primary care settings JAMA Int. Med. 2013 173 418 425 10.1001/jamainternmed.2013.2777 23440149 PMC3690001 · DOI · Paper page
  3. [4]Cresswell K.M. Panesar S.S. Salvilla S.A. Carson-Stevens A. Larizgoitia I. Donaldson L.J. Bates D. Sheikh A. World Health Organization’s (WHO) Safer Primary Care Expert Working Group Global Research Priorities to Better Understand the Burden of Iatrogenic Harm in Primary Care: An International Delphi Exercise PLoS Med. 2013 10 e1001554 10.1371/journal.pmed.1001554 24260028 PMC3833831 · DOI
  4. [5]Panesar S.S. deSilva D. Carson-Stevens A. Cresswell K.M. Salvilla S.A. Slight S.P. Javad S. Netuveli G. Larizgoitia I. Donaldson L.J. How Safe Is Primary Care? A Systematic Review BMJ Qual. Saf. 2016 25 544 553 10.1136/bmjqs-2015-004178 26715764 · DOI
  5. [6]Kostopoulou O. Delaney B.C. Munro C.W. Diagnostic Difficulty and Error in Primary Care--A Systematic Review Fam. Pract. 2008 25 400 413 10.1093/fampra/cmn071 18842618 · DOI · Paper page
  6. [8]Delaney B.C. Kostopoulou O. Decision Support for Diagnosis Should Become Routine in 21st Century Primary Care Br. J. Gen. Pract. 2017 67 494 495 10.3399/bjgp17X693185 29074677 PMC5647893 · DOI
  7. [9]Farmer N. An Update and Further Testing of a Knowledge-Based Diagnostic Clinical Decision Support System for Musculoskeletal Disorders of the Shoulder for Use in a Primary Care Setting J. Eval. Clin. Pract. 2014 20 589 595 10.1111/jep.12153 24828447 · DOI
  8. [10]Delaney B.C. Fitzmaurice D.A. Riaz A. Hobbs F.D. Can Computerised Decision Support Systems Deliver Improved Quality in Primary Care? Interview by Abi Berger BMJ 1999 319 1281 10.1136/bmj.319.7220.1281 10559035 PMC1129060 · DOI
  9. [11]Roshanov P.S. Fernandes N. Wilczynski J.M. Hemens B.J. You J.J. Handler S.M. Nieuwlaat R. Souza N.M. Beyene J. Van Spall H.G. Features of Effective Computerised Clinical Decision Support Systems: Meta-Regression of 162 Randomised Trials BMJ 2013 346 f657 10.1136/bmj.f657 23412440 · DOI
  10. [12]Osheroff J.A. Teich J.M. Middleton B. STeen E.B. Wright A. Detmer D.E. A Roadmap for National Action on Clinical Decision Support J. Am. Med. Inform. Assoc. 2007 14 141 10.1197/jamia.M2334 17213487 PMC2213467 · DOI · Paper page
  11. [14]Henderson E.J. Rubin G.P. The Utility of an Online Diagnostic Decision Support System (Isabel) in General Practice: A Process Evaluation JRSM Short Rep. 2013 4 31 23772310 PMC3681231
  12. [15]Fraser H. Coiera E. Wong D. Safety of Patient-facing Digital Symptom Checkers Lancet 2018 392 2263 10.1016/S0140-6736(18)32819-8 30413281 · DOI
  13. [17]Inokuchi R. Sato H. Nakajima S. Shinohara K. Nakamura K. Gunshin M. Hiruma T. Ishii T. Matsubara T. Kitsuta Y. Development of Information Systems and Clinical Decision Support Systems for Emergency Departments: A Long Road Ahead for Japan Emerg. Med. J. 2013 30 914 10.1136/emermed-2012-201869 23302505 · DOI
  14. [18]Biruk S. Yilma T. Andualem M. Tilahun B. Health Professionals’ Readiness to Implement Electronic Medical Record System at Three Hospitals in Ethiopia: A Cross Sectional Study BMC Med. Inform. Decis. Mak. 2014 14 115 25495757 PMC4276073
  15. [19]Ei-Kareh R. Hasan O. Schiff G.D. Use of Health Information Technology to Reduce Diagnostic Errors BMJ Qual. Saf. 2013 22 ii40 ii51 10.1136/bmjqs-2013-001884 PMC3786650 23852973 · DOI
  16. [20]Chima S. Reece C.J. Milley K. Milton S. Mclntosh J.G. Emery J.D. Decision Support Tools to Improve Cancer Diagnostic Decision Making in Primary Care: A Systematic Review Br. J. Gen. Pract. 2019 69 e809 10.3399/bjgp19X706745 31740460 PMC6863677 · DOI
  17. [21]Jing X. Himawan L. Law T. Availability and Usage of Clinical Decision Support Systems (CDSSs) in Office-based Primary Care Settings in the USA BMJ Health Care Inform. 2019 26 e100015 PMC7252956 31818828
  18. [22]Harry M.L. Truitt A. Saman D.M. Henzler-Buckingham H.A. Allen C.T. Walton K.M. Ekstrom H.L. O’Connor P.L. Sperl-Hillen J.M. Bianco J.A. Barriers and Facilitators to Implementing Cancer Prevention Clinical Decision Support in Primary Care: A Qualitative Study BMC Health Serv. Res. 2019 19 534 31366355 PMC6668099
  19. [23]Horsky J. Schiff G.D. Johnston D. Mercincavage L. Bell D. Middleton B. Interface Design Principles for Usable Decision Support: A Targeted Review of Best Practices for Clinical Prescribing Interventions J. Biomed. Inform. 2012 45 1202 10.1016/j.jbi.2012.09.002 22995208 · DOI
  20. [24]Brunner J. Chuang E. Goldzweig C. Cain C.L. Sugar C. Yano E.M. User-centered Design to Improve Clinical Decision Support in Primary Care Int. J. Med. Inform. 2017 104 56 10.1016/j.ijmedinf.2017.05.004 28599817 PMC5836500 · DOI
  21. [26]Rosser W.W. McDowell I. Newell C. Use of Reminders for Preventive Procedures in Family Medicine Can. Med Assoc. J. 1991 145 807 814 1913409 PMC1335900
  22. [27]Ornstein S.M. Garr D.R. Jenkins R.G. Rust P.F. Arnon A. Computer-Generated Physician and Patient Reminders. Tools to Improve Population Adherence to Selected Preventive Services J. Fam. Pract. 1991 32 82 90 1985140
  23. [28]McPhee S.J. Bird J.A. Fordham D. Rodnick J.E. Osborn E.H. Promoting Cancer Prevention Activities by Primary Care Physicians. Results of a Randomized, Controlled Trial JAMA 1991 266 538 544 10.1001/jama.1991.03470040102030 2061981 · DOI
  24. [29]McPhee S.J. Bird J.A. Jenkins C.N. Fordham D. Promoting Cancer Screening. A Randomized, Controlled Trial of Three Interventions Arch. Intern. Med. 1989 149 1866 1872 10.1001/archinte.1989.00390080116025 2764657 · DOI
  25. [30]McDonald C.J. Hui S.L. Smith D.M. Tierney W.M. Cohen S.J. Weinberger M. McCabe G.P. Reminders to Physicians from an Introspective Computer Medical Record. A Two-Year Randomized Trial Ann. Intern. Med. 1984 100 130 138 10.7326/0003-4819-100-1-130 6691639 · DOI
  26. [31]Hamilton W. Green T. Martins T. Elliott K. Rubin G. Macleod U. Evaluation of Risk Assessment Tools for Suspected Cancer in General Practice: A Cohort Study Br. J. Gen. Pract. 2013 63 e30 e36 10.3399/bjgp13X660751 23336455 PMC3529290 · DOI
  27. [32]Murphy D.R. Wu L. Thomas E.J. Forjuoh S.N. Meyer A.N. Singh H. Electronic Trigger-Based Intervention to Reduce Delays in Diagnostic Evaluation for Cancer: A Cluster Randomized Controlled Trial J. Clin. Oncol. 2015 33 3560 3567 10.1200/JCO.2015.61.1301 26304875 PMC4622097 · DOI
  28. [33]Price S. Spencer A. Medina-Lara A. Hamilton W. Availability and Use of Cancer Decision-Support Tools: A Cross-Sectional Survey of UK Primary Care Br. J. Gen. Pract. 2019 69 e437 e443 10.3399/bjgp19X703745 31064743 PMC6592323 · DOI
  29. [34]Vetter M.J. The Influence of Clinical Decision Support on Diagnostic Accuracy in Nurse Practitioners Worldviews Evid. Based Nurs. 2015 12 355 363 10.1111/wvn.12121 26630088 · DOI
  30. [35]Shimizu T. Nemoto T. Tokuda Y. Effectiveness of a Clinical Knowledge Support System for Reducing Diagnostic Errors in Outpatient Care in Japan: A Retrospective Study Int. J. Med. Inform. 2018 109 1 4 10.1016/j.ijmedinf.2017.09.010 29195700 · DOI
  31. [36]Burack R.C. Gimotty P.A. Promoting Screening Mammography in Inner-City Settings. The Sustained Effectiveness of Com-puterized Reminders in a Randomized Controlled Trial Med. Care 1997 35 921 931 10.1097/00005650-199709000-00005 9298081 · DOI
  32. [37]Burack R.C. Gimotty P.A. George J. McBride S. Moncrease A. Simon M.S. Dews P. Coombs J. How Reminders Given to Patients and Physicians Affected Pap Smear Use in a Health Maintenance Organization: Results of a Randomized Controlled Trial Cancer 1998 82 2391 2400 10.1002/(SICI)1097-0142(19980615)82:12<2391::AID-CNCR13>3.0.CO;2-K 9635532 · DOI
  33. [38]Sequist T.D. Zaslavsky A.M. Marshall R. Fletcher R.H. Ayanian J.Z. Patient and Physician Reminders to Promote Colo-rectal Cancer Screening: A Randomized Controlled Trial Arch. Intern. Med. 2009 169 364 371 10.1001/archinternmed.2008.564 19237720 PMC2683730 · DOI
  34. [39]Litvin C.B. Hyer J.M. Ornstein S.M. Use of Clinical Decision Support to Improve Primary Care Identification and Man-agement of Chronic Kidney Disease (CKD) J. Am. Board Fam. Med. 2016 29 604 612 10.3122/jabfm.2016.05.160020 27613793 · DOI
  35. [40]Lee N.J. Chen E.S. Currie L.M. Donovan M. Hall E.K. Jia H. John R.M. Bakken S. The Effect of a Mobile Clinical Deci-sion Support System on the Diagnosis of Obesity and Overweight in Acute and Primary Care Encounters Adv. Nurs. Sci. 2009 32 211 221 10.1097/ANS.0b013e3181b0d6bf 19707090 · DOI
  36. [41]Chaudhry R. Tulledge-Scheitel S.M. Parks D.A. Angstman K.B. Decker L.K. Stroebel R.J. Use of a Web-Based Clinical Decision Support System to Improve Abdominal Aortic Aneurysm Screening in a Primary Care Practice J. Eval. Clin. Pract. 2012 18 666 670 10.1111/j.1365-2753.2011.01661.x 21401808 PMC3489055 · DOI
  37. [42]Kenealy T. Arroll B. Petrie K.J. Patients and Computers as Reminders to Screen for Diabetes in Family Practice. Random-ized-Controlled Trial J. Gen. Intern. Med. 2005 20 916 921 10.1111/j.1525-1497.2005.0197.x 16191138 PMC1490216 · DOI
  38. [43]van Wyk J.T. van Wijk M.A. Sturkenboom M.C. Mosseveld M. Moorman P.W. van der Lei J. Electronic Alerts Versus On-Demand Decision Support to Improve Dyslipidemia Treatment: A Cluster Randomized Controlled Trial Circulation 2008 117 371 378 10.1161/CIRCULATIONAHA.107.697201 18172036 · DOI
  39. [44]Rubenstein L.V. McCoy J.M. Cope D.W. Barrett P.A. Hirsch S.H. Messer K.S. Young R.T. Improving Patient Quality of Life with Feedback to Physicians About Functional Status J. Gen. Intern. Med. 1995 10 607 614 10.1007/BF02602744 8583263 · DOI
  40. [45]DeJesus R.S. Angstman K.B. Kesman R. Stroebel R.J. Bernard M.E. Scheitel S.M. Hunt V.L. Rahman A.S. Chaudhry R. Use of a Clinical Decision Support System to Increase Osteoporosis Screening J. Eval. Clin. Pract. 2012 18 89 92 10.1111/j.1365-2753.2010.01528.x 20722888 PMC3303889 · DOI
  41. [46]DeSilva M.B. Kodet A. Walker P.F. A Best Practice Alert for Identifying Hepatitis B-Infected Patients Am. J. Trop. Med. Hyg. 2020 103 884 886 10.4269/ajtmh.20-0041 32431283 PMC7410429 · DOI
  42. [47]Chak E. Taefi A. Li C.S. Chen M.S. Harris A.M. MacDonald S. Bowlus C. Electronic Medical Alerts Increase Screening for Chronic Hepatitis B: A Randomized, Double-Blind, Controlled Trial. Cancer Epidemiol Biomark. Prev. 2018 27 1352 1357 10.1158/1055-9965.EPI-18-0448 PMC6214733 30089680 · DOI · Paper page
  43. [48]Sundaram V. Lazzeroni L.C. Douglass L.R. Sanders G.D. Tempio P. Owens D.K. A Randomized Trial of Computer-Based Reminders and Audit and Feedback to Improve HIV Screening in a Primary Care Setting Int. J. STD AIDS 2009 20 527 533 10.1258/ijsa.2008.008423 19625582 · DOI
  44. [49]Miller M.J. Burns C.F. Kapusnik-Uner J. Carreno R. Matuszewski K.A. Depression Screening for Prescribed Medications with Mental Health Risk: Considerations for Clinical Decision Support, Workflow Redesign, and Health Information Exchange Arrangements Res. Soc. Adm. Pharm. 2017 13 485 493 10.1016/j.sapharm.2016.06.008 27514236 · DOI
  45. [50]Downs M. Turner S. Bryans M. Wilcock J. Keady J. Levin E. O’Carroll R. Howie K. Iliffe S. Effectiveness of Educational Interventions in Improving Detection and Management of Dementia in Primary Care: Cluster Randomised Controlled Study BMJ 2006 332 692 696 10.1136/bmj.332.7543.692 16565124 PMC1410839 · DOI
  46. [51]Ahmad F. Hogg-Johnson S. Stewart D.E. Skinner H.A. Glazier R.H. Levinson W. Computer-Assisted Screening for In-timate Partner Violence and Control: A Randomized Trial Ann. Intern. Med. 2009 151 93 102 10.7326/0003-4819-151-2-200907210-00124 19487706 · DOI
  47. [52]Cooper J.G. West R.M. Clamp S.E. Hassan T.B. Does Computer-Aided Clinical Decision Support Improve the Management of Acute Abdominal Pain? A Systematic Review Emerg. Med. J. 2011 28 553 557 10.1136/emj.2009.086801 21045220 · DOI
  48. [53]López M.M. López M.M. de la Torre Díez I.T. Jimeno J.C.P. López-Coronado M. MHealth App for iOS to Help in Diagnostic Decision in Ophthalmology to Primary Care Physicians J. Med. Syst. 2017 41 81 10.1007/s10916-017-0731-6 28364359 · DOI
  49. [54]Gerbert B. Bronstone A. Maurer T. Hofmann R. Berger T. Decision Support Software to Help Primary Care Physicians Triage Skin Cancer: A Pilot Study Arch. Dermatol. 2000 136 187 192 10.1001/archderm.136.2.187 10677094 · DOI
  50. [55]Pearce F. Lanyon P.C. Watts R.A. Can Prediction Models in Primary Care Enable Earlier Diagnosis of Rare Rheumatic Diseases? Rheumatology 2018 57 2065 2066 10.1093/rheumatology/kex508 29462470 · DOI
  51. [56]Ramnarayan P. Roberts C.G. Coren M. Nanduri V. Tomlinson A. Taylor M.P. Wyatt J.C. Britto J.F. Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: A quasi-experimental study BMC Med. Inform. Decis. Mak. 2006 6 22 10.1186/1472-6947-6-22 16646956 PMC1513379 · DOI
  52. [57]Feldman M.D. Petersen A.J. Karliner L.S. Tice J.A. Who is responsible for evaluating the safety and effectiveness of medical devices? The role of independent technology assessment J. Gen. Intern. Med. 2007 23 Suppl. S1 57 63 10.1007/s11606-007-0275-4 PMC2150636 18095046 · DOI
  53. [58]Ronicke S. Hirsch M.C. Türk E. Larionov K. Tientcheu D. Wagner A.D. Can a Decision Support System Accelerate Rare Disease Diagnosis? Evaluating the Potential Impact of Ada DX in a Retrospective Study Orphanet J. Rare Dis. 2019 14 69 10.1186/s13023-019-1040-6 30898118 PMC6427854 · DOI · Paper page
  54. [59]Rees F. Doherty M. Lanyon P. Davenport G. Riley R.D. Zhang W. Grainge J.W. Early Clinical Features in Systemic Lupus Erythematosus: Can They Be Used to Achieve Earlier Diagnosis? A Risk Prediction Model Arthritis Care Res. 2016 69 8334 10.1002/acr.23021 27588834 · DOI
  55. [60]Pearce F.A. Habbard R.B. Grainge M.J. Watts R.A. Abhishek A. Lanyon P.C. Can granulomatosis with polyangiitis be diagnosed earlier in primary care? A case-control study QJM Int. J. Med. 2018 111 39 45 10.1093/qjmed/hcx194 29340693 · DOI
  56. [61]Hamilton W. Walter F.M. Rubin G. Neal R.D. Improving Early Diagnosis of Symptomatic Cancer Nat. Rev. Clin. Oncol. 2016 13 740 749 10.1038/nrclinonc.2016.109 27458007 · DOI
  57. [62]Graber M.L. Progress Understanding Diagnosis and Diagnostic Errors: Thoughts at Year 10 Diagnosis 2020 7 151 159 10.1515/dx-2020-0055 32628630 · DOI
  58. [63]Abdellatif A. Bouaud J. Nghiem D. Lafuente-Lafuente C. Belmin J. Seroussi B. Clinical Decision Support Systems in Nursing Homes: A Scoping Review Stud. Health Technol. Inform. 2020 270 542 546 32570442
  59. [64]Boers S.N. Jongsma K.R. Lucivero F. Aardoom J. Büchner F.L. de Vries M. Honkoop P. Houwink E.J.F. Kasteleyn M.J. Meijer E. SERIES: EHealth in Primary Care. Part 2: Exploring the Ethical Implications of Its Application in Primary Care Practice Eur. J. Gen. Pract. 2020 26 26 32 10.1080/13814788.2019.1678958 31663394 PMC7034078 · DOI
  60. [65]Harada T. Shimizu T. Kaji Y. Suyama Y. Matsumoto T. Kosaka C. Shimizu H. Nei T. Watanuki S. A Perspective from a Case Conference on Comparing the Diagnostic Process: Human Diagnostic Thinking vs. Artificial Intelligence (AI) Decision Support Tools Int. J. Environ. Res. Public Health 2020 17 6110 10.3390/ijerph17176110 32842581 PMC7504543 · DOI
  61. [66]van der Kleij R.M.J.J. Kasteleyn M.J. Meijer E. Bonten T.N. Houwink E.J.F. Teichert M. van Luenen S. Vedanthan R. Evers A. Car J. SERIES: EHealth in Primary Care. Part 1: Concepts, Conditions and Challenges Eur. J. Gen. Pract. 2019 25 179 189 10.1080/13814788.2019.1658190 31597502 PMC6853224 · DOI
  62. [67]Shimizu T. The 6C model for accurately capturing the patient’s medical history Diagnosis 2021 10.1515/dx-2020-0126 33887130 · DOI
  63. [68]Harada Y. Katsukura S. Kawamura R. Shimizu T. Efficacy of Artificial-Intelligence-Driven Differential-Diagnosis List on the Diagnostic Accuracy of Physicians: An Open-Label Randomized Controlled Study Int. J. Environ. Res. Public Health 2021 18 2086 10.3390/ijerph18042086 33669930 PMC7924871 · DOI · Paper page

Authors
Harada, T., Miyagami, T., Kunitomo, K., & Shimizu, T.
Affiliations
  • SHOWA Medical University Koto Toyosu Hospital (JP)
  • Juntendo University (JP)
  • Kumamoto Medical Center (JP)
  • Dokkyo Medical University Hospital (JP)
Corresponding author
Shimizu, Taro
Venue
International Journal of Environmental Research and Public Health
Publisher
MDPI AG
Published
2021-08-10
Volume
18
Issue
16
Pages
8435
ISSN
1660-4601 (ISSN-L)
OpenAlex
W3187814586
Cited by
89
References
69
Citations by year
2026: 13 · 2025: 18 · 2024: 28 · 2023: 17 · 2022: 13
FWCI
2.55
Type
journal article
Language
en
Open access
Locations
  • International Journal of Environmental Research and Public Health (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
clinical decision support systems, diagnostic errors, primary care, diagnostic accuracy, chronic disease screening, health information technology
MeSH terms
Mass Screening, Primary Health Care, Decision Support Systems, Clinical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review