A scoping review of artificial intelligence-based methods for diabetes risk prediction
Open accessAbstract
The increasing prevalence of type 2 diabetes mellitus (T2DM) and its associated health complications highlight the need to develop predictive models for early diagnosis and intervention. While many artificial intelligence (AI) models for T2DM risk prediction have emerged, a comprehensive review of their advancements and challenges is currently lacking. This scoping review maps out the existing literature on AI-based models for T2DM prediction, adhering to the PRISMA extension for Scoping Reviews guidelines. A systematic search of longitudinal studies was conducted across four databases, including PubMed, Scopus, IEEE-Xplore, and Google Scholar. Forty studies that met our inclusion criteria were reviewed. Classical machine learning (ML) models dominated these studies, with electronic health records (EHR) being the predominant data modality, followed by multi-omics, while medical imaging was the least utilized. Most studies employed unimodal AI models, with only ten adopting multimodal approaches. Both unimodal and multimodal models showed promising results, with the latter being superior. Almost all studies performed internal validation, but only five conducted external validation. Most studies utilized the area under the curve (AUC) for discrimination measures. Notably, only five studies provided insights into the calibration of their models. Half of the studies used interpretability methods to identify key risk predictors revealed by their models. Although a minority highlighted novel risk predictors, the majority reported commonly known ones. Our review provides valuable insights into the current state and limitations of AI-based models for T2DM prediction and highlights the challenges associated with their development and clinical integration.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
AI is now being utilized to predict an individual's risk for developing type 2 diabetes (T2DM) and potential complications.
“Beyond intervention and treatment, AI is now being utilized to predict an individual’s risk for developing type 2 diabetes (T2DM) and potential complications.”
From AI-based diabetes care: risk prediction models and implementation concerns (2024) · cites this paper as [5]
The Introduction and Results describe AI models used to predict individuals’ risk of developing T2DM. The Introduction also says precision prognostics aims to predict T2DM and its complications, but the review does not establish that the AI models it examines predict complications. (LLM, conf=0.85)
Experimental — accuracy not yet measuredMultimodal AI approaches were superior to unimodal models for diabetes risk prediction in the Mohsen et al. scoping review.
“A scoping review of 40 studies by Mohsen et al. shows that while most studies used unimodal AI models, multimodal approaches were superior because they integrate multiple types of data.”
From AI-based diabetes care: risk prediction models and implementation concerns (2024) · cites this paper as [5]
A modest number (n = 10) of studies in the Mohsen et al. review adopted multimodal approaches combining EHR with multi-omics or medical imaging data.
“Although a modest number (n = 10) studies adopted multimodal approaches (combining EHR with multi-omics or medical imaging data), these were shown to be superior to unimodal models (n = 30).”
From AI-based diabetes care: risk prediction models and implementation concerns (2024) · cites this paper as [5]
Most models in the Mohsen et al. review were classical machine learning models with electronic health records as the predominant data source.
“Of these models, most were classical machine learning models with electronic health records as the predominant data source.”
From AI-based diabetes care: risk prediction models and implementation concerns (2024) · cites this paper as [5]
Only five studies in the Mohsen et al. review provided insights into calibration of models.
“Only five studies provided insights into calibration of models and only five conducted external validations.”
From AI-based diabetes care: risk prediction models and implementation concerns (2024) · cites this paper as [5]
Only five studies in the Mohsen et al. review conducted external validations.
“Only five studies provided insights into calibration of models and only five conducted external validations.”
From AI-based diabetes care: risk prediction models and implementation concerns (2024) · cites this paper as [5]
The performance of the algorithms in the Mohsen et al. review was measured using the area under the curve (AUC) metric in most studies.
“The performance of the algorithms was measured using the area under the curve (AUC) metric in most studies.”
From AI-based diabetes care: risk prediction models and implementation concerns (2024) · cites this paper as [5]
There are concerns with bias due to variability of demographic representation across models, with many studies showing a pronounced imbalance of gender, ethnicity, and age.
“There are further concerns with bias due to the variability of demographic representation across models, with many in this study showing a pronounced imbalance of gender, ethnicity, and age.”
From AI-based diabetes care: risk prediction models and implementation concerns (2024) · cites this paper as [5]
Most studies in the Mohsen et al. scoping review of 40 studies used unimodal AI models.
“A scoping review of 40 studies by Mohsen et al. shows that while most studies used unimodal AI models, multimodal approaches were superior because they integrate multiple types of data.”
From AI-based diabetes care: risk prediction models and implementation concerns (2024) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · see citing works
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092 · see citing works
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669 · see citing works
Huang, S.-C., Pareek, A., Seyyedi, S., Banerjee, I., & Lungren, M. P. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00341-z · Cited by 934 · see citing works
Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints
van der Ploeg, T., Austin, P. C., & Steyerberg, E. W. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-137 · Cited by 809 · see citing works
Multimodal machine learning in precision health: A scoping review
Kline, A., Wang, H., Li, Y., Dennis, S., Hutch, M., Xu, Z., Wang, F., Cheng, F., & Luo, Y. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00712-8 · Cited by 528 · cited 2× · see citing works
“They often face scalability issues, and the data concatenation process can be time-consuming 61 .”
BackgroundBuilding Classifiers with Independency Constraints
Calders, T., Kamiran, F., & Pechenizkiy, M. (2009) · 2009 IEEE International Conference on Data Mining Workshops · doi:10.1109/icdmw.2009.83 · Cited by 468 · see citing works
Chung, W. K., Erion, K., Florez, J. C., Hattersley, A. T., Hivert, M.-F., Lee, C. G., McCarthy, M. I., Nolan, J. J., Norris, J. M., Pearson, E. R., et al. (2020) · Diabetes Care · doi:10.2337/dci20-0022 · Cited by 400 · see citing works
Boehm, K. M., Aherne, E. A., Ellenson, L., Nikolovski, I., Alghamdi, M., Vázquez-García, I., Zamarin, D., Long Roche, K., Liu, Y., Patel, D., et al. (2022) · Nature Cancer · doi:10.1038/s43018-022-00388-9 · Cited by 357 · see citing works
A survey of the statistical power of research in behavioral ecology and animal behavior
Jennions, M. D. (2003) · Behavioral Ecology · doi:10.1093/beheco/14.3.438 · Cited by 278 · see citing works
Artificial intelligence-based methods for fusion of electronic health records and imaging data
Mohsen, F., Ali, H., El Hajj, N., & Shah, Z. (2022) · Scientific Reports · doi:10.1038/s41598-022-22514-4 · Cited by 250 · see citing works
Self-citationDinov, I. D., Heavner, B., Tang, M., Glusman, G., Chard, K., Darcy, M., Madduri, R., Pa, J., Spino, C., Kesselman, C., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0157077 · Cited by 145 · see citing works
Sambyal, N., Saini, P., & Syal, R. (2021) · Current Diabetes Reviews · doi:10.2174/1573399816666200511003357 · Cited by 19 · see citing works
Liu, J., Wang, L., Qian, Y., Shen, Q., Yang, M., Dong, Y., Chen, H., Yang, Z., Liu, Y., Cui, X., et al. (2022) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgac487 · Cited by 12 · see citing works
Flagged first, then by citations
Research works printed but not linked: 67
- [2]Griffin S Diabetes precision medicine: plenty of potential, pitfalls and perils but not yet ready for prime time Diabetologia 2022 65 1913 1921 35999379 PMC9522689
- [3]Schiborn C Schulze MB Precision prognostics for the development of complications in diabetes Diabetologia 2022 65 1867 1882 35727346 PMC9522742
- [4]Moons KG Risk prediction models: Ii. external validation, model updating, and impact assessment Heart 2012 98 691 698 22397946
- [5]Moons KG Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio) marker Heart 2012 98 683 690 22397945
- [6]Pencina MJ Goldstein BA D’Agostino RB Prediction models-development, evaluation, and clinical application N. Engl. J. Med. 2020 382 1583 1586 32320568
- [7]Altman DG Vergouwe Y Royston P Moons KG Prognosis and prognostic research: validating a prognostic model Br. Med. J. 2009 338 1432 1435 19477892
- [8]Noble D Mathur R Dent T Meads C Greenhalgh T Risk models and scores for type 2 diabetes: systematic review Br. Med. J. 2011 343 d7163 22123912 PMC3225074
- [9]Royston P Moons KG Altman DG Vergouwe Y Prognosis and prognostic research: developing a prognostic model Br. Med. J. 2009 338 1373 1377 19336487
- [10]Kodama S Predictive ability of current machine learning algorithms for type 2 diabetes mellitus: a meta-analysis J. Diabetes Investig. 2022 13 900 908 34942059 PMC9077721
- [11]Casanova R Prediction of incident diabetes in the jackson heart study using high-dimensional machine learning PloS ONE 2016 11 0163942 PMC5058485 27727289
- [12]Talaei-Khoei A Wilson JM Identifying people at risk of developing type 2 diabetes: a comparison of predictive analytics techniques and predictor variables Int. J. Med. Inform. 2018 119 22 38 30342683
- [13]Wang R Artificial intelligence in reproductive medicine Reproduction 2019 158 139 PMC6733338 30970326
- [14]Wang F Preininger A Ai in health: state of the art, challenges, and future directions Yearb. Med. Inform. 2019 28 016 026 PMC6697503 31419814
- [15]Chaki J Ganesh ST Cidham S Theertan SA Machine learning and artificial intelligence based diabetes mellitus detection and self-management: a systematic review J. King Saud. Univ. 2022 34 3204 3225
- [16]De Silva K Use and performance of machine learning models for type 2 diabetes prediction in community settings: a systematic review and meta-analysis Int. J. Med. Inform. 2020 143 104268 32950874
- [18]Cho A-R Lee S-B Hong K-W Jung D-H C-reactive protein-to-albumin ratio and 8-year incidence of type 2 diabetes: the korean genome and epidemiology study Acta Diabetol. 2021 58 1525 1532 34129103
- [19]Garcia-Carretero R Vigil-Medina L Barquero-Perez O The use of machine learning techniques to determine the predictive value of inflammatory biomarkers in the development of type 2 diabetes mellitus Metab. Syndr. Relat. Disord. 2021 19 240 248 33596118
- [20]Zhang L Predicting the development of type 2 diabetes in a large australian cohort using machine-learning techniques: longitudinal survey study JMIR Med. Inform. 2020 8 16850 PMC7420582 32720912
- [21]Perveen S Shahbaz M Keshavjee K Guergachi A Prognostic modeling and prevention of diabetes using machine learning technique Sci. Rep. 2019 9 13805 31551457 PMC6760163
- [22]Farran B Use of non-invasive parameters and machine-learning algorithms for predicting future risk of type 2 diabetes: a retrospective cohort study of health data from kuwait Front. Endocrinol. 2019 10 624 PMC6749017 31572303
- [23]Choi BG Machine learning for the prediction of new-onset diabetes mellitus during 5-year follow-up in non-diabetic patients with cardiovascular risks Yonsei Med. J. 2019 60 191 199 30666841 PMC6342710
- [24]Peddinti G Early metabolic markers identify potential targets for the prevention of type 2 diabetes Diabetologia 2017 60 1740 1750 28597074 PMC5552834
- [25]Alghamdi M Predicting diabetes mellitus using smote and ensemble machine learning approach: The henry ford exercise testing (fit) project PloS ONE 2017 12 0179805 PMC5524285 28738059
- [26]Liu Q Predicting the 2-year risk of progression from prediabetes to diabetes using machine learning among chinese elderly adults J. Personalized Med. 2022 12 1055 PMC9324396 35887552
- [27]Razavian N Population-level prediction of type 2 diabetes from claims data and analysis of risk factors Big Data 2015 3 277 287 27441408
- [28]Nguyen BP Predicting the onset of type 2 diabetes using wide and deep learning with electronic health records Comput. Methods Prog. Biomed. 2019 182 105055 31505379
- [29]Bernardini M Morettini M Romeo L Frontoni E Burattini L Early temporal prediction of type 2 diabetes risk condition from a general practitioner electronic health record: a multiple instance boosting approach Artif. Intell. Med. 2020 105 101847 32505428
- [30]Ravaut M Development and validation of a machine learning model using administrative health data to predict onset of type 2 diabetes JAMA Netw. open 2021 4 2111315 2111315 PMC8150694 34032855
- [31]Perveen S Handling irregularly sampled longitudinal data and prognostic modeling of diabetes using machine learning technique IEEE Access 2020 8 21875 21885
- [32]Wu Y Machine learning for predicting the 3-year risk of incident diabetes in chinese adults Front. Public Health 2021 9 626331 34268283 PMC8275929
- [33]Zhang K Deep-learning models for the detection and incidence prediction of chronic kidney disease and type 2 diabetes from retinal fundus images Nat. Biomed. Eng. 2021 5 533 545 34131321
- [34]Tang, Y. et al. Prediction of type ii diabetes onset with computed tomography and electronic medical records. In: Multimodal Learning for Clinical Decision Support and Clinical Image-Based Procedures: 10th International Workshop, ML-CDS 2020, and 9th International Workshop, CLIP 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 4–8, 2020, Proceedings 9, pp. 13–23. (Springer, 2020). PMC8188902 34113927
- [35]Wang Y Genetic risk score increased discriminant efficiency of predictive models for type 2 diabetes mellitus using machine learning: cohort study Front. Public Health 2021 9 606711 33681127 PMC7925839
- [36]Aasmets O Machine learning reveals time-varying microbial predictors with complex effects on glucose regulation Msystems 2021 6 01191 20 PMC8573957 33594006
- [37]Nusinovici S Logistic regression was as good as machine learning for predicting major chronic diseases J. Clin. Epidemiol. 2020 122 56 69 32169597
- [38]Perveen S Shahbaz M Ansari MS Keshavjee K Guergachi A A hybrid approach for modeling type 2 diabetes mellitus progression Front. Genet. 2020 10 1076 31969896 PMC6958689
- [39]Ramezankhani A Decision tree-based modelling for identification of potential interactions between type 2 diabetes risk factors: a decade follow-up in a middle east prospective cohort study BMJ Open 2016 6 013336 PMC5168628 27909038
- [40]Ramezankhani A The impact of oversampling with smote on the performance of 3 classifiers in prediction of type 2 diabetes Med. Decis. Mak. 2014 36 137 144 25449060
- [41]Ramezankhani A Applying decision tree for identification of a low risk population for type 2 diabetes. Tehran lipid and glucose study Diabetes Res Clin. Pract. 2014 105 391 8 25085758
- [42]Martínez-Hervás S Developing a simple and practical decision model to predict the risk of incident type 2 diabetes among the general population: the di@ bet. es study Eur. J. Intern. Med. 2022 102 80 87 35570127
- [43]Yun J-S A deep learning model for screening type 2 diabetes from retinal photographs Nutr. Metab. Cardiovasc. Dis. 2022 32 1218 1226 35197214 PMC9018521
- [44]Hahn S-J Kim S Choi YS Lee J Kang J Prediction of type 2 diabetes using genome-wide polygenic risk score and metabolic profiles: a machine learning analysis of population-based 10-year prospective cohort study Ebiomedicine 2022 86 104383 36462406 PMC9713286
- [45]Rhee SY Development and validation of a deep learning based diabetes prediction system using a nationwide population-based cohort Diabetes Metab. J. 2021 45 515 525 33631067 PMC8369223
- [47]Kim J Kim J Kwak M Bajaj M Genetic prediction of type 2 diabetes using deep neural network Clin. Genet. 2018 93 822 829 29136281
- [48]Allalou A A predictive metabolic signature for the transition from gestational diabetes mellitus to type 2 diabetes Diabetes 2016 65 2529 2539 27338739 PMC5001181
- [49]Abbas, H., Alic, L., Rios, M., Abdul-Ghani, M., Qaraqe, K. Predicting diabetes in healthy population through machine learning. In: 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS), pp. 567–570 (2019)
- [50]Islam MS Qaraqe MK Belhaouari SB Abdul-Ghani MA Advanced techniques for predicting the future progression of type 2 diabetes IEEE Access 2020 8 120537 120547
- [51]Abbas HT Predicting long-term type 2 diabetes with support vector machine using oral glucose tolerance test Plos ONE 2019 14 0219636 PMC6905529 31826018
- [52]Mani, S., Chen, Y., Elasy, T., Clayton, W., Denny, J.: Type 2 diabetes risk forecasting from emr data using machine learning. In: AMIA Annual Symposium Proceedings, vol. 2012, p. 606 (2012). PMC3540444 23304333
- [53]Fazakis N Machine learning tools for long-term type 2 diabetes risk prediction IEEE Access 2021 9 103737 103757
- [54]Nii, M. et al. Medical checkup and image data analysis for preventing life style diseases: a research survey of japan society for the promotion of science with grant-in-aid for scientific research (a)(grant number 25240038). In: 2015 7th International Conference on Emerging Trends in Engineering & Technology (ICETET), pp. 117–122 (2015).
- [55]Deberneh HM Kim I Prediction of type 2 diabetes based on machine learning algorithm Int. J. Environ. Res. Public Health 2021 18 3317 33806973 PMC8004981
- [56]Yamazaki H Fat distribution patterns and future type 2 diabetes Diabetes 2022 71 1937 1945 35724270
- [60]Moons KG Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (tripod): explanation and elaboration Ann. Intern. Med. 2015 162 1 73 25560730
- [62]Lipkova J Artificial intelligence for multimodal data integration in oncology Cancer Cell 2022 40 1095 1110 36220072 PMC10655164
- [63]Collins GS Reitsma JB Altman DG Moons KG Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (tripod): the tripod statement Ann. Intern. Med. 2015 162 55 63 25560714
- [64]Amal S Use of multi-modal data and machine learning to improve cardiovascular disease care Front. Cardiovasc. Med 2022 9 840262 35571171 PMC9091962
- [65]Bella, A., Ferri, C., Hernández-Orallo, J., Ramírez-Quintana, M.J. Calibration of machine learning models. In: Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, pp. 128–146 (2010)
- [67]Hardt M Price E Srebro N Equality of opportunity in supervised learning Adv. Neural Inf. Process. Syst. 2016 29 3315 3323
- [68]Siontis GC Tzoulaki I Castaldi PJ Ioannidis JP External validation of new risk prediction models is infrequent and reveals worse prognostic discrimination J. Clin. Epidemiol. 2015 68 25 34 25441703
- [69]Salazar de Pablo G Implementing precision psychiatry: a systematic review of individualized prediction models for clinical practice Schizophr. Bull. 2021 47 284 297 32914178 PMC7965077
- [71]Nosek BA Errington TM Reproducibility in cancer biology: making sense of replications Elife 2017 6 23383 PMC5245957 28100398
- [72]Gentleman, R., Carey, V.J. Unsupervised machine learning. In: Bioconductor Case Studies, pp. 137–157 (2008)
- [73]Guidotti R A survey of methods for explaining black box models ACM Comput. Surv. 2018 51 1 42
- [78]Chen IY Szolovits P Ghassemi M Can AI help reduce disparities in general medical and mental health care? AMA J. Ethics 2019 21 167 179 30794127
- [79]Ellis, R.J., Sander, R.M., Limon, A. Twelve key challenges in medical machine learning and solutions. Intell. Based Med.10.1016/j.ibmed.2022.100068 (2022). · DOI · Paper page
- [81]Goncalves A Generation and evaluation of synthetic patient data BMC Med. Res. Methodol. 2020 20 1 40 PMC7204018 32381039
Cited by
Sorted by citations
Next-generation agentic AI for transforming healthcare
Karunanayake, N. (2025) · Informatics and Health · doi:10.1016/j.infoh.2025.03.001 · Cited by 165 · see citing works
Alzheimer's disease digital biomarkers multidimensional landscape and AI model scoping review
Qi, W., Zhu, X., Wang, B., Shi, Y., Dong, C., Shen, S., Li, J., Zhang, K., He, Y., Zhao, M., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01640-z · Cited by 78 · see citing works
AI-based diabetes care: risk prediction models and implementation concerns
Wang, S. C. Y., Nickel, G., Venkatesh, K. P., Raza, M. M., & Kvedar, J. C. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01034-7 · Cited by 50 · see citing works
Multimodal Artificial Intelligence for Precision Critical Care: A Scoping Review
Yang, M., Shi, N., Chen, H., Po, E. Y. P., Ng, P. Y., Lai, P. C. K., Wu, Y.-C., & Fong, D. Y. T. (2026) · Health Data Science · doi:10.34133/hds.0356 · Cited by 3 · see citing works
“…of medical imaging and EHR data; similarly, Kline et al. [ 17 ] observed a mean AUC improvement of 6.4% when applying multimodal machine learning in precision health; and Mohsen et al. [ 35 ] identified an average AUC increase of 7% using multimodal fusion methods for diabetes risk prediction.”
Influential
- Authors
- Mohsen, F., Al-Absi, H. R. H., Yousri, N. A., El Hajj, N., & Shah, Z.
- Affiliations
- Hamad bin Khalifa University (QA)
- Corresponding author
- Shah, Zubair
- Venue
- npj Digital Medicine
- Published
- 2023-10-25
- Volume
- 6
- Issue
- 1
- Pages
- 197-197
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC10600138
- OpenAlex
- W4387949693
- Cited by
- 125
- References
- 14
- Citations by year
- 2026: 37 · 2025: 53 · 2024: 25 · 2023: 10
- FWCI
- 4.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Greater South Information System
- Funders
- Fonds National de la Recherche Luxembourg
- Qatar National Research Fund
- Qatar National Library
- Topics
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- type 2 diabetes, diabetes risk prediction, artificial intelligence, machine learning, electronic health records, multi-omics, multimodal models, external validation, model calibration, interpretability, risk predictors, clinical integration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review