Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review
Open accessThe DOI matches its Crossref record; 141 of the 144 references it cites were found in a registry or an index.
Abstract
Objective: Electronic health records (EHRs) are an increasingly common data source for clinical risk prediction, presenting both unique analytic opportunities and challenges. We sought to evaluate the current state of EHR based risk prediction modeling through a systematic review of clinical prediction studies using EHR data. Methods: We searched PubMed for articles that reported on the use of an EHR to develop a risk prediction model from 2009 to 2014. Articles were extracted by two reviewers, and we abstracted information on study design, use of EHR data, model building, and performance from each publication and supplementary documentation. Results: We identified 107 articles from 15 different countries. Studies were generally very large (median sample size = 26 100) and utilized a diverse array of predictors. Most used validation techniques (n = 94 of 107) and reported model coefficients for reproducibility (n = 83). However, studies did not fully leverage the breadth of EHR data, as they uncommonly used longitudinal information (n = 37) and employed relatively few predictor variables (median = 27 variables). Less than half of the studies were multicenter (n = 50) and only 26 performed validation across sites. Many studies did not fully address biases of EHR data such as missing data or loss to follow-up. Average c-statistics for different outcomes were: mortality (0.84), clinical prediction (0.83), hospitalization (0.71), and service utilization (0.71). Conclusions: EHR data present both opportunities and challenges for clinical risk prediction. There is room for improvement in designing such studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In spite of the richness and potential of available data, scaling the development of predictive models is difficult because, for traditional predictive modeling techniques, each outcome to be predicted requires the creation of a custom dataset with specific variables.7”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Despite the rich data now digitized in EHRs,20 a recent systematic review of the medical literature7 found that predictive models built with EHR data use a median of only 27 variables, rely on traditional generalized linear models, and are built using data at a single center.”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Although external validation is recognized as an area of improvement for clinical risk prediction models [85]”
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationPrediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 2×
“Traditionally, risk pre- diction algorithms have been developed from large cohort studies such as the Framingham Heart Study.3 These studies were designed to follow people for years or even decades.”
MethodMoons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Joint modelling of longitudinal measurements and event time data
Henderson, R. (2000) · Biostatistics · doi:10.1093/biostatistics/1.4.465 · Cited by 913
The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future
Gottesman, O., Kuivaniemi, H., Tromp, G., Faucett, W. A., Li, R., Manolio, T. A., Sanderson, S. C., Kannry, J., Zinberg, R., Basford, M. A., et al. (2013) · Genetics in Medicine · doi:10.1038/gim.2013.72 · Cited by 698
Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC Curve
Cook, N. R. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096529 · Cited by 691
Research works printed but not linked: 1
- Liu, 2010, Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables, Med Care., 48, 739, 10.1097/mlr.0b013e3181e359f3 · DOI · Paper page
Cited by
Items 901–1,000 of 1,000
Bishara, A. M., Chiu, C., Whitlock, E. L., Douglas, V. C., Lee, S., Butte, A. J., Leung, J. M., & Donovan, A. L. (2022) · Figshare · doi:10.6084/m9.figshare.17799098
Labib, D. O. M. (2023) · Libraries and Cultural Resources (University of Calgary) · doi:10.11575/prism/dspace/41184
Abraham, A., Le, B. L., Kosti, I., Straub, P., Velez-Edwards, D. R., Davis, L. K., Newton, J. M., Muglia, L. J., Rokas, A., Bejan, C. A., et al. (2022) · Figshare · doi:10.6084/m9.figshare.21220054
Additional file 1 of Patient similarity analytics for explainable clinical risk prediction
Fang, H. S. A., Tan, N. C., Tan, W. Y., Oei, R. W., Lee, M. L., & Hsu, W. (2021) · Figshare · doi:10.6084/m9.figshare.14897350
Bishara, A. M., Chiu, C., Whitlock, E. L., Douglas, V. C., Lee, S., Butte, A. J., Leung, J. M., & Donovan, A. L. (2022) · Figshare · doi:10.6084/m9.figshare.17799092
Chen, Y., Hao, L., Zou, V. Z., Hollander, Z., Ng, R. T., & Isaac, K. V. (2022) · Figshare · doi:10.6084/m9.figshare.19759377
Withrow, D. R., Shine, B. S. F., Oke, J., Tamm, A., James, T., Morris, E., Davies, J., Harris, S., East, J. E., & Nicholson, B. D. (2022) · Figshare · doi:10.6084/m9.figshare.19359669
Hurst, J. H., Zhao, C., Hostetler, H. P., Ghorveh, M. G., Lang, J. E., & Goldstein, B. A. (2022) · Figshare · doi:10.6084/m9.figshare.19641970
Self-citationDauphinot, V., Laurent, M., Prodel, M., Civet, A., Vainchtock, A., Moutet, C., Krolak‐Salmon, P., & Garnier‐Crussard, A. (2024) · Figshare · doi:10.6084/m9.figshare.26384591
Bologa, C. G., Pankratz, V. S., Unruh, M. L., Roumelioti, M. E., Shah, V., Shaffi, S. K., Arzhan, S., Cook, J., & Argyropoulos, C. (2021) · Figshare · doi:10.6084/m9.figshare.15048945
Deardorff, W. J., Jing, B., Jeon, S. Y., Boscardin, W. J., Lee, A. K., Fung, K. Z., & Lee, S. J. (2022) · Figshare · doi:10.6084/m9.figshare.19793405
Chung, R. (2023) · Apollo (University of Cambridge) · doi:10.17863/cam.101704
Fridgeirsson, E. A., Sontag, D. A., & Rijnbeek, P. R. (2023) · Figshare · doi:10.6084/m9.figshare.24770267
Reps, J. M., Rijnbeek, P. R., Cuthbert, A. R., Ryan, P. B., Pratt, N., & Schuemie, M. J. (2021) · Figshare · doi:10.6084/m9.figshare.13727404
Chen, Y., Hao, L., Zou, V. Z., Hollander, Z., Ng, R. T., & Isaac, K. V. (2022) · Figshare · doi:10.6084/m9.figshare.19759386
Understanding and Addressing Uncertainty of the Crowd
Chen, Q. Z. (2022) · ResearchWorks at the University of Washington (University of Washington)
Do socioeconomic measures improve prediction of cardiovascular disease hospitalization?
Vasylkiv, V. (2022) · Mspace (University of Manitoba)
Registres de salut digitals: Tractament de dades i construcció de models de predicció de malaltia
Cros Roura, S. (2021) · O2 - Repositori Institucional (Universitat Oberta de Catalunya)
Data Informed Decision Making: Cardiovascular Disease Prevention
Mohammad Ammar Faiq, A. (. (2019) · Research Repository (Delft University of Technology)
On Semi-Parametric Regression for Time-to-Event Analyses in Electronic Health Records Studies
Conniff, K. R. (2024) · eScholarship (California Digital Library)
Petter, E. (2025) · eScholarship (California Digital Library)
Fowler, E. N. (2018) · OhioLink ETD Center (Ohio Library and Information Network)
Screening for Delirium Using the Electronic Medical Record
Hendrie, K. A., & Hendrie, K. A. (2023) · UA Campus Repository (The University of Arizona)
Early detection of cancer among patients presenting to healthcare services with fatigue
White, B. (2023) · UCL Discovery (University College London)
The epidemiology of symptom diagnoses in general practice
Chaabouni, A. (2025) · Radboud Repository (Radboud University)
Linking AI for Intervention Strategies: A systematic Review for Nursing
Fascia, M. (2024) · Edinburgh Napier Research Repository (Edinburgh Napier University)
Dynamic joint modelling of longitudinal and survival data using a state space framework
Cauchi, M. (2024) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Latent Factor Point Processes for Patient Representation in Electronic Health RecordsPreprint
Knight, P., Zhou, D., Xia, Z., Cai, T., & Lu, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.20327
Predicting Progression of Metabolic Dysfunction-associated Steatotic Liver Disease
Li, J. (2025) · DSpace@MIT (Massachusetts Institute of Technology)
Application of Machine Learning Models for Patients Health Insurance Cost Prediction
Majumder, A. B., Das, S., Biswas, A., Ghosh, T., Poddar, R., & Chakraborty, S. (2025) · International Journal of Soft Computing and Engineering · doi:10.35940/ijsce.d3685.15040925
Maqungo, M. (2025) · Open University of Cape Town (University of Cape Town)
Vatsa, R. (2024) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Honwana, F. E. (2025) · Open University of Cape Town (University of Cape Town)
Білявенко, Л., & Козак, Л. (2025) · Наука і техніка сьогодні · doi:10.52058/2786-6025-2025-11(52)-1899-1911
Sariaslan, A., Fanshawe, T. R., Forsman, J., Pitkänen, J., Kuja‐Halkola, R., Brikell, I., Chang, Z., Larsson, H., Martikainen, P., Lichtenstein, P., et al. (2025) · medRxiv · doi:10.64898/2025.12.17.25342475
AI-Based Medical Diagnosis System Using Machine Learning
Patni, J. C., Leni, A. E. S., Singh, A., Parida, P. Y., Singh, A. P., Agrawal, P., & Shingne, H. (2025) · International Conference on Emerging Trends in Networks and Computer Communications (ETNCC) · doi:10.1109/etncc66224.2025.11299658
Uthama Kumar, A., & Makal, R. (2025) · International Journal of Computer Applications · doi:10.5120/ijca2025926009
Clinical Decision Support Systems Based on Historical Patient Data
Pambala, G. (2026) · IJIREEICE · doi:10.17148/ijireeice.2021.91221
Digital Metabolism Twins Reveal Latent Dietary Metabolic States for Diabetes Risk StratificationPreprint
Kaipa, V. K. (2026) · Research Square · doi:10.21203/rs.3.rs-8573646/v1
Secondary Use of Health Data as a Core Capability in Medical Informatics (Preprint)Preprint
Vargas, A. I. C. (2026) · doi:10.2196/preprints.92049
Cyber-Medical Systems for AI-Driven Precision and Preventive HealthcarePreprint
Nath, K. C. (2026) · doi:10.36227/techrxiv.176948389.97362819/v1
Integrating Electronic Health Records with Machine Learning for Decision Support
Olaniran, O. (2024) · International Journal of Emerging Research in Engineering and Technology · doi:10.63282/3050-922x.ijeret-v5i4p115
Sağlık Yönetiminde Güncel Konular
SEYHAN, F., Hatipler, Ç., Ekinci, G., Danayiyen, A., Çalışal, S., Altın, U., Dönmez, B., Altan, F., Aksoy, M. R., Alu, A., et al. (2026) · Akademisyen Kitabevi eBooks · doi:10.37609/akya.3999
Muthulingam, G. A., Nagaraj, P., Kanna, R. R., Sakthi Sanjay, S., Vijayakumar, M., & Rohith, K. (2025) · International Conference on Intelligent Computing, Information and Control Systems (ICOIICS) · doi:10.1109/icoiics67115.2025.11390403
Wang, X., Zhong, B., Du, Y., & Dong, X. (2025) · International Conference on Health Big Data and Intelligent Healthcare (ICHIH) · doi:10.1145/3792746.3792760
Transfer Learning with Network Embeddings under Structured MissingnessPreprint
Li, M., Li, X., Mandl, K. D., & Cai, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.19922
L, A. N. T. (2024) · Tuwhera (Auckland University of Technology)
Dormosh, N. (2023) · UvA-DARE (University of Amsterdam)
Kom, I. Y. (2024) · Pure Amsterdam UMC
The Impact of Electronic Health Systems on Nursing Work Efficiency
Dulskytė, M. (2024) · Lithuanian University of Health Sciences
McBurney, S. H. (2022) · TSpace (University of Toronto)
Sequeira, L. (2022) · TSpace (University of Toronto)
Harbaoui, H., Harbeoui, H., & Tounsi, M. S. (2026) · Exon. · doi:10.69936/en06y0026
Abdel-Zahra, T. A., & Alshiblawy, H. J. (2026) · Journal of Health and Biology · doi:10.71428/jhb.2026.0104
Wang, Z., Jiang, J., & Ni, G. (2026) · Research Square · doi:10.21203/rs.3.rs-8705732/v1
Haque, M. A. (2025) · Mspace (University of Manitoba)
Koulaouzidis, A., Toth, E., & Marlicz, W. M. (2026) · Digestive Diseases and Sciences · doi:10.1007/s10620-026-09834-5
Predictive Modeling for Patient Outcomes in Healthcare Decision Systems
Emmanuel, M. (2025) · International Journal of Modern Scientific Discoveries · doi:10.64137/31079377/ijmsd-v1i2p105
Heterogeneous readmission prediction with hierarchical effect decomposition and regularizationPreprint
Jiang, Z., Huo, L., Hou, J., Vaughan-Sarrazin, M., Smith, M. A., & Huling, J. D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.19569
Do, D. A. (2023) · Institutional Repositories DataBase (IRDB) · doi:10.15083/0002012114
The Application and Challenges of Regression Analysis Methods in Clinical Research
Fei, H., & Jia, H. (2025) · International Journal of Clinical and Experimental Medicine Research · doi:10.26855/ijcemr.2025.11.019
Transparent approach based on deep learning and multiagent argumentation for hypertension management
Sendi, N. (2020) · theses.fr (ABES) · doi:10.70675/287e3bf5z984az4b7azbffaz0e578f463977
PUBLIC HEALTH DATA ANALYSIS FOR DISEASE PATTERN IDENTIFICATION
Kumar, B. A., Chandana, A. S. S., Saranya, G. S., Divya, G. S., & Sirisha, A. V. (2026) · International Journal of Innovative Research in Technology · doi:10.64643/ijirtv12i10-194822-459
Equiflow: An open-source software package for evaluating changes in cohort composition
Ellen, J., Fernandes, C. O., Viola, M., Yap, K., Jordan, A., Kirabo, M. F., de Matos, J. C. R. G., Moreira, P., & Celi, L. A. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001342
李, 艺. (2026) · Advances in Clinical Medicine · doi:10.12677/acm.2026.1641461
Suh, E., Kim, S., Kuk, S., Kim, K. M., & Jeong, Y. (2026) · doi:10.2196/preprints.96690
Saddari, A., Rassemadji, C., Boulkassoum, M., Lekfif, H., Lahmer, M., Ezrari, S., Madani, M., Kerkri, A., & Maleb, A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-18716-1_33
Khattab, A., Wang, Z., Srinivasasainagendra, V., Tiwari, H. K., Loos, R. J. F., Limdi, N. A., & Irvin, M. R. (2026) · medRxiv · doi:10.64898/2026.04.21.26351384
Population Health Data Systems and Insight Generation
Reddy, V. A. R. (2026) · doi:10.70593/978-93-7185-810-6_8
AI-Based Clinical Decision Support Framework for Health Report Visual Analytics
Gajalakshmi, N., Harishmi, R., & Lishiga, T. (2026) · International Research Journal on Advanced Engineering Hub (IRJAEH) · doi:10.47392/irjaeh.2026.0300
Steiner, L. M., Zwakhalen, S. M. G., Bonetti, L., & Hahn, S. (2026) · BMC Geriatrics · doi:10.1186/s12877-026-07468-w
Jiang, W., Chen, L., Tang, Y., & Deng, X. (2026) · Research Square · doi:10.21203/rs.3.rs-9218650/v1
Artificial intelligence in ovarian cancer: advancing in precision diagnosis and clinical management
Shao, M., Wang, T., Ji, L., Xu, L., Zhang, Y., Wang, D. Q., Jia, C., Chen, L., Zhang, H., Yan, W., et al. (2026) · Frontiers in Immunology · doi:10.3389/fimmu.2026.1795144
(2026) · Wiley eBooks · doi:10.1002/9781394369683.biblio
MACHINE LEARNING-BASED PREDICTION OF MORTALITY RISK IN HEART FAILURE PATIENTS USING CLINICAL DATA
McMurray, J. J. V. (2026) · IJRDO-Journal of Applied Science · doi:10.69980/as.v12i2.6674
Song, H. (2026) · VTechWorks (Virginia Tech)
Mai, X., Liu, Y., Ning, Y., Wacker, D. A., Lin, M., Liu, N., Puskarich, M. A., & Xie, F. (2026) · Research Square · doi:10.21203/rs.3.rs-9161309/v1
Responsabilidad y compromiso social ante la inteligencia artificial en salud
Pérez, L. F.-C., Targarona, E. M., & Ibeas, J. (2026) · Medicina Clínica · doi:10.1016/j.medcli.2026.107446
Poreddy, K. K. R., Sahu, A., Mukherjee, S., & Basavaraju, B. K. (2026) · doi:10.2196/preprints.101580
Leveraging Machine Learning to Assess Post-COVID-19 Glycemic Control in Diabetic Patients
Lluberes-Contreras, M., Figueroa-Santiago, E., Kohan‐Ghadr, H., Ortiz-Ortega, A., & Roche-Lima, A. (2026) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph23050644
Ju, Y. J., & Lee, S. Y. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03536-8
Suh, E., Kim, S., Kuk, S., Kim, K., & Jeong, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-9465265/v1
Kapatais, C., Karaoulani, F., Fortis, S. P., Saritzoglou, M., Martsoukos, N., & Kapatais, A. (2026) · Viruses · doi:10.3390/v18060610
Gunn, C. M., Boyer, N. C., Sheikh, S., Lee, J. M., Woloshin, S., Specht, J. M., Hubbard, R. A., Bowles, E. J. A., & Tosteson, A. N. A. (2026) · JCO Oncology Practice · doi:10.1200/op-25-01048
Improving clinical decision-making and operational efficiency through predictive analytics
Karthikeyan, V., & Visu, Y. P. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-41545-6.00017-8
Ledebur, K., Devetak, M., & Klimek, P. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-03265-2
Utility of large observational datasets for clinical prediction
John, L. H. (2026) · EUR Research Repository (Erasmus University Rotterdam)
Statistical Methods for Institution-Scale Science
Knight, P. (2026) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
The Statistical CompassPreprint
Cui, E. H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.11282
AI Driven CNN-LSTM Hybrid Neural Network for Robust Heart Disease Prediction
Hasan, M. M., Abdullah, Z., & Nity, F. S. (2026) · IEEE International Conference on Quantum Photonics, Artificial Intelligence & Networking (QPAIN) · doi:10.1109/qpain69676.2026.11545908
The Clinomics Approach to Precision Health
Yorke, B. (2026) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/dh9m-ej83
Olaniran, O. R., Kunle, S. A., Alzahrani, A., Alharbi, M. H., Alharbi, N. M., & Alzahrani, A. A. (2026) · Mathematics · doi:10.3390/math14122084
Kesselmeier, M., Thalheim, T., Schmidt, F., Peschel, T., Palm, J., Strübing, A., Medek, A., Przybilla, J., Wermund, A. M., Maas, R., et al. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03550-w
Liu, Y., Chen, X., Hu, Y., Shi, K., Xiao, W., & Ang, C. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1849932
Interpretação de Modelos de Aprendizado de Máquina Aplicados à Saúde com SHAP
Raposo, L. M., & Stelet, V. N. (2026) · doi:10.5753/sbc.19670.4.2
Gupta, R. D., Wu, X., Liu, X., & He, J. (2025) · doi:10.1109/ccat68690.2025.00034
Metadata
- Authors
- Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A.
- Affiliations
- Duke University (US)
- Center for Predictive Medicine, Duke Clinical Research Institute, Duke University, Durham, NC 27710, USA
- Stanford University (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-05-17
- Volume
- 24
- Issue
- 1
- Pages
- 198-208
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC5201180
- OpenAlex
- W2395172628
- Cited by
- 936
- References
- 144
- Citations by year
- 2026: 132 · 2025: 115 · 2024: 97 · 2023: 98 · 2022: 107 · 2021: 122 · 2020: 100 · 2019: 82 · 2018: 59 · 2017: 15 · 2016: 6
- FWCI
- 9.07
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (K25DK097279)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, clinical risk prediction, risk prediction model, model validation, multicenter validation, longitudinal data, missing data, loss to follow-up, model reproducibility, concordance index, mortality prediction, hospitalization prediction, service utilization
- MeSH terms
- Humans, Models, Statistical, Risk Assessment, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.