Inflammatory and hematologic markers as predictors of severe outcomes in COVID-19 infection: A systematic review and meta-analysis
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Background Laboratory testing is commonly performed in patients with COVID-19. Each of the laboratory parameters has potential value for risk stratification and prediction of COVID-19 outcomes. This systematic review and meta-analysis aimed to evaluate the difference between these parameters in severe and nonsevere disease and to provide the optimal cutoff value for predicting severe disease. Method We performed a systematic literature search through electronic databases. The variables of interest were serum procalcitonin, albumin, C-reactive protein (CRP), D-dimer, and lactate dehydrogenase (LDH) levels in each group of severity outcomes from COVID-19. Results There were a total of 4848 patients from 23 studies. Our meta-analysis suggest that patients with severe COVID-19 infections have higher procalcitonin, (mean difference 0.07; 95% CI 0.05–0.10; p < 0.00001), CRP (mean difference 36.88; 95% CI 29.10–44.65; p < 0.00001), D-Dimer (mean difference 0.43; 95% CI 0.31–0.56; p < 0.00001), and LDH (mean difference 102.79; 95% CI 79.10–126.49; p < 0.00001) but lower levels of albumin (mean difference −4.58; 95% CI −5.76 to −3.39; p < 0.00001) than those with nonsevere COVID-19 infections. The cutoff values for the parameters were 0.065 ng/mL for procalcitonin, 38.85 g/L for albumin, 33.55 mg/L for CRP, 0.635 μ/L for D-dimer, and 263.5 U/L for LDH, each with high sensitivity and specificity. Conclusion This meta-analysis suggests elevated procalcitonin, CRP, D-dimer, and LDH and decreased albumin can be used for predicting severe outcomes in COVID-19.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · cited 1×
“A funnel plot, Begg's rank correlation method [17], and Egger's weighted regression method [18] were adopted to statistically assess publication bias (p < 0.”
MethodClinical features of patients infected with 2019 novel coronavirus in Wuhan, China
Huang, C., Wang, Y., Li, X., Ren, L., Zhao, J., Hu, Y., Zhang, L., Fan, G., Xu, J., Gu, X., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30183-5 · Cited by 48,884
Chen, N., Zhou, M., Dong, X., Qu, J., Gong, F., Han, Y., Qiu, Y., Wang, J., Liu, Y., Wei, Y., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30211-7 · Cited by 21,415
Wang, D., Hu, B., Hu, C., Zhu, F., Liu, X., Zhang, J., Wang, B., Xiang, H., Cheng, Z., Xiong, Y., et al. (2020) · JAMA · doi:10.1001/jama.2020.1585 · Cited by 20,148
La certeza de lo impredecible: Cultura Educación y Sociedad en tiempos de COVID19
Martínez González, M. (2020) · DSPACE System - Metalibrary (University of the Coast) · Cited by 18,463
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Wan, X., Wang, W., Liu, J., & Tong, T. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-135 · Cited by 11,735 · cited 1×
“[15] The mean values of parameters that were found to be significant in themeta-analysis were then used to generate receiver operating characteristic (ROC) curves using SPSS ver.”
MethodPathological findings of COVID-19 associated with acute respiratory distress syndrome
Xu, Z., Shi, L., Wang, Y., Zhang, J., Huang, L., Zhang, C., Liu, S., Zhao, P., Liu, H., Zhu, L., et al. (2020) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(20)30076-x · Cited by 8,545 · cited 1×
“Studies also suggest that under inflammatory conditions, dysregulation of the coagulation cascade in SARS-CoV-2 infection results in diffuse alveolar damage with cellular fibromyxoid exudates, pneumocyte desquamation, and formation of a hyaline membrane, pulmonary edema with hyaline membrane formation, and interstitia…”
BackgroundWiersinga, W. J., Rhodes, A., Cheng, A. C., Peacock, S. J., & Prescott, H. C. (2020) · JAMA · doi:10.1001/jama.2020.12839 · Cited by 4,609 · cited 1×
“Based on the pathophysiology of severe COVID-19, which involves a hyperinflammatory state, coagulation cascade, andmultiorgan dysfunction [11], several biomarkers that represent each of those conditions, such as CRP, procalcitonin, D-dimer, LDH, and albumin, might be helpful to predict the outcome of COVID-19.”
BackgroundClinical characteristics of 140 patients infected with SARS‐CoV‐2 in Wuhan, China
Zhang, J.-J., Dong, X., Cao, Y.-Y., Yuan, Y.-D., Yang, Y.-B., Yan, Y.-Q., Akdis, C. A., & Gao, Y.-D. (2020) · Allergy · doi:10.1111/all.14238 · Cited by 4,004
Role of C-Reactive Protein at Sites of Inflammation and Infection
Sproston, N. R., & Ashworth, J. J. (2018) · Frontiers in Immunology · doi:10.3389/fimmu.2018.00754 · Cited by 3,029 · cited 1×
“116 resistance against invading pathogens [45].”
Estimation of the Youden Index and its Associated Cutoff Point
Fluss, R., Faraggi, D., & Reiser, B. (2005) · Biometrical Journal · doi:10.1002/bimj.200410135 · Cited by 2,608 · cited 1×
“The optimal cutoff for parameters with a significant p-value (two-tailed) was determined using Youden's index [16], and the corresponding sensitivity and specificity for the cutoff were also calculated.”
MethodChannappanavar, R., & Perlman, S. (2017) · Seminars in Immunopathology · doi:10.1007/s00281-017-0629-x · Cited by 2,524 · cited 1×
“Studies also suggest that under inflammatory conditions, dysregulation of the coagulation cascade in SARS-CoV-2 infection results in diffuse alveolar damage with cellular fibromyxoid exudates, pneumocyte desquamation, and formation of a hyaline membrane, pulmonary edema with hyaline membrane formation, and interstitia…”
BackgroundCancer cell metabolism: warburg and beyond
Hsu, P. P., & Sabatini, D. M. (2008) · Cell · doi:10.1016/j.cell.2008.08.021 · Cited by 2,452 · cited 1×
“It is present in the cytoplasm of all human tissues, with higher concentrations in the liver, heart, and skeletal muscle [52].”
BackgroundChapter 7: Systematic reviews of etiology and risk
Moola, S., Munn, Z., Tufanaru, C., Aromataris, E., Sears, K., Sfetic, R., Currie, M., Lisy, K., Qureshi, R., Mattis, P., et al. (2019) · JBI Reviewer's Manual · doi:10.46658/jbirm-17-06 · Cited by 2,114
Assiri, A., Al-Tawfiq, J. A., Al-Rabeeah, A. A., Al-Rabiah, F. A., Al-Hajjar, S., Al-Barrak, A., Flemban, H., Al-Nassir, W. N., Balkhy, H. H., Al-Hakeem, R. F., et al. (2013) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(13)70204-4 · Cited by 1,435 · cited 1×
“It has been reported that elevated LDH levels are one of the most common findings in patients infected with MERS-CoV [53] and H5N1 [54] and are also one of the biomarkers most strongly associated with ARDS mortality [55].”
BackgroundChapter 7: Systematic reviews of etiology and risk
(2020) · JBI Manual for Evidence Synthesis · doi:10.46658/jbimes-20-08 · Cited by 1,268 · cited 1×
“They also independently evaluated the quality of the included caseseries studies using the Joanna Briggs Institute Critical Appraisal Checklist for Case Series [14].”
MethodDiagnostic utility of clinical laboratory data determinations for patients with the severe COVID‐19
Gao, Y., Li, T., Han, M., Li, X., Wu, D., Xu, Y., Zhu, Y., Liu, Y., Wang, X., & Wang, L. (2020) · Journal of Medical Virology · doi:10.1002/jmv.25770 · Cited by 1,047 · cited 2×
“[25] 43 Retrospective cohort Procalcitonin, CR”
BackgroundClinical Features and Treatment of COVID-19 Patients in Northeast Chongqing
Wan, S., Xiang, Y., Fang, W., Zheng, Y., Li, B., Hu, Y., Lang, C., Huang, D., Sun, Q., Xiong, Y., et al. (2020) · Journal of Medical Virology · doi:10.1002/jmv.25783 · Cited by 982 · cited 1×
“[34] 135 Retrospective case series Procalcitonin, Al”
COVID-19 with Different Severities: A Multicenter Study of Clinical Features
Feng, Y., Ling, Y., Bai, T., Xie, Y., Huang, J., Li, J., Xiong, W., Yang, D., Chen, R., Lu, F., et al. (2020) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.202002-0445oc · Cited by 838 · cited 2×
“[24] 406 Retrospective cohort Procalcitonin, Al”
Levitt, D., & Levitt, M. (2016) · International Journal of General Medicine · doi:10.2147/ijgm.s102819 · Cited by 763 · cited 1×
“In such patients, the synthesis of albumin is also disturbed, making hypoalbuminemia more profound [43].”
BackgroundHenry, B. M., Aggarwal, G., Wong, J., Benoit, S., Vikse, J., Plebani, M., & Lippi, G. (2020) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2020.05.073 · Cited by 608
D-dimer is Associated with Severity of Coronavirus Disease 2019: A Pooled Analysis
Lippi, G., & Favaloro, E. J. (2020) · Thrombosis and Haemostasis · doi:10.1055/s-0040-1709650 · Cited by 598 · cited 1×
“Proinflammatory cytokines also contribute to endothelial injury, which could activate coagulation and inhibit fibrinolysis in patients with severe COVID-19 [51].”
BackgroundSerum albumin and health in older people: Review and meta analysis
Cabrerizo, S., Cuadras, D., Gomez-Busto, F., Artaza-Artabe, I., Marín-Ciancas, F., & Malafarina, V. (2015) · Maturitas · doi:10.1016/j.maturitas.2015.02.009 · Cited by 579
Procalcitonin for diagnosis of infection and guide to antibiotic decisions: past, present and future
Schuetz, P., Albrich, W., & Mueller, B. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-107 · Cited by 528 · cited 1×
“Bacterial infections trigger extrathyroidal synthesis of PCT, which is actively maintained by elevated values of IL-6, IL-1β, and TNFα, while viral infections hinder PCT production due to interferon-γ [63].”
BackgroundGong, J., Ou, J., Qiu, X., Jie, Y., Chen, Y., Yuan, L., Cao, J., Tan, M., Xu, W., Zheng, F., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa443 · Cited by 513 · cited 2×
“[26] 189 Retrospective cohort Procalcitonin, CR”
BackgroundSchuetz, P., Wirz, Y., Sager, R., Christ-Crain, M., Stolz, D., Tamm, M., Bouadma, L., Luyt, C. E., Wolff, M., Chastre, J., et al. (2018) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(17)30592-3 · Cited by 486 · cited 1×
“While it is still controversial whether PCT can accurately distinguish bacterial or viral pneumonia [61], PCTguided therapy in acute respiratory infectionsmay reduce antibiotic exposure [62].”
BackgroundMargulis, A. V., Pladevall, M., Riera-Guardia, N., Varas-Lorenzo, C., Hazell, L., Berkman, N., Viswanathan, M., & Perez-Gutthann, S. (2014) · Clinical Epidemiology · doi:10.2147/clep.s66677 · Cited by 441 · cited 3×
“The Newcastle Ottawa Scale (NOS) was used to assess the cohort and case-control studies (Table 2), while the Joanna Briggs Institute Critical Appraisal checklistwas used for case series studies (Table 3).”
MethodInfluentialSong, J., Park, D. W., Moon, S., Cho, H.-J., Park, J. H., Seok, H., & Choi, W. S. (2019) · BMC Infectious Diseases · doi:10.1186/s12879-019-4618-7 · Cited by 348 · cited 1×
“An elevated serum PCT is often found in patients with sepsis and septic shock [60].”
BackgroundMartinez-Outschoorn, U. E., Prisco, M., Ertel, A., Tsirigos, A., Lin, Z., Pavlides, S., Wang, C., Flomenberg, N., Knudsen, E. S., Howell, A., et al. (2011) · Cell Cycle · doi:10.4161/cc.10.8.15330 · Cited by 338 · cited 1×
“Multiple organ injury and decreased oxygenation with upregulation of the glycolytic pathway can result in abnormal values because the acidic extracellular pH resulting from infection and tissue injury will activate metalloproteases and enhance macrophage-mediated angiogenesis [56].”
BackgroundProcalcitonin to Distinguish Viral From Bacterial Pneumonia: A Systematic Review and Meta-analysis
Kamat, I. S., Ramachandran, V., Eswaran, H., Guffey, D., & Musher, D. M. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciz545 · Cited by 272 · cited 1×
“While it is still controversial whether PCT can accurately distinguish bacterial or viral pneumonia [61], PCTguided therapy in acute respiratory infectionsmay reduce antibiotic exposure [62].”
BackgroundThe value of clinical parameters in predicting the severity of COVID‐19
Shang, W., Dong, J., Ren, Y., Tian, M., Li, W., Hu, J., & Li, Y. (2020) · Journal of Medical Virology · doi:10.1002/jmv.26031 · Cited by 270 · cited 2×
“[31] Cohort *** ** *** 8 Good Shi et al.”
The Characteristics of 50 Hospitalized COVID-19 Patients With and Without ARDS
Dreher, M., Kersten, A., Bickenbach, J., Balfanz, P., Hartmann, B., Cornelissen, C., Daher, A., Stöhr, R., Kleines, M., Lemmen, S. W., et al. (2020) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2020.0271 · Cited by 246 · cited 1×
“[22] 50 Prospective cohort Procalcitonin, CR”
Avian Influenza A (H5N1) Infection in Eastern Turkey in 2006
Oner, A. F., Bay, A., Arslan, S., Akdeniz, H., Sahin, H. A., Cesur, Y., Epcacan, S., Yilmaz, N., Deger, I., Kizilyildiz, B., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa060601 · Cited by 236
Sun, Y., Dong, Y., Wang, L., Xie, H., Li, B., Chang, C., & Wang, F.-S. (2020) · Journal of Autoimmunity · doi:10.1016/j.jaut.2020.102473 · Cited by 230 · cited 2×
“[33] 18 Prospective cohort Albumin, CRP, D”
BackgroundWang, C., Deng, R., Gou, L., Fu, Z., Zhang, X., Shao, F., Wang, G., Fu, W., Xiao, J., Ding, X., et al. (2020) · Annals of Translational Medicine · doi:10.21037/atm-20-3391 · Cited by 219 · cited 1×
“[35] 45 Retrospective cohort Albumin, D-Dim”
Lv, Z., Cheng, S., Le, J., Huang, J., Feng, L., Zhang, B., & Li, Y. (2020) · Microbes and Infection · doi:10.1016/j.micinf.2020.05.007 · Cited by 217
D-dimer Correlates With Proinflammatory Cytokine Levels and Outcomes in Critically Ill Patients
Shorr, A. F., Thomas, S. J., Alkins, S. A., Fitzpatrick, T. M., & Ling, G. S. (2002) · Chest · doi:10.1378/chest.121.4.1262 · Cited by 193 · cited 1×
“It is assumed that in severe COVID-19 (critically ill) patients, proinflammatory cytokines and the coagulation cascade, including Ddimer, are activated [48].”
BackgroundAlmazeedi, S., Al-Youha, S., Jamal, M. H., Al-Haddad, M., Al-Muhaini, A., Al-Ghimlas, F., & Al-Sabah, S. (2020) · eClinicalMedicine · doi:10.1016/j.eclinm.2020.100448 · Cited by 163 · cited 2×
“[19] Cohort **** ** *** 9 Good Alshukry et al.”
BackgroundDiagnostic value of blood parameters for community-acquired pneumonia
Huang, Y., Liu, A., Liang, L., Jiang, J., Luo, H., Deng, W., Lin, G., Wu, M., LI, T. W., & Jiang, Y. (2018) · International Immunopharmacology · doi:10.1016/j.intimp.2018.08.022 · Cited by 155 · cited 1×
“These combinations include the neutrophil to lymphocyte ratio (NLR) and the lymphocyte to C-reactive protein ratio (LCR) [10].”
BackgroundCoronavirus disease 2019 and cardiovascular system: A narrative review
Kwenandar, F., Japar, K. V., Damay, V., Hariyanto, T. I., Tanaka, M. S., Lugito, N. P. H., & Kurniawan, A. (2020) · IJC Heart & Vasculature · doi:10.1016/j.ijcha.2020.100557 · Cited by 141 · cited 1×
“However, the disease can deteriorate over a short period of time (between 7 and 10 days) into acute respiratory distress syndrome (ARDS) and other multiorgan complications due to rapid viral replication and cytokine storms [4,5].”
BackgroundSelf-citationHariyanto, T. I., & Kurniawan, A. (2020) · Obesity Medicine · doi:10.1016/j.obmed.2020.100290 · Cited by 132 · cited 1×
“Several comorbidities have also been demonstrated to be associated with the development of severe COVID-19, such as hypertension, diabetes mellitus, dyslipidemia, thyroid disease, cardiovascular disease, dementia, and pulmonary disease [6-9].”
BackgroundSelf-citationKhamis, F. A., Al-Zakwani, I. S., Naamani, H. A., Lawati, S. A., Pandak, N., Omar, M. B., Bahrani, M. A., Bulushi, Z. A., Khalili, H. A., Salmi, I. A., et al. (2020) · Journal of Infection and Public Health · doi:10.1016/j.jiph.2020.06.002 · Cited by 111 · cited 2×
“[29] Cohort *** ** *** 8 Good Lv et al.”
Predictors of progression from moderate to severe coronavirus disease 2019: a retrospective cohort
Cheng, B., Hu, J., Zuo, X., Chen, J., Li, X., Chen, Y., Yang, G., Shi, X., & Deng, A. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.06.033 · Cited by 92 · cited 2×
“[21] 456 Retrospective cohort Procalcitonin, Al”
Duan, J., Wang, X., Chi, J., Chen, H., Bai, L., Hu, Q., Han, X., Hu, W., Zhu, L., Wang, X., et al. (2020) · Journal of Medical Virology · doi:10.1002/jmv.26082 · Cited by 88 · cited 2×
“[23] 348 Retrospective cohort Procalcitonin, Al”
Zhang, S., Lian, J., Hu, J., Zhang, X., Lu, Y., Cai, H. Q., Gu, J., Ye, C., Jin, C., Yu, G., et al. (2020) · Infectious Diseases of Poverty · doi:10.1186/s40249-020-00710-6 · Cited by 86 · cited 1×
“[41] 113 Retrospective cohort Procalcitonin, Al”
Yang, L., Liu, J., Zhang, R., Li, M., Li, Z., Zhou, X., Hu, C., Tian, F., Zhou, F., & Lei, Y. (2020) · Journal of Clinical Virology · doi:10.1016/j.jcv.2020.104475 · Cited by 84 · cited 2×
“[38] 200 Retrospective cohort Procalcitonin, Al”
Clinical characteristics of coronavirus disease 2019 (COVID-19) patients in Kuwait
Alshukry, A., Ali, H., Ali, Y., Al-Taweel, T., Abu‐Farha, M., Abubaker, J. A., Devarajan, S., Dashti, A. A., Bandar, A., Taleb, H., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242768 · Cited by 84
Risk factors for severe COVID-19: Evidence from 167 hospitalized patients in Anhui, China
Wei, Y.-Y., Wang, R.-R., Zhang, D., Tu, Y.-H., Chen, C.-S., Ji, S., Li, C.-X., Li, X.-Y., Zhou, M.-X., Cao, W.-S., et al. (2020) · Journal of Infection · doi:10.1016/j.jinf.2020.04.010 · Cited by 80 · cited 2×
“[37] 167 Retrospective cohort Procalcitonin, Al”
BackgroundDementia is a predictor for mortality outcome from coronavirus disease 2019 (COVID-19) infection
Hariyanto, T. I., Putri, C., Situmeang, R. F. V., & Kurniawan, A. (2020) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-020-01205-z · Cited by 75 · cited 1×
“Several comorbidities have also been demonstrated to be associated with the development of severe COVID-19, such as hypertension, diabetes mellitus, dyslipidemia, thyroid disease, cardiovascular disease, dementia, and pulmonary disease [6-9].”
Self-citationHoeboer, S. H., Straaten, H. M. O., & Groeneveld, A. J. (2015) · BMC Pulmonary Medicine · doi:10.1186/s12890-015-0015-1 · Cited by 74
Hariyanto, T. I., & Kurniawan, A. (2020) · Journal of Medical Virology · doi:10.1002/jmv.26698 · Cited by 65 · cited 1×
“In particular, severe COVID-19 infections that mainly affect the lungs will release a high amount of LDH isozyme commonly found in lung tissue (LHD isoenzyme 3) [57,58].”
BackgroundSelf-citationCreamer, A. W., Kent, A. E., & Albur, M. (2019) · Breathe · doi:10.1183/20734735.0258-2019 · Cited by 57 · cited 1×
“A peptide precursor of the hormone calcitonin, PCT, has beenwidely investigated as a promising biomarker for the initial investigation of a bacterial infection [59].”
Shi, P., Ren, G., Yang, J., Li, Z., Deng, S., Li, M., Wang, S., Xu, X., Chen, F., Li, Y., et al. (2020) · Epidemiology and Infection · doi:10.1017/s0950268820002332 · Cited by 52 · cited 2×
“[32] Cohort *** ** *** 8 Good Sun et al.”
Liu, B., Gao, J., Li, Q., & Xu, L. (2008) · Clinica Chimica Acta · doi:10.1016/j.cca.2008.12.015 · Cited by 47 · cited 1×
“Moreover, albumin has been found to have the ability to downregulate ACE2 receptors [44], which is crucial for modulating COVID-19 infection; therefore, low levels of albuminwill possibly result in upregulation of ACE2 receptors and an increase in COVID-19 infectivity.”
Background
Metadata
- Authors
- Hariyanto, T. I., Japar, K. V., Kwenandar, F., Damay, V., Siregar, J. I., Lugito, N. P. H., Tjiang, M. M., & Kurniawan, A.
- Venue
- The American Journal of Emergency Medicine
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 41
- Pages
- 110-119
- ISSN
- 0735-6757 (ISSN-L)
- OpenAlex
- W3115208504
- Cited by
- 218
- References
- 55
- FWCI
- 2.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.