Bias in Peripheral Depression Biomarkers
The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
Background: To aid in the differentiation of individuals with major depressive disorder (MDD) from healthy controls, numerous peripheral biomarkers have been proposed. To date, no comprehensive evaluation of the existence of bias favoring the publication of significant results or inflating effect sizes has been conducted. Methods: Here, we performed a comprehensive review of meta-analyses of peripheral nongenetic biomarkers that could discriminate individuals with MDD from nondepressed controls. PubMed/MEDLINE, EMBASE, and PsycINFO databases were searched through April 10, 2015. Results: From 15 references, we obtained 31 eligible meta-analyses evaluating biomarkers in MDD (21,201 cases and 78,363 controls). Twenty meta-analyses reported statistically significant effect size estimates. Heterogeneity was high (I2 ≥50%) in 29 meta-analyses. We plausibly assumed that the true effect size for a meta-analysis would equal the one of its largest study. A significant summary effect size estimate was observed for 20 biomarkers. We observed an excess of statistically significant studies in 21 meta-analyses. The summary effect size of the meta-analysis was higher than the effect of its largest study in 25 meta-analyses, while 11 meta-analyses had evidence of small-study effects. Conclusions: Our findings suggest that there is an excess of studies with statistically significant results in the literature of peripheral biomarkers for MDD. The selective publication of ‘positive studies' and the selective reporting of outcomes are possible mechanisms. Effect size estimates of meta-analyses may be inflated in this literature.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“although evidence of bias may limit inferences derived from the literature on peripheral biomarkers for MDD (14).”
From Peripheral cytokine and chemokine alterations in depression: a meta‐analysis of 82 studies (2017) · cites this paper as [14]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
A Meta-Analysis of Cytokines in Major Depression
Dowlati, Y., Herrmann, N., Swardfager, W., Liu, H., Sham, L., Reim, E. K., & Lanctôt, K. L. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.09.033 · Cited by 4,729
Self-citationWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Associations of depression with C-reactive protein, IL-1, and IL-6: a meta-analysis.
Howren, M. B., Lamkin, D. M., & Suls, J. (2009) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181907c1b · Cited by 2,766
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Cited by
Peripheral cytokine and chemokine alterations in depression: a meta‐analysis of 82 studies
Köhler, C. A., Freitas, T. H., Maes, M., de Andrade, N. Q., Liu, C. S., Fernandes, B. S., Stubbs, B., Solmi, M., Veronese, N., Herrmann, N., et al. (2017) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12698 · Cited by 1,443
“1, and the ES of the largest study was more conservative or changed direction when compared with the overall ES estimate (funnel plots of ES estimates in which evidence of publication bias was observed are illustrated in Figs S10–S14) (14).”
BackgroundResultSelf-citationThe new field of ‘precision psychiatry’
Fernandes, B. S., Williams, L. M., Steiner, J., Leboyer, M., Carvalho, A. F., & Berk, M. (2017) · BMC Medicine · doi:10.1186/s12916-017-0849-x · Cited by 549
“Considering that no single biomarker will probably define any psychiatric disorder as defined by traditional diagnostic boundaries [13, 20, 21], it will be essential to pursue in parallel theory- and data-driven discovery approaches to delineate the multivariate and combinatorial profiles of biomarkers (across units o…”
Self-citationDietary fiber and health outcomes: an umbrella review of systematic reviews and meta-analyses
Veronese, N., Solmi, M., Caruso, M. G., Giannelli, G., Osella, A. R., Evangelou, E., Maggi, S., Fontana, L., Stubbs, B., & Tzoulaki, I. (2018) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqx082 · Cited by 536
Köhler, C. A., Freitas, T. H., Stubbs, B., Maes, M., Solmi, M., Veronese, N., de Andrade, N. Q., Morris, G., Fernandes, B. S., Brunoni, A. R., et al. (2017) · Molecular Neurobiology · doi:10.1007/s12035-017-0632-1 · Cited by 449
Self-citationKöhler, C. A., Evangelou, E., Stubbs, B., Solmi, M., Veronese, N., Belbasis, L., Bortolato, B., Melo, M. C. A., Coelho, C. A., Fernandes, B. S., et al. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.05.020 · Cited by 302
Self-citationMachado, M. O., Veronese, N., Sanches, M., Stubbs, B., Koyanagi, A., Thompson, T., Tzoulaki, I., Solmi, M., Vancampfort, D., Schuch, F. B., et al. (2018) · BMC Medicine · doi:10.1186/s12916-018-1101-z · Cited by 264
“10 in the Egger’s test and the ES of the largest study being more conservative than the summary random effects ES of the meta-analysis were considered indicative of small-study effects [41].”
MethodSelf-citationKim, J. Y., Son, M. J., Son, C. Y., Radua, J., Eisenhut, M., Gressier, F., Koyanagi, A., Carvalho, A. F., Stubbs, B., Solmi, M., et al. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30181-6 · Cited by 271
Self-citationComprehensive geriatric assessment in older people: an umbrella review of health outcomes
Veronese, N., Custodero, C., Demurtas, J., Smith, L., Barbagallo, M., Maggi, S., Cella, A., Vanacore, N., Aprile, P. L., Ferrucci, L., et al. (2022) · Age and Ageing · doi:10.1093/ageing/afac104 · Cited by 184
Bortolato, B., Köhler, C. A., Evangelou, E., León‐Caballero, J., Solmi, M., Stubbs, B., Belbasis, L., Pacchiarotti, I., Kessing, L. V., Berk, M., et al. (2017) · Bipolar Disorders · doi:10.1111/bdi.12490 · Cited by 195
“10 in Egger’s test and the ES of the largest study being more conservative than the summary ES of the randomeffects meta -analysis were considered as indicative of small-study effects .(27) Finally, we assessed whether an excess of significant findings was present by means of the Ioannidis’s test.”
Self-citationEvidence-based umbrella review of 162 peripheral biomarkers for major mental disorders
Carvalho, A. F., Solmi, M., Sanches, M., Machado, M. O., Stubbs, B., Ajnakina, O., Sherman, C., Sun, Y. R., Liu, C. S., Brunoni, A. R., et al. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0835-5 · Cited by 204
Self-citationDessauer, C. W., Watts, V. J., Ostrom, R. S., Conti, M., Dove, S., & Seifert, R. (2017) · Pharmacological Reviews · doi:10.1124/pr.116.013078 · Cited by 201
“We are fully aware of the current discussion about data reproducibility (Kannt and Wieland, 2016) and positive publication bias (Carvalho et al., 2016).”
BackgroundPeripheral Markers of Depression
Nobis, A., Zalewski, D., & Waszkiewicz, N. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9123793 · Cited by 197
Razza, L. B., Moffa, A. H., Moreno, M. L., Carvalho, A. F., Padberg, F., Fregni, F., & Brunoni, A. R. (2018) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.10.016 · Cited by 172
Self-citationMachado, M. O., Stergiopoulos, V., Maes, M. H. J., Kurdyak, P. A., Lin, P.-Y., Wang, L., Shyu, Y., Firth, J., Koyanagi, A., Solmi, M., et al. (2019) · JAMA Dermatology · doi:10.1001/jamadermatol.2019.0759 · Cited by 166
Self-citationBelbasis, L., Köhler, C. A., Stefanis, N., Stubbs, B., van Os, J., Vieta, E., Seeman, M. V., Arango, C., Carvalho, A. F., & Evangelou, E. (2018) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12847 · Cited by 148
Self-citationSarcopenia and health-related outcomes: an umbrella review of observational studies
the Special Interest Groups in Systematic Reviews and Meta-analyses for healthy ageing Sarcopenia and Frailty and resilience in older persons of the European Geriatric Medicine Society (EuGMS), Veronese, N., Demurtas, J., Soysal, P., Smith, L., Torbahn, G., Schoene, D., Schwingshackl, L., Sieber, C. C., Bauer, J. M., et al. (2019) · European Geriatric Medicine · doi:10.1007/s41999-019-00233-w · Cited by 140
Veronese, N., Demurtas, J., Pesolillo, G., Celotto, S., Barnini, T., Calusi, G., Caruso, M. G., Notarnicola, M., Reddavide, R., Stubbs, B., et al. (2019) · European Journal of Nutrition · doi:10.1007/s00394-019-01905-w · Cited by 125
Cognitive Impairment in Euthymic Pediatric Bipolar Disorder: A Systematic Review and Meta-Analysis
Elias, L. R., Miskowiak, K. W., Vale, A. M. O., Köhler, C. A., Kjærstad, H. L., Stubbs, B., Kessing, L. V., Vieta, E., Maes, M., Goldstein, B. I., et al. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2017.01.008 · Cited by 104
Self-citationMetabolomic changes in animal models of depression: a systematic analysis
Pu, J., Liu, Y., Gui, S., Tian, L., Yu, Y., Song, X., Zhong, X., Chen, X., Chen, W., Zheng, P., et al. (2021) · Molecular Psychiatry · doi:10.1038/s41380-021-01269-w · Cited by 107
Agah, E., Zardoui, A., Saghazadeh, A., Ahmadi, M., Tafakhori, A., & Rezaei, N. (2018) · PLOS ONE · doi:10.1371/journal.pone.0190252 · Cited by 92
Gruzdev, S. K., Yakovlev, A. A., Druzhkova, T. A., Guekht, A. B., & Gulyaeva, N. V. (2019) · Cellular and Molecular Neurobiology · doi:10.1007/s10571-019-00684-6 · Cited by 75
Veronese, N., Demurtas, J., Celotto, S., Caruso, M. G., Maggi, S., Bolzetta, F., Firth, J., Smith, L., Schofield, P., Koyanagi, A., et al. (2018) · Clinical Nutrition · doi:10.1016/j.clnu.2018.05.019 · Cited by 73
Immune Aberrations in Obsessive-Compulsive Disorder: a Systematic Review and Meta-analysis
Cosco, T. D., Pillinger, T., Emam, H., Solmi, M., Budhdeo, S., Prina, M. A., Maes, M. H. J., Stein, D. J., Stubbs, B., & Carvalho, A. F. (2018) · Molecular Neurobiology · doi:10.1007/s12035-018-1409-x · Cited by 65
Self-citationVeronese, N., Gianfredi, V., Solmi, M., Barbagallo, M., Dominguez, L. J., Mandalà, C., Palermo, C. D., Carruba, L., Solimando, L., Stubbs, B., et al. (2025) · Clinical Nutrition · doi:10.1016/j.clnu.2025.06.021 · Cited by 61
LUPIEN, S. J., Sasseville, M., François, N., Giguère, C., Boissonneault, J., Plusquellec, P., Godbout, R., Xiong, L., Potvin, S., Kouassi, É., et al. (2017) · Stress · doi:10.1080/10253890.2017.1286324 · Cited by 58
“This high discrepancy of data has been related to various factors, ranging from publication bias (Carvalho et al., 2016), changes in glucocorticoid receptors' regulation (Yehuda et al.”
BackgroundHomocysteine as a peripheral biomarker in bipolar disorder: A meta-analysis
Salagre, E., Vizuete, A. F., Leite, M., Brownstein, D. J., McGuinness, A., Jacka, F., Dodd, S., Stubbs, B., Köhler, C. A., Vieta, E., et al. (2017) · European Psychiatry · doi:10.1016/j.eurpsy.2017.02.482 · Cited by 46
“A strength of this meta-analysis is that we found no evidence of publication bias, a common issue with biomarkers in psychiatric disorders such as BD [55] and major depressive disorder [54], as the funnel plot was symmetric.”
MethodSelf-citationBehavioural biomarkers and mobile mental health: a new paradigm
Hidalgo‐Mazzei, D., Young, A. H., Vieta, E., & Colom, F. (2018) · International Journal of Bipolar Disorders · doi:10.1186/s40345-018-0119-7 · Cited by 52
Brownstein, D. J., Salagre, E., Köhler, C., Stubbs, B., Vian, J., Pereira, C., Chavarria, V., Karmakar, C., Turner, A., Quevedo, J., et al. (2018) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867417721654 · Cited by 46
Self-citationDiagnostic biomarkers for obsessive-compulsive disorder: A reasonable quest or ignis fatuus?
Fullana, M. A., Abramovitch, A., Via, E., López-Sola, C., Goldberg, X., Reina, N., Fortea, L., Solanes, A., Buckley, M. J., Ramella-Cravaro, V., et al. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.08.008 · Cited by 44
Self-citationFunctional Implications of the IL-23/IL-17 Immune Axis in Schizophrenia
Debnath, M., & Berk, M. (2016) · Molecular Neurobiology · doi:10.1007/s12035-016-0309-1 · Cited by 43
Self-citationGrabovac, I., Veronese, N., Štefanac, S., Haider, S., Jackson, S. E., Koyanagi, A., Meilinger, M., Stubbs, B., Firth, J., Soysal, P., et al. (2019) · Clinical Infectious Diseases · doi:10.1093/cid/ciz539 · Cited by 39
“10, with more conservative effects in larger studies than in random-effects meta-analyses, was considered as indicative of small-study effects [22].”
BackgroundWainberg, M., Kloiber, S. M., Diniz, B. S., McIntyre, R. S., Felsky, D., & Tripathy, S. J. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01505-5 · Cited by 42
“Publication bias [4, 18], confounding [6], small sample size, and methodological heterogeneity across studies [4, 5], all complicate the interpretation of prior studies on this topic.”
BackgroundPrecision non-implantable neuromodulation therapies: a perspective for the depressed brain
Borrione, L., Bellini, H., Razza, L. B., Ganho-Ávila, A., Baeken, C., Brem, A., Busatto, G. F., Carvalho, A. F., Chekroud, A. M., Daskalakis, Z. J., et al. (2020) · Brazilian Journal of Psychiatry · doi:10.1590/1516-4446-2019-0741 · Cited by 38
Self-citationVeronese, N., Demurtas, J., Thompson, T., Solmi, M., Pesolillo, G., Celotto, S., Barnini, T., Stubbs, B., Maggi, S., Pilotto, A., et al. (2020) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.14310 · Cited by 39
“10.(25) Finally, we applied the excess of significance test.”
MethodZilocchi, M., Broderick, K., Phanse, S., Aly, K. A., & Babu, M. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.09.008 · Cited by 34
Xu, Y., Zhang, Y., Zhao, D., Tian, Y., & Yuan, T. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00118-9 · Cited by 34
Biomarkers for Psychosis: Are We There Yet? Umbrella Review of 1478 Biomarkers
Fuentes‐Claramonte, P., Estradé, A., Solanes, A., Ramella‐Cravaro, V., García‐León, M. Á., de Diego-Adeliño, J., Molins, C., Fung, E., Valentí, M., Anmella, G., et al. (2024) · Schizophrenia Bulletin Open · doi:10.1093/schizbullopen/sgae018 · Cited by 28
“41,68,203,204 Furthermore, reporting bias via the Egger test could not be assessed for 87.5% of all factors due to insufficient data or due to only one study being included, and was significant for 1.1% and non-significant for 11.4% of biomarkers.”
MethodInfluentialImaging genetics paradigms in depression research: Systematic review and meta-analysis
Pereira, L. P., Köhler, C. A., Stubbs, B., Miskowiak, K. W., Morris, G., de Freitas, B. P., Thompson, T., Fernandes, B. S., Brunoni, A. R., Maes, M. H. J., et al. (2018) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2018.05.012 · Cited by 28
Self-citationGlucosamine sulphate: an umbrella review of health outcomes
Veronese, N., Demurtas, J., Smith, L., Reginster, J., Bruyère, O., Beaudart, C., Honvo, G., Maggi, S., & on behalf on the European Geriatric Medicine Society Special Interest Groups in Systematic Reviews and Meta-Analyses and Arthritis (2020) · Therapeutic Advances in Musculoskeletal Disease · doi:10.1177/1759720x20975927 · Cited by 29
“38 We considered the effect size of the largest RCT included for each outcome, determining if it was statistically significant ( p value 0.05) or not.”
InfluentialOrthostatic hypotension and health outcomes: an umbrella review of observational studies
The Special Interest Groups in Systematic Reviews and Meta-analyses for Healthy Ageing, A. C. M. O. T. E. S. O. G. M. (., Soysal, P., Veronese, N., Smith, L., Torbahn, G., Jackson, S. E., Yang, L., Ungar, A., Rivasi, G., Rafanelli, M., et al. (2019) · European Geriatric Medicine · doi:10.1007/s41999-019-00239-4 · Cited by 25
Brunoni, A. R., Salum, G. A., Hoffmann, M. S., Goulart, A. C., Barreto, S. M., Canhada, S., Carvalho, A. F., Koyanagi, A., Cálice-Silva, V., Lotufo, P. A., et al. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.03.074 · Cited by 22
Self-citationVeronese, N., Smith, L., Bolzetta, F., Cester, A., Demurtas, J., & Punzi, L. (2020) · Wiener klinische Wochenschrift · doi:10.1007/s00508-020-01702-0 · Cited by 20
Celotto, S., Veronese, N., Barbagallo, M., Ometto, F., Smith, L., Pardhan, S., Barnett, Y., Ilie, P. C., Soysal, P., Lagolio, E., et al. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.12.018 · Cited by 11
Oommen, A. M., Cunningham, S., O’Súilleabháin, P. S., Hughes, B. M., & Joshi, L. (2021) · Scientific Reports · doi:10.1038/s41598-021-89040-7 · Cited by 9
Umbrella Review on Associations Between Single Nucleotide Polymorphisms and Lung Cancer Risk
Li, X., Wu, Q., Zhou, B., Liu, Y., Lv, J.-L., Chang, Q., & Zhao, Y. (2021) · Frontiers in Molecular Biosciences · doi:10.3389/fmolb.2021.687105 · Cited by 8
“10 and 2) the larger studies had a more conservative effect size than the random-effects meta-analysis (Carvalho et al., 2016).”
BackgroundLaboratory diagnostics as a basis for 5P medicine
Николаевич, Щ. С., & Shcherbo, D. S. (2019) · Bulletin of Russian State Medical University · doi:10.24075/vrgmu.2018.095 · Cited by 8
Wang, R., Xu, F., Wang, L., Zhang, X., Huang, M., Wei, Z., Jiang, Y., Zhang, Y., Chen, X., Liang, Y., et al. (2026) · Chemical Engineering Journal · doi:10.1016/j.cej.2026.175043 · Cited by 2
Ethanolamine as a potential biomarker and therapeutic target for depressive disorder
Ogawa, S., Hattori, K., Hidese, S., Sasayama, D., Ota, M., Miyakawa, T., Tatsumi, M., Matsumura, R., Yoshida, S., Noda, T., et al. (2026) · Molecular Psychiatry · doi:10.1038/s41380-026-03559-7 · Cited by 1
The Precision Psychiatry. An Individualized Approach to the Diseases.
Buono, G. D. (2018) · PubMed · Cited by 1
δEPCD: the electrophysiologic coefficient of depressiveness
Khalil, R. B., & Khoury, R. E. (2021) · Biomarkers · doi:10.1080/1354750x.2021.1995497 · Cited by 1
Nagano, C. P. (2019) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.23.2019.tde-07082019-094835
Metadata
- Authors
- Carvalho, A. F., Köhler, C. A., Brunoni, A. R., Miskowiak, K. W., Herrmann, N., Lanctôt, K. L., Hyphantis, T. N., Quevedo, J., Fernandes, B. S., & Berk, M.
- Affiliations
- Universidade Federal do Ceará (BR)
- Universidade de São Paulo (BR)
- Copenhagen University Hospital (DK)
- Sunnybrook Health Science Centre (CA)
- University of Ioannina (GR)
- Barwon Health (AU)
- ORCID
- Venue
- Psychotherapy and Psychosomatics
- Publisher
- S. Karger AG
- Published
- 2016
- Volume
- 85
- Issue
- 2
- Pages
- 81-90
- ISSN
- 0033-3190 (ISSN-L)
- 1423-0348
- OpenAlex
- W2258842160
- Cited by
- 52
- References
- 61
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 5 · 2020: 10 · 2019: 10 · 2018: 9 · 2017: 11 · 2016: 1
- FWCI
- 3.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Psychotherapy and Psychosomatics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- major depressive disorder, peripheral biomarkers, publication bias, small-study effects, effect size inflation, selective reporting, meta-analysis, depression diagnosis, heterogeneity
- MeSH terms
- Major Depressive Disorder, Depressive Disorder, Major, Diagnosis, Differential, Female, Humans, Biomarkers, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.