Prognostic and Predictive Impact of Circulating Tumor DNA in Patients with Advanced Cancers Treated with Immune Checkpoint Blockade
Open accessPublished version of a preprint
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
The utility of circulating tumor DNA (ctDNA) as a biomarker in patients with advanced cancers receiving immunotherapy is uncertain. We therefore analyzed pretreatment (n = 978) and on-treatment (n = 171) ctDNA samples across 16 advanced-stage tumor types from three phase I/II trials of durvalumab (± the anti-CTLA4 therapy tremelimumab). Higher pretreatment variant allele frequencies (VAF) were associated with poorer overall survival (OS) and other known prognostic factors, but not objective response, suggesting a prognostic role for patient outcomes. On-treatment reductions in VAF and lower on-treatment VAF were independently associated with longer progression-free survival and OS and increased objective response rate, but not prognostic variables, suggesting that on-treatment ctDNA dynamics are predictive of benefit from immune checkpoint blockade. Accordingly, we propose a concept of “molecular response” using ctDNA, incorporating both pretreatment and on-treatment VAF, that predicted long-term survival similarly to initial radiologic response while also permitting early differentiation of responders among patients with initially radiologically stable disease. Significance: In a pan-cancer analysis of immune checkpoint blockade, pretreatment ctDNA levels appeared prognostic and on-treatment dynamics predictive. A “molecular response” metric identified long-term responders and adjudicated benefit among patients with initially radiologically stable disease. Changes in ctDNA may be more dynamic than radiographic changes and could complement existing trial endpoints. This article is highlighted in the In This Issue feature, p. 1775
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, integration of longitudinal blood-based assays such as circulating-tumor DNA (ctDNA; ref. 216), which are easier to implement and less invasive as opposed to longitudinal tumor biopsies, is under investigation as a method to monitor responses to ICT.”
From The Next Decade of Immune Checkpoint Therapy (2021) · cites this paper as [216]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PD-1 and PD-L1 Immune Checkpoint Blockade to Treat Breast Cancer
Hartkopf, A. D., Taran, F.-A., Wallwiener, M., Walter, C. B., Krämer, B., Grischke, E.-M., & Brucker, S. Y. (2016) · Breast Care · doi:10.1159/000453569 · Cited by 30,845
Adverse Renal Effects of Immune Checkpoint Inhibitors: A Narrative Review
Wanchoo, R., Karam, S., Uppal, N. N., Barta, V. S., Deray, G., Devoe, C., Launay-Vacher, V., Jhaveri, K. D., & on behalf of Cancer and Kidney International Network Workgroup on Immune Checkpoint Inhibitors (2017) · American Journal of Nephrology · doi:10.1159/000455014 · Cited by 15,256
Pembrolizumab versus Chemotherapy for PD-L1-Positive Non-Small-Cell Lung Cancer
Reck, M., Rodríguez-Abreu, D., Robinson, A. G., Hui, R., Csőszi, T., Fülöp, A., Gottfried, M., Peled, N., Tafreshi, A., Cuffe, S., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1606774 · Cited by 10,089
Nivolumab versus Docetaxel in Advanced Squamous-Cell Non–Small-Cell Lung Cancer
Brahmer, J., Reckamp, K. L., Baas, P., Crinò, L., Eberhardt, W. E. E., Poddubskaya, E., Antonia, S., Pluzanski, A., Vokes, E. E., Holgado, E., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1504627 · Cited by 8,447
Mismatch repair deficiency predicts response of solid tumors to PD-1 blockade
Le, D. T., Durham, J. N., Smith, K. N., Wang, H., Bartlett, B. R., Aulakh, L. K., Lu, S., Kemberling, H., Wilt, C., Luber, B. S., et al. (2017) · Science · doi:10.1126/science.aan6733 · Cited by 6,645
Pembrolizumab versus Ipilimumab in Advanced Melanoma
Robert, C., Schachter, J., Long, G. V., Arance, A., Grob, J. J., Mortier, L., Daud, A., Carlino, M. S., McNeil, C., Lotem, M., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1503093 · Cited by 5,887
Overall Survival with Combined Nivolumab and Ipilimumab in Advanced Melanoma
Wolchok, J. D., Chiarion-Sileni, V., Gonzalez, R., Rutkowski, P., Grob, J.-J., Cowey, C. L., Lao, C. D., Wagstaff, J., Schadendorf, D., Ferrucci, P. F., et al. (2017) · New England Journal of Medicine · doi:10.1056/nejmoa1709684 · Cited by 5,357
Durvalumab after chemoradiotherapy in stage III non–small-cell lung cancer
Antonia, S. J., Villegas, A., Daniel, D., Vicente, D., Murakami, S., Hui, R., Yokoi, T., Chiappori, A., Lee, K. H., de Wit, M., et al. (2017) · New England Journal of Medicine · doi:10.1056/nejmoa1709937 · Cited by 4,593
Self-citationAtezolizumab and nab-paclitaxel in advanced triple-negative breast cancer
Schmid, P., Adams, S., Rugo, H. S., Schneeweiss, A., Barrios, C. H., Iwata, H., Diéras, V., Hegg, R., Im, S.-A., Shaw Wright, G., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1809615 · Cited by 4,350
El-Khoueiry, A. B., Sangro, B., Yau, T., Crocenzi, T. S., Kudo, M., Hsu, C., Kim, T.-Y., Choo, S.-P., Trojan, J., Welling, T. H., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31046-2 · Cited by 4,280
PD-1 Blockade with Nivolumab in Relapsed or Refractory Hodgkin's Lymphoma
Ansell, S. M., Lesokhin, A. M., Borrello, I., Halwani, A., Scott, E. C., Gutierrez, M., Schuster, S. J., Millenson, M. M., Cattry, D., Freeman, G. J., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1411087 · Cited by 3,560
Pembrolizumab plus axitinib versus sunitinib for advanced renal-cell carcinoma
Rini, B. I., Plimack, E. R., Stus, V., Gafanov, R., Hawkins, R., Nosov, D., Pouliot, F., Alekseev, B., Soulières, D., Melichar, B., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1816714 · Cited by 3,403
Pembrolizumab as Second-Line Therapy for Advanced Urothelial Carcinoma
Bellmunt, J., de Wit, R., Vaughn, D. J., Fradet, Y., Lee, J.-L., Fong, L., Vogelzang, N. J., Climent, M. A., Petrylak, D. P., Choueiri, T. K., et al. (2017) · New England Journal of Medicine · doi:10.1056/nejmoa1613683 · Cited by 3,395
Fundamental Mechanisms of Immune Checkpoint Blockade Therapy
Wei, S. C., Duffy, C. R., & Allison, J. P. (2018) · Cancer Discovery · doi:10.1158/2159-8290.cd-18-0367 · Cited by 3,088
Detection and localization of surgically resectable cancers with a multi-analyte blood test
Cohen, J. D., Li, L., Wang, Y., Thoburn, C., Afsari, B., Danilova, L., Douville, C., Javed, A. A., Wong, F., Mattox, A., et al. (2018) · Science · doi:10.1126/science.aar3247 · Cited by 2,783
Pan-tumor genomic biomarkers for PD-1 checkpoint blockade–based immunotherapy
Cristescu, R., Mogg, R., Ayers, M., Albright, A., Murphy, E., Yearley, J., Sher, X., Liu, X. Q., Lu, H., Nebozhyn, M., et al. (2018) · Science · doi:10.1126/science.aar3593 · Cited by 2,301
Analysis of Circulating Tumor DNA to Monitor Metastatic Breast Cancer
Dawson, S.-J., Tsui, D. W. Y., Murtaza, M., Biggs, H., Rueda, O. M., Chin, S.-F., Dunning, M. J., Gale, D., Forshew, T., Mahler-Araujo, B., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1213261 · Cited by 2,207
Taube, J. M., Anders, R. A., Young, G. D., Xu, H., Sharma, R., McMiller, T. L., Chen, S., Klein, A. P., Pardoll, D. M., Topalian, S. L., et al. (2012) · Science Translational Medicine · doi:10.1126/scitranslmed.3003689 · Cited by 2,157
Phylogenetic ctDNA analysis depicts early-stage lung cancer evolution
The TRACERx consortium, Abbosh, C., The PEACE consortium, Birkbak, N. J., Wilson, G. A., Jamal-Hanjani, M., Constantin, T., Salari, R., Le Quesne, J., Moore, D. A., et al. (2017) · Nature · doi:10.1038/nature22364 · Cited by 1,874
Fuchs, C. S., Doi, T., Jang, R. W., Muro, K., Satoh, T., Machado, M., Sun, W., Jalal, S. I., Shah, M. A., Metges, J.-P., et al. (2018) · JAMA Oncology · doi:10.1001/jamaoncol.2018.0013 · Cited by 1,784
Cohen, E. E. W., Soulières, D., Le Tourneau, C., Dinis, J., Licitra, L., Ahn, M.-J., Soria, A., Machiels, J.-P., Mach, N., Mehra, R., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(18)31999-8 · Cited by 1,709
Powles, T., Durán, I., van der Heijden, M. S., Loriot, Y., Vogelzang, N. J., De Giorgi, U., Oudard, S., Retz, M. M., Castellano, D., Bamias, A., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)33297-x · Cited by 1,408
Rizvi, H., Sanchez-Vega, F., La, K., Chatila, W., Jonsson, P., Halpenny, D., Plodkowski, A., Long, N., Sauter, J. L., Rekhtman, N., et al. (2018) · Journal of Clinical Oncology · doi:10.1200/jco.2017.75.3384 · Cited by 1,367
Self-citationGandara, D. R., Paul, S. M., Kowanetz, M., Schleifman, E., Zou, W., Li, Y., Rittmeyer, A., Fehrenbacher, L., Otto, G., Malboeuf, C., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0134-3 · Cited by 1,157
Chaudhuri, A. A., Chabon, J. J., Lovejoy, A. F., Newman, A. M., Stehr, H., Azad, T. D., Khodadoust, M. S., Esfahani, M. S., Liu, C. L., Zhou, L., et al. (2017) · Cancer Discovery · doi:10.1158/2159-8290.cd-17-0716 · Cited by 1,072
Powles, T., O'Donnell, P. H., Massard, C., Arkenau, H.-T., Friedlander, T. W., Hoimes, C. J., Lee, J. L., Ong, M., Sridhar, S. S., Vogelzang, N. J., et al. (2017) · JAMA Oncology · doi:10.1001/jamaoncol.2017.2411 · Cited by 869 · cited 1×
“The study design, patient demographics, and clinical outcomes of these studies have been reported previously (5, 6, 48, 49).”
BackgroundGarassino, M. C., Cho, B.-C., Kim, J.-H., Mazières, J., Vansteenkiste, J., Lena, H., Corral Jaime, J., Gray, J. E., Powderly, J., Chouaid, C., et al. (2018) · The Lancet Oncology · doi:10.1016/s1470-2045(18)30144-x · Cited by 568
Self-citationEarly Assessment of Lung Cancer Immunotherapy Response via Circulating Tumor DNA
Goldberg, S. B., Narayan, A., Kole, A. J., Decker, R. H., Teysir, J., Carriero, N. J., Lee, A., Nemati, R., Nath, S. K., Mane, S. M., et al. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-17-1341 · Cited by 443
Odegaard, J. I., Vincent, J. J., Mortimer, S., Vowles, J. V., Ulrich, B. C., Banks, K. C., Fairclough, S. R., Zill, O. A., Sikora, M., Mokhtari, R., et al. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-17-3831 · Cited by 435
Moding, E. J., Liu, Y., Nabet, B. Y., Chabon, J. J., Chaudhuri, A. A., Hui, A. B., Bonilla, R. F., Ko, R. B., Yoo, C. H., Gojenola, L., et al. (2020) · Nature Cancer · doi:10.1038/s43018-019-0011-0 · Cited by 365
Anagnostou, V., Forde, P. M., White, J. R., Niknafs, N., Hruban, C., Naidoo, J., Marrone, K., Sivakumar, I. K. A., Bruhm, D. C., Rosner, S., et al. (2019) · Cancer Research · doi:10.1158/0008-5472.can-18-1127 · Cited by 318
Self-citationLee, J. H., Long, G. V., Menzies, A. M., Lo, S., Guminski, A., Whitbourne, K., Peranec, M., Scolyer, R., Kefford, R. F., Rizos, H., et al. (2018) · JAMA Oncology · doi:10.1001/jamaoncol.2017.5332 · Cited by 315
AKT Inhibition in Solid Tumors With AKT1 Mutations
Hyman, D. M., Smyth, L. M., Donoghue, M. T. A., Westin, S. N., Bedard, P. L., Dean, E. J., Bando, H., El-Khoueiry, A. B., Pérez-Fidalgo, J. A., Mita, A., et al. (2017) · Journal of Clinical Oncology · doi:10.1200/jco.2017.73.0143 · Cited by 311
Self-citationRaja, R., Kuziora, M., Brohawn, P. Z., Higgs, B. W., Gupta, A., Dennis, P. A., & Ranade, K. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-0386 · Cited by 239
Self-citationCirculating Tumor DNA Sequencing Analysis of Gastroesophageal Adenocarcinoma
Maron, S. B., Chase, L. M., Lomnicki, S., Kochanny, S., Moore, K. L., Joshi, S. S., Landron, S., Johnson, J., Kiedrowski, L. A., Nagy, R. J., et al. (2019) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-19-1704 · Cited by 229
Lipson, E. J., Velculescu, V. E., Pritchard, T. S., Sausen, M., Pardoll, D. M., Topalian, S. L., & Diaz, L. A. (2014) · Journal for ImmunoTherapy of Cancer · doi:10.1186/s40425-014-0042-0 · Cited by 217
Ptashkin, R. N., Mandelker, D. L., Coombs, C. C., Bolton, K., Yelskaya, Z., Hyman, D. M., Solit, D. B., Baselga, J., Arcila, M. E., Ladanyi, M., et al. (2018) · JAMA Oncology · doi:10.1001/jamaoncol.2018.2297 · Cited by 212
Santiago-Walker, A., Gagnon, R., Mazumdar, J., Casey, M., Long, G. V., Schadendorf, D., Flaherty, K., Kefford, R., Hauschild, A., Hwu, P., et al. (2016) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-15-0321 · Cited by 206
Khagi, Y., Goodman, A. M., Daniels, G. A., Patel, S. P., Sacco, A. G., Randall, J. M., Bazhenova, L. A., & Kurzrock, R. (2017) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-17-1439 · Cited by 202
Clinical potential of circulating tumour DNA in patients receiving anticancer immunotherapy
Cabel, L., Proudhon, C., Romano, E., Girard, N., Lantz, O., Stern, M.-H., Pierga, J.-Y., & Bidard, F.-C. (2018) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-018-0074-3 · Cited by 196
Kluger, H. M., Zito, C. R., Turcu, G., Baine, M. K., Zhang, H., Adeniran, A., Sznol, M., Rimm, D. L., Kluger, Y., Chen, L., et al. (2017) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-16-3146 · Cited by 152
Hrebien, S., Citi, V., Garcia-Murillas, I., Cutts, R., Fenwick, K., Kozarewa, I., McEwen, R., Ratnayake, J., Maudsley, R., Carr, T. H., et al. (2019) · Annals of Oncology · doi:10.1093/annonc/mdz085 · Cited by 146
Schwaederlé, M. C., Patel, S. P., Husain, H., Ikeda, M., Lanman, R. B., Banks, K. C., Talasaz, A., Bazhenova, L., & Kurzrock, R. (2017) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-16-2497 · Cited by 145
A Prospective Study of Circulating Tumor DNA to Guide Matched Targeted Therapy in Lung Cancers
Sabari, J. K., Offin, M., Stephens, D., Ni, A., Lee, A., Pavlakis, N., Clarke, S., Diakos, C. I., Datta, S., Tandon, N., et al. (2019) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djy156 · Cited by 123
Self-citationSlavin, T. P., Banks, K. C., Chudova, D., Oxnard, G. R., Odegaard, J. I., Nagy, R. J., Tsang, K. W. K., Neuhausen, S. L., Gray, S. W., Cristofanilli, M., et al. (2018) · Journal of Clinical Oncology · doi:10.1200/jco.18.00328 · Cited by 115
Pembrolizumab as First-Line Therapy for Metastatic Non-Small-Cell Lung Cancer
Reck, M. (2017) · Immunotherapy · doi:10.2217/imt-2017-0121 · Cited by 104
Pécuchet, N., Zonta, E., Didelot, A., Combe, P., Thibault, C., Gibault, L., Lours, C., Rozenholc, Y., Taly, V., Laurent‐Puig, P., et al. (2016) · PLoS Medicine · doi:10.1371/journal.pmed.1002199 · Cited by 103
Antonia, S. J., Balmanoukian, A., Brahmer, J., Ou, S.-H. I., Hellmann, M. D., Kim, S.-W., Ahn, M.-J., Kim, D.-W., Gutierrez, M., Liu, S. V., et al. (2019) · Journal of Thoracic Oncology · doi:10.1016/j.jtho.2019.06.010 · Cited by 97
Self-citationPembrolizumab for Advanced Urothelial Carcinoma
Liang, F., & Zhu, J. (2017) · New England Journal of Medicine · doi:10.1056/nejmc1704612 · Cited by 52
Use of Circulating Tumor DNA for Cancer Immunotherapy
Snyder, A., Morrissey, M., & Hellmann, M. D. (2019) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-2688 · Cited by 48
Self-citationTakahashi, T., Tateishi, A., Bychkov, A., & Fukuoka, J. (2019) · International Journal of Molecular Sciences · doi:10.3390/ijms20102578 · Cited by 42
Abstract CT112: Durvalumab + tremelimumab in patients with metastatic urothelial cancer
Balar, A. V., Mahipal, A., Grande, E., Villalobos, V. M., Salas, S., Kang, T. W., Kim, S. H., Powles, T. B., Tsai, F. Y.-C., Naing, A., et al. (2018) · Cancer Research · doi:10.1158/1538-7445.am2018-ct112 · Cited by 16
Self-citationUpdated overall survival and safety profile of durvalumab monotherapy in advanced NSCLC.
Hellmann, M. D., Antonia, S. J., Balmanoukian, A. S., Brahmer, J. R., Ou, S. I., Kim, S., Ahn, M., Kim, D., Gutierrez, M. E., Liu, S. V., et al. (2018) · Journal of Clinical Oncology · doi:10.1200/jco.2018.36.5_suppl.169 · Cited by 7
Self-citation
Cited by
Liquid biopsy: current technology and clinical applications
Nikanjam, M., Kato, S., & Kurzrock, R. (2022) · Journal of Hematology & Oncology · doi:10.1186/s13045-022-01351-y · Cited by 931
Pascual, J., Attard, G., Bidard, F.-C., Curigliano, G., De Mattos-Arruda, L., Diehn, M., Italiano, A., Lindberg, J., Merker, J. D., Montagut, C., et al. (2022) · Annals of Oncology · doi:10.1016/j.annonc.2022.05.520 · Cited by 783
The Next Decade of Immune Checkpoint Therapy
Sharma, P., Siddiqui, B. A., Anandhan, S., Yadav, S. S., Subudhi, S. K., Gao, J., Goswami, S., & Allison, J. P. (2021) · Cancer Discovery · doi:10.1158/2159-8290.cd-20-1680 · Cited by 750
Rolfo, C., Mack, P., Scagliotti, G. V., Aggarwal, C., Arcila, M. E., Barlesi, F., Bivona, T., Diehn, M., Dive, C., Dziadziuszko, R., et al. (2021) · Journal of Thoracic Oncology · doi:10.1016/j.jtho.2021.06.017 · Cited by 683
ctDNA guiding adjuvant immunotherapy in urothelial carcinoma
Powles, T., Assaf, Z. J., Davarpanah, N., Banchereau, R., Szabados, B. E., Yuen, K. C., Grivas, P., Hussain, M., Oudard, S., Gschwend, J. E., et al. (2021) · Nature · doi:10.1038/s41586-021-03642-9 · Cited by 646
Metadata
- Authors
- Zhang, Q., Luo, J., Wu, S., Si, H., Gao, C., Xu, W., Abdullah, S. E., Higgs, B. W., Dennis, P. A., van der Heijden, M. S., Segal, N. H., Chaft, J. E., Hembrough, T., Barrett, J. C., & Hellmann, M. D.
- Affiliations
- 1Translational Medicine, Early Oncology, AstraZeneca, Gaithersburg, Maryland.
- Memorial Sloan Kettering Cancer Center (US)
- 3Early Oncology Statistics, AstraZeneca, Gaithersburg, Maryland.
- AstraZeneca (United States) (US)
- 5Division of Molecular Carcinogenesis and Medical Oncology, The Netherlands Cancer Institute, Plesmanlaan, Amsterdam, the Netherlands.
- Corresponding author
- Hellmann, Matthew D.
- ORCID
- Venue
- Cancer Discovery
- Published
- 2020-12-01
- Volume
- 10
- Issue
- 12
- Pages
- 1842-1853
- ISSN
- 2159-8274 (ISSN-L)
- 2159-8290
- PMC
- PMC8358981
- OpenAlex
- W3049083268
- Cited by
- 348
- References
- 53
- Citations by year
- 2026: 31 · 2025: 72 · 2024: 60 · 2023: 70 · 2022: 54 · 2021: 54 · 2020: 6
- FWCI
- 16.61
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Cancer Discovery (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- AstraZeneca (NCT01693562, NCT02087423, NCT02261220)
- Memorial Sloan Kettering Cancer Center (P30 CA008748)
- Damon Runyon Cancer Research Foundation (CI-98-18)
- Parker Institute for Cancer Immunotherapy
- NIH (T32-CA009207, K30-UL1TR00457)
- Topics
- Health Sciences › Medicine › Oncology › Cancer Immunotherapy and Biomarkers
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Cancer Research › Cancer Genomics and Diagnostics
- Health Sciences › Medicine › Oncology › Colorectal Cancer Treatments and Studies
- Keywords
- circulating tumor DNA, immune checkpoint blockade, durvalumab, tremelimumab, variant allele frequency, molecular response, prognostic factors, predictive biomarkers, overall survival, progression-free survival, objective response rate, pan-cancer analysis, CTLA-4 blockade
- MeSH terms
- Circulating Tumor DNA, Immune Checkpoint Inhibitors, Humans, Neoplasms, Prognosis, Survival Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.