Genomic correlates of response to CTLA-4 blockade in metastatic melanoma
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Is cancer immunotherapy a private affair?: Immune checkpoint blockade, a relatively new cancer treatment, substantially extends the survival of a subset of patients. Previous work has shown that patients whose tumors harbor the largest number of mutations—and thus produce a large number of “neoantigens” recognized as foreign by the immune system—are most likely to benefit. Expanding on these earlier studies, Van Allen et al. studied over 100 patients with melanoma and found a similar correlation (see the Perspective by Gubin and Schreiber). There was no evidence, however, that specific neoantigen sequences were shared by patients who responded. Science , this issue p. 207 , see also p. 158
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“ORR and Kaplan-Meier survival analysis revealed that the PathTIGR model effectively stratified patients with melanoma into subgroups exhibiting significantly disparate therapeutic responses (Fisher’s exact test, P < 0.0001; Fig. 4C) and clinical outcomes (log-rank test, P < 0.0001; Fig. 4, D and E).”
From PathTIGR: A pathway topology-informed graph representation learning framework for immunotherapy response prediction (2026) · doi:10.1126/sciadv.aed6373 · cites this paper as [37]
In the citing paper
“ORR and Kaplan-Meier survival analysis revealed that the PathTIGR model effectively stratified patients with melanoma into subgroups exhibiting significantly disparate therapeutic responses (Fisher’s exact test, P < 0.0001; Fig. 4C) and clinical outcomes (log-rank test, P < 0.0001; Fig. 4, D and E).”
From PathTIGR: A pathway topology-informed graph representation learning framework for immunotherapy response prediction (2026) · doi:10.1126/sciadv.aed6373 · cites this paper as [37]
In the citing paper
“The model achieved AUCs of 0.734, 0.729, and 0.935 at 1, 2, and 3 years, respectively (Fig. 4F).”
From PathTIGR: A pathway topology-informed graph representation learning framework for immunotherapy response prediction (2026) · doi:10.1126/sciadv.aed6373 · cites this paper as [37]
In the citing paper
“Cox proportional hazard regression analysis established the algorithm’s independence as a prognostic determinant following adjustment for conventional clinicopathological covariates (P < 0.001; Fig. 4G and table S1).”
From PathTIGR: A pathway topology-informed graph representation learning framework for immunotherapy response prediction (2026) · doi:10.1126/sciadv.aed6373 · cites this paper as [37]
In the citing paper
“it achieved an AUC of 0.989, an AUPRC of 0.993, an F1 score of 0.99, and a C-index of 0.989 (Fig. 4, A and B, and fig. S2A).”
From PathTIGR: A pathway topology-informed graph representation learning framework for immunotherapy response prediction (2026) · doi:10.1126/sciadv.aed6373 · cites this paper as [37]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
PD-1 and PD-L1 Immune Checkpoint Blockade to Treat Breast Cancer
Hartkopf, A. D., Taran, F.-A., Wallwiener, M., Walter, C. B., Krämer, B., Grischke, E.-M., & Brucker, S. Y. (2016) · Breast Care · doi:10.1159/000453569 · Cited by 30,845
New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1)
Eisenhauer, E. A., Therasse, P., Bogaerts, J., Schwartz, L. H., Sargent, D., Ford, R., Dancey, J., Arbuck, S., Gwyther, S., Mooney, M., et al. (2009) · European Journal of Cancer · doi:10.1016/j.ejca.2008.10.026 · Cited by 29,534 · cited 2×
“To stratify our cohort, “clinical benefit” was defined using a composite end point of complete response or partial response to ipilimumab by RECIST criteria (21) or stable disease by RECIST criteria with overall survival greater than 1 year (n = 27).”
Robinson, J. T., Thorvaldsdóttir, H., Winckler, W., Guttman, M., Lander, E. S., Getz, G., & Mesirov, J. P. (2011) · Nature Biotechnology · doi:10.1038/nbt.1754 · Cited by 15,390
Adverse Renal Effects of Immune Checkpoint Inhibitors: A Narrative Review
Wanchoo, R., Karam, S., Uppal, N. N., Barta, V. S., Deray, G., Devoe, C., Launay-Vacher, V., Jhaveri, K. D., & on behalf of Cancer and Kidney International Network Workgroup on Immune Checkpoint Inhibitors (2017) · American Journal of Nephrology · doi:10.1159/000455014 · Cited by 15,256
Improved Survival with Ipilimumab in Patients with Metastatic Melanoma
Hodi, F. S., O'Day, S. J., McDermott, D. F., Weber, R. W., Sosman, J. A., Haanen, J. B., Gonzalez, R., Robert, C., Schadendorf, D., Hassel, J. C., et al. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa1003466 · Cited by 15,155
Self-citationPD-1 Blockade in Tumors with Mismatch-Repair Deficiency
Le, D. T., Uram, J. N., Wang, H., Bartlett, B. R., Kemberling, H., Eyring, A. D., Skora, A. D., Luber, B. S., Azad, N. S., Laheru, D., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1500596 · Cited by 9,377
Combined Nivolumab and Ipilimumab or Monotherapy in Untreated Melanoma
Larkin, J., Chiarion-Sileni, V., Gonzalez, R., Grob, J. J., Cowey, C. L., Lao, C. D., Schadendorf, D., Dummer, R., Smylie, M., Rutkowski, P., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1504030 · Cited by 8,157
Self-citationMutational landscape determines sensitivity to PD-1 blockade in non–small cell lung cancer
Rizvi, N. A., Hellmann, M. D., Snyder, A., Kvistborg, P., Makarov, V., Havel, J. J., Lee, W., Yuan, J., Wong, P., Ho, T. S., et al. (2015) · Science · doi:10.1126/science.aaa1348 · Cited by 7,802
Sensitive detection of somatic point mutations in impure and heterogeneous cancer samples
Cibulskis, K., Lawrence, M. S., Carter, S. L., Sivachenko, A., Jaffe, D., Sougnez, C., Gabriel, S., Meyerson, M., Lander, E. S., & Getz, G. (2013) · Nature Biotechnology · doi:10.1038/nbt.2514 · Cited by 4,981 · cited 1×
“We performed somatic mutation identification (table S1) and germline human lymphocyte antigen (HLA) typing (table S2) using established methods (14, 19).”
Self-citationThe future of immune checkpoint therapy
Sharma, P., & Allison, J. P. (2015) · Science · doi:10.1126/science.aaa8172 · Cited by 4,878 · cited 1×
“Incorporation of patient-matched RNA-level information may help prioritize putative neoantigens and elucidate possible tumor immune microenvironmental effects, including interferon-related genes and additional immune checkpoint molecules that are relevant in melanoma (28).”
Neoantigens in cancer immunotherapy
Schumacher, T. N., & Schreiber, R. D. (2015) · Science · doi:10.1126/science.aaa4971 · Cited by 4,783
Ipilimumab plus Dacarbazine for Previously Untreated Metastatic Melanoma
Robert, C., Thomas, L., Bondarenko, I., O'Day, S., Weber, J., Garbe, C., Lebbe, C., Baurain, J.-F., Testori, A., Grob, J.-J., et al. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1104621 · Cited by 4,496
Genetic Basis for Clinical Response to CTLA-4 Blockade in Melanoma
Snyder, A., Makarov, V., Merghoub, T., Yuan, J., Zaretsky, J. M., Desrichard, A., Walsh, L. A., Postow, M. A., Wong, P., Ho, T. S., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1406498 · Cited by 4,286 · cited 5×
“Furthermore, a tetrapeptide signature (13) previously associated with ipilimumab response was not enriched in the cohort with clinical benefit relative to that with no clinical benefit (fig.”
InfluentialMolecular and genetic properties of tumors associated with local immune cytolytic activity
Rooney, M. S., Shukla, S. A., Wu, C. J., Getz, G., & Hacohen, N. (2015) · Cell · doi:10.1016/j.cell.2014.12.033 · Cited by 3,825 · cited 5×
“First, we identified putative immunogenic 9– and 10–amino acid neoantigens with ≤500 nM binding affinity for HLA class I molecules across the cohort, using patientspecific nonsynonymous mutations and HLA types (tables S2 and S4) (14).”
InfluentialSelf-citationWolchok, J. D., Hoos, A., O'Day, S., Weber, J. S., Hamid, O., Lebbé, C., Maio, M., Binder, M., Bohnsack, O., Nichol, G., et al. (2009) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-09-1624 · Cited by 3,222 · cited 1×
“Patterns of initial increases in tumor mass or delayed responses to therapy have been observed after cancer immunotherapy in the past (32).”
Genomic classification of cutaneous melanoma
Akbani, R., Akdemir, K. C., Aksoy, B. A., Albert, M., Ally, A., Amin, S. B., Arachchi, H., Arora, A., Auman, J. T., Ayala, B., et al. (2015) · Cell · doi:10.1016/j.cell.2015.05.044 · Cited by 3,151
Self-citationMelanoma-intrinsic β-catenin signalling prevents anti-tumour immunity
Spranger, S., Bao, R., & Gajewski, T. F. (2015) · Nature · doi:10.1038/nature14404 · Cited by 2,830
Nivolumab and ipilimumab versus ipilimumab in untreated melanoma
Postow, M. A., Chesney, J., Pavlick, A. C., Robert, C., Grossmann, K., McDermott, D., Linette, G. P., Meyer, N., Giguere, J. K., Agarwala, S. S., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1414428 · Cited by 2,781
A landscape of driver mutations in melanoma
Hodis, E., Watson, I. R., Kryukov, G. V., Arold, S. T., Imielinski, M., Theurillat, J.-P., Nickerson, E., Auclair, D., Li, L., Place, C., et al. (2012) · Cell · doi:10.1016/j.cell.2012.06.024 · Cited by 2,610 · cited 1×
“The median nonsynonymous mutational load was 197 per sample (range: 7 to 5854), which is consistent with the known high mutational loads in cutaneous melanoma (13, 20).”
Self-citationSchadendorf, D., Hodi, F. S., Robert, C., Weber, J. S., Margolin, K., Hamid, O., Patt, D., Chen, T.-T., Berman, D. M., & Wolchok, J. D. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2014.56.2736 · Cited by 2,141
Self-citationReich, M., Liefeld, T., Gould, J., Lerner, J., Tamayo, P., & Mesirov, J. P. (2006) · Nature Genetics · doi:10.1038/ng0506-500 · Cited by 2,032
Checkpoint blockade cancer immunotherapy targets tumour-specific mutant antigens
Gubin, M. M., Zhang, X., Schuster, H., Caron, E., Ward, J. P., Noguchi, T., Ivanova, Y., Hundal, J., Arthur, C. D., Krebber, W.-J., et al. (2014) · Nature · doi:10.1038/nature13988 · Cited by 1,974
A dendritic cell vaccine increases the breadth and diversity of melanoma neoantigen-specific T cells
Carreno, B. M., Magrini, V., Becker-Hapak, M., Kaabinejadian, S., Hundal, J., Petti, A. A., Ly, A., Lie, W.-R., Hildebrand, W. H., Mardis, E. R., et al. (2015) · Science · doi:10.1126/science.aaa3828 · Cited by 1,285
Mutant MHC class II epitopes drive therapeutic immune responses to cancer
Kreiter, S., Vormehr, M., van de Roemer, N., Diken, M., Löwer, M., Diekmann, J., Boegel, S., Schrörs, B., Vascotto, F., Castle, J. C., et al. (2015) · Nature · doi:10.1038/nature14426 · Cited by 1,243
Predicting immunogenic tumour mutations by combining mass spectrometry and exome sequencing
Yadav, M., Jhunjhunwala, S., Phung, Q. T., Lupardus, P., Tanguay, J., Bumbaca, S., Franci, C., Cheung, T. K., Fritsche, J., Weinschenk, T., et al. (2014) · Nature · doi:10.1038/nature14001 · Cited by 1,186
RNA-SeQC: RNA-seq metrics for quality control and process optimization
DeLuca, D. S., Levin, J. Z., Sivachenko, A., Fennell, T., Nazaire, M.-D., Williams, C., Reich, M., Winckler, W., & Getz, G. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts196 · Cited by 899
van Rooij, N., van Buuren, M. M., Philips, D., Velds, A., Toebes, M., Heemskerk, B., van Dijk, L. J. A., Behjati, S., Hilkmann, H., el Atmioui, D., et al. (2013) · Journal of Clinical Oncology · doi:10.1200/jco.2012.47.7521 · Cited by 798 · cited 2×
“Clinical studies of exceptional responders (11) and of small cohorts of melanoma patients have highlighted NRAS mutation status, total neoantigen load, and a neoantigen-derived tetrapeptide signature as possible correlates of response to ipilimumab in metastatic melanoma (12, 13).”
Nielsen, M., Lundegaard, C., Blicher, T., Lamberth, K., Harndahl, M., Justesen, S., Røder, G., Peters, B., Sette, A., Lund, O., et al. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000796 · Cited by 719
Fisher, S., Barry, A., Abreu, J., Minie, B., Nolan, J., Delorey, T. M., Young, G., Fennell, T. J., Allen, A., Ambrogio, L., et al. (2011) · Genome Biology · doi:10.1186/gb-2011-12-1-r1 · Cited by 682
Self-citationLinnemann, C., van Buuren, M. M., Bies, L., Verdegaal, E. M. E., Schotte, R., Calis, J. J. A., Behjati, S., Velds, A., Hilkmann, H., Atmioui, D. E., et al. (2015) · Nature Medicine · doi:10.1038/nm.3773 · Cited by 679
Somatic ERCC2 Mutations Correlate with Cisplatin Sensitivity in Muscle-Invasive Urothelial Carcinoma
Van Allen, E. M., Mouw, K. W., Kim, P., Iyer, G., Wagle, N., Al-Ahmadie, H., Zhu, C., Ostrovnaya, I., Kryukov, G. V., O'Connor, K. W., et al. (2014) · Cancer Discovery · doi:10.1158/2159-8290.cd-14-0623 · Cited by 620
Self-citationSchadendorf, D., Fisher, D. E., Garbe, C., Gershenwald, J. E., Grob, J.-J., Halpern, A., Herlyn, M., Marchetti, M. A., McArthur, G., Ribas, A., et al. (2015) · Nature Reviews Disease Primers · doi:10.1038/nrdp.2015.3 · Cited by 613
Self-citationNeo-antigens predicted by tumor genome meta-analysis correlate with increased patient survival
Brown, S. D., Warren, R. L., Gibb, E. A., Martin, S. D., Spinelli, J. J., Nelson, B. H., & Holt, R. A. (2014) · Genome Research · doi:10.1101/gr.165985.113 · Cited by 594 · cited 2×
“Specifically, the geometric mean of expression of granzyme A (GZMA) and perforin (PRF1) has been shown to correlate with both the cytolytic activity of local immune infiltrates and the neoantigen load (14, 15).”
Van Allen, E. M., Wagle, N., Stojanov, P., Perrin, D. L., Cibulskis, K., Marlow, S., Jane-Valbuena, J., Friedrich, D. C., Kryukov, G., Carter, S. L., et al. (2014) · Nature Medicine · doi:10.1038/nm.3559 · Cited by 546
Self-citationCostello, M., Pugh, T. J., Fennell, T. J., Stewart, C., Lichtenstein, L., Meldrim, J. C., Fostel, J. L., Friedrich, D. C., Perrin, D., Dionne, D., et al. (2013) · Nucleic Acids Research · doi:10.1093/nar/gks1443 · Cited by 522
Self-citationMaio, M., Grob, J.-J., Aamdal, S., Bondarenko, I., Robert, C., Thomas, L., Garbe, C., Chiarion-Sileni, V., Testori, A., Chen, T.-T., et al. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2014.56.6018 · Cited by 481 · cited 1×
“Although overall single-agent response rates are low, a long-term clinical benefit is consistently observed for ~20% of treated patients (5, 6).”
Systematic identification of personal tumor-specific neoantigens in chronic lymphocytic leukemia
Rajasagi, M., Shukla, S. A., Fritsch, E. F., Keskin, D. B., DeLuca, D., Carmona, E., Zhang, W., Sougnez, C., Cibulskis, K., Sidney, J., et al. (2014) · Blood · doi:10.1182/blood-2014-04-567933 · Cited by 309
Self-citationCloning Genes Encoding MHC Class II-Restricted Antigens: Mutated CDC27 as a Tumor Antigen
Wang, R.-F., Wang, X., Atwood, A. C., Topalian, S. L., & Rosenberg, S. A. (1999) · Science · doi:10.1126/science.284.5418.1351 · Cited by 300
ContEst: estimating cross-contamination of human samples in next-generation sequencing data
Cibulskis, K., McKenna, A., Fennell, T., Banks, E., DePristo, M., & Getz, G. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr446 · Cited by 289 · cited 1×
“Manual review of raw sequencing data was performed to exclude samples with evidence suggesting low purity, high contamination by ContEst (33), or discordant copy number quality control.”
Impact of NRAS Mutations for Patients with Advanced Melanoma Treated with Immune Therapies
Johnson, D. B., Lovly, C. M., Flavin, M., Panageas, K. S., Ayers, G. D., Zhao, Z., Iams, W. T., Colgan, M., DeNoble, S., Terry, C. R., et al. (2015) · Cancer Immunology Research · doi:10.1158/2326-6066.cir-14-0207 · Cited by 174 · cited 1×
“Clinical studies of exceptional responders (11) and of small cohorts of melanoma patients have highlighted NRAS mutation status, total neoantigen load, and a neoantigen-derived tetrapeptide signature as possible correlates of response to ipilimumab in metastatic melanoma (12, 13).”
Biomarkers in Cancer Immunotherapy
Schumacher, T. N., Keşmir, C., & van Buuren, M. M. (2015) · Cancer Cell · doi:10.1016/j.ccell.2014.12.004 · Cited by 160
Hofbauer, G. F. L., Burkhart, A., Schüler, G., Dummer, R., Burg, G., & Nestle, F. O. (2003) · Journal of Immunotherapy · doi:10.1097/00002371-200401000-00007 · Cited by 23 · cited 1×
“Conceivably, an inadequate immune response to tumor neoantigens could also be explained by aberrant HLA class I expression, which has been previously observed in melanoma (27).”
Self-citation
Cited by
Cancer immunotherapy using checkpoint blockade
Ribas, A., & Wolchok, J. D. (2018) · Science · doi:10.1126/science.aar4060 · Cited by 6,791
Primary, Adaptive, and Acquired Resistance to Cancer Immunotherapy
Sharma, P., Hu-Lieskovan, S., Wargo, J. A., & Ribas, A. (2017) · Cell · doi:10.1016/j.cell.2017.01.017 · Cited by 5,588
“On the basis of insights gained (Hugo et al., 2016; Snyder et al., 2014; Van Allen et al., 2015), efforts are currently underway to derive actionable strategies to combat therapeutic resistance to immunotherapy.”
InfluentialTGFβ attenuates tumour response to PD-L1 blockade by contributing to exclusion of T cells
Mariathasan, S., Turley, S. J., Nickles, D., Castiglioni, A., Yuen, K., Wang, Y., Kadel III, E. E., Koeppen, H., Astarita, J. L., Cubas, R., et al. (2018) · Nature · doi:10.1038/nature25501 · Cited by 5,400
Signatures of T cell dysfunction and exclusion predict cancer immunotherapy response
Jiang, P., Gu, S., Pan, D., Fu, J., Sahu, A., Hu, X., Li, Z., Traugh, N., Bu, X., Li, B., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0136-1 · Cited by 5,179
Charoentong, P., Finotello, F., Angelova, M., Mayer, C., Efremova, M., Rieder, D., Hackl, H., & Trajanoski, Z. (2017) · Cell Reports · doi:10.1016/j.celrep.2016.12.019 · Cited by 5,041
Metadata
- Authors
- Van Allen, E. M., Miao, D., Schilling, B., Shukla, S. A., Blank, C., Zimmer, L., Sucker, A., Hillen, U., Geukes Foppen, M. H., Goldinger, S. M., Utikal, J., Hassel, J. C., Weide, B., Kaehler, K. C., Loquai, C., Mohr, P., Gutzmer, R., Dummer, R., Gabriel, S., Wu, C. J., Schadendorf, D., & Garraway, L. A.
- Affiliations
- Department of Medical Oncology, Dana-Farber Cancer Institute, Boston, MA 02215, USA.
- Broad Institute (US)
- Deutsches Konsortium für Translationale Krebsforschung (DE)
- The Netherlands Cancer Institute (NL)
- Department of Medical Oncology, Netherlands Cancer Institute, 1066 CX Amsterdam, Netherlands.
- University Hospital Zurich (CH)
- German Cancer Research Center (DE)
- Heidelberg University (DE)
- Universitätsklinikum Tübingen (DE)
- University Hospital Schleswig-Holstein (DE)
- University Medical Center of the Johannes Gutenberg University Mainz (DE)
- Elbe Kliniken Stade-Buxtehude (DE)
- Medizinische Hochschule Hannover (DE)
- Corresponding author
- Miao, Diana
- Schilling, Bastian
- Schadendorf, Dirk
- Garraway, Levi A.
- ORCID
- Venue
- Science
- Published
- 2015-10-09
- Volume
- 350
- Issue
- 6257
- Pages
- 207-211
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- PMC
- PMC5054517
- OpenAlex
- W2107429737
- Cited by
- 2,839
- References
- 42
- Citations by year
- 2026: 106 · 2025: 187 · 2024: 236 · 2023: 308 · 2022: 313 · 2021: 348 · 2020: 327 · 2019: 274 · 2018: 270 · 2017: 248 · 2016: 207 · 2015: 12
- FWCI
- 107.45
- Type
- journal article
- Language
- en
- Update notices
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Funders
- NIH (U54 HG003067)
- Topics
- Health Sciences › Medicine › Oncology › Cancer Immunotherapy and Biomarkers
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Life Sciences › Immunology and Microbiology › Immunology › Immunotherapy and Immune Responses
- Keywords
- metastatic melanoma, CTLA-4 blockade, ipilimumab, immune checkpoint inhibitors, tumor mutational burden, neoantigens, tumor microenvironment, predictive biomarkers, treatment response, exome sequencing, transcriptome, germline mutations
- MeSH terms
- Ipilimumab, Adult, Aged, Aged, 80 and over, Antibodies, Monoclonal, Antigens, Neoplasm, DNA Mutational Analysis, Female, HLA Antigens, Humans, Male, Melanoma, Middle Aged, Mutation, Skin Neoplasms, Cohort Studies, Drug Resistance, Neoplasm, Genomics, Biomarkers, Pharmacological, Young Adult, Tumor Microenvironment, Cell Cycle Checkpoints, Exome, CTLA-4 Antigen
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.