CoChat

Interlaboratory Study for Characterizing Monoclonal Antibodies by Top-Down and Middle-Down Mass Spectrometry

Open access
Srzentić, Kristina, Fornelli, Luca, Tsybin, Yury O., Loo, Joseph A., Seckler, Henrique, Agar, Jeffrey N., Anderson, Lissa C., Bai, Dina L., Beck, Alain, Brodbelt, Jennifer S., van der Burgt, Yuri E. M., Chamot-Rooke, Julia, Chatterjee, Sneha, Chen, Yunqiu, Clarke, David J., Danis, Paul O., Diedrich, Jolene K., D’Ippolito, Robert A., Dupré, Mathieu, Gasilova, Natalia, Ge, Ying, Goo, Young Ah, Goodlett, David R., Greer, Sylvester, Haselmann, Kim F., He, Lidong, Hendrickson, Christopher L., Hinkle, Joshua D., Holt, Matthew V., Hughes, Sam, Hunt, Donald F., Kelleher, Neil L., Kozhinov, Anton N., Lin, Ziqing, Malosse, Christian, Marshall, Alan G., Menin, Laure, Millikin, Robert J., Nagornov, Konstantin O., Nicolardi, Simone, Paša-Tolić, Ljiljana, Pengelley, Stuart, Quebbemann, Neil R., Resemann, Anja, Sandoval, Wendy, Sarin, Richa, Schmitt, Nicholas D., Shabanowitz, Jeffrey, Shaw, Jared B., Shortreed, Michael R., Smith, Lloyd M., Sobott, Frank, Suckau, Detlev, Toby, Timothy, Weisbrod, Chad R., Wildburger, Norelle C., Yates, John R., Yoon, Sung Hwan, Young, Nicolas L., Zhou, Mowei · 2020 · Journal of the American Society for Mass Spectrometry
Cited by 116

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.

Abstract

The Consortium for Top-Down Proteomics (www.topdownproteomics.org) launched the present study to assess the current state of top-down mass spectrometry (TD MS) and middle-down mass spectrometry (MD MS) for characterizing monoclonal antibody (mAb) primary structures, including their modifications. To meet the needs of the rapidly growing therapeutic antibody market, it is important to develop analytical strategies to characterize the heterogeneity of a therapeutic product's primary structure accurately and reproducibly. The major objective of the present study is to determine whether current TD/MD MS technologies and protocols can add value to the more commonly employed bottom-up (BU) approaches with regard to confirming protein integrity, sequencing variable domains, avoiding artifacts, and revealing modifications and their locations. We also aim to gather information on the common TD/MD MS methods and practices in the field. A panel of three mAbs was selected and centrally provided to 20 laboratories worldwide for the analysis: Sigma mAb standard (SiLuLite), NIST mAb standard, and the therapeutic mAb Herceptin (trastuzumab). Various MS instrument platforms and ion dissociation techniques were employed. The present study confirms that TD/MD MS tools are available in laboratories worldwide and provide complementary information to the BU approach that can be crucial for comprehensive mAb characterization. The current limitations, as well as possible solutions to overcome them, are also outlined. A primary limitation revealed by the results of the present study is that the expert knowledge in both experiment and data analysis is indispensable to practice TD/MD MS.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1021/jasms.0c00036

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 82

  1. Beck, 2019, Macro- and Micro-Heterogeneity of Natural and Recombinant IgG Antibodies, Antibodies, 8, 18, 10.3390/antib8010018 · DOI
  2. Rathore, 2018, The role of mass spectrometry in the characterization of biologic protein products, Expert Rev. Proteomics, 15, 431, 10.1080/14789450.2018.1469982 · DOI · Paper page
  3. Taussig, 2018, Antibody validation: a view from the mountains, New Biotechnol., 45, 1, 10.1016/j.nbt.2018.08.002 · DOI · Paper page
  4. Rogers, 2018, A View on the Importance of "Multi-Attribute Method" for Measuring Purity of Biopharmaceuticals and Improving Overall Control Strategy, AAPS J., 20, 7, 10.1208/s12248-017-0168-3 · DOI · Paper page
  5. Xu, 2017, A Quadrupole Dalton-based multi-attribute method for product characterization, process development, and quality control of therapeutic proteins, mAbs., 9, 1186, 10.1080/19420862.2017.1364326 · DOI · Paper page
  6. Grilo, 2019, The Increasingly Human and Profitable Monoclonal Antibody Market, Trends Biotechnol., 37, 9, 10.1016/j.tibtech.2018.05.014 · DOI · Paper page
  7. Duivelshof, 2019, Glycosylation of biosimilars: Recent advances in analytical characterization and clinical implications, Anal. Chim. Acta, 1089, 1, 10.1016/j.aca.2019.08.044 · DOI
  8. Kaplon, 2020, Antibodies to watch in 2020, mAbs., 12, 1703531, 10.1080/19420862.2019.1703531 · DOI · Paper page
  9. Xu, 2019, Structure, heterogeneity and developability assessment of therapeutic antibodies, mAbs., 11, 239, 10.1080/19420862.2018.1553476 · DOI · Paper page
  10. Nowak, 2017, Forced degradation of recombinant monoclonal antibodies: A practical guide, mAbs, 9, 1217, 10.1080/19420862.2017.1368602 · DOI · Paper page
  11. Ebbers, 2012, Interchangeability, immunogenicity and biosimilars, Nat. Biotechnol., 30, 1186, 10.1038/nbt.2438 · doi:10.1038/nbt.2438
  12. Rogstad, 2017, A Retrospective Evaluation of the Use of Mass Spectrometry in FDA Biologics License Applications, J. Am. Soc. Mass Spectrom., 28, 786, 10.1007/s13361-016-1531-9 · DOI · Paper page
  13. Ambrogelly, 2018, Analytical comparability study of recombinant monoclonal antibody therapeutics, mAbs., 10, 513, 10.1080/19420862.2018.1438797 · DOI
  14. Fornelli, 2018, Top-down proteomics: Where we are, where we are going?, J. Proteomics, 175, 3, 10.1016/j.jprot.2017.02.002 · DOI
  15. Boutz, 2014, Proteomic Identification of Monoclonal Antibodies from Serum, Anal. Chem., 86, 4758, 10.1021/ac4037679 · DOI
  16. Miller, 2019, Improved Protein Inference from Multiple Protease Bottom-Up Mass Spectrometry Data, Journal of Proteome Research., 18, 3429, 10.1021/acs.jproteome.9b00330 · DOI
  17. Cheung, 2012, A proteomics approach for the identification and cloning of monoclonal antibodies from serum, Nat. Biotechnol., 30, 447, 10.1038/nbt.2167 · DOI · Paper page
  18. Srzentić, 2018, Chemical-Mediated Digestion: An Alternative Realm for Middle-down Proteomics?, Journal of Proteome Research., 17, 2005, 10.1021/acs.jproteome.7b00834 · DOI
  19. Srzentić, 2014, Advantages of extended bottom-up proteomics using Sap9 for analysis of monoclonal antibodies, Anal. Chem., 86, 9945, 10.1021/ac502766n · DOI
  20. McLafferty, 2007, Top-down MS, a powerful complement to the high capabilities of proteolysis proteomics, FEBS J., 274, 6256, 10.1111/j.1742-4658.2007.06147.x · DOI · Paper page
  21. Sen, 2017, Automated antibody de novo sequencing and its utility in biopharmaceutical discovery, J. Am. Soc. Mass Spectrom., 28, 803, 10.1007/s13361-016-1580-0 · DOI
  22. Morsa, 2019, Multi-Enzymatic Limited Digestion: The Next-Generation Sequencing for Proteomics?, Journal of Proteome Research., 18, 2501, 10.1021/acs.jproteome.9b00044 · DOI
  23. Müller, 2017, Systematic Evaluation of Protein Reduction and Alkylation Reveals Massive Unspecific Side Effects by Iodine-containing Reagents, Mol. Cell. Proteomics, 16, 1173, 10.1074/mcp.M116.064048 · DOI · Paper page
  24. Resemann, 2016, Full validation of therapeutic antibody sequences by middle-up mass measurements and middle-down protein sequencing, mAbs., 8, 318, 10.1080/19420862.2015.1128607 · DOI
  25. Loo, 1990, Primary sequence information from intact proteins by electrospray ionization tandem mass spectrometry, Science, 248, 201, 10.1126/science.2326633 · DOI · Paper page
  26. Loo, 1991, Tandem mass spectrometry of very large molecules: serum albumin sequence information from multiply charged ions formed by electrospray ionization, Anal. Chem., 63, 2488, 10.1021/ac00021a018 · DOI · Paper page
  27. McLafferty, 2001, Electron capture dissociation of gaseous multiply charged ions by Fourier transform ion cyclotron resonance, J. Am. Soc. Mass Spectrom., 12, 245, 10.1016/S1044-0305(00)00223-3 · DOI · Paper page
  28. Brodbelt, 2014, Photodissociation mass spectrometry: new tools for characterization of biological molecules, Chem. Soc. Rev., 43, 2757, 10.1039/C3CS60444F · DOI · Paper page
  29. Demeure, 2007, Rational Selection of the Optimum MALDI Matrix for Top-Down Proteomics by In-Source Decay, Anal. Chem., 79, 8678, 10.1021/ac070849z · DOI
  30. Fukuyama, 2006, Rapid sequencing and disulfide mapping of peptides containing disulfide bonds by using 1,5-diaminonaphthalene as a reductive matrix, J. Mass Spectrom., 41, 191, 10.1002/jms.977 · DOI
  31. LeDuc, 2007, Using ProSight PTM and Related Tools for Targeted Protein Identification and Characterization with High Mass Accuracy Tandem MS Data, Current Protocols in Bioinformatics., 19, 13.16.11, 10.1002/0471250953.bi1306s19 · DOI · Paper page
  32. Smith, 2019, A five-level classification system for proteoform identifications, Nat. Methods, 16, 939, 10.1038/s41592-019-0573-x · DOI · Paper page
  33. Park, 2017, Informed-Proteomics: open-source software package for top-down proteomics, Nat. Methods, 14, 909, 10.1038/nmeth.4388 · DOI · Paper page
  34. Tsybin, 2011, Structural analysis of intact monoclonal antibodies by electron transfer dissociation mass spectrometry, Anal. Chem., 83, 8919, 10.1021/ac201293m · DOI · Paper page
  35. Mao, 2013, Top-down structural analysis of an intact monoclonal antibody by electron capture dissociation Fourier transform ion cyclotron resonance mass spectrometry, Anal. Chem., 85, 4239, 10.1021/ac303525n · DOI · Paper page
  36. Fornelli, 2017, Top-down analysis of immunoglobulin G isotypes 1 and 2 with electron transfer dissociation on a high-field Orbitrap mass spectrometer, J. Proteomics, 159, 67, 10.1016/j.jprot.2017.02.013 · DOI · Paper page
  37. Fornelli, 2012, Analysis of intact monoclonal antibody IgG1 by electron transfer dissociation Orbitrap FTMS, Mol. Cell. Proteomics, 11, 1758, 10.1074/mcp.M112.019620 · DOI · Paper page
  38. Shaw, 2018, Sequencing grade tandem mass spectrometry for top-down proteomics using hybrid electron capture dissociation methods in a benchtop Orbitrap mass spectrometer, Anal. Chem., 90, 10819, 10.1021/acs.analchem.8b01901 · DOI · Paper page
  39. Zhang, 2009, Mass spectrometry for structural characterization of therapeutic antibodies, Mass Spectrom. Rev., 28, 147, 10.1002/mas.20190 · DOI · Paper page
  40. Wang, 2013, Structural comparison of two anti-CD20 monoclonal antibody drug products using middle-down mass spectrometry, Analyst, 138, 3058, 10.1039/c3an36524g · DOI
  41. Bondarenko, 2009, Mass measurement and top-down HPLC/MS analysis of intact monoclonal antibodies on a hybrid linear quadrupole ion trap–Orbitrap mass spectrometer, J. Am. Soc. Mass Spectrom., 20, 1415, 10.1016/j.jasms.2009.03.020 · DOI · Paper page
  42. Ayoub, 2013, Correct primary structure assessment and extensive glyco-profiling of cetuximab by a combination of intact, middle-up, middle-down and bottom-up ESI and MALDI mass spectrometry techniques, mAbs., 5, 699, 10.4161/mabs.25423 · DOI · Paper page
  43. Fornelli, 2014, Middle-Down Analysis of Monoclonal Antibodies with Electron Transfer Dissociation Orbitrap Fourier Transform Mass Spectrometry, Anal. Chem., 86, 3005, 10.1021/ac4036857 · DOI · Paper page
  44. Srzentić, 2018, Multiplexed Middle-Down Mass Spectrometry as a Method for Revealing Light and Heavy Chain Connectivity in a Monoclonal Antibody, Anal. Chem., 90, 12527, 10.1021/acs.analchem.8b02398 · DOI · Paper page
  45. Cotham, 2016, Characterization of Therapeutic Monoclonal Antibodies at the Subunit-Level using Middle-Down 193 nm Ultraviolet Photodissociation, Anal. Chem., 88, 4004, 10.1021/acs.analchem.6b00302 · DOI · Paper page
  46. Laskay, 2014, Extended bottom-up proteomics with secreted aspartic protease Sap9, J. Proteomics, 110, 20, 10.1016/j.jprot.2014.07.035 · DOI
  47. Sjögren, 2017, Generating and Purifying Fab Fragments from Human and Mouse IgG Using the Bacterial Enzymes IdeS, SpeB and Kgp, 10.1007/978-1-4939-6673-8_21 · DOI
  48. Faid, 2018, Middle-up analysis of monoclonal antibodies after combined IgdE and IdeS hinge proteolysis: Investigation of free sulfhydryls, J. Pharm. Biomed. Anal., 149, 541, 10.1016/j.jpba.2017.11.046 · DOI
  49. Brunner, 2015, Benchmarking Multiple Fragmentation Methods on an Orbitrap Fusion for Top-down Phospho-Proteoform Characterization, Anal. Chem., 87, 4152, 10.1021/acs.analchem.5b00162 · DOI · Paper page
  50. Fornelli, 2013, Top-down analysis of 30–80 kDa proteins by electron transfer dissociation time-of-flight mass spectrometry, Anal. Bioanal. Chem., 405, 8505, 10.1007/s00216-013-7267-5 · DOI
  51. Bakalarski, 2016, Rapid, semi-automated protein terminal characterization using ISDetect, Nat. Biotechnol., 34, 811, 10.1038/nbt.3621 · DOI
  52. De Leoz, M. L. A.; Duewer, D. L.; Stein, S. E. NIST Interlaboratory Study on the Glycosylation of NIST mAb, a Monoclonal Antibody Reference Material, June 2015 to February 2016, NISTIR 8186; NIST, 2017. 10.6028/NIST.IR.8186. · doi:10.6028/nist.ir.8186
  53. Li, 2017, Global Post-Translational Modification Discovery, Journal of Proteome Research., 16, 1383, 10.1021/acs.jproteome.6b00034 · DOI · Paper page
  54. Farrell, 2018, Monoclonal antibody sequence assessment using a hybrid quadrupole-Orbitrap mass spectrometer, Anal. Methods, 10, 3100, 10.1039/C8AY00582F · DOI
  55. Lössl, 2014, Boundaries of Mass Resolution in Native Mass Spectrometry, J. Am. Soc. Mass Spectrom., 25, 906, 10.1007/s13361-014-0874-3 · DOI · Paper page
  56. Jennewein, 2017, The Immunoregulatory Roles of Antibody Glycosylation, Trends Immunol., 38, 358, 10.1016/j.it.2017.02.004 · DOI · Paper page
  57. Wei, 2017, Glycation of antibodies: Modification, methods and potential effects on biological functions, mAbs., 9, 586, 10.1080/19420862.2017.1300214 · DOI · Paper page
  58. Li, 2015, Structural Elucidation of Post-Translational Modifications in Monoclonal Antibodies, 10.1021/bk-2015-1201.ch003 · DOI
  59. van der Burgt, 2019, Structural Analysis of Monoclonal Antibodies by Ultrahigh Resolution MALDI In-Source Decay FT-ICR Mass Spectrometry, Anal. Chem., 91, 2079, 10.1021/acs.analchem.8b04515 · DOI
  60. Nallet, 2012, Glycan variability on a recombinant IgG antibody transiently produced in HEK-293E cells, New Biotechnol., 29, 471, 10.1016/j.nbt.2012.02.003 · DOI
  61. Gstöttner, 2020, Monitoring glycation levels of a bispecific monoclonal antibody at subunit level by ultrahigh-resolution MALDI FT-ICR mass spectrometry, mAbs., 12, 1682403, 10.1080/19420862.2019.1682403 · DOI
  62. Tyshchuk, 2019, Characterization and prediction of positional 4-hydroxyproline and sulfotyrosine, two post-translational modifications that can occur at substantial levels in CHO cells-expressed biotherapeutics, mAbs, 11, 1219, 10.1080/19420862.2019.1635865 · DOI
  63. Tran, 2016, Complete De Novo Assembly of Monoclonal Antibody Sequences, Sci. Rep., 6, 31730, 10.1038/srep31730 · DOI · Paper page
  64. Wu, 2009, An Integrated Top-Down and Bottom-Up Strategy for Broadly Characterizing Protein Isoforms and Modifications, Journal of Proteome Research., 8, 1347, 10.1021/pr800720d · DOI · Paper page
  65. He, 2019, Classification of Plasma Cell Disorders by 21 T Fourier Transform Ion Cyclotron Resonance Top-Down and Middle-Down MS/MS Analysis of Monoclonal Immunoglobulin Light Chains in Human Serum, Anal. Chem., 91, 3263, 10.1021/acs.analchem.8b03294 · DOI
  66. Sjögren, 2015, EndoS and EndoS2 hydrolyze Fc-glycans on therapeutic antibodies with different glycoform selectivity and can be used for rapid quantification of high-mannose glycans, Glycobiology, 25, 1053, 10.1093/glycob/cwv047 · DOI
  67. Plomp, 2015, Hinge-Region O-Glycosylation of Human Immunoglobulin G3 (IgG3), Mol. Cell. Proteomics, 14, 1373, 10.1074/mcp.M114.047381 · DOI
  68. Zauner, 2013, Glycoproteomic Analysis of Antibodies, Mol. Cell. Proteomics, 12, 856, 10.1074/mcp.R112.026005 · DOI · Paper page
  69. Lyon, 2018, The Ups and Downs of Repeated Cleavage and Internal Fragment Production in Top-Down Proteomics, J. Am. Soc. Mass Spectrom., 29, 150, 10.1007/s13361-017-1823-8 · DOI · Paper page
  70. Zenaidee, M. A.; Lantz, C.; Perkins, T.; Jung, W.; Ogorzalek Loo, R. R.; Loo, J. A. Internal Fragments Generated by Electron Ionization Dissociation Enhance Protein Top-Down Mass Spectrometry. J. Am. Soc. Mass Spectrom., 2020 in press (https://doi.org/10.1021/jasms.0c00160). · doi:10.26434/chemrxiv.11573337.v2
  71. Huang, 2010, Top-down protein characterization facilitated by ion/ion reactions on a quadrupole/time of flight platform, Proteomics, 10, 3577, 10.1002/pmic.201000187 · DOI
  72. Riley, 2015, Activated Ion Electron Transfer Dissociation for Improved Fragmentation of Intact Proteins, Anal. Chem., 87, 7109, 10.1021/acs.analchem.5b00881 · DOI · Paper page
  73. Giorgetti, 2020, Combination of intact, middle-up and bottom-up levels to characterize 7 therapeutic monoclonal antibodies by capillary electrophoresis – mass spectrometry, J. Pharm. Biomed. Anal., 182, 113107, 10.1016/j.jpba.2020.113107 · DOI
  74. Lermyte, 2019, MIND: A Double-Linear Model To Accurately Determine Monoisotopic Precursor Mass in High-Resolution Top-Down Proteomics, Anal. Chem., 91, 10310, 10.1021/acs.analchem.9b02682 · DOI
  75. Vyatkina, 2016, Top-down analysis of protein samples by de novo sequencing techniques, Bioinformatics, 32, 2753, 10.1093/bioinformatics/btw307 · DOI
  76. Zhou, 2015, Performance metrics for evaluating system suitability in liquid chromatographyMass spectrometry peptide mass mapping of protein therapeutics and monoclonal antibodies, mAbs., 7, 1104, 10.1080/19420862.2015.1074364 · DOI
  77. Florio, 2018, Recent Advances and Ongoing Challenges in the Diagnosis of Microbial Infections by MALDI-TOF Mass Spectrometry, Front. Microbiol., 10.3389/fmicb.2018.01097 · DOI
  78. Zhou, 2014, Surface Induced Dissociation: Dissecting Noncovalent Protein Complexes in the Gas phase, Acc. Chem. Res., 47, 1010, 10.1021/ar400223t · DOI · Paper page
  79. Di Stefano, 2018, Size-Dependent Hydrogen Atom Attachment to Gas-Phase Hydrogen-Deficient Polypeptide Radical Cations, J. Am. Chem. Soc., 140, 531, 10.1021/jacs.7b10318 · doi:10.1021/jacs.7b10318
  80. Beck, 2019, Cutting-edge multi-level analytical and structural characterization of antibody-drug conjugates: present and future, Expert Rev. Proteomics, 16, 337, 10.1080/14789450.2019.1578215 · DOI
  81. Hernandez-Alba, 2019, A Case Study to Identify the Drug Conjugation Site of a Site-Specific Antibody-Drug-Conjugate Using Middle-Down Mass Spectrometry, J. Am. Soc. Mass Spectrom., 30, 2419, 10.1007/s13361-019-02296-2 · DOI
  82. Watts, 2020, Comprehensive Middle-Down Mass Spectrometry Characterization of an Antibody–Drug Conjugate by Combined Ion Activation Methods, Anal. Chem., 92, 9790, 10.1021/acs.analchem.0c01232 · DOI

Cited by

See all 116

Metadata

Authors
Srzentić, K., Fornelli, L., Tsybin, Y. O., Loo, J. A., Seckler, H., Agar, J. N., Anderson, L. C., Bai, D. L., Beck, A., Brodbelt, J. S., van der Burgt, Y. E. M., Chamot-Rooke, J., Chatterjee, S., Chen, Y., Clarke, D. J., Danis, P. O., Diedrich, J. K., D’Ippolito, R. A., Dupré, M., Gasilova, N., Ge, Y., Goo, Y. A., Goodlett, D. R., Greer, S., Haselmann, K. F., He, L., Hendrickson, C. L., Hinkle, J. D., Holt, M. V., Hughes, S., Hunt, D. F., Kelleher, N. L., Kozhinov, A. N., Lin, Z., Malosse, C., Marshall, A. G., Menin, L., Millikin, R. J., Nagornov, K. O., Nicolardi, S., Paša-Tolić, L., Pengelley, S., Quebbemann, N. R., Resemann, A., Sandoval, W., Sarin, R., Schmitt, N. D., Shabanowitz, J., Shaw, J. B., Shortreed, M. R., Smith, L. M., Sobott, F., Suckau, D., Toby, T., Weisbrod, C. R., Wildburger, N. C., Yates, J. R., Yoon, S. H., Young, N. L., & Zhou, M.
Venue
Journal of the American Society for Mass Spectrometry
Published
2020-07-31
Volume
31
Issue
9
Pages
1783-1802
ISSN
  • 1044-0305 (ISSN-L)
  • 1879-1123
OpenAlex
W3046609539
Cited by
116
References
25
FWCI
5.81
Type
journal article
Language
en
Open access
green
Funders
  • Division of Chemistry (CHE1402753)
  • Welch Foundation (F-1155)
  • National Center for Research Resources (S10RR028893)
  • Thermo Fisher Scientific
  • NIH Office of the Director (S10 OD018504)
  • H2020 Future and Emerging Technologies (829157)
  • National Institute of General Medical Sciences (GM037537, GM108569, R01GM103479)
  • Bruker Corporation
  • Genovis AB

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.