The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
Folding non-homologous proteins by coupling deep-learning contact maps with I-TASSER assembly simulations
Open accessAbstract
Structure prediction for proteins lacking homologous templates in the Protein Data Bank (PDB) remains a significant unsolved problem. We developed a protocol, C-I-TASSER, to integrate interresidue contact maps from deep neural-network learning with the cutting-edge I-TASSER fragment assembly simulations. Large-scale benchmark tests showed that C-I-TASSER can fold more than twice the number of non-homologous proteins than the I-TASSER, which does not use contacts. When applied to a folding experiment on 8,266 unsolved Pfam families, C-I-TASSER successfully folded 4,162 domain families, including 504 folds that are not found in the PDB. Furthermore, it created correct folds for 85% of proteins in the SARS-CoV-2 genome, despite the quick mutation rate of the virus and sparse sequence profiles. The results demonstrated the critical importance of coupling whole-genome and metagenome-based evolutionary information with optimal structure assembly simulations for solving the problem of non-homologous protein structure prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gapped BLAST and PSI-BLAST: a new generation of protein database search programs
Altschul, S. (1997) · Nucleic Acids Research · doi:10.1093/nar/25.17.3389 · Cited by 73,302
Fast Parallel Algorithms for Short-Range Molecular Dynamics
Plimpton, S. (1995) · Journal of Computational Physics · doi:10.1006/jcph.1995.1039 · Cited by 44,721
Crystallography & NMR System: A New Software Suite for Macromolecular Structure Determination
Brünger, A. T., Adams, P. D., Clore, G. M., DeLano, W. L., Gros, P., Grosse-Kunstleve, R. W., Jiang, J. S., Kuszewski, J., Nilges, M., Pannu, N. S., et al. (1998) · Acta Crystallographica Section D Biological Crystallography · doi:10.1107/s0907444998003254 · Cited by 15,715
Comparative Protein Modelling by Satisfaction of Spatial Restraints
Šali, A., & Blundell, T. L. (1993) · Journal of Molecular Biology · doi:10.1006/jmbi.1993.1626 · Cited by 12,977
(2017) · Cited by 11,625
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665 · cited 1×
“Given the training features, two architectures were proposed based on deep residual neural networks (ResNets) (He et al., 2016), where the first version of ResNet is used as the basic residual block, defined as:”
MethodThe I-TASSER Suite: protein structure and function prediction
Yang, J., Yan, R., Roy, A., Xu, D., Poisson, J., & Zhang, Y. (2015) · Nature Methods · doi:10.1038/nmeth.3213 · Cited by 5,596 · cited 6×
“…2013) https://zhanglab.ccmb.med.umich.edu/ ThreaDom/ DEMO (Zhou et al., 2019) https://zhanglab.ccmb.med.umich.edu/ DEMO/ I-TASSER (Wu et al., 2007; Yang et al., 2015) https://zhanglab.ccmb.med.umich.edu/ I-TASSER/ CNS (Brunger et al., 1998)…”
BackgroundMethodInfluentialSelf-citationEddy, S. R. (1998) · Bioinformatics · doi:10.1093/bioinformatics/14.9.755 · Cited by 5,515
Jones, D. T. (1999) · Journal of Molecular Biology · doi:10.1006/jmbi.1999.3091 · Cited by 5,449
The Pfam protein families database in 2019
El-Gebali, S., Mistry, J., Bateman, A., Eddy, S. R., Luciani, A., Potter, S. C., Qureshi, M., Richardson, L. J., Salazar, G. A., Smart, A., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gky995 · Cited by 4,602
TM-align: a protein structure alignment algorithm based on the TM-score
Zhang, Y. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki524 · Cited by 3,774
Self-citationImproved protein structure prediction using potentials from deep learning
Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., Qin, C., Žídek, A., Nelson, A. W. R., Bridgland, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1923-7 · Cited by 3,378
Knowledge‐based protein secondary structure assignment
Frishman, D., & Argos, P. (1995) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.340230412 · Cited by 2,523
Protein homology detection by HMM–HMM comparison
Söding, J. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti125 · Cited by 2,423
Scoring function for automated assessment of protein structure template quality
Zhang, Y., & Skolnick, J. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20264 · Cited by 2,392
Self-citationHHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment
Remmert, M., Biegert, A., Hauser, A., & Söding, J. (2012) · Nature Methods · doi:10.1038/nmeth.1818 · Cited by 2,288
UniRef clusters: a comprehensive and scalable alternative for improving sequence similarity searches
Suzek, B. E., Wang, Y., Huang, H., McGarvey, P. B., Wu, C. H., & the UniProt Consortium (2015) · Bioinformatics · doi:10.1093/bioinformatics/btu739 · Cited by 1,928
Force Fields for Protein Simulations
Ponder, J. W., & Case, D. A. (2003) · Advances in Protein Chemistry · doi:10.1016/s0065-3233(03)66002-x · Cited by 1,903
Improved protein structure prediction using predicted interresidue orientations
Yang, J., Anishchenko, I., Park, H., Peng, Z., Ovchinnikov, S., & Baker, D. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1914677117 · Cited by 1,421
HH-suite3 for fast remote homology detection and deep protein annotation
Steinegger, M., Meier, M., Mirdita, M., Vöhringer, H., Haunsberger, S. J., & Söding, J. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-3019-7 · Cited by 1,145
Protein 3D Structure Computed from Evolutionary Sequence Variation
Marks, D. S., Colwell, L. J., Sheridan, R., Hopf, T. A., Pagnani, A., Zecchina, R., & Sander, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028766 · Cited by 1,144 · cited 2×
“Most recently, with the development of advanced algorithms in co-evolutionary decoupling (Jones et al., 2012; Marks et al., 2011; Weigt et al., 2009) and deep machine learning (Li et al.”
BackgroundMethodHow significant is a protein structure similarity with TM-score = 0.5?
Xu, J., & Zhang, Y. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq066 · Cited by 1,142
Self-citationIdentification of direct residue contacts in protein–protein interaction by message passing
Weigt, M., White, R. A., Szurmant, H., Hoch, J. A., & Hwa, T. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0805923106 · Cited by 1,025
Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
Wang, S., Sun, S., Li, Z., Zhang, R., & Xu, J. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005324 · Cited by 931
Clustering huge protein sequence sets in linear time
Steinegger, M., & Söding, J. (2018) · Nature Communications · doi:10.1038/s41467-018-04964-5 · Cited by 875
Correlated mutations and residue contacts in proteins
Göbel, U., Sander, C., Schneider, R., & Valencia, A. (1994) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.340180402 · Cited by 863
LOMETS: A local meta-threading-server for protein structure prediction
Wu, S., & Zhang, Y. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm251 · Cited by 778
Self-citationJones, D. T., Buchan, D. W. A., Cozzetto, D., & Pontil, M. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr638 · Cited by 770
Uniclust databases of clustered and deeply annotated protein sequences and alignments
Mirdita, M., von den Driesch, L., Galiez, C., Martin, M. J., Söding, J., & Steinegger, M. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw1081 · Cited by 759
Kamisetty, H., Ovchinnikov, S., & Baker, D. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1314045110 · Cited by 672
Critical assessment of methods of protein structure prediction (CASP) — round x
Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T., & Tramontano, A. (2014) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.24452 · Cited by 652
Browne, W. J., North, A. C. T., Phillips, D. C., Brew, K., Vanaman, T. C., & Hill, R. L. (1969) · Journal of Molecular Biology · doi:10.1016/0022-2836(69)90487-2 · Cited by 525
Protein structure determination using metagenome sequence data
Ovchinnikov, S., Park, H., Varghese, N., Huang, P.-S., Pavlopoulos, G. A., Kim, D. E., Kamisetty, H., Kyrpides, N. C., & Baker, D. (2017) · Science · doi:10.1126/science.aah4043 · Cited by 520
Ab initio modeling of small proteins by iterative TASSER simulations
Wu, S., Skolnick, J., & Zhang, Y. (2007) · BMC Biology · doi:10.1186/1741-7007-5-17 · Cited by 514
Self-citationProgress and challenges in protein structure prediction
Zhang, Y. (2008) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2008.02.004 · Cited by 506
Self-citationCritical assessment of methods of protein structure prediction (CASP)—Round XIII
Kryshtafovych, A., Schwede, T., Topf, M., Fidelis, K., & Moult, J. (2019) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25823 · Cited by 506
CCMpred—fast and precise prediction of protein residue–residue contacts from correlated mutations
Seemayer, S., Gruber, M., & Söding, J. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu500 · Cited by 416
Distance-based protein folding powered by deep learning
Xu, J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821309116 · Cited by 401
SPICKER: A clustering approach to identify near‐native protein folds
Zhang, Y., & Skolnick, J. (2004) · Journal of Computational Chemistry · doi:10.1002/jcc.20011 · Cited by 393
Self-citationWu, S., & Zhang, Y. (2008) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.21945 · Cited by 375
Self-citationFast parallel algorithms for short-range molecular dynamics
Sandia National Labs., A., Plimpton, S. J., & USDOE, W. (1993) · doi:10.2172/10176421 · Cited by 365
Zhang, J., Liang, Y., & Zhang, Y. (2011) · Structure · doi:10.1016/j.str.2011.09.022 · Cited by 335
Self-citationCritical assessment of methods of protein structure prediction (CASP)—Round XII
Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T., & Tramontano, A. (2018) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25415 · Cited by 326
Yang, Y., Faraggi, E., Zhao, H., & Zhou, Y. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr350 · Cited by 325
Critical assessment of methods of protein structure prediction—Round VII
Moult, J., Fidelis, K., Kryshtafovych, A., Rost, B., Hubbard, T., & Tramontano, A. (2007) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.21767 · Cited by 324
PDBTM: Protein Data Bank of transmembrane proteins after 8 years
Kozma, D., Simon, I., & Tusnády, G. E. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1169 · Cited by 285
Protein structure prediction: when is it useful?
Zhang, Y. (2009) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2009.02.005 · Cited by 277 · cited 2×
“Finally, REMO (Li and Zhang, 2009) is used to add backbone atoms (N, C, O) and FASPR (Huang et al., 2020) is used to build side-chain rotamers.”
BackgroundMethodSelf-citationTOUCHSTONE II: A New Approach to Ab Initio Protein Structure Prediction
Zhang, Y., Kolinski, A., & Skolnick, J. (2003) · Biophysical Journal · doi:10.1016/s0006-3495(03)74551-2 · Cited by 272
Self-citationRecovery of protein structure from contact maps
Vendruscolo, M., Kussell, E., & Domany, E. (1997) · Folding and Design · doi:10.1016/s1359-0278(97)00041-2 · Cited by 268
Zhou, H., & Zhou, Y. (2005) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20308 · Cited by 254
Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T., & Tramontano, A. (2016) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25064 · Cited by 232
Critical assessment of methods of protein structure prediction (CASP)—round IX
Moult, J., Fidelis, K., Kryshtafovych, A., & Tramontano, A. (2011) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.23200 · Cited by 211
Deep‐learning contact‐map guided protein structure prediction in CASP13
Zheng, W., Li, Y., Zhang, C., Pearce, R., Mortuza, S. M., & Zhang, Y. (2019) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25792 · Cited by 208
Self-citationYan, R., Xu, D., Yang, J., Walker, S., & Zhang, Y. (2013) · Scientific Reports · doi:10.1038/srep02619 · Cited by 206
Self-citationProtein threading using PROSPECT: Design and evaluation
Xu, Y., & Xu, D. (2000) · Proteins: Structure, Function, and Genetics · doi:10.1002/1097-0134(20000815)40:3<343::aid-prot10>3.0.co;2-s · Cited by 199
Critical assessment of methods of protein structure prediction—Round VIII
Moult, J., Fidelis, K., Kryshtafovych, A., Rost, B., & Tramontano, A. (2009) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.22589 · Cited by 186
Jones, D. T., & Kandathil, S. M. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty341 · Cited by 184
Zhang, C., Zheng, W., Mortuza, S. M., Li, Y., & Zhang, Y. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz863 · Cited by 182
Self-citationGreener, J. G., Kandathil, S. M., & Jones, D. T. (2019) · Nature Communications · doi:10.1038/s41467-019-11994-0 · Cited by 178
FreeContact: fast and free software for protein contact prediction from residue co-evolution
Kaján, L., Hopf, T. A., Kalaš, M., Marks, D. S., & Rost, B. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-85 · Cited by 165
Chandonia, J.-M., Fox, N. K., & Brenner, S. E. (2019) · Nucleic Acids Research · doi:10.1093/nar/gky1134 · Cited by 165
DNCON2: improved protein contact prediction using two-level deep convolutional neural networks
Adhikari, B., Hou, J., & Cheng, J. (2018) · Bioinformatics · doi:10.1093/bioinformatics/btx781 · Cited by 165
Li, Y., Hu, J., Zhang, C., Yu, D.-J., & Zhang, Y. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz291 · Cited by 158
Self-citationAutomatic Prediction of Protein 3D Structures by Probabilistic Multi-template Homology Modeling
Meier, A., & Söding, J. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004343 · Cited by 153
Zheng, W. H., Zhang, C., Wuyun, Q., Pearce, R., Li, Y., & Zhang, Y. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz384 · Cited by 144
Self-citationLi, Y., & Zhang, Y. (2009) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.22380 · Cited by 138
Self-citationCASP9 assessment of free modeling target predictions
Kinch, L. N., Shi, S. Y., Cong, Q., Cheng, H., Liao, Y., & Grishin, N. V. (2011) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.23181 · Cited by 125
Automated server predictions in CASP7
Battey, J. N. D., Kopp, J., Bordoli, L., Read, R. J., Clarke, N. D., & Schwede, T. F. (2007) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.21761 · Cited by 124
Xu, D. H., Jaroszewski, L., Li, Z., & Godzik, A. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt578 · Cited by 118
Enhancing Evolutionary Couplings with Deep Convolutional Neural Networks
Liu, Y., Palmedo, P., Ye, Q., Berger, B., & Peng, J. (2018) · Cell Systems · doi:10.1016/j.cels.2017.11.014 · Cited by 114
Assembling multidomain protein structures through analogous global structural alignments
Zhou, X., Hu, J. S., Zhang, C., Zhang, G., & Zhang, Y. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905068116 · Cited by 113
Self-citationEvaluation of residue–residue contact predictions in CASP9
Monastyrskyy, B., Fidelis, K. A., Tramontano, A. L., & Kryshtafovych, A. (2011) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.23160 · Cited by 110
Zhang, C., Mortuza, S. M., He, B., Wang, Y., & Zhang, Y. (2017) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25414 · Cited by 102
Self-citationFASPR: an open-source tool for fast and accurate protein side-chain packing
Huang, X., Pearce, R., & Zhang, Y. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa234 · Cited by 98
Self-citationProfile Comparer: a program for scoring and aligning profile hidden Markov models
Madera, M. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn504 · Cited by 96
Li, Y., Zhang, C., Bell, E. W., Yu, D., & Zhang, Y. (2019) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25798 · Cited by 94
Self-citationEvaluation of residue–residue contact prediction in CASP10
Monastyrskyy, B., D’Andrea, D., Fidelis, K. A., Tramontano, A. L., & Kryshtafovych, A. (2013) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24340 · Cited by 92
ThreaDom: extracting protein domain boundary information from multiple threading alignments
Xue, Z., Xu, D. H., Wang, Y., & Zhang, Y. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt209 · Cited by 87
Self-citation(2021) · doi:10.1371/journal.pcbi.1008865 · Cited by 85
Improving Protein Structure Prediction Using Multiple Sequence-Based Contact Predictions
Wu, S., Szilágyi, A., & Zhang, Y. (2011) · Structure · doi:10.1016/j.str.2011.05.004 · Cited by 75
Self-citationHe, B., Mortuza, S. M., Wang, Y., Shen, H., & Zhang, Y. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx164 · Cited by 72
Self-citationEvaluation of the template‐based modeling in CASP12
Kryshtafovych, A., Monastyrskyy, B., Fidelis, K. A., Moult, J., Schwede, T. F., & Tramontano, A. L. (2017) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25425 · Cited by 68
Assessing the accuracy of contact predictions in CASP13
Shrestha, R., Fajardo, E. J., Gil, N., Fidelis, K. A., Kryshtafovych, A., Monastyrskyy, B., & Fiser, A. (2019) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25819 · Cited by 63
Improved protein contact predictions with the MetaPSICOV2 server in CASP12
Buchan, D. W., & Jones, D. T. (2017) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25379 · Cited by 54
Detecting distant-homology protein structures by aligning deep neural-network based contact maps
Zheng, W. H., Wuyun, Q., Li, Y., Mortuza, S. M., Zhang, C., Pearce, R., Ruan, J., & Zhang, Y. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007411 · Cited by 54
Self-citationChan, W. K. B., & Zhang, Y. (2020) · Journal of Molecular Biology · doi:10.1016/j.jmb.2020.07.003 · Cited by 25
Self-citationPconsFam: An Interactive Database of Structure Predictions of Pfam Families
Lamb, J., Jarmolinska, A. I., Michel, M., Hurtado, D. M., Sulkowska, J. I., & Elofsson, A. (2019) · Journal of Molecular Biology · doi:10.1016/j.jmb.2019.01.047 · Cited by 14
Cited by
Zhou, X., Zheng, W., Li, Y., Pearce, R., Zhang, C., Bell, E. W., Zhang, G., & Zhang, Y. (2022) · Nature Protocols · doi:10.1038/s41596-022-00728-0 · Cited by 519
Self-citationDeepUMQA: Ultrafast Shape Recognition-based Protein Model Quality Assessment using Deep Learning
Guo, S.-S., Liu, J., Zhou, X.-G., & Zhang, G.-J. (2021) · doi:10.1101/2021.10.02.462491 · Cited by 53
DeepUMQA: ultrafast shape recognition-based protein model quality assessment using deep learning
Guo, S.-S., Liu, J., Zhou, X.-G., & Zhang, G.-J. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac056 · Cited by 53
Adcox, H. E., Hunt, J. R., Allen, P. E., Siff, T. E., Rodino, K. G., Ottens, A. K., & Carlyon, J. A. (2024) · Nature Communications · doi:10.1038/s41467-024-52119-6 · Cited by 13
A Revised Molecular Model of Ovarian Cancer Biomarker CA125 (MUC16) Enabled by Long-read Sequencing
Wang, C.-W., Weaver, S. D., Boonpattrawong, N., Schuster-Little, N., Patankar, M., & Whelan, R. J. (2024) · Cancer Research Communications · doi:10.1158/2767-9764.crc-23-0327 · Cited by 12
Metadata
- Authors
- Zheng, W., Zhang, C., Li, Y., Pearce, R., Bell, E. W., & Zhang, Y.
- Venue
- Cell Reports Methods
- Publisher
- Elsevier BV
- Published
- 2021-07
- Volume
- 1
- Issue
- 3
- Pages
- 100014
- ISSN
- 2667-2375 (ISSN-L)
- OpenAlex
- W3173197060
- Cited by
- 569
- References
- 89
- FWCI
- 28.38
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.