The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligence
Open accessAbstract
Legal Artificial Intelligence (LegalAI) focuses on applying the technology of artificial intelligence, especially natural language processing, to benefit tasks in the legal domain.In recent years, LegalAI has drawn increasing attention rapidly from both AI researchers and legal professionals, as LegalAI is beneficial to the legal system for liberating legal professionals from a maze of paperwork.Legal professionals often think about how to solve tasks from rulebased and symbol-based methods, while NLP researchers concentrate more on data-driven and embedding methods.In this paper, we describe the history, the current state, and the future directions of research in LegalAI.We illustrate the tasks from the perspectives of legal professionals and NLP researchers and show several representative applications in LegalAI.We conduct experiments and provide an indepth analysis of the advantages and disadvantages of existing works to explore possible future directions.You can find the implementation of our work from https://github. com/thunlp/CLAIM.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · Psychology of Learning and Motivation · doi:10.1016/c2009-0-62209-1 · Cited by 5,994
(2013) · Cited by 5,726
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
Learning Entity and Relation Embeddings for Knowledge Graph Completion
Lin, Y., Liu, Z., Sun, M., Liu, Y., & Zhu, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9491 · Cited by 3,749
Self-citationRendle, S. (2010) · 2010 IEEE International Conference on Data Mining · doi:10.1109/icdm.2010.127 · Cited by 3,189
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Yang, B., Yih, W.-T., He, X., Gao, J., & Deng, L. (2014) · arXiv · doi:10.48550/arxiv.1412.6575 · Cited by 2,252
Know What You Don't Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · arXiv · doi:10.48550/arxiv.1806.03822 · Cited by 2,242
Know What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505665 · Cited by 2,009
ERNIE: Enhanced Language Representation with Informative Entities
Zhang, Z., Han, X., Liu, Z., Jiang, X., Sun, M., & Liu, Q. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1139 · Cited by 1,482
Self-citationSome Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval
Robertson, S. E., & Walker, S. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_24 · Cited by 1,477
Bidirectional Attention Flow for Machine Comprehension
Seo, M. J., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01603 · Cited by 1,445
End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures
Miwa, M., & Bansal, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1105 · Cited by 1,322
Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks
Zeng, D., Liu, K., Chen, Y., & Zhao, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1203 · Cited by 1,149
Convolutional Neural Network Architectures for Matching Natural Language Sentences
Hu, B., Lu, Z., Li, H., & Chen, Q. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.03244 · Cited by 1,098
Neural Relation Extraction with Selective Attention over Instances
Lin, Y., Shen, S., Liu, Z., Luan, H., & Sun, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1200 · Cited by 1,021
Self-citationABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs
Yin, W., Schütze, H., Xiang, B., & Zhou, B. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00097 · Cited by 924
Event Extraction via Dynamic Multi-Pooling Convolutional Neural Networks
Chen, Y., Xu, L., Liu, K., Zeng, D., & Zhao, J. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1017 · Cited by 906
FastText.zip: Compressing text classification models
Joulin, A., Grave, E., Bojanowski, P., Douze, M., Jégou, H., & Mikolov, T. (2016) · arXiv · doi:10.48550/arxiv.1612.03651 · Cited by 887
Deep Pyramid Convolutional Neural Networks for Text Categorization
Johnson, R., & Zhang, T. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1052 · Cited by 823
Self-citationAletras, N., Tsarapatsanis, D., Preoţiuc-Pietro, D., & Lampos, V. (2016) · PeerJ Computer Science · doi:10.7717/peerj-cs.93 · Cited by 810
Knowledge Enhanced Contextual Word Representations
Peters, M. E., Neumann, M., Logan, R., Schwartz, R., Joshi, V., Singh, S., & Smith, N. A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1005 · Cited by 661
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Shen, Y., He, X., Gao, J., Deng, L., & Mesnil, G. (2014) · Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management · doi:10.1145/2661829.2661935 · Cited by 661
FISM: factored item similarity models for top-N recommender systems
Kabbur, S., Ning, X., & Karypis, G. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2487589 · Cited by 651
Joint Event Extraction via Recurrent Neural Networks
Nguyen, T. H., Cho, K., & Grishman, R. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1034 · Cited by 647
An artificial intelligence approach to legal reasoning
Gardner, A. V. D. L. (1985) · Medical Entomology and Zoology · Cited by 387
Graph Convolutional Networks With Argument-Aware Pooling for Event Detection
Nguyen, T., & Grishman, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12039 · Cited by 383
Predicting Supreme Court Cases Probabilistically: The Search and Seizure Cases, 1962-1981
Segal, J. A. (1984) · American Political Science Review · doi:10.2307/1955796 · Cited by 362
Neural Legal Judgment Prediction in English
Chalkidis, I., Androutsopoulos, I., & Aletras, N. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1424 · Cited by 352
Legal Judgment Prediction via Topological Learning
Zhong, H., Guo, Z., Tu, C., Xiao, C., Liu, Z., & Sun, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1390 · Cited by 344
Self-citationPooled Contextualized Embeddings for Named Entity Recognition
Akbik, A., Bergmann, T., & Vollgraf, R. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1078 · Cited by 286
Convolutional neural tensor network architecture for community-based question answering
Qiu, X., & Huang, X. (2015) · International Conference on Artificial Intelligence · Cited by 284
Kort, F. (1957) · American Political Science Review · doi:10.2307/1951767 · Cited by 200
(2019) · bepress Legal Repository · Cited by 192
Large-Scale Multi-Label Text Classification on EU Legislation
Chalkidis, I., Fergadiotis, E., Malakasiotis, P., & Androutsopoulos, I. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1636 · Cited by 191
Deep learning in law: early adaptation and legal word embeddings trained on large corpora
Chalkidis, I., & Kampas, D. (2019) · Artificial Intelligence and Law · doi:10.1007/s10506-018-9238-9 · Cited by 189
CAIL2018: A Large-Scale Legal Dataset for Judgment Prediction
Xiao, C., Zhong, H., Guo, Z., Tu, C., Liu, Z., Sun, M., Feng, Y., Han, X., Hu, Z., Wang, H., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02478 · Cited by 185
Self-citationFew-Shot Charge Prediction with Discriminative Legal Attributes
Hu, Z., Li, X., Tu, C., Liu, Z., & Sun, M. (2018) · International Conference on Computational Linguistics · Cited by 172
Self-citationJEC-QA: A Legal-Domain Question Answering Dataset
Zhong, H., Xiao, C., Tu, C., Zhang, T., Liu, Z., & Sun, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6519 · Cited by 168
Self-citationCharNER: Character-Level Named Entity Recognition
Kuru, O., Can, O. A., & Yüret, D. (2016) · International Conference on Computational Linguistics · Cited by 164
Ye, H., Jiang, X., Luo, Z., & Chao, W. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1168 · Cited by 161
Extractive summarisation of legal texts
Hachey, B., & Grover, C. (2007) · Artificial Intelligence and Law · doi:10.1007/s10506-007-9039-z · Cited by 157
The Supreme Court's Many Median Justices
Lauderdale, B. E., & Clark, T. S. (2012) · American Political Science Review · doi:10.1017/s0003055412000469 · Cited by 154
On the concept of relevance in legal information retrieval
van Opijnen, M., & Santos, C. T. (2017) · Artificial Intelligence and Law · doi:10.1007/s10506-017-9195-8 · Cited by 150
A Comparative Study of Summarization Algorithms Applied to Legal Case Judgments
Bhattacharya, P., Hiware, K., Rajgaria, S., Pochhi, N., Ghosh, K., & Ghosh, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-15712-8_27 · Cited by 145
Charge-Based Prison Term Prediction with Deep Gating Network
Chen, H., Cai, D., Dai, W., Dai, Z., & Ding, Y. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1667 · Cited by 123
Text retrieval in the legal world
Turtle, H. R. (1995) · Artificial Intelligence and Law · doi:10.1007/bf00877694 · Cited by 119
Iteratively Questioning and Answering for Interpretable Legal Judgment Prediction
Zhong, H., Wang, Y., Tu, C., Zhang, T., Liu, Z., & Sun, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5479 · Cited by 113
Self-citationA Co-Matching Model for Multi-choice Reading Comprehension
Wang, S., Yu, M., Jiang, J., & Chang, S. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2118 · Cited by 106
Artificial Intelligence and Legal Analytics: New Tools for Law Practice in the Digital Age
Zataraín, J. M. N. (2018) · SCRIPTed A Journal of Law Technology & Society · doi:10.2966/scrip.150118.156 · Cited by 105
A Walk-based Model on Entity Graphs for Relation Extraction
Christopoulou, F., Miwa, M., & Ananiadou, S. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2014 · Cited by 104
Semantic Text Matching for Long-Form Documents
Jiang, J., Zhang, M., Li, C., Bendersky, M., Golbandi, N., & Najork, M. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313707 · Cited by 97
Legal Document Retrieval Using Document Vector Embeddings and Deep Learning
Sugathadasa, K., Ayesha, B., de Silva, N., Perera, A. S., Jayawardana, V., Lakmal, D., & Perera, M. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-01177-2_12 · Cited by 89
Clickthrough-based latent semantic models for web search
Gao, J., Toutanova, K., & Yih, W.-T. (2011) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2009916.2010007 · Cited by 83
Artificial Intelligence and Legal Analytics: New Tools for Law Practice in the Digital Age
Ashley, K. D. (2017) · Cited by 80
CAIL2019-SCM: A Dataset of Similar Case Matching in Legal DomainPreprint
Xiao, C., Zhong, H., Guo, Z., Tu, C., Liu, Z., Sun, M., Zhang, T., Han, X., Hu, Z., Wang, H., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08962 · Cited by 75
Self-citationConcept and Context in Legal Information Retrieval
Tamsin, M. K., & Schäfer, B. (2008) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-58603-952-3-63 · Cited by 73
Hierarchical Attention Flow for Multiple-Choice Reading Comprehension
Zhu, H., Wei, F., Qin, B., & Liu, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12040 · Cited by 73
Named Entity Recognition, Linking and Generation for Greek Legislation
Angelidis, I., Chalkidis, I., & Koubarakis, M. (2018) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-61499-935-5-1 · Cited by 68
MANN: A Multichannel Attentive Neural Network for Legal Judgment Prediction
Li, S., Zhang, H., Ye, L., Guo, X., & Fang, B. (2019) · IEEE Access · doi:10.1109/access.2019.2945771 · Cited by 68
Quantitative Analysis of Judicial Processes: Some Practical and Theoretical Applications
Ulmer, S. S. (1963) · Law and Contemporary Problems · doi:10.2307/1190728 · Cited by 57
Truyens, M., & Eecke, P. V. (2014) · Computer law & security review · doi:10.1016/j.clsr.2014.01.009 · Cited by 57
Learning query and document similarities from click-through bipartite graph with metadata
Wu, W., Li, H., & Xu, J. (2013) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2433396.2433481 · Cited by 54
COLIEE-2018: Evaluation of the Competition on Legal Information Extraction and Entailment
Kano, Y., Kim, M., Yoshioka, M., Lu, Y., Rabelo, J. C. B., Kiyota, N., Goebel, R. G., & Satoh, K. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-31605-1_14 · Cited by 46
Latent Relation Language Models
Hayashi, H., Hu, Z., Xiong, C., & Neubig, G. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6298 · Cited by 44
Legal NERC with ontologies, Wikipedia and curriculum learning
Cardellino, C., Teruel, M., Alemany, L. A., & Villata, S. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2041 · Cited by 37
An Ontological Chinese Legal Consultation System
Zhang, N., Pu, Y., Sui-quan, Y., Zhou, J., & Gao, J.-K. (2017) · IEEE Access · doi:10.1109/access.2017.2745208 · Cited by 35
Two-step cascaded textual entailment for legal bar exam question answering
Kim, M.-Y., & Goebel, R. G. (2017) · International Conference on Artificial Intelligence and Law · doi:10.1145/3086512.3086550 · Cited by 35
A Test Collection for Evaluating Legal Case Law Search
Locke, D., & Zuccon, G. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210161 · Cited by 35
NLP for Shallow Question Answering of Legal Documents Using Graphs
Monroy, A. L., Calvo, H., & Gelbukh, A. F. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-00382-0_40 · Cited by 27
Using Citation Analysis Techniques for Computer-Assisted Legal Research in Continental JurisdictionsPreprint
Geist, A. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1397674 · Cited by 23
Legal Cause Prediction with Inner Descriptions and Outer Hierarchies
Liu, Z., Tu, C., Liu, Z., & Sun, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32381-3_46 · Cited by 16
Self-citationGov2Vec: Learning Distributed Representations of Institutions and Their Legal Text
Nay, J. J. (2016) · Workshop on Natural Language Processing and Computational Social Science (NLP+CSS) · doi:10.18653/v1/w16-5607 · Cited by 15
Using Legal Ontologies with Rules for Legal Textual Entailment
Fawei, B., Wyner, A., Pan, J. Z., & Kollingbaum, M. J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00178-0_21 · Cited by 12
Litigation Analytics: Case Outcomes Extracted from
Vacek, T., Teo, R., Song, D., Nugent, T., Cowling, C., & Schilder, F. (2019) · Natural Legal Language Processing Workshop (NLLP) · doi:10.18653/v1/w19-2206 · Cited by 8
Event Identification as a Decision Process with Non-linear Representation of TextPreprint
Yan, Y., Zheng, D., Lu, Z., & Song, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.00969 · Cited by 7
Cited by
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Self-citationKatz, D. M., Bommarito, M. J., Gao, S., & Arredondo, P. (2024) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2023.0254 · Cited by 420
Lawformer: A pre-trained language model for Chinese legal long documents
Xiao, C., Hu, X., Liu, Z., Tu, C., & Sun, M. (2021) · AI Open · doi:10.1016/j.aiopen.2021.06.003 · Cited by 278
Self-citation(2021) · doi:10.1145/3462757.3466088 · Cited by 151
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English
Chalkidis, I., Jana, A., Hartung, D., Bommarito, M. J., Androutsopoulos, I., Katz, D. M., & Aletras, N. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3936759 · Cited by 111
Metadata
- Authors
- Zhong, H., Xiao, C., Tu, C., Zhang, T., Liu, Z., & Sun, M.
- Venue
- Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
- Published
- 2020
- Pages
- 5218-5230
- OpenAlex
- W3035668167
- Cited by
- 367
- References
- 86
- FWCI
- 207.47
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.