The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Abstract
Message from the Program ChairsIt's hard to believe that we're actually going to be seeing the program come together in Toronto.We're really looking forward to it and to seeing you all there!Most of the work of a program chair is behind the scenes: herding reviewers and chairs, wrangling data from various sources, and answering lots and lots of email.This is a volunteer position, so the only reward we get for this is our chance to make the process of submitting and reviewing papers to our conference better.This letter will outline some of those experiments.First, we asked reviewers for two scores: soundness and excitement.Our goal was that any sound paper would be accepted to some ACL affiliated venue, but that the "main conference" distinction (limited by space) would be focused on the most exciting papers.Our hope was that soundness would be less noisy than a single "overall recommendation" score, which would help reduce the randomness of decisions.Judging by the exit surveys, this change was well received: over 80% of the chairs, reviewers and authors either expressed support or did not object to this change.Next, we developed a new process for matching papers to reviewers based on keywords for not only the subject matter of the paper, but also its type of contribution and target language(s).This allowed more fine-grained control over the paper-reviewer matches, and we were also able to provide the chairs with context for the paper-reviewer matches.To improve review quality, we also updated the reviewer guidelines, and developed a system for the authors to flag specific types of issues with reviews.Finally, we have also proposed a new initiative for recognizing outstanding reviewers and chairs (73 awards at ACL'23).Finally, we have tried to give more options for presentations.Findings papers now have an in-person presentation spotlight slot and virtual posters in addition to recording videos.Virtual posters have portals to link in-person attendees to virtual posters.We have also brought back Miniconf and RocketChat to allow for better virtual communication between papers (regardless of where the authors are).This conference is a result of the joint efforts of over ten thousand people.We deeply thank them all, and apologize for the many nagging emails we had to send out.In particular: AreasTo ensure a smooth process, the submissions to ACL 2023 were divided into 26 areas.The areas mostly followed these of previous ACL, and more broadly *ACL conferences, reflecting the typical divisions in the field.Following EMNLP 2022, we split the "Large Language Models" track away from "Machine learning in NLP", reflecting the growth of submissions in the area.We also offered two new tracks ("Linguistic diversity" and "Multilingualism and Cross-Lingual NLP").For the papers authored by SACs, the final recommendation decisions were made by a separate SAC team.The most popular areas (with over 250 submissions) were "Dialogue and Interactive Systems", "Information Extraction", "Large Language Models", "Machine Learning for NLP", and "NLP Applications". Best Paper AwardsACL'23 implemented the new ACL award policy, aiming to expand the pool of work that is recognized as outstanding.In total, 73 papers were nominated by the reviewers or area chairs for consideration for awards.These papers were assessed by the Best Paper Award Committee, and with their help we selected 4 best papers, 3 special awards (social impact, resource, reproduction), and several dozen outstanding papers.The best and outstanding papers will be announced in a dedicated plenary session for Best Paper Awards on July 10 2023. Presentation ModeIn ACL 2023, there is no meaningful distinction between oral and poster presentations in terms of paper quality.The composition of the oral sessions were proposed by the SACs of their respective tracks, so as to compose a thematically coherent set of papers on a shared topic or method, which would allow for an engaging discussion.The decisions were not based on the authors' virtual or on-site attendance.We hope you enjoy the program and the new elements we introduced (but let us know either way).We are looking forward to a great ACL 2023!
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
A note on a general definition of the coefficient of determination
NAGELKERKE, N. J. D. (1991) · Biometrika · doi:10.1093/biomet/78.3.691 · Cited by 5,927
Modern Applied Statistics with S Fourth edition
Venables, W. N., & Ripley, B. D. (2002) · Cited by 2,538
The Proof and Measurement of Association between Two Things
Spearman, C. (1987) · The American Journal of Psychology · doi:10.2307/1422689 · Cited by 996
ordinal: Regression Models for Ordinal Data
Christensen, R. H. B. (2010) · CRAN: Contributed Packages · doi:10.32614/cran.package.ordinal · Cited by 811
Computing Krippendorff's Alpha-Reliability
Krippendorff, K. (2011) · ScholarlyCommons (University of Pennsylvania) · Cited by 809
Knowledge Unlearning for Mitigating Privacy Risks in Language Models
Jang, J., Yoon, D., Yang, S., Cha, S., Lee, M., Logeswaran, L., & Seo, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.805 · Cited by 612
Reviewer bias in single- versus double-blind peer review
Tomkins, A., Zhang, M., & Heavlin, W. D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1707323114 · Cited by 605
Galactica: A Large Language Model for Science
Taylor, R., Kardas, M., Cucurull, G., Scialom, T., Hartshorn, A., Saravia, E., Poulton, A., Kerkez, V., & Stojnic, R. (2022) · arXiv · doi:10.48550/arxiv.2211.09085 · Cited by 605
Large Language Models Meet NL2Code: A Survey
Zan, D., Chen, B., Zhang, F., Lu, D., Wu, B., Guan, B., Yongji, W., & Lou, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.411 · Cited by 363
Can Large Language Models Be an Alternative to Human Evaluations?
Chiang, C.-H., & Lee, H.-Y. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.870 · Cited by 331
Can Large Language Models Be an Alternative to Human Evaluations?
Chiang, C.-H., & Lee, H.-Y. (2023) · arXiv · doi:10.48550/arxiv.2305.01937 · Cited by 331
A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications
Kang, D., Ammar, W., Dalvi, B., Zuylen, M., Kohlmeier, S., Hovy, E., & Schwartz, R. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1149 · Cited by 270
Revisiting Relation Extraction in the era of Large Language Models
Wadhwa, S., Amir, S., & Wallace, B. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.868 · Cited by 207
An Incentive Solution to the Peer Review Problem
Hauser, M., & Fehr, E. (2007) · PLoS Biology · doi:10.1371/journal.pbio.0050107 · Cited by 175
Classical peer review: an empty gun
Smith, R. W. (2010) · Breast Cancer Research · doi:10.1186/bcr2742 · Cited by 153
Is GPT-3 a Good Data Annotator?
Ding, B., Qin, C., Liu, L., Chia, Y. K., Li, B., Joty, S., & Bing, L. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.626 · Cited by 149
Rewarding reviewers – sense or sensibility? A Wiley study explained
Warne, V. (2016) · Learned Publishing · doi:10.1002/leap.1002 · Cited by 129
Does incentive provision increase the quality of peer review? An experimental study
Squazzoni, F., Bravo, G., & Takács, K. (2013) · Research Policy · doi:10.1016/j.respol.2012.04.014 · Cited by 93
MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African languages
Dione, C. M. B., Adelani, D. I., Nabende, P., Alabi, J. O., Sindane, T., Buzaaba, H., Muhammad, S. H., Emezue, C. C., Ogayo, P., Aremu, A., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.609 · Cited by 87
Argument Mining for Understanding Peer Reviews
Hua, X., Nikolov, M., Badugu, N., & Wang, L. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1219 · Cited by 86
Can LMs Learn New Entities from Descriptions? Challenges in Propagating Injected Knowledge
Onoe, Y., Zhang, M., Padmanabhan, S., Durrett, G., & Choi, E. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.300 · Cited by 83
Character-Aware Models Improve Visual Text Rendering
Liu, R., Garrette, D., Saharia, C., Chan, W., Roberts, A., Narang, S., Blok, I., Mical, R., Norouzi, M., & Constant, N. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.900 · Cited by 81
Rehearsal-free Continual Language Learning via Efficient Parameter Isolation
Wang, Z., Liu, Y., Ji, T., Wang, X., Wu, Y., Jiang, C., Ye, C., Han, Z., Wang, L., Shao, X., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.612 · Cited by 81
MISGENDERED: Limits of Large Language Models in Understanding Pronouns
Hossain, T., Dev, S., & Singh, S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.293 · Cited by 74
RankCSE: Unsupervised Sentence Representations Learning via Learning to Rank
Liu, J., Liu, J., Wang, Q., Wang, J., Wu, W., Xian, Y., Zhao, D., Chen, K., & Yan, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.771 · Cited by 65
Zheng, W., Yu, J., Xia, R., & Wang, S. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.861 · Cited by 51
CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding
Hou, Z., Zhong, W., Ji, L., Gao, D., Yan, K., Chan, W. K., Ngo, C., Shou, M. Z., & Duan, N. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.445 · Cited by 51
LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming
Gao, J., Lian, Y., Zhou, Z., Fu, Y., & Wang, B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.858 · Cited by 50
Gender Issues in Computer Science: Lessons Learnt and Reflections for the Future
Jaccheri, L., Pereira, C., & Fast, S. (2020) · International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) · doi:10.1109/synasc51798.2020.00014 · Cited by 44
I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation
Bhagavatula, C., Hwang, J. D., Downey, D., Bras, R. J. L., Lu, X., Qin, L., Sakaguchi, K., Swayamdipta, S., West, P., & Choi, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.535 · Cited by 44
Statistical Methods for Annotation Analysis
Paun, S., Artstein, R., & Poesio, M. (2022) · Synthesis lectures on human language technologies · doi:10.2200/s01131ed1v01y202109hlt054 · Cited by 43
Jiang, Y. E., Liu, T., Ma, S., Zhang, D., Sachan, M., & Cotterell, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.435 · Cited by 37
Pre-trained Language Models Can be Fully Zero-Shot Learners
Zhao, X., Ouyang, S., Yu, Z., Wu, M., & Li, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.869 · Cited by 36
PaRe: A Paper-Reviewer Matching Approach Using a Common Topic Space
Anjum, O., Gong, H., Bhat, S., Hwu, W., & Xiong, J. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1049 · Cited by 35
(2020) · doi:10.18653/v1/2020.findings-emnlp.112 · Cited by 32
Are Message Passing Neural Networks Really Helpful for Knowledge Graph Completion?
Li, J., Shomer, H., Ding, J., Wang, Y., Ma, Y., Shah, N., Tang, J., & Yin, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.597 · Cited by 31
Query Refinement Prompts for Closed-Book Long-Form QA
Amplayo, R. K., Webster, K., Collins, M., Das, D., & Narayan, S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.444 · Cited by 31
Hu, Y., Li, R., Chen, C., Qin, C., Zhu, Q., & Chng, E. S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.848 · Cited by 30
Double-Branch Multi-Attention based Graph Neural Network for Knowledge Graph Completion
Xu, H., Bao, J., & Liu, W. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.850 · Cited by 30
Learning Better Masking for Better Language Model Pre-training
Yang, D., Zhang, Z., & Zhao, H. Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.400 · Cited by 30
Collusion rings threaten the integrity of computer science research
Littman, M. L. (2021) · Communications of the ACM · doi:10.1145/3429776 · Cited by 29
Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference
Zheng, J., Ma, Q., Qiu, S., Wu, Y., Ma, P., Liu, J., Feng, H., Shang, X., & Chen, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.509 · Cited by 27
Reproducibility in NLP: What Have We Learned from the Checklist?
Magnusson, I., Smith, N. A., & Dodge, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.809 · Cited by 22
A Dataset on Malicious Paper Bidding in Peer Review
Jecmen, S., Yoon, M., Conitzer, V., Shah, N. B., & Fang, F. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583424 · Cited by 21
Back Translation for Speech-to-text Translation Without Transcripts
Fang, Q., & Feng, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.251 · Cited by 20
The fate of published articles, submitted again
Bartko, J. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011213 · Cited by 17
Wang, Y., Hu, Z., Liang, J., & Li, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.785 · Cited by 17
Emerging trends: Reviewing the reviewers (again)
Church, K. W. (2020) · Natural Language Engineering · doi:10.1017/s1351324920000030 · Cited by 16
Does My Rebuttal Matter? Insights from a Major NLP Conference
Gao, Y., Eger, S., Kuznetsov, I., Gurevych, I., & Miyao, Y. (2019) · TUbilio (Technical University of Darmstadt) · doi:10.48550/arxiv.1903.11367 · Cited by 16
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation
Zhang, S., Liang, Y., Wang, S., Chen, Y., Han, W., Liu, J., & Xu, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.448 · Cited by 16
MAD-TSC: A Multilingual Aligned News Dataset for Target-dependent Sentiment Classification
Dufraisse, E., Popescu, A., Tourille, J., Brun, A., & Deshayes-Chossart, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.461 · Cited by 16
Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment
Cortes, C., & Lawrence, N. D. (2021) · arXiv · doi:10.48550/arxiv.2109.09774 · Cited by 15
A comparative study on the impact of model compression techniques on fairness in language models
Ramesh, K., Chavan, A., Pandit, S., & Sitaram, S. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.878 · Cited by 15
Two-Stage Fine-Tuning for Improved Bias and Variance for Large Pretrained Language Models
Wang, L., Li, Y., Miller, T., Bethard, S. J., & Savova, G. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.877 · Cited by 12
Introducing Semantics into Speech Encoders
Xu, D. C., Dong, S., Wang, C., Kim, S., Lin, Z., Liu, B., Shrivastava, A., Li, S.-W. D., Tseng, L.-H., Lin, G.-T., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.639 · Cited by 11
Yes-Yes-Yes: Proactive Data Collection for ACL Rolling Review and Beyond
Dycke, N., Kuznetsov, I., & Gurevych, I. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.23 · Cited by 10
Multilingual Event Extraction from Historical Newspaper Adverts
Borenstein, N., Perez, N. D. S., & Augenstein, I. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.574 · Cited by 9
Chen, Y., Zhang, H., Zhou, Y., Bai, X., Wang, Y., Ming, Z., Yan, J., Li, Y., Li, J., Xianchao, Z., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.519 · Cited by 8
Distributed Marker Representation for Ambiguous Discourse Markers and Entangled Relations
Ru, D., Qiu, L., Qiu, X., Zhang, Y., & Zhang, Z. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.292 · Cited by 8
Chen, C., Walker, D., & Saligrama, V. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.530 · Cited by 8
INK: Injecting kNN Knowledge in Nearest Neighbor Machine Translation
Zhu, W., Xu, J., Huang, S., Kong, L., & Chen, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.888 · Cited by 6
A New Dataset and Empirical Study for Sentence Simplification in Chinese
Yang, S., Sun, R., & Wan, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.462 · Cited by 5
Towards Zero-Shot Multilingual Transfer for Code-Switched Responses
Wu, T.-W., Zhao, C., Chang, E., Shi, Y., Chuang, P., Chandra, V., & Juang, B. H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.417 · Cited by 5
Dynamic Regularization in UDA for Transformers in Multimodal Classification
Monter-Aldana, I., López-Monroy, A. P., & Sánchez-Vega, F. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.485 · Cited by 4
Zhang, X., Huang, H., Chi, Z., & Mao, X.-L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.857 · Cited by 4
Constrained Tuple Extraction with Interaction-Aware Network
Xue, X., Zhang, C., Xu, T., & Niu, Z. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.640 · Cited by 4
Soft Language Clustering for Multilingual Model Pre-training
Zeng, J., Jiang, Y., Yin, Y., Yi, J., Meng, F., Lin, B., Cao, Y., & Zhou, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.388 · Cited by 2
Tao, Z., Jin, Z. G., Zhao, H., Dou, C., Zhao, Y., Shen, T., & Tao, C. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.391 · Cited by 2
Thorn Jakobsen, T., & Rogers, A. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.354 · Cited by 1
Automatic Annotation of Direct Speech in Written French Narratives
Durandard, N., Tran, V. A., Michel, G., & Epure, E. V. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.393 · Cited by 1
Cited by
A Comprehensive Overview of Large Language Models
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2023) · arXiv · doi:10.48550/arxiv.2307.06435 · Cited by 1,259
A Comprehensive Overview of Large Language Models
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3744746 · Cited by 1,257
Large Language Models for Software Engineering: A Systematic Literature Review
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3695988 · Cited by 1,029
Automated Text Analysis for Consumer Research
Humphreys, A., & Wang, R. J.-H. (2018) · Journal of Consumer Research · doi:10.1093/jcr/ucx104 · Cited by 636
Unleashing the potential of prompt engineering for large language models
Chen, B., Zhang, Z., Langrené, N., & Zhu, S. (2025) · Patterns · doi:10.1016/j.patter.2025.101260 · Cited by 490
Metadata
- Published
- 2023
- OpenAlex
- W2148437670
- Cited by
- 355
- References
- 71
- Type
- paratext
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.