The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Deduplicating Training Data Makes Language Models Better
Open accessAbstract
Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, Nicholas Carlini. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2022.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Data deduplication has become a key tool for language model projects following research showing that it both improves performance on downstream tasks (Lee et al., 2022; Zhang et al., 2021) and decreases memorization of training data (Kandpal et al., 2022).”
From The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset (2023) · cites this paper as Lee et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ensure reliable evaluation and improve performance [26], we deduplicate documents by title and utilize the predefined training and validation splits.”
From Lightweight and Direct Document Relevance Optimization for Generative Information Retrieval (2025) · cites this paper as [26]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For example, the probability of reproducing training data has been shown to correlate with its frequency of appearance [12].”
From Hallucinations in Bibliographic Recommendation: Citation Frequency as a Proxy for Training Data Redundancy (2025) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“Deduplication is a powerful strategy for improving dataset quality (Li et al., 2024; Lee et al., 2022; Penedo et al., 2024b; Fang et al., 2025; Liu et al., 2024).”
From OpenThoughts: Data Recipes for Reasoning Models (2025) · cites this paper as Lee et al., 2022
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Moreover, it is provided only on the complete text generated by the model (trajectory) and not on specific parts of the text (particular state) [92,138].”
From RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs (2026) · cites this paper as [92]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Space/time trade-offs in hash coding with allowable errors
Bloom, B. (1970) · CACM · doi:10.1145/362686.362692 · Cited by 8,424
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 4×
“And so because these datasets are up to 19% smaller, even including the deduplication runtime itself, training on dedupli-cated datasets directly reduces the training cost in terms of time, dollar, and the environment (Bender et al., 2021; Strubell et al., 2019; Patterson et al., 2021).”
BackgroundInfluentialMembership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754
THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE. 1
Jaccard, P. (1912) · New Phytologist · doi:10.1111/j.1469-8137.1912.tb05611.x · Cited by 4,561
Energy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1355 · Cited by 3,684
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
Flagged first, then by citations
Research works printed but not linked: 7
- PMLR.
- David Graff, Junbo Kong, Ke Chen, and Kazuaki Maeda. 2003. English gigaword. Linguistic Data Consortium, Philadelphia, 4(1):34.
- Paul Jaccard. 1912. The distribution of the flora in the alpine zone. New phytologist, 11(2):37-50. 10 8433
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9.
- Colin Raffel, Noam Shazeer, Adam Roberts, Kather- ine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to- text transformer. Journal of Machine Learning Re- search, 21(140):1-67.
- PMLR.
- Yannick Versley and Yana Panchenko. 2012. Not just bigger: Towards better-quality web corpora. In Pro- ceedings of the seventh Web as Corpus Workshop (WAC7), pages 44-52.
Cited by
Sorted by citations
Items 201–300 of 344
Wen, J., Zhou, H., Guan, J., Zhou, J., & Huang, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.612 · Cited by 3
Gómez, F. J. D., & Galende, J. N. (2024) · Revista Tecnología Ciencia y Educación · doi:10.51302/tce.2024.19081 · Cited by 5
Mitigating Hallucination in Large Language Model by Leveraging Decoder Layer Contrasting
Liu, G., Ai, X., Luo, W., & Li, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78498-9_4 · Cited by 3
Teleron, J. I., Gonzales, S. L., & Fajardo, A. C. (2025) · International Journal of Computational and Experimental Science and Engineering · doi:10.22399/ijcesen.2293 · Cited by 3
Evaluating the Evaluations: A Perspective on Benchmarks
Alonso, O., & Church, K. (2024) · ACM SIGIR Forum · doi:10.1145/3722449.3722467 · Cited by 3
A Survey of Text Deduplication: From Syntactic Matching to Semantic Understanding
Kim, J., & Park, Y. (2026) · IEEE Access · doi:10.1109/access.2026.3658439 · Cited by 2
Data Preparation for Large Language Models
Liang, H., Wong, Z. H., Liu, R., Wang, Y.-H., Qiang, M.-Y., Zhao, Z.-Y., Shen, C.-Y., He, C.-H., Zhang, W.-T., & Cui, B. (2026) · Journal of Computer Science and Technology · doi:10.1007/s11390-026-5948-8 · Cited by 6
AL-X0: Cost-Aware Active Learning for Cloud-Scale NLP via Zero-Shot Proxy Valuation
Kariyakaranage, V. S., & Athuraliya, B. (2026) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic68212.2026.11454245 · Cited by 2
Kerimoğlu, C. (2026) · Dil Araştırmaları · doi:10.54316/dilarastirmalari.1879242 · Cited by 2
Moon, S., He, H., & Fan, J. W. (2022) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi54592.2022.00017 · Cited by 2
Noise Masking Attacks and Defenses for Pretrained Speech Models
Jagielski, M., Thakkar, O. D., & Wang, L. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447773 · Cited by 2
Alshamrani, S. (2024) · IEEE Access · doi:10.1109/access.2024.3434612 · Cited by 2
SIKGC: Structural Information Prompt Based Knowledge Graph Completion with Large Language Models
Li, W., Ge, J., Feng, W., Zhang, L., Li, L., & Wu, B. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831590 · Cited by 2
Santosa, A., Prasanna, G. A., Rizky, M., & Prabowo, A. S. (2025) · International Conference on Electronics Representation and Algorithm (ICERA) · doi:10.1109/icera66156.2025.11087264 · Cited by 2
Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks
Rodríguez, P., Azab, M., Silvert, B., Sanchez, R., Labson, L., Shah, H., & Moon, S. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.3 · Cited by 4
esCorpius-m: A Massive Multilingual Crawling Corpus with a Focus on Spanish
Gutiérrez-Fandiño, A., Pérez‐Fernández, D., Armengol-Estapé, J., Griol, D., Kharitonova, K., & Callejas, Z. (2023) · Applied Sciences · doi:10.3390/app132212155 · Cited by 3
SoK: Unintended Interactions among Machine Learning Defenses and Risks
Duddu, V., Szyller, S., & Asokan, N. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00243 · Cited by 7
Chatgpt Inaccuracy Mitigation During Technical Report Understanding: Are we There Yet?
Tamanna, S. B., Uddin, G., Wang, S., Xia, L., & Zhang, L. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00145 · Cited by 4
Data security in large language models: risks, defense, and directions
Chen, K., Zhou, X., Yu, Y., Lin, Y., Chen, H., Cai, C., & Shen, L. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01200-9 · Cited by 2
Simplify Your Law: Using Information Theory to Deduplicate Legal Documents
Coupette, C., Singh, J., & Spamann, H. (2021) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw53433.2021.00083 · Cited by 2
On Membership Inference Attacks to Generative Language Models Across Language Domains
Oh, M. G., Park, L. H., Kim, J., Park, J., & Kwon, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25659-2_11 · Cited by 2
Extracting memorized pieces of (copyrighted) books from open-weight language modelsPreprint
Lemley, M. A., Cooper, A. F., Gokaslan, A., Cyphert, A., De, C., Ho, D. E., & Liang, P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5262084 · Cited by 4
OpenThoughts: Data Recipes for Reasoning Models
Guha, E., Marten, R., Keh, S., Raoof, N., Smyrnis, G., Bansal, H., Nezhurina, M., Mercat, J., Vu, T., Sprague, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.04178 · Cited by 1
RIAND: Robustness-Improved and Accelerated Neural-Deduplication
Chen, B. (2025) · IEEE Symposium on Computational Intelligence in Natural Language Processing and Social Media (CI-NLPSoMe) · doi:10.1109/ci-nlpsome64976.2025.10970772 · Cited by 1
Application of Simhash Algorithm Based on Bucket Index in Deduplication of Privacy Data
Xiahui, Z., Zhongying, N., & Li-cheng, W. (2025) · IEEE International Conference on Electronics, Energy Systems and Power Engineering (EESPE) · doi:10.1109/eespe63401.2025.10987512 · Cited by 1
Research on Key Methods for Extracting High-Quality Chinese Corpus Based on Common Crawl
Xiao, L., Zhao, Z., Wang, C., Zhang, J., & Liu, F. (2025) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd64889.2025.11033399 · Cited by 1
Li, J., Wang, J., Zhao, Z., & Wei, Z. (2026) · Computer Standards & Interfaces · doi:10.1016/j.csi.2026.104181 · Cited by 1
Li, C., Gülfidan, G., & Zhang-Kopf, Y. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100642 · Cited by 1
(2024) · Slovenian KDD Conference on Data Mining and Data Warehouses (SiKDD) · doi:10.70314/is.2024.sikdd.19 · Cited by 1
Efficient opinion mining for imbalanced customer reviews in last-mile services
Kim, S., 이홍철, & Kim, J. (2025) · Data & Knowledge Engineering · doi:10.1016/j.datak.2025.102466 · Cited by 1
QSE: Mitigating LLM Hallucinations Through Query-Adaptive Saliency-Localized Activation Editing
Liao, K., Wang, T., & Yu., F. M. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-0988-1_5 · Cited by 1
Amplifying Training Data Exposure Through Fine-Tuning With Pseudo-Labeled Memberships
Oh, M. G., Ahn, H. E., Park, L. H., & Kwon, T. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3613882 · Cited by 1
Enabling doctor-centric medical AI with LLMs through workflow-aligned tasks and benchmarks
Xie, W., Xiao, Q., Zheng, Y., Wang, X., Chen, J., Ji, K., Gao, A., Tiwari, P., Wan, X., Jiang, F., et al. (2025) · npj Health Systems · doi:10.1038/s44401-025-00038-z · Cited by 1
Tleubayeva, A., Biloshchytska, S., Kuchanskyi, O., Andrashko, Y., Boluk, P. S., Lisnevskyi, R., & Mukhatayev, A. (2026) · Data · doi:10.3390/data11060133 · Cited by 1
Quantifying Memorization and Privacy Risks in Genomic Language Models
Nemecek, A., Li, W., Jiang, X., Vaidya, J. S., & Ayday, E. (2026) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3807503.3819470 · Cited by 1
Automated Annotation of Privacy Information in User Interactions with Large Language Models
Zeng, H., Liu, X., Hu, Y., Niu, C., Wu, F., Tang, S., & Chen, G. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3785680 · Cited by 1
WeLT: Improving Biomedical Fine-tuned Pre-trained Language Models with Cost-sensitive Learning
Mobasher, G., Müller, W., Krebs, O., & Gertz, M. (2023) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2023.bionlp-1.40 · Cited by 1
CoRRPUS: Code-based Structured Prompting for Neurosymbolic Story Understanding
Dong, Y., Martin, L. J., & Callison-Burch, C. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.832 · Cited by 2
Self-citationConfidence Elicitation Improves Selective Generation in Black-Box Large Language Models
Liu, S., Yue, Z., & Li, J. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831438 · Cited by 1
Wee, P., & Baghdadi, R. (2024) · IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT) · doi:10.1109/bdcat63179.2024.00048 · Cited by 3
Chu, Y.-W., Han, D.-J., & Brinton, C. G. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3564854 · Cited by 1
Learning with User-Level Differential Privacy Under Fixed Compute Budgets
Charles, Z., Ganesh, A., McKenna, R., McMahan, H. B., Mitchell, N., Pillutla, K., & Rush, K. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00055 · Cited by 2
Interrogating LLM design under copyright law
Wei, J. T.-Z., Wang, M., Godbole, A., Choi, J., & Jia, R. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732193 · Cited by 1
On “Scientific Debt” in NLP: A Case for More Rigour in Language Model Pre-Training Research
Nityasya, M. N., Wibowo, H. A., Aji, A. F., Winata, G. I., Prasojo, R. E., Blunsom, P., & Kuncoro, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.477 · Cited by 3
ChapGTP, ILLC’s Attempt at Raising a BabyLM: Improving Data Efficiency by Automatic Task Formation
Jumelet, J., Hanna, M., Kloots, M. D. H., Langedijk, A., Pouw, C., & van der Wal, O. (2023) · BabyLM Challenge · doi:10.18653/v1/2023.conll-babylm.6 · Cited by 1
Deduplicating and Ranking Solution Programs for Suggesting Reference Solutions
Shirafuji, A., & Watanobe, Y. (2023) · Asia Service Sciences and Software Engineering Conference (ASSE) · doi:10.1145/3634814.3634828 · Cited by 1
Studies in conversational AI : multilingual capabilities, world knowledge, and evaluation strategies
Bruyn, M. D. (2024) · doi:10.63028/10067/2023030151162165141 · Cited by 1
A Comprehensive Survey on the Integration of Reinforcement Learning and NLP for Stock Market TradingPreprint
Ferrell, B., & McInnes, B. T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5135573 · Cited by 1
Niimi, J. (2025) · arXiv · doi:10.48550/arxiv.2510.25378 · Cited by 7
“Conversely, security-oriented studies have highlighted the opposite tendency: information repeated multiple times during pretraining is more likely to be memorized and re-produced verbatim [18, 19, 20, 12].”
Mitigating the Burden of Redundant Datasets via Batch-Wise Unique Samples and Frequency-Aware Losses
Crisostomi, D., Caciolai, A., Pedrani, A., Rottmann, K., Manzotti, A., Palumbo, E., & Bernardi, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-industry.23
A Practical Algorithm for Efficiently Deduplicating Highly Similar News in Large News Corpora
Zhang, W. (2023) · doi:10.5121/csit.2023.131214 · Cited by 1
Duplicate Detection of Technical Documents in Petroleum Context Based on Near-Duplicate Image Search
Maze, E., Dirhoussi, A., Vernaz, Y., & Farahbakhsh, R. (2023) · SPE Annual Technical Conference and Exhibition · doi:10.2118/215161-ms
Gradual Syntactic Label Replacement for Language Model Pre-Training
Wang, Y., Zhang, Y., Li, P., & Liu, Y. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3331096
Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns
Coca, A., Tseng, B.-H., Chen, J., Lin, W., Zhang, W., Anders, T., & Byrne, B. (2023) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2023.sigdial-1.42
On the Impact of Cross-Domain Data on German Language Models
Dada, A., Chen, A., Cheng, P., Smith, K. E., Idrissi-Yaghir, A., Seibold, C., Li, J., Heiliger, L., Friedrich, C. M., Truhn, D., et al. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.922 · Cited by 1
An Intent-based and Annotation-free Method for Duplicate Question Detection in CQA Forums
Shu, Y., Gu, H., Zhang, P., Lu, T., & Gu, N. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.596
SKYNET 2023 Conception of the Artificial Super Intelligence Project. A System Approach. ver. 3Preprint
Novikov, A. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/kqt9p
A Large Financial Chat ModelPreprint
Ding, F. (2024) · doi:10.33774/coe-2024-lsc94
Improving clinical expertise in large language models using electronic medical recordsPreprint
Zhu, L., Liu, J., Wang, J., Zhang, W., Jiang, S., Yang, H., Wang, C., Ye, Q., Ruan, T., Rui, X., et al. (2024) · Research Square · doi:10.21203/rs.3.rs-5285540/v1
DataDecon: Data Cleansing Tools for Large Language Model with Efficient Decontamination Techniques
Yuenyong, S., Buppodom, N., Sangkaew, K., Boonmeeprakob, K., Boonkwan, P., Jaroenkantasima, J., Khlaisamniang, P., Lertpiya, A., Piyatumrong, A., Rojratchadakorn, P., et al. (2024) · International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP) · doi:10.1109/isai-nlp64410.2024.10799278
Defender: The Possibility of Repairing Jailbreak Defects
Wang, X., & Wei, Y. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-1694-7_17
Developing Foundation Models for Predicting Viral Animal Host Range in Intelligent SurveillancePreprint
Guo, J., Guo, Q., Yin, H., Han, Y., Geng, P. X., Hou, J., Zhang, H., Tan, J., Li, M., Zhang, Y., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.02.13.638012 · Cited by 1
Empirical Approach to a Fine-Tuning Using Forgetting in Large Language Models
Taguchi, K., Gu, Y., & Sakurai, K. (2025) · Smart innovation, systems and technologies · doi:10.1007/978-981-97-7786-0_23
Mukherjee, A., & Chang, H. H. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5213450
Data Optimization for LLMs: A Survey
Wu, O. (2026) · ACM Transactions on Knowledge Discovery from Data · doi:10.36227/techrxiv.174776562.20873028/v1
Li, P. (2025) · International Conference on Data Science and Network Security (ICDSNS) · doi:10.1109/icdsns65743.2025.11168629
Rethinking Data Use in Large Language Models
Min, S., Hajishirzi, H., & Zettlemoyer, L. (2025) · Computational Linguistics · doi:10.1162/coli.a.573
Utilization of Large Language Models for conformity assessment: Chances, Threats, and Mitigations
Litzinger, J., Peters, D., Thiel, F., & Tschorsch, F. (2025) · Annals of Computer Science and Information Systems · doi:10.15439/2025f7772
Meta-Heuristic Optimized Generative Models for Enriching Chinese-English Intelligent Translation
Wang, Y. (2025) · International Conference on Intelligent Algorithms for Computational Intelligence Systems (IACIS) · doi:10.1109/iacis65746.2025.11211389
Differential Privacy on Large Language Models for Privacy Preserving Clinical Coding
Marshall, B., Li, S., Meka, S. A., & Liu, W. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229049
Yu, Z., Li, C., Zhang, Y., Liu, M., Pinckney, N., Zhou, W., Liang, R., Yang, H., Ren, H. M., & Lin, Y. (2025) · 2025 IEEE/ACM International Conference On Computer Aided Design (ICCAD) · doi:10.1109/iccad66269.2025.11240644
Yuxia, S. (2025) · International Conference on Machine Learning, Pattern Recognition and Automation Engineering (MLPRAE) · doi:10.1109/mlprae67267.2025.11290735
Cross-Domain Semantic-Enhanced Adaptive Graph Fusion Network for Robust Skeleton Action RecognitionPreprint
Gu, Z., & Tan, J. (2025) · Preprints.org · doi:10.20944/preprints202512.2690.v1
Evaluate LLMs on Code Review Understanding: A Multi-step Reasoning Benchmark
Wei, X., & Xin, J. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-4445-5_34
Tiwari, A., & Gupta, V. (2026) · Research Square · doi:10.21203/rs.3.rs-8589677/v1 · Cited by 1
Enhancing LLM to Decompile Optimized PTX to Readable CUDA for Tensor Programs
Sun, X., Tang, F., Zhang, Y., Shen, H., Song, C., & Zhang, D. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00185
Xue, Y., Tsunokake, M., Koreeda, Y., & Sogawa, Y. (2026) · International Journal of Semantic Computing · doi:10.1142/s1793351x26410023
Analysis of Semantic Benchmark Data Contamination Attack for LLM-Driven Fake News Detection
Xu, C. G., & Kechadi, T. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402039
Gradiyoga, F., Chandra, J. N., Edbert, I. S., & Diana (2025) · International Conference of Science and Information Technology in Smart Administration (ICSINTESA) · doi:10.1109/icsintesa68165.2025.11413671
CodeGraphNet: embedding-driven enhanced vulnerability detection with line-level error identification
Sultan, M. F., Shaon, M. S. H., Karim, T., Wardat, M., Cuzzocrea, A., & Akter, M. S. (2026) · Software Quality Journal · doi:10.1007/s11219-026-09752-9
Building a Low-Resource Bikol Naga-English Parallel Corpus
Serrano, P. A. M., & Ingosan, J. S. (2026) · International Conference on Advanced Research in Computing (ICARC) · doi:10.1109/icarc68737.2026.11453621
A Data-driven Approach to Natural Language Processing for Contemporary and Historical French
Suárez, P. O. (2022) · theses.fr (ABES) · doi:10.70675/9b4a07fdza641z489fza523zddeee03a6544
Proactive models for open-domain conversational search
Erbacher, P. (2024) · theses.fr (ABES) · doi:10.70675/f7d68861zc694z49f1zb130z675cbf38ed1c
Foundation Vision-Language models
Laurençon, H. (2025) · theses.fr (ABES) · doi:10.70675/ec0311a0zb6a4z4249zb9fbz01bf51a02c7c
A Novel Approach for De-Biasing and Enhanced Hallucination Mitigation in LLM
Shamseera, M. K., & Durga, R. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-17846-6_11
A Survey on Privacy-Preserving Large LanguageModels (LLMs): Architectures, Techniques, and Use-CasesPreprint
Tariq, A., Serhani, M. A., Taleb, I., Kassabi, H. T. E., Navaz, A. N., & Brik, B. (2026) · Research Square · doi:10.21203/rs.3.rs-9258244/v1
Boulahia, A. K., & Mars, M. (2026) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v15.i2.pp1891-1908
AMPSD24K: A Structurally Enriched Dataset for Primary-Level Chinese Mathematical Word Problems
Chen, X., Shen, Z., Ming, H., Hu, H., & Cheng, X. (2025) · International Conference on Intelligent Education and Intelligent Research (IEIR) · doi:10.1109/ieir67391.2025.11491575
Mitigating Security Risks in Large Language Models: A Full Lifecycle Perspective
Wang, Y. K., Bai, Z., Huo, J., Wang, B., Liu, J., Cao, H., Meng, F., Yang, X., & Gao, Y. (2026) · Machine Learning · doi:10.1007/s10994-025-06930-x
Niimi, J. (2026) · Research Square · doi:10.21203/rs.3.rs-9733633/v1
Pseudoperplexity Probes Memorization in Protein Language ModelsPreprint
Alexander, P., PLONER, M., Sewald, Z., Senoner, T., Franz, S., Brenner, M., Heinzinger, M., & Rost, B. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.08.730685
Secure and Intelligent Data Deduplication for Large Scale Data Storage in Language Model
Sun, W., Zhang, Y., Li, Y., & Li, J. J. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-9884-7_10
VecAlign: Efficient Vector Sequence Alignment for Similarity Search in the Embedding Space
Wang, Z., & Deng, D. (2026) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew71238.2026.00018
Beyond Price: A Technical Quality Framework for AI Antitrust
Wu, P. Y. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812338
Rich data drive generalization: Lessons from machine learning for linguistics and cognitive science
Lampinen, A. K. (2026) · Behavioral and Brain Sciences · doi:10.1017/s0140525x26104609
Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings
Westny, T., Axelsson, D., Olofsson, B., & Frisk, E. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37461-5_3
Can Foundation LLMs Accurately Estimate Password Strength and Provide Appropriate Password Feedback?
Pickering, M., Hinson-Hasty, G., Dovichi, L., Williams, H., Kim, N., Esmer, A., & Ur, B. (2026) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp63933.2026.00179
Beyond Indistinguishability: Measuring Extraction Risk in LLM APIs
Liu, R., Evans, D., & Xiong, L. (2026) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp63933.2026.00165
Metadata
- Authors
- Lee, K., Ippolito, D., Nystrom, A., Zhang, C., Eck, D., Callison-Burch, C., & Carlini, N.
- Affiliations
- Google (United States) (US)
- University of Pennsylvania (US)
- Corresponding author
- Ippolito, Daphne
- Venue
- Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2022
- Pages
- 8424-8445
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W3177765786
- Cited by
- 304
- References
- 50
- Citations by year
- 2026: 62 · 2025: 79 · 2024: 65 · 2023: 64 · 2022: 27
- FWCI
- 32.49
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- language model training, training data quality, duplicate removal
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
