The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Automatic Detection of Generated Text is Easiest when Humans are Fooled
Open accessAbstract
Recent advancements in neural language modelling make it possible to rapidly generate vast amounts of human-sounding text.The capabilities of humans and automatic discriminators to detect machine-generated text have been a large source of research interest, but humans and machines rely on different cues to make their decisions.Here, we perform careful benchmarking and analysis of three popular sampling-based decoding strategies-topk, nucleus sampling, and untruncated random sampling-and show that improvements in decoding methods have primarily optimized for fooling humans.This comes at the expense of introducing statistical abnormalities that make detection easy for automatic systems.We also show that though both human and automatic detector performance improve with longer excerpt length, even multi-sentence excerpts can fool expert human raters over 30% of the time.Our findings reveal the importance of using both human and automatic detectors to assess the humanness of text generation systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLMs typically exhibit less diversity in word usage compared to humans [Ippolito et al., 2020;Dugan et al., 2023].”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Ippolito et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Pre-trained language models (PTMs), especially BERT-based architectures [Devlin et al., 2019] such as BERT [Ippolito et al., 2020;Fabien et al., 2020;Manolache et al., 2021], Sentence-BERT [Schlicht and de Paula, 2021;Rivera-Soto et al., 2021], and RoBERTa [Huertas-Tato et al., 2022], have proven effective for learning authorship representation.”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Ippolito et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Additionally, neural networkbased models such as BERT [Ippolito et al., 2020], Radar [Hu et al., 2023], and GPT-sentinel [Chen et al., 2023a] can also be applied.”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Ippolito et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, exposing evaluators to examples before evaluation enhances their detection capabilities, especially with longer samples.”
From A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions (2025) · cites this paper as Ippolito et al. 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Neural network-based detectors, particularly those utilizing BERT, have proven effective in distinguishing between human-written texts and those generated by GPT-2 [Ippolito et al., 2020;Liu et al., 2019].”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Ippolito et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“In contrast, detection algorithms frequently outperform the human in this task [Ippolito et al., 2020].”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Ippolito et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Existing detectors also lack robustness to various factors, such as alternative decoding strategies [Ippolito et al., 2020], input sequence length [Solaiman et al., 2019], different prompts [Kumarage et al., 2023;Lu et al., 2023], and repetition penalties [Fishchuk and Braun, 2023].”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Ippolito et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Recent studies (Ippolito et al. 2020) indicated that human evaluators might not be as proficient as detection algorithms in recognizing LLM-generated text across various settings.”
From A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions (2025) · cites this paper as Ippolito et al. 2020
The cited source says what the claim attributes to it.
In the citing paper
“Ippolito et al. (2020) suggested that text perceived as high quality by humans tends to be more easily recognizable by detectors.”
From A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions (2025) · cites this paper as Ippolito et al. 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 2×
“It propogates quickly (Vosoughi et al., 2018), sets political agendas”
BackgroundSocial Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
BERTScore: Evaluating Text Generation with BERT
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09675 · Cited by 2,865
Hierarchical Neural Story Generation
Fan, A., Lewis, M., & Dauphin, Y. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1082 · Cited by 1,266
Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud
Luca, M., & Zervas, G. (2016) · Management Science · doi:10.1287/mnsc.2015.2304 · Cited by 1,263
Hierarchical Neural Story Generation
Fan, A., Lewis, M., & Dauphin, Y. (2018) · arXiv · doi:10.48550/arxiv.1805.04833 · Cited by 1,242
Adversarial Learning for Neural Dialogue Generation
Li, J., Monroe, W., Shi, T., Jean, S., Ritter, A., & Jurafsky, D. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1230 · Cited by 955
Research works printed but not linked: 4
- Timothy Niven and Hung-Yu Kao. 2019. Probing neu- ral network comprehension of natural language ar- guments. In Proceedings of the 57th Annual Meet- ing of the Association for Computational Linguis- tics, pages 4658-4664, Florence, Italy. Association for Computational Linguistics.
- Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. Neural machine translation of rare words with subword units. In Proceedings of the 54th An- nual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1715- 1725.
- Alan Turing. 1950. Computing machinery and intelligence-am turing. Mind, 59(236):433.
- Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk, Ali Farhadi, Franziska Roesner, and Yejin Choi. 2019. Defending against neural fake news. CoRR, abs/1905.12616. · arXiv
Cited by
Sorted by citations
Items 101–200 of 324
M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detection
Wang, Y., Mansurov, J., Ivanov, P., Su, J., Shelmanov, A., Tsvigun, A., Whitehouse, C., Afzal, O. M., Mahmoud, T., Sasaki, T., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.14902 · Cited by 19
“Using pretrained classifier has been well studied and widely used in previous work (Solaiman et al., 2019; Zellers et al., 2019; Ippolito et al., 2019; Bakhtin et al., 2021; Uchendu et al., 2021).”
MethodNew Automation for Social Bots: From Trivial Behavior to AI-Powered Communication
Grimme, C., Pohl, J., Cresci, S., Lüling, R., & Preuss, M. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-18253-2_6 · Cited by 19
Detection Vs. Anti-detection: Is Text Generated by AI Detectable?
Zhang, Y., Ma, Y., Liu, J., Liu, X., Wang, X., & Lu, W. P. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-57850-2_16 · Cited by 21
Automated Identification of Social Media Bots Using Deepfake Text Detection
Saravani, S. M., Ray, I., & Ray, I. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-92571-0_7 · Cited by 18
LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected?
Zhang, Q., Gao, C., Chen, D., Huang, Y., Huang, Y., Sun, Z., Zhang, S., Li, W., Fu, Z., Wan, Y., et al. (2024) · Findings of the Association for Computational Linguistics: NAACL 2024 · doi:10.18653/v1/2024.findings-naacl.29 · Cited by 18
Leveraging Multi-Model Linguistic Fusion for Enhanced AI Text Generation Evasion
Khan, A. A., & Rajagopalan, S. (2025) · International Generative AI and Computational Language Modelling Conference (GACLM) · doi:10.1109/gaclm67198.2025.11231821 · Cited by 18
How to Detect AI-Generated Texts?
Nguyen, T. T., Hatua, A., & Sung, A. H. (2023) · IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON) · doi:10.1109/uemcon59035.2023.10316132 · Cited by 20
On the Zero-Shot Generalization of Machine-Generated Text Detectors
Xiao, P., Zhang, J., Han, X., Tsvetkov, Y., & He, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.318 · Cited by 24
Limits of Detecting Text Generated by Large-Scale Language Models
Varshney, L. R., Keskar, N. S., & Socher, R. (2020) · Information Theory and Applications Workshop (ITA) · doi:10.1109/ita50056.2020.9245012 · Cited by 21
Decoding Methods for Neural Narrative Generation
DeLucia, A., Mueller, A., Li, X. L., & Sedoc, J. (2021) · Workshop on Generation, Evaluation and Metrics (GEM) · doi:10.18653/v1/2021.gem-1.16 · Cited by 21
Automatic Detection of Machine Generated Texts: Need More Tokens
Gritsay, G., Grabovoy, A., & Chekhovich, Y. V. (2022) · Ivannikov Memorial Workshop (IVMEM) · doi:10.1109/ivmem57067.2022.9983964 · Cited by 19
Lee, S.-C., Lee, D.-G., & Seo, Y. (2023) · Applied Intelligence · doi:10.1007/s10489-023-05201-3 · Cited by 19
Synthetically generated text for supervised text analysis
Halterman, A. (2025) · Political Analysis · doi:10.1017/pan.2024.31 · Cited by 22
On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook
Fan, M., Wang, C., Chen, C., Liu, Y., & Huang, J. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02375-w · Cited by 40
Token-modification adversarial attacks for natural language processing: A survey
Roth, T., Gao, Y., Abuadbba, A., Nepal, ., & Liu, W. (2024) · AI Communications · doi:10.3233/aic-230279 · Cited by 24
One-Class Learning for AI-Generated Essay Detection
Corizzo, R., & Leal-Arenas, S. (2023) · Applied Sciences · doi:10.3390/app13137901 · Cited by 16
How effectively can machines defend against machine-generated fake news? An empirical study
Bhat, M. M., & Parthasarathy, S. (2020) · Proceedings of the First Workshop on Insights from Negative Results in NLP · doi:10.18653/v1/2020.insights-1.7 · Cited by 16
Madani, M., Motameni, H., & Mohamadi, H. (2022) · Security and Privacy · doi:10.1002/spy2.264 · Cited by 16
Automatic Detection of Bot-generated Tweets
Tourille, J., Sow, B., & Popescu, A. (2022) · Proceedings of the 1st International Workshop on Multimedia AI against Disinformation · doi:10.1145/3512732.3533584 · Cited by 15
Classifying human vs. AI text with machine learning and explainable transformer models
Masih, A., Afzal, B., Firdoos, S., Mahmood, J., Ali, A., Abdulnabi, M. S. H., & Balungu, D. M. (2025) · Scientific Reports · doi:10.1038/s41598-025-27377-z · Cited by 17
How Reliable Are AI-Generated-Text Detectors? An Assessment Framework Using Evasive Soft Prompts
Kumarage, T., Sheth, P., Moraffah, R., Garland, J., & Liu, H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.94 · Cited by 27
Generative AI and Perceptual Harms: Who's Suspected of using LLMs?
Kadoma, K., Metaxa, D., & Naaman, M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713897 · Cited by 14
Mosca, E., Abdalla, M. H. I., Basso, P., Musumeci, M., & Groh, G. (2023) · Proceedings of the 3rd Workshop on Trustworthy Natural Language Processing (TrustNLP 2023) · doi:10.18653/v1/2023.trustnlp-1.17 · Cited by 14
Can attention detect AI-generated text? A novel Benford's law-based approach
Wang, Z., Xu, G., & Ren, M. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104139 · Cited by 14
Detection of AI-Generated Emails - A Case Study
Gryka, P., Gradoń, K., Kozłowski, M., Kutyła, M., & Janicki, A. (2024) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3664476.3670465 · Cited by 14
Seeing Through AI's Lens: Enhancing Human Skepticism Towards LLM-Generated Fake News
Ayoobi, N., Shahriar, S., & Mukherjee, A. (2024) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3648188.3675136 · Cited by 15
Controllable Fake Document Infilling for Cyber Deception
Hu, Y., Yu, L., Parolin, E. S., Khan, L. R., & Hamlen, K. W. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.486 · Cited by 14
Artificially Generated Text Fragments Search in Academic Documents
Gritsai, G., Grabovoy, A., Kildyakov, A., & Chekhovich, Y. V. (2023) · Doklady Mathematics · doi:10.1134/s1064562423701211 · Cited by 14
A deep fusion model for human $vs$. Machine-generated essay classification
Corizzo, R., & Leal-Arenas, S. (2023) · 2023 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191322 · Cited by 13
Wang, Q., & Li, H. (2025) · Big Data and Cognitive Computing · doi:10.3390/bdcc9030050 · Cited by 13
Detecting multi-modal GAI-manipulated tourism review
Li, J., Zheng, W., & Guo, X. (2025) · Tourism Management · doi:10.1016/j.tourman.2025.105220 · Cited by 12
How Reliable Are AI-Generated-Text Detectors? An Assessment Framework Using Evasive Soft Prompts
Kumarage, T., Sheth, P., Moraffah, R., Garland, J., & Liu, H. (2023) · arXiv · doi:10.48550/arxiv.2310.05095 · Cited by 11
Through the Looking Glass: Learning to Attribute Synthetic Text Generated by Language Models
Munir, S., Batool, B., Shafiq, Z., Srinivasan, P., & Zaffar, F. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.155 · Cited by 11
Schneider, D. M., Mishra, A., Gluski, J. M., Shah, H., Ward, M., Brown, E. D. L., Sciubba, D. M., & Lo, S.-F. L. (2025) · Cureus · doi:10.7759/cureus.79086 · Cited by 12
The Authenticity Gap in Human Evaluation
Ethayarajh, K., & Jurafsky, D. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.406 · Cited by 10
The art of deception: humanizing AI to outsmart detection
Ayub, T., Malla, R. A., Khan, M. Y., & Ganaie, S. A. (2024) · Global Knowledge, Memory and Communication · doi:10.1108/gkmc-03-2024-0133 · Cited by 12
MAGECODE: Machine-Generated Code Detection Method Using Large Language Models
Pham, H. N., Ha, H., Tong, V., Hoang, D., Tran, D., & Le, N. T. (2024) · IEEE Access · doi:10.1109/access.2024.3509987 · Cited by 11
DIALOG-22 RuATD Generated Text Detection
Lomonosov, M. S. U., Maloyan, N., Nutfullin, B., Lomonosov, M. S. U., Ilyshin, E., & Lomonosov, M. S. U. (2022) · Computational Linguistics and Intellectual Technologies · doi:10.28995/2075-7182-2022-21-394-401 · Cited by 12
LLM-Enhanced Multi-Task Joint Learning Model for Misinformation Detection
Ren, G., Li, J., Huang, T., Yang, Y., & Xie, R. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104305 · Cited by 9
Detecting AI-Generated Essays with Hybrid Supervised–Unsupervised NLP Techniques
Hole, S. R., Salotagi, S., Lakshmanan, M., Nuthakki, S., Nuthakki, Y., & Sagar, A. (2025) · International Conference on Artificial Intelligence and Signal Processing (AISP) · doi:10.1109/aisp68263.2025.11396327 · Cited by 9
STADEE: STAtistics-Based DEEp Detection of Machine Generated Text
Chen, Z., & Liu, H. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-4752-2_60 · Cited by 9
Supervised machine-generated text detectors: Family and scale matters
Sarvazyan, A. M., González, J. Á., Rosso, P., & Franco-Salvador, M. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-42448-9_11 · Cited by 9
Lost in Transformation: Rediscovering LLM-Generated Campaigns in Social Media
Britta, G., Pohl, J., Winkelmann, H., Stampe, L., & Grimme, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47896-3_6 · Cited by 9
CoAT: Corpus of artificial texts
Shamardina, T., Saidov, M., Fenogenova, A., Tumanov, A., Zemlyakova, A., Lebedeva, A., Gryaznova, E., Shavrina, T., Mikhailov, V., & Artemova, E. (2024) · Natural language processing. · doi:10.1017/nlp.2024.38 · Cited by 8
Covington, N. V., & Vruwink, O. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00427-9 · Cited by 8
Probing BERT’s priors with serial reproduction chains
Yamakoshi, T., Griffiths, T. L., & Hawkins, R. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.314 · Cited by 9
The Effectiveness of Free Software for Detecting AI-Generated Writing
Price, G., & Sakellarios, M. D. (2023) · International Journal of Teaching Learning and Education · doi:10.22161/ijtle.2.6.4 · Cited by 9
Exploring Artificial Jabbering for Automatic Text Comprehension Question Generation
Steuer, T., Filighera, A., & Rensing, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-57717-9_1 · Cited by 8
Identifying Automatically Generated Headlines using Transformers
Maronikolakis, A., Schütze, H., & Stevenson, M. (2021) · Workshop on Natural Language Processing for Internet Freedom: Censorship, Disinformation, and Propaganda (NLP4IF) · doi:10.18653/v1/2021.nlp4if-1.1 · Cited by 12
Detecting Bot-Generated Text by Characterizing Linguistic Accommodation in Human-Bot Interactions
Bhatt, P., & Rios, A. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.286 · Cited by 8
Authorship Verification in software engineering education
Rios, S., Zhang, Y., & de Oliveira, E. A. (2023) · ASCILITE Publications · doi:10.14742/apubs.2023.559 · Cited by 7
One-GPT: A One-Class Deep Fusion Model for Machine-Generated Text Detection
Corizzo, R., & Leal-Arenas, S. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386674 · Cited by 8
A Proposed Model for Distinguishing Between Human-Based and ChatGPT Content in Scientific Articles
Mohamed, T. A., Khafagy, M. H., Elsedawy, A. B., & Ismail, A. S. (2024) · IEEE Access · doi:10.1109/access.2024.3448315 · Cited by 8
Legal Language Modeling with Transformers
Peric, L., Mijic, S., Stammbach, D., & Ash, E. (2020) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000456079 · Cited by 7
Ilic, P., & Carr, N. (2023) · 2023 IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie58773.2023.10343337 · Cited by 6
SEFD: Semantic-Enhanced Framework for Detecting LLM-Generated Text
He, W., Hou, B., Shang, T., Tarzanagh, D. A., Long, Q., & Shen, L. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825110 · Cited by 6
Stack More LLM’s: Efficient Detection of Machine-Generated Texts via Perplexity Approximation
Gritsai, G., Khabutdinov, I., & Grabovoy, A. (2024) · Doklady Mathematics · doi:10.1134/s1064562424602075 · Cited by 6
Huynh, L. K., Nguyen, T., Goh, J., Kim, H., & Hong, J. B. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3481894 · Cited by 7
Reinforcement learning for few-shot text generation adaptation
Cheng, P., Dai, J., Liu, J., Liu, J., & Jia, P. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126689 · Cited by 6
Automatic Detection for Machine-generated Texts is Easy
Lyu, M., Bao, C., Tang, J., Wang, T., & Liu, P. (2022) · IEEE Smart World Congress (SWC) · doi:10.1109/smartworld-uic-atc-scalcom-digitaltwin-pricomp-metaverse56740.2022.00223 · Cited by 5
A Novel Benford’s Law-Driven Approach for Detecting Machine-Generated Text
Wang, Z., Zhang, C., & Ren, M. (2025) · ACM Transactions on Information Systems · doi:10.1145/3748305 · Cited by 6
Reverse-Engineering Decoding Strategies Given Blackbox Access to a Language Generation System
Ippolito, D., Carlini, N., Lee, K., Nasr, M., & Yu, Y. W. (2023) · International Conference on Natural Language Generation · doi:10.18653/v1/2023.inlg-main.28 · Cited by 7
Self-citationRojas-Simón, J., Ledeneva, Y. N., & García-Hernández, R. A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-62836-8_31 · Cited by 5
Fingerprinting Fine-tuned Language Models in the Wild
Diwan, N., Chakraborty, T., & Shafiq, Z. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.409 · Cited by 9
Towards AI-Generated Essay Classification Using Numerical Text Representation
Krawczyk, N., Probierz, B., & Kozak, J. (2024) · Applied Sciences · doi:10.3390/app14219795 · Cited by 4
Fu, J., Guo, C., & Li, C. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754862 · Cited by 6
Cowap, A., Graham, Y., & Foster, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.665 · Cited by 4
A Method for Distinguishing Model Generated Text and Human Written Text
Shimada, H., & Kimura, M. (2024) · Journal of Advances in Information Technology · doi:10.12720/jait.15.6.714-722 · Cited by 4
A Metric-Based Detection System for Large Language Model Texts
Le, L., & Tran, D. T. (2024) · ACM Transactions on Management Information Systems · doi:10.1145/3704739 · Cited by 4
Beyond N-Grams: Enhancing String Kernels With Transformer-Guided Semantic Insights
Zaki, N., Alderei, R., Alketbi, M., Alkaabi, A., Alneyadi, F., & Zaki, N. (2025) · IEEE Access · doi:10.1109/access.2025.3576076 · Cited by 4
MAiDE-up: Multilingual Deception Detection of AI-generated Hotel Reviews
Ignat, O., Xu, X., & Mihalcea, R. F. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.88 · Cited by 4
On the Generalization and Adaptation Ability of Machine-Generated Text Detectors in Academic Writing
Liu, Y., Zhong, Z., Liao, Y., Sun, Z. T., Zheng, J., Wei, J., Gong, Q., Tong, F., Chen, Y., Zhang, Y., et al. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737408 · Cited by 7
TH-Bench: Evaluating Evading Attacks via Humanizing AI Text on Machine-Generated Text Detectors
Zheng, J., Wang, J., Sun, Z. T., Dong, W., Liu, Y., & He, X. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737418 · Cited by 6
ESPERANTO: Evaluating Synthesized Phrases to Enhance Robustness in AI Detection for Text Origination
Ayoobi, N., Knab, L., Cheng, W., Pantoja, D., Alikhani, H., Flamant, S., Kim, J., & Mukherjee, A. (2025) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3720553.3746665 · Cited by 9
Artificial text detection in Russian language: a BERT-based Approach
Posokhov, P., Skrylnikov, S., & Makhnytkina, O. V. (2022) · Computational Linguistics and Intellectual Technologies · doi:10.28995/2075-7182-2022-21-470-476 · Cited by 4
Human Perception in Natural Language Generation
Mattei, L. D., Lai, H., Dell’Orletta⋄, F., & Nissim, M. (2021) · Workshop on Generation, Evaluation and Metrics (GEM) · doi:10.18653/v1/2021.gem-1.2 · Cited by 5
TextMachina: Seamless Generation of Machine-Generated Text Datasets
Sarvazyan, A. M., González, J. Á., & Franco-Salvador, M. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.09.462 · Cited by 4
Nassar, J. E., Farias, M. J., Singh, M., Dinh, P. V., Sahhar, M., Daher, M., Fallon, R. T., Marcaccio, S. E., Daniels, A. H., & Owens, B. D. (2025) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671251371234 · Cited by 4
AI-generated language remains systematically distinguishable from human communication
Pagan, N., Törnberg, P., Bail, C. A., & Barrie, C. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2531748123 · Cited by 10
Exploring Naive Approaches to Tell Apart LLMs Productions from Human-written Text
Giudice, O., Maggi, A., & Nardelli, M. (2023) · International Conference on Natural Language Processing and Information Retrieval (NLPIR) · doi:10.1145/3639233.3639354 · Cited by 3
Bilingual generated text detection through semantic and statistical analysis
Min, C., Zhang, R., & Liu, J. (2025) · Intelligent Data Analysis · doi:10.1177/1088467x241307192 · Cited by 3
An Ensemble-Based Approach for Generative Language Model Attribution
Abburi, H., Suesserman, M., Pudota, N., Veeramani, B., Bowen, E., & Bhattacharya, S. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-7254-8_54 · Cited by 3
Towards Better Statistical Understanding of Watermarking LLMs
Cai, Z., Liu, S., Wang, H., Zhong, H., & Li, X. (2026) · Journal of the American Statistical Association · doi:10.1080/01621459.2026.2618290 · Cited by 17
MIROSTAT: A NEURAL TEXT DECODING ALGORITHM THAT DIRECTLY CONTROLS PERPLEXITY
Basu, S., Ramachandran, G. S., Keskar, N. S., & Varshney, L. R. (2021) · International Conference on Learning Representations · Cited by 3
Accurate Generated Text Detection Based on Deep Layer-wise Relevance Propagation
Guo, M., Liu, L., Guo, M., Liu, S., & Xu, Z. (2023) · IEEE International Conference on Big Data Analytics (ICBDA) · doi:10.1109/icbda57405.2023.10104941 · Cited by 3
Exploring the Profile of University Assessments Flagged as Containing AI-Generated Material
Gooch, D., Waugh, K., Richards, M., Slaymaker, M., & Woodthorpe, J. (2024) · ACM Inroads · doi:10.1145/3656478 · Cited by 3
Machine Learning Approaches to Identify AI-Generated Text: a Comparative Analysis
Mihir, T. K., Harsha, K. V. S., Nitya, S. Y., Krishna, G. B., Anamalamudi, S., & Sivarajan, S. (2024) · International Conference on Intelligent Computing and Emerging Communication Technologies (ICEC) · doi:10.1109/icec59683.2024.10837481 · Cited by 2
To Write or Not to Write as a Machine? That’s the Question
Sepúlveda-Torres, R., Martínez-Murillo, I., Saquete, E., Lloret, E., & Palomar, M. (2025) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3536938 · Cited by 2
Distinguishing AI-Generated Text from Human-Written Text Using Machine Learning
Apte, S., Masnun, R., Lashiyal, A., & Kubek, M. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-90295-6_5 · Cited by 2
Detecting AI-Generated Text: A Bi-GRU with Linguistic Features Approach
Hireche, A., Al-Dabet, S., Mediani, M., & Belkacem, A. N. (2025) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016416 · Cited by 2
Continual Origin Tracing of LLM-Generated Text
Li, H., & Wang, Q. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3729935 · Cited by 2
User-side Model Consistency Monitoring for Open Source Large Language Models Inference Services
Miao, Q., & Fang, Z. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.569 · Cited by 3
Synergizing linguistic features and transformer networks for detecting AI-generated text
Yadagiri, A., Kumar, P., Poddar, Y., Pakray, P., & Chunka, C. (2026) · Knowledge and Information Systems · doi:10.1007/s10115-025-02637-6 · Cited by 2
CopyCAT: Masking Strategy Conscious Augmented Text for Machine Generated Text Detection
Liu, C., & Kao, H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-33374-3_29 · Cited by 2
Fine-Tuning GPT-3 for Synthetic Danish News Generation
Almasi, M., & Schiønning, A. (2023) · International Conference on Natural Language Generation · doi:10.18653/v1/2023.inlg-main.4 · Cited by 2
Adapting the Teaching of Academic Writing to the Emergence of Natural Language Generators
Ilieva, R. Y., & Tonchev, A. (2022) · International Conference on High Technology for Sustainable Development (HiTech) · doi:10.1109/hitech56937.2022.10145549 · Cited by 2
Detection and Analysis of AI-Generated Malicious Content
Arafah, M. E., Al-Banna, A.-K., & Aladawi, A. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0832-6.ch011 · Cited by 3
Decoding AI-Generated Content Through Human Heuristics
Mitra, A., Mohanty, S., & Mishra, D. (2025) · Springer eBooks · doi:10.1007/978-3-031-77232-0_12 · Cited by 2
Who Wrote This? Identifying Machine vs Human-Generated Text in Hausa
Sani, B., Soy, A., Imam, S. H., Mustapha, A., Aliyu, L. J., Abdulmumin, I., Ahmad, I. S., & Muhammad, S. H. (2025) · Workshop on African Natural Language Processing (AfricaNLP) · doi:10.18653/v1/2025.africanlp-1.12 · Cited by 2
Metadata
- Authors
- Ippolito, D., Duckworth, D., Callison-Burch, C., & Eck, D.
- Affiliations
- University of Pennsylvania (US)
- Google (United States) (US)
- Venue
- Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
- Published
- 2020
- Pages
- 1808-1822
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W3021153741
- Cited by
- 264
- References
- 31
- Citations by year
- 2026: 39 · 2025: 64 · 2024: 38 · 2023: 63 · 2022: 18 · 2021: 29 · 2020: 13
- FWCI
- 11.75
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Defense Advanced Research Projects Agency (FA8750-19-2-1004, FA8750)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- AI-generated text detection, decoding strategies, top-k sampling, nucleus sampling, random sampling, human raters, text generation evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
