CoChat
Sign Up
PreprintCited by 6Authorship Attribution and ProfilingNatural Language Processing TechniquesTopic Modeling

Authorship Obfuscation in Multilingual Machine-Generated Text Detection

Open access
Macko, Dominik, Moro, Robert, Uchendu, Adaku, Srba, Ivan, Lucas, Jason Samuel, Yamashita, Michiharu, Tripto, Nafis Irtiza, Lee, Dongwon +2 more·2024·arXiv
DOI 10.48550/arxiv.2401.07867arXiv 2401.07867
Open this paper in CoChat — free accountOpen PDF

Abstract

High-quality text generation capability of recent Large Language Models (LLMs) causes concerns about their misuse (e.g., in massive generation/spread of disinformation). Machine-generated text (MGT) detection is important to cope with such threats. However, it is susceptible to authorship obfuscation (AO) methods, such as paraphrasing, which can cause MGTs to evade detection. So far, this was evaluated only in monolingual settings. Thus, the susceptibility of recently proposed multilingual detectors is still unknown. We fill this gap by comprehensively benchmarking the performance of 10 well-known AO methods, attacking 37 MGT detection methods against MGTs in 11 languages (i.e., 10 $\times$ 37 $\times$ 11 = 4,070 combinations). We also evaluate the effect of data augmentation on adversarial robustness using obfuscated texts. The results indicate that all tested AO methods can cause evasion of automated detection in all tested languages, where homoglyph attacks are especially successful. However, some of the AO methods severely damaged the text, making it no longer readable or easily recognizable by humans (e.g., changed language, weird characters).

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2401.07867

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Detectors are vulnerable to adversarial attacks including homoglyph attacks, whitespace insertion, syntactic perturbations, synonym replacement, and paraphrasing.

    “Additionally, detectors are vulnerable to adversarial attacks, including homoglyph attacks [Gagiano et al., 2021;Macko et al., 2024], whitespace insertion [Cai and Cui, 2023], syntactic perturbations [Bhat and Parthasarathy, 2020a], synonym replacement [Kulkarni et al., 2023], and paraphrasing [Krishna et al., 2024b;Shi et al., 2024;Becker et al., 2023].”

    From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Macko et al., 2024

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 65

  1. Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774. · arXiv
  2. Bo Ai, Yuchen Wang, Yugin Tan, and Samson Tan. 2022. Whodunit? learning to contrast for authorship attribution. In AACL.
  3. Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Al- shamsi, Alessandro Cappelli, Ruxandra Cojocaru, Mérouane Debbah, Étienne Goffinet, Daniel Hesslow, Julien Launay, Quentin Malartic, Daniele Mazzotta, Badreddine Noune, Baptiste Pannier, and Guilherme Penedo. 2023. The falcon series of open language models. arXiv preprint arXiv:2311.16867. · arXiv
  4. Mishari Almishari, Ekin Oguz, and Gene Tsudik. 2014. Fighting authorship linkability with crowdsourcing. In Proceedings of the Second ACM Conference on Online Social Networks, COSN '14, page 69-82, New York, NY, USA. Association for Computing Machinery. · DOI
  5. Malik Altakrori, Thomas Scialom, Benjamin C. M. Fung, and Jackie Chi Kit Cheung. 2022. A mul- tifaceted framework to evaluate evasion, content preservation, and misattribution in authorship obfus- cation techniques. In Proceedings of the 2022 Con- ference on Empirical Methods in Natural Language Processing, pages 2391-2406, Abu Dhabi, United Arab Emirates. Association for Computational Lin- guistics. · DOI
  6. Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with im- proved correlation with human judgments. In Pro- ceedings of the ACL Workshop on Intrinsic and Ex- trinsic Evaluation Measures for Machine Transla- tion and/or Summarization, pages 65-72, Ann Arbor, Michigan. Association for Computational Linguis- tics.
  7. Guangsheng Bao, Yanbin Zhao, Zhiyang Teng, Linyi Yang, and Yue Zhang. 2024. Fast-DetectGPT: Effi- cient zero-shot detection of machine-generated text via conditional probability curvature. In The Twelfth International Conference on Learning Representa- tions.
  8. Florian Beil, Martin Ester, and Xiaowei Xu. 2002. Fre- quent term-based text clustering. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '02, page 436-442, New York, NY, USA. Association for Computing Machinery. · DOI
  9. Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, et al. 2021. Extracting training data from large language models. In 30th USENIX Security Symposium (USENIX Security 21), pages 2633-2650.
  10. Jan Cegin, Jakub Simko, and Peter Brusilovsky. 2023. ChatGPT to replace crowdsourcing of paraphrases for intent classification: Higher diversity and compa- rable model robustness. In The 2023 Conference on Empirical Methods in Natural Language Processing.
  11. Canyu Chen and Kai Shu. 2023a. Can llm-generated misinformation be detected? In NeurIPS 2023 Work- shop on Instruction Tuning and Instruction Follow- ing.
  12. Canyu Chen and Kai Shu. 2023b. Combating misinfor- mation in the age of llms: Opportunities and chal- lenges. arXiv preprint arXiv:2311.05656. · arXiv
  13. Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al. 2022. Scaling instruction-finetuned language models. arXiv preprint arXiv:2210.11416. · arXiv
  14. Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettle- moyer, and Veselin Stoyanov. 2020. Unsupervised cross-lingual representation learning at scale. In Pro- ceedings of the 58th Annual Meeting of the Associa- tion for Computational Linguistics. Association for Computational Linguistics.
  15. Marta R Costa-jussà, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, et al. 2022. No language left behind: Scaling human-centered machine translation. arXiv preprint arXiv:2207.04672. · arXiv
  16. Evan Crothers, Nathalie Japkowicz, Herna Viktor, and Paula Branco. 2022. Adversarial robustness of neural-statistical features in detection of generative transformers. In 2022 International Joint Conference on Neural Networks (IJCNN), pages 1-8. · DOI
  17. Evan Crothers, Nathalie Japkowicz, and Herna L Viktor. 2023. Machine-generated text: A comprehensive survey of threat models and detection methods. IEEE Access.
  18. Ameet Deshpande, Vishvak Murahari, Tanmay Rajpuro- hit, Ashwin Kalyan, and Karthik Narasimhan. 2023. Toxicity in chatgpt: Analyzing persona-assigned lan- guage models. arXiv preprint arXiv:2304.05335. · arXiv
  19. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: pre-training of deep bidirectional transformers for language under- standing. Proceedings of NAACL-HLT.
  20. Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines, Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, et al. 2021. Beyond english-centric mul- tilingual machine translation. Journal of Machine Learning Research, 22:1-48.
  21. Sebastian Gehrmann, Hendrik Strobelt, and Alexander Rush. 2019. Gltr: Statistical detection and visual- ization of generated text. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations. Association for Computational Linguistics.
  22. Biyang Guo, Xin Zhang, Ziyuan Wang, Minqi Jiang, Jinran Nie, Yuxuan Ding, Jianwei Yue, and Yupeng Wu. 2023a. How close is ChatGPT to human experts? Comparison corpus, evaluation, and detection. arXiv preprint arxiv:2301.07597. · arXiv
  23. Jiaxin Guo, Daimeng Wei, Zhanglin Wu, Zongyao Li, Zhiqiang Rao, Minghan Wang, Hengchao Shang, Xi- aoyu Chen, Zhengzhe Yu, Shaojun Li, Yuhao Xie, Lizhi Lei, and Hao Yang. 2023b. The HW-TSC's simultaneous speech-to-text translation system for IWSLT 2023 evaluation. In Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023), pages 376-382, Toronto, Canada (in-person and online). Association for Com- putational Linguistics. · DOI
  24. Abhimanyu Hans, Avi Schwarzschild, Valeriia Cherepanova, Hamid Kazemi, Aniruddha Saha, Micah Goldblum, Jonas Geiping, and Tom Goldstein. 2024. Spotting LLMs with Binoculars: Zero-shot detection of machine-generated text. arXiv preprint arXiv:2401.12070. · arXiv
  25. Pengcheng He, Jianfeng Gao, and Weizhu Chen. 2022. Debertav3: Improving deberta using electra-style pre- training with gradient-disentangled embedding shar- ing. In The Eleventh International Conference on Learning Representations.
  26. Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru, Todor Mihaylov, Dániel Simig, Ping Yu, Kurt Shus- ter, Tianlu Wang, Qing Liu, Punit Singh Koura, et al. 2022. OPT-IML: Scaling language model instruc- tion meta learning through the lens of generalization. arXiv preprint arXiv:2212.12017. · arXiv
  27. Yashwant Keswani, Harsh Trivedi, Parth Mehta, and P Majumder. 2016. Author masking through transla- tion-notebook for pan at clef 2016. In Conference and Labs of the Evaluation Forum, CLEF.
  28. Kalpesh Krishna, Yixiao Song, Marzena Karpinska, John Wieting, and Mohit Iyyer. 2023. Paraphras- ing evades detectors of ai-generated text, but re- trieval is an effective defense. arXiv preprint arXiv:2303.13408. · arXiv
  29. Thomas Lavergne, Tanguy Urvoy, and François Yvon. 2008. Detecting fake content with relative entropy scoring. In Proceedings of the 2008 International Conference on Uncovering Plagiarism, Authorship and Social Software Misuse -Volume 377, PAN'08, page 27-31, Aachen, DEU. CEUR-WS.org.
  30. Jooyoung Lee, Thai Le, Jinghui Chen, and Dongwon Lee. 2023. Do language models plagiarize? In Proceedings of the ACM Web Conference 2023, pages 3637-3647.
  31. Yafu Li, Qintong Li, Leyang Cui, Wei Bi, Longyue Wang, Linyi Yang, Shuming Shi, and Yue Zhang. 2023. Deepfake text detection in the wild. arXiv preprint arxiv:2305.13242. · arXiv
  32. Vijini Liyanage, D. Buscaldi, and Adeline Nazarenko. 2022. A benchmark corpus for the detection of au- tomatically generated text in academic publications. In International Conference on Language Resources and Evaluation.
  33. Ning Lu, Shengcai Liu, Rui He, and Ke Tang. 2023. Large language models can be guided to evade ai-generated text detection. arXiv preprint arXiv:2305.10847. · arXiv
  34. Jason Lucas, Adaku Uchendu, Michiharu Yamashita, Jooyoung Lee, Shaurya Rohatgi, and Dongwon Lee. 2023. Fighting fire with fire: The dual role of llms in crafting and detecting elusive disinformation. In Pro- ceedings of the 2023 Conference on Empirical Meth- ods in Natural Language Processing, pages 14279- 14305.
  35. Dominik Macko, Robert Moro, Adaku Uchendu, Ja- son Lucas, Michiharu Yamashita, Matúš Pikuliak, Ivan Srba, Thai Le, Dongwon Lee, Jakub Simko, and Maria Bielikova. 2023a. MULTITuDE: Large- scale multilingual machine-generated text detection benchmark. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Process- ing, pages 9960-9987, Singapore. Association for Computational Linguistics. · DOI · Paper page
  36. Eric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D. Manning, and Chelsea Finn. 2023. DetectGPT: Zero-shot machine-generated text de- tection using probability curvature. arXiv preprint arXiv:2301.11305. · arXiv
  37. Shaoor Munir, Brishna Batool, Zubair Shafiq, Padmini Srinivasan, and Fareed Zaffar. 2021. Through the looking glass: Learning to attribute synthetic text generated by language models. In Conference of the European Chapter of the Association for Computa- tional Linguistics.
  38. Milad Nasr, Nicholas Carlini, Jonathan Hayase, Matthew Jagielski, A Feder Cooper, Daphne Ippolito, Christopher A Choquette-Choo, Eric Wallace, Flo- rian Tramèr, and Katherine Lee. 2023. Scalable ex- traction of training data from (production) language models. arXiv preprint arXiv:2311.17035. · arXiv
  39. Jiameng Pu, Zain Sarwar, Sifat Muhammad Abdullah, Abdullah Rehman, Yoonjin Kim, Parantapa Bhat- tacharya, Mobin Javed, and Bimal Viswanath. 2023. Deepfake text detection: Limitations and opportu- nities. In 2023 IEEE Symposium on Security and Privacy (SP), pages 1613-1630. · DOI
  40. Jiashu Pu, Zi Feng Huang, Yadong Xi, Guandan Chen, Weijie Chen, and Rongsheng Zhang. 2022. Unravel- ing the mystery of artifacts in machine generated text. In International Conference on Language Resources and Evaluation.
  41. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9.
  42. Sara Rosenthal, Mihaela Bornea, and Avirup Sil. 2021. Are multilingual BERT models robust? A case study on adversarial attacks for multilingual question an- swering. arXiv preprint arXiv:2104.07646. · arXiv
  43. Vinu Sankar Sadasivan, Aounon Kumar, Sriram Bala- subramanian, Wenxiao Wang, and Soheil Feizi. 2023. Can ai-generated text be reliably detected? arXiv preprint arXiv:2303.11156. · arXiv
  44. Zhouxing Shi, Yihan Wang, Fan Yin, Xiangning Chen, Kai-Wei Chang, and Cho-Jui Hsieh. 2023. Red team- ing language model detectors with language models. arXiv preprint arXiv:2305.19713. · arXiv
  45. Oleh Shliazhko, Alena Fenogenova, Maria Tikhonova, Vladislav Mikhailov, Anastasia Kozlova, and Tatiana Shavrina. 2022. mGPT: Few-shot learners go multi- lingual. arXiv preprint arXiv:2204.07580. · DOI
  46. Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Rad- ford, Gretchen Krueger, Jong Wook Kim, Sarah Kreps, et al. 2019. Release strategies and the so- cial impacts of language models. arXiv preprint arXiv:1908.09203. · arXiv
  47. Michal Spiegel and Dominik Macko. 2024. IMGTB: A framework for machine-generated text detection benchmarking. In Proceedings of the 62nd Annual Meeting of the Association for Computational Lin- guistics (Volume 3: System Demonstrations), pages 172-179, Bangkok, Thailand. Association for Com- putational Linguistics. · DOI
  48. Jinyan Su, Terry Yue Zhuo, Di Wang, and Preslav Nakov. 2023. DetectLLM: Leveraging log rank information for zero-shot detection of machine-generated text. arXiv preprint arXiv:2306.05540. · arXiv
  49. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. 2023. LLaMA: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971. · arXiv
  50. Nafis Irtiza Tripto, Saranya Venkatraman, Dominik Macko, Robert Moro, Ivan Srba, Adaku Uchendu, Thai Le, and Dongwon Lee. 2024. A ship of theseus: Curious cases of paraphrasing in LLM-generated texts. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Vol- ume 1: Long Papers), pages 6608-6625, Bangkok, Thailand. Association for Computational Linguistics. · DOI
  51. Adaku Uchendu, Thai Le, and Dongwon Lee. 2023. At- tribution and obfuscation of neural text authorship: A data mining perspective. ACM SIGKDD Explo- rations Newsletter, 25(1):1-18.
  52. Adaku Uchendu, Zeyu Ma, Thai Le, Rui Zhang, and Dongwon Lee. 2021. Turingbench: A benchmark environment for turing test in the age of neural text generation. In Conference on Empirical Methods in Natural Language Processing.
  53. Saranya Venkatraman, Adaku Uchendu, and Dongwon Lee. 2024. Gpt-who: An information density-based machine-generated text detector. In Findings of the Association for Computational Linguistics: NAACL 2024.
  54. Pranav Narayanan Venkit, Sanjana Gautam, Ruchi Pan- chanadikar, Ting-Hao Huang, and Shomir Wilson. 2023. Nationality bias in text generation. In Pro- ceedings of the 17th Conference of the European Chapter of the Association for Computational Lin- guistics, pages 116-122.
  55. Ivan Vykopal, Matúš Pikuliak, Ivan Srba, Robert Moro, Dominik Macko, and Maria Bielikova. 2024. Dis- information capabilities of large language models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14830-14847, Bangkok, Thai- land. Association for Computational Linguistics. · DOI · Paper page
  56. Xiao Wang, Qin Liu, Tao Gui, Qi Zhang, Yicheng Zou, Xin Zhou, Jiacheng Ye, Yongxin Zhang, Rui Zheng, Zexiong Pang, Qinzhuo Wu, Zhengyan Li, Chong Zhang, Ruotian Ma, Zichu Fei, Ruijian Cai, Jun Zhao, Xingwu Hu, Zhiheng Yan, Yiding Tan, Yuan Hu, Qiyuan Bian, Zhihua Liu, Shan Qin, Bolin Zhu, Xiaoyu Xing, Jinlan Fu, Yue Zhang, Minlong Peng, Xiaoqing Zheng, Yaqian Zhou, Zhongyu Wei, Xipeng Qiu, and Xuanjing Huang. 2021. TextFlint: Unified multilingual robustness evaluation toolkit for natural language processing. In Proceedings of the 59th Annual Meeting of the Association for Compu- tational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations, pages 347-355, Online. Association for Computational Linguistics. · DOI
  57. Yuxia Wang, Jonibek Mansurov, Petar Ivanov, Jinyan Su, Artem Shelmanov, Akim Tsvigun, Chenxi Whitehouse, Osama Mohammed Afzal, Tarek Mah- moud, Alham Fikri Aji, and Preslav Nakov. 2023. M4: Multi-generator, multi-domain, and multi- lingual black-box machine-generated text detection. arXiv:2305.14902. · arXiv
  58. Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, et al. 2022. Emergent abilities of large language models. Transactions on Machine Learning Research.
  59. Junchao Wu, Shu Yang, Runzhe Zhan, Yulin Yuan, Derek F Wong, and Lidia S Chao. 2023. A sur- vey on llm-gernerated text detection: Necessity, methods, and future directions. arXiv preprint arXiv:2310.14724. · arXiv
  60. Zhendong Wu and Hui Xiang. 2023. MFD: Multi- feature detection of LLM-generated text. PREPRINT (Version 1) available at Research Square. · DOI
  61. Eric Xing, Saranya Venkatraman, Thai Le, and Dong- won Lee. 2024. ALISON: Fast and effective stylo- metric authorship obfuscation. In 38th AAAI Conf. on Artificial Intelligence (AAAI).
  62. Xianjun Yang, Wei Cheng, Yue Wu, Linda Ruth Pet- zold, William Yang Wang, and Haifeng Chen. 2024. DNA-GPT: Divergent N-gram analysis for training- free detection of GPT-generated text. In The Twelfth International Conference on Learning Representa- tions.
  63. Yinfei Yang, Daniel Cer, Amin Ahmad, Mandy Guo, Jax Law, Noah Constant, Gustavo Hernandez Abrego, Steve Yuan, Chris Tar, Yun-Hsuan Sung, et al. 2020. Multilingual universal sentence encoder for semantic retrieval. In Proceedings of the 58th Annual Meet- ing of the Association for Computational Linguistics: System Demonstrations, pages 87-94.
  64. Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk, Ali Farhadi, Franziska Roesner, and Yejin Choi. 2019. Defending against neural fake news. Advances in neural information processing systems, 32.
  65. Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Wein- berger, and Yoav Artzi. 2019. BERTScore: Evalu- ating text generation with BERT. In International Conference on Learning Representations. 11 https://colab.research.google.com/ 12 https://huggingface.co/facebook/m2m100_1.2B 13 https://huggingface.co/facebook/nllb-200-distilled-1.3B 14 https://huggingface.co/tuner007/pegasus_paraphrase 15 https://github.com/martiansideofthemoon/ ai-detection-paraphrases 16 https://openai.com/blog/chatgpt 17 https://github.com/Declipsonator/GPTZzzs 18 https://github.com/o2161405/GPTZero-Bypasser 19 https://www.unicode.org/Public/security/8.0.0/confusables. txt 20 https://github.com/EricX003/ALISON 21 https://github.com/jmpu/DeepfakeTextDetection/tree/main/

Cited by

Sorted by citations

Authors
Macko, D., Moro, R., Uchendu, A., Srba, I., Lucas, J. S., Yamashita, M., Tripto, N. I., Lee, D., Simko, J., & Bielikova, M.
Affiliations
  • Kempelen Institute of Intelligent Technologies (SK)
  • MIT Lincoln Laboratory (US)
  • Pennsylvania State University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Pages
6348-6368
DOI
10.48550/arxiv.2401.07867
arXiv
2401.07867
OpenAlex
W4404782577
Cited by
6
References
0
Citations by year
2026: 1 · 2025: 4 · 2024: 1
FWCI
1.77
Type
conference paper
Language
en
Open access
Licence
Locations
  • Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Science Foundation (1820609, 1934782, 2114824, 2131144, 1925001)
  • European Commission (311070AKF2, 101073921, 101135437)
  • Agentúra na Podporu Výskumu a Vývoja (APVV-22-, APVV-22-0414)
  • HORIZON EUROPE Framework Programme
  • European Regional Development Fund (311070AKF2)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
AI-generated text detection, multilingual text, authorship attribution

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review