Large Language Model (LLM) AI text generation detection based on transformer deep learning algorithm
Open accessAbstract
In this paper, a tool for detecting LLM AI text generation is developed based on the Transformer model, aiming to improve the accuracy of AI text generation detection and provide reference for subsequent research. Firstly the text is Unicode normalised, converted to lowercase form, characters other than non-alphabetic characters and punctuation marks are removed by regular expressions, spaces are added around punctuation marks, first and last spaces are removed, consecutive ellipses are replaced with single spaces and the text is connected using the specified delimiter. Next remove non-alphabetic characters and extra whitespace characters, replace multiple consecutive whitespace characters with a single space and again convert to lowercase form. The deep learning model combines layers such as LSTM, Transformer and CNN for text classification or sequence labelling tasks. The training and validation sets show that the model loss decreases from 0.127 to 0.005 and accuracy increases from 94.96 to 99.8, indicating that the model has good detection and classification ability for AI generated text. The test set confusion matrix and accuracy show that the model has 99% prediction accuracy for AI-generated text, with a precision of 0.99, a recall of 1, and an f1 score of 0.99, achieving a very high classification accuracy. Looking forward, it has the prospect of wide application in the field of AI text detection.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Operating system caching systems such as Linux page cache and ZFS ARC are built for uniform cache-line sizes and cannot handle the varying computational costs of different-length KV cache misses in LLMs.
“Operating system caching systems, like Linux page cache [38] and ZFS ARC [40], are optimized for uniform cache-line sizes, failing to address the variable computational costs of different-length KV cache misses in LLMs.”
From HotPrefix: Hotness-Aware KV Cache Scheduling for Efficient Prefix Sharing in LLM Inference Systems (2025) · cites this paper as [40]
The Introduction describes detecting AI-generated text, and the Method describes a transformer-based text classifier. Searches for Linux page cache, ZFS ARC, KV-cache misses, and variable recomputation costs found no passage addressing the caching claim. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
Cited by 31
Research works printed but not linked: 8
- Meng, Yinan, et al. "Spring-IMU Fusion-Based Proprioception for Feedback Control of Soft Manipulators." IEEE/ASME Transactions on Mechatronics (2023).
- Mu, Pengyu, Wenhao Zhang, and Yuhong Mo. "Research on spatio-temporal patterns of traffic operation index hotspots based on big data mining technology." Basic & Clinical Pharmacology & Toxicology. Vol. 128. 111 RIVER ST, HOBOKEN 07030-5774, NJ USA: WILEY, 2021.
- ImaniGooghari, Ayyoob, et al. "Glot500: Scaling multilingual corpora and language models to 500 languages." ar**v preprint ar**v:2305.12182 (2023).
- Bernacki, Bruce E., Timothy J. Johnson, and Tanya L. Myers. "Modeling thin layers of analytes on substrates for spectral analysis: use of solid/liquid n and k values to model reflectance spectra." Optical Engineering 59.9 (2020): 092005-092005.
- Szabó, Ferenc János. "Comparison of Programming Ansys and COSMOS/M Finite Element Systems." DESIGN OF MACHINES AND STRUCTURES: A PUBLICATION OF THE UNIVERSITY OF MISKOLC 12.2 (2022): 110-119.
- Aristantia, Dita Wahyuni, et al. "Learning Model of Arabic in Indonesia: A Study of The Curriculum System at Bahrul Ulum Tambakberas Islamic Boarding School, Jombang and an-Nuqayah, Madura." Edumaspul: Jurnal Pendidikan 8.1 (2024): 485-499.
- Beniwal, Mohit, Archana Singh, and Nand Kumar. "Forecasting long-term stock prices of global indices: A forward-validating Genetic Algorithm optimization approach for Support Vector Regression." Applied Soft Computing 145 (2023): 110566.
- Burruel Stone, Theresa. "Socializing Latinx college-going youth to (White) Neutral Rationality: Liberal teaching practices and right-wing racisms." International Journal of Qualitative Studies in Education (2024): 1-17.
- Authors
- Mo, Y., Qin, H., Dong, Y., Zhu, Z., & Li, Z.
- Affiliations
- Carnegie Mellon University (US)
- New York University (US)
- Texas A&M University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2405.06652
- OpenAlex
- W4396912870
- Cited by
- 31
- References
- 0
- Citations by year
- 2025: 8 · 2024: 23
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- AI-generated text detection, large language models, transformer models, text classification, text preprocessing, LSTM, convolutional neural networks, hybrid deep learning model
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
