Can Users Distinguish Narrative Texts Written by an Artificial Intelligence Writing Tool from Purely Human Text?
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Current generation LLMs can produce output which humans struggle to identify as being machine created.
“emerging research has suggested that existing LLMs can produce output which humans struggle to identify as being machine created”
From Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond (2023) · cites this paper as Gunser et al., 2021
Poem continuations could not always be correctly identified by professionals with a literature-specific background as machine or human written.
“Gunser et al. (2021) found that poem continuations could not always be correctly identified by professionals with a literature-specific background as machine or human written.”
From Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond (2023) · cites this paper as Gunser et al. (2021)
Cites
The forthcoming artificial intelligence (AI) revolution: Its impact on society and firms
Makridakis, S. (2017) · Futures · doi:10.1016/j.futures.2017.03.006 · Cited by 1,866 · see citing works
Shneiderman, B. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3419764 · Cited by 768 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Perkins, M. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.02.07 · Cited by 839 · see citing works
Perkins, M., Roe, J., Postma, D., McGaughran, J., & Hickerson, D. (2024) · Journal of Academic Ethics · doi:10.1007/s10805-023-09492-6 · Cited by 234 · see citing works
Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania
Rudolph, J., Mohamed Ismail, F. M., & Popenici, S. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/54fs5e77 · Cited by 128 · see citing works
Playing games with AIs: the limits of GPT-3 and similar large language models
Sobieszek, A., & Price, T. (2022) · Minds and Machines · doi:10.1007/s11023-022-09602-0 · Cited by 86 · see citing works
Cross-domain detection of GPT-2-generated technical text
Rodriguez, J., Hay, T., Gros, D., Shamsi, Z., & Srinivasan, R. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.88 · Cited by 40 · see citing works
Students are using large language models and AI detectors can often detect their use
Paustian, T., & Slinger, B. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1374889 · Cited by 27 · see citing works
Perkins, M., & Roe, J. (2023) · doi:10.35542/osf.io/z4cru · Cited by 117 · see citing works
- Authors
- Gunser, V. E., Gottschling, S., Brucker, B., Richter, S., & Gerjets, P.
- Affiliations
- Leibniz-Institut für Wissensmedien (DE)
- German Literature Archive (DE)
- Corresponding author
- Gunser, Vivian Emily
- Richter, Sandra
- Gerjets, Peter
- Venue
- Communications in Computer and Information Science
- Publisher
- Springer International Publishing
- Published
- 2021
- Pages
- 520-527
- ISSN
- 1865-0929 (ISSN-L)
- 1865-0937
- OpenAlex
- W3181318144
- Cited by
- 25
- References
- 2
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 9 · 2023: 5 · 2022: 2
- FWCI
- 1.78
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Communications in computer and information science (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Social Sciences › Political Science and International Relations › Literary and Philosophical Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Keywords
- AI-generated text, GPT-2, creative writing, narrative texts, text classification, AI writing tools
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
