The DOI matches its Crossref record; 212 of the 212 references it cites were found in a registry or an index; 63 of the 161 sources its claims cite were checked for support.
Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges
Open accessAbstract
A literature review of human-written, LLM-generated, attributed, and co-authored text detection problems, methods, and challenges.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This survey maps authorship attribution in the LLM era into four problem types and reviews methods, datasets, metrics, and open challenges. It argues that LLMs blur human–machine authorship boundaries and that progress requires better generalization, explainability, standardized benchmarks, and interdisciplinary work.
Key findings
- The paper organizes the field into four representative problems: human-written text attribution, LLM-generated text detection, LLM-generated text attribution, and human-LLM co-authored text attribution, with complexity increasing across them.
- Detection approaches are grouped into metric-based and model-based families, including feature-based, neural network-based, zero-shot, and watermarking methods; neural detectors often outperform metric-based ones but are less explainable, need retraining for new LLMs, and are vulnerable to adversarial or poisoning attacks.
- The survey compares 21 benchmarks/datasets: all support LLM-generated text detection, but fewer support LLM-generated text attribution or human-LLM co-authored attribution, and many treat human-written text as one class, making them unsuitable for identifying individual human authors.
- Human judgment is weak: untrained reviewers distinguish GPT-3 text from human text at roughly chance level, and experienced faculty/researchers identify GPT-generated academic writing correctly only about half the time. Commercial detectors often claim over 99% accuracy, yet few are tested on shared benchmarks and many have high false-positive rates.
Methods
- Design: a literature review/survey that synthesizes existing research rather than presenting new experiments.
- Data/sample: cited prior studies, 21 authorship attribution datasets/benchmarks, and a table of commercial and open-source LLM-text detectors.
- Analysis: qualitative thematic categorization of four attribution problems, comparison of methodologies, datasets, evaluation metrics, and discussion of future directions.
Limitations
- Stated: fewer studies address human-LLM co-authored attribution because it is difficult, and existing work often simplifies the task; many datasets are unsuitable for individual human authorship attribution; detectors lack robustness to decoding strategies, prompts, adversarial attacks, unseen domains, and unseen models.
- Stated: LLM-based attribution becomes less effective as the number of candidate authors grows due to context-length limits, and training-data biases can produce inaccurate attributions for marginalized groups and languages.
- Evident: as a survey, it provides no new empirical validation or standardized benchmark results, and its comparisons draw on heterogeneous prior datasets and metrics, so reported performance is not directly comparable; the text also does not describe a systematic search or inclusion protocol.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
63 of 161 cited sources checked · 38 supported · 0 flagged · accuracy not yet measured
Every source the paper cites for this claim was checked and supports it.
In the paper
“In contrast, detection algorithms frequently outperform the human in this task [Ippolito et al., 2020].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2 Methodologies
What the sources say
- Supportedcites Ippolito et al., 2020 source
The Human Evaluation section reports that human raters, including trained experts, had consistently worse accuracy than automatic discriminators across all tested decoding methods and excerpt lengths. This supports the citing sentence’s comparison for the text-generation settings studied. (LLM, conf=0.94)
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“untrained human reviewers are often unable to distinguish GPT-3-generated text from humanwritten text, identifying it correctly only at a rate consistent with random chance [Clark et al., 2021].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2 Methodologies
What the sources say
- Supportedcites Clark et al., 2021 source
Section 2.4 (Results; page not provided) reports that evaluators identified GPT-3 versus human authorship correctly 49.9% of the time, compared with 50% random chance, and that their accuracy was not significantly different from chance. The Conclusion identifies these evaluators as untrained. (LLM, conf=0.95)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The rapid advancements of Large Language Models (LLMs) have blurred the lines between human and machine authorship, posing significant challenges for traditional methods.”
- Also stated in: § 1. INTRODUCTION · plain
“The advent of LLMs has complicated authorship attribution, making it increasingly difficult to distinguish between LLM-generated texts and human-written texts [Clark et al., 2021;Sadasivan et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > Abstract
What the sources say
- Supportedcites Clark et al., 2021 source
The Results (§2.4) report that evaluators distinguished GPT-3 text from human-authored text at 49.9% accuracy, approximately chance, compared with 57.9% for GPT-2. The Analysis (§2.5) links that increased difficulty to improvements in newer models and raises concerns about existing human-evaluation methods. (LLM, conf=0.88)
- Supportedcites Sadasivan et al., 2023 source
The Introduction (p. 2) says LLMs produce human-like text and that this creates an authenticity challenge. The Abstract (p. 1) describes reliable AI-text detection as a challenge and reports vulnerabilities in existing detection methods, supporting the claim that distinguishing machine from human authorship has become difficult. (LLM, conf=0.90)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § 1. INTRODUCTION · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“Existing detectors also lack robustness to various factors, such as alternative decoding strategies [Ippolito et al., 2020], input sequence length [Solaiman et al., 2019], different prompts [Kumarage et al., 2023;Lu et al., 2023], and repetition penalties [Fishchuk and Braun, 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.3 Open Challenges
What the sources say
- Supportedcites Solaiman et al., 2019 source
In “Our Work,” the paper says shorter outputs are harder to detect than longer ones. Figure 2 in “Roberta-Large Transferred Model Accuracy” shows detection accuracy increasing with text length, supporting the claim that detector performance is sensitive to input sequence length. (LLM, conf=0.91)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Sadasivan et al. [2023] provided theoretical insights indicating that the detection problem is becoming increasingly difficult.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2 Methodologies
What the sources say
- Supportedcites Sadasivan et al., 2023 source
Section 4 (p. 12) explicitly says that, as more advanced language models more closely mimic human text, the detection problem becomes increasingly difficult under the paper’s theoretical result. The Introduction (p. 4) makes clear that this conclusion depends on the distance between human and AI text distributions decreasing. (LLM, conf=0.94)
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, existing detectors and models for LLM-generated text are not yet fully reliable [Sadasivan et al., 2023;Wang et al., 2023;Dugan et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2 Methodologies
What the sources say
- Supportedcites Sadasivan et al., 2023 source
The Abstract (p. 1) reports that paraphrasing attacks substantially reduce detection rates, exposing vulnerabilities in current AI-text detection systems. The Conclusion (p. 37) also warns that false positives can make their practical applications unreliable. These findings support the claim that existing detectors are not fully reliable. (LLM, conf=0.92)
- Supportedcites Wang et al., 2023 source
The Feasibility of Black-Box Machine-Generated Text Detection section says current approaches may be less effective and generalize poorly to unseen domains, generators, and languages. The paper’s empirical findings also describe detectors misclassifying machine-generated text in those settings. Page numbers are not supplied in our copy. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites Dugan et al., 2024 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Humanauthored texts are generally more coherent, while LLMgenerated texts tend to repeat terms within a paragraph [Dugan et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2.1 Featured-based Method
What the sources say
- Partly supportedcites Dugan et al., 2023 sourceExperimental — accuracy not yet measured
Section 6, “RoFT-Specific Insights” (page not available in our copy), reports that irrelevance and contradiction were among the most reliable reasons participants gave for identifying generated text. That lends some support to a coherence difference, but the paper does not establish that human-authored text is generally more coherent across LLMs, or that generated text tends to repeat terms within a paragraph; it records repetition as a participant-selected reason, not a measured paragraph-level tendency. (LLM, conf=0.78)
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“These detectors also face limitations such as overfitting to training data [Uchendu et al., 2020].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2.2 Neural Network-Based Detectors
What the sources say
- Could not verifycites Uchendu et al., 2020 sourceExperimental — accuracy not yet measured
The supplied passages contain bibliographic metadata, not a discussion of detector limitations. Searches for overfitting, generalization, and training-data limitations returned only the title and author listing (no section or page), so the available copy does not establish this claim. (LLM, conf=0.72)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These detectors require retraining when encountering text generated by new LLMs to ensure reliable detection [Mitchell et al., 2023;Chakraborty et al., 2023b].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2.2 Neural Network-Based Detectors
What the sources say
- Partly supportedcites Mitchell et al., 2023 sourceExperimental — accuracy not yet measured
Section 5.1 reports that supervised detectors can overfit to their training data, including the source model, and perform worse under distribution shift. Section 5 contrasts this with zero-shot detectors, which do not require retraining for new source models. The paper does not establish that neural network-based detectors invariably require retraining for every new LLM to ensure reliable detection. (LLM, conf=0.84)
- Not matchedcites Chakraborty et al., 2023b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Existing detectors also lack robustness to various factors, such as alternative decoding strategies [Ippolito et al., 2020], input sequence length [Solaiman et al., 2019], different prompts [Kumarage et al., 2023;Lu et al., 2023], and repetition penalties [Fishchuk and Braun, 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.3 Open Challenges
What the sources say
- Supportedcites Ippolito et al., 2020 source
The Transferability section reports that detectors trained on one decoding strategy often perform poorly when tested on another, including a top-k-trained detector whose accuracy fell to 42.5%. The Conclusion likewise says that discriminators generally transfer poorly between decoding strategies, while noting that training on a mix of strategies can help. (LLM, conf=0.93)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Supported
- It may state two separate claims as one. 38
- Probably not a substantial claim. 42
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Additionally, detectors are vulnerable to adversarial attacks, including homoglyph attacks [Gagiano et al., 2021;Macko et al., 2024], whitespace insertion [Cai and Cui, 2023], syntactic perturbations [Bhat and Parthasarathy, 2020a], synonym replacement [Kulkarni et al., 2023], and paraphrasing [Krishna et al., 2024b;Shi et al., 2024;Becker et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.3 Open Challenges
What the sources say
- Not matchedcites Gagiano et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Macko et al., 2024 source
Macko et al. (2024) is cited for the homoglyph-attack portion of the sentence. The Text edits section describes its homoglyph attacks, and Section 4.1 reports that these attacks often evade machine-generated-text detection across the tested languages. The paper also notes that preprocessing can mitigate them. (LLM, conf=0.94)
- Supportedcites Cai and Cui, 2023 source
The Introduction reports that adding a single space before a comma substantially reduces AI-text detection rates. Section 3, “Space Infiltration,” describes this whitespace-insertion attack as a way to bypass detectors. The other attack types in the citing sentence are attributed to other sources, not this paper. (LLM, conf=0.94)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“Techniques like slanted triangular learning rates and gradual unfreezing can be used to avoid catastrophic forgetting during fine-tuning [Howard and Ruder, 2018].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.3 Pre-trained Language Models
What the sources say
- Supportedcites Howard and Ruder, 2018 source
The Introduction explicitly identifies slanted triangular learning rates and gradual unfreezing as techniques to retain previous knowledge and avoid catastrophic forgetting during fine-tuning. The Conclusion also says the proposed techniques, used together, prevent catastrophic forgetting. (LLM, conf=0.95)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Typically, this task is approached as a binary classification problem [Zellers et al., 2019;Solaiman et al., 2019;Jawahar et al., 2020b;Fagni et al., 2021;Mitchell et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.1 Problem Definition
What the sources say
- Supportedcites Zellers et al., 2019 source
Section 5 (p. 6) describes detecting machine-generated news by classifying articles as Human or Machine. Section 5.1 (p. 6) explicitly requires the discriminator to assign one of those two labels to each article in its unpaired evaluation, supporting the binary-classification characterization. (LLM, conf=0.88)
- Supportedcites Solaiman et al., 2019 source
The “Automated ML-based detection” section describes classifiers that distinguish language-model outputs from a true-text distribution. “Our Work” describes a detector trained on samples equally likely to be real or fake, supporting the characterization of detection as a binary classification task. (LLM, conf=0.89)
- Supportedcites Jawahar et al., 2020b source
The Introduction describes the commonly used approach as a classification task distinguishing machine-generated from human-written text. Those are two classes, matching the claim that detection is typically approached as binary classification. No page number is provided in the supplied passage. (LLM, conf=0.93)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Rivera-Soto et al. [2021] concluded that topic diversity and dataset size are crucial for effective cross-domain transfer.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.3 Pre-trained Language Models
What the sources say
- Partly supportedcites Rivera-Soto et al., 2021 sourceExperimental — accuracy not yet measured
The Conclusion attributes Reddit’s strong cross-domain transfer to both topic diversity and dataset size. But §4.2 says size only partially explains Reddit’s performance and that increasing the number of Amazon authors yielded marginal gains. Calling both factors “crucial” for cross-domain transfer generally is stronger than the paper’s finding. (LLM, conf=0.82)
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Authorship attribution methods are typically divided into classification-based methods for a small set of candidate authors and similarity-based ranking methods for larger numbers of authors [Rivera-Soto et al., 2021;Huertas-Tato et al., 2022].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.1 Problem Definition
What the sources say
- Partly supportedcites Rivera-Soto et al., 2021 sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) contrasts a prior closed-world study of 21 authors with this paper’s open-world setting involving far more authors. The Experiments metrics passage (page unavailable) describes ranking candidates by cosine similarity. The paper does not say that authorship attribution methods are typically divided into classification-based and similarity-based categories, or that classification is generally used for small candidate sets. (LLM, conf=0.84)
- Partly supportedcites Huertas-Tato et al., 2022 sourceExperimental — accuracy not yet measured
The paper describes classifier-based authorship approaches in §2.1 (p. 3) and evaluates its own similarity-based attribution from a pool of authors in §5.2 (p. 8). It does not say that methods are typically divided into these two categories or associate classification with small candidate sets and similarity-based ranking with larger ones. (LLM, conf=0.78)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Beyond feature extraction, LLMs possess the ability to identify the author of unknown text based on nuanced linguistic features, making it possible to conduct end-to-end authorship attribution [Huang et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.4 LLM-based Methods
What the sources say
- Supportedcites Huang et al., 2024 source
The Introduction reports that LLMs can perform authorship attribution and use subtle stylistic and linguistic patterns to distinguish authors. The Conclusion describes applying end-to-end methods directly to authorship attribution while bypassing intermediate feature extraction. (LLM, conf=0.93)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Authorship attribution is a complex reasoning task, and LLMs possess significant capabilities in reasoning and problem-solving, particularly in zero-shot learning within resource-limited domains [Kojima et al., 2022].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.4 LLM-based Methods
What the sources say
- Partly supportedcites Kojima et al., 2022 sourceExperimental — accuracy not yet measured
The Abstract (p. 1) reports substantial gains on diverse reasoning tasks using zero-shot prompting, and the Discussion (p. 9) describes LLMs as decent zero-shot reasoners with potential for generic problem solving. The paper does not establish these capabilities specifically within resource-limited domains; its zero-shot method avoids handcrafted examples and time-consuming fine-tuning, which is a narrower point. (LLM, conf=0.84)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Contrastive learning [Khosla et al., 2020] is often used with pre-trained language models to enhance stylistic representation by maximizing similarity between texts written by the same authors and minimizing it with texts from different authors [Huertas-Tato et al., 2022].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.3 Pre-trained Language Models
What the sources say
- Not checked — no full text of the sourcecites Khosla et al., 2020 source
- Partly supportedcites Huertas-Tato et al., 2022 sourceExperimental — accuracy not yet measured
Section 2.3 (p. 5) says the authors pair pre-trained transformers with contrastive learning to build representations of writing style. The Introduction (p. 2) says texts by the same author should have higher similarity than texts by different authors. The paper supports this approach, but its discussion of recent efforts does not establish that it is often used for stylistic representation. (LLM, conf=0.82)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One variation of this task is to detect the boundary between human-written and LLM-generated text [Cutler et al., 2021;Wang et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 5.1 Problem Definition
What the sources say
- Not matchedcites Cutler et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Wang et al., 2024 source
Section 3.3, “Boundary Identification,” defines a task in which a human begins a text, an LLM continues it, and a detector identifies the boundary. The Introduction also lists human-written-to-machine-generated change-point detection as Task 3. This supports the cited description of a variation involving boundary detection. (LLM, conf=0.95)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Human-authored texts tend to be more coherent and exhibit greater lexical diversity compared to LLM-generated texts [Guo et al., 2023;Dugan et al., 2023;Zhang et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 5.2 Methodologies
What the sources say
- Not checked — no full text of the sourcecites Guo et al., 2023 source
- Partly supportedcites Dugan et al., 2023 sourceExperimental — accuracy not yet measured
Section 6, “RoFT-Specific Insights” (page unavailable), reports that irrelevant and contradictory sentences were among the most reliable signs participants used to detect generated text. This lends support to the coherence comparison, but the paper does not establish that human-authored text has greater lexical diversity; its sentence-level analysis examines length, parts of speech, and named entities instead. (LLM, conf=0.83)
- Not checked — no full text of the sourcecites Zhang et al., 2024 source
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The evaluation of the quality of machine-generated excerpts has traditionally relied on human judgement, which is considered the gold standard for open-domain generation systems [van der Lee et al., 2019;Gehrmann et al., 2019a].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2 Methodologies
What the sources say
- Supportedcites van der Lee et al., 2019 source
Section 2, “Automatic versus human evaluation,” explicitly says that human evaluation remains the gold standard for assessing overall NLG system quality. The Introduction describes human evaluation as crucial to assessing system quality, supporting the claim’s broader account of its role. The paper makes this point about NLG generally rather than singling out open-domain systems. (LLM, conf=0.91)
- Could not verifycites Gehrmann et al., 2019a sourceExperimental — accuracy not yet measured
The Abstract reports a human-subjects study of detecting generated text, and the Method describes statistical tests for that detection task. Neither passage says that human judgment has traditionally been the gold standard for evaluating the quality of open-domain generation; searches for human evaluation and quality found no passage making that point. (LLM, conf=0.73)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Some studies categorize any text that is generated, modified, or extended by a machine as LLM-generated.This simplifies the task to either LLM-generated Text Detection or LLMgenerated Text Attribution [Yang et al., 2023c;Crothers et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 5.1 Problem Definition
What the sources say
- Not matchedcites Yang et al., 2023c
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites Crothers et al., 2023 sourceExperimental — accuracy not yet measured
The Definition and Scope section defines machine-generated text as text produced, modified, or extended by a machine. Section IV describes detection as distinguishing machine-generated from human text, and Section V-B discusses attribution to a generative model. The paper uses the broader category “machine-generated text,” however; it does not categorize all such text as LLM-generated. (LLM, conf=0.86)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Some studies have formulated a seven-class classification that includes one human class and six LLM classes [He et al., 2023;Wang et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 4.2 Methodologies
What the sources say
- Not matchedcites He et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Wang et al., 2024 source
Section 5.3, “Multi-way Detection,” explicitly describes Task 2 as seven-label classification and lists one human class and six LLM classes. This matches the classification attributed to Wang et al. (2024). (LLM, conf=0.95)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Models like DNA-GPT [Yang et al., 2023a] and DetectGPT [Mitchell et al., 2023] utilized the T5 model [Raffel et al., 2020] to simulate scenarios in which humans modify LLMgenerated texts.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 5.2 Methodologies
What the sources say
- Not matchedcites Yang et al., 2023a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Mitchell et al., 2023 source
Section 5.2 states that DetectGPT's authors simulated human revision of machine-generated text by replacing word spans with T5-3B samples. This supports the claim as it pertains to DetectGPT; the separate citation to DNA-GPT is not assessed here. (LLM, conf=0.95)
- Not matchedcites Raffel et al., 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“In human authorship attribution, where there are a large number of candidate authors, retrieval metrics such as Mean Reciprocal Rank (MRR) and recall-at-k are used [Rivera-Soto et al., 2021].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.2 Evaluation Metrics
What the sources say
- Supportedcites Rivera-Soto et al., 2021 source
The Experiments metrics passage, following §3.3, explicitly says the paper assesses performance with recall-at-8 and mean reciprocal rank (MRR). The Introduction describes its setting as open-world, with several orders of magnitude more authors than a 21-author study, supporting the large-candidate context. (LLM, conf=0.94)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The increasingly large context length of LLMs enables in-context learning (ICL) [Brown et al., 2020] by incorporating more documents, enhancing the model's ability to capture intricate writing patterns.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 7.5 Leveraging LLM Capabilities
What the sources say
- Partly supportedcites Brown et al., 2020 sourceExperimental — accuracy not yet measured
The Introduction (p. 5) describes in-context learning with as many demonstrations as fit in the model’s context window, and §3.7 (p. 20) reports improved performance with more examples in context. These passages support the role of context capacity in ICL, but they do not establish that incorporating more documents enhances the model’s ability to capture intricate writing patterns. (LLM, conf=0.85)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The challenge remains to provide higher-level explainability that aligns with human cognitive processes [Rudin, 2019].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 7.3 Explainability
What the sources say
- Supportedcites Rudin, 2019 source
In ‘Challenge #3’ (page unavailable), Rudin frames interpretability around how people explain their reasoning in visual classification and calls for models that reason about image parts so their explanations reflect the decision process. The Introduction also relates interpretable model design to limits on human cognitive capacity. This supports the claim’s broad point, though Rudin advocates inherently interpretable models rather than post-hoc explanations of black boxes. (LLM, conf=0.85)
Strength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Advanced techniques are required to dissect these integrations, identifying where and how the contributions of LLM intersect with human input [Wang et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 5.3 Open Challenges
What the sources say
- Supportedcites Wang et al., 2024 source
Section 3.3, “Boundary Identification,” describes detecting where human-written text changes to LLM-generated text. The Limitations section says real mixed texts can be more complicated and calls for methods that detect mixed text and identify all changing points, supporting the claim’s need for more capable techniques. (LLM, conf=0.88)
Strength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Models like BERT and RoBERTa have shown limitations in cross-domain tasks [Barlas and Stamatatos, 2020b;Huertas-Tato et al., 2022], and adapting models to new domains remains difficult due to factors like dataset size variability and writing styles.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 7.2 Generalization
What the sources say
- Not matchedcites Barlas and Stamatatos, 2020b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites Huertas-Tato et al., 2022 sourceExperimental — accuracy not yet measured
Section 2.1 (p. 3) says adaptation to new domains is usually hard and identifies variation in document size and style; Section 5.2 (p. 8) shows the RoBERTa baseline underperforming other models on out-of-domain authorship tasks. The paper does not establish a cross-domain limitation for BERT specifically, and its discussion of varying size concerns documents rather than explicitly identifying variability in dataset size as a cause of adaptation difficulty. (LLM, conf=0.84)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The Linguistic Inquiry and Word Count (LIWC) tool exemplifies how automated text analysis can use more than 100 psychological dimensions to analyze word use, reflecting distinct language variations among different groups in specific genres and languages [Goldstein-Stewart et al., 2009;Pennebaker et al., 2015;Dudău and Sava, 2021].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 7.7 Integrating Interdisciplinary Perspectives
What the sources say
- Not checked — no full text of the sourcecites Goldstein-Stewart et al., 2009 source
- Not matchedcites Pennebaker et al., 2015
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites Dudău and Sava, 2021 sourceExperimental — accuracy not yet measured
The Introduction describes LIWC2015 as an automated word-counting tool with categories that include psychological constructs, and the Discussion reports differences among the languages studied. But the Introduction says it has approximately 90 categories in total—not more than 100 psychological dimensions—and the cited passages do not establish the claim about variations among groups in specific genres. (LLM, conf=0.88)
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The challenge in social media stems from the brief nature of posts and a large pool of potential authors, making the attribution of short documents particularly difficult [Aborisade and Anwar, 2018;Seroussi et al., 2014;Theophilo et al., 2021].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.1 Benchmarks and Datasets
What the sources say
- Not checked — no full text of the sourcecites Aborisade and Anwar, 2018 source
- Supportedcites Seroussi et al., 2014 source
The Abstract states that attributing online texts such as blogs and e-mails is more challenging than attributing traditional texts because they tend to be short and have more candidate authors. The Related Work section likewise identifies many candidate authors and short e-mails as challenges. (LLM, conf=0.94)
- Not checked — no full text of the sourcecites Theophilo et al., 2021 source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Misattribution can lead to wrongful accusations or misinterpretation of an author's intent [Lund et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 8. ETHICAL AND PRIVACY CONCERNS
What the sources say
- Could not verifycites Lund et al., 2023 sourceExperimental — accuracy not yet measured
The 'Authorship attribution is a major issue' section discusses ownership, plagiarism, and the difficulty of tracing sources in AI-generated text (page unavailable). Searches for wrongful accusations and misinterpretation of an author's intent found no passage addressing either consequence. (LLM, conf=0.72)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Could not verify
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“For instance, Kowalczyk et al. [2022] detected GPT-2-generated fake reviews using Shapley Additive Explanations (SHAP) [Lundberg and Lee, 2017].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 7.3 Explainability
What the sources say
- Not checked — no full text of the sourcecites Kowalczyk et al., 2022 source
- Supportedcites Lundberg and Lee, 2017 source
The Abstract (p. 1) identifies SHAP as “SHapley Additive exPlanations” and describes it as a framework for interpreting model predictions. The citation to Lundberg and Lee identifies the method named in the sentence; the fake-review study is attributed separately to Kowalczyk et al. (LLM, conf=0.94)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although many of these detectors claim over 99% accuracy in detecting LLM-generated text, few are tested on shared benchmark datasets.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.1 Benchmarks and Datasets
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
- Rests on an assumption: Despite their high accuracy claims, many detectors suffer from high false positive rates, which could falsely accuse individuals of plagiarism and undermine credibility and trust in genuine authors.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These detectors are primarily designed for LLM-generated text detection (Problem 2).”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.1 Benchmarks and Datasets
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, fewer support LLM-generated text attribution (Problem 3) and Human-LLM Co-authored Text Attribution (Problem 4).”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.1 Benchmarks and Datasets
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Neural network-based detectors generally outperform metric-based methods in both human authorship attribution and LLM-generated text detection problems [He et al., 2023;Zhang et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 1. INTRODUCTION
What the sources say
- Not matchedcites He et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Zhang et al., 2024 source
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Not matched
In the paper
“Chakraborty et al. [2023a] employed theoretical analysis to argue that detecting LLM-generated text is nearly always feasible with the collection of multiple samples, and they established precise sample complexity bounds for this detection.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2 Methodologies
What the sources say
- Not matchedcites Chakraborty et al., 2023a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
In the paper
“LLM-generated texts are typically less emotional and more objective than human-written texts [Guo et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2.1 Featured-based Method
What the sources say
- Not checked — no full text of the sourcecites Guo et al., 2023 source
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“whereas deep learning methods demand significant computational resources and extensive labeled data, with the risk of catastrophic forgetting [Ramasesh et al., 2022].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.3 Open Challenges
What the sources say
- Not matchedcites Ramasesh et al., 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, these neural network approaches often offer less explainability compared to their metric-based counterparts.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 1. INTRODUCTION
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“The rapid evolution of LLMs further complicates detection, as newer versions exhibit different stylistic characteristics, making detection models quickly obsolete [Chakraborty et al., 2023b].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.3 Open Challenges
What the sources say
- Not matchedcites Chakraborty et al., 2023b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Not matched
In the paper
“Barlas and Stamatatos [2020a] found that BERT performed well with large vocabularies, outperforming multi-headed RNNs.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.3 Pre-trained Language Models
What the sources say
- Not matchedcites Barlas and Stamatatos, 2020a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
In the paper
“Unlike BERT-based models, which require computationally expensive fine-tuning and large amounts of domain-specific data for optimal performance, LLMs can generalize across various domains without fine-tuning, thereby mitigating issues related to domain specificity [Barlas and Stamatatos, 2020a].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.4 LLM-based Methods
What the sources say
- Not matchedcites Barlas and Stamatatos, 2020a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Not matched
In the paper
“Collaborative texts, which blend multiple writing styles, further mask individual contributions and obscure distinct authorial signals [Dauber et al., 2017].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.3 Open Challenges
What the sources say
- Not checked — no full text of the sourcecites Dauber et al., 2017 source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“Traditionally, LLMs have been employed mainly for auxiliary tasks such as feature extraction and data annotation [Patel et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.4 LLM-based Methods
What the sources say
- Not checked — no full text of the sourcecites Patel et al., 2023 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These methods do not require hand-crafted features but require substantial training time and domain-specific labeled data, struggling with cross-domain generalization and explainability.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.3 Pre-trained Language Models
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The natural language understanding capability allows LLMs to recognize nuances, styles, and patterns in language, which are crucial for distinguishing between authors.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.4 LLM-based Methods
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
In the paper
“LLMs are also effective with shorter texts, reducing the necessity for long inputs to derive meaningful representations [Eder, 2015].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.2.4 LLM-based Methods
What the sources say
- Not checked — no full text of the sourcecites Eder, 2015 source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“Zero-shot detection methods are generally statistics-based, enabling the detection of LLM-generated text without additional training [Su et al., 2023b].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2.3 Zero-Shot Detectors
What the sources say
- Not matchedcites Su et al., 2023b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This attribution task extends beyond binary classification to handle multiple classes, increasing the complexity of LLMgenerated text detection.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 4.1 Problem Definition
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“In contrast, LLMgenerated texts typically exhibit consistent syntax and a broader vocabulary [Guo et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 5.3 Open Challenges
What the sources say
- Not checked — no full text of the sourcecites Guo et al., 2023 source
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally, LLMs may inadvertently reproduce snippets of their training data.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 4.2 Methodologies
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Feature-based methods are more explainable but have drawbacks, such as poor generalizability of certain features across different domains and sampling methods.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2.1 Featured-based Method
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“For instance, a 10-class classification might include seven human classes and three LLM classes [Tripto et al., 2023].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 4.2 Methodologies
What the sources say
- Not checked — no full text of the sourcecites Tripto et al., 2023 source
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“These texts may begin as human drafts that are later extended or revised by LLMs, or vice versa, resulting in an integration of styles that obscures authorial markers [Liu et al., 2023b].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 5.3 Open Challenges
What the sources say
- Not matchedcites Liu et al., 2023b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Attributing texts to LLMs versus human writers involves recognizing inherent differences in their text generation capabilities.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 4.2 Methodologies
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“As a result, the detection of LLM-generated text has garnered significant attention [Kumarage and Liu, 2023;Tang et al., 2023a;Wu et al., 2023b;Yang et al., 2023c].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3. LLM-GENERATED TEXT DETECTION
What the sources say
- Not checked — no full text of the sourcecites Kumarage and Liu, 2023 source
- Not matchedcites Tang et al., 2023a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Wu et al., 2023b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Transformer-based models, such as BERT and RoBERTa, are fine-tuned on datasets containing both human-written and LLM-generated texts to conduct the attribution.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 4.2 Methodologies
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally, LLMs can be misused to generate content that conceals true authorship by mimicking others or using LLMs to alter their work.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.3 Open Challenges
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This variability complicates authorship attribution, necessitating the identification of consistent and unique stylistic markers.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 2.3 Open Challenges
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
In the paper
“Variations in training data, model architecture, and fine-tuning processes contribute to the distinctive outputs of different LLMs, though these differences are often subtle and difficult to detect [Uchendu et al., 2021].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 4.3 Open Challenges
What the sources say
- Not checked — no full text of the sourcecites Uchendu et al., 2021 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“LLM-generated text detectors can be categorized into metricbased and model-based methods [He et al., 2023], which are further divided into feature-based, neural network-based, zero-shot-based, and watermark-based methods.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2 Methodologies
What the sources say
- Not matchedcites He et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Watermarking-based methods typically fall under the white-box detection category, while proprietary models are restricted to black-box methods.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2 Methodologies
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“MIXSET [Zhang et al., 2024] offers a more comprehensive dataset that includes text refined by LLMs through polishing, completion, and rewriting operations.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 5.2 Methodologies
What the sources say
- Not checked — no full text of the sourcecites Zhang et al., 2024 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“LLM-generated text attribution builds upon techniques for LLM-generated text detection.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 4. LLM-GENERATED TEXT ATTRIBUTION
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“These detectors are also classified as white-box or black-box, depending on their access to the LLM weights [Tang et al., 2023b;Yang et al., 2023c].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 3.2 Methodologies
What the sources say
- Not matchedcites Tang et al., 2023b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Yang et al., 2023c
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
In the paper
“Moreover, leveraging LLMs for data augmentation and synthetic data generation can create diverse training datasets, which in turn improves the generalization of attribution models [Albalak et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 7.5 Leveraging LLM Capabilities
What the sources say
- Not checked — no full text of the sourcecites Albalak et al., 2024 source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“Factors influencing the performance of existing authorship attribution models include the size of the training text [Hirst and Feiguina, 2007;Marton et al., 2005], the number of candidate authors [Koppel et al., 2006], and the imbalanced distribution of training texts among candidate authors [Stamatatos, 2008].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.1 Benchmarks and Datasets
What the sources say
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“Some detectors like GPTZero [Tian and Cui, 2023] can also detect human-LLM co-authored text and identify portions likely to be LLM-generated, addressing the boundary detection sub-problem of Problem 4 [Cutler et al., 2021].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.1 Benchmarks and Datasets
What the sources say
- Not matchedcites Tian and Cui, 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Cutler et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This involves detecting subtle shifts in style and contextual cues that indicate the extent of LLM involvement, allowing for accurate segmentation and attribution of authorship within hybrid documents.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 5.3 Open Challenges
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“Authorship attribution is inherently multidisciplinary, encompassing elements of linguistics, computer science, forensic science, and psychology [Stamatatos, 2009].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 7.7 Integrating Interdisciplinary Perspectives
What the sources say
- Not checked — no full text of the sourcecites Stamatatos, 2009 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Additionally, Self-BLEU are useful metrics, with a lower score indicating higher textual diversity [Zhang et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.2 Evaluation Metrics
What the sources say
- Not checked — no full text of the sourcecites Zhang et al., 2024 source
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“For example, tweets are limited to 280 characters, whereas legal judgment documents contain thousands of words [Seroussi et al., 2011].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.1 Benchmarks and Datasets
What the sources say
- Not matchedcites Seroussi et al., 2011
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Since Problems 2, 3, and 4 frequently treat human-written text as a single category for simplicity, rather than identifying individual authors as in Problem 1, many of these datasets are unsuitable for Problem 1, which requires unique author identification.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.1 Benchmarks and Datasets
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Combining these interdisciplinary perspectives enhances our ability to distinguish between human-and machine-generated texts, addressing the emerging challenges posed by sophisticated language models.”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 7.7 Integrating Interdisciplinary Perspectives
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
In the paper
“Additionally, these detectors often lack robustness against variations in sampling strategies, adversarial attacks, and unseen domains and language models [Dugan et al., 2024].”
§ Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges > 6.1 Benchmarks and Datasets
What the sources say
- Not checked — no full text of the sourcecites Dugan et al., 2024 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper relies on this without support.
The proprietary nature of many LLMs restricts access to comparative data, posing significant hurdles.
“However, the proprietary nature of many LLMs restricts access to comparative data, posing significant hurdles.”
The paper relies on this without support.
The high degree of stylistic overlap among LLMs, especially those with similar architectures or trained on overlapping datasets, further complicates accurate classification.
“Additionally, the high degree of stylistic overlap among LLMs, especially those with similar architectures or trained on overlapping datasets, further complicates accurate classification.”
The paper relies on this without support.
Hybrid texts may originate as human-written content, with LLMs employed for conditional generation, making it difficult to clearly distinguish between the stylistic features of human and machine contributions.
“Hybrid texts may originate as human-written content, with LLMs employed for conditional generation, making it difficult to clearly distinguish between the stylistic features of human and machine contributions.”
The paper relies on this without support.
There are fewer studies on human-LLM co-authored text attribution due to its difficulty, and existing research often makes simplifications.
“There are fewer studies on this task due to its difficulty, and existing research often makes simplifications.”
The paper relies on this without support.
The complexity of human-LLM co-authored text attribution increases as users may employ multiple LLMs to compose different sections of an article, further blurring the lines between human and machine-generated content.
“The complexity of this task increases as users may employ multiple LLMs to compose different sections of an article, further blurring the lines between human and machine-generated content.”
The paper relies on this without support.
Analyzing and classifying texts co-authored by humans and LLMs presents a significant challenge due to the blending of human and machine stylistic features.
“Analyzing and classifying texts co-authored by humans and LLMs presents a significant challenge due to the blending of human and machine stylistic features.”
The paper relies on this without support.
Human-LLM co-authored texts often start as human drafts and are later extended or revised by LLMs, or the process might occur in reverse.
“These texts often start as human drafts and are later extended or revised by LLMs, or the process might occur in reverse.”
The paper relies on this without support.
The integration of styles in human-LLM co-authored texts creates a hybrid form that makes it difficult to distinguish distinct authorial markers, thereby complicating the attribution process.
“This integration of styles creates a hybrid form that makes it difficult to distinguish distinct authorial markers, thereby complicating the attribution process.”
The paper relies on this without support.
Human-LLM co-authored texts pose a more intricate challenge due to the blending of stylistic and linguistic elements from both human authors and LLMs.
“Human-LLM co-authored texts pose a more intricate challenge due to the blending of stylistic and linguistic elements from both human authors and LLMs.”
The paper relies on this without support.
Manually collecting authorship data is time-consuming and costly, motivating researchers to utilize web data sources such as Wikipedia and Reddit.
“Manually collecting data is time-consuming and costly, motivating researchers to utilize web data sources such as Wikipedia and Reddit.”
The paper relies on this without support.
Custom datasets for LLM-generated text are easier and more affordable to create, and are often built alongside human-written text to maintain a similar domain and format.
“In contrast, custom datasets for LLM-generated text are easier and more affordable to create, and are often built alongside human-written text to maintain a similar domain and format.”
The paper relies on this without support.
LLM-generated and human-written texts are often disproportionate, making class imbalance a crucial issue.
“Addressing class imbalance is crucial, as LLM-generated and human-written texts are often disproportionate.”
The paper relies on this without support.
The rapid growth of online communication has led to shifts in writing behavior, resulting in shorter, fragmented, and less coherent social media tweets and text messages.
“However, the rapid growth of online communication has also led to shifts in writing behavior, resulting in shorter, fragmented, and less coherent social media tweets and text messages.”
The paper relies on this without support.
Despite their high accuracy claims, many detectors suffer from high false positive rates, which could falsely accuse individuals of plagiarism and undermine credibility and trust in genuine authors.
“Despite their high accuracy claims, many detectors suffer from high false positive rates, which could falsely accuse individuals of plagiarism and undermine credibility and trust in genuine authors.”
The paper relies on this without support.
Current authorship attribution methods face limitations when handling a more extensive range of candidate human authors or LLMs.
“Current authorship attribution methods face limitations when handling a more extensive range of candidate human authors or LLMs, presenting opportunities for future research.”
The paper relies on this without support.
Existing approaches for LLM-generated Text Attribution typically manage only a limited number of authors or models, which restricts their applicability in real-world scenarios where the pool of potential authors or models can be vast.
“For instance, existing approaches for LLM-generated Text Attribution typically manage only a limited number of authors or models, which restricts their applicability in real-world scenarios where the pool of potential authors or models can be vast.”
The paper relies on this without support.
Domain generalization poses significant challenges due to variability in vocabularies, syntax, and styles across different subjects, complicating accurate authorship attribution.
“Domain generalization poses significant challenges due to variability in vocabularies, syntax, and styles across different subjects, complicating accurate authorship attribution.”
The paper relies on this without support.
Authors' adaptation to various genres dilutes their identifiable stylistic traits, complicating attribution.
“Authors' adaptation to various genres dilutes their identifiable stylistic traits, complicating attribution.”
The paper relies on this without support.
Traditional attribution methods struggle to distinguish between human-authored texts and those generated by LLMs, which adeptly replicate these features.
“Traditional attribution methods, which rely on stylistic and linguistic features to identify an author, struggle to distinguish between human-authored texts and those generated by LLMs, which adeptly replicate these features.”
The paper relies on this without support.
The diversity in datasets and evaluation metrics currently hinders the comparability and generalizability of different authorship attribution methods.
“The diversity in datasets and evaluation metrics currently hinders the comparability and generalizability of different authorship attribution methods.”
The paper relies on this without support.
Authorship attribution techniques are essential in digital forensics, cybersecurity, and plagiarism detection.
“Authorship attribution techniques are essential in digital forensics, cybersecurity, and plagiarism detection.”
The paper relies on this without support.
The attribution of text to specific authors or models raises significant ethical and privacy issues.
“The attribution of text to specific authors or models raises significant ethical and privacy issues.”
The paper relies on this without support.
The potential to reveal the identities of anonymous authors presents significant ethical challenges.
“However, the potential to reveal the identities of anonymous authors presents significant ethical challenges.”
The paper relies on this without support.
Applications such as linking user accounts across platforms and identifying compromised accounts raise privacy concerns and ethical questions about surveillance and profiling individuals based on their writing style.
“Applications such as linking user accounts across platforms and identifying compromised accounts raise privacy concerns and ethical questions about surveillance and profiling individuals based on their writing style.”
The paper relies on this without support.
Despite existing measures to prohibit the unethical use of LLMs, these restrictions could be evaded through prompt engineering and jail-breaking, posing risks of phishing and fraud scams.
“Despite existing measures to prohibit the unethical use of LLMs, these restrictions could be evaded through prompt engineering and jail-breaking, posing risks of phishing and fraud scams.”
The paper relies on this without support.
The increasing difficulty in distinguishing between human and LLM-generated content raises concerns about intellectual property, plagiarism, and accountability.
“Furthermore, the increasing difficulty in distinguishing between human and LLM-generated content raises concerns about intellectual property, plagiarism, and accountability.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Opposing claims about LLM vocabulary diversity
MinorOne section says LLM-generated text has greater vocabulary breadth than human writing, while another says humans have greater lexical diversity than LLMs. The text does not explain how these opposing comparisons fit together.
“In contrast, LLMgenerated texts typically exhibit consistent syntax and a broader vocabulary [Guo et al., 2023].”
“Human-authored texts tend to be more coherent and exhibit greater lexical diversity compared to LLM-generated texts [Guo et al., 2023;Dugan et al., 2023;Zhang et al., 2024].”
Corpus citation points to a different work
MinorThe entry cited for the Aston 100 Idiolects Corpus is titled as a paper about GPTZero detection, not the described corpus.
“• Aston 100 Idiolects Corpus [Heini and Kredens, 2021]: Comprising emails, essays, text messages, and business memos from 100 individuals (ages 18-22, native English speakers), this corpus provides a broad spectrum of text types for analyzing both content and stylistic features.”
“78. Pezik-P. Heini, A. and K. Kredens. 2021. GPTZero: To- wards detection of AI-generated text using zero-shot and supervised methods. http://fold.aston.ac.uk/handle/ 123456789/17”
Citations
Cites
Items 201–212 of 212
Automatic Detection of Chinese Generated Essayss Based on Pre-trained BERT
Chen, X., Jin, P., Jing, S., & Xie, C. (2022) · IEEE Joint International Information Technology and Artificial Intelligence Conference (ITAIC) · doi:10.1109/itaic54216.2022.9836571 · Cited by 3 · cited 1×
“Finally, improving attribution in multilingual contexts enables models to operate effectively across various languages (Chen et al., 2022, Shamardina et al., 2022).”
Exploring Semantic Perturbations on GroverPreprint
Ji, Z., Kulkarni, P., Neskovic, M., Nolan, K., & Xu, Y. L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.00509 · Cited by 3 · cited 2×
“These texts may begin as human drafts later extended or revised by LLMs, or vice versa, resulting in an integration of styles that obscures distinct authorial markers (Liu et al., 2023a).”
ConDA: Contrastive Domain Adaptation for AI-generated Text Detection
Bhattacharjee, A., Kumarage, T., Moraffah, R., & Liu, H. (2023) · arXiv · doi:10.48550/arxiv.2309.03992 · Cited by 3
SemStamp: A semantic watermark with paraphrastic robustness for text generation
Hou, A. B., Zhang, J., He, T., Wang, Y., Chuang, Y.-S., Wang, H., Shen, L., Van Durme, B., Khashabi, D., & Tsvetkov, Y. (2023) · arXiv · doi:10.48550/arxiv.2310.03991 · Cited by 3
(2017) · doi:10.9728/dcs.2024.25.7.1847 · Cited by 2 · cited 1×
“For instance, Kowalczyk et al. (2022) detected GPT-2-generated fake reviews using Shapley Additive Explanations (SHAP) (Lundberg and Lee, 2017).”
Neural Authorship Attribution: Stylometric Analysis on Large Language ModelsPreprint
Kumarage, T., & Liu, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.07305 · Cited by 2
RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors
Dugan, L., Hwang, A., Trhlik, F., Ludan, J. M., Zhu, A., Xu, H., Ippolito, D., & Callison-Burch, C. (2024) · arXiv · doi:10.48550/arxiv.2405.07940 · Cited by 1 · cited 4×
“As detection methods advance, adversarial attacks also evolve to bypass these measures, creating a continuous cycle of challenge and response in the quest to distinguish and disguise authorship (Dugan et al., 2024).”
Influential(2021) · doi:10.7287/peerj-cs.443v0.1/reviews/1 · cited 1×
“Similar to the problem of human authorship attribution, linguistic features such as phrasal verbs, coreference, part-of-speech (POS) tags, and named entity (NE) tags are also useful in distinguishing LLM-generated text (Fröhling and Zubiaga, 2021, Nguyen-Son et al., 2017, See et al., 2019).”
Automatic Authorship Analysis in Human-AI Collaborative Writing
Richburg, A., Bao, C., & Carpuat, M. (2024) · Proceedings of the Language Resources and Evaluation Conference · doi:10.63317/3zc23owwkofd · cited 2×
“Despite existing measures to prohibit the unethical use of LLMs, these restrictions could be evaded through prompt engineering and jail-breaking, posing risks of phishing and fraud scams.”
Token Prediction as Implicit Classification to Identify LLM-Generated Text
Chen, Y., Kang, H., Zhai, V., et al. (2023) · arXiv · doi:10.48550/arxiv.2311.08723
MULTITuDE: Large-Scale Multilingual Machine-Generated Text Detection Benchmark
Macko, D., Moro, R., Uchendu, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.13606
Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russian
Shamardina, T., Mikhailov, V., Chernianskii, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.01583
Flagged first, then by citations
Research works printed but not linked: 20
- [7]7. Shlomo Argamon. 2018. Computational forensic author- ship analysis: Promises and pitfalls. Language and Law/Linguagem e Direito 5, 2 (2018), 7-37.
- [16]16. Georgios Barlas and Efstathios Stamatatos. 2020b. Cross- domain authorship attribution using pre-trained language models. In Artificial Intelligence Applications and Innova- tions: 16th IFIP WG 12.5 International Conference, AIAI 2020, Neos Marmaras, Greece, June 5-7, 2020, Proceed- ings, Part I 16. Springer, 255-266.
- [54]54. Maël Fabien, Esau Villatoro-Tello, Petr Motlicek, and Shan- tipriya Parida. 2020. BertAA : BERT fine-tuning for Authorship Attribution. In Proceedings of the 17th In- ternational Conference on Natural Language Processing (ICON). NLP Association of India (NLPAI), Indian Insti- tute of Technology Patna, Patna, India, 127-137. https: //aclanthology.org/2020.icon-main.16
- [58]58. Rinaldo Gagiano, Maria Myung-Hee Kim, Xiuzhen Zhang, and Jennifer Biggs. 2021. Robustness Analysis of Grover for Machine-Generated News Detection. In Proceedings of the The 19th Annual Workshop of the Australasian Language Technology Association. Australasian Language Technology Association, Online, 119-127. https://aclanthology. org/2021.alta-1.12
- [90]90. Ganesh Jawahar, Muhammad Abdul-Mageed, and Laks Lakshmanan, V.S. 2020b. Automatic Detection of Ma- chine Generated Text: A Critical Survey. In Proceed- ings of the 28th International Conference on Computa- tional Linguistics. International Committee on Computa- tional Linguistics, Barcelona, Spain (Online), 2296-2309. https://doi.org/10.18653/v1/2020.coling-main.208 · DOI · Paper page
- [94]94. Prannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna, Yonglong Tian, Phillip Isola, Aaron Maschinot, Ce Liu, and Dilip Krishnan. 2020. Supervised Contrastive Learn- ing. In Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin (Eds.). https://proceedings.neurips.cc/paper/2020/hash/ d89a66c7c80a29b1bdbab0f2a1a94af8-Abstract.html
- [99]99. Moshe Koppel, Jonathan Schler, and Eran Messeri. 2008. Au- thorship attribution in law enforcement scenarios. NATO Security Through Science Series D-Information and Com- munication Security 15 (2008), 111.
- [108]108. Thomas Lavergne, Tanguy Urvoy, and François Yvon. 2008. Detecting Fake Content with Relative Entropy Scoring. Pan 8, 27-31 (2008), 4.
- [123]123. David Madigan, Alexander Genkin, David D Lewis, Shlomo Argamon, Dmitriy Fradkin, and Li Ye. 2005b. Author identification on the large scale. In Proceedings of the 2005 Meeting of the Classification Society of North America (CSNA).
- [127]127. Rohith Menon and Yejin Choi. 2011. Domain Independent Authorship Attribution without Domain Adaptation. In Proceedings of the International Conference Recent Ad- vances in Natural Language Processing 2011. Association for Computational Linguistics, Hissar, Bulgaria, 309-315. https://aclanthology.org/R11-1043
- [145]145. Jiameng Pu, Zain Sarwar, Sifat Muhammad Abdullah, Ab- dullah Rehman, Yoonjin Kim, Parantapa Bhattacharya, Mobin Javed, and Bimal Viswanath. 2023a. Deepfake text detection: Limitations and opportunities. In 2023 IEEE Symposium on Security and Privacy (SP). IEEE, 1613-1630.
- [150]150. Vinay Venkatesh Ramasesh, Aitor Lewkowycz, and Ethan Dyer. 2022. Effect of scale on catastrophic forgetting in neural networks. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net. https://openreview. net/forum?id=GhVS8_yPeEa
- [155]155. Juan Rodriguez, Todd Hay, David Gros, Zain Shamsi, and Ravi Srinivasan. 2022b. Cross-Domain Detection of GPT-2-Generated Technical Text. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Seattle, United States, 1213-1233. https: //doi.org/10.18653/v1/2022.naacl-main.88 · DOI · Paper page
- [163]163. Jonathan Schler, Moshe Koppel, Shlomo Argamon, and James W Pennebaker. 2006. Effects of age and gender on blogging.. In AAAI spring symposium: Computational approaches to analyzing weblogs, Vol. 6. 199-205.
- [168]168. Seroussi, Russell Smyth, and Ingrid Zukerman. 2011. Ghosts from the high court's past: Evidence from compu- tational linguistics for Dixon ghosting for Mctiernan and rich. University of New South Wales Law Journal, The 34, 3 (2011), 984-1005.
- [174]174. Prasha Shrestha, Sebastian Sierra, Fabio González, Manuel Montes, Paolo Rosso, and Thamar Solorio. 2017b. Con- volutional Neural Networks for Authorship Attribution of Short Texts. In Proceedings of the 15th Conference of the European Chapter of the Association for Computa- tional Linguistics: Volume 2, Short Papers. Association for Computational Linguistics, Valencia, Spain, 669-674. https://aclanthology.org/E17-2106
- [190]190. Jinyan Su, Terry Yue Zhuo, Di Wang, and Preslav Nakov. 2023c. Detectllm: Leveraging log rank information for zero- shot detection of machine-generated text. ArXiv preprint abs/2306.05540 (2023). https://arxiv.org/abs/2306. 05540 · arXiv
- [192]192. Kalaivani Sundararajan and Damon Woodard. 2018. What represents "style" in authorship attribution?. In Proceed- ings of the 27th International Conference on Computa- tional Linguistics. Association for Computational Linguis- tics, Santa Fe, New Mexico, USA, 2814-2822. https: //aclanthology.org/C18-1238
- [194]194. Ruixiang Tang, Yu-Neng Chuang, and Xia Hu. 2023b. The science of detecting llm-generated texts. ArXiv preprint abs/2303.07205 (2023). https://arxiv.org/abs/2303. 07205 · arXiv
- [216]216. Xianjun Yang, Wei Cheng, Yue Wu, Linda Petzold, William Yang Wang, and Haifeng Chen. 2023b. Dna-gpt: Divergent n-gram analysis for training-free detection of gpt-generated text. ArXiv preprint abs/2305.17359 (2023). https://arxiv.org/abs/2305.17359 · arXiv
Cited by
Sorted by citations
Artificial Intelligence and the Psychology of Human Connection
Boyd, R. L., & Markowitz, D. M. (2026) · Perspectives on Psychological Science · doi:10.1177/17456916251404394 · Cited by 78
“Prior work has shown that people often misattribute authorship— mistaking AI-generated writing for human writing, or vice versa—on the basis of subtle stylistic cues (Gunser et al., 2021; B. Huang et al., 2025; Köbis & Mossink, 2021).”
Advancements in AI-Generated Content Forensics: A Systematic Literature Review
Xu, Q., Mu, W., Li, J., Sun, T., & Jiang, X. (2025) · ACM Computing Surveys · doi:10.1145/3760526 · Cited by 19
“Beyond binary detection, a more profound challenge is model attribution–accurately identifying the source model of a piece of content [260].”
Auditing the Shadows: A Review of Methods to Detect Shared Training Data in Large Language Models
Naser, M. Z. (2025) · ACM Computing Surveys · doi:10.1145/3774897 · Cited by 7
“Each methodology is distinguished by its underlying assumptions about how training data manifests in learned parameters and by the computational strategies they employ to isolate signals that reliably indicate the presence of shared textual fragments [ 68 –70 ].”
Distinguishing AI-Generated and Human-Written Text Through Psycholinguistic Analysis
Opara, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98462-4_27 · Cited by 3
Authorship Drift: How Self-Efficacy and Trust Evolve During LLM-Assisted Writing
Park, Y. S., Arvi, N. A. P., Kim, S., & Kim, J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790276 · Cited by 8
Metadata
- Authors
- Huang, B., Chen, C., & Shu, K.
- Affiliations
- Illinois Institute of Technology (US)
- Emory University (US)
- Venue
- ACM SIGKDD Explorations Newsletter
- Published
- 2025-01-21
- Volume
- 26
- Issue
- 2
- Pages
- 21-43
- ISSN
- 1931-0145 (ISSN-L)
- 1931-0153
- PMC
- PMC12019761
- OpenAlex
- W4406939734
- Cited by
- 42
- References
- 209
- Citations by year
- 2026: 28 · 2025: 14
- FWCI
- 16.71
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM SIGKDD Explorations Newsletter (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (2346158, 2241068, 2339198)
- U.S. Department of Homeland Security (17STQAC00001-07-04)
- Cisco Systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- authorship attribution, large language models, AI-generated text detection, misinformation, plagiarism detection, forensic investigation, explainability, domain generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review