Cited by 45Authorship Attribution and ProfilingTopic ModelingNatural Language Processing Techniques

Cross-domain detection of GPT-2-generated technical text

Open access
Rodriguez, Juan, Hay, Todd, Gros, David, Shamsi, Zain, Srinivasan, Ravi·2022·Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies

Abstract

Juan Rodriguez, Todd Hay, David Gros, Zain Shamsi, Ravi Srinivasan. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2022.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18653/v1/2022.naacl-main.88

Cites

57 of 58 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • These vulnerabilities can undermine technical expertise.

    “undermine technical expertise (Rodriguez et al. 2022a; Aliman and Kester 2021)”

    From A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions (2025) · cites this paper as Rodriguez et al. 2022a

    The Abstract says convincing synthetic text can undermine genuine research, and the Introduction says synthetic technical texts could hinder the scientific process. Those passages support a threat to scientific work, but they do not specifically say that technical expertise itself is undermined. (LLM, conf=0.78)

    Experimental — accuracy not yet measured
  • LLM-generated text detectors often struggle to generalize to unseen domains.

    “LLM-generated text detectors often struggle to generalize to unseen domains encountered during training [Pu et al., 2023b;Rodriguez et al., 2022b;Li et al., 2023a]”

    From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Rodriguez et al., 2022b

  • Detectors based on RoBERTa exhibit significant potential for robustness, requiring as few as a few hundred labels to fine-tune and deliver impressive results.

    “Despite this, detectors based on RoBERTa exhibit significant potential for robustness, requiring as few as a few hundred labels to fine-tune and deliver impressive results (Rodriguez et al. 2022b).”

    From A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions (2025) · cites this paper as Rodriguez et al. 2022b

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. Nadisha-Marie Aliman and Leon Kester. 2021. Epis- temic defenses against scientific and empirical ad- versarial AI attacks. In CEUR Workshop Proceed- ings, 2021 Workshop on Artificial Intelligence Safety, AISafety 2021, 19 August 2021 through 20 August 2021. CEUR-WS.
  2. Tomasz Darmetko. 2021. Fake or not? generating ad- versarial examples from language models. Under- graduate thesis, Maastricht University.
  3. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Lan- guage models are unsupervised multitask learners. OpenAI blog, 1(8):9.
  4. Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk, Ali Farhadi, Franziska Roesner, and Yejin Choi. 2019. Defending against neural fake news. In Advances in Neural Information Process- ing Systems 32: Annual Conference on Neural In- formation Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada.

Cited by

Sorted by citations

Authors
Rodriguez, J., Hay, T., Gros, D., Shamsi, Z., & Srinivasan, R.
Affiliations
  • University of California, Davis (US)
  • Applied Research Laboratories, The University of Texas at Austin (US)
Venue
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Published
2022
Pages
1213-1233
OpenAlex
W4287889356
Cited by
40
References
54
Citations by year
2026: 8 · 2025: 12 · 2024: 12 · 2023: 8
FWCI
4.42
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
GPT-2, AI-generated text detection, technical texts, cross-domain detection, large language models, text forgery detection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review