Cited by 37Misinformation and Its ImpactsSpam and Phishing DetectionTopic Modeling

Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformation

Open access
Lucas, Jason, Uchendu, Adaku, Yamashita, Michiharu, Lee, Jooyoung, Rohatgi, Shaurya, Lee, Dongwon·2023·Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

Abstract

Recent ubiquity and disruptive impacts of large language models (LLMs) have raised concerns about their potential to be misused (i.e., generating large-scale harmful and misleading content).To combat this emerging risk of LLMs, we propose a novel "Fighting Fire with Fire" (F3) strategy that harnesses modern LLMs' generative and emergent reasoning capabilities to counter human-written and LLM-generated disinformation.First, we leverage GPT-3.5-turbo to synthesize authentic and deceptive LLMgenerated content through paraphrase-based and perturbation-based prefix-style prompts, respectively.Second, we apply zero-shot incontext semantic reasoning techniques with cloze-style prompts to discern genuine from deceptive posts & news articles.In our extensive experiments, we observe GPT-3.5-turbo'szero-shot superiority for both in-distribution and out-of-distribution datasets, where GPT-3.5-turboconsistently achieved accuracy at 68-72%, unlike the decline observed in previous customized and fine-tuned disinformation detectors.Our codebase and dataset are available at https://github.com/mickeymst/F3.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18653/v1/2023.emnlp-main.883

Cites

68 of 69 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Methods for detecting hallucinations and evaluating their mitigation are themselves not foolproof.

    “methods for detecting hallucinations and evaluating their mitigation are themselves not foolproof.”

    From Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models (2024) · cites this paper as Lucas et al. 2023

    Appendix B.2 identifies limitations of statistical hallucination-detection methods, and Section 5.3.1 says overlapping metric scores make real and fake news difficult to distinguish. These passages support the point that detection is not foolproof, but the paper does not address whether methods for evaluating hallucination mitigation are reliable. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • Evaluation datasets and metrics may not always accurately reflect real-world performance reliability.

    “Evaluation datasets and metrics may not always accurately reflect real-world performance reliability (Ji, Lee, et al. 2023; Y. Zhang et al. 2023; Lucas et al. 2023).”

    From Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models (2024) · cites this paper as Lucas et al. 2023

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 5

  1. Angela D Evans and Kim P Roberts. 2009b. Can paraphrasing increase the amount and accuracy of reports from child eyewitnesses? "Psy- chology, Crime, & Law, 6, 531-546. DOI: 10.1080/10683160802385398". · DOI
  2. Martin Müller, Marcel Salathé, and Per E Kummervold. 2023. Covid-twitter-bert: A natural language pro- cessing model to analyse covid-19 content on twitter. Frontiers, 6:1023281. · DOI
  3. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9.
  4. Faisal Rahutomo, Teruaki Kitasuka, and Masayoshi Ar- itsugi. 2012. Semantic cosine similarity. In The 7th international student conference on advanced science and technology ICAST, volume 4, page 1.
  5. Xiaojuan Tang, Zilong Zheng, Jiaqi Li, Fanxu Meng, Song-Chun Zhu, Yitao Liang, and Muhan Zhang. 2023b. Large language models are in-context seman- tic reasoners rather than symbolic reasoners. arXiv preprint arXiv:2305.14825. · arXiv

Cited by

Sorted by citations

Authors
Lucas, J., Uchendu, A., Yamashita, M., Lee, J., Rohatgi, S., & Lee, D.
Affiliations
Pennsylvania State University (US)
Venue
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Published
2023
Pages
14279-14305
OpenAlex
W4389523840
Cited by
37
References
65
Citations by year
2026: 16 · 2025: 11 · 2024: 10
FWCI
34.36
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
  • Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University)
Funders
National Science Foundation (1820609, 1934782, 2114824, 2131144)
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
disinformation detection, large language models, GPT-3.5-turbo

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review