The DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Durably reducing conspiracy beliefs through dialogues with AI
Abstract
Conspiracy theory beliefs are notoriously persistent. Influential hypotheses propose that they fulfill important psychological needs, thus resisting counterevidence. Yet previous failures in correcting conspiracy beliefs may be due to counterevidence being insufficiently compelling and tailored. To evaluate this possibility, we leveraged developments in generative artificial intelligence and engaged 2190 conspiracy believers in personalized evidence-based dialogues with GPT-4 Turbo. The intervention reduced conspiracy belief by ~20%. The effect remained 2 months later, generalized across a wide range of conspiracy theories, and occurred even among participants with deeply entrenched beliefs. Although the dialogues focused on a single conspiracy, they nonetheless diminished belief in unrelated conspiracies and shifted conspiracy-related behavioral intentions. These findings suggest that many conspiracy theory believers can revise their views if presented with sufficiently compelling evidence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This supports the view that the power of AI debunking comes from the facts and evidence it provides (3, 4), rather than any special characteristics of, or attitudes towards AI or resistance to human-delivered information.”
From Dialogues with large language models reduce conspiracy beliefs even when the AI is perceived as human (2025) · cites this paper as [3]
In the citing paper
“Recent experiments have also shown that conversational generative AI fact-checking can yield positive outcomes (e.g., Costello et al. 2024; Lu 2025).”
From Generative AI and misinformation: a scoping review of the role of generative AI in the generation, detection, mitigation, and impact of misinformation (2026) · cites this paper as Costello et al. 2024
In the citing paper
“For example, while LLMs’ persuasive writing has been associated with deception (25, 52) and harmful outcomes (27), recent studies have shown that it can equally be used to dissuade users of their beliefs in conspiracy theories (153), or drive users’ willingness to make donations for positive outcomes (55).”
From The benefits and dangers of anthropomorphic conversational agents (2025) · cites this paper as [153]
In the citing paper
“Critically, however, AI-powered debunking experiments have thus far involved more than just facts—they also rely on messages expressly delivered by a large language model (LLM).”
From Dialogues with large language models reduce conspiracy beliefs even when the AI is perceived as human (2025) · cites this paper as [3]
In the citing paper
“Although conspiracy beliefs are often viewed as resistant to correction, recent evidence shows that personalized, fact-based dialogues with a large language model (LLM) can reduce them.”
From Dialogues with large language models reduce conspiracy beliefs even when the AI is perceived as human (2025) · cites this paper as [3]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
(1996) · Cited by 20,179
Petty, R. E., & Cacioppo, J. T. (1986) · doi:10.1007/978-1-4612-4964-1 · Cited by 5,219
Pennycook, G., & Rand, D. G. (2019) · Cognition · doi:10.1016/j.cognition.2018.06.011 · Cited by 2,022
Self-citationProceedings of the 2020 CHI Conference on Human Factors in Computing Systems
(2020) · doi:10.1145/3313831 · Cited by 1,951
Athey, S., Tibshirani, J., & Wager, S. (2019) · The Annals of Statistics · doi:10.1214/18-aos1709 · Cited by 1,870
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey
Min, B., Ross, H., Sulem, E., Veyseh, A. P. B., Nguyen, T. H., Sainz, O., Agirre, E., Heinz, I., & Roth, D. (2021) · arXiv · doi:10.48550/arxiv.2111.01243 · Cited by 1,387
Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey
Min, B., Ross, H., Sulem, E., Veyseh, A. P. B., Nguyen, T. H., Sainz, O., Agirre, E., Heintz, I., & Roth, D. (2024) · ACM Computing Surveys · doi:10.1145/3605943 · Cited by 1,387
The Psychology of Conspiracy Theories
Douglas, K. M., Sutton, R. M., & Cichocka, A. (2017) · Current Directions in Psychological Science · doi:10.1177/0963721417718261 · Cited by 1,316 · cited 3×
“Popular explanations propose that people adopt conspiracy theories to sate underlying psychic “ needs ” or motivations, such as thedesirefor control over one ’ s environment and experiences ( 15 ), certainty and predictability ( 20 ), security and stability ( 21 ), and uniqueness ( 22 ).”
ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks
Gilardi, F., Alizadeh, M., & Kubli, M. (2023) · arXiv · doi:10.48550/arxiv.2303.15056 · Cited by 1,207
ChatGPT outperforms crowd workers for text-annotation tasks
Gilardi, F., Alizadeh, M., & Kubli, M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2305016120 · Cited by 1,197
Research works printed but not linked: 2
- M. G. Napolitano “Conspiracy theories and resistance to evidence ” thesis University of California Irvine (2022).
- R. Hofstadter, The Paranoid Style in American Politics (Knopf Doubleday Publishing Group, 1964).
Cited by
The impact of generative artificial intelligence on socioeconomic inequalities and policy making
Capraro, V., Lentsch, A., Acemoglu, D., Akgun, S., Akhmedova, A., Bilancini, E., Bonnefon, J.-F., Brañas-Garza, P., Butera, L., Douglas, K. M., et al. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae191 · Cited by 371
On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trial
Salvi, F., Ribeiro, M. H., Gallotti, R., & West, R. (2024) · doi:10.21203/rs.3.rs-4429707/v1 · Cited by 285
On the conversational persuasiveness of GPT-4
Salvi, F., Horta Ribeiro, M., Gallotti, R., & West, R. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02194-6 · Cited by 264
“59).”
AI and Its Impact on Creativity and Diversity: An Empirical Study of LLM-Generated Product Ideas
Terwiesch, C., Meincke, L., Girotra, K., Mollick, E. R., Nave, G., & Ulrich, K. T. (2023) · doi:10.2139/ssrn.4526071 · Cited by 174
Human-AI agency in the age of generative AI
Krakowski, S. (2025) · Information and Organization · doi:10.1016/j.infoandorg.2025.100560 · Cited by 162
Metadata
- Authors
- Costello, T. H., Pennycook, G., & Rand, D. G.
- Affiliations
- American University (US)
- Cornell University (US)
- Massachusetts Institute of Technology (US)
- Corresponding author
- Costello, Thomas H.
- Venue
- Science
- Published
- 2024-09-13
- Volume
- 385
- Issue
- 6714
- Pages
- eadq1814-eadq1814
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W4402474910
- Cited by
- 354
- References
- 79
- Citations by year
- 2026: 175 · 2025: 162 · 2024: 16
- FWCI
- 252.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Psychology › Social Psychology › Paranormal Experiences and Beliefs
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Keywords
- conspiracy beliefs, conspiracy theories, belief revision, counterevidence, personalized dialogue, generative AI, GPT-4 Turbo, belief persistence, behavioral intention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Durably reducing conspiracy beliefs through dialogues with AI. https://app.cochat.ai/papers/10.1126/science.adq1814
- The paper
- Costello, T. H., Pennycook, G., & Rand, D. G. (2024). Durably reducing conspiracy beliefs through dialogues with AI. Science. https://doi.org/10.1126/science.adq1814
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.