Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index; 9 of the 23 sources its claims cite were checked for support.

Misinformation reloaded? Fears about the impact of generative AI on misinformation are overblown

Open access
Simon, Felix M., Altay, Sacha, Mercier, Hugo · 2023 · Harvard Kennedy School Misinformation Review

Abstract

Many observers of the current explosion of generative AI worry about its impact on our information environment, with concerns being raised about the increased quantity, quality, and personalization of misinformation. We assess these arguments with evidence from communication studies, cognitive science, and political science. We argue that current concerns about the effects of generative AI on the misinformation landscape are overblown.

Overview

CoChat Summary

TL;DR

The commentary argues that fears about generative AI worsening misinformation are overblown, because misinformation consumption is limited more by demand and finite attention than by supply. It reviews claims about increased quantity, quality, and personalization of AI-generated misinformation and finds existing evidence suggests at best modest effects.

Key findings

  • The paper identifies four common worries—increased quantity, quality, personalization, and a fourth argument not addressed in detail—and reviews the first three, arguing they are speculative and that existing research suggests at best modest effects of generative AI on the misinformation landscape.
  • On quantity, misinformation already abounds online and is rarely behind paywalls, but the average internet user consumes very little of it; consumption is concentrated in a small portion of very active and vocal users, so increased supply is unlikely to greatly increase diffusion because attention is finite.
  • On quality, most people are barely exposed to misinformation and overwhelmingly consume mainstream sources; for generative AI to tip the scales in favor of misinformation, the increase in the appeal of misinformation would have to be 20 to 100 times larger than the increase in the appeal of reliable content (Acerbi et al., 2022).
  • On personalization, the infrastructures enabling micro-targeting are not directly impacted by generative AI, evidence on personalized political advertising is mixed with at best small and context-dependent effects, and current LLMs cannot represent the full range of users’ preferences and values or hold direct information about users themselves.

Methods

  • This is a commentary/argumentative review, not an empirical study; the authors synthesize evidence from communication studies, cognitive science, and political science.
  • No original data or sample are reported; the paper assesses three arguments—quantity, quality, and personalization—and explicitly does not address the fourth argument in detail.
  • The main analysis is conceptual: it evaluates claims about generative AI and misinformation against existing literature and reasoning about supply and demand, attention, persuasion, and micro-targeting.

Limitations

  • Stated in the paper: the argument mostly relies on evidence about the media environment of wealthy, democratic countries with rich and competitive media ecosystems; less data is available in other countries, and the authors cannot rule out that generative AI might have a larger negative effect there, although it could also have a larger positive effect.
  • Evident from the text: it is a commentary with no new empirical data, and conclusions about future effects rest on existing evidence and argument; some discussed possibilities, such as using chatbots to form relationships and then feed misinformation, remain entirely speculative.
  • Evident from the text: the fourth argument is not addressed in detail by design, so the review is not comprehensive across all proposed harms.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.37016/mr-2020-127

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

7 Valid · 2 Not valid · 9 Not checked · 20 Own results and interpretations

17 more claims

Create a free account to see all 38 claims and to verify the 2 references still open.

See all claims — free account
  • It may state two separate claims as one. 13
  • Probably not a substantial claim. 7

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 47 references

Research works printed but not linked: 2

  1. Marcus, G. (2023, February 8). AI's Jurassic Park moment. Communications of the ACM. https://cacm.acm.org/blogs/blog-cacm/267674-ais-jurassic-park-moment/fulltext
  2. Silverman, C. (Ed.). (2014). Verification handbook: An ultimate guideline on digital age sourcing for emergency coverage. European Journalism Centre. https://datajournalism.com/read/handbook/verification-3

Cited by

See all 85

Metadata

Authors
Simon, F. M., Altay, S., & Mercier, H.
Affiliations
  • University of Oxford (GB)
  • University of Zurich (CH)
  • Centre National de la Recherche Scientifique (FR)
Venue
Harvard Kennedy School Misinformation Review
Published
2023-10-18
ISSN
2766-1652 (ISSN-L)
OpenAlex
W4387633104
Cited by
85
References
47
Citations by year
2026: 24 · 2025: 33 · 2024: 24 · 2023: 4
FWCI
36.50
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Harvard Kennedy School Misinformation Review (publishedVersion, cc-by)
  • Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by-nc-nd)
  • HAL (submittedVersion, other-oa)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by)
  • Zurich Open Repository and Archive (University of Zurich)
Funders
  • University of Oxford
  • HORIZON EUROPE European Research Council (883121)
  • Agence Nationale de la Recherche (ANR-21-CE28-0016-01, ANR-17-EURE-0017, ANR-10-IDEX-0001-02)
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Communication › Social Media and Politics
Keywords
generative AI, misinformation, information environment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Misinformation reloaded? Fears about the impact of generative AI on misinformation are overblown. https://app.cochat.ai/papers/10.37016/mr-2020-127
The paper
Simon, F. M., Altay, S., & Mercier, H. (2023). Misinformation reloaded? Fears about the impact of generative AI on misinformation are overblown. Harvard Kennedy School Misinformation Review. https://doi.org/10.37016/mr-2020-127

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.