CoChat

Labeling AI-generated media online

Wittenberg, Chloe, Epstein, Ziv, Péloquin-Skulski, Gabrielle, Berinsky, Adam J, Rand, David G · 2025 · PNAS Nexus
Cited by 45

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

Recent advancements in generative AI have raised widespread concern about the use of this technology to spread audio and visual misinformation. In response, there has been a major push among policymakers and technology companies to label AI-generated media appearing online. It remains unclear, however, what types of labels are most effective for this purpose. Here, we evaluate two (potentially complementary) strategies for labeling AI-generated content online: (i) a process-based approach, aimed at clarifying how content was made and (ii) a harm-based approach, aimed at highlighting content's potential to mislead. Using two preregistered survey experiments focused on misleading, AI-generated images (total n = 7,579 Americans), we assess the consequences of these different labeling strategies for viewers' beliefs and behavioral intentions. Overall, we find that all of the labels we tested significantly decreased participants' belief in the presented claims. However, in both studies, labels that simply informed participants that content was generated using AI tended to have little impact on respondents' stated likelihood of engaging with their assigned post. Together, these results shed light on the relative advantages and disadvantages of different approaches to labeling AI-generated media online.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/pnasnexus/pgaf170

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 18 references

Research works printed but not linked: 30

  1. Helmus, 2022, Artificial intelligence, deepfakes, and disinformation: a primer
  2. Marcinek, 2024, Risk-based AI regulation: a primer on the artificial intelligence act of the European Union
  3. Straub, 2022, Americans’ perspectives on online Media warning labels, Behavioral Sciences, 12, 59, 10.3390/bs12030059 · DOI
  4. DiResta, 2024, How spammers and scammers leverage AI-generated images on Facebook for audience growth, Harvard Kennedy School Misinformation Rev, 5, 10.37016/mr-2020-151 · DOI
  5. Koch, 2023, Effects of fact-checking warning labels and social endorsement cues on climate change fake news credibility and engagement on social media, J Appl Soc Psychol., 53, 495, 10.1111/jasp.12959 · DOI
  6. Pennycook, 2020, The implied truth effect: attaching warnings to a subset of fake news headlines increases perceived accuracy of headlines without warnings, Manage Sci., 66, 4944, 10.1287/mnsc.2019.3478 · DOI · Paper page
  7. Porter, 2022, Political misinformation and factual corrections on the Facebook news feed: experimental evidence, J Polit., 84, 1812, 10.1086/719271 · DOI
  8. Shen, 2021, Research note: this photograph has been altered: testing the effectiveness of image forensic labeling on news image credibility, Harvard Kennedy School Misinformation Rev, 2, 10.37016/mr-2020-72 · DOI
  9. Mena, 2020, Cleaning up social media: the effect of warning labels on likelihood of sharing false news on Facebook, Policy Internet., 12, 165, 10.1002/poi3.214 · DOI · Paper page
  10. Martel, 2024, Fact-checker warning labels are effective even for those who distrust fact-checkers, Nat Hum Behav., 8, 1957, 10.1038/s41562-024-01973-x · DOI
  11. Lewis, 2023, Deepfake detection with and without content warnings, R Soc Open Sci., 10, 231214, 10.1098/rsos.231214 · DOI
  12. Ternovski, 2022, The negative consequences of informing voters about deepfakes: evidence from two survey experiments, Journal of Online Trust and Safety, 1, 10.54501/jots.v1i2.28 · DOI · Paper page
  13. Oeldorf-Hirsch, 2020, The ineffectiveness of fact-checking labels on news memes and articles, Mass Commun Soc., 23, 682, 10.1080/15205436.2020.1733613 · DOI
  14. Morrow, 2022, The emerging science of content labeling: contextualizing social media content moderation, J Assoc Inf Sci Technol., 73, 1365, 10.1002/asi.24637 · DOI
  15. Li, 2024, Impact of artificial intelligence-generated content labels on perceived accuracy, message credibility, and sharing intentions for misinformation: web-based, randomized, controlled experiment, JMIR Form Res., 8, e60024, 10.2196/60024 · DOI · Paper page
  16. Peng, 2023, An agenda for studying credibility perceptions of visual misinformation, Polit Commun., 40, 225, 10.1080/10584609.2023.2175398 · DOI
  17. Newman, 2024, Misinformed by images: how images influence perceptions of truth and what can be done about it, Curr Opin Psychol., 56, 101778, 10.1016/j.copsyc.2023.101778 · DOI
  18. Mosleh, 2020, Self-reported willingness to share political news articles in online surveys correlates with actual sharing on Twitter, PLoS One, 15, e0228882, 10.1371/journal.pone.0228882 · DOI · Paper page
  19. Dobber, 2025, The effect of traffic light veracity labels on perceptions of political advertising source and message credibility on social media, J Inform Technol Politics, 22, 82, 10.1080/19331681.2023.2224316 · DOI
  20. Guo, 2023, Seeing is not believing: a nuanced view of misinformation warning efficacy on video-sharing social media platforms, Proc ACM Hum Comput Interact., 7, 1
  21. Burke, 2005, High-cost banner blindness: ads increase perceived workload, hinder visual search, and are forgotten, ACM Trans Comput Hum Interact., 12, 423, 10.1145/1121112.1121116 · DOI · Paper page
  22. Grady, 2021, Nevertheless, partisanship persisted: fake news warnings help briefly, but bias returns with time, Cogn Res Princ Implic., 6, 52, 10.1186/s41235-021-00315-z · DOI · Paper page
  23. Farid, 2022, Creating, using, misusing, and detecting deep fakes, J Online Trust Safety, 1, 10.54501/jots.v1i4.56 · DOI · Paper page
  24. Freeze, 2021, Fake claims of fake news: political misinformation, warnings, and the tainted truth effect, Polit Behav., 43, 1433, 10.1007/s11109-020-09597-3 · DOI · Paper page
  25. Schiff, 2025, The Liar's dividend: can politicians claim misinformation to evade accountability?, Am Polit Sci Rev., 119, 71, 10.1017/S0003055423001454 · DOI
  26. Watson, 1988, Development and validation of brief measures of positive and negative affect: the PANAS scales, J Pers Soc Psychol., 54, 1063, 10.1037/0022-3514.54.6.1063 · DOI · Paper page
  27. Cacioppo, 1982, The need for cognition, J Pers Soc Psychol., 42, 116, 10.1037/0022-3514.42.1.116 · DOI · Paper page
  28. Thomson, 2016, Investigating an alternate form of the cognitive reflection test, Judgm Decis Mak., 11, 99, 10.1017/S1930297500007622 · DOI · Paper page
  29. Schwartz, 2021, A repository of Schwartz value scales with instructions and an Introduction, Online Read Psychol Culture, 2, 9
  30. Wittenberg, 2025, 10.17605/OSF.IO/F8GQP · doi:10.17605/osf.io/f8gqp

Cited by

See all 45

Metadata

Authors
Wittenberg, C., Epstein, Z., Péloquin-Skulski, G., Berinsky, A. J., & Rand, D. G.
Affiliations
  • Sloan School of Management, Massachusetts Institute of Technology , Cambridge, MA 02142 ,
  • Stanford Institute for Human-Centered AI, Stanford University , Palo Alto, CA 94305 ,
  • Department of Political Science, Massachusetts Institute of Technology , Cambridge, MA 02139 ,
Venue
PNAS Nexus
Published
2025-05-28
Volume
4
Issue
6
ISSN
2752-6542
Cited by
45
References
18
Language
en
Funders
  • MIT Generative AI Impact Awards
  • MIT Social and Ethical Responsibilities of Computing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Labeling AI-generated media online. https://app.cochat.ai/papers/10.1093/pnasnexus/pgaf170
The paper
Wittenberg, C., Epstein, Z., Péloquin-Skulski, G., Berinsky, A. J., & Rand, D. G. (2025). Labeling AI-generated media online. PNAS Nexus. https://doi.org/10.1093/pnasnexus/pgaf170

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.