Deepfakes and Disinformation: Exploring the Impact of Synthetic Political Video on Deception, Uncertainty, and Trust in News
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Artificial Intelligence (AI) now enables the mass creation of what have become known as “deepfakes”: synthetic videos that closely resemble real videos. Integrating theories about the power of visual communication and the role played by uncertainty in undermining trust in public discourse, we explain the likely contribution of deepfakes to online disinformation. Administering novel experimental treatments to a large representative sample of the United Kingdom population allowed us to compare people’s evaluations of deepfakes. We find that people are more likely to feel uncertain than to be misled by deepfakes, but this resulting uncertainty, in turn, reduces trust in news on social media. We conclude that deepfakes may contribute toward generalized indeterminacy and cynicism, further intensifying recent challenges to online civic culture in democratic societies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
(2013) · Cited by 44,563
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 1×
“Hence, driving our study is the concern that, over time, in common with other sources of false information (e.g., Vosoughi et al., 2018), deepfakes may cultivate the assumption among citizens that a basic ground of truth cannot be established.”
BackgroundAn Economic Theory of Democracy
Marvick, D., & Downs, A. (1960) · The Western Political Quarterly · doi:10.2307/444355 · Cited by 4,109 · cited 1×
“As Downs (1957) argued, uncertainty arises among citizens because the costs of acquiring accurate information are too high.”
BackgroundFactors affecting trust in market research relationships
Moorman, C., Deshpandé, R., & Zaltman, G. (1993) · Journal of Marketing · doi:10.1177/002224299305700106 · Cited by 3,659 · cited 2×
“, 2009), use of e-commerce websites (Angriawan & Thakur, 2008), and reliance on market research (Moorman et al. 1993).”
BackgroundMisinformation and Its Correction: Continued Influence and Successful Debiasing
Lewandowsky, S., Ecker, U. K. H., Seifert, C. M., Schwarz, N., & Cook, J. (2012) · Psychological Science in the Public Interest · doi:10.1177/1529100612451018 · Cited by 2,920
Trust and commitment in the United States and Japan
Yamagishi, T., & Yamagishi, M. (1994) · Motivation and Emotion · doi:10.1007/bf02249397 · Cited by 2,392 · cited 1×
“On the one hand, trust has often been conceptualized as providing “a solution to the problems caused by social uncertainty” (Yamagishi & Yamagishi, 1994, p. 131).”
BackgroundFace2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
The disinformation order: Disruptive communication and the decline of democratic institutions
Bennett, W. L., & Livingston, S. (2018) · European Journal of Communication · doi:10.1177/0267323118760317 · Cited by 1,552 · cited 1×
“…disinformation and, if left unchallenged, could have profound implications for journalism, citizen competence, and the quality of democracy (Bennett & Livingston, 2018; Chadwick et al., 2018; Flynn et al., 2017; Rojecki & Meraz, 2016; Waisbord, 2018).2 This study provides the first…”
BackgroundSocial Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity
Kreuter, F., Presser, S., & Tourangeau, R. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn063 · Cited by 1,220 · cited 1×
“Also, because we used a self-administered online questionnaire, responses were less affected by social desirability biases (Kreuter et al., 2008).”
MethodThe Nature and Origins of Misperceptions: Understanding False and Unsupported Beliefs About Politics
Flynn, D. J., Nyhan, B., & Reifler, J. (2017) · Political Psychology · doi:10.1111/pops.12394 · Cited by 1,183 · cited 2×
“…unchallenged, could have profound implications for journalism, citizen competence, and the quality of democracy (Bennett & Livingston, 2018; Chadwick et al., 2018; Flynn et al., 2017; Rojecki & Meraz, 2016; Waisbord, 2018).2 This study provides the first evidence on the deceptiveness of deepfakes.”
BackgroundThe Origins of Totalitarianism
Duzer, C. H. V., & Arendt, H. (1952) · The American Historical Review · doi:10.2307/1844245 · Cited by 1,146
Digital Media, Youth, and Credibility
Metzger, M. J., & Flanagin, A. J. (2007) · Cited by 1,060
Synthesizing Obama: learning lip sync from audio
Suwajanakorn, S., Seitz, S. M., & Kemelmacher-Shlizerman, I. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073640 · Cited by 1,057 · cited 1×
“Using this technique, Suwajanakorn et al. (2017) realistically synthesized both audio and video content of humans speaking.”
MethodThe Oxford Handbook of Analytical Sociology
(2011) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199215362.001.0001 · Cited by 987
How Conditioning on Posttreatment Variables Can Ruin Your Experiment and What to Do about It
Montgomery, J. M., Nyhan, B., & Torres, M. (2018) · American Journal of Political Science · doi:10.1111/ajps.12357 · Cited by 800 · cited 3×
“As possible solutions, they cite designs that include “a treatment that affects the mediator but not the outcome” (Montgomery et al., 2018, p. 772).”
BackgroundInfluentialMedia Literacy: From a Report of the National Leadership Conference on Media Literacy
Aufderheide, P. (2018) · MEDIA LITERACY in the INFORMATION AGE · doi:10.4324/9781351292924-4 · Cited by 799 · cited 1×
“Media literacy campaigners have focused on encouraging the public to seek out alternative sources of information and to juxtapose these with any utterance or source that claims to be authoritative (e.g., Aufderheide, 1992).”
BackgroundRumors and Health Care Reform: Experiments in Political Misinformation
Berinsky, A. J. (2017) · British Journal of Political Science · doi:10.1017/s0007123415000186 · Cited by 703 · cited 1×
“People are more likely to accept messages as true if they perceive them as familiar (Berinsky, 2017).”
BackgroundTrust, conflict, and cooperation: A meta-analysis.
Balliet, D., & Van Lange, P. A. M. (2013) · Psychological Bulletin · doi:10.1037/a0030939 · Cited by 659 · cited 1×
“Individuals are less likely to cooperate in contexts where trust is low, and this is particularly the case in highconflict situations—such as the polarized politics of our times (Balliet & Van Lange, 2013).”
BackgroundThe Structural Virality of Online Diffusion
Goel, S., Anderson, A., Hofman, J., & Watts, D. J. (2016) · Management Science · doi:10.1287/mnsc.2015.2158 · Cited by 647 · cited 2×
“Video and still images are more likely than news and online petitions to spread on Twitter (Goel et al., 2015, p. 186).”
BackgroundTsfati, Y., & Cappella, J. N. (2003) · Communication Research · doi:10.1177/0093650203253371 · Cited by 638
Truth is What Happens to News: On journalism, fake news, and post-truth
Waisbord, S. (2018) · Journalism Studies · doi:10.1080/1461670x.2018.1492881 · Cited by 635 · cited 2×
“…unchallenged, could have profound implications for journalism, citizen competence, and the quality of democracy (Bennett & Livingston, 2018; Chadwick et al., 2018; Flynn et al., 2017; Rojecki & Meraz, 2016; Waisbord, 2018).2 This study provides the first evidence on the deceptiveness of deepfakes.”
BackgroundDemo of Face2Face: real-time face capture and reenactment of RGB videos
Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., & Nießner, M. (2016) · ACM SIGGRAPH 2016 Emerging Technologies · doi:10.1145/2929464.2929475 · Cited by 589 · cited 1×
“Thies et al. (2016) developed software that enables anyone with a webcam to generate replicas of other people’s facial expressions.”
BackgroundInterpretation and identification of causal mediation
Pearl, J. (2014) · Psychological Methods · doi:10.1037/a0036434 · Cited by 554
Caught in the Nexus: A Comparative and Longitudinal Analysis of Public Trust in the Press
Hanitzsch, T., Van Dalen, A., & Steindl, N. (2018) · The International Journal of Press/Politics · doi:10.1177/1940161217740695 · Cited by 477 · cited 1×
“Trust in news is declining across the world (Hanitzsch et al., 2018) and trust in news on social media is now lower than in news accessed through other channels (Newman et al.”
BackgroundSchwarz, N., Sanna, L. J., Skurnik, I., & Yoon, C. (2007) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(06)39003-x · Cited by 441 · cited 1×
“When images and audiovisual content are easier to understand and process than written text this brings into play “metacognitive experience”: the experientially derived feelings-about-our-thinking that shape our responses to tasks such as processing new information (Schwarz et al., 2007).”
BackgroundSeeing Is Remembering: How Visuals Contribute to Learning from Television News
Graber, D. A. (1990) · Journal of Communication · doi:10.1111/j.1460-2466.1990.tb02275.x · Cited by 437 · cited 1×
“In a landmark experiment, Graber (1990) found that television viewers were more likely to accurately recall visual messages than verbal messages.”
BackgroundPriming and Fake News: The Effects of Elite Discourse on Evaluations of News Media
Van Duyn, E., & Collier, J. (2019) · Mass Communication and Society · doi:10.1080/15205436.2018.1511807 · Cited by 426 · cited 2×
“With respect to problematic information online, increased uncertainty may explain why Van Duyn and Collier (2018) found that exposing people to elite tweets about the problem of fake news reduces the public’s trust in news.”
BackgroundNews Frames, Political Cynicism, and Media Cynicism
CAPPELLA, J. N., & JAMIESON, K. H. (1996) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716296546001007 · Cited by 394 · cited 1×
“It is also possible that the reduction of trust in news on social media resulting from the uncertainty induced by deceptive deepfakes may not generate cynicism and alienation, but skepticism (Cappella & Jamieson, 1996).”
BackgroundGrabe, M. E., & Bucy, E. P. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195372076.001.0001 · Cited by 388 · cited 1×
“Grabe and Bucy (2009) showed that “image bites” (i.e., clips where candidates are shown but not heard) are more powerful in shaping voters’ opinions than “sound bites” (where candidates are heard talking, with or without images of them speaking).”
BackgroundThe Ambivalent Internet: Mischief, Oddity, and Antagonism Online
Phillips, W., & Milner, R. M. (2017) · Cited by 357
FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339
Alvarez, R. (1997) · University of Michigan Press eBooks · doi:10.3998/mpub.15100 · Cited by 332
Do tabloids poison the well of social media? Explaining democratically dysfunctional news sharing
Chadwick, A., Vaccari, C., & O’Loughlin, B. (2018) · New Media & Society · doi:10.1177/1461444818769689 · Cited by 258 · cited 5×
“See Chadwick et al. (2018), who follow Jack (2017).”
BackgroundInfluentialSelf-citationLexicon of Lies: Terms for Problematic Information
Jack, C. (2017) · doi:10.69985/kmpz3134 · Cited by 226 · cited 1×
“See Chadwick et al. (2018), who follow Jack (2017).”
Are Americans Ambivalent Towards Racial Policies?
Alvarez, R. M., & Brehm, J. (1997) · American Journal of Political Science · doi:10.2307/2111768 · Cited by 211 · cited 2×
“By contrast, uncertainty is experienced when not enough information is available to make a choice, and thus it can be overcome by the introduction of new information (Alvarez & Brehm, 1997).”
BackgroundThe “Need for Chaos” and Motivations to Share Hostile Political Rumors
PETERSEN, M. B., OSMUNDSEN, M., & ARCENEAUX, K. (2023) · American Political Science Review · doi:10.1017/s0003055422001447 · Cited by 194
Garrett, R. K., Nisbet, E. C., & Lynch, E. K. (2013) · Journal of Communication · doi:10.1111/jcom.12038 · Cited by 184 · cited 1×
“However, the educational video did not reduce outright deception—a finding that chimes with an important strand of research showing the limited effects of fact-checking (e.g., Garrett et al., 2013).”
Fragile and Resilient Trust: Risk and Uncertainty in Negotiated and Reciprocal Exchange
Molm, L. D., Schaefer, D. R., & Collett, J. L. (2009) · Sociological Theory · doi:10.1111/j.1467-9558.2009.00336.x · Cited by 169 · cited 2×
“Increased uncertainty has been found to reduce trust in business decisions (Adobor, 2006), negotiated and reciprocal exchanges (Molm et al., 2009), use of e-commerce websites (Angriawan & Thakur, 2008), and reliance on market research (Moorman et al.”
BackgroundWhy Seeing Is Believing: Merging Auditory and Visual Worlds
Witten, I. B., & Knudsen, E. I. (2005) · Neuron · doi:10.1016/j.neuron.2005.10.020 · Cited by 164 · cited 1×
“Witten and Knudsen (2005) argue that, due to its perceived “precision,” visual information is integrated more effectively than other types of sensory data.”
BackgroundFalse memories of fabricated political events
Frenda, S. J., Knowles, E. D., Saletan, W., & Loftus, E. F. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2012.10.013 · Cited by 146 · cited 1×
“Misleading visuals are more likely than misleading verbal content to generate false perceptions because, based on the “realism heuristic” (Frenda et al., 2013; Sundar, 2008), individuals treat audio and images as more likely than text to resemble “the real world” of everyday experience.”
BackgroundExperimental Methodology in Journalism and Mass Communication Research
Thorson, E., Wicks, R., & Leshner, G. (2012) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699011430066 · Cited by 145 · cited 1×
“While asking such questions is good practice in experimental research (Thorson et al., 2012), we did not employ them for two reasons.”
BackgroundItem Nonresponse: Distinguishing between don't Know and Refuse
Shoemaker, P. J. (2002) · International Journal of Public Opinion Research · doi:10.1093/ijpor/14.2.193 · Cited by 143 · cited 1×
“Refusals are more likely when a question asks for personally sensitive information; DKs are associated with cognitive effort and uncertainty (Shoemaker et al., 2002).”
BackgroundRumors and factitious informational blends: The role of the web in speculative politics
Rojecki, A., & Meraz, S. (2016) · New Media & Society · doi:10.1177/1461444814535724 · Cited by 142
Pasek, J. (2016) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edv016 · Cited by 136 · cited 1×
“Finally, we drew on an online panel-based sample to recruit our participants, and even though this makes our findings more generalizable than if we had drawn a convenience sample, results from nonprobability samples do not automatically generalize to the population (Pasek, 2015).”
Conceptual and perceptual factors in the picture superiority effect
Stenberg, G. (2006) · European Journal of Cognitive Psychology · doi:10.1080/09541440500412361 · Cited by 133 · cited 2×
“Stenberg (2006) shows that individuals process visual information more directly and with less effort than verbal information.”
BackgroundVisual Political Knowledge: A Different Road to Competence?
Prior, M. (2014) · The Journal of Politics · doi:10.1017/s0022381613001096 · Cited by 115
Pancer, E., & Poole, M. (2016) · Social Influence · doi:10.1080/15534510.2016.1265582 · Cited by 113 · cited 1×
“During the 2016 US Presidential campaign, tweets from Donald Trump and Hillary Clinton that contained images or videos received significantly more likes and retweets (Pancer & Poole 2016).”
Green, M. C., & Donahue, J. K. (2011) · Media Psychology · doi:10.1080/15213269.2011.598050 · Cited by 90 · cited 1×
“While skepticism is no panacea (Green & Donahue, 2011), it is much less problematic for democracy than cynicism and may be a sign, or even a component, of a healthily critical but engaged online civic culture.”
BackgroundThe “Need for Chaos” and Motivations to Share Hostile Political RumorsPreprint
Petersen, M. B., Osmundsen, M., & Arceneaux, K. (2018) · doi:10.31234/osf.io/6m4ts · Cited by 79
Silent Voices: Public Opinion and Political Participation in America
Niven, D. (2005) · Perspectives on Politics · doi:10.1017/s1537592705350158 · Cited by 77
Truthiness and falsiness of trivia claims depend on judgmental contexts.
Newman, E. J., Garry, M., Unkelbach, C., Bernstein, D. M., Lindsay, D. S., & Nash, R. A. (2015) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000099 · Cited by 60
Optimal trust? Uncertainty as a determinant and limit to trust in inter‐firm alliances
Adobor, H. (2006) · Leadership & Organization Development Journal · doi:10.1108/01437730610692407 · Cited by 53 · cited 2×
“Increased uncertainty has been found to reduce trust in business decisions (Adobor, 2006), negotiated and reciprocal exchanges (Molm et al., 2009), use of e-commerce websites (Angriawan & Thakur, 2008), and reliance on market research (Moorman et al. 1993).”
BackgroundA Parsimonious Model of the Antecedents and Consequence of Online Trust: An Uncertainty Perspective
Angriawan, A., & Thakur, R. (2008) · Journal of Internet Commerce · doi:10.1080/15332860802004337 · Cited by 51 · cited 1×
“Increased uncertainty has been found to reduce trust in business decisions (Adobor, 2006), negotiated and reciprocal exchanges (Molm et al., 2009), use of e-commerce websites (Angriawan & Thakur, 2008), and reliance on market research (Moorman et al. 1993).”
BackgroundTo Verify or to Disengage: Coping with “Fake News” and Ambiguity
Wenzel, A. D. (2019) · International journal of communication · Cited by 41
Online Panels and the Future of Political Communication Research
Lyengar, S., & Vavreck, L. (2012) · SAGE Publications Ltd eBooks · doi:10.4135/9781446201015.n19 · Cited by 15 · cited 1×
“Compared with labbased experiments, experiments embedded in online surveys offer greater representativeness and enable rich and realistic treatments, such as those employed in this study (c.f. Iyengar & Vavreck, 2012).”
Method
Research works printed but not linked: 3
- Arendt H. (1978, October 26). Hannah Arendt: From an Interview. The New York Review of Books https://www.nybooks.com/articles/1978/10/26/hannah-arendt-from-an-interview/
- Goodfellow I., 2014, Advances in Neural Information Processing Systems, 3, 2672
- Wenzel A., 2019, International Journal of Communication, 13, 19
Cited by
ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1166120 · Cited by 708
“Political Deepfakes already contributed toward generalized indeterminacy and disinformation (67).”
BackgroundHabbal, A., Ali, M. K., & Abuzaraida, M. A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122442 · Cited by 407
HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editing
Alaluf, Y., Tov, O., Mokady, R., Gal, R., & Bermano, A. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01796 · Cited by 259
Do (microtargeted) deepfakes have real effects on political attitudes?
Dobber, T., Metoui, N., Trilling, D., Helberger, N., & de Vreese, C. (2021) · The International Journal of Press/Politics · doi:10.1177/1940161220944364 · Cited by 256
Artificial intelligence in digital media: the era of deepfakes
Karnouskos, S. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.3001312 · Cited by 239
Metadata
- Authors
- Vaccari, C., & Chadwick, A.
- Affiliations
- Loughborough University (GB)
- Corresponding author
- Vaccari, Cristian
- Venue
- Social Media + Society
- Publisher
- SAGE Publications
- Published
- 2020-01
- Volume
- 6
- Issue
- 1
- ISSN
- 2056-3051 (ISSN-L)
- OpenAlex
- W3007419529
- Semantic Scholar
- feeaefe8b4d6cc1a0f30c1fbd66c041399161558
- Cited by
- 978
- References
- 54
- Citations by year
- 2026: 251 · 2025: 236 · 2024: 149 · 2023: 124 · 2022: 84 · 2021: 111 · 2020: 22
- FWCI
- 114.56
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Social Media + Society (publishedVersion, cc-by-nc)
- DergiPark (Istanbul University) (submittedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by-nc)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Communication › Social Media and Politics
- Social Sciences › Sociology and Political Science › Media Influence and Politics
- Keywords
- deepfakes, disinformation, deception, uncertainty, trust in news, social media, visual communication, political cynicism, democratic society
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.