Cited by 224Social Media and PoliticsMisinformation and Its ImpactsMedia Influence and Politics

Assessing the Russian Internet Research Agency's impact on the political attitudes and behaviors of American Twitter users in late 2017

Open access
Bail, Christopher A., Guay, Brian, Maloney, Emily, Combs, Aidan, Hillygus, D. Sunshine, Merhout, Friedolin, Freelon, Deen, Volfovsky, Alexander·2020·Proceedings of the National Academy of Sciences

Abstract

There is widespread concern that Russia and other countries have launched social-media campaigns designed to increase political divisions in the United States. Though a growing number of studies analyze the strategy of such campaigns, it is not yet known how these efforts shaped the political attitudes and behaviors of Americans. We study this question using longitudinal data that describe the attitudes and online behaviors of 1,239 Republican and Democratic Twitter users from late 2017 merged with nonpublic data about the Russian Internet Research Agency (IRA) from Twitter. Using Bayesian regression tree models, we find no evidence that interaction with IRA accounts substantially impacted 6 distinctive measures of political attitudes and behaviors over a 1-mo period. We also find that interaction with IRA accounts were most common among respondents with strong ideological homophily within their Twitter network, high interest in politics, and high frequency of Twitter usage. Together, these findings suggest that Russian trolls might have failed to sow discord because they mostly interacted with those who were already highly polarized. We conclude by discussing several important limitations of our study—especially our inability to determine whether IRA accounts influenced the 2016 presidential election—as well as its implications for future research on social media influence campaigns, political polarization, and computational social science.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1073/pnas.1906420116

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Misinformation has been shown not to easily change beliefs or political voting behavior.

    “Additionally, misinformation has been shown not to easily change beliefs or political voting behavior (Bail et al., 2020; Guess et al., 2020).”

    From Social Drivers and Algorithmic Mechanisms on Digital Media. (2024) · cites this paper as Bail et al., 2020

    The Conclusion reports no substantial effect of interactions with Russian IRA accounts on political attitudes among frequent partisan Twitter users in late 2017. But it explicitly says the study could not assess voting behavior, and its findings do not establish the broader claim for misinformation generally. (LLM, conf=0.90)

    Experimental — accuracy not yet measured
  • A recent paper followed over 1,200 American Twitter users for 1 month in late 2017 and found that only a small fraction of users interacted with Russian trolls, and they did not observe any change in partisan attitude during that time among these users.

    “A recent paper followed over 1,200 American Twitter users for the course of 1 month in late 2017. The authors found that only a small fraction of users interacted with Russian trolls, and they did not observe any change in partisan attitude during that time among these users (68).”

    From Troll and divide: the language of online polarization (2022) · cites this paper as [68]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 30 · Cited by 224

Research works printed but not linked: 9

  1. [1]Sunstein C. R., # Republic: Divided Democracy in the Age of Social Media (Princeton University Press, Princeton, NJ, 2018).
  2. [5]Phillips W., This Is Why We Can’t Have Nice Things: Mapping the Relationship Between Online Trolling and Mainstream Culture (MIT Press, Cambridge, MA, 2015).
  3. [10]Tucker J., “Social media, political polarization, and political disinformation: A Review of the scientific literature” (Tech. Rep., Hewlett Foundation, Menlo Park, CA, 2018).
  4. [12]Jamieson K. H., Cyberwar: How Russian Hackers and Trolls Helped Elect a President What We Don’t, Can’t, and Do Know (Oxford University Press, Oxford, UK, 2018).
  5. [15]Stewart L. G., Arif A., Starbird K., “ Examining trolls and polarization with a retweet network” in Proceedings of WSDM Workshop on Misinformation and Misbehavior Mining on the Web (MIS2) (ACM, New York, 2018).
  6. [16]Berelson B. R., Lazarsfeld P. F., McPhee W. N., McPhee W. N., Voting: A Study of Opinion Formation in a Presidential Campaign (University of Chicago Press, Chicago, 1954).
  7. [23]Hahn P. R., Murray J. S., Carvalho C., Bayesian regression tree models for causal inference: Regularization, confounding, and heterogeneous effects. arXiv:1706.09523 (23 May 2019). · arXiv
  8. [24]Lazer D., Life in the network: The coming age of computational social science. Science 323, 721– 723 (2009). 19197046 PMC2745217
  9. [25]Bail C. A., Replication data for "Assessing the Russian Internet Agency’s impact on the political attitudes and behaviors of U.S. Twitter users in late 2017" Proceedings of the National Academy of Sciences. https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/UATZBA. Deposited 7 November 2019. PMC6955293 31767743 · DOI

Authors
Bail, C. A., Guay, B., Maloney, E., Combs, A., Hillygus, D. S., Merhout, F., Freelon, D., & Volfovsky, A.
Affiliations
  • Duke University (US)
  • University of Copenhagen (DK)
  • University of North Carolina at Chapel Hill (US)
Corresponding author
Bail, Christopher A.
Venue
Proceedings of the National Academy of Sciences
Published
2019-11-25
Volume
117
Issue
1
Pages
243-250
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W2991581987
Cited by
224
References
30
Citations by year
2026: 18 · 2025: 17 · 2024: 24 · 2023: 60 · 2022: 39 · 2021: 34 · 2020: 29 · 2019: 3
FWCI
55.60
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, cc-by-nc-nd)
Funders
National Science Foundation (1756140, 1644868)
Topics
  • Social Sciences › Communication › Social Media and Politics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Social Sciences › Sociology and Political Science › Media Influence and Politics
Keywords
political polarization, political attitudes, political behavior, Twitter users, 2016 US presidential election, computational social science, Russian disinformation
MeSH terms
Attitude, Behavior, Communication, Humans, Organizations, Politics, Russia, Social Sciences, United States, Internet, Social Media

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review