Disinformation as Collaborative Work: Surfacing the Participatory Nature of Strategic Information Operations
Open accessThe DOI matches its Crossref record; 75 of the 76 references it cites were found in a registry or an index.
Abstract
In this paper, we argue that strategic information operations (e.g. disinformation, political propaganda, and other forms of online manipulation) are a critical concern for CSCW researchers, and that the CSCW community can provide vital insight into understanding how these operations function-by examining them as collaborative "work" within online crowds. First, we provide needed definitions and a framework for conceptualizing strategic information operations, highlighting related literatures and noting historical context. Next, we examine three case studies of online information operations using a sociotechnical lens that draws on CSCW theories and methods to account for the mutual shaping of technology, social structure, and human action. Through this lens, we contribute a more nuanced understanding of these operations (beyond "bots" and "trolls") and highlight a persistent challenge for researchers, platform designers, and policy makers-distinguishing between orchestrated, explicitly coordinated, information operations and the emergent, organic behaviors of an online crowd.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The 'falsehood firehose' is another strategy that pushes huge volumes of self-contradictory disinformation (123), meant to deceive, confuse, disorient, and agitate (124, 125).”
From Misinformation in and about science (2021) · cites this paper as [125]
Citations
Cites
(1984) · Cited by 21,166
The Interpretation of Cultures
(2017) · Macat Library eBooks · doi:10.4324/9781912128310 · Cited by 16,449
(2014) · Cited by 15,747
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801 · cited 1×
“structuration [26], sociomateriality [61], and distributed cognition [39]—to assist in the investigation both of how technology shapes work within formal organizations [60, 61] and of how online environments facilitate and shape collective behavior in the “crowd” [82, 86, 95].”
BackgroundThe theory of communicative action
(2014) · The Philosophy of Habermas · doi:10.4324/9781315710495-5 · Cited by 8,634
The Duality of Technology: Rethinking the Concept of Technology in Organizations
Orlikowski, W. J. (1992) · Organization Science · doi:10.1287/orsc.3.3.398 · Cited by 4,957 · cited 2×
“…theories—e.g. structuration [26], sociomateriality [61], and distributed cognition [39]—to assist in the investigation both of how technology shapes work within formal organizations [60, 61] and of how online environments facilitate and shape collective behavior in the “crowd” [82, 86, 95].”
BackgroundI tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience
Marwick, A. E., & boyd, D. (2011) · New Media & Society · doi:10.1177/1461444810365313 · Cited by 4,612 · cited 1×
“Finally, social media feeds combine different types of content such as news and entertainment, collapsing different contexts together [55].”
BackgroundSociomaterial practices: exploring technology at work
Orlikowski, W. J. (2007) · Organization Studies · doi:10.1177/0170840607081138 · Cited by 3,248 · cited 2×
“structuration [26], sociomateriality [61], and distributed cognition [39]—to assist in the investigation both of how technology shapes work within formal organizations [60, 61] and of how online environments facilitate and shape collective behavior in the “crowd” [82, 86, 95].”
BackgroundEthics, Reflexivity, and “Ethically Important Moments” in Research
Guillemin, M., & Gillam, L. (2004) · Qualitative Inquiry · doi:10.1177/1077800403262360 · Cited by 2,671
Awareness and coordination in shared workspaces
Dourish, P., & Bellotti, V. (1992) · Proceedings of the 1992 ACM conference on Computer-supported cooperative work - CSCW '92 · doi:10.1145/143457.143468 · Cited by 2,550
Personal Influence: The Part Played by People in the Flow of Mass Communications
Willigan, W. L., Katz, E., & Lazarsfeld, P. F. (1956) · The American Catholic Sociological Review · doi:10.2307/3708755 · Cited by 2,157
Ferrara, E., Varol, O., Davis, C., Menczer, F., & Flammini, A. (2016) · Communications of the ACM · doi:10.1145/2818717 · Cited by 1,973 · cited 1×
“In these examples, and in existing contemporary research into strategic online information operations more broadly, the focus is often on explicitly coordinated activity—i.e. those activities conducted by automated “bots” [e.g. 1, 22, 103] or paid workers [e.g. 47, 59].”
BackgroundPersonal Influence: The Part Played by People in the Flow of Mass Communications
Roshwalb, I., Katz, E., & Lazarsfeld, P. F. (1956) · Journal of Marketing · doi:10.2307/1247718 · Cited by 1,880
The constitution of society: Outline of the theory of structuration
Palm, R. (1986) · Political Geography Quarterly · doi:10.1016/0260-9827(86)90040-6 · Cited by 1,590
Vieweg, S., Hughes, A. L., Starbird, K., & Palen, L. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753486 · Cited by 1,427
Self-citationKING, G., PAN, J., & ROBERTS, M. E. (2017) · American Political Science Review · doi:10.1017/s0003055417000144 · Cited by 1,028 · cited 2×
“In these examples, and in existing contemporary research into strategic online information operations more broadly, the focus is often on explicitly coordinated activity—i.e. those activities conducted by automated “bots” [e.g. 1, 22, 103] or paid workers [e.g. 47, 59].”
BackgroundTwitter adoption and use in mass convergence and emergency events
Hughes, A. L., & Palen, L. (2009) · International Journal of Emergency Management · doi:10.1504/ijem.2009.031564 · Cited by 991 · cited 1×
“colleagues argued that ICT-enabled interaction (and the resulting trace data) would allow us to examine human reactions to crisis events in new ways, even as it facilitated new responses and configurations of responders [38].”
BackgroundUsing Reflexivity to Optimize Teamwork in Qualitative Research
Barry, C. A., Britten, N., Barber, N., Bradley, C., & Stevenson, F. (1999) · Qualitative Health Research · doi:10.1177/104973299129121677 · Cited by 773 · cited 1×
“To do this, we draw on qualitative traditions for fostering reflexivity in research design [7, 31, 49].”
MethodThe Theory of Communicative Action
(2001) · Communicative Action and Rational Choice · doi:10.7551/mitpress/1955.003.0004 · Cited by 679
"Voluntweeters": self-organizing by digital volunteers in times of crisis
Starbird, K., & Palen, L. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979102 · Cited by 546
Self-citationProceedings of the Annual Hawaii International Conference on System Sciences
Goggins, S., Schmidt, M., Guajardo, J. R., & Moore, J. L. (2010) · Cited by 499
Citizen communications in crisis: anticipating a future of ICT-supported public participation
Palen, L., & Liu, S. B. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240736 · Cited by 495 · cited 1×
“It allows us to explore and account for both big “W” work that occurs within formal organizations [45] and little “w” work that emerges within distributed, online crowds [e.g. 57, 64, 71, 85]—as well as the intersection between the two.”
BackgroundPolitical communication, computational propaganda, and autonomous agents - Introduction
Howard, P., & Woolley, S. (2016) · International journal of communication · Cited by 438
WHY DO PEOPLE SHARE FAKE NEWS? A SOCIOTECHNICAL MODEL OF MEDIA EFFECTS
Marwick, A. E. (2018) · Cited by 428
Network Ethnography and the Hypermedia Organization: New Media, New Organizations, New Methods
HOWARD, P. N. (2002) · New Media & Society · doi:10.1177/146144402321466813 · Cited by 400 · cited 1×
“These methods are closely aligned with trace ethnography [25] and network ethnography [36], which provide similarly valuable lenses for following human activities through and across online platforms and noting how technologies and social structures (e.”
MethodThe Russian "Firehose of Falsehood" Propaganda Model: Why It Might Work and Options to Counter It
Paul, C., & Matthews, M. (2016) · doi:10.7249/pe198 · Cited by 344 · cited 1×
“Strategic information operations, and in particular disinformation, function to undermine the integrity of the information space and reduce human agency by overwhelming our capacity to make sense of information [66, 69].”
BackgroundOffice of the Director of National Intelligence
Senate, C. (2016) · govinfo.gov · Cited by 322
The menace of unreality: how the Kremlin weaponizes information, culture and money
Pomerantsev, P., & Weiss, M. (2014) · Cited by 313
Crisis informatics—New data for extraordinary times
Palen, L., & Anderson, K. M. (2016) · Science · doi:10.1126/science.aag2579 · Cited by 309 · cited 2×
“In recent years, we have employed and evolved the methods of crisis informatics [63] first for studying online rumors and misinformation [2, 53], and then later for studying intentional disinformation and information operations [e.”
BackgroundMethodStarbird, K. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14878 · Cited by 307 · cited 3×
“Another significant finding (first reported in [83]), revealed when we look more deeply at the broader content on the web domains in red (Figure 6), is that many of these websites host content supporting not”
BackgroundInfluentialSelf-citationOskamp, S., & Schultz, P. W. (2005) · Psychology Press eBooks · doi:10.4324/9781410611963 · Cited by 295
Online Harassment and Content Moderation: The Case of Blocklists
Jhaver, S., Ghoshal, S., Bruckman, A., & Gilbert, E. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3185593 · Cited by 270
Classification and Its Consequences for Online Harassment: Design Insights from HeartMob
Blackwell, L., Dimond, J., Schoenebeck, S., & Lampe, C. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134659 · Cited by 245
Trace Ethnography: Following Coordination through Documentary Practices
Geiger, R. S., & Ribes, D. (2011) · 2011 44th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2011.455 · Cited by 232 · cited 1×
“ethnography [25] and network ethnography [36], which provide similarly valuable lenses for following human activities through and across online platforms and noting how technologies and social structures (e.”
BackgroundLexicon of Lies: Terms for Problematic Information
Jack, C. (2017) · doi:10.69985/kmpz3134 · Cited by 226 · cited 4×
“information war [68]) and give them historical context (active measures [9], disinformation [40], asymmetric warfare [91]).”
BackgroundInfluentialZannettou, S., Caulfield, T., De Cristofaro, E., Sirivianos, M., Stringhini, G., & Blackburn, J. (2019) · Companion Proceedings of The 2019 World Wide Web Conference · doi:10.1145/3308560.3316495 · Cited by 206 · cited 1×
“Some of these recent studies [e.g. 79, 105] have reported observing limited effects on the short-term online behaviors of social media users that were exposed to these information operations.”
Vitak, J., Chadha, K., Steiner, L., & Ashktorab, Z. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998337 · Cited by 180 · cited 1×
“And they affect things we care about—for example, finding life-saving information during a crisis event [85, 95], organizing online for political change [87, 96, 104], and protecting online spaces from bullying and harassment [10, 97].”
BackgroundConnected Through Crisis: Emotional Proximity and the Spread of Misinformation Online
Huang, Y. L., Starbird, K., Orand, M., Stanek, S. A., & Pedersen, H. T. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675202 · Cited by 173
Self-citationResearchers, Reflexivity, and Good Data: Writing to Unlearn
Kleinsasser, A. M. (2000) · Theory Into Practice · doi:10.1207/s15430421tip3903_6 · Cited by 173 · cited 1×
“To do this, we draw on qualitative traditions for fostering reflexivity in research design [7, 31, 49].”
MethodThe tactics & tropes of the Internet Research Agency
DiResta, R., Shaffer, K. P., Ruppel, B., Sullivan, D. B., Matney, R., Fox, R. B., Albright, J., & Johnson, B. (2018) · Lincoln (University of Nebraska) · Cited by 165
Manufacturing Consent in Cyberspace: China's “Fifty-Cent Army”
Han, R. (2015) · Journal of Current Chinese Affairs · doi:10.1177/186810261504400205 · Cited by 164 · cited 2×
“For instance, the flooding of conversational spaces on social media with positive messages or attempts to change the subject has emerged to be a misdirectional tactic called xuanchuan that is associated with the “Fifty-Cent Army” in China [34, 47].”
BackgroundDissecting a Social Botnet: Growth, Content and Influence in Twitter
Abokhodair, N., Yoo, D., & McDonald, D. W. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675208 · Cited by 162
Acting the Part: Examining Information Operations Within #BlackLivesMatter Discourse
Arif, A., Stewart, L. G., & Starbird, K. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274289 · Cited by 152
Self-citationFlexible, active support for collaborative work with ConversationBuilder
Kaplan, S. M., Tolone, W. J., Bogia, D. P., & Bignoli, C. (1992) · Proceedings of the 1992 ACM conference on Computer-supported cooperative work - CSCW '92 · doi:10.1145/143457.143552 · Cited by 149
Conspiracy Theories and Other Dangerous Ideas
Sunstein, C. R. (2014) · Medical Entomology and Zoology · Cited by 148
The policy knot: re-integrating policy, practice and design in cscw studies of social computing
Jackson, S. J., Gillespie, T., & Payette, S. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531674 · Cited by 143
Authoritarianism Goes Global (II): The Kremlin’s Information War
Pomerantsev, P. (2015) · Journal of democracy · doi:10.1353/jod.2015.0074 · Cited by 141 · cited 1×
“information war [68]) and give them historical context (active measures [9], disinformation [40], asymmetric warfare [91]).”
BackgroundInformating Crisis: Expanding Critical Perspectives in Crisis Informatics
Soden, R., & Palen, L. A. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274431 · Cited by 141
Cyberwar: How Russian Hackers and Trolls Helped Elect a President—What We Don’t, Can’t, and Do Know
Traugott, M. (2019) · Public Opinion Quarterly · doi:10.1093/poq/nfy051 · Cited by 131
Characterizing Online Rumoring Behavior Using Multi-Dimensional Signatures
Maddock, J., Starbird, K., Al-Hassani, H. J., Sandoval, D. E., Orand, M., & Mason, R. M. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675280 · Cited by 129 · cited 2×
“In recent years, we have employed and evolved the methods of crisis informatics [63] first for studying online rumors and misinformation [2, 53], and then later for studying intentional disinformation and information operations [e.g. 3, 84, 102] We employ a grounded, interpretivist, mixed-method…”
MethodSelf-citationThe Citizen Marketer: Promoting Political Opinion in the Social Media Age
Penney, J. (2017) · Cited by 124
Working and sustaining the virtual "Disaster Desk"
Starbird, K., & Palen, L. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441832 · Cited by 115 · cited 1×
“structuration [26], sociomateriality [61], and distributed cognition [39]—to assist in the investigation both of how technology shapes work within formal organizations [60, 61] and of how online environments facilitate and shape collective behavior in the “crowd” [82, 86, 95].”
BackgroundSelf-citationSarcevic, A., Palen, L., White, J., Starbird, K., Bagdouri, M., & Anderson, K. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145217 · Cited by 108
Self-citationA Closer Look at the Self-Correcting Crowd: Examining Corrections in Online Rumors
Arif, A., Robinson, J. J., Stanek, S. A., Fichet, E. S., Townsend, P., Worku, Z., & Starbird, K. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998294 · Cited by 96
Self-citationPolitical communication, computational propaganda, and autonomous agents - Introduction
Howard, P., & Woolley, S. (2016) · International journal of communication · Cited by 89
Ecosystem or Echo-System? Exploring Content Sharing across Alternative Media Domains
Starbird, K., Arif, A., Wilson, T., Van Koevering, K., Yefimova, K., & Scarnecchia, D. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15009 · Cited by 85 · cited 3×
“A version of this graph appeared originally in [84].”
BackgroundMethodInfluentialSelf-citationThe KGB and Soviet Disinformation: An Insider's View
Campbell, J. C., & Bittman, L. (1986) · Foreign Affairs · doi:10.2307/20042744 · Cited by 84
Drawing the Lines of Contention: Networked Frame Contests Within #BlackLivesMatter Discourse
Stewart, L. G., Arif, A., Nied, A. C., Spiro, E. S., & Starbird, K. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134920 · Cited by 82
Self-citationThe citizen marketer: Promoting political opinion in the social media age
Bossetta, M. (2018) · Journal of Communication · doi:10.1093/joc/jqy034 · Cited by 74 · cited 4×
“This dynamic is not new [9, 13, 67, 72].”
BackgroundInfluentialDelivering patients to sacré coeur: collective intelligence in digital volunteer communities
Starbird, K. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470769 · Cited by 73
Self-citationReflective HCI: articulating an agenda for critical practice
Sengers, P., McCarthy, J., & Dourish, P. (2006) · CHI '06 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1125451.1125762 · Cited by 72
Wilson, T., Zhou, K., & Starbird, K. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274452 · Cited by 61
Self-citationThe Deception Game : Czechoslovak Intelligence in Soviet Political Warfare
Bittman, L. (1972) · Cited by 42
Cyberwar: How Russian Hackers and Trolls Helped Elect a President: What We Don't, Can't, and Do Know
Jamieson, K. H. (2018) · Cited by 42
#Indigenous: Tracking the Connective Actions of Native American Advocates on Twitter
Vigil-Hayes, M., Duarte, M. E., Parkhurst, N. D., & Belding, E. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998194 · Cited by 35
(1991) · Choice Reviews Online · doi:10.5860/choice.28-6402 · Cited by 31
What do you think?: the structuring of an online community as a collective-sensemaking process
Nagar, Y. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145266 · Cited by 30
Engaging with Political and Social Issues on Facebook in College Life
Wang, Y., & Mark, G. J. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998295 · Cited by 28
Asymmetric Warfare: Threat and Response in the 21st Century
Thornton, R. (2006) · Cited by 28
GROUPWARE AND COMPUTER-SUPPORTED COOPERATIVE WORK
Olson, G. M., & Olson, J. S. (2007) · CRC Press eBooks · doi:10.1201/9781410615862-38 · Cited by 25
Analysis of Strategy and Spread of Russia-sponsored Content in the US in 2017Preprint
Spangher, A., Ranade, G. V., Nushi, B., Fourney, A., & Horvitz, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.10033 · Cited by 25 · cited 1×
“Some of these recent studies [e.g. 79, 105] have reported observing limited effects on the short-term online behaviors of social media users that were exposed to these information operations.”
Privacy in Context: Critically Engaging with Theory to Guide Privacy Research and Design
Badillo-Urquiola, K. A., Yao, Y., Ayalon, O., Knijnenurg, B., Page, X., Toch, E., Wang, Y., & Wisniewski, P. (2018) · CSCW Companion · doi:10.1145/3272973.3273012 · Cited by 21
Asymmetric Warfare: Threat and Response in the 21st Century
Norton, R. J., & Thornton, R. (2007) · Cited by 20
COMMONCORE Project (2017) How Social Media is Changing the Politics of Education
Supovitz, J. A., Kolouch, C., Daley, A. J., & del Fresno, M. (2015) · ScholarlyCommons (University of Pennsylvania) · Cited by 11
Research works printed but not linked: 24
- Dan Arnaudo . 2017. Computational Propaganda in Brazil: Social Bots during Elections. Computational Propaganda Research Project . Oxford University , Oxford, UK . Dan Arnaudo. 2017. Computational Propaganda in Brazil: Social Bots during Elections. Computational Propaganda Research Project. Oxford University, Oxford, UK.
- Ronald M. Baecker Jonathan Grudin William A. S. Buxton and Saul Greenberg (Ed.). 1995. Groupware and social dynamics: Eight challenges for developers. Readings in Human--Computer Interaction. DOI: https://doi.org/10.1016/B978-0-08-051574--8.50079-0. Ronald M. Baecker Jonathan Grudin William A. S. Buxton and Saul Greenberg (Ed.). 1995. Groupware and social dynamics: Eight challenges for developers. Readings in Human--Computer Interaction. DOI: https://doi.org/10.1016/B978-0-08-051574--8.50079-0. · doi:10.1016/b978-0-08-051574--8.50079-0
- Samantha Bradshaw and Phillip N . Howard . 2018 . Challenging truth and trust: A global inventory of organized social media manipulation. Computational Propaganda Research Project. Oxford University , Oxford, UK. Samantha Bradshaw and Phillip N. Howard. 2018. Challenging truth and trust: A global inventory of organized social media manipulation. Computational Propaganda Research Project. Oxford University, Oxford, UK.
- Samantha Bradshaw and Phillip N . Howard . 2018 . Why does Junk News Spread So Quickly Across Social Media? Algorithms, Advertising and Exposure in Public Life. Knight Foundation. Retrieved from https://kf-site -production.s3.amazonaws.com/media_elements/files/000/000/142/original/Topos_KF_ White-Paper _Howard_V1_ado.pdf Samantha Bradshaw and Phillip N. Howard. 2018. Why does Junk News Spread So Quickly Across Social Media? Algorithms, Advertising and Exposure in Public Life. Knight Foundation. Retrieved from https://kf-site -production.s3.amazonaws.com/media_elements/files/000/000/142/original/Topos_KF_ White-Paper_Howard_V1_ado.pdf
- Randall L. Bytwerk . 2010 . Grassroots propaganda in the Third Reich: The Reich ring for National Socialist propaganda and public enlightenment . German Studies Review 33 (2010). 93 -- 118 . DOI: http://dx.doi.org/10.2307/40574929 Randall L. Bytwerk. 2010. Grassroots propaganda in the Third Reich: The Reich ring for National Socialist propaganda and public enlightenment. German Studies Review 33 (2010). 93--118. DOI: http://dx.doi.org/10.2307/40574929 · doi:10.2307/40574929
- Norman K. Denzin and Yvonna S. Lincoln (Eds.). 1994. Grounded Theory Methodology: An Overview. Anselm Strauss and Juliet Corbin. Handbook of Qualitative Research. Sage Thousand Oaks CA. Norman K. Denzin and Yvonna S. Lincoln (Eds.). 1994. Grounded Theory Methodology: An Overview. Anselm Strauss and Juliet Corbin. Handbook of Qualitative Research. Sage Thousand Oaks CA.
- English Oxford Living Dictionaries. Disinformation. Retrieved April 3 2019 from https://en.oxforddictionaries.com/definition/disinformation English Oxford Living Dictionaries. Disinformation. Retrieved April 3 2019 from https://en.oxforddictionaries.com/definition/disinformation
- Robert M. Faris , Hal Roberts , Bruce Etling , Nikki Bourassa , Ethan Zuckerman , and Yochai Benkler . 2017. Partisanship, Propaganda, and Disinformation : Online Media and the 2016 U.S. Presidential Election . Berkman Klein Center for Internet & Society Research. Harvard University , Cambridge, Massachusetts, United States. Robert M. Faris, Hal Roberts, Bruce Etling, Nikki Bourassa, Ethan Zuckerman, and Yochai Benkler. 2017. Partisanship, Propaganda, and Disinformation: Online Media and the 2016 U.S. Presidential Election. Berkman Klein Center for Internet & Society Research. Harvard University, Cambridge, Massachusetts, United States.
- Sam Gill . 2019. The price of progress: How "Digital Pollution" is poisoning democracy and what we can do about it. (January 2019 ). Retrieved April 3, 2019 from https://knightfoundation.org/articles/the-price-of-progress-how-digital-pollution-is-poisoning-democracy-and-what-we-can-do-about-it Sam Gill. 2019. The price of progress: How "Digital Pollution" is poisoning democracy and what we can do about it. (January 2019). Retrieved April 3, 2019 from https://knightfoundation.org/articles/the-price-of-progress-how-digital-pollution-is-poisoning-democracy-and-what-we-can-do-about-it
- Nathaniel Gleicher . 2019 . Coordinated Inauthentic Behavior Explained. Facebook Newsroom. (December 2018) . Retrieved June 26, 2019 from https://newsroom.fb.com/news/2018/12/inside-feed-coordinated-inauthentic-behavior/ Nathaniel Gleicher. 2019. Coordinated Inauthentic Behavior Explained. Facebook Newsroom. (December 2018). Retrieved June 26, 2019 from https://newsroom.fb.com/news/2018/12/inside-feed-coordinated-inauthentic-behavior/
- Nathaniel Gleicher . 2019. Removing Coordinated Inauthentic Behavior and Spam From India and Pakistan. (April 2019) Retrieved April 3, 2019 from https://newsroom.fb.com/news/2019/04/cib-and-spam-from-india-pakistan/ Nathaniel Gleicher. 2019. Removing Coordinated Inauthentic Behavior and Spam From India and Pakistan. (April 2019) Retrieved April 3, 2019 from https://newsroom.fb.com/news/2019/04/cib-and-spam-from-india-pakistan/
- Matthew Levinger . 2018 . Master Narratives of Disinformation Campaigns . Journal of International Affairs 71 , 1 .5 (2018). 125--134. Matthew Levinger. 2018. Master Narratives of Disinformation Campaigns. Journal of International Affairs 71, 1.5 (2018). 125--134.
- Herbert S. Lin and Jaclyn Kerr . 2017 . On Cyber-Enabled Information/Influence Warfare and Manipulation. Oxford University Press , UK. Herbert S. Lin and Jaclyn Kerr. 2017. On Cyber-Enabled Information/Influence Warfare and Manipulation. Oxford University Press, UK.
- Jonathan Corp us Ong and Jason Vincent A. Cabanes . 2018. Architects of Networked Disinformation. The Newton Tech4Dev Network . University of Leeds , Leeds, UK . Retrieved from http://newtontechfordev.com/wp-content/uploads/ 2018 /02/ARCHITECTS-OF-NETWORKED-DISINFORMATION-FULL-REPORT.pdf Jonathan Corpus Ong and Jason Vincent A. Cabanes. 2018. Architects of Networked Disinformation. The Newton Tech4Dev Network. University of Leeds, Leeds, UK. Retrieved from http://newtontechfordev.com/wp-content/uploads/2018/02/ARCHITECTS-OF-NETWORKED-DISINFORMATION-FULL-REPORT.pdf
- Peter Pomerantsev . The Kremlin's information war. Journal of Democracy 26, 4 ( 2015 ). 40--50. Peter Pomerantsev. The Kremlin's information war. Journal of Democracy 26, 4 (2015). 40--50.
- David Rees . 1984. Soviet Active Measure: The Propaganda War . Institute for the Study of Conflict , London, UK . David Rees. 1984. Soviet Active Measure: The Propaganda War. Institute for the Study of Conflict, London, UK.
- Craig Silverman . 2018 . Russian Trolls Ran Wild On Tumblr And The Company Refuses To Say Anything About It. (Feb. 2018) . Retrieved April 17, 2018 from https://www.buzzfeed.com/craigsilverman/russian-trolls-ran-wild-on-tumblr-and-the-company-refuses?utm_term=.ad65gb5jz#.rdwOw8O6Z Craig Silverman. 2018. Russian Trolls Ran Wild On Tumblr And The Company Refuses To Say Anything About It. (Feb. 2018). Retrieved April 17, 2018 from https://www.buzzfeed.com/craigsilverman/russian-trolls-ran-wild-on-tumblr-and-the-company-refuses?utm_term=.ad65gb5jz#.rdwOw8O6Z
- Andrei Soshnikov . 2015 . The capital of political trolling. MR7.ru. (March 2015) . Retrieved June 26, 2016 from https://mr-7.ru/articles/112478/ Andrei Soshnikov. 2015. The capital of political trolling. MR7.ru. (March 2015). Retrieved June 26, 2016 from https://mr-7.ru/articles/112478/
- Supraja Srinivasan . 2018 . We don't want to be arbiters of truth: YouTube CBO Robert Kyncl. Economic Times/India Times. (March 2018) . Retrieved June 26, 2019 from https://tech.economictimes.indiatimes.com/news/internet/we-dont-want-to-be-arbiters-of-truth-youtube-cbo-robert-kyncl/63438805 Supraja Srinivasan. 2018. We don't want to be arbiters of truth: YouTube CBO Robert Kyncl. Economic Times/India Times. (March 2018). Retrieved June 26, 2019 from https://tech.economictimes.indiatimes.com/news/internet/we-dont-want-to-be-arbiters-of-truth-youtube-cbo-robert-kyncl/63438805
- Alex Stamos . 2018 . Authenticity Matters: The IRA Has No Place on Facebook. (Apr. 2018) Retrieved April 17, 2018 from https://newsroom.fb.com/news/2018/04/authenticity-matters/ Alex Stamos. 2018. Authenticity Matters: The IRA Has No Place on Facebook. (Apr. 2018) Retrieved April 17, 2018 from https://newsroom.fb.com/news/2018/04/authenticity-matters/
- The Internet Archive . About the Internet Archive . Retrieved April 17, 2018 from https://archive.org/about/ The Internet Archive. About the Internet Archive. Retrieved April 17, 2018 from https://archive.org/about/
- Tumblr Help Center . 2018 . Public Record of Usernames Linked to State-Sponsored Disinformation Campaigns. (Mar. 2018) . Retrieved April 17, 2018 from https://tumblr.zendesk.com/hc/en-us/articles/360002280214 Tumblr Help Center. 2018. Public Record of Usernames Linked to State-Sponsored Disinformation Campaigns. (Mar. 2018). Retrieved April 17, 2018 from https://tumblr.zendesk.com/hc/en-us/articles/360002280214
- Clair Wardle and Hossein Derakhshan . 2017 . Information Disorder: Toward an Interdisciplinary Framework for Research and Policy Making . Council of Europe Report . Clair Wardle and Hossein Derakhshan. 2017. Information Disorder: Toward an Interdisciplinary Framework for Research and Policy Making. Council of Europe Report.
- YouTube. 2019 . Our Ongoing Work to Tackle Hate. Official Blog. (June 2019) . Retrieved June 26, 2019 from https://youtube.googleblog.com/2019/06/our-ongoing-work-to-tackle-hate.html YouTube. 2019. Our Ongoing Work to Tackle Hate. Official Blog. (June 2019). Retrieved June 26, 2019 from https://youtube.googleblog.com/2019/06/our-ongoing-work-to-tackle-hate.html
Cited by
Fake news, disinformation and misinformation in social media: a review
Aïmeur, E., Amri, S., & Brassard, G. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01028-5 · Cited by 772
Misinformation in and about science
West, J. D., & Bergstrom, C. T. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912444117 · Cited by 391
Disinformation as a Threat to Deliberative Democracy
McKay, S., & Tenove, C. (2021) · Political Research Quarterly · doi:10.1177/1065912920938143 · Cited by 378
How social learning amplifies moral outrage expression in online social networks
Brady, W. J., McLoughlin, K., Doan, T. N., & Crockett, M. J. (2021) · Science Advances · doi:10.1126/sciadv.abe5641 · Cited by 375
“There is a high likelihood that both processes occur in tandem and feed into one another, as the joint influence of learning and self-selection into networks or social media platforms has been examined in recent work ( 34 , 50 ).”
BackgroundInfluentialEcho chambers, filter bubbles, and polarisation: a literature review
Arguedas, R., Robertson, C. T., Fletcher, R., & Nielsen, R. K. (2022) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.60625/risj-etxj-7k60 · Cited by 334
Metadata
- Authors
- Starbird, K., Arif, A., & Wilson, T.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2019-11-07
- Volume
- 3
- Issue
- CSCW
- Pages
- 1-26
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2988120509
- Cited by
- 370
- References
- 76
- Citations by year
- 2026: 50 · 2025: 82 · 2024: 47 · 2023: 68 · 2022: 46 · 2021: 46 · 2020: 29 · 2019: 2
- FWCI
- 61.88
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Funders
- Office of Naval Research (N000141712980, N000141812012)
- National Science Foundation (1749815, 1715078)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Communication › Social Media and Politics
- Social Sciences › Political Science and International Relations › European and Russian Geopolitical Military Strategies
- Keywords
- disinformation, political propaganda, online manipulation, collaboration, online crowds, socio-technical systems, bots, trolls, emergent behavior, platform design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.