Disinformation as Collaborative Work: Surfacing the Participatory Nature of Strategic Information Operations
Open accessThe DOI matches its Crossref record; 75 of the 76 references it cites were found in a registry or an index.
Abstract
In this paper, we argue that strategic information operations (e.g. disinformation, political propaganda, and other forms of online manipulation) are a critical concern for CSCW researchers, and that the CSCW community can provide vital insight into understanding how these operations function-by examining them as collaborative "work" within online crowds. First, we provide needed definitions and a framework for conceptualizing strategic information operations, highlighting related literatures and noting historical context. Next, we examine three case studies of online information operations using a sociotechnical lens that draws on CSCW theories and methods to account for the mutual shaping of technology, social structure, and human action. Through this lens, we contribute a more nuanced understanding of these operations (beyond "bots" and "trolls") and highlight a persistent challenge for researchers, platform designers, and policy makers-distinguishing between orchestrated, explicitly coordinated, information operations and the emergent, organic behaviors of an online crowd.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The 'falsehood firehose' is another strategy that pushes huge volumes of self-contradictory disinformation (123), meant to deceive, confuse, disorient, and agitate (124, 125).”
From Misinformation in and about science (2021) · cites this paper as [125]
Citations
Cites
(1984) · Cited by 21,166
The Interpretation of Cultures
(2017) · Macat Library eBooks · doi:10.4324/9781912128310 · Cited by 16,449
(2014) · Cited by 15,747
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801 · cited 1×
“structuration [26], sociomateriality [61], and distributed cognition [39]—to assist in the investigation both of how technology shapes work within formal organizations [60, 61] and of how online environments facilitate and shape collective behavior in the “crowd” [82, 86, 95].”
BackgroundThe theory of communicative action
(2014) · The Philosophy of Habermas · doi:10.4324/9781315710495-5 · Cited by 8,634
The Duality of Technology: Rethinking the Concept of Technology in Organizations
Orlikowski, W. J. (1992) · Organization Science · doi:10.1287/orsc.3.3.398 · Cited by 4,957 · cited 2×
“…theories—e.g. structuration [26], sociomateriality [61], and distributed cognition [39]—to assist in the investigation both of how technology shapes work within formal organizations [60, 61] and of how online environments facilitate and shape collective behavior in the “crowd” [82, 86, 95].”
BackgroundI tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience
Marwick, A. E., & boyd, D. (2011) · New Media & Society · doi:10.1177/1461444810365313 · Cited by 4,612 · cited 1×
“Finally, social media feeds combine different types of content such as news and entertainment, collapsing different contexts together [55].”
BackgroundSociomaterial practices: exploring technology at work
Orlikowski, W. J. (2007) · Organization Studies · doi:10.1177/0170840607081138 · Cited by 3,248 · cited 2×
“structuration [26], sociomateriality [61], and distributed cognition [39]—to assist in the investigation both of how technology shapes work within formal organizations [60, 61] and of how online environments facilitate and shape collective behavior in the “crowd” [82, 86, 95].”
BackgroundEthics, Reflexivity, and “Ethically Important Moments” in Research
Guillemin, M., & Gillam, L. (2004) · Qualitative Inquiry · doi:10.1177/1077800403262360 · Cited by 2,671
Awareness and coordination in shared workspaces
Dourish, P., & Bellotti, V. (1992) · Proceedings of the 1992 ACM conference on Computer-supported cooperative work - CSCW '92 · doi:10.1145/143457.143468 · Cited by 2,550
Research works printed but not linked: 24
- Dan Arnaudo . 2017. Computational Propaganda in Brazil: Social Bots during Elections. Computational Propaganda Research Project . Oxford University , Oxford, UK . Dan Arnaudo. 2017. Computational Propaganda in Brazil: Social Bots during Elections. Computational Propaganda Research Project. Oxford University, Oxford, UK.
- Ronald M. Baecker Jonathan Grudin William A. S. Buxton and Saul Greenberg (Ed.). 1995. Groupware and social dynamics: Eight challenges for developers. Readings in Human--Computer Interaction. DOI: https://doi.org/10.1016/B978-0-08-051574--8.50079-0. Ronald M. Baecker Jonathan Grudin William A. S. Buxton and Saul Greenberg (Ed.). 1995. Groupware and social dynamics: Eight challenges for developers. Readings in Human--Computer Interaction. DOI: https://doi.org/10.1016/B978-0-08-051574--8.50079-0. · doi:10.1016/b978-0-08-051574--8.50079-0
- Samantha Bradshaw and Phillip N . Howard . 2018 . Challenging truth and trust: A global inventory of organized social media manipulation. Computational Propaganda Research Project. Oxford University , Oxford, UK. Samantha Bradshaw and Phillip N. Howard. 2018. Challenging truth and trust: A global inventory of organized social media manipulation. Computational Propaganda Research Project. Oxford University, Oxford, UK.
- Samantha Bradshaw and Phillip N . Howard . 2018 . Why does Junk News Spread So Quickly Across Social Media? Algorithms, Advertising and Exposure in Public Life. Knight Foundation. Retrieved from https://kf-site -production.s3.amazonaws.com/media_elements/files/000/000/142/original/Topos_KF_ White-Paper _Howard_V1_ado.pdf Samantha Bradshaw and Phillip N. Howard. 2018. Why does Junk News Spread So Quickly Across Social Media? Algorithms, Advertising and Exposure in Public Life. Knight Foundation. Retrieved from https://kf-site -production.s3.amazonaws.com/media_elements/files/000/000/142/original/Topos_KF_ White-Paper_Howard_V1_ado.pdf
- Randall L. Bytwerk . 2010 . Grassroots propaganda in the Third Reich: The Reich ring for National Socialist propaganda and public enlightenment . German Studies Review 33 (2010). 93 -- 118 . DOI: http://dx.doi.org/10.2307/40574929 Randall L. Bytwerk. 2010. Grassroots propaganda in the Third Reich: The Reich ring for National Socialist propaganda and public enlightenment. German Studies Review 33 (2010). 93--118. DOI: http://dx.doi.org/10.2307/40574929 · doi:10.2307/40574929
- Norman K. Denzin and Yvonna S. Lincoln (Eds.). 1994. Grounded Theory Methodology: An Overview. Anselm Strauss and Juliet Corbin. Handbook of Qualitative Research. Sage Thousand Oaks CA. Norman K. Denzin and Yvonna S. Lincoln (Eds.). 1994. Grounded Theory Methodology: An Overview. Anselm Strauss and Juliet Corbin. Handbook of Qualitative Research. Sage Thousand Oaks CA.
- English Oxford Living Dictionaries. Disinformation. Retrieved April 3 2019 from https://en.oxforddictionaries.com/definition/disinformation English Oxford Living Dictionaries. Disinformation. Retrieved April 3 2019 from https://en.oxforddictionaries.com/definition/disinformation
- Robert M. Faris , Hal Roberts , Bruce Etling , Nikki Bourassa , Ethan Zuckerman , and Yochai Benkler . 2017. Partisanship, Propaganda, and Disinformation : Online Media and the 2016 U.S. Presidential Election . Berkman Klein Center for Internet & Society Research. Harvard University , Cambridge, Massachusetts, United States. Robert M. Faris, Hal Roberts, Bruce Etling, Nikki Bourassa, Ethan Zuckerman, and Yochai Benkler. 2017. Partisanship, Propaganda, and Disinformation: Online Media and the 2016 U.S. Presidential Election. Berkman Klein Center for Internet & Society Research. Harvard University, Cambridge, Massachusetts, United States.
- Sam Gill . 2019. The price of progress: How "Digital Pollution" is poisoning democracy and what we can do about it. (January 2019 ). Retrieved April 3, 2019 from https://knightfoundation.org/articles/the-price-of-progress-how-digital-pollution-is-poisoning-democracy-and-what-we-can-do-about-it Sam Gill. 2019. The price of progress: How "Digital Pollution" is poisoning democracy and what we can do about it. (January 2019). Retrieved April 3, 2019 from https://knightfoundation.org/articles/the-price-of-progress-how-digital-pollution-is-poisoning-democracy-and-what-we-can-do-about-it
- Nathaniel Gleicher . 2019 . Coordinated Inauthentic Behavior Explained. Facebook Newsroom. (December 2018) . Retrieved June 26, 2019 from https://newsroom.fb.com/news/2018/12/inside-feed-coordinated-inauthentic-behavior/ Nathaniel Gleicher. 2019. Coordinated Inauthentic Behavior Explained. Facebook Newsroom. (December 2018). Retrieved June 26, 2019 from https://newsroom.fb.com/news/2018/12/inside-feed-coordinated-inauthentic-behavior/
- Nathaniel Gleicher . 2019. Removing Coordinated Inauthentic Behavior and Spam From India and Pakistan. (April 2019) Retrieved April 3, 2019 from https://newsroom.fb.com/news/2019/04/cib-and-spam-from-india-pakistan/ Nathaniel Gleicher. 2019. Removing Coordinated Inauthentic Behavior and Spam From India and Pakistan. (April 2019) Retrieved April 3, 2019 from https://newsroom.fb.com/news/2019/04/cib-and-spam-from-india-pakistan/
- Matthew Levinger . 2018 . Master Narratives of Disinformation Campaigns . Journal of International Affairs 71 , 1 .5 (2018). 125--134. Matthew Levinger. 2018. Master Narratives of Disinformation Campaigns. Journal of International Affairs 71, 1.5 (2018). 125--134.
- Herbert S. Lin and Jaclyn Kerr . 2017 . On Cyber-Enabled Information/Influence Warfare and Manipulation. Oxford University Press , UK. Herbert S. Lin and Jaclyn Kerr. 2017. On Cyber-Enabled Information/Influence Warfare and Manipulation. Oxford University Press, UK.
- Jonathan Corp us Ong and Jason Vincent A. Cabanes . 2018. Architects of Networked Disinformation. The Newton Tech4Dev Network . University of Leeds , Leeds, UK . Retrieved from http://newtontechfordev.com/wp-content/uploads/ 2018 /02/ARCHITECTS-OF-NETWORKED-DISINFORMATION-FULL-REPORT.pdf Jonathan Corpus Ong and Jason Vincent A. Cabanes. 2018. Architects of Networked Disinformation. The Newton Tech4Dev Network. University of Leeds, Leeds, UK. Retrieved from http://newtontechfordev.com/wp-content/uploads/2018/02/ARCHITECTS-OF-NETWORKED-DISINFORMATION-FULL-REPORT.pdf
- Peter Pomerantsev . The Kremlin's information war. Journal of Democracy 26, 4 ( 2015 ). 40--50. Peter Pomerantsev. The Kremlin's information war. Journal of Democracy 26, 4 (2015). 40--50.
- David Rees . 1984. Soviet Active Measure: The Propaganda War . Institute for the Study of Conflict , London, UK . David Rees. 1984. Soviet Active Measure: The Propaganda War. Institute for the Study of Conflict, London, UK.
- Craig Silverman . 2018 . Russian Trolls Ran Wild On Tumblr And The Company Refuses To Say Anything About It. (Feb. 2018) . Retrieved April 17, 2018 from https://www.buzzfeed.com/craigsilverman/russian-trolls-ran-wild-on-tumblr-and-the-company-refuses?utm_term=.ad65gb5jz#.rdwOw8O6Z Craig Silverman. 2018. Russian Trolls Ran Wild On Tumblr And The Company Refuses To Say Anything About It. (Feb. 2018). Retrieved April 17, 2018 from https://www.buzzfeed.com/craigsilverman/russian-trolls-ran-wild-on-tumblr-and-the-company-refuses?utm_term=.ad65gb5jz#.rdwOw8O6Z
- Andrei Soshnikov . 2015 . The capital of political trolling. MR7.ru. (March 2015) . Retrieved June 26, 2016 from https://mr-7.ru/articles/112478/ Andrei Soshnikov. 2015. The capital of political trolling. MR7.ru. (March 2015). Retrieved June 26, 2016 from https://mr-7.ru/articles/112478/
- Supraja Srinivasan . 2018 . We don't want to be arbiters of truth: YouTube CBO Robert Kyncl. Economic Times/India Times. (March 2018) . Retrieved June 26, 2019 from https://tech.economictimes.indiatimes.com/news/internet/we-dont-want-to-be-arbiters-of-truth-youtube-cbo-robert-kyncl/63438805 Supraja Srinivasan. 2018. We don't want to be arbiters of truth: YouTube CBO Robert Kyncl. Economic Times/India Times. (March 2018). Retrieved June 26, 2019 from https://tech.economictimes.indiatimes.com/news/internet/we-dont-want-to-be-arbiters-of-truth-youtube-cbo-robert-kyncl/63438805
- Alex Stamos . 2018 . Authenticity Matters: The IRA Has No Place on Facebook. (Apr. 2018) Retrieved April 17, 2018 from https://newsroom.fb.com/news/2018/04/authenticity-matters/ Alex Stamos. 2018. Authenticity Matters: The IRA Has No Place on Facebook. (Apr. 2018) Retrieved April 17, 2018 from https://newsroom.fb.com/news/2018/04/authenticity-matters/
- The Internet Archive . About the Internet Archive . Retrieved April 17, 2018 from https://archive.org/about/ The Internet Archive. About the Internet Archive. Retrieved April 17, 2018 from https://archive.org/about/
- Tumblr Help Center . 2018 . Public Record of Usernames Linked to State-Sponsored Disinformation Campaigns. (Mar. 2018) . Retrieved April 17, 2018 from https://tumblr.zendesk.com/hc/en-us/articles/360002280214 Tumblr Help Center. 2018. Public Record of Usernames Linked to State-Sponsored Disinformation Campaigns. (Mar. 2018). Retrieved April 17, 2018 from https://tumblr.zendesk.com/hc/en-us/articles/360002280214
- Clair Wardle and Hossein Derakhshan . 2017 . Information Disorder: Toward an Interdisciplinary Framework for Research and Policy Making . Council of Europe Report . Clair Wardle and Hossein Derakhshan. 2017. Information Disorder: Toward an Interdisciplinary Framework for Research and Policy Making. Council of Europe Report.
- YouTube. 2019 . Our Ongoing Work to Tackle Hate. Official Blog. (June 2019) . Retrieved June 26, 2019 from https://youtube.googleblog.com/2019/06/our-ongoing-work-to-tackle-hate.html YouTube. 2019. Our Ongoing Work to Tackle Hate. Official Blog. (June 2019). Retrieved June 26, 2019 from https://youtube.googleblog.com/2019/06/our-ongoing-work-to-tackle-hate.html
Cited by
Fake news, disinformation and misinformation in social media: a review
Aïmeur, E., Amri, S., & Brassard, G. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01028-5 · Cited by 772
Misinformation in and about science
West, J. D., & Bergstrom, C. T. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912444117 · Cited by 391
Disinformation as a Threat to Deliberative Democracy
McKay, S., & Tenove, C. (2021) · Political Research Quarterly · doi:10.1177/1065912920938143 · Cited by 378
How social learning amplifies moral outrage expression in online social networks
Brady, W. J., McLoughlin, K., Doan, T. N., & Crockett, M. J. (2021) · Science Advances · doi:10.1126/sciadv.abe5641 · Cited by 375
“There is a high likelihood that both processes occur in tandem and feed into one another, as the joint influence of learning and self-selection into networks or social media platforms has been examined in recent work ( 34 , 50 ).”
BackgroundInfluentialEcho chambers, filter bubbles, and polarisation: a literature review
Arguedas, R., Robertson, C. T., Fletcher, R., & Nielsen, R. K. (2022) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.60625/risj-etxj-7k60 · Cited by 334
Lee, C., Yang, T., Inchoco, G. D., Jones, G. M., & Satyanarayan, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445211 · Cited by 140
SoK: Hate, Harassment, and the Changing Landscape of Online Abuse
Thomas, K., Akhawe, D., Bailey, M., Boneh, D., Bursztein, E., Consolvo, S., Dell, N., Durumeric, Z., Kelley, P. G., Kumar, D., et al. (2021) · 2021 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40001.2021.00028 · Cited by 148
Paradoxes of Media and Information Literacy: The Crisis of Information
Haider, J., & Sundin, O. (2022) · Routledge eBooks · doi:10.4324/9781003163237 · Cited by 189
Goldstein, J. A., Sastry, G., Musser, M., DiResta, R., Gentzel, M., & Sedova, K. (2023) · arXiv · doi:10.48550/arxiv.2301.04246 · Cited by 152
Cross-Platform Disinformation Campaigns: Lessons Learned and Next Steps
Starbird, K., & Wilson, T. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-002 · Cited by 109
“The entanglement of sincere activists, journalists, and information operations complicates simplistic views of disinformation campaigns as being the work of “bots” and “trolls” (Starbird et al., 2019).”
BackgroundInfluentialSelf-citationPracticing Information Sensibility: How Gen Z Engages with Online Information
Hassoun, A., Beacock, I., Consolvo, S., Goldberg, B., Kelley, P. G., & Russell, D. M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581328 · Cited by 147
Charting the Landscape of Online Cryptocurrency Manipulation
Nizzoli, L., Tardelli, S., Avvenuti, M., Cresci, S., Tesconi, M., & Ferrara, E. (2020) · IEEE Access · doi:10.1109/access.2020.3003370 · Cited by 132
Countering Fake News: A Comparison of Possible Solutions Regarding User Acceptance and Effectiveness
Kirchner, J., & Reuter, C. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415211 · Cited by 123
Brady, W. J., McLoughlin, K. L., Torres, M. P., Luo, K. F., Gendron, M., & Crockett, M. J. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01582-0 · Cited by 121
Austin, E. W., Austin, B., Willoughby, J. F., Amram, O., & Domgaard, S. (2021) · Journal of Health Communication · doi:10.1080/10810730.2021.1899345 · Cited by 115
The Tools and Tactics Used in Intimate Partner Surveillance: An Analysis of Online Infidelity ForumsPreprint
Tseng, E., Bellini, R. F., McDonald, N., Danos, M., Greenstadt, R., McCoy, D., Dell, N. L., & Ristenpart, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.14341 · Cited by 115
“strategies that facilitate abuse [13]. Similar methods have also been used to analyze forums associated with hate groups [7,38], cyberbullying [8,29], doxxing [40], mis- and disinformation campaigns [42], harassment [24,25,31], and sex trafficking [37]. These measurement studies include ones that directly document abus…”
MethodUyheng, J., & Carley, K. M. (2020) · Journal of Computational Social Science · doi:10.1007/s42001-020-00087-4 · Cited by 96
“Without discounting that the broader public may organically engage in hateful talk online [71, 72], the evidence that bots exert significant influence in driving digital toxicity nonetheless makes it important for researchers to examine their potential impacts in the context of the pandemic [74, 79].”
BackgroundHaque, M. M., Yousuf, M., Alam, A. S., Saha, P., Ahmed, S. I., & Hassan, N. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415201 · Cited by 83
“o U.S. voters via social media [10]. Russia is also believed to have conducted strategic information operations against the U.S. targeting political discourses, such as the #BlackLivesMatter movement [95]. Starbird et al. [95] found that the Russian Internet Research Agency (IRA) targeted, infiltrated, and cultivated…”
BackgroundUnveiling Coordinated Groups Behind White Helmets Disinformation
Pacheco, D. F., Flammini, A., & Menczer, F. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366424.3385775 · Cited by 107
“[19] presented a case study related to the White Helmets disinformation campaign.”
BackgroundAmplifying influence through coordinated behaviour in social networks
Weber, D., & Neumann, F. (2021) · Social Network Analysis and Mining · doi:10.1007/s13278-021-00815-2 · Cited by 71
“Modern Strategic Information Operations (SIOs) are participatory activities, which aim to use their audiences to amplify their desired narratives, not just receive it (Starbird et al. 2019).”
BackgroundInterventions to Mitigate COVID-19 Misinformation: A Systematic Review and Meta-Analysis
Janmohamed, K., Walter, N., Nyhan, K., Khoshnood, K., Tucker, J. D., Sangngam, N., Altice, F. L., Ding, Q., Wong, A., Schwitzky, Z. M., et al. (2021) · Journal of Health Communication · doi:10.1080/10810730.2021.2021460 · Cited by 104
Coordinated Behavior on Social Media in 2019 UK General Election
Nizzoli, L., Tardelli, S., Avvenuti, M., Cresci, S., & Tesconi, M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v15i1.18074 · Cited by 95
Misleading Beyond Visual Tricks: How People Actually Lie with Charts
Lisnic, M., Polychronis, C., Lex, A., & Kogan, M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580910 · Cited by 97
Influence and Improvisation: Participatory Disinformation during the 2020 US Election
Starbird, K., DiResta, R., & DeButts, M. (2023) · Social Media + Society · doi:10.1177/20563051231177943 · Cited by 90
“In this article, we seek to unpack those participatory dynamics—both the top-down (elite-driven) dynamics stressed by Benkler et al. (2020) and others, and the bottomup (collaborative) dynamics noted by Starbird et al. (2019), as well as the interplay between them.”
BackgroundMethodResultInfluentialSelf-citationPark, C. Y., Mendelsohn, J., Field, A., & Tsvetkov, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.382 · Cited by 88
The Spread of Propaganda by Coordinated Communities on Social Media
Hristakieva, K., Cresci, S., Martino, G. D. S., Conti, M., & Nakov, P. (2022) · ACM Web Science Conference (WebSci) · doi:10.1145/3501247.3531543 · Cited by 83
Harambam, J. (2021) · Journal for Cultural Research · doi:10.1080/14797585.2021.1886424 · Cited by 80
Defining Misinformation and Related Terms in Health-Related Literature: Scoping Review
Mikati, I. K. E., Hoteit, R., Harb, T., Zein, O. E., Piggott, T., Melki, J. P., Mustafa, R. A., & Akl, E. A. (2023) · Journal of Medical Internet Research · doi:10.2196/45731 · Cited by 76
Prochaska, S., Duskin, K., Kharazian, Z., Minow, C., Blucker, S., Venuto, S., West, J. D., & Starbird, K. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579616 · Cited by 76
Self-citationOn the Detection of Disinformation Campaign Activity with Network Analysis
Vargas, L., Emami, P., & Traynor, P. (2020) · Proceedings of the 2020 ACM SIGSAC Conference on Cloud Computing Security Workshop · doi:10.1145/3411495.3421363 · Cited by 74
Aghajari, Z., Baumer, E. P. S., & DiFranzo, D. J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579520 · Cited by 74
Ling, C., Stringhini, G., Balci, U., & Blackburn, J. (2021) · IEEE Security & Privacy · doi:10.1109/msec.2021.3127392 · Cited by 71
Characterizing network dynamics of online hate communities around the COVID-19 pandemic
Uyheng, J., & Carley, K. M. (2021) · Applied Network Science · doi:10.1007/s41109-021-00362-x · Cited by 70
Misinformation and professional news on largely unmoderated platforms: the case of telegram
Herasimenka, A., Bright, J., Knuutila, A., & Howard, P. N. (2022) · Journal of Information Technology & Politics · doi:10.1080/19331681.2022.2076272 · Cited by 68
It's Not What It Looks Like: Manipulating Perceptual Hashing based Applications
Hao, Q., Luo, L., Jan, S. T. K., & Wang, G. (2021) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3460120.3484559 · Cited by 64
Broniatowski, D. A., Simons, J. R., Gu, J., Jamison, A. M., & Abroms, L. C. (2023) · Science Advances · doi:10.1126/sciadv.adh2132 · Cited by 62
“Antivaccine page administrators can use this structure to disseminate content to users in a manner that is mediated by participatory ( 52 ) discussion groups that facilitate awareness of and demand for antivaccine content.”
BackgroundTrend Alert: A Cross-Platform Organization Manipulated Twitter Trends in the Indian General Election
Jakesch, M., Garimella, K. V., Eckles, D., & Naaman, M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479523 · Cited by 63
Misinfo Reaction Frames: Reasoning about Readers’ Reactions to News Headlines
Gabriel, S., Hallinan, S., Sap, M., Nguyen, P., Roesner, F., Choi, E., & Choi, Y. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.222 · Cited by 28
Biancovilli, P., Makszin, L., & Jurberg, C. (2021) · BMC Public Health · doi:10.1186/s12889-021-11165-1 · Cited by 62
Tully, M., Madrid‐Morales, D., Wasserman, H., Gondwe, G., & Ireri, K. (2021) · Digital Journalism · doi:10.1080/21670811.2021.1965491 · Cited by 61
“…by Bontcheva et al. (2020) and supported by research that takes a socio-technical perspective (Marwick 2018; Saurwein and Spencer-Smith 2020; Starbird, Arif, and Wilson 2019) highlights that the responsibility for countering misinformation is shared across actors and is context dependent as…”
BackgroundInfluentialHaughey, M. M., Muralikumar, M. D., Wood, C. A., & Starbird, K. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415204 · Cited by 60
Self-citationAustin, E. W., Borah, P., & Domgaard, S. (2021) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-58 · Cited by 60
“Moreover, disinformation purveyors increasingly use fake outlets (Alba & Nicas, 2020) and fake local hashtags (Starbird et al., 2019) to replace real, local journalism that is disappearing from communities, particularly those with less affluence (Abernathy, 2020).”
BackgroundWilson, T., & Starbird, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476086 · Cited by 60
Self-citationPlaying Both Sides: Russian State-Backed Media Coverage of the #BlackLivesMatter Movement
Bradshaw, S., DiResta, R., & Miller, C. (2022) · The International Journal of Press/Politics · doi:10.1177/19401612221082052 · Cited by 59
“(Starbird, Arif, and Wilson 2019).”
Hackenburg, K., Ibrahim, L., Tappin, B. M., & Tsakiris, M. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02464-x · Cited by 23
A typology of disinformation intentionality and impact
French, A. M., Storey, V. C., & Wallace, L. G. (2023) · Information Systems Journal · doi:10.1111/isj.12495 · Cited by 57
The Gender Dimensions of Foreign Influence Operations
Bradshaw, S., & Henle, A. (2021) · International journal of communication · Cited by 56
Williams, A. R., Burke-Moore, L., Chan, R. S.-Y., Enock, F. E., Nanni, F., Sippy, T., Chung, Y.-L., Gabašová, E., Hackenburg, K., & Bright, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0317421 · Cited by 56
TrollMagnifier: Detecting State-Sponsored Troll Accounts on Reddit
Saeed, M. H., Ali, S., Blackburn, J., Cristofaro, E. D., Zannettou, S., & Stringhini, G. (2022) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46214.2022.9833706 · Cited by 56
Handbook of Computational Social Science for Policy
Bertoni, E., Fontana, M., Gabrielli, L., Signorelli, S., & Vespe, M. (2023) · Springer eBooks · doi:10.1007/978-3-031-16624-2 · Cited by 57
Chambers, S. (2023) · Constellations · doi:10.1111/1467-8675.12662 · Cited by 53
Bots in Social and Interaction Networks: Detection and Impact Estimation
Mendoza, M., Tesconi, M., & Cresci, S. (2021) · ACM Transactions on Information Systems · doi:10.1145/3419369 · Cited by 36
“Our findings also support other recent scientific work that stressed the role of hybrid accounts—such as unwitting humans, trolls, and possibly also cyborgs—in the spread of misinfor-mation [57].”
ResultInvestigating the difference between trolls, social bots, and humans on Twitter
Mazza, M., Avvenuti, M., Cresci, S., & Tesconi, M. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.09.022 · Cited by 51
Xiao, X., & Su, Y. (2022) · Internet Research · doi:10.1108/intr-10-2021-0791 · Cited by 50
Who's in the Gang? Revealing Coordinating Communities in Social Media
Weber, D., & Neumann, F. (2020) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam49781.2020.9381418 · Cited by 46
Tactics, Threats & Targets: Modeling Disinformation and its Mitigation
Mirza, S., Begum, L., Niu, L., Pardo, S., Abouzied, A., Papotti, P., & Pöpper, C. (2023) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2023.23657 · Cited by 45
Mapping the Design Space of Teachable Social Media Feed Experiences
Feng, K. J. K., Koo, X., Tan, L., Bruckman, A. S., McDonald, D. W., & Zhang, A. X. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642120 · Cited by 44
Detection and Characterization of Coordinated Online Behavior: A Survey
Mannocci, L., Mazza, M., Monreale, A., Tesconi, M., & Cresci, S. (2026) · ACM Computing Surveys · doi:10.1145/3839225 · Cited by 46
Pasquetto, I. V., Olivieri, A. F., Tacchetti, L., Riotta, G., & Spada, A. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512931 · Cited by 44
Computer-Supported Cooperative Work
Ciolfi, L., Lewkowicz, M., & Schmidt, K. (2023) · Springer eBooks · doi:10.1007/978-3-319-27648-9_30-1 · Cited by 44
In-House Vs. Outsourced Trolls: How Digital Mercenaries Shape State Influence Strategies
DiResta, R., Grossman, S., & Siegel, A. A. (2021) · Political Communication · doi:10.1080/10584609.2021.1994065 · Cited by 43
“The goal of this process of establishing audiences and building community is to facilitate authentic, participatory peer-to-peer transmission of content from real people who are unaware of its source, and act as unwitting spreaders and amplifiers (Starbird et al., 2019).”
BackgroundSubekti, D., Yusuf, M., Saadah, M., & Wahid, M. (2025) · Frontiers in Political Science · doi:10.3389/fpos.2025.1625535 · Cited by 43
Linder, R., Mohseni, S., Yang, F., Pentyala, S., Ragan, E. D., & Hu, X. (2021) · Applied AI Letters · doi:10.1002/ail2.49 · Cited by 43
Ng, L. H. X., Robertson, D. C., & Carley, K. M. (2022) · Online Social Networks and Media · doi:10.1016/j.osnem.2022.100198 · Cited by 42
The Far-Right Smokescreen: Environmental Conspiracy and Culture Wars on Brazilian YouTube
Salles, D., de Medeiros, P. M., Santini, R. M., & Barros, C. E. (2023) · Social Media + Society · doi:10.1177/20563051231196876 · Cited by 41
“A growing body of knowledge looks beyond orchestrated campaigns to consider the activities of “unwitting crowds” of online participants, granting a participatory character to disinformation campaigns (Starbird et al., 2019).”
BackgroundWrecking the public sphere: The new authoritarians’ digital attack on pluralism and truth
Chambers, S., & Kopstein, J. S. (2022) · Constellations · doi:10.1111/1467-8675.12620 · Cited by 40
From Adolescents' Eyes: Assessing an Indicator-Based Intervention to Combat Misinformation on TikTok
Hartwig, K., Biselli, T., Schneider, F., & Reuter, C. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642264 · Cited by 40
Akhtar, M. M., Masood, R., Ikram, M., & Kanhere, S. S. (2024) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3634737.3644998 · Cited by 39
Digital Civic Participation and Misinformation during the 2020 Taiwanese Presidential Election
Chang, H.-C. H., Haider, S., & Ferrara, E. (2021) · Media and Communication · doi:10.17645/mac.v9i1.3405 · Cited by 39
Adherence to Misinformation on Social Media Through Socio-Cognitive and Group-Based Processes
Efstratiou, A., & Cristofaro, E. D. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555589 · Cited by 38
Complicating the Resilience Model: A Four-Country Study About Misinformation
Boulianne, S., Tenove, C., & Buffie, J. (2022) · Media and Communication · doi:10.17645/mac.v10i3.5346 · Cited by 37
“Ordinary users are a major source of the spread of misinformation, leading some to refer to their “par‐ ticipatory” role in disinformation campaigns (Starbird et al., 2019).”
BackgroundProactive Discovery of Fake News Domains from Real-Time Social Media Feeds
Chen, Z., & Freire, J. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366424.3385772 · Cited by 37
Multifaceted online coordinated behavior in the 2020 US presidential election
Tardelli, S., Nizzoli, L., Avvenuti, M., Cresci, S., & Tesconi, M. (2024) · EPJ Data Science · doi:10.1140/epjds/s13688-024-00467-0 · Cited by 36
Age of Deception: Cybersecurity as Secret Statecraft
Lindsay, J. R. (2025) · Cornell University Press eBooks · doi:10.1353/book.134635 · Cited by 36
Misinformation, Crisis, and Public Health—Reviewing the Literature
Starbird, K., Spiro, E. S., & Koltai, K. (2020) · doi:10.35650/md.2063.d.2020 · Cited by 36
Self-citationModeling disinformation networks on Twitter: structure, behavior, and impact
Muñoz, P., Díez, F., & Bellogín, A. (2024) · Applied Network Science · doi:10.1007/s41109-024-00610-w · Cited by 36
Post-Post-API Age: Studying Digital Platforms in Scant Data Access Times
Mimizuka, K., Brown, M. A., Yang, K.-C., & Lukito, J. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816985 · Cited by 34
AI could create a perfect storm of climate misinformationPreprint
Galaz, V., Metzler, H., Daume, S., Olsson, A., Lindström, B., & Marklund, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.12807 · Cited by 35
This Account Doesn’t Exist: Tweet Decay and the Politics of Deletion in the Brexit Debate
Bastos, M. (2019) · American Behavioral Scientist · doi:10.1177/0002764221989772 · Cited by 34
Minici, M., Luceri, L., Cinus, F., & Ferrara, E. (2024) · First Monday · doi:10.5210/fm.v29i11.13831 · Cited by 32
‘Do your own research': affordance activation and disinformation spread
Tripodi, F. B., Garcia, L. C., & Marwick, A. E. (2024) · Information, Communication & Society · doi:10.1080/1369118x.2023.2245869 · Cited by 31
“…studies fi nd that tactics for spreading disinformation often exploit the human desire to fact-check information and encourage audiences to engage in participatory practices to create alternative facts (Lee et al., 2021; Marwick & Partin, 2022; Starbird et al., 2019; Tripodi, 2021; Tripodi, 2022).”
BackgroundKharazian, Z., Starbird, K., & Hill, B. M. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637338 · Cited by 31
Self-citationLu, Y., Pan, J., Xu, X., & Xu, Y. (2025) · American Journal of Political Science · doi:10.1111/ajps.12990 · Cited by 33
Lutz, B., Adam, M. T. P., Feuerriegel, S., Pröllochs, N., & Neumann, D. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3641030 · Cited by 31
"Positive Energy": Perceptions and Attitudes Towards COVID-19 Information on Social Media in China
Lu, Z., Jiang, Y., Shen, C., Jack, M., Wigdor, D., & Naaman, M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449251 · Cited by 31
Telegram as a Battlefield: Kremlin-Related Communications During the Russia-Ukraine Conflict
Bawa, A., Kursuncu, U., Achilov, D., Shalin, V. L., Agarwal, N., & Akbaş, E. (2025) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v19i1.35939 · Cited by 30
Analyzing Twitter Users' Behavior Before and After Contact by the Russia's Internet Research Agency
Dutta, U., Hanscom, R., Zhang, J. S., Han, R. Y., Lehman, T. S., Lv, Q., & Mishra, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449164 · Cited by 30
“ger scale. Starbird et al. conducted an interpretative analysis of a cross-platform campaign targeting a rescue group in Syria, which conceptualized what a disinformation campaign is and how it works [36,39]. DATA COLLECTION The goal of this research is to understand behavioral changes of general American Twitter user…”
BackgroundMatatov, H., Naaman, M., & Amir, O. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555599 · Cited by 31
Modeling information diffusion in social media: data-driven observations
Iamnitchi, A., Hall, L., Horawalavithana, S., Mubang, F., Ng, K. W., & Skvoretz, J. V. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2023.1135191 · Cited by 30
“” Scientists have analyzed the spread of information in various contexts, such as political manipulation and disinformation (Starbird et al., 2019; Ferrara et al., 2020; Francois et al., 2021).”
BackgroundCoordinated Behavior in Information Operations on Twitter
Cima, L., Mannocci, L., Avvenuti, M., Tesconi, M., & Cresci, S. (2024) · IEEE Access · doi:10.1109/access.2024.3393482 · Cited by 30
Relational AI: Facilitating Intergroup Cooperation with Socially Aware Conversational Support
Claggett, E. L., Kraut, R. E., & Shirado, H. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713757 · Cited by 29
Graham, T. (2024) · Media International Australia · doi:10.1177/1329878x241267756 · Cited by 29
“…dimensions of mis-and dis-information, where platforms play a critical mediating role in the feedback loop of communication between political elites and audiences that forms a kind of ‘ collaborative ’ model (Starbird et al., 2019) or ‘ participatory propaganda ’ (Wanless and Berk, 2017).”
Orlando, G. M., Ye, J., Gatta, V. L., Saeedi, M., Moscato, V., Ferrara, E., & Luceri, L. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792580 · Cited by 28
Schmid, S., Hartwig, K., Cieslinski, R., & Reuter, C. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10347-5 · Cited by 28
“While misinformation has been perceived as an exogenous issue, more recent works interested in successful collaboration of social media users have noted ideological foundations and (state) actors’ involvement (Nied et al., 2017; Starbird, 2017; Starbird et al., 2019).”
Lee, A. Y., Moore, R. C., & Hancock, J. T. (2023) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-111 · Cited by 28
Hofmann, M. K., Lakshmi, U. K., Mack, K., Hudson, S. E., Arriaga, R. I., & Mankoff, J. C. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445707 · Cited by 27
Bridging Action Frames: Instagram Infographics in U.S. Ethnic Movements
Kaviani, D., & Salehi, N. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512926 · Cited by 27
Evidence of inter-state coordination amongst state-backed information operations
Wang, X., Li, J., Srivatsavaya, E., & Rajtmajer, S. M. (2023) · Scientific Reports · doi:10.1038/s41598-023-34245-1 · Cited by 26
Shedding Light on ShadowbanningPreprint
Nicholas, G. (2022) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/xcz2t · Cited by 26
A systemic framework for disinformation on social media platforms
Recuero, R. (2025) · Platforms & Society · doi:10.1177/29768624251367199 · Cited by 26
“In the same direction of the conceptual shift, ore recent works, like Bastos and Tuters (2023) or Starbird et al. (2019) have pointed to more complex relations for the study of disinfor-mation.”
Metadata
- Authors
- Starbird, K., Arif, A., & Wilson, T.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2019-11-07
- Volume
- 3
- Issue
- CSCW
- Pages
- 1-26
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2988120509
- Cited by
- 370
- References
- 76
- Citations by year
- 2026: 50 · 2025: 82 · 2024: 47 · 2023: 68 · 2022: 46 · 2021: 46 · 2020: 29 · 2019: 2
- FWCI
- 61.88
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Funders
- Office of Naval Research (N000141712980, N000141812012)
- National Science Foundation (1749815, 1715078)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Communication › Social Media and Politics
- Social Sciences › Political Science and International Relations › European and Russian Geopolitical Military Strategies
- Keywords
- disinformation, political propaganda, online manipulation, collaboration, online crowds, socio-technical systems, bots, trolls, emergent behavior, platform design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.