Cited by 95Misinformation and Its ImpactsComplex Network Analysis TechniquesSpam and Phishing Detection

Coordinated Behavior on Social Media in 2019 UK General Election

Open access
Nizzoli, Leonardo, Tardelli, Serena, Avvenuti, Marco, Cresci, Stefano, Tesconi, Maurizio·2021·Proceedings of the International AAAI Conference on Web and Social Media

Abstract

Coordinated online behaviors are an essential part of information and influence operations, as they allow a more effective disinformation's spread. Most studies on coordinated behaviors involved manual investigations, and the few existing computational approaches make bold assumptions or oversimplify the problem to make it tractable. Here, we propose a new network-based framework for uncovering and studying coordinated behaviors on social media. Our research extends existing systems and goes beyond limiting binary classifications of coordinated and uncoordinated behaviors. It allows to expose different coordination patterns and to estimate the degree of coordination that characterizes diverse communities. We apply our framework to a dataset collected during the 2019 UK General Election, detecting and characterizing coordinated communities that participated in the electoral debate. Our work conveys both theoretical and practical implications and provides more nuanced and fine-grained results for studying online information manipulation.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1609/icwsm.v15i1.18074

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Key signals for unsupervised bot detection include temporal activities, common retweets, and URLs shared in tweets.

    “Key signals include temporal activities (Chavoshi et al., 2016;Keller et al., 2017), common retweets (Nizzoli et al., 2021), and URLs shared in tweets (Pacheco et al., 2021;Giglietto et al., 2020).”

    From Anatomy of an AI-powered malicious social botnet (2024) · cites this paper as Nizzoli et al., 2021

    In “Surfacing Coordination in 2019 UK GE,” the paper models users by the tweets they retweeted and uses similarities between those users to investigate coordination. This supports the common-retweets signal attributed to Nizzoli et al., but not its characterization as a signal for bot detection: “Use of automation” says coordination and automation are different concepts. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Coordination in account activity does not necessarily coincide with automation.

    “While coordination in account activity does not necessarily coincide with automation [36,37], accounts created on similar dates and following users successively are more likely to be automated [3,48].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 37 · Cited by 95

Research works printed but not linked: 16

  1. Assenmacher, D.; Adam, L.; Trautmann, H.; and Grimme, C. 2020a. Semi-automatic campaign detection by means of text stream clustering. In AAAI FLAIRS'20.
  2. Blondel, V. D.; Guillaume, J.-L.; Lambiotte, R.; and Lefeb- vre, E. 2008. Fast unfolding of communities in large net- works. Journal of statistical mechanics: theory and experi- ment 2008(10):P10008.
  3. Cresci, S.; Di Pietro, R.; Petrocchi, M.; Spognardi, A.; and Tesconi, M. 2018. Social Fingerprinting: Detection of Spambot Groups Through DNA-Inspired Behavioral Mod- eling. IEEE TDSC 15(4).
  4. Fazil, M., and Abulaish, M. 2020. A socialbots analysis- driven graph-based approach for identifying coordinated campaigns in Twitter. Journal of Intelligent & Fuzzy Sys- tems 38:2961-2977.
  5. Gallagher, R. J.; Frank, M. R.; Mitchell, L.; Schwartz, A. J.; Reagan, A. J.; Danforth, C. M.; and Dodds, P. S. 2020. Gen- eralized word shift graphs: A method for visualizing and ex- plaining pairwise comparisons between texts. arXiv preprint arXiv:2008.02250. · arXiv
  6. Garlaschelli, D., and Loffredo, M. I. 2008. Maximum like- lihood: Extracting unbiased information from complex net- works. Physical Review E 78(1):015101.
  7. Giglietto, F.; Righetti, N.; Rossi, L.; and Marino, G. 2020a. Coordinated link sharing behavior as a signal to surface sources of problematic information on Facebook. In Inter- national Conference on Social Media and Society, 85-91.
  8. Mazza, M.; Cresci, S.; Avvenuti, M.; Quattrociocchi, W.; and Tesconi, M. 2019. RTbust: Exploiting temporal pat- terns for botnet detection on Twitter. In ACM WebSci'19. ACM.
  9. Nizzoli, L.; Tardelli, S.; Avvenuti, M.; Cresci, S.; Tesconi, M.; and Ferrara, E. 2020. Charting the landscape of on- line cryptocurrency manipulation. IEEE Access 8:113230- 113245.
  10. Pacheco, D.; Hui, P.-M.; Torres-Lugo, C.; Truong, B. T.; Flammini, A.; and Menczer, F. 2020. Uncovering coordinated networks on social media. arXiv preprint arXiv:2001.05658. · arXiv
  11. Ratkiewicz, J.; Conover, M. D.; Meiss, M.; Gonc ¸alves, B.; Flammini, A.; and Menczer, F. M. 2011. Detecting and tracking political abuse in social media. In AAAI ICWSM'11.
  12. Starbird, K.; Arif, A.; and Wilson, T. 2019. Disinformation as Collaborative Work: Surfacing the Participatory Nature of Strategic Information Operations. In ACM CSCW'19.
  13. Tumminello, M.; Micciche, S.; Lillo, F.; Piilo, J.; and Man- tegna, R. N. 2011. Statistically validated networks in bipar- tite complex systems. PloS one 6(3):e17994.
  14. Vargas, L.; Emami, P.; and Traynor, P. 2020. On the detec- tion of disinformation campaign activity with network anal- ysis. arXiv preprint arXiv:2005.13466. · arXiv
  15. Wang, X.; Wei, F.; Liu, X.; Zhou, M.; and Zhang, M. 2011. Topic sentiment analysis in twitter: a graph-based hashtag sentiment classification approach. In Proc. of CIKM'11, 1031-1040.
  16. Zellers, R.; Holtzman, A.; Rashkin, H.; Bisk, Y.; Farhadi, A.; Roesner, F.; and Choi, Y. 2019. Defending against neural fake news. In NeurIPS'19.

Authors
Nizzoli, L., Tardelli, S., Avvenuti, M., Cresci, S., & Tesconi, M.
Affiliations
  • University of Pisa (IT)
  • Institute of Informatics and Telematics (IT)
Venue
Proceedings of the International AAAI Conference on Web and Social Media
Published
2021-05-22
Volume
15
Pages
443-454
ISSN
  • 2162-3449 (ISSN-L)
  • 2334-0770
OpenAlex
W3068316593
Cited by
95
References
37
Citations by year
2026: 8 · 2025: 21 · 2024: 27 · 2023: 9 · 2022: 17 · 2021: 11 · 2020: 2
FWCI
43.32
Type
conference paper
Language
en
Open access
Locations
  • Proceedings of the International AAAI Conference on Web and Social Media (publishedVersion)
  • CINECA IRIS Institutial research information system (University of Pisa) (submittedVersion)
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
  • Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
Keywords
coordinated behavior, social media, 2019 UK general election, disinformation, information manipulation, election debates

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review