The public accountability of social platforms: lessons from a study on bots and trolls in the Brexit campaign
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
In this article, we review our study of 13 493 bot-like Twitter accounts that tweeted during the UK European Union membership referendum debate and disappeared from the platform after the ballot. We discuss the methodological challenges and lessons learned from a study that emerged in a period of increasing weaponization of social media and mounting concerns about information warfare. We address the challenges and shortcomings involved in bot detection, the extent to which disinformation campaigns on social media are effective, valid metrics for user exposure, activation and engagement in the context of disinformation campaigns, unsupervised and supervised posting protocols, along with infrastructure and ethical issues associated with social sciences research based on large-scale social media data. We argue for improving researchers' access to data associated with contentious issues and suggest that social media platforms should offer public application programming interfaces to allow researchers access to content generated on their networks. We conclude with reflections on the relevance of this research agenda to public policy. This article is part of a discussion meeting issue ‘The growing ubiquity of algorithms in society: implications, impacts and innovations'.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
De Veirman, M., Cauberghe, V., & Hudders, L. (2017) · International Journal of Advertising · doi:10.1080/02650487.2017.1348035 · Cited by 2,548
Massanari, A. (2017) · New Media & Society · doi:10.1177/1461444815608807 · Cited by 1,264 · cited 1×
“Supervised high-volume posting encapsulates a new agent in the political arena to which little attention has been given beyond Reddit forums and the toxic corners of internet culture [52].”
Social bots distort the 2016 U.S. Presidential election online discussion
Bessi, A., & Ferrara, E. (2016) · First Monday · doi:10.5210/fm.v21i11.7090 · Cited by 993 · cited 2×
“more positive content in support of a candidate [19] and only tweet hashtags used by opponents to disrupt their communication flow [20].”
Online Human-Bot Interactions: Detection, Estimation, and Characterization
Varol, O., Ferrara, E., Davis, C., Menczer, F., & Flammini, A. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14871 · Cited by 981 · cited 2×
“The number of false negatives in our study most certainly extends beyond these accounts, with similar studies estimating false positives and false negatives in bot detection to hover at around 26% of the data, or 11% and 15%, respectively [13].”
The dynamics of protest recruitment through an online network
González-Bailón, S., Borge-Holthoefer, J., Rivero, A., & Moreno, Y. (2011) · Scientific Reports · doi:10.1038/srep00197 · Cited by 571
Where are human subjects in big data research? the emerging ethics divide
Metcalf, J., & Crawford, K. (2016) · Big Data & Society · doi:10.1177/2053951716650211 · Cited by 394 · cited 1×
“Although public, users might hold a reasonable expectation that the publicness of their activities will not infringe on their privacy or make them vulnerable to unintended scrutiny and even abuse [67],”
Bots, #Strongerin, and #Brexit: Computational Propaganda During the UK-EU Referendum
Howard, P. N., & Kollanyi, B. (2016) · doi:10.2139/ssrn.2798311 · Cited by 392
“Not this one”: social movements, the attention economy, and microcelebrity networked activism
Tufekci, Z. (2013) · American Behavioral Scientist · doi:10.1177/0002764213479369 · Cited by 323
Cited by
Yigitcanlar, T., & Cugurullo, F. (2020) · Sustainability · doi:10.3390/su12208548 · Cited by 337
“…of data Facebook and WhatsApp campaigns changed the results of the 2016 USA and 2018 Brazil presidential elections, and the 2016 Brexit referendum [41–43], thereby showing how data is being used not to inform, but rather to misinform and to protect the interests of certain political elites groups.”
BackgroundFalse equivalencies: Online activism from left to right
Freelon, D., Marwick, A., & Kreiss, D. (2020) · Science · doi:10.1126/science.abb2428 · Cited by 281
Artificial Intelligence in News Media: Current Perceptions and Future Outlook
de-Lima-Santos, M.-F., & Ceron, W. (2021) · Journalism and Media · doi:10.3390/journalmedia3010002 · Cited by 277
Botometer 101: social bot practicum for computational social scientists
Yang, K.-C., Ferrara, E., & Menczer, F. (2022) · Journal of Computational Social Science · doi:10.1007/s42001-022-00177-5 · Cited by 159
The growing ubiquity of algorithms in society: implications, impacts and innovations
Olhede, S. C., & Wolfe, P. J. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0364 · Cited by 120
“Finally Bastos [11] focuses on understanding the impact of social media on recent elections.”
BackgroundInfluential
Metadata
- Authors
- Bastos, M., & Mercea, D.
- Venue
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Publisher
- The Royal Society
- Published
- 2018-08-06
- Volume
- 376
- Issue
- 2128
- Pages
- 20180003
- ISSN
- 1364-503X (ISSN-L)
- 1471-2962
- OpenAlex
- W2806474198
- Cited by
- 61
- References
- 8
- FWCI
- 10.25
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The public accountability of social platforms: lessons from a study on bots and trolls in the Brexit campaign. https://app.cochat.ai/papers/10.1098/rsta.2018.0003
- The paper
- Bastos, M., & Mercea, D. (2018). The public accountability of social platforms: lessons from a study on bots and trolls in the Brexit campaign. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences. https://doi.org/10.1098/rsta.2018.0003
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.