The rise of social bots
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Today's social bots are sophisticated and sometimes menacing. Indeed, their presence can endanger online ecosystems as well as our society.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Several authors (Shu et al. 2018b, 2017; Shi et al. 2019; Bessi and Ferrara 2016; Shao et al. 2018a) have also shown that fake news is likely to be created and spread by non-human accounts with similar attributes and structure in the network, such as social bots (Ferrara et al. 2016).”
From Fake news, disinformation and misinformation in social media: a review (2023) · cites this paper as Ferrara et al. 2016
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Time went by and new studies acknowledged the rise of a third wave of bots that spread through online social networks from 2016 onwards [5, 13], as shown in panel C of Figure 4.”
From A decade of social bot detection (2020) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We provide empirical evidence of the existence of a novel wave of Twitter spambots, which, up to now, has been just theorized [16].”
From The Paradigm-Shift of Social Spambots: Evidence, Theories, and Tools for the Arms Race (2017) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To identify automated agents in the data set, we developed a deep neural network model (see Methods and SI), which classified 13.4% of users as bots, a value compatible to estimations during other voting events [10, 11, 12].”
From Influence of augmented humans in online interactions during voting events (2019) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The 12-second timing gap constitutes direct evidence of coordinated manipulation analogous to bot farming operations documented on human social media platforms 13,16,22 .”
From The Moltbook Illusion: Separating Human Influence from Emergent Behavior in AI Agent Societies (2026) · cites this paper as [13]
Experimental — accuracy not yet measured
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“1 Many things have changed since the early days of AI, when bots like Joseph Weizenbaum’s ELIZA [Weizenbaum 1966] —that employed a Rogerian approach to fool the interlocutor— were developed as proofs-of-concept or for delight.”
BackgroundExperimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687 · cited 2×
“A recent study demonstrated that emotions are contagious on social media [Kramer et al. 2014]: elusive bots acting unno-ticed in a population of unaware humans could easily manipulate them and alter their perception of reality, with unpredictable results.”
BackgroundPolitical Polarization on Twitter
Conover, M., Ratkiewicz, J., Francisco, M., Goncalves, B., Flammini, A., & Menczer, F. (2011) · Zenodo · doi:10.5281/zenodo.4589064 · Cited by 1,254
Self-citationDiurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures
Golder, S. A., & Macy, M. W. (2011) · Science · doi:10.1126/science.1202775 · Cited by 1,155 · cited 3×
“ial at predetermined times, emulating the human temporal signature of content production and consumption —including circadian patterns of daily activity and temporal spikes of information generation [Golder and Macy 2011]. They can even engage in more complex types of interactions, such as entertaining conversations w…”
BackgroundMethodInfluentialBotOrNot: A System to Evaluate Social Bots
Davis, C. A., Varol, O., Ferrara, E., Flammini, A., & Menczer, F. (2016) · Proceedings of the 25th International Conference Companion on World Wide Web - WWW 16 Companion · doi:10.1145/2872518.2889302 · Cited by 909
Self-citationDetecting spammers on social networks
Stringhini, G., Kruegel, C., & Vigna, G. (2010) · Proceedings of the 26th Annual Computer Security Applications Conference · doi:10.1145/1920261.1920263 · Cited by 791 · cited 1×
“12”
Ratkiewicz (2011) · doi:10.1145/1963192.1963301 · Cited by 541 · cited 3×
“…elections, a small set of social bots started a smearing campaign against one U.S. Senate candidate for Delaware, injecting thousands of tweets pointing to a pernicious website reporting unverified information, aimed at slandering this candidate and support his opponent [Ratkiewicz et al. 2011a].”
BackgroundThe DARPA Twitter Bot Challenge
Subrahmanian, V. S., Azaria, A., Durst, S., Kagan, V., Galstyan, A., Lerman, K., Zhu, L., Ferrara, E., Flammini, A., & Menczer, F. (2016) · Computer · doi:10.1109/mc.2016.183 · Cited by 461
Self-citationCopyCatch: stopping group attacks by spotting lockstep behavior in social networks
Beutel, A., Xu, W., Guruswami, V., Palow, C., & Faloutsos, C. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488400 · Cited by 335
Research works printed but not linked: 14
- Aiello L.M., 2012, Proceedings of the 6th AAAI International Conference on Weblogs and Social Media
- Boshmaf Y., 2012, Proceedings of the 5th USENIX Conference on Large-scale Exploits and Emergent Threats, 12
- Cao Q., 2012, Aiding the detection of fake accounts in large scale social online services. NSDI
- Conover M., 2011, Proceedings of the 5th International AAAI Conference on Weblogs and Social Media
- Elovici Y., 2013, Ethical considerations when employing fake identities in online social networks for research. Science and Engineering Ethics
- Ghosh R., 2011, Proceedings of the KDD Workshop on Social Network Analysis
- Gupta A., 2013, $1.00 per RT #BostonMarathon #PrayForBoston: Analyzing fake content on Twitter. eCrime Researchers Summit
- Lee K., 2011, Proceedings of the 5th International AAAI Conference on Weblogs and Social Media
- Ratkiewicz J., 2011, Proceedings of the 5th International AAAI Conference on Weblogs and Social Media
- Turing A.M, 1950, Computing machinery and intelligence, Mind, 49, 236
- Wagner C., 2012, Proceedings of the 21st International Conference on World Wide Web
- Wald R., Proceedings of the 14th IEEE International Conference on Information Reuse and Integration. IEEE, 6--13
- Wang G., 2013, You are how you click: Clickstream analysis for sybil detection. USENIX Security
- Wang G., 2013, Social turing tests: Crowdsourcing sybil detection
Cited by
Items 101–129 of 129
Coordination patterns reveal online political astroturfing across the world
Schoch, D., Keller, F. B., Stier, S., & Yang, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-08404-9 · Cited by 64
The Rise of Germany's AfD: A Social Media Analysis
Serrano, J. C. M., Shahrezaye, M., Papakyriakopoulos, O., & Hegelich, S. (2019) · Proceedings of the 10th International Conference on Social Media and Society · doi:10.1145/3328529.3328562 · Cited by 62
Using Improved Conditional Generative Adversarial Networks to Detect Social Bots on Twitter
Wu, B., Liu, L., Yang, Y., Zheng, K., & Wang, X. (2020) · IEEE Access · doi:10.1109/access.2020.2975630 · Cited by 54
Better Safe Than Sorry: An Adversarial Approach to Improve Social Bot Detection
Cresci, S., Petrocchi, M., Spognardi, A., & Tognazzi, S. (2019) · Proceedings of the 10th ACM Conference on Web Science · doi:10.1145/3292522.3326030 · Cited by 52
Influence of augmented humans in online interactions during voting events
Stella, M., Cristoforetti, M., & De Domenico, M. (2019) · PLOS ONE · doi:10.1371/journal.pone.0214210 · Cited by 51
“By promoting online activity, bots can interact with humans and influence their standing against specific topics such as political issues [7, 10, 12, 13].”
Twitter's Glass Ceiling: The Effect of Perceived Gender on Online Visibility
Nilizadeh, S., Groggel, A., Lista, P., Das, S., Ahn, Y.-Y., Kapadia, A., & Rojas, F. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v10i1.14711 · Cited by 48
“We cross-checked the effectiveness of this approach by using the ‘bot-or-not’ API, which implements a machine learningbased method with many features (Ferrara et al. 2014).”
MethodAddressing the harms of AI-generated inauthentic content
Menczer, F., Crandall, D., Ahn, Y.-Y., & Kapadia, A. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00690-w · Cited by 42
Self-citationThe evolution of software development orchestration: current state and an agenda for future research
Maruping, L. M., & Matook, S. (2020) · European Journal of Information Systems · doi:10.1080/0960085x.2020.1831834 · Cited by 41
Bruno, M., Lambiotte, R., & Saracco, F. (2022) · EPJ Data Science · doi:10.1140/epjds/s13688-022-00330-0 · Cited by 40
Journalists on Twitter: self-branding, audiences, and involvement of bots
Varol, O., & Uluturk, I. (2020) · Journal of Computational Social Science · doi:10.1007/s42001-019-00056-6 · Cited by 39
Self-citationZubiaga, A., Procter, R., & Maple, C. (2018) · PLOS ONE · doi:10.1371/journal.pone.0209472 · Cited by 38
User-Characteristic Enhanced Model for Fake News Detection in Social Media
Jiang, S., Chen, X., Zhang, L., Chen, S., & Liu, H. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32233-5_49 · Cited by 34
Screening Out Social Bots Interference: Are There Any Silver Bullets?
Zago, M., Nespoli, P., Papamartzivanos, D., Perez, M. G., Marmol, F. G., Kambourakis, G., & Perez, G. M. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1800520 · Cited by 30
“In June 2014, CYNK Technology Corp was able to exploit the decision making process of high-frequency trading bots by renting an army of Social Bots [6].”
BackgroundToward Mitigating Misinformation and Social Media Manipulation in LLM Era
Zhang, Y., Sharma, K., Du, L., & Liu, Y. (2024) · Companion Proceedings of the ACM Web Conference 2024 · doi:10.1145/3589335.3641256 · Cited by 25
“Researchers have been persistently working on combating mis-information and its manipulation toward social media [2, 13, 18, 32, 33, 38].”
BackgroundA language framework for modeling social media account behavior
Nwala, A. C., Flammini, A., & Menczer, F. (2023) · EPJ Data Science · doi:10.1140/epjds/s13688-023-00410-9 · Cited by 31
Self-citationUnsupervised detection of coordinated fake-follower campaigns on social media
Zouzou, Y., & Varol, O. (2024) · EPJ Data Science · doi:10.1140/epjds/s13688-024-00499-6 · Cited by 25
Self-citationNeely, S. R. (2021) · Social Media + Society · doi:10.1177/20563051211055438 · Cited by 19
New Automation for Social Bots: From Trivial Behavior to AI-Powered Communication
Grimme, C., Pohl, J., Cresci, S., Lüling, R., & Preuss, M. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-18253-2_6 · Cited by 19
Super-amplifiers! The role of Twitter extended party networks in political elections
Yoon, N., Hemsley, J., Smith, A., Simpson, E., & Eakins, J. (2022) · Policy & Internet · doi:10.1002/poi3.295 · Cited by 18
Artificial Intelligence Crime: An Interdisciplinary Analysis of Foreseeable Threats and Solutions
King, T., Aggarwal, N., Taddeo, M., & Floridi, L. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3183238 · Cited by 17
North, S., Piwek, L., & Joinson, A. (2021) · Policy & Internet · doi:10.1002/poi3.247 · Cited by 16
Investigating coordinated account creation using burst detection and network analysis
Bellutta, D., & Carley, K. M. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00695-7 · Cited by 15
Characterizing Communication Patterns between Audiences and Newsbots
Gómez-Zará, D., & Diakopoulos, N. (2020) · Digital Journalism · doi:10.1080/21670811.2020.1816485 · Cited by 15
A socialbots analysis-driven graph-based approach for identifying coordinated campaigns in twitter
Fazil, M., & Abulaish, M. (2020) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-182895 · Cited by 14
Tracking and Characterizing the Competition of Fact Checking and Misinformation: Case Studies
Shao, C., Hui, P.-M., Cui, P., Jiang, X., & Peng, Y. (2018) · IEEE Access · doi:10.1109/access.2018.2881037 · Cited by 13
Truth and lies in the Caliphate: The use of deception in Islamic State propaganda
Milton, D. (2022) · Media, War & Conflict · doi:10.1177/1750635220945734 · Cited by 10
Dormant bots in social media: Twitter and the 2018 U.S. senate election
Takacs, R., & McCulloh, I. (2019) · Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining · doi:10.1145/3341161.3343852 · Cited by 9
Tucker, J. A. (2023) · Handbook of Computational Social Science for Policy · doi:10.1007/978-3-031-16624-2_20 · Cited by 3
The Moltbook Illusion: Separating Human Influence from Emergent Behavior in AI Agent Societies
Li, N. (2026) · arXiv · doi:10.48550/arxiv.2602.07432 · Cited by 22
“A decade of research on social bot detection 13–15 has established that automated accounts exhibit distinctive temporal, linguistic, and network signatures 14,31 .”
Metadata
- Authors
- Ferrara, E., Varol, O., Davis, C., Menczer, F., & Flammini, A.
- Affiliations
- University of Southern California (US)
- Indiana University Bloomington (US)
- Venue
- Communications of the ACM
- Published
- 2016-06-24
- Volume
- 59
- Issue
- 7
- Pages
- 96-104
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W1837843568
- Cited by
- 1,973
- References
- 32
- Citations by year
- 2026: 167 · 2025: 177 · 2024: 161 · 2023: 170 · 2022: 189 · 2021: 233 · 2020: 296 · 2019: 250 · 2018: 177 · 2017: 89 · 2016: 45
- FWCI
- 418.27
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- SSRN Electronic Journal (submittedVersion)
- arXiv (Cornell University)
- Funders
- NSF (CCF-1101743)
- Topics
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- social bots, online safety, social media, online communities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.