The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Tweets as impact indicators: Examining the implications of automated “bot” accounts on Twitter
Open accessAbstract
This brief communication presents preliminary findings on automated T witter accounts distributing links to scientific articles deposited on the preprint repository ar X iv. It discusses the implication of the presence of such bots from the perspective of social media metrics (altmetrics), where mentions of scholarly documents on T witter have been suggested as a means of measuring impact that is both broader and timelier than citations. Our results show that automated T witter accounts create a considerable amount of tweets to scientific articles and that they behave differently than common social bots, which has critical implications for the use of raw tweet counts in research evaluation and assessment. We discuss some definitions of T witter cyborgs and bots in scholarly communication and propose distinguishing between different levels of engagement—that is, differentiating between tweeting only bibliographic information to discussing or commenting on the content of a scientific work.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Haustein et al. (2014) suggest that papers are more likely to be tweeted if they are “curious or funny, have potential health applications or refer to a catastrophe” [30].”
From Measuring scientific impact beyond academia: An assessment of existing impact metrics and proposed improvements (2017) · cites this paper as [30]
Citations
Cites
Ferrara, E., Varol, O., Davis, C., Menczer, F., & Flammini, A. (2016) · Communications of the ACM · doi:10.1145/2818717 · Cited by 1,973
Eysenbach, G. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.2012 · Cited by 1,088
Assessing the impact of planned social change
Campbell, D. T. (1979) · Evaluation and Program Planning · doi:10.1016/0149-7189(79)90048-x · Cited by 957
Costas, R., Zahedi, Z., & Wouters, P. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23309 · Cited by 711
Detecting Automation of Twitter Accounts: Are You a Human, Bot, or Cyborg?
Chu, Z., Gianvecchio, S., Wang, H., & Jajodia, S. (2012) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2012.75 · Cited by 634
Boshmaf, Y., Muslukhov, I., Beznosov, K., & Ripeanu, M. (2011) · Annual Computer Security Applications Conference · doi:10.1145/2076732.2076746 · Cited by 458
Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature
Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M. A., & Larivière, V. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23101 · Cited by 434
Self-citationSocial media use in the research workflow
Rowlands, I., Nicholas, D., RUSSELL, B., Canty, N., & Watkinson, A. (2011) · Learned Publishing · doi:10.1087/20110306 · Cited by 344
Shuai, X., Pepe, A., & Bollen, J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047523 · Cited by 327
How and why scholars cite on Twitter
Priem, J. R., & Costello, K. L. (2010) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14504701201 · Cited by 265
Flagged first, then by citations
Research works printed but not linked: 1
- Mowbray M., 2010, Proceedings of the Sixth International Conference on Web Information Systems and Technologies, WEBIST (2), 299
Cited by
Sorted by citations
Items 201–230 of 230
Harrison, L. M. (2022) · Queensland University of Technology · doi:10.5204/thesis.eprints.233168 · Cited by 1
The art of sharing: From research to outreach in the social media era
Mohammad, M., Mohamed, A. A., Dahmen, J., Bjerre-Bastos, J. J., & Pihl, A. F. (2025) · Experimental Physiology · doi:10.1113/ep092887 · Cited by 2
Pinheiro, A., Cappelli, C., Aguiar, A., & Maciel, C. D. O. (2018) · Iberian Conference on Information Systems and Technologies (CISTI) · doi:10.23919/cisti.2018.8399286
The spatial-temporal transfer of scientometrics research topics based on citation analysis
Hou, J., & Yang, X. (2018) · Malaysian Journal of Library & Information Science · doi:10.22452/mjlis.vol23no3.4
The Advent of the (Ro)bot and Their Incipient Spread in the Web
Minaudo, M. (2018) · 美中经济评论：英文版 · doi:10.17265/1537-1514/2018.09.003
Citizen centric stakeholder theory
Yaqub, U. (2018) · doi:10.7282/t3-b5tw-b154
The future of impact metric use among collection development librarians
Sutton, S. W., Miles, R., & Konkiel, S. (2019) · Qualitative and Quantitative Methods in Libraries
Bot and Gender Identification from Twitter.
Radarapu, R., Vishwakarma, Y., Gopal, A. S. S., & Kumar, M. A. (2019) · CLEF (Working Notes)
Valgas, A., Carmo, F., Ponciano, L., & Góes, L. F. W. (2017) · Simpósio Brasileiro de Sistemas Colaborativos (SBSC) · doi:10.5753/sbsc.2017.9958
Santos, N. (2020) · Etudes de communication/Études de communication · doi:10.4000/edc.10746
Sistemas fuzzy complementam a detecção de socialbots por aprendizado de máquina
Ferreira, C. C. D. C. P., Garcia, A. D. V., Salles, R. M., & Machado, R. (2019) · Brazilian Journal of Development · doi:10.34117/bjdv5n12-308
Persily, N., & Tucker, J. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108890960.001
Persily, N., & Tucker, J. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108890960.015
Kollányi, B. (2022) · CUB Ph.D. Dissertations (Corvinus University of Budapest) · doi:10.14267/phd.2022050
Agenda do impacto social da pesquisa entre 2009 e 2019
Arruda, D. B. D. S. (2021) · doi:10.47749/t/unicamp.2021.1234194
Ng, J. Y., Judge, A., & Cramer, H. (2024) · Research Square · doi:10.21203/rs.3.rs-4947531/v1
Zhang, Y., & Fang, Z. (2025) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.70002
Tensions and Triumphs Between MSM and Police
Small, V. (2025) · Springer eBooks · doi:10.1007/978-981-96-9558-4_7
Yu, Y., Zhou, R., Jiang, R., & Liu, F. (2025) · Electronic Markets · doi:10.1007/s12525-025-00849-w
Shaping scientific papers diffusion structure: academia and public in social media networks
Wang, Y., Zhang, Y., Hou, J., & Zheng, B. (2026) · Scientometrics · doi:10.1007/s11192-025-05511-y
Maleki, A., & Holmberg, K. (2026) · Research Evaluation · doi:10.1093/reseval/rvag014 · Cited by 1
Self-citationThe reconfiguration of the communication environment : twitter in the 2013 Brazilian protests
dos Santos, N. F. (2019) · doi:10.70675/b48fbaf2zfaf4z49dcz8b23z4314708dde17 · Cited by 4
Speaking of bots: Unpacking representations of political bots in news media discourse
Sigurdh, H., & Lundström, R. (2026) · Acta Sociologica · doi:10.1177/00016993261450360
Mogbojuri, O., Walsh, B. A., & Aguirre, M. (2026) · Journal of Human Sciences and Extension · doi:10.55533/2325-5226.1564
Active or silent? The spiral of silence in social bots
Zhu, H., Xiao, Y., Yan, W., Wu, M., & Zhang, Y. (2026) · Journal of Informetrics · doi:10.1016/j.joi.2026.101870
Metadata
- Authors
- Haustein, S., Bowman, T. D., Holmberg, K., Tsou, A., Sugimoto, C. R., & Larivière, V.
- Affiliations
- Université de Montréal (CA)
- University of Turku (FI)
- Indiana University Bloomington (US)
- Université du Québec à Montréal (CA)
- Corresponding author
- Haustein, Stefanie
- Bowman, Timothy D.
- Holmberg, Kim
- Tsou, Andrew
- Sugimoto, Cassidy R.
- Larivière, Vincent
- ORCID
- Venue
- Journal of the Association for Information Science and Technology
- Publisher
- Wiley
- Published
- 2015-05-05
- Volume
- 67
- Issue
- 1
- Pages
- 232-238
- ISSN
- 2330-1635 (ISSN-L)
- 2330-1643
- OpenAlex
- W1953503995
- Cited by
- 231
- References
- 25
- Citations by year
- 2026: 8 · 2025: 10 · 2024: 10 · 2023: 9 · 2022: 25 · 2021: 17 · 2020: 43 · 2019: 37 · 2018: 30 · 2017: 27 · 2016: 11 · 2015: 4
- FWCI
- 22.20
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Journal of the Association for Information Science and Technology (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Papyrus : Institutional Repository (Université de Montréal) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Alfred P. Sloan Foundation (G-2014-3-25)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- Twitter bots, altmetrics, research impact metrics, research evaluation, cyborg, scholarly communication, tweet engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
