Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics
Open accessThe claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Altmetrics can serve as a valuable index of societal impact, indicating public engagement and interest in research.
“Altmetrics, on the other hand, can serve as a valuable index of societal impact, indicating public engagement and interest in research (Bornmann, 2014; Pulido et al., 2018).”
From Can ChatGPT be used to predict citation counts, readership, and social media interaction? An exploration among 2222 scientific abstracts (2024) · cites this paper as Bornmann, 2014
It is possible to game the Altmetric system through the generation of false likes and mentions, adding significant noise.
“In addition to this, it is possible to game the Altmetric system through the generation of false likes and mentions [21], adding significant noise.”
From Measuring scientific impact beyond academia: An assessment of existing impact metrics and proposed improvements (2017) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The New production of knowledge: the dynamics of science and research in contemporary societies
Gibbons, M. (1995) · Choice Reviews Online · doi:10.5860/choice.32-4463 · Cited by 7,049 · see citing works
What do citation counts measure? A review of studies on citing behavior
Bornmann, L., & Daniel, H. (2008) · Journal of Documentation · doi:10.1108/00220410810844150 · Cited by 1,607 · cited 1× · see citing works
“Furthermore, there are numerous different reasons why scientists cite a publication – and they are not always related to intellectual influence (Bornmann & Daniel, 2008).”
BackgroundSelf-citationEysenbach, G. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.2012 · Cited by 1,088 · see citing works
Do Altmetrics Work? Twitter and Ten Other Social Web Services
Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064841 · Cited by 907 · see citing works
What is societal impact of research and how can it be assessed? a literature survey
Bornmann, L. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22803 · Cited by 732 · see citing works
Self-citationBornmann, L. (2011) · Annual Review of Information Science and Technology · doi:10.1002/aris.2011.1440450112 · Cited by 567 · see citing works
Self-citationTweeting biomedicine: An analysis of tweets and citations in the biomedical literature
Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M. A., & Larivière, V. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23101 · Cited by 434 · see citing works
Citation time window choice for research impact evaluation
Wang, J. (2012) · Scientometrics · doi:10.1007/s11192-012-0775-9 · Cited by 427 · see citing works
An Introduction to Social Media for Scientists
Bik, H. M., & Goldstein, M. C. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001535 · Cited by 409 · see citing works
Piwowar, H. (2013) · Nature · doi:10.1038/493159a · Cited by 398 · see citing works
Zahedi, Z., Costas, R., & Wouters, P. F. (2014) · Scientometrics · doi:10.1007/s11192-014-1264-0 · Cited by 386 · see citing works
Scientometrics 2.0: New metrics of scholarly impact on the social Web
Priem, J. R., & Hemminger, B. H. (2010) · First Monday · doi:10.5210/fm.v15i7.2874 · Cited by 382 · see citing works
Disciplinary differences in Twitter scholarly communication
Holmberg, K., & Thelwall, M. A. (2014) · Scientometrics · doi:10.1007/s11192-014-1229-3 · Cited by 289 · see citing works
Delgado López‐Cózar, E., Robinson‐García, N., & Torres‐Salinas, D. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23056 · Cited by 272 · see citing works
Coverage and adoption of altmetrics sources in the bibliometric community
Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H., & Terliesner, J. (2014) · Scientometrics · doi:10.1007/s11192-013-1221-3 · Cited by 264 · see citing works
Validating online reference managers for scholarly impact measurement
Li, X., Thelwall, M. A., & Giustini, D. (2011) · Scientometrics · doi:10.1007/s11192-011-0580-x · Cited by 258 · see citing works
Measuring the societal impact of research
Bornmann, L. (2012) · EMBO Reports · doi:10.1038/embor.2012.99 · Cited by 257 · see citing works
Self-citationSud, P., & Thelwall, M. A. (2013) · Scientometrics · doi:10.1007/s11192-013-1117-2 · Cited by 255 · see citing works
Mohammadi, E., & Thelwall, M. A. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23071 · Cited by 245 · see citing works
Article-Level Metrics and the Evolution of Scientific Impact
Neylon, C., & Wu, S. (2009) · PLoS Biology · doi:10.1371/journal.pbio.1000242 · Cited by 244 · see citing works
Altmetric: enriching scholarly content with article‐level discussion and metrics
Adie, E. A., & William, R. O. E. (2012) · Learned Publishing · doi:10.1087/20130103 · Cited by 224 · see citing works
Google Scholar citations and Google Web/URL citations: A multi‐discipline exploratory analysis
Kousha, K., & Thelwall, M. A. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20584 · Cited by 211 · see citing works
Shema, H., Bar‐Ilan, J., & Thelwall, M. A. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23037 · Cited by 209 · see citing works
Using altmetrics for assessing research impact in the humanities
Hammarfelt, B. (2014) · Scientometrics · doi:10.1007/s11192-014-1261-3 · Cited by 209 · see citing works
Bornmann, L., Loet Leydesdorff, A., & Mutz, R. (2012) · Journal of Informetrics · doi:10.1016/j.joi.2012.10.001 · Cited by 205 · see citing works
Self-citationThe Evaluation of Research by Scientometric Indicators
Vinkler, P. (2010) · Chandos Publishing eBooks · doi:10.1533/9781780630250 · Cited by 195 · see citing works
Kurtz, M. J., & Bollen, J. (2010) · Annual Review of Information Science and Technology · doi:10.1002/aris.2010.1440440108 · Cited by 146 · see citing works
The Impact of the Social Sciences.
Musgrave, A. E., & Boulding, K. E. (1967) · Economica · doi:10.2307/2552042 · Cited by 142 · see citing works
Waltman, L., & Costas, R. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23040 · Cited by 132 · see citing works
Social scholarship: Reconsidering scholarly practices in the age of social media
Greenhow, C. M., & Gleason, B. (2014) · British Journal of Educational Technology · doi:10.1111/bjet.12150 · Cited by 126 · see citing works
The role of Twitter in the life cycle of a scientific publicationPreprint
Darling, E. S., Shiffman, D. S., Côté, I. M., & Drew, J. (2013) · doi:10.7287/peerj.preprints.16v1 · Cited by 123 · see citing works
Web citation data for impact assessment: A comparison of four science disciplines
Vaughan, L. Q., & Shaw, D. (2005) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20199 · Cited by 111 · see citing works
Altmetrics in Evolution: Defining and Redefining the Ontology of Article-Level Metrics
Lin, J., & Fenner, M. H. (2013) · Information Standards Quarterly · doi:10.3789/isqv25no2.2013.04 · Cited by 108 · see citing works
Brigham, T. (2014) · Medical Reference Services Quarterly · doi:10.1080/02763869.2014.957093 · Cited by 107 · see citing works
Weller, K., Dröge, E., & Puschmann, C. (2011) · Cited by 100 · see citing works
Twitter and the health reforms in the English National Health Service
King, D., Ramirez-Cano, D., Greaves, F., Vlaev, I., Beales, S., & Darzi, A. W. (2013) · Health Policy · doi:10.1016/j.healthpol.2013.02.005 · Cited by 95 · see citing works
Altmetrics: nuevos indicadores para la comunicación científica en la Web 2.0
Salinas, D. T., Cabezas-Clavijo, Á., & Jiménez‐Contreras, E. (2013) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.3916/c41-2013-05 · Cited by 93 · see citing works
The power of altmetrics on a CV
Piwowar, H., & Priem, J. R. (2013) · Bulletin of the American Society for Information Science and Technology · doi:10.1002/bult.2013.1720390405 · Cited by 86 · see citing works
A new look at evidence of scholarly citation in citation indexes and from web sources
Vaughan, L. Q., & Shaw, D. (2007) · Scientometrics · doi:10.1007/s11192-008-0220-2 · Cited by 85 · see citing works
Research Blogging: Indexing and Registering the Change in Science 2.0
de Fausto, S. S., Machado, F. A., Bento, L. F. J., Iamarino, A., Nahas, T. R., & Munger, D. S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0050109 · Cited by 85 · see citing works
What Can Article-Level Metrics Do for You?
Fenner, M. H. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001687 · Cited by 82 · see citing works
Bornmann, L., & Williams, R. A. (2013) · Journal of Informetrics · doi:10.1016/j.joi.2013.02.005 · Cited by 76 · see citing works
Self-citationHow is research blogged? A content analysis approach
Shema, H., Bar‐Ilan, J., & Thelwall, M. A. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23239 · Cited by 73 · see citing works
From bibliometrics to altmetrics: A changing scholarly landscape
Roemer, R. C., & Borchardt, R. (2012) · College & Research Libraries News · doi:10.5860/crln.73.10.8846 · Cited by 72 · see citing works
Liu, C., Xu, Y. Q., Wu, H. M., Chen, S. S., & Guo, J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2707 · Cited by 69 · see citing works
Social Signals Reflect Academic Impact: What it Means When a Scholar Adds a Paper to Mendeley
Gunn, W. (2013) · Information Standards Quarterly · doi:10.3789/isqv25no2.2013.06 · Cited by 68 · see citing works
Health research: measuring the social, health and economic benefits
Frank, C. B., & Nason, E. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.090016 · Cited by 66 · see citing works
Assessing non-standard article impact using F1000 labels
Mohammadi, E., & Thelwall, M. A. (2013) · Scientometrics · doi:10.1007/s11192-013-0993-9 · Cited by 63 · see citing works
Five challenges in altmetrics: A toolmaker's perspective
Liu, J., & Adie, E. A. (2013) · Bulletin of the American Society for Information Science and Technology · doi:10.1002/bult.2013.1720390410 · Cited by 63 · see citing works
New opportunities for repositories in the age of altmetrics
Konkiel, S., & Scherer, D. (2013) · Bulletin of the American Society for Information Science and Technology · doi:10.1002/bult.2013.1720390408 · Cited by 61 · see citing works
A multi-metric approach for research evaluation
Ronald, R., & Fred, Y. Y. (2013) · Chinese Science Bulletin · doi:10.1007/s11434-013-5939-3 · Cited by 59 · see citing works
Introduction to Altmetrics for Science, Technology, Engineering, and Mathematics (STEM) Librarians
Galloway, L. M., Pease, J., & Rauh, A. (2013) · Science & Technology Libraries · doi:10.1080/0194262x.2013.829762 · Cited by 40 · see citing works
Consuming Article-Level Metrics: Observations and Lessons
Chamberlain, S. (2013) · Information Standards Quarterly · doi:10.3789/isqv25no2.2013.02 · Cited by 40 · see citing works
Institutional Altmetrics and Academic Libraries
Roemer, R. C., & Borchardt, R. (2013) · Information Standards Quarterly · doi:10.3789/isqv25no2.2013.03 · Cited by 40 · see citing works
Is there currently a scientific revolution in Scientometrics?
Bornmann, L. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23073 · Cited by 37 · see citing works
Self-citationScience Communication in a Digital Age: Social Media and the American Fisheries Society
Claussen, J. E., Cooney, P. B., Defilippi, J. M., et al. (2013) · Fisheries · doi:10.1080/03632415.2013.816289 · Cited by 34 · see citing works
Taylor, M. (2013) · Information Standards Quarterly · doi:10.3789/isqv25no2.2013.05 · Cited by 33 · see citing works
Rethinking Impact: Applying Altmetrics to Southern African Research
Neylon, C., Willmers, M., & King, T. (2014) · Open University of Cape Town (University of Cape Town) · Cited by 26 · see citing works
Using social bookmarks and tags as alternative indicators of journal content description
Haustein, S., & Peters, I. (2012) · First Monday · doi:10.5210/fm.v17i11.4110 · Cited by 24 · see citing works
A Look at Altmetrics and its Growing Significance to Research Libraries
Rodgers, E. P. (2014) · Deep Blue (University of Michigan) · doi:10.6084/m9.figshare.1014300 · Cited by 23 · see citing works
Bibliographic References in Web 2.0
Bar‐Ilan, J., Shema, H., & Thelwall, M. A. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9445.003.0021 · Cited by 23 · see citing works
The evolving indicator space (i S pace)
Cronin, B. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.23041 · Cited by 18 · see citing works
Weller, K., & Peters, I. (2012) · Dusseldorfer Dokumenten- und Publikationsservice (DUP) · Cited by 16 · see citing works
Scientific bloggers under the altmetric microscope
Peters, I., Beutelspacher, L., Maghferat, P., & Terliesner, J. (2012) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14504901305 · Cited by 12 · see citing works
Letter from the Guest Content Editor: Altmetrics Have Come of Age
Fenner, M. H. (2013) · Information Standards Quarterly · doi:10.3789/isqv25no2.2013.01 · Cited by 11 · see citing works
The grey literature from an altmetrics perspective - opportunity and challenges
Adie, E. A. (2014) · Cited by 7 · see citing works
Flagged first, then by citations
Research works printed but not linked: 9
- American Psychological Association. (2010). Publication manual of the American Psychological Association (6. ed.). Washington, DC, USA: American Psychological Association (APA).
- In B. Cronin & C. R. Sugimoto (Eds.), Beyond bibliometrics: harnessing multi-dimensional indicators of performance (pp. 307-325). Cambridge, MA, USA: MIT Press.
- Haustein, S. (2014). Readership metrics. In B. Cronin & C. R. Sugimoto (Eds.), Beyond bibliometrics: harnessing multi-dimensional indicators of performance (pp. 327-344). Cambridge, MA, USA: MIT Press.
- Maflahi, N., & Thelwall, M. (in press). When are readers as good as citers for bibliometrics? Scopus vs. Mendeley for LIS journals. Journal of the Association for Information Science and Technology.
- Mohammadi, E., Thelwall, M., Haustein, S., & Larivière, V. (2014). Who Reads Research Articles? An Altmetrics Analysis of Mendeley User Categories1. Retrieved March 18, from http://www.academia.edu/6298635/Who_Reads_Research_Articles_An_Altmetrics_A nalysis_of_Mendeley_User_Categories National Information Standards Organization. (2014). Altmetrics standards project white paper. Baltimore, MD, USA: National Information Standards Organization (NISO).
- Priem, J. (2014). Altmetrics. In B. Cronin & C. R. Sugimoto (Eds.), Beyond bibliometrics: harnessing multi-dimensional indicators of performance. Cambridge, MA, USA: MIT Press.
- Priem, J., Piwowar, H., & Hemminger, B. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. Retrieved March 27, from http://arxiv.org/html/1203.4745
- Puschmann, C. (2014). (Micro)Blogging Science? Notes on Potentials and Constraints of New Forms of Scholarly Communication. In S. Bartling & S. Friesike (Eds.), Opening Science (pp. 89-106): Springer International Publishing.
- In A. Tokar, M. Beurskens, S. Keuneke, M. Mahrt, I. Peters, C. Puschmann, T. van Treeck & K. Weller (Eds.), Science and the Internet (pp. 209-222). Düsseldorf. Germany: Düsseldorf University Press.
Cited by
Sorted by citations
A Review of Theory and Practice in Scientometrics
Mingers, J., & Leydesdorff, L. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.04.002 · Cited by 1,002 · see citing works
Ravenscroft, J., Liakata, M., Clare, A., & Duma, D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0173152 · Cited by 202 · see citing works
A systematic identification and analysis of scientists on Twitter
Ke, Q., Ahn, Y.-Y., & Sugimoto, C. R. (2017) · PLOS ONE · doi:10.1371/journal.pone.0175368 · Cited by 175 · see citing works
Müller, A. M., Maher, C. A., Vandelanotte, C., Hingle, M., Middelweerd, A., Lopez, M. L., DeSmet, A., Short, C. E., Nathan, N., Hutchesson, M. J., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8954 · Cited by 180 · see citing works
Bibliometric reports for institutions: Best practices in a responsible metrics scenario
Cabezas-Clavijo, A., & Torres-Salinas, D. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.696470 · Cited by 36 · see citing works
de Winter, J. (2024) · Scientometrics · doi:10.1007/s11192-024-04939-y · Cited by 34 · see citing works
“Altmetrics, on the other hand, can serve as a valuable index of societal impact, indicating public engagement and interest in research (Bornmann, 2014; Pulido et al., 2018).”
Bennett, H., & Slattery, F. (2023) · Scientometrics · doi:10.1007/s11192-023-04709-2 · Cited by 8 · see citing works
“…GPO Box 2471, Adelaide 5001, Australia 2 Alliance for Research in Exercise, Nutrition, and Activity (ARENA), University of South Australia, Adelaide, Australia 3 Central Adelaide Local Health Network (CALHN), Adelaide, SA 5000, Australia 1 3 channels as a proxy for social impact (Bornmann, 2014).”
Background
- Authors
- Bornmann, L.
- Affiliations
- Max Planck Society (DE)
- Corresponding author
- Bornmann, Lutz
- ORCID
- Bornmann, Lutz
- Venue
- Journal of Informetrics
- Publisher
- Elsevier BV
- Published
- 2014-10
- Volume
- 8
- Issue
- 4
- Pages
- 895-903
- ISSN
- 1751-1577 (ISSN-L)
- OpenAlex
- W1986828568
- Cited by
- 578
- References
- 66
- Citations by year
- 2026: 31 · 2025: 42 · 2024: 56 · 2023: 39 · 2022: 47 · 2021: 71 · 2020: 64 · 2019: 58 · 2018: 66 · 2017: 38 · 2016: 39 · 2015: 25 · 2014: 2
- FWCI
- 33.96
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Journal of Informetrics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Keywords
- altmetrics, social impact of research, research impact assessment, social media engagement, bibliometric analysis, scholarly communication, Twitter, Mendeley
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
