The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Characterizing Social Media Metrics of Scholarly Papers: The Effect of Document Properties and Collaboration Patterns
Open accessAbstract
A number of new metrics based on social media platforms--grouped under the term "altmetrics"--have recently been introduced as potential indicators of research impact. Despite their current popularity, there is a lack of information regarding the determinants of these metrics. Using publication and citation data from 1.3 million papers published in 2012 and covered in Thomson Reuters' Web of Science as well as social media counts from Altmetric.com, this paper analyses the main patterns of five social media metrics as a function of document characteristics (i.e., discipline, document type, title length, number of pages and references) and collaborative practices and compares them to patterns known for citations. Results show that the presence of papers on social media is low, with 21.5% of papers receiving at least one tweet, 4.7% being shared on Facebook, 1.9% mentioned on blogs, 0.8% found on Google+ and 0.7% discussed in mainstream media. By contrast, 66.8% of papers have received at least one citation. Our findings show that both citations and social media metrics increase with the extent of collaboration and the length of the references list. On the other hand, while editorials and news items are seldom cited, it is these types of document that are the most popular on Twitter. Similarly, while longer papers typically attract more citations, an opposite trend is seen on social media platforms. Finally, contrary to what is observed for citations, it is papers in the Social Sciences and humanities that are the most often found on social media platforms. On the whole, these findings suggest that factors driving social media and citations are different. Therefore, social media metrics cannot actually be seen as alternatives to citations; at most, they may function as complements to other type of indicators.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Sociology of Science: Theoretical and Empirical Investigations
Kaplan, N., Merton, R. K., & Storer, N. W. (1974) · Technology and Culture · doi:10.2307/3102264 · Cited by 4,005
Kettenmann, H., Hanisch, U.-K., Noda, M., & Verkhratsky, A. (2011) · Physiological Reviews · doi:10.1152/physrev.00011.2010 · Cited by 3,547
The frequency distribution of scientific productivity
Lotka, A. J. (1926) · Journal of the Washington Academy of Sciences · Cited by 2,246
What do citation counts measure? A review of studies on citing behavior
Bornmann, L., & Daniel, H. (2008) · Journal of Documentation · doi:10.1108/00220410810844150 · Cited by 1,607 · cited 1×
“Subsequently, in the natural and medical sciences, bibliometric indicators are generally recognized as indicators of scientific activity and impact, despite continuous debates on their validity and usefulness in a research evaluation context [16 – 19].”
BackgroundTHE SOCIOLOGY OF SCIENCE:: Theoretical and Empirical Investigations
Merton, R. Κ., & Storer, N. W. (2017) · Cited by 1,462
The frequency distribution of scientific productivity
G.F.S. (1926) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(26)91166-6 · Cited by 1,344
The Sociology of Science. Theoretical and Empirical Investigations
Namer, G., Merton, R. K., Storer, N. W., & Namer, G. (1975) · Revue Française de Sociologie · doi:10.2307/3321144 · Cited by 1,305
Social Stratification in Science
Cole, J. R., Cole, S., & deB. Beaver, D. (1974) · American Journal of Physics · doi:10.1119/1.1987897 · Cited by 1,135
Do Altmetrics Work? Twitter and Ten Other Social Web Services
Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064841 · Cited by 907
Self-citationSources of information on specific subjects 1934
(1985) · Journal of Information Science · doi:10.1177/016555158501000407 · Cited by 863
Costas, R., Zahedi, Z., & Wouters, P. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23309 · Cited by 711
Self-citation"Sources of information on specific subjects" by S.C. Bradford
Brookes, B. C. (1985) · Journal of Information Science · doi:10.1177/016555158501000406 · Cited by 707
College Libraries and Chemical Education
Gross, P. L. K., & Gross, E. M. (1927) · Science · doi:10.1126/science.66.1713.385 · Cited by 649
Social Stratification in Science
Whitley, R., Cole, J. R., & Cole, S. (1974) · The British Journal of Sociology · doi:10.2307/590178 · Cited by 595
Team size matters: Collaboration and scientific impact since 1900
Larivière, V., Gingras, Y., Sugimoto, C. R., & Tsou, A. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23266 · Cited by 484
Self-citationTweeting biomedicine: An analysis of tweets and citations in the biomedical literature
Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M., & Larivière, V. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23101 · Cited by 434
Self-citationZahedi, Z., Costas, R., & Wouters, P. (2014) · Scientometrics · doi:10.1007/s11192-014-1264-0 · Cited by 384
Self-citationScientometrics 2.0: New metrics of scholarly impact on the social Web
Priem, J., & Hemminger, B. H. (2010) · First Monday · doi:10.5210/fm.v15i7.2874 · Cited by 375
The citation process: The role and significance of citations in scientific communication
Cronin, B. (1984) · International Linear Collider · Cited by 355
Wouters, P. F. (1999) · UvA-DARE (University of Amsterdam) · Cited by 350
Quantitative Measures of Communication in Science: A Critical Review
Edge, D. (1979) · History of Science · doi:10.1177/007327537901700202 · Cited by 283
Nicolaisen, J. (2007) · Annual Review of Information Science and Technology · doi:10.1002/aris.2007.1440410120 · Cited by 273
Double effort = Double impact? A critical view at international co-authorship in chemistry
Glänzel, W., & Schubert, A. (2001) · Scientometrics · doi:10.1023/a:1010561321723 · Cited by 268
Validating online reference managers for scholarly impact measurement
Li, X., Thelwall, M., & Giustini, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0580-x · Cited by 255
Sud, P., & Thelwall, M. (2014) · Scientometrics · doi:10.1007/s11192-013-1117-2 · Cited by 251
Article-Level Metrics and the Evolution of Scientific Impact
Neylon, C., & Wu, S. (2009) · PLoS Biology · doi:10.1371/journal.pbio.1000242 · Cited by 244
Factors affecting citation rates of research articles
Onodera, N., & Yoshikane, F. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23209 · Cited by 202
Tweets vs. Mendeley readers: How do these two social media metrics differ?
Haustein, S., Larivière, V., Thelwall, M. A., Amyot, D., & Peters, I. (2014) · it - Information Technology · doi:10.1515/itit-2014-1048 · Cited by 195
Self-citationUsers, narcissism and control – tracking the impact of scholarly publications in the 21st century
Costas, R., & Wouters, P. F. (2012) · Cited by 195
Self-citationWho reads research articles? An altmetrics analysis of Mendeley user categories
Mohammadi, E., Thelwall, M., Haustein, S., & Larivière, V. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23286 · Cited by 194
Self-citationNew data, new possibilities: exploring the insides of Altmetric.com
Robinson‐García, N., Torres‐Salinas, D., Zahedi, Z., & Costas, R. (2014) · El Profesional de la Informacion · doi:10.3145/epi.2014.jul.03 · Cited by 192
Self-citationCitation analysis and the complex problem of intellectual influence
Zuckerman, H. (1987) · Scientometrics · doi:10.1007/bf02016675 · Cited by 180
Falagas, M. E., Zarkali, A., Karageorgopoulos, D. E., Bardakas, V., & Mavros, M. N. (2013) · PLoS ONE · doi:10.1371/journal.pone.0049476 · Cited by 168
What's in a title? Numbers of words and the presence of colons
Lewison, G., & Hartley, J. R. (2005) · Scientometrics · doi:10.1007/s11192-005-0216-0 · Cited by 145
Waltman, L., & Costas, R. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23040 · Cited by 132
Self-citationCorrelation between impact and collaboration
Hsu, J.-W., & Huang, D.-W. (2010) · Scientometrics · doi:10.1007/s11192-010-0265-x · Cited by 132
Multiple Authorship Trends in Scientific Papers
Clarke, B. L. (1964) · Science · doi:10.1126/science.143.3608.822 · Cited by 112
Webster, G. D., Jonason, P. K., & Schember, T. O. (2009) · Evolutionary Psychology · doi:10.1177/147470490900700301 · Cited by 101
Proceedings of the 17th International conference on science and technology indicators
Larivière, V. (2012) · Cited by 101
Self-citationButer, R. K., & van Raan, A. F. J. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2011.05.008 · Cited by 89
How is research blogged? A content analysis approach
Shema, H., Bar‐Ilan, J., & Thelwall, M. A. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23239 · Cited by 87
Document categories in the ISI Web of Knowledge: Misunderstanding the Social Sciences?
Harzing, A.-W. K. (2012) · Scientometrics · doi:10.1007/s11192-012-0738-1 · Cited by 77
Does it pay to cooperate? A bibliometric case study in molecular biology
Herbertz, H. (1995) · Scientometrics · doi:10.1007/bf02020777 · Cited by 74
A multi-metric approach for research evaluation
Ronald, R., & Fred, Y. Y. (2013) · Chinese Science Bulletin · doi:10.1007/s11434-013-5939-3 · Cited by 59
Citation analysis and the science policy arena
MacRoberts, M. H., & MacRoberts, B. R. (1989) · Trends in Biochemical Sciences · doi:10.1016/0968-0004(89)90077-7 · Cited by 56
The influence of references per paper in the SCI to Impact Factors and the Matthew Effect
Biglu, M. H. (2007) · Scientometrics · doi:10.1007/s11192-007-1815-8 · Cited by 52
The role of editorial material in bibliometric research performance assessments
van Leeuwen, T. N., Costas, R., Calero‐Medina, C., & Visser, M. S. (2012) · Scientometrics · doi:10.1007/s11192-012-0904-5 · Cited by 43
Self-citationSigogneau, A. (2000) · Scientometrics · doi:10.1023/a:1005628218890 · Cited by 37
Costas, R., van Leeuwen, T. N., & Bordons, M. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22662 · Cited by 35
Self-citationPredicting citations to journal articles: The ideal number of references
Lovaglia, M. J. (1991) · The American Sociologist · doi:10.1007/bf02691867 · Cited by 32
Extending SemRep to the public health domain
Rosemblat, G., Resnick, M., Auston, I., Shin, D., Sneiderman, C. A., Fizsman, M., & Rindflesch, T. C. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22899 · Cited by 11
(1987) · doi:10.1002/(sici)1097-4571(198707)38:4<305::aid-asi11>3.0.co;2-i
(1949) · Max Planck Digital Library
Cited by
Scholarly use of social media and altmetrics: A review of the literature
Sugimoto, C. R., Work, S., Larivière, V., & Haustein, S. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23833 · Cited by 569
Self-citationSwedberg, R. (2020) · The Production of Knowledge · doi:10.1017/9781108762519.002 · Cited by 293
A systematic identification and analysis of scientists on Twitter
Ke, Q., Ahn, Y.-Y., & Sugimoto, C. R. (2017) · PLOS ONE · doi:10.1371/journal.pone.0175368 · Cited by 175
Holmberg, K., Hedman, J., Bowman, T. D., Didegah, F., & Laakso, M. (2020) · Scientometrics · doi:10.1007/s11192-019-03301-x · Cited by 103
Availability of digital object identifiers (DOIs) in web of science and scopus
Gorraiz, J., Melero-Fuentes, D., Gumpenberger, C., & Valderrama-Zurián, J.-C. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2015.11.008 · Cited by 93
Metadata
- Authors
- Haustein, S., Costas, R., & Larivière, V.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-03-17
- Volume
- 10
- Issue
- 3
- Pages
- e0120495
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2081305716
- Cited by
- 362
- References
- 54
- FWCI
- 33.79
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.