The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
The Altmetrics Collection
Open accessAbstract
What paper should I read next? Who should I talk to at a conference? Which research group should get this grant? Researchers and funders alike must make daily judgments on how to best spend their limited time and money–judgments that are becoming increasingly difficult as the volume of scholarly communication increases. Not only does the number of scholarly papers continue to grow, it is joined by new forms of communication from data publications to microblog posts. To deal with incoming information, scholars have always relied upon filters. At first these filters were manually compiled compendia and corpora of the literature. But by the mid-20th century, filters built on manual indexing began to break under the weight of booming postwar science production. Garfield [1] and others pioneered a solution: automated filters that leveraged scientists own impact judgments, aggregating citations as “pellets of peer recognition.” [2]. These citation-based filters have dramatically grown in importance and have become the tenet of how research impact is measured. But, like manual indexing 60 years ago, they may today be failing to keep up with the literature’s growing volume, velocity, and diversity [3]. Citations are heavily gamed [4]–[6] and are painfully slow to accumulate [7], and overlook increasingly important societal and clinical impacts [8]. Most importantly, they overlook new scholarly forms like datasets, software, and research blogs that fall outside of the scope of citable research objects. In sum, citations only reflect formal acknowledgment and thus they provide only a partial picture of the science system [9]. Scholars may discuss, annotate, recommend, refute, comment, read, and teach a new finding before it ever appears in the formal citation registry. We need new mechanisms to create a subtler, higher-resolution picture of the science system. The Quest for Better Filters The scientometrics community has not been blind to the limitations of citation measures, and has collectively proposed methods to gather evidence of broader impacts and provide more detail about the science system: tracking acknowledgements [10], patents [11], mentorships [12], news articles [8], usage in syllabuses [13], and many others, separately and in various combinations [14]. The emergence of the Web, a “nutrient-rich space for scholars” [15], has held particular promise for new filters and lenses on scholarly output. Webometrics researchers have uncovered evidence of informal impact by examining networks of hyperlinks and mentions on the broader Web [16]–[18]. An important strand of webometrics has also examined the properties of article download data [7], [19], [20]. The last several years, however, have presented a promising new approach to gathering fine-grained impact data: tracking large-scale activity around scholarly products in online tools and environments. These tools and environments include, among others: social media like Twitter and Facebook online reference managers like CiteULike, Zotero, and Mendeley collaborative encyclopedias like Wikipedia blogs, both scholarly and general-audience scholarly social networks, like ResearchGate or Academia.edu conference organization sites like Lanyrd.com Growing numbers of scholars are using these and similar tools to mediate their interaction with the literature. In doing so, they are leaving valuable tracks behind them–tracks with potential to show informal paths of influence with unprecedented speed and resolution. Many of these tools offer open APIs, supporting large-scale, automated mining of online activities and conversations around research objects [21]. Altmetrics [22], [23] is the study and use of scholarly impact measures based on activity in online tools and environments. The term has also been used to describe the metrics themselves–one could propose in plural a “set of new altmetrics.” Altmetrics is in most cases a subset of both scientometrics and webometrics; it is a subset of the latter in that it focuses more narrowly on scholarly influence as measured in online tools and environments, rather than on the Web more generally. Altmetrics may support finer-grained maps of science, broader and more equitable evaluations, and improvements to the peer-review system [24]. On the other hand, the use and development of altmetrics should be pursued with appropriate scientific caution. Altmetrics may face attempts at manipulation similar to what Google must deal with in web search ranking. Addressing such manipulation may, in-turn, impact the transparency of altmetrics. New and complex measures may distort our picture of the science system if not rigorously assessed and correctly understood. Finally, altmetrics may promote an evaluation system for scholarship that many argue has become overly focused on metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1968) · PubMed · Cited by 4,803
Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas
Garfield, E. (1955) · Science · doi:10.1126/science.122.3159.108 · Cited by 2,334
The Matthew Effect in Science, II: Cumulative Advantage and the Symbolism of Intellectual Property
Merton, R. K. (1988) · Isis · doi:10.1086/354848 · Cited by 1,397
Collaboration in an invisible college.
De Solla Price, D. J., & Beaver, D. (1966) · American Psychologist · doi:10.1037/h0024051 · Cited by 782
Patent statistics as indicators of innovative activities: Possibilities and problems
Pavitt, K. (1985) · Scientometrics · doi:10.1007/bf02020142 · Cited by 643
Informetric analyses on the world wide web: methodological approaches to ‘webometrics’
Almind, T. C., & Ingwersen, P. (1997) · Journal of Documentation · doi:10.1108/eum0000000007205 · Cited by 575
A Principal Component Analysis of 39 Scientific Impact Measures
Bollen, J., Van de Sompel, H., Hagberg, A., & Chute, R. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006022 · Cited by 572
Martin, B. R., & Irvine, J. (1983) · Research Policy · doi:10.1016/0048-7333(83)90005-7 · Cited by 527
Coercive Citation in Academic Publishing
Wilhite, A. W., & Fong, E. A. (2012) · Science · doi:10.1126/science.1212540 · Cited by 433
Earlier Web usage statistics as predictors of later citation impact
Brody, T., Harnad, S., & Carr, L. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20373 · Cited by 402
Scientometrics 2.0: New metrics of scholarly impact on the social Web
Priem, J., & Hemminger, B. H. (2010) · First Monday · doi:10.5210/fm.v15i7.2874 · Cited by 375
Self-citationEditors, T. P. M. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030291 · Cited by 373
Thelwall, M. A., Vaughan, L. Q., & Björneborn, L. (2005) · Annual Review of Information Science and Technology · doi:10.1002/aris.1440390110 · Cited by 252
The top-ten in journal impact factor manipulation
Falagas, M. E., & Alexiou, V. G. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0024-5 · Cited by 250
Cronin, B., Snyder, H. W., Rosenbaum, H. S., Martinson, A. M., & Callahan, E. (1998) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1998)49:14<1319::aid-asi9>3.0.co;2-w · Cited by 146
Web citation data for impact assessment: A comparison of four science disciplines
Vaughan, L. Q., & Shaw, D. (2005) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20199 · Cited by 118
The bibliometric properties of article readership information
Kurtz, M. J., Eichhorn, G., Accomazzi, A., Grant, C., Demleitner, M., Murray, S. S., Martimbeau, N., & Elwell, B. (2004) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20096 · Cited by 112
Electronic Journals and Changes in Scholarly Article Seeking and Reading Patterns
Tenopir, C., & King, D. W. (2008) · D-Lib Magazine · doi:10.1045/november2008-tenopir · Cited by 94
Soft peer review: social software and distributed scientific evaluation
Taraborelli, D. (2008) · UCL Discovery (University College London) · Cited by 72
Self-citationTHE SCHOLAR'S COURTESY: A SURVEY OF ACKNOWLEDGEMENT BEHAVIOUR
Cronin, B., & Overfelt, K. (1994) · Journal of Documentation · doi:10.1108/eb026929 · Cited by 71
Kousha, K., & Thelwall, M. A. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20920 · Cited by 67
Cited by
OpenML: networked science in machine learning
Vanschoren, J., van Rijn, J. N., Bischl, B., & Torgo, L. (2014) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2641190.2641198 · Cited by 1,141
Do Altmetrics Work? Twitter and Ten Other Social Web Services
Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064841 · Cited by 907
Open Science: One Term, Five Schools of Thought
Fecher, B., & Friesike, S. (2014) · Opening Science · doi:10.1007/978-3-319-00026-8_2 · Cited by 654
Golinelli, D., Boetto, E., Carullo, G., Nuzzolese, A. G., Landini, M. P., & Fantini, M. P. (2020) · Journal of Medical Internet Research · doi:10.2196/22280 · Cited by 574
Scholarly use of social media and altmetrics: A review of the literature
Sugimoto, C. R., Work, S., Larivière, V., & Haustein, S. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23833 · Cited by 569
Metadata
- Authors
- Priem, J., Groth, P., & Taraborelli, D.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-11-01
- Volume
- 7
- Issue
- 11
- Pages
- e48753
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2396414759
- Cited by
- 280
- References
- 21
- FWCI
- 24.05
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.