Methods for measuring the citations and productivity of scientists across time and discipline
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Publication statistics are ubiquitous in the ratings of scientific achievement, with citation counts and paper tallies factoring into an individual's consideration for postdoctoral positions, junior faculty, and tenure. Citation statistics are designed to quantify individual career achievement, both at the level of a single publication, and over an individual's entire career. While some academic careers are defined by a few significant papers (possibly out of many), other academic careers are defined by the cumulative contribution made by the author's publications to the body of science. Several metrics have been formulated to quantify an individual's publication career, yet none of these metrics account for the collaboration group size, and the time dependence of citation counts. In this paper we normalize publication metrics in order to achieve a universal framework for analyzing and comparing scientific achievement across both time and discipline. We study the publication careers of individual authors over the 50-year period 1958-2008 within six high-impact journals: CELL, the New England Journal of Medicine (NEJM), Nature, the Proceedings of the National Academy of Science (PNAS), Physical Review Letters (PRL), and Science. Using the normalized metrics (i) "citation shares" to quantify scientific success, and (ii) "paper shares" to quantify scientific productivity, we compare the career achievement of individual authors within each journal, where each journal represents a local arena for competition. We uncover quantifiable statistical regularity in the probability density function of scientific achievement in all journals analyzed, which suggests that a fundamental driving force underlying scientific achievement is the competitive nature of scientific advancement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
Power-Law Distributions in Empirical Data
Clauset, A., Shalizi, C. R., & Newman, M. E. J. (2009) · SIAM Review · doi:10.1137/070710111 · Cited by 8,019
The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720
Newman (2005) · doi:10.1080/00107510500052444 · Cited by 5,749
Statistical physics of social dynamics
Castellano, C., Fortunato, S., & Loreto, V. (2009) · Reviews of Modern Physics · doi:10.1103/revmodphys.81.591 · Cited by 4,119
Lazer, D., Pentland, A., Adamic, L., Aral, S., Barabási, A.-L., Brewer, D., Christakis, N., Contractor, N., Fowler, J., Gutmann, M., et al. (2009) · Science · doi:10.1126/science.1167742 · Cited by 3,365
Universality of citation distributions: Toward an objective measure of scientific impact
Radicchi, F., Fortunato, S., & Castellano, C. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0806977105 · Cited by 828 · cited 7×
“In Ref.”
BackgroundInfluentialCitation Statistics from 110 Years of Physical Review
Redner, S. (2005) · Physics Today · doi:10.1063/1.1996475 · Cited by 426 · cited 3×
“The growth dynamics of citations vary, ranging from stunted growth to steady growth and, in some cases where research is published ahead of its time, to late blooming growth [2].”
BackgroundInfluentialDifferences in impact factor across fields and over time
Althouse, B. M., West, J. D., Bergstrom, C. T., & Bergstrom, T. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20936 · Cited by 270 · cited 3×
“The popular Impact Factor (IF) [10, 11] of a journal for a particular year is the average number of citations obtained in a given year for articles published over the previous two years.”
BackgroundQuantitative and empirical demonstration of the Matthew effect in a study of career longevity
Petersen, A. M., Jung, W.-S., Yang, J.-S., & Stanley, H. E. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1016733108 · Cited by 228
Self-citation
Cited by
The Matthew effect in empirical data
Perc, M. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.0378 · Cited by 456
Using publication metrics to highlight academic productivity and research impact
Carpenter, C. R., Cone, D. C., & Sarli, C. C. (2014) · Academic Emergency Medicine · doi:10.1111/acem.12482 · Cited by 377
“First, older publications have more time to accrue citations than newer publications and invariably yield higher citation counts than more recent publications.(42) Second, early reports of scientific findings, which at the time they are reported are at odds with the broadly held beliefs”
Reputation and impact in academic careers
Petersen, A. M., Fortunato, S., Pan, R. K., Kaski, K., Penner, O., Rungi, A., Riccaboni, M., Stanley, H. E., & Pammolli, F. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1323111111 · Cited by 304
Self-citationQuantitative and empirical demonstration of the Matthew effect in a study of career longevity
Petersen, A. M., Jung, W.-S., Yang, J.-S., & Stanley, H. E. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1016733108 · Cited by 228
Self-citationThe advantage of short paper titles
Letchford, A., Moat, H. S., & Preis, T. (2015) · Royal Society Open Science · doi:10.1098/rsos.150266 · Cited by 184
Metadata
- Authors
- Petersen, A. M., Wang, F., & Stanley, H. E.
- Venue
- Physical Review E
- Publisher
- American Physical Society (APS)
- Published
- 2010-03-24
- Volume
- 81
- Issue
- 3
- Pages
- 036114-036114
- ISSN
- 1539-3755 (ISSN-L)
- 1550-2376
- OpenAlex
- W2148355043
- Cited by
- 107
- References
- 10
- FWCI
- 9.26
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.