Estimates of the Continuously Publishing Core in the Scientific Workforce
Open accessThe DOI matches its Crossref record; 26 of the 28 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The ability of a scientist to maintain a continuous stream of publication may be important, because research requires continuity of effort. However, there is no data on what proportion of scientists manages to publish each and every year over long periods of time. METHODOLOGY/PRINCIPAL FINDINGS: Using the entire Scopus database, we estimated that there are 15,153,100 publishing scientists (distinct author identifiers) in the period 1996-2011. However, only 150,608 (<1%) of them have published something in each and every year in this 16-year period (uninterrupted, continuous presence [UCP] in the literature). This small core of scientists with UCP are far more cited than others, and they account for 41.7% of all papers in the same period and 87.1% of all papers with >1000 citations in the same period. Skipping even a single year substantially affected the average citation impact. We also studied the birth and death dynamics of membership in this influential UCP core, by imputing and estimating UCP-births and UCP-deaths. We estimated that 16,877 scientists would qualify for UCP-birth in 1997 (no publication in 1996, UCP in 1997-2012) and 9,673 scientists had their UCP-death in 2010. The relative representation of authors with UCP was enriched in Medical Research, in the academic sector and in Europe/North America, while the relative representation of authors without UCP was enriched in the Social Sciences and Humanities, in industry, and in other continents. CONCLUSIONS: The proportion of the scientific workforce that maintains a continuous uninterrupted stream of publications each and every year over many years is very limited, but it accounts for the lion's share of researchers with high citation impact. This finding may have implications for the structure, stability and vulnerability of the scientific workforce.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Evidence suggests that only a very small proportion of scientists produce the bulk of published research and generate the lion’s share of citation impact [38]”
From The natural selection of bad science (2016) · cites this paper as [38]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In a system such as modern science, with finite career opportunities and high network connectivity, the marginal return for being in the top tier of publications may be orders of magnitude higher than an otherwise respectable publication record [37,38,79].”
From The natural selection of bad science (2016) · cites this paper as [38]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
Price, D. J. D. S. (1963) · Columbia University Press eBooks · doi:10.7312/pric91844 · Cited by 4,264
Price, D. J. D. S. (1965) · Science · doi:10.1126/science.149.3683.510 · Cited by 3,122
The History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770
Biomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
Self-citationResearch productivity over the life cycle: evidence for academic scientists
Levin, S. G., & Stephan, P. E. (1991) · American Economic Review · Cited by 961
Scientific teams and institutional collaborations: Evidence from U.S. universities, 1981–1999
Adams, J. D., Black, G. C., Clemmons, J. R., & Stephan, P. E. (2005) · Research Policy · doi:10.1016/j.respol.2005.01.014 · Cited by 549
Why Current Publication Practices May Distort Science
Young, N. S., Ioannidis, J. P. A., & Al-Ubaydli, O. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050201 · Cited by 502
Self-citationAge and outstanding achievement: What do we know after a century of research?
Simonton, D. K. (1988) · Psychological Bulletin · doi:10.1037//0033-2909.104.2.251 · Cited by 398 · cited 1×
“The accumulated evidence exhibits substantial variability across disciplines and individuals, and in the relative contributions of scientists at different stages of their career and with different chronologic and academic age [3–8].”
BackgroundWHO'S PATENTING IN THE UNIVERSITY? EVIDENCE FROM THE SURVEY OF DOCTORATE RECIPIENTS
Stephan, P. E., Gurmu, S., Sumell, A. J., & Black, G. (2007) · Economics of Innovation and New Technology · doi:10.1080/10438590600982806 · Cited by 301 · cited 1×
“Nevertheless, there is mounting evidence that the current scientific enterprise may be focusing more on disciplines that require incremental continuous contributions; this is also confounded by the funding and entrepreneurial support of the scientific endeavor [21] and it furthermore affect norms for the training of y…”
BackgroundStriking the mother lode in science: the importance of age, place, and time
(1993) · Choice Reviews Online · doi:10.5860/choice.30-3244 · Cited by 268
Organizational Context and Scientific Productivity
Long, J. S., & McGinnis, R. (1981) · American Sociological Review · doi:10.2307/2095262 · Cited by 254 · cited 1×
“Empirical studies have addressed for example gender differences in the continuity of scientific careers [19].”
BackgroundDesign and Update of a Classification System: The UCSD Map of Science
Börner, K., Klavans, R., Patek, M., Zoss, A. M., Biberstine, J. R., Light, R. P., Larivière, V., & Boyack, K. W. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039464 · Cited by 246
Self-citationAging and Productivity Among Economists
Oster, S. M., & Hamermesh, D. S. (1998) · Review of Economics and Statistics · doi:10.1162/003465398557258 · Cited by 205 · cited 1×
“The accumulated evidence exhibits substantial variability across disciplines and individuals, and in the relative contributions of scientists at different stages of their career and with different chronologic and academic age [3–8].”
BackgroundNicholson, J. M., & Ioannidis, J. P. A. (2012) · Nature · doi:10.1038/492034a · Cited by 169
Self-citationCreation of a highly detailed, dynamic, global model and map of science
Boyack, K. W., & Klavans, R. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.22990 · Cited by 168
Self-citationIoannidis, J. P. A. (2011) · Nature · doi:10.1038/477529a · Cited by 163
Self-citationScientific Teams and Institution Collaborations: Evidence from U.S. Universities, 1981-1999
Adams, J. (2004) · National Bureau of Economic Research · doi:10.3386/w10640 · Cited by 163
Concentration of the Most-Cited Papers in the Scientific Literature: Analysis of Journal Ecosystems
Ioannidis, J. P. A. (2006) · PLoS ONE · doi:10.1371/journal.pone.0000005 · Cited by 122 · cited 1×
“The concentration of 87% of the most highly-cited papers among ,1% of scientists represents a heavy-tail phenomenon that is much stronger than the heavy-tail phenomena described for the concentration of influential papers in specific high-profile journals [16] or the concentration of most citations to a relatively mod…”
BackgroundSelf-citationThe growth of science and database coverage
Michels, C., & Schmoch, U. (2012) · Scientometrics · doi:10.1007/s11192-012-0732-7 · Cited by 96 · cited 1×
“been detected in previous analyses of the growing number of total articles [20].”
ResultAging and the Quality of Faculty Job Performance
Blackburn, R. T., & Lawrence, J. H. (1986) · Review of Educational Research · doi:10.3102/00346543056003265 · Cited by 65 · cited 1×
“The accumulated evidence exhibits substantial variability across disciplines and individuals, and in the relative contributions of scientists at different stages of their career and with different chronologic and academic age [3–8].”
BackgroundChange in Academic Coauthorship, 1953–2003
O’Brien, T. L. (2011) · Science Technology & Human Values · doi:10.1177/0162243911406744 · Cited by 51 · cited 1×
“Continuous productivity may be influenced by changing patterns of extensive co-authorship [8] and important differences may exist across scientific disciplines on whether they depend mostly on ‘‘core’’ or ‘‘elite’’ researchers [11].”
BackgroundA list of highly influential biomedical researchers, 1996–2011
Boyack, K. W., Klavans, R., Sorensen, A. A., & Ioannidis, J. P. A. (2013) · European Journal of Clinical Investigation · doi:10.1111/eci.12171 · Cited by 42
Self-citationMcNamee, S. J., & Willis, C. L. (1994) · Science Communication · doi:10.1177/107554709401500403 · Cited by 35
An examination of the contributions of young scientists in new fields
Wray, K. B. (2004) · Scientometrics · doi:10.1023/b:scie.0000037367.99073.bb · Cited by 22
Maddox, G. L. (1979) · Annual Review of Sociology · doi:10.1146/annurev.so.05.080179.000553 · Cited by 19 · cited 1×
“The accumulated evidence exhibits substantial variability across disciplines and individuals, and in the relative contributions of scientists at different stages of their career and with different chronologic and academic age [3–8].”
Background
Research works printed but not linked: 1
- E Garfield, 1996, The significant scientific literature appears in a small core of journals, Scientist, 10, 13
Cited by
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“…such as modern science, with finite career opportunities and high network connectivity, the marginal return for being in the top tier of publications may be orders of magnitude higher than an otherwise respectable publication record (Clauset et al., 2015; Ioannidis et al., 2014; Frank, 2011).”
BackgroundWhy Most Clinical Research Is Not Useful
Ioannidis, J. P. A. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002049 · Cited by 655
“The clinical research workforce is huge: millions of people have coauthored at least one biomedical paper, and most have done so only once [48].”
BackgroundSelf-citationMeta-research: Evaluation and Improvement of Research Methods and Practices
Ioannidis, J. P. A., Fanelli, D., Dunne, D. D., & Goodman, S. N. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002264 · Cited by 495
“Several million new research papers are published annually, and the number of publishing authors in 1996–2011 exceeded, according to one estimate, 15 million [2].”
BackgroundSelf-citationKlavans, R., & Boyack, K. W. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23734 · Cited by 334
“Third, the percentage of influential core authors – those who had published continuously for at least 7 years (Ioannidis, Boyack, & Klavans, 2014; Price & Gürsey, 1975) – is highest for papers with 100+ references, while the actual number of authors per paper is very low.”
BackgroundSelf-citation“Excellence R Us”: university research and the fetishisation of excellence
Moore, S., Neylon, C., Paul Eve, M., Paul O’Donnell, D., & Pattinson, D. (2017) · Palgrave Communications · doi:10.1057/palcomms.2016.105 · Cited by 264
“It also provides further evidence of funding-agency bias against disruptively innovative work noted by many researchers over the years (Kuhn [1962] 2012; Campanario, 1993, 1995, 1996, 2009; Costello, 2010; Ioannidis et al., 2014; Siler et al., 2015).”
Background
Metadata
- Authors
- Ioannidis, J. P. A., Boyack, K. W., & Klavans, R.
- Affiliations
- Stanford University (US)
- SciTech Strategies (United States) (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-07-09
- Volume
- 9
- Issue
- 7
- Pages
- e101698
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4090124
- OpenAlex
- W1979798418
- Cited by
- 160
- References
- 28
- Citations by year
- 2026: 5 · 2025: 14 · 2024: 13 · 2023: 13 · 2022: 10 · 2021: 15 · 2020: 10 · 2019: 6 · 2018: 16 · 2017: 12 · 2016: 21 · 2015: 20 · 2014: 5
- FWCI
- 18.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- scholarly publishing, continuous publication, research workforce, citation impact, highly cited papers, research productivity, Scopus
- MeSH terms
- Workforce, Europe, Humans, North America, Periodicals as Topic, Research Personnel, Social Sciences, Bibliometrics, Peer Review, Research, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.