The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Bias against novelty in science: A cautionary tale for users of bibliometric indicators
Open accessAbstract
Research which explores unchartered waters has a high potential for major impact but also carries a high uncertainty of having minimal impact. Such explorative research is often described as taking a novel approach. This study examines the complex relationship between pursuing a novel approach and impact. We measure novelty by examining the extent to which a published paper makes first time ever combinations of referenced journals, taking into account the difficulty of making such combinations. We apply this newly developed measure of novelty to a set of one million research articles across all scientific disciplines. We find that highly novel papers, defined to be those that make more (distinct) new combinations, have more than a triple probability of being a top 1% highly cited paper when using a sufficiently long citation time window to assess impact. Moreover, follow-on papers that cite highly novel research are themselves more likely to be highly cited. However, novel research is also risky as it has a higher variance in the citation performance. These findings are consistent with the “high risk/high gain” characteristic of novel research. We also find that novel papers are typically published in journals with a lower than expected Impact Factor and are less cited when using a short time window. Our findings suggest that science policy, in particular funding decisions which are over reliant on traditional bibliometric indicators based on short-term direct citation counts and Journal Impact Factors, may be biased against novelty.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
Exploration and Exploitation in Organizational Learning
March, J. G. (1991) · Organization Science · doi:10.1287/orsc.2.1.71 · Cited by 21,942
An Evolutionary Theory of Economic Change.
Loasby, B. J., Nelson, R. R., & Winter, S. G. (1983) · The Economic Journal · doi:10.2307/2232409 · Cited by 21,366
Economic Welfare and the Allocation of Resources for Invention
Arrow, K. J. (1962) · The Rate and Direction of Inventive Activity · doi:10.1515/9781400879762-024 · Cited by 8,635
THE STRUCTURE OF SCIENTIFIC REVOLUTIONS
MCGUIRE, J. E. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00813.x · Cited by 8,424
Structural Holes and Good Ideas
Burt, R. S. (2004) · American Journal of Sociology · doi:10.1086/421787 · Cited by 5,642
The associative basis of the creative process.
Mednick, S. (1962) · Psychological Review · doi:10.1037/h0048850 · Cited by 4,140 · cited 1×
“This combinatorial view of novelty has been embraced by studies with various disciplinary roots (Burt, 2004; Mednick, 1962; Nelson & Winter, 1982; Schumpeter, 1939; Simonton, 2004), and there is an emerging interest in operationalizing this view to measure the novelty of patents, research…”
The Origins of Endogenous Growth
Romer, P. M. (1994) · Journal of Economic Perspectives · doi:10.1257/jep.8.1.3 · Cited by 3,783
The New Production of Knowledge
Gibbons, M. (1994) · Medical Entomology and Zoology · Cited by 3,405
Recombinant Uncertainty in Technological Search
Fleming, L. (2001) · Management Science · doi:10.1287/mnsc.47.1.117.10671 · Cited by 2,873
Cited by
Guidelines for advancing theory and practice through bibliometric research
Mukherjee, D., Lim, W. M., Kumar, S., & Donthu, N. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.04.042 · Cited by 1,135
Circular economy business models: The state of research and avenues ahead
Ferasso, M., Beliaeva, T., Kraus, S., Clauss, T., & Ribeiro‐Soriano, D. (2020) · Business Strategy and the Environment · doi:10.1002/bse.2554 · Cited by 588
The citation advantage of linking publications to research data
Colavizza, G., Hrynaszkiewicz, I., Staden, I., Whitaker, K., & McGillivray, B. (2020) · PLOS ONE · doi:10.1371/journal.pone.0230416 · Cited by 335
Swedberg, R. (2020) · The Production of Knowledge · doi:10.1017/9781108762519.002 · Cited by 293
Reliance on science: Worldwide front‐page patent citations to scientific articles
Marx, M., & Fuegi, A. (2020) · Strategic Management Journal · doi:10.1002/smj.3145 · Cited by 266
When Is More Uncertainty Better? A Model of Uncertainty Regulation and Effectiveness
Griffin, M. A., & Grote, G. (2020) · Academy of Management Review · doi:10.5465/amr.2018.0271 · Cited by 223
NIH peer review: Criterion scores completely account for racial disparities in overall impact scores
Erosheva, E. A., Grant, S., Chen, M.-C., Lindner, M. D., Nakamura, R. K., & Lee, C. J. (2020) · Science Advances · doi:10.1126/sciadv.aaz4868 · Cited by 125
Who games metrics and rankings? Institutional niches and journal impact factor inflation
Siler, K., & Larivière, V. (2022) · Research Policy · doi:10.1016/j.respol.2022.104608 · Cited by 70
The Pricing of Open Access Journals: Diverse Niches and Sources of Value in Academic Publishing
Siler, K., & Frenken, K. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00016 · Cited by 64
How can Blockchain technology support patent management? A systematic literature review
Denter, N. M., Seeger, F., & Moehrle, M. G. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2022.102506 · Cited by 64
Evaluating Research and Researchers by the Journal Impact Factor: Is It Better than Coin Flipping?
Brito, R., & Rodríguez-Navarro, A. (2019) · Journal of Informetrics · doi:10.1016/j.joi.2019.01.009 · Cited by 47
Galli, C., Sala, R., Colangelo, M. T., & Guizzardi, S. (2022) · Scientometrics · doi:10.1007/s11192-022-04434-2 · Cited by 5
“Figure III could still show a WB but with ICAM/VCAM adhesion proteins, together with their bar charts, followed by a bar chart representing the effects of the X compound on cell adhesion (Yong Li et al., 2016; Song et al., 2016), but these two figures could also appear in the inverted order (Lin et al., 2017; Xiaodong…”
InfluentialN. Lane, J., Friis, S., Cai, T., Menietti, M., Weber, G., & Guinan, E. (2024) · doi:10.2139/ssrn.4769282 · Cited by 3
Metadata
- Authors
- Wang, J., Veugelers, R., & Stephan, P.
- Venue
- Research Policy
- Publisher
- Elsevier BV
- Published
- 2017-10
- Volume
- 46
- Issue
- 8
- Pages
- 1416-1436
- ISSN
- 0048-7333 (ISSN-L)
- OpenAlex
- W3123050710
- Cited by
- 540
- References
- 55
- FWCI
- 33.46
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.