The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Data-driven predictions in the science of science
Open accessAbstract
The desire to predict discoveries—to have some idea, in advance, of what will be discovered, by whom, when, and where—pervades nearly all aspects of modern science, from individual scientists to publishers, from funding agencies to hiring committees. In this Essay, we survey the emerging and interdisciplinary field of the “science of science” and what it teaches us about the predictability of scientific discovery. We then discuss future opportunities for improving predictions derived from the science of science and its potential impact, positive and negative, on the scientific community.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Price, D. J. D. S. (1965) · Science · doi:10.1126/science.149.3683.510 · Cited by 3,122
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Merton, R. K. (1948) · The Antioch Review · doi:10.2307/4609267 · Cited by 2,145
Merton, R. K. (2016) · The Antioch Review · doi:10.7723/antiochreview.74.3.0504 · Cited by 1,371
Error and the Growth of Experimental Knowledge
Mayo, D. G. (1996) · doi:10.7208/chicago/9780226511993.001.0001 · Cited by 1,325
Race, Ethnicity, and NIH Research Awards
Ginther, D. K., Schaffer, W. T., Schnell, J., Masimore, B., Liu, F., Haak, L. L., & Kington, R. (2011) · Science · doi:10.1126/science.1196783 · Cited by 1,075
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
Quantifying Long-Term Scientific Impact
Wang, D., Song, C., & Barabási, A.-L. (2013) · Science · doi:10.1126/science.1237825 · Cited by 753
Systematic inequality and hierarchy in faculty hiring networks
Clauset, A., Arbesman, S., & Larremore, D. B. (2015) · Science Advances · doi:10.1126/sciadv.1400005 · Cited by 624
Self-citationQuantifying the evolution of individual scientific impact
Sinatra, R., Wang, D., Deville, P., Song, C., & Barabási, A.-L. (2016) · Science · doi:10.1126/science.aaf5239 · Cited by 619
Self-citationCreative productivity: A predictive and explanatory model of career trajectories and landmarks.
Simonton, D. K. (1997) · Psychological Review · doi:10.1037/0033-295x.104.1.66 · Cited by 612
van Raan, A. F. J. (2004) · Scientometrics · doi:10.1023/b:scie.0000018543.82441.f1 · Cited by 579
Boudreau, K. J., Guinan, E. C., Lakhani, K. R., & Riedl, C. (2016) · Management Science · doi:10.1287/mnsc.2015.2285 · Cited by 481
Creative productivity: A predictive and explanatory model of career trajectories and landmarks.
Simonton, D. K. (1997) · Psychological Review · doi:10.1037//0033-295x.104.1.66 · Cited by 446
Citation Statistics from 110 Years of Physical Review
Redner, S. (2005) · Physics Today · doi:10.1063/1.1996475 · Cited by 426
Defining and identifying Sleeping Beauties in science
Ke, Q., Ferrara, E., Radicchi, F., & Flammini, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1424329112 · Cited by 416
Gender differences in grant peer review: A meta-analysis
BORNMANN, L., MUTZ, R., & DANIEL, H. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2007.03.001 · Cited by 337
Age dynamics in scientific creativity
Jones, B. F., & Weinberg, B. A. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1102895108 · Cited by 304
Evans, J. A., & Foster, J. G. (2011) · Science · doi:10.1126/science.1201765 · Cited by 252
The first-mover advantage in scientific publication
Newman, M. E. J. (2009) · EPL (Europhysics Letters) · doi:10.1209/0295-5075/86/68001 · Cited by 187
Negotiating academicity: postgraduate research supervision as category boundary work
Petersen, E. B. (2007) · Studies in Higher Education · doi:10.1080/03075070701476167 · Cited by 162
Weaving the fabric of science: Dynamic network models of science's unfolding structure
Shi, F., Foster, J. G., & Evans, J. A. (2015) · Social Networks · doi:10.1016/j.socnet.2015.02.006 · Cited by 159
The misleading narrative of the canonical faculty productivity trajectory
Way, S. F., Morgan, A. C., Clauset, A. J., & Larremore, D. B. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1702121114 · Cited by 142
Self-citationGender, Productivity, and Prestige in Computer Science Faculty Hiring Networks
Way, S. F., Larremore, D. B., & Clauset, A. J. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872427.2883073 · Cited by 105
Self-citationMoreira, J. A. G., Zeng, X. H. T., & Amaral, L. A. N. (2015) · PLoS ONE · doi:10.1371/journal.pone.0143108 · Cited by 48
Research works printed but not linked: 7
- P. E. Stephan S. G. Levin Striking the Mother Lode in Science: The Importance of Age Place and Time (Oxford Univ. Press 1992).
- 10.1038/538444a · doi:10.1038/538444a
- F.Radicchi et al . Quantifying perceived impact of scientific publications. https://arxiv.org/abs/1612.03962 (2016). · arXiv
- 10.15779/Z38BG31 · doi:10.15779/z38bg31 · Paper page
- Fairness Accountability and Transparency in Machine Learning: 2016 Workshop; www.fatml.org.
- F.Dyson,Birds and frogs. Not. Am. Math. Soc. 56, 212–223 (2009).
- J. Langford “The NIPS experiment” [blog] (Communications of the Association for Computing Machinery 2015); http://cacm.acm.org/blogs/blog-cacm/181996-the-nipsexperiment/fulltext.
Cited by
Fortunato, S., Bergstrom, C. T., Börner, K., Evans, J. A., Helbing, D., Milojević, S., Petersen, A. M., Radicchi, F., Sinatra, R., Uzzi, B., et al. (2018) · Science · doi:10.1126/science.aao0185 · Cited by 1,497
Self-citationThe science of science: From the perspective of complex systems
Zeng, A., Shen, Z., Zhou, J., Wu, J., Fan, Y., Wang, Y., & Stanley, H. E. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.10.001 · Cited by 410
On scientific understanding with artificial intelligence
Krenn, M., Pollice, R., Guo, S. Y., Aldeghi, M., Cervera-Lierta, A., Friederich, P., dos Passos Gomes, G., Häse, F., Jinich, A., Nigam, A., et al. (2022) · Nature Reviews Physics · doi:10.1038/s42254-022-00518-3 · Cited by 372
Data-driven modeling and learning in science and engineering
Montáns, F. J., Chinesta, F., Gómez-Bombarelli, R., & Kutz, J. N. (2019) · Comptes Rendus. Mécanique · doi:10.1016/j.crme.2019.11.009 · Cited by 299
The Why, How, and When of Representations for Complex Systems
Torres, L., Blevins, A. S., Bassett, D., & Eliassi-Rad, T. (2021) · SIAM Review · doi:10.1137/20m1355896 · Cited by 297
Metadata
- Authors
- Clauset, A., Larremore, D. B., & Sinatra, R.
- Venue
- Science
- Published
- 2017-02-03
- Volume
- 355
- Issue
- 6324
- Pages
- 477-480
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2585057539
- Cited by
- 265
- References
- 25
- FWCI
- 21.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.