The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
The science of science: From the perspective of complex systems
Open accessAbstract
The science of science (SOS) is a rapidly developing field which aims to understand, quantify and predict scientific research and the resulting outcomes. The problem is essentially related to almost all scientific disciplines and thus has attracted attention of scholars from different backgrounds. Progress on SOS will lead to better solutions for many challenging issues, ranging from the selection of candidate faculty members by a university to the development of research fields to which a country should give priority. While different measurements have been designed to evaluate the scientific impact of scholars, journals and academic institutions, the multiplex structure, dynamics and evolution mechanisms of the whole system have been much less studied until recently. In this article, we review the recent advances in SOS, aiming to cover the topics from empirical study, network analysis, mechanistic models, ranking, prediction, and many important related issues. The results summarized in this review significantly deepen our understanding of the underlying mechanisms and statistical rules governing the science system. Finally, we review the forefront of SOS research and point out the specific difficulties as they arise from different contexts, so as to stimulate further efforts in this emerging interdisciplinary field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Emergence of Scaling in Random Networks
Barabási, A.-L., & Albert, R. (1999) · Science · doi:10.1126/science.286.5439.509 · Cited by 36,135
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Exploration and Exploitation in Organizational Learning
March, J. G. (1991) · Organization Science · doi:10.1287/orsc.2.1.71 · Cited by 21,942
Software survey: VOSviewer, a computer program for bibliometric mapping
van Eck, N. J., & Waltman, L. (2010) · Scientometrics · doi:10.1007/s11192-009-0146-3 · Cited by 21,484
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
Fortunato, S. (2010) · Physics Reports · doi:10.1016/j.physrep.2009.11.002 · Cited by 11,293
node2vec: Scalable Feature Learning for Networks
Grover, A., & Leskovec, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939754 · Cited by 10,926
Hierarchical Organization of Modularity in Metabolic Networks
Ravasz, E., Somera, A. L., Mongru, D. A., Oltvai, Z. N., & Barabási, A.-L. (2002) · Science · doi:10.1126/science.1073374 · Cited by 4,224
Gompertz, B. (1825) · Philosophical Transactions of the Royal Society of London · doi:10.1098/rstl.1825.0026 · Cited by 3,816
The Increasing Dominance of Teams in Production of Knowledge
Wuchty, S., Jones, B. F., & Uzzi, B. (2007) · Science · doi:10.1126/science.1136099 · Cited by 3,615
Limits of Predictability in Human Mobility
Song, C., Qu, Z., Blumm, N., & Barabási, A.-L. (2010) · Science · doi:10.1126/science.1177170 · Cited by 3,234
The structure and dynamics of multilayer networks
Boccaletti, S., Bianconi, G., Criado, R., del Genio, C. I., Gómez-Gardeñes, J., Romance, M., Sendiña-Nadal, I., Wang, Z., & Zanin, M. (2014) · Physics Reports · doi:10.1016/j.physrep.2014.07.001 · Cited by 3,125
Bibliometrics: The Leiden Manifesto for Research Metrics
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015) · Nature · doi:10.1038/520429a · Cited by 2,828
Garfield, E. (1972) · Science · doi:10.1126/science.178.4060.471 · Cited by 2,788 · cited 2×
“For instance, many proposed metrics, such as the well-known h index [2] for individual scientists and the impact factor [3] for scientific journals, are now widely used in practice.”
BackgroundGraphs over time: densification laws, shrinking diameters and possible explanations
Leskovec, J., Kleinberg, J., & Faloutsos, C. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081893 · Cited by 2,281
The origin of bursts and heavy tails in human dynamics
Barabási, A.-L. (2005) · Nature · doi:10.1038/nature03459 · Cited by 2,210
Hierarchical structure and the prediction of missing links in networks
Clauset, A., Moore, C., & Newman, M. E. J. (2008) · Nature · doi:10.1038/nature06830 · Cited by 2,171
Community Structure in Time-Dependent, Multiscale, and Multiplex Networks
Mucha, P. J., Richardson, T., Macon, K., Porter, M. A., & Onnela, J.-P. (2010) · Science · doi:10.1126/science.1184819 · Cited by 2,123
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
The Hidden Geometry of Complex, Network-Driven Contagion Phenomena
Brockmann, D., & Helbing, D. (2013) · Science · doi:10.1126/science.1245200 · Cited by 1,253
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · cited 1×
“studied a relatively large number of retracted papers in PubMed, finding that the number of retracted papers increases over time [348].”
BackgroundDetecting rich-club ordering in complex networks
Colizza, V., Flammini, A., Serrano, M. A., & Vespignani, A. (2006) · Nature Physics · doi:10.1038/nphys209 · Cited by 1,001
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860 · cited 1×
“focused on the false-positive findings and confirmed via a case study that they persist in scientific publications [341].”
BackgroundLadyman, J., Lambert, J., & Wiesner, K. (2013) · European Journal for Philosophy of Science · doi:10.1007/s13194-012-0056-8 · Cited by 846
Universality of citation distributions: Toward an objective measure of scientific impact
Radicchi, F., Fortunato, S., & Castellano, C. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0806977105 · Cited by 828
Why Copy Others? Insights from the Social Learning Strategies Tournament
Rendell, L., Boyd, R., Cownden, D., Enquist, M., Eriksson, K., Feldman, M. W., Fogarty, L., Ghirlanda, S., Lillicrap, T., & Laland, K. N. (2010) · Science · doi:10.1126/science.1184719 · Cited by 811
Bose-Einstein Condensation in Complex Networks
Bianconi, G., & Barabási, A.-L. (2001) · Physical Review Letters · doi:10.1103/physrevlett.86.5632 · Cited by 808
Structural reducibility of multilayer networks
De Domenico, M., Nicosia, V., Arenas, A., & Latora, V. (2015) · Nature Communications · doi:10.1038/ncomms7864 · Cited by 661
Popularity versus similarity in growing networks
Papadopoulos, F., Kitsak, M., Serrano, M. Á., Boguñá, M., & Krioukov, D. (2012) · Nature · doi:10.1038/nature11459 · Cited by 634
Measuring Contextual Citation Impact of Scientific Journals
Moed, H. F. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.01.002 · Cited by 628
van Raan, A. F. J. (2004) · Scientometrics · doi:10.1023/b:scie.0000018543.82441.f1 · Cited by 579
Hutchins, B. I., Yuan, X., Anderson, J. M., & Santangelo, G. M. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002541 · Cited by 500
Ranking in interconnected multilayer networks reveals versatile nodes
De Domenico, M., Solé-Ribalta, A., Omodei, E., Gómez, S., & Arenas, A. (2015) · Nature Communications · doi:10.1038/ncomms7868 · Cited by 459
Interdisciplinary research by the numbers
Van Noorden, R. (2015) · Nature · doi:10.1038/525306a · Cited by 443
Citation Statistics from 110 Years of Physical Review
Redner, S. (2005) · Physics Today · doi:10.1063/1.1996475 · Cited by 426
A Further Step Forward in Measuring Journals’ Scientific Prestige: The SJR2 Indicator
Guerrero-Bote, V. P., & Moya-Anegón, F. (2012) · Journal of Informetrics · doi:10.1016/j.joi.2012.07.001 · Cited by 406
World citation and collaboration networks: uncovering the role of geography in science
Pan, R. K., Kaski, K., & Fortunato, S. (2012) · Scientific Reports · doi:10.1038/srep00902 · Cited by 304
Partial connectivity increases cultural accumulation within groups
Derex, M., & Boyd, R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1518798113 · Cited by 289
Acuna, D. E., Allesina, S., & Kording, K. P. (2012) · Nature · doi:10.1038/489201a · Cited by 249
Phenomena of Retraction: Reasons for Retraction and Citations to the Publications
Budd, J. M., Sievert, M., & Schultz, T. R. (1998) · JAMA · doi:10.1001/jama.280.3.296 · Cited by 230
Quantitative and empirical demonstration of the Matthew effect in a study of career longevity
Petersen, A. M., Jung, W.-S., Yang, J.-S., & Stanley, H. E. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1016733108 · Cited by 228
Big names or big ideas: Do peer-review panels select the best science proposals?
Li, D., & Agha, L. (2015) · Science · doi:10.1126/science.aaa0185 · Cited by 227
The Retraction Penalty: Evidence from the Web of Science
Lu, S. F., Jin, G. Z., Uzzi, B., & Jones, B. (2013) · Scientific Reports · doi:10.1038/srep03146 · Cited by 191
The Continued Use of Retracted, Invalid Scientific Literature
Pfeifer, M. P. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100140020 · Cited by 188
Persistence and uncertainty in the academic career
Petersen, A. M., Riccaboni, M., Stanley, H. E., & Pammolli, F. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1121429109 · Cited by 188
The advantage of short paper titles
Letchford, A., Moat, H. S., & Preis, T. (2015) · Royal Society Open Science · doi:10.1098/rsos.150266 · Cited by 184
Network Effects on Scientific Collaborations
Uddin, S., Hossain, L., & Rasmussen, K. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057546 · Cited by 160
Social learning strategies modify the effect of network structure on group performance
Barkoczi, D., & Galesic, M. (2016) · Nature Communications · doi:10.1038/ncomms13109 · Cited by 131
Predicting publication success for biologists
Laurance, W. F., Useche, D. C., Laurance, S. G., & Bradshaw, C. J. A. (2013) · BioScience · doi:10.1525/bio.2013.63.10.9 · Cited by 100
Bias in Research Grant Evaluation Has Dire Consequences for Small Universities
Murray, D. L., Morris, D., Lavoie, C., Leavitt, P. R., MacIsaac, H., Masson, M. E. J., & Villard, M.-A. (2016) · PLOS ONE · doi:10.1371/journal.pone.0155876 · Cited by 87 · cited 1×
“conducted a case study of the applications to Canada’s Natural Sciences and Engineering Research Council (NSERC) Discovery Grant program and showed that both the success rates and grant amounts are lower for applicants from small institutes [370].”
MethodSocial Learning Strategies in Networked Groups
Wisdom, T. N., Song, X., & Goldstone, R. L. (2013) · Cognitive Science · doi:10.1111/cogs.12052 · Cited by 83
Fraud: retracted articles are still being cited
Campanario, J. M. (2000) · Nature · doi:10.1038/35042753 · Cited by 28
Cited by
Data-driven materials research enabled by natural language processing and information extraction
Olivetti, E. A., Cole, J. M., Kim, E., Kononova, O., Ceder, G., Han, T. Y.-J., & Hiszpanski, A. M. (2020) · Applied Physics Reviews · doi:10.1063/5.0021106 · Cited by 302
The role of Internet of Things in food supply chain quality management: A review
Ben-Daya, M., Hassini, E., Bahroun, Z., & Banimfreg, B. H. (2021) · Quality Management Journal · doi:10.1080/10686967.2020.1838978 · Cited by 120
Fresh teams are associated with original and multidisciplinary research
Zeng, A., Fan, Y., Di, Z., Wang, Y., & Havlin, S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01084-x · Cited by 106
Self-citationQuantifying the use and potential benefits of artificial intelligence in scientific research
Gao, J., & Wang, D. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02020-5 · Cited by 81
Early indicators of scientific impact: Predicting citations with altmetrics
Akella, A. P., Alhoori, H., Kondamudi, P. R., Freeman, C., & Zhou, H. (2021) · Journal of Informetrics · doi:10.1016/j.joi.2020.101128 · Cited by 74
Metadata
- Authors
- Zeng, A., Shen, Z., Zhou, J., Wu, J., Fan, Y., Wang, Y., & Stanley, H. E.
- Venue
- Physics Reports
- Publisher
- Elsevier BV
- Published
- 2017-11
- Volume
- 714-715
- Pages
- 1-73
- ISSN
- 0370-1573 (ISSN-L)
- OpenAlex
- W2765658614
- Cited by
- 410
- References
- 53
- FWCI
- 27.44
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.