A Century of Science: Globalization of Scientific Collaborations, Citations, and Innovations
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Progress in science has advanced the development of human society across history, with dramatic revolutions shaped by information theory, genetic cloning, and artificial intelligence, among the many scientific achievements produced in the 20th century. However, the way that science advances itself is much less well-understood. In this work, we study the evolution of scientific development over the past century by presenting an anatomy of 89 million digitalized papers published between 1900 and 2015. We find that science has benefited from the shift from individual work to collaborative effort, with over 90% of the world-leading innovations generated by collaborations in this century, nearly four times higher than they were in the 1900s. We discover that rather than the frequent myopic- and self-referencing that was common in the early 20th century, modern scientists instead tend to look for literature further back and farther around. Finally, we also observe the globalization of scientific development from 1900 to 2015, including 25-fold and 7-fold increases in international collaborations and citations, respectively, as well as a dramatic decline in the dominant accumulation of citations by the US, the UK, and Germany, from ~95% to ~50% over the same period. Our discoveries are meant to serve as a starter for exploring the visionary ways in which science has developed throughout the past century, generating insight into and an impact upon the current scientific innovations and funding policies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One reason is that the number of publications is increasing exponentially (8).”
From Dynamics of cross-platform attention to retracted papers (2022) · cites this paper as [8]
Citations
Cites
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
The structure of scientific collaboration networks
Newman, M. E. J. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.2.404 · Cited by 4,482
The Increasing Dominance of Teams in Production of Knowledge
Wuchty, S., Jones, B. F., & Uzzi, B. (2007) · Science · doi:10.1126/science.1136099 · Cited by 3,615
Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas
Garfield, E. (1955) · Science · doi:10.1126/science.122.3159.108 · Cited by 2,334
ArnetMiner: extraction and mining of academic social networks
Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., & Su, Z. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1402008 · Cited by 2,231 · cited 2×
“Besides the study of science, noticeable academic and scientic online systems, such as AMiner [30], CiteSeerX [14], Google Scholar [32], and Microso Academic Services [18, 26], have been developed for beer servicing the scientists for beer science.”
BackgroundAtypical Combinations and Scientific Impact
Uzzi, B., Mukherjee, S., Stringer, M., & Jones, B. (2013) · Science · doi:10.1126/science.1240474 · Cited by 1,457
CiteSeer: an automatic citation indexing system
Giles, C. L., Bollacker, K. D., & Lawrence, S. (1998) · Proceedings of the third ACM conference on Digital libraries - DL '98 · doi:10.1145/276675.276685 · Cited by 1,040 · cited 1×
“Besides the study of science, noticeable academic and scientific online systems, such as AMiner [30], Cite-SeerX [14], Google Scholar [32], and Microsoft Academic Services [18, 26], have been developed for better servicing the scientists for better science.”
BackgroundUniversality of citation distributions: Toward an objective measure of scientific impact
Radicchi, F., Fortunato, S., & Castellano, C. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0806977105 · Cited by 828 · cited 1×
“In addition to the prediction of impact, tremendous effort has been devoted to the characterization of scientific impact, such as its universal citation distributions [22], author credit allocation [23, 24], and h - index’s growth pattern [10].”
BackgroundMulti-University Research Teams: Shifting Impact, Geography, and Stratification in Science
Jones, B. F., Wuchty, S., & Uzzi, B. (2008) · Science · doi:10.1126/science.1158357 · Cited by 812
Quantifying Long-Term Scientific Impact
Wang, D., Song, C., & Barabási, A.-L. (2013) · Science · doi:10.1126/science.1237825 · Cited by 753 · cited 3×
“In particular, the prediction of citation count and h -index has attracted various of attention from diverse communities, including information science [6], computer science [13, 19, 36], Physics [34] and so on.”
BackgroundMeasuring Scholarly Impact: Methods and Practice
(2014) · Springer eBooks · doi:10.1007/978-3-319-10377-8 · Cited by 675
An Overview of Microsoft Academic Service (MAS) and Applications
Sinha, A., Shen, Z., Song, Y., Ma, H., Eide, D., Hsu, B.-J. (., & Wang, K. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742839 · Cited by 658 · cited 2×
“Besides the study of science, noticeable academic and scientific online systems, such as AMiner [30], Cite-SeerX [14], Google Scholar [32], and Microsoft Academic Services [18, 26], have been developed for better servicing the scientists for better science.”
BackgroundMethodSelf-citationMining Heterogeneous Information Networks: Principles and Methodologies
Sun, Y., & Han, J. (2012) · Synthesis lectures on data mining and knowledge discovery · doi:10.2200/s00433ed1v01y201207dmk005 · Cited by 471 · cited 1×
“Further, network science has brought a network perspective to the analysis of scientific collaboration and citation, including the anatomy of collaboration [20, 29] and citation [21] networks, team organization [17], and heterogeneous entity and structure [27, 33].”
BackgroundMeasuring Scholarly Impact: Methods and Practice
Ding, Y., Rousseau, R., & Wolfram, D. (2014) · Cited by 335
World citation and collaboration networks: uncovering the role of geography in science
Pan, R. K., Kaski, K., & Fortunato, S. (2012) · Scientific Reports · doi:10.1038/srep00902 · Cited by 304 · cited 2×
“Another two related work studied the collaboration or citation links happened between two institutions conditioned on their geographical locations by using a set of papers published between 2003 and 2010 [21], and between 1996 and 2013 [8], respectively, disabling the potential to unveil the evolution of science over…”
BackgroundCross-domain collaboration recommendation
Tang, J., Wu, S., Sun, J., & Su, H. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339730 · Cited by 292 · cited 1×
“Further, network science has brought a network perspective to the analysis of scientific collaboration and citation, including the anatomy of collaboration [20, 29] and citation [21] networks, team organization [17], and heterogeneous entity and structure [27, 33].”
BackgroundGehrke, J., Ginsparg, P., & Kleinberg, J. (2003) · ACM SIGKDD Explorations Newsletter · doi:10.1145/980972.980992 · Cited by 281 · cited 1×
“In particular, the prediction of citation count and h -index has attracted various of attention from diverse communities, including information science [6], computer science [13, 19, 36], Physics [34] and so on.”
BackgroundAcuna, D. E., Allesina, S., & Kording, K. P. (2012) · Nature · doi:10.1038/489201a · Cited by 249 · cited 3×
“In particular, the prediction of citation count and h -index has attracted various of attention from diverse communities, including information science [6], computer science [13, 19, 36], Physics [34] and so on.”
BackgroundCollective credit allocation in science
Shen, H.-W., & Barabási, A.-L. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1401992111 · Cited by 196 · cited 2×
“6 RELATEDWORK Science of science has been an emerging discipline wherein science is used to study the development of itself—science [6, 12, 24, 31].”
BackgroundSinatra, R., Deville, P., Szell, M., Wang, D., & Barabási, A.-Ĺ. (2015) · Nature Physics · doi:10.1038/nphys3494 · Cited by 184
Quantifying Coauthor Contributions
Şekercioğlu, Ç. H. (2008) · Science · doi:10.1126/science.322.5900.371a · Cited by 154 · cited 1×
“In addition to the prediction of impact, tremendous effort has been devoted to the characterization of scientific impact, such as its universal citation distributions [22], author credit allocation [23, 24], and h - index’s growth pattern [10].”
BackgroundTo better stand on the shoulder of giants
Yan, R., Huang, C., Tang, J., Zhang, Y., & Li, X. (2012) · Proceedings of the 12th ACM/IEEE-CS joint conference on Digital Libraries · doi:10.1145/2232817.2232831 · Cited by 105
Handful of papers dominates citation
Barabási, A.-Ĺ., Song, C., & Wang, D. (2012) · Nature · doi:10.1038/491040a · Cited by 74 · cited 1×
“A previous case study [7] has also shown a similar trend, wherein the top 1% most-cited papers in ve journals published in 1990 collected 5%∼20% of the citations within 5–20 years.”
ResultGoogle Scholar pioneer on search engine’s future
Noorden, R. V. (2014) · Nature · doi:10.1038/nature.2014.16269 · Cited by 54 · cited 2×
“Besides the study of science, noticeable academic and scientic online systems, such as AMiner [30], CiteSeerX [14], Google Scholar [32], and Microso Academic Services [18, 26], have been developed for beer servicing the scientists for beer science.”
BackgroundCimini, G., Zaccaria, A., & Gabrielli, A. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.01.002 · Cited by 49 · cited 1×
“…the collaboration or citation links happened between two institutions conditioned on their geographical locations by using a set of papers published between 2003 and 2010 [21], and between 1996 and 2013 [8], respectively, disabling the potential to unveil the evolution of science over centuries.”
BackgroundThe Child is Father of the Man: Foresee the Success at the Early Stage
Li, L., & Tong, H. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783340 · Cited by 33
Quantifying Publication Impact
Taber, D. F. (2005) · Science · doi:10.1126/science.309.5744.2166a · Cited by 32
The Child is Father of the Man: Foresee the Success at the Early StagePreprint
Li, L., & Tong, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00948 · Cited by 19
WSDM Cup 2016: Entity Ranking Challenge
Wade, A. D., Wang, K., Sun, Y., & Gullì, A. (2016) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2835776.2855119 · Cited by 19 · cited 1×
“Further, network science has brought a network perspective to the analysis of scientific collaboration and citation, including the anatomy of collaboration [20, 29] and citation [21] networks, team organization [17], and heterogeneous entity and structure [27, 33].”
BackgroundSelf-citationCollaboration Signatures Reveal Scientific Impact
Dong, Y., Johnson, R. A., Yang, Y., & Chawla, N. V. (2015) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/2808797.2808846 · Cited by 16 · cited 1×
“…increase every 12 years for the past 116 years, which is in accordance with previous discoveries in individual fields such as Computer Science [11] and Physics [25]. exponential development of science was derailed twice, once around 1915 and once around 1940, corresponding to World Wars I and…”
ResultSelf-citationAI science search engines expand their reach
Jones, N. (2016) · Nature · doi:10.1038/nature.2016.20964 · Cited by 16 · cited 1×
“Besides the study of science, noticeable academic and scientic online systems, such as AMiner [30], CiteSeerX [14], Google Scholar [32], and Microso Academic Services [18, 26], have been developed for beer servicing the scientists for beer science.”
Background
Research works printed but not linked: 2
- Yuxiao Dong , Reid A. Johnson , and Nitesh V . Chawla . 2015 . Will This Paper Increase Your h-index?: Scientific Impact Prediction WSDM '15. ACM , 149--158. Yuxiao Dong, Reid A. Johnson, and Nitesh V. Chawla. 2015. Will This Paper Increase Your h-index?: Scientific Impact Prediction WSDM '15. ACM, 149--158.
- Won-Seok Hwang , Soo-Min Chae , Sang-Wook Kim , and Gyun Woo .2010. Yet Another Paper Ranking Algorithm Advocating Recent Publications WWW '10 . ACM, 1117--1118. Won-Seok Hwang, Soo-Min Chae, Sang-Wook Kim, and Gyun Woo.2010. Yet Another Paper Ranking Algorithm Advocating Recent Publications WWW '10. ACM, 1117--1118.
Cited by
Heterogeneous Graph Transformer
Hu, Z., Dong, Y., Wang, K., & Sun, Y. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380027 · Cited by 1,646
“, 1) the volume of publications doubles every 12 years [4], and 2) the KDD conference was more related to database in the 1990s whereas more to machine learning in recent years; Finally, OAG contains hundreds of millions of nodes ar X iv :2 00 3.”
BackgroundSelf-citationDeepInf: Social Influence Prediction with Deep Learning
Qiu, J., Tang, J., Ma, H., Dong, Y., Wang, K., & Tang, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220077 · Cited by 587
“OAG 4 OAG (Open Academic Graph) dataset is generated by linking two large academic graphs: Microsoft Academic Graph [15] and AMiner [44].”
MethodSelf-citationOpen Graph Benchmark: Datasets for Machine Learning on Graphs
Hu, W., Fey, M., Žitnik, M., Dong, Y., Ren, H., Liu, B., Catasta, M., & Leskovec, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00687 · Cited by 470
“With the volume of scientific publications doubling every 12 years over the past century (Dong et al., 2017), it is practically critical to automatically classify each publication’s areas and topics.”
BackgroundSelf-citationOGB-LSC: A Large-Scale Challenge for Machine Learning on GraphsPreprint
Hu, W., Fey, M., Ren, H., Nakata, M., Dong, Y., & Leskovec, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.09430 · Cited by 444
“The volume of scientific publication has been increasing exponentially, doubling every 12 years (Dong et al., 2017).”
BackgroundSelf-citationOver-optimization of academic publishing metrics: observing Goodhart's Law in action
Fire, M., & Guestrin, C. (2019) · GigaScience · doi:10.1093/gigascience/giz053 · Cited by 351
“From the perspective of impact and innovations, Dong et al. observed “diversifica-tion of scientific development across the planet over the past century” [53].”
Metadata
- Authors
- Dong, Y., Ma, H., Shen, Z., & Wang, K.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
- Publisher
- ACM
- Published
- 2017-08-13
- Pages
- 1437-1446
- OpenAlex
- W2610002097
- Cited by
- 89
- References
- 31
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 7 · 2023: 10 · 2022: 10 · 2021: 12 · 2020: 9 · 2019: 8 · 2018: 8 · 2017: 1
- FWCI
- 19.60
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- Funders
- National Institutes of Health
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Library Science and Information
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- evolution of science, research collaboration, international scientific collaboration, citation patterns, scientific impact, globalization of science, history of science, research funding policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.