The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Microsoft Academic Graph: When experts are not enough
Open accessAbstract
An ongoing project explores the extent to which artificial intelligence (AI), specifically in the areas of natural language processing and semantic reasoning, can be exploited to facilitate the studies of science by deploying software agents equipped with natural language understanding capabilities to read scholarly publications on the web. The knowledge extracted by these AI agents is organized into a heterogeneous graph, called Microsoft Academic Graph (MAG), where the nodes and the edges represent the entities engaging in scholarly communications and the relationships among them, respectively. The frequently updated data set and a few software tools central to the underlying AI components are distributed under an open data license for research and commercial applications. This paper describes the design, schema, and technical and business motivations behind MAG and elaborates how MAG can be used in analytics, search, and recommendation scenarios. How AI plays an important role in avoiding various biases and human induced errors in other data sets and how the technologies can be further improved in the future are also discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Garfield, E. (1972) · Science · doi:10.1126/science.178.4060.471 · Cited by 2,788 · cited 2×
“It has seen tremendous growth since the pioneer work by Eugene Garfield at the Institute for Scientific Information (ISI), now part of Clarivate Analytics (Garfield, 1955, 1964, 1972).”
BackgroundCitation Indexes for Science: A New Dimension in Documentation through Association of Ideas
Garfield, E. (1955) · Science · doi:10.1126/science.122.3159.108 · Cited by 2,334
2013 IEEE International Conference on Big Data
(2013) · doi:10.1109/bigdata21311.2013 · Cited by 1,390
An Overview of Microsoft Academic Service (MAS) and Applications
Sinha, A., Shen, Z., Song, Y., Ma, H., Eide, D., Hsu, B.-J. (., & Wang, K. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742839 · Cited by 658
Self-citationThe Handbook of Evolutionary Psychology
(2015) · Wiley eBooks · doi:10.1002/9780470939376 · Cited by 608
Unbiased Learning-to-Rank with Biased Feedback
Joachims, T., Swaminathan, A., & Schnabel, T. (2017) · Proceedings of the Tenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3018661.3018699 · Cited by 531
The Evolution of Cognitive Bias
Haselton, M. G., Nettle, D., & Andrews, P. W. (2015) · The Handbook of Evolutionary Psychology · doi:10.1002/9780470939376.ch25 · Cited by 472
Coercive Citation in Academic Publishing
Wilhite, A. W., & Fong, E. A. (2012) · Science · doi:10.1126/science.1212540 · Cited by 433
Dimensions: Building Context for Search and Evaluation
Hook, D. W., Porter, S. J., & Herzog, C. (2018) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2018.00023 · Cited by 325
Good‐turing frequency estimation without tears*
Gale, W. A., & Sampson, G. (1995) · Journal of Quantitative Linguistics · doi:10.1080/09296179508590051 · Cited by 314
Learning to Rank with Selection Bias in Personal Search
Wang, X., Bendersky, M., Metzler, D., & Najork, M. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911537 · Cited by 284
The Google scholar experiment: How to index false papers and manipulate bibliometric indicators
Delgado López‐Cózar, E., Robinson‐García, N., & Torres‐Salinas, D. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23056 · Cited by 272
PageRank: standing on the shoulders of giants
Franceschet, M. (2011) · Communications of the ACM · doi:10.1145/1953122.1953146 · Cited by 193
Ten Hot Topics around Scholarly Publishing
Tennant, J., Crane, H., Crick, T., Dávila, J. A., Enkhbayar, A., Havemann, J., Kramer, B. M. R., Martin, R., Masuzzo, P., Nobes, A., et al. (2019) · Publications · doi:10.3390/publications7020034 · Cited by 190
Beliefs and biases in web search
White, R. (2013) · Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/2484028.2484053 · Cited by 183
A Review of Microsoft Academic Services for Science of Science Studies
Wang, K., Shen, Z., Huang, C., Wu, C., Eide, D., Dong, Y., Qian, J., Kanakia, A., Chen, A., & Rogahn, R. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00045 · Cited by 175
Self-citationHarzing, A.-W. (2019) · Scientometrics · doi:10.1007/s11192-019-03114-y · Cited by 164
Sustainable computational science: the ReScience initiative
Rougier, N. P., Hinsen, K., Alexandre, F., Arildsen, T., Barba, L. A., Benureau, F., Brown, C. T., de Buyl, P., Çağlayan, O., Davison, A. P., et al. (2017) · PeerJ Computer Science · doi:10.7717/peerj-cs.142 · Cited by 141
Promise and Pitfalls of Extending Google's PageRank Algorithm to Citation Networks
Maslov, S., & Redner, S. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.0002-08.2008 · Cited by 128
Zhang, Y., Zhang, F., Yao, P., & Tang, J. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219859 · Cited by 124
The Coverage of Microsoft Academic: Analyzing the Publication Output of a University
Hug, S. E., & Brändle, M. P. (2017) · Scientometrics · doi:10.1007/s11192-017-2535-3 · Cited by 120
Microsoft Academic: is the phoenix getting wings?
Harzing, A.-W. K., & Alakangas, S. (2016) · Scientometrics · doi:10.1007/s11192-016-2185-x · Cited by 114
Citation analysis with microsoft academic
Hug, S. E., Ochsner, M., & Brändle, M. P. (2017) · Scientometrics · doi:10.1007/s11192-017-2247-8 · Cited by 112
An Analysis of the Microsoft Academic Graph
Herrmannová, D., & Knoth, P. (2016) · D-Lib Magazine · doi:10.1045/september2016-herrmannova · Cited by 77
PageRank-Related Methods for Analyzing Citation Networks
Waltman, L., & Yan, E. (2014) · Springer eBooks · doi:10.1007/978-3-319-10377-8_4 · Cited by 61
Thelwall, M. A. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.11.001 · Cited by 50
Thelwall, M. A. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.10.006 · Cited by 44
A Scalable Hybrid Research Paper Recommender System for Microsoft Academic
Kanakia, A., Shen, Z., Eide, D., & Wang, K. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313700 · Cited by 44
Self-citationThe Microsoft academic search dataset and KDD Cup 2013
Roy, S. B., Cock, M. D., Mandava, V., Savvana, S., Dalessandro, B., Perlich, C., Cukierski, W. J., & Hamner, B. (2013) · doi:10.1145/2517288.2517299 · Cited by 38
Thelwall, M. A. (2018) · RePEc: Research Papers in Economics · Cited by 35
Does Microsoft Academic find early citations?
Thelwall, M. A. (2017) · Scientometrics · doi:10.1007/s11192-017-2558-9 · Cited by 32
Open Scholarship and Peer Review: a Time for Experimentation
Soergel, D. A. W., Saunders, A., & McCallum, A. (2013) · Cited by 24
Kousha, K., Thelwall, M. A., & Abdoli, M. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.01.009 · Cited by 23
Tang, J. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872518.2890513 · Cited by 21
Thelwall, M. A. (2018) · Scientometrics · doi:10.1007/s11192-018-2704-z · Cited by 15
Li, C., Su, Y.-C., Lin, T., Tsai, C.-H., Chang, W., Huang, K.-H., Kuo, T.-M., Lin, S.-W., Lin, Y., Lu, Y., et al. (2015) · Journal of Machine Learning Research · Cited by 9
The state‐of‐the‐art of open peer review: Early adopters
Wang, P., & Tahamtan, I. (2017) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2017.14505401170 · Cited by 8
Large-scale author coreference via hierarchical entity representations
Wick, M., Kobren, A., & McCallum, A. (2013) · Cited by 3
(2005)
Cited by
Martín-Martín, A., Thelwall, M., Orduna-Malea, E., & Delgado López-Cózar, E. (2021) · Scientometrics · doi:10.1007/s11192-020-03690-4 · Cited by 1,018
Visser, M., van Eck, N. J., & Waltman, L. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00112 · Cited by 865
Knowledge Graphs: Opportunities and Challenges
Peng, C., Xia, F., Naseriparsa, M., & Osborne, F. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10465-9 · Cited by 717
Bornmann, L., Haunschild, R., & Mutz, R. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00903-w · Cited by 496
Open Graph Benchmark: Datasets for Machine Learning on Graphs
Hu, W., Fey, M., Žitnik, M., Dong, Y., Ren, H., Liu, B., Catasta, M., & Leskovec, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00687 · Cited by 470
Self-citation
Metadata
- Authors
- Wang, K., Shen, Z., Huang, C., Wu, C.-H., Dong, Y., & Kanakia, A.
- Venue
- Quantitative Science Studies
- Publisher
- MIT Press
- Published
- 2020-02
- Volume
- 1
- Issue
- 1
- Pages
- 396-413
- ISSN
- 2641-3337 (ISSN-L)
- OpenAlex
- W3002924435
- Cited by
- 509
- References
- 42
- FWCI
- 38.58
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.