The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Which Type of Citation Analysis Generates the Most Accurate Taxonomy of Scientific and Technical Knowledge?
Open accessAbstract
In 1965, Price foresaw the day when a citation‐based taxonomy of science and technology would be delineated and correspondingly used for science policy. A taxonomy needs to be comprehensive and accurate if it is to be useful for policy making, especially now that policy makers are utilizing citation‐based indicators to evaluate people, institutions and laboratories. Determining the accuracy of a taxonomy, however, remains a challenge. Previous work on the accuracy of partition solutions is sparse, and the results of those studies, although useful, have not been definitive. In this study we compare the accuracies of topic‐level taxonomies based on the clustering of documents using direct citation, bibliographic coupling, and co‐citation. Using a set of new gold standards—articles with at least 100 references—we find that direct citation is better at concentrating references than either bibliographic coupling or co‐citation. Using the assumption that higher concentrations of references denote more accurate clusters, direct citation thus provides a more accurate representation of the taxonomy of scientific and technical knowledge than either bibliographic coupling or co‐citation. We also find that discipline‐level taxonomies based on journal schema are highly inaccurate compared to topic‐level taxonomies, and recommend against their use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
The Structure of Scientific Revolutions: 50th Anniversary Edition
Kuhn, T. S., & Hacking, I. (2012) · doi:10.7208/chicago/9780226458144.001.0001 · Cited by 21,170
Finding and evaluating community structure in networks
Newman, M. E. J., & Girvan, M. (2004) · Physical Review E · doi:10.1103/physreve.69.026113 · Cited by 13,931
Modularity and community structure in networks
Newman, M. E. J. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601602103 · Cited by 12,256
The Structure of Scientific Revolutions.
Bohm, D., & Kuhn, T. S. (1964) · The Philosophical Quarterly · doi:10.2307/2217783 · Cited by 9,130
Finding community structure in very large networks
Clauset, A., Newman, M. E. J., & Moore, C. (2004) · Physical Review E · doi:10.1103/physreve.70.066111 · Cited by 7,390
Co‐citation in the scientific literature: A new measure of the relationship between two documents
Small, H. (1973) · Journal of the American Society for Information Science · doi:10.1002/asi.4630240406 · Cited by 5,345
Latour, B. (1987) · Cited by 4,106
Price, D. J. D. S. (1965) · Science · doi:10.1126/science.149.3683.510 · Cited by 3,122
Bibliographic coupling between scientific papers
Kessler, M. M. (1963) · American Documentation · doi:10.1002/asi.5090140103 · Cited by 2,855
Cited by
bibliometrix: An R-tool for comprehensive science mapping analysis
Aria, M., & Cuccurullo, C. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.08.007 · Cited by 16,064
From Louvain to Leiden: guaranteeing well-connected communities
Traag, V. A., Waltman, L., & van Eck, N. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-41695-z · Cited by 5,635
“Similarly, in citation networks, such as the Web of Science network, nodes in a community are usually considered to share a common topic 26,27 .”
BackgroundCitation-based clustering of publications using CitNetExplorer and VOSviewer
van Eck, N. J., & Waltman, L. (2017) · Scientometrics · doi:10.1007/s11192-017-2300-7 · Cited by 2,664
Fortunato, S., Bergstrom, C. T., Börner, K., Evans, J. A., Helbing, D., Milojević, S., Petersen, A. M., Radicchi, F., Sinatra, R., Uzzi, B., et al. (2018) · Science · doi:10.1126/science.aao0185 · Cited by 1,497
“By applying network science methods to citation networks, researchers are able to identify communities as defined by subsets of publications that frequently cite one another (6).”
Predictive maintenance in the Industry 4.0: A systematic literature review
Zonta, T., da Costa, C. A., da Rosa Righi, R., de Lima, M. J., da Trindade, E. S., & Li, G. P. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106889 · Cited by 1,302
Cipresso, P., Giglioli, I. A. C., Raya, M. A., & Riva, G. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02086 · Cited by 1,131
Social innovation research: An emerging area of innovation studies?
van der Have, R. P., & Rubalcaba, L. (2016) · Research Policy · doi:10.1016/j.respol.2016.06.010 · Cited by 796
Hallinger, P., & Kovačević, J. (2019) · Review of Educational Research · doi:10.3102/0034654319830380 · Cited by 490
Annarelli, A., Battistella, C., Nonino, F., Parida, V., & Pessot, E. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.120635 · Cited by 422
Wang, Q., & Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.003 · Cited by 417
The citation advantage of linking publications to research data
Colavizza, G., Hrynaszkiewicz, I., Staden, I., Whitaker, K., & McGillivray, B. (2020) · PLOS ONE · doi:10.1371/journal.pone.0230416 · Cited by 335
Exploring Topics in Bibliometric Research Through Citation Networks and Semantic Analysis
Mejia, C., Wu, M., Zhang, Y., & Kajikawa, Y. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.742311 · Cited by 316
Springer Handbook of Science and Technology Indicators
(2019) · Springer Handbooks · doi:10.1007/978-3-030-02511-3 · Cited by 300
Shen, C.-W., & Ho, J.-T. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2019.106177 · Cited by 283
Comparing Journal and Paper Level Classifications of Science
Shu, F., Julien, C.-A., Zhang, L., Qiu, J., Zhang, J., & Larivière, V. (2019) · Journal of Informetrics · doi:10.1016/j.joi.2018.12.005 · Cited by 95
AI Research Funding Portfolios and Extreme Growth
Rahkovsky, I., Toney, A., Boyack, K. W., Klavans, R., & Murdick, D. A. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.630124 · Cited by 24
Self-citationWhat drives the growth of black holes: A decade of progress
Alexander, D. M., Hickox, R. C., Aird, J., Combes, F., Costa, T., Habouzit, M., Harrison, C. M., Leng, R. I., Morabito, L. K., Uckelman, S. L., et al. (2025) · New Astronomy Reviews · doi:10.1016/j.newar.2025.101733 · Cited by 18
Metadata
- Authors
- Klavans, R., & Boyack, K. W.
- Venue
- Journal of the Association for Information Science and Technology
- Publisher
- Wiley
- Published
- 2016-10-13
- Volume
- 68
- Issue
- 4
- Pages
- 984-998
- ISSN
- 2330-1635 (ISSN-L)
- 2330-1643
- OpenAlex
- W3103443220
- Cited by
- 334
- References
- 49
- FWCI
- 26.89
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.