The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Which Type of Citation Analysis Generates the Most Accurate Taxonomy of Scientific and Technical Knowledge?
Open accessAbstract
In 1965, Price foresaw the day when a citation‐based taxonomy of science and technology would be delineated and correspondingly used for science policy. A taxonomy needs to be comprehensive and accurate if it is to be useful for policy making, especially now that policy makers are utilizing citation‐based indicators to evaluate people, institutions and laboratories. Determining the accuracy of a taxonomy, however, remains a challenge. Previous work on the accuracy of partition solutions is sparse, and the results of those studies, although useful, have not been definitive. In this study we compare the accuracies of topic‐level taxonomies based on the clustering of documents using direct citation, bibliographic coupling, and co‐citation. Using a set of new gold standards—articles with at least 100 references—we find that direct citation is better at concentrating references than either bibliographic coupling or co‐citation. Using the assumption that higher concentrations of references denote more accurate clusters, direct citation thus provides a more accurate representation of the taxonomy of scientific and technical knowledge than either bibliographic coupling or co‐citation. We also find that discipline‐level taxonomies based on journal schema are highly inaccurate compared to topic‐level taxonomies, and recommend against their use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
The Structure of Scientific Revolutions: 50th Anniversary Edition
Kuhn, T. S., & Hacking, I. (2012) · doi:10.7208/chicago/9780226458144.001.0001 · Cited by 21,170
Finding and evaluating community structure in networks
Newman, M. E. J., & Girvan, M. (2004) · Physical Review E · doi:10.1103/physreve.69.026113 · Cited by 13,931
Modularity and community structure in networks
Newman, M. E. J. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601602103 · Cited by 12,256
The Structure of Scientific Revolutions.
Bohm, D., & Kuhn, T. S. (1964) · The Philosophical Quarterly · doi:10.2307/2217783 · Cited by 9,130
Finding community structure in very large networks
Clauset, A., Newman, M. E. J., & Moore, C. (2004) · Physical Review E · doi:10.1103/physreve.70.066111 · Cited by 7,390
Co‐citation in the scientific literature: A new measure of the relationship between two documents
Small, H. (1973) · Journal of the American Society for Information Science · doi:10.1002/asi.4630240406 · Cited by 5,345
Latour, B. (1987) · Cited by 4,106
Price, D. J. D. S. (1965) · Science · doi:10.1126/science.149.3683.510 · Cited by 3,122
Bibliographic coupling between scientific papers
Kessler, M. M. (1963) · American Documentation · doi:10.1002/asi.5090140103 · Cited by 2,855
Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas
Garfield, E. (1955) · Science · doi:10.1126/science.122.3159.108 · Cited by 2,334
THE GENERAL ADAPTATION SYNDROME AND THE DISEASES OF ADAPTATION1
SELYE, H. (1946) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jcem-6-2-117 · Cited by 2,287
The Structure of Scientific Revolutions
Sankey, H. (2002) · Australian & New Zealand Journal of Psychiatry · doi:10.1046/j.1440-1614.2002.t01-5-01102a.x · Cited by 1,850
Atypical Combinations and Scientific Impact
Uzzi, B., Mukherjee, S., Stringer, M., & Jones, B. (2013) · Science · doi:10.1126/science.1240474 · Cited by 1,457
Boyack, K. W., & Klavans, R. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21419 · Cited by 1,427
Self-citationA smart local moving algorithm for large-scale modularity-based community detection
Waltman, L., & van Eck, N. J. (2013) · The European Physical Journal B · doi:10.1140/epjb/e2013-40829-0 · Cited by 1,088
Visualizing science by citation mapping
Small, H. (1999) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1999)50:9<799::aid-asi9>3.0.co;2-g · Cited by 977
The Structure of Scientific Literatures I: Identifying and Graphing Specialties
Small, H., & Griffith, B. C. (1974) · Science Studies · doi:10.1177/030631277400400102 · Cited by 731
A new methodology for constructing a publication‐level classification system of science
Waltman, L., & van Eck, N. J. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22748 · Cited by 661
Tradition and Innovation in Scientists’ Research Strategies
Foster, J. G., Rzhetsky, A., & Evans, J. A. (2015) · American Sociological Review · doi:10.1177/0003122415601618 · Cited by 613
Citation indexes for science. A new dimension in documentation through association of ideas†
Garfield, E. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyl189 · Cited by 505
Characteristics of highly cited papers
Aksnes, D. W. (2003) · Research Evaluation · doi:10.3152/147154403781776645 · Cited by 491
Science overlay maps: A new tool for research policy and library management
Rafols, I., Porter, A. L., & Leydesdorff, L. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21368 · Cited by 430
THE USE OF CITATION DATA IN WRITING THE HISTORY OF SCIENCE
Garfield, E., Sher, I. H., & Torpie, R. J. (1964) · doi:10.21236/ad0466578 · Cited by 429
Wang, Q., & Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.003 · Cited by 417
Identifying emerging topics in science and technology
Small, H., Boyack, K. W., & Klavans, R. (2014) · Research Policy · doi:10.1016/j.respol.2014.02.005 · Cited by 378
Self-citationGlänzel, W., & Schubert, A. (2003) · Scientometrics · doi:10.1023/a:1022378804087 · Cited by 329
Clustering thescience citation index ® using co-citations: I. A comparison of methods
Small, H., & Sweeney, E. (1985) · Scientometrics · doi:10.1007/bf02017157 · Cited by 282
OpenOrd: an open-source toolbox for large graph layout
Martin, S., Brown, W. M., Klavans, R., & Boyack, K. W. (2011) · SPIE Proceedings · doi:10.1117/12.871402 · Cited by 278
Self-citationTen Simple Rules for Writing a Literature Review
Pautasso, M. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003149 · Cited by 272
Boyack, K. W., Newman, D., Duhon, R. J., Klavans, R., Patek, M., Biberstine, J. R., Schijvenaars, B., Skupin, A., Ma, N., & Börner, K. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018029 · Cited by 271
Self-citationThe Hirsch index and related impact measures
Egghe, L. (2010) · Annual Review of Information Science and Technology · doi:10.1002/aris.2010.1440440109 · Cited by 256
Design and Update of a Classification System: The UCSD Map of Science
Börner, K., Klavans, R., Patek, M., Zoss, A. M., Biberstine, J. R., Light, R. P., Larivière, V., & Boyack, K. W. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039464 · Cited by 246
Self-citationCommunity detection in networks: Structural communities versus ground truth
Hric, D., Darst, R. K., & Fortunato, S. (2014) · Physical Review E · doi:10.1103/physreve.90.062805 · Cited by 238
Clustering the science citation index using co-citations. II. Mapping science
Small, H., Sweeney, E., & Greenlee, E. (1985) · Scientometrics · doi:10.1007/bf02018057 · Cited by 194
Various methods for the mapping of science
Leydesdorff, L. (1987) · Scientometrics · doi:10.1007/bf02279351 · Cited by 188
Creation of a highly detailed, dynamic, global model and map of science
Boyack, K. W., & Klavans, R. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.22990 · Cited by 168
Self-citationEstimates of the Continuously Publishing Core in the Scientific Workforce
Ioannidis, J. P. A., Boyack, K. W., & Klavans, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0101698 · Cited by 160
Self-citationLoet Leydesdorff, A., Ràfols, I., & Chen, C. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22946 · Cited by 128
Bibliometrics: Is your most cited work your best?
Ioannidis, J. P. A., Boyack, K. W., Small, H. G., Sorensen, A. A., & Klavans, R. (2014) · Nature · doi:10.1038/514561a · Cited by 126
Self-citationComparison of the results of bibliographic coupling and analytic subject indexing
Kessler, M. M. (1965) · American Documentation · doi:10.1002/asi.5090160309 · Cited by 125
Ruiz‐Castillo, J., & Waltman, L. (2014) · Journal of Informetrics · doi:10.1016/j.joi.2014.11.010 · Cited by 122
Quantitative evaluation of large maps of science
Klavans, R., & Boyack, K. W. (2006) · Scientometrics · doi:10.1007/s11192-006-0125-x · Cited by 102
Self-citationGarcía‐Pérez, M. A. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21372 · Cited by 101
Studies in Scientometrics I Transience and Continuance in Scientific Authorship
Price, D. D. S., & Gürsey, S. (1975) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.18225/ci.inf.v4i1.64 · Cited by 80
Cluster stability and the use of noise in interpretation of clustering
Davidson, G. S., Wylie, B., & Boyack, K. W. (2005) · IEEE Symposium on Information Visualization · doi:10.1109/infvis.2001.963275 · Cited by 77
Self-citationFranklin, J. J., & Johnston, R. (1988) · Elsevier eBooks · doi:10.1016/b978-0-444-70537-2.50017-9 · Cited by 69
Toward an objective, reliable and accurate method for measuring research leadership
Klavans, R., & Boyack, K. W. (2010) · Scientometrics · doi:10.1007/s11192-010-0188-6 · Cited by 54
Self-citationIncluding cited non-source items in a large-scale map of science: What difference does it make?
Boyack, K. W., & Klavans, R. (2014) · Journal of Informetrics · doi:10.1016/j.joi.2014.04.001 · Cited by 45
Self-citation
Cited by
bibliometrix: An R-tool for comprehensive science mapping analysis
Aria, M., & Cuccurullo, C. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.08.007 · Cited by 16,064
From Louvain to Leiden: guaranteeing well-connected communities
Traag, V. A., Waltman, L., & van Eck, N. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-41695-z · Cited by 5,635
Citation-based clustering of publications using CitNetExplorer and VOSviewer
van Eck, N. J., & Waltman, L. (2017) · Scientometrics · doi:10.1007/s11192-017-2300-7 · Cited by 2,664
Fortunato, S., Bergstrom, C. T., Börner, K., Evans, J. A., Helbing, D., Milojević, S., Petersen, A. M., Radicchi, F., Sinatra, R., Uzzi, B., et al. (2018) · Science · doi:10.1126/science.aao0185 · Cited by 1,497
“By applying network science methods to citation networks, researchers are able to identify communities as defined by subsets of publications that frequently cite one another (6).”
Predictive maintenance in the Industry 4.0: A systematic literature review
Zonta, T., da Costa, C. A., da Rosa Righi, R., de Lima, M. J., da Trindade, E. S., & Li, G. P. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106889 · Cited by 1,302
Metadata
- Authors
- Klavans, R., & Boyack, K. W.
- Venue
- Journal of the Association for Information Science and Technology
- Publisher
- Wiley
- Published
- 2016-10-13
- Volume
- 68
- Issue
- 4
- Pages
- 984-998
- ISSN
- 2330-1635 (ISSN-L)
- 2330-1643
- OpenAlex
- W3103443220
- Cited by
- 334
- References
- 49
- FWCI
- 26.89
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.