The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Co‐citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately?
Abstract
In the past several years studies have started to appear comparing the accuracies of various science mapping approaches. These studies primarily compare the cluster solutions resulting from different similarity approaches, and give varying results. In this study we compare the accuracies of cluster solutions of a large corpus of 2,153,769 recent articles from the biomedical literature (2004–2008) using four similarity approaches: co‐citation analysis, bibliographic coupling, direct citation, and a bibliographic coupling‐based citation‐text hybrid approach. Each of the four approaches can be considered a way to represent the research front in biomedicine, and each is able to successfully cluster over 92% of the corpus. Accuracies are compared using two metrics—within‐cluster textual coherence as defined by the Jensen‐Shannon divergence, and a concentration measure based on the grant‐to‐article linkages indexed in MEDLINE. Of the three pure citation‐based approaches, bibliographic coupling slightly outperforms co‐citation analysis using both accuracy measures; direct citation is the least accurate mapping approach by far. The hybrid approach improves upon the bibliographic coupling results in all respects. We consider the results of this study to be robust given the very large size of the corpus, and the specificity of the accuracy measures used.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Co‐citation in the scientific literature: A new measure of the relationship between two documents
Small, H. (1973) · Journal of the American Society for Information Science · doi:10.1002/asi.4630240406 · Cited by 5,345 · cited 1×
“While bibliographic coupling (Kessler, 1963) and co-citation analysis (Marshakova, 1973; Small, 1973) both trace their roots back several decades, co-citation analysis was adopted as the de facto standard in the 1970s, and has enjoyed that position of preference ever since.”
Divergence measures based on the Shannon entropy
Lin, J. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.61115 · Cited by 5,140
Bibliographic coupling between scientific papers
Kessler, M. M. (1963) · American Documentation · doi:10.1002/asi.5090140103 · Cited by 2,855
Mapping the backbone of science
Boyack, K. W., Klavans, R., & Börner, K. (2005) · Scientometrics · doi:10.1007/s11192-005-0255-6 · Cited by 937
Self-citationAlignment-free genome comparison with feature frequency profiles (FFP) and optimal resolutions
Sims, G. E., Jun, S.-R., Wu, G. A., & Kim, S.-H. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0813249106 · Cited by 400
Mapping of science by combined co-citation and word analysis. I. Structural aspects
Braam, R. R., Moed, H. F., & van Raan, A. F. J. (1991) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199105)42:4<233::aid-asi1>3.0.co;2-i · Cited by 396
Shibata, N., Kajikawa, Y., Takeda, Y., & Matsushima, K. (2008) · Technovation · doi:10.1016/j.technovation.2008.03.009 · Cited by 338
Analysis of symbolic sequences using the Jensen-Shannon divergence
Grosse, I., Bernaola-Galván, P., Carpena, P., Román-Roldán, R., Oliver, J., & Stanley, H. E. (2002) · Physical Review E · doi:10.1103/physreve.65.041905 · Cited by 297
Bibliographic coupling and its application to research-front and other core documents
Jarneving, B. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2007.07.004 · Cited by 291
OpenOrd: an open-source toolbox for large graph layout
Martin, S., Brown, W. M., Klavans, R., & Boyack, K. W. (2011) · SPIE Proceedings · doi:10.1117/12.871402 · Cited by 278
Self-citationThe geography of science: disciplinary and national mappings
Small, H., & Garfield, E. (1985) · Journal of Information Science · doi:10.1177/016555158501100402 · Cited by 218
A comparison of two bibliometric methods for mapping of the research front
Jarneving, B. (2005) · Scientometrics · doi:10.1007/s11192-005-0270-7 · Cited by 197
Comparative study on methods of detecting research fronts using different types of citation
Shibata, N., Kajikawa, Y., Takeda, Y., & Matsushima, K. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20994 · Cited by 172
Identifying a better measure of relatedness for mapping science
Klavans, R., & Boyack, K. W. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20274 · Cited by 158
Self-citationCombining full text and bibliometric information in mapping scientific disciplines
Glenisson, P., Glänzel, W., Janssens, F., & Moor, B. D. (2005) · Information Processing & Management · doi:10.1016/j.ipm.2005.03.021 · Cited by 147
Hybrid clustering for validation and improvement of subject-classification schemes
Janssens, F., Zhang, L., Moor, B. D., & Glänzel, W. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.06.003 · Cited by 113
Quantitative evaluation of large maps of science
Klavans, R., & Boyack, K. W. (2006) · Scientometrics · doi:10.1007/s11192-006-0125-x · Cited by 102
Self-citationAhlgren, P., & Colliander, C. (2009) · Journal of Informetrics · doi:10.1016/j.joi.2008.11.003 · Cited by 96
Liu, X., Yu, S. Q., Janssens, F., Glänzel, W., Moreau, Y., & Moor, B. D. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21312 · Cited by 64
Ahlgren, P., & Jarneving, B. (2008) · Scientometrics · doi:10.1007/s11192-007-1935-1 · Cited by 56
Combining full-text analysis and bibliometric indicators. A pilot study
Glenisson, P., Glänzel, W., & Persson, O. (2005) · Scientometrics · doi:10.1007/s11192-005-0208-0 · Cited by 54
Toward an objective, reliable and accurate method for measuring research leadership
Klavans, R., & Boyack, K. W. (2010) · Scientometrics · doi:10.1007/s11192-010-0188-6 · Cited by 54
Self-citationA comparative study of citations and links in document classification
Couto, T., de Cristo, M. A. P., Gonçalves, M. A., Calado, P. P., Ziviani, N., de Moura, E. S., & Ribeiro-Neto, B. A. (2006) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/1141753.1141766 · Cited by 46
Combining Contents and Citations for Scientific Document Classification
Cao, M. D., & Gao, X. (2005) · Lecture notes in computer science · doi:10.1007/11589990_17 · Cited by 27
Cited by
Bibliometric Methods in Management and Organization
Zupic, I., & Čater, T. (2015) · Organizational Research Methods · doi:10.1177/1094428114562629 · Cited by 7,495
Visualizing Bibliometric Networks
van Eck, N. J., & Waltman, L. (2014) · Measuring Scholarly Impact · doi:10.1007/978-3-319-10377-8_13 · Cited by 3,342
Citation-based clustering of publications using CitNetExplorer and VOSviewer
van Eck, N. J., & Waltman, L. (2017) · Scientometrics · doi:10.1007/s11192-017-2300-7 · Cited by 2,664
Theory of value co-creation: a systematic literature review
Galvagno, M., & Dalli, D. (2014) · Managing Service Quality · doi:10.1108/msq-09-2013-0187 · Cited by 884
Pournader, M., Shi, Y., Seuring, S., & Koh, S. C. L. (2020) · International Journal of Production Research · doi:10.1080/00207543.2019.1650976 · Cited by 854
Metadata
- Authors
- Boyack, K. W., & Klavans, R.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2010-12
- Volume
- 61
- Issue
- 12
- Pages
- 2389-2404
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W4255497883
- Cited by
- 1,427
- References
- 24
- FWCI
- 14.89
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.