The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Co‐citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately?
Abstract
In the past several years studies have started to appear comparing the accuracies of various science mapping approaches. These studies primarily compare the cluster solutions resulting from different similarity approaches, and give varying results. In this study we compare the accuracies of cluster solutions of a large corpus of 2,153,769 recent articles from the biomedical literature (2004–2008) using four similarity approaches: co‐citation analysis, bibliographic coupling, direct citation, and a bibliographic coupling‐based citation‐text hybrid approach. Each of the four approaches can be considered a way to represent the research front in biomedicine, and each is able to successfully cluster over 92% of the corpus. Accuracies are compared using two metrics—within‐cluster textual coherence as defined by the Jensen‐Shannon divergence, and a concentration measure based on the grant‐to‐article linkages indexed in MEDLINE. Of the three pure citation‐based approaches, bibliographic coupling slightly outperforms co‐citation analysis using both accuracy measures; direct citation is the least accurate mapping approach by far. The hybrid approach improves upon the bibliographic coupling results in all respects. We consider the results of this study to be robust given the very large size of the corpus, and the specificity of the accuracy measures used.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Co‐citation in the scientific literature: A new measure of the relationship between two documents
Small, H. (1973) · Journal of the American Society for Information Science · doi:10.1002/asi.4630240406 · Cited by 5,345 · cited 1×
“While bibliographic coupling (Kessler, 1963) and co-citation analysis (Marshakova, 1973; Small, 1973) both trace their roots back several decades, co-citation analysis was adopted as the de facto standard in the 1970s, and has enjoyed that position of preference ever since.”
Divergence measures based on the Shannon entropy
Lin, J. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.61115 · Cited by 5,140
Bibliographic coupling between scientific papers
Kessler, M. M. (1963) · American Documentation · doi:10.1002/asi.5090140103 · Cited by 2,855
Mapping the backbone of science
Boyack, K. W., Klavans, R., & Börner, K. (2005) · Scientometrics · doi:10.1007/s11192-005-0255-6 · Cited by 937
Self-citationAlignment-free genome comparison with feature frequency profiles (FFP) and optimal resolutions
Sims, G. E., Jun, S.-R., Wu, G. A., & Kim, S.-H. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0813249106 · Cited by 400
Mapping of science by combined co-citation and word analysis. I. Structural aspects
Braam, R. R., Moed, H. F., & van Raan, A. F. J. (1991) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199105)42:4<233::aid-asi1>3.0.co;2-i · Cited by 396
Shibata, N., Kajikawa, Y., Takeda, Y., & Matsushima, K. (2008) · Technovation · doi:10.1016/j.technovation.2008.03.009 · Cited by 338
Analysis of symbolic sequences using the Jensen-Shannon divergence
Grosse, I., Bernaola-Galván, P., Carpena, P., Román-Roldán, R., Oliver, J., & Stanley, H. E. (2002) · Physical Review E · doi:10.1103/physreve.65.041905 · Cited by 297
Bibliographic coupling and its application to research-front and other core documents
Jarneving, B. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2007.07.004 · Cited by 291
OpenOrd: an open-source toolbox for large graph layout
Martin, S., Brown, W. M., Klavans, R., & Boyack, K. W. (2011) · SPIE Proceedings · doi:10.1117/12.871402 · Cited by 278
Self-citation
Cited by
Bibliometric Methods in Management and Organization
Zupic, I., & Čater, T. (2015) · Organizational Research Methods · doi:10.1177/1094428114562629 · Cited by 7,495
Visualizing Bibliometric Networks
van Eck, N. J., & Waltman, L. (2014) · Measuring Scholarly Impact · doi:10.1007/978-3-319-10377-8_13 · Cited by 3,342
Citation-based clustering of publications using CitNetExplorer and VOSviewer
van Eck, N. J., & Waltman, L. (2017) · Scientometrics · doi:10.1007/s11192-017-2300-7 · Cited by 2,664
Theory of value co-creation: a systematic literature review
Galvagno, M., & Dalli, D. (2014) · Managing Service Quality · doi:10.1108/msq-09-2013-0187 · Cited by 884
Pournader, M., Shi, Y., Seuring, S., & Koh, S. C. L. (2020) · International Journal of Production Research · doi:10.1080/00207543.2019.1650976 · Cited by 854
Social innovation research: An emerging area of innovation studies?
van der Have, R. P., & Rubalcaba, L. (2016) · Research Policy · doi:10.1016/j.respol.2016.06.010 · Cited by 796
Goodell, J. W., Kumar, S., Lim, W. M., & Pattnaik, D. (2021) · Journal of Behavioral and Experimental Finance · doi:10.1016/j.jbef.2021.100577 · Cited by 715
A Bibliometric Analysis and Visualization of Medical Big Data Research
Liao, H., Tang, M., Luo, L., Li, C., Chiclana, F., & Zeng, X.-J. (2018) · Sustainability · doi:10.3390/su10010166 · Cited by 663
A new methodology for constructing a publication‐level classification system of science
Waltman, L., & van Eck, N. J. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22748 · Cited by 661
Mariani, M. M., Perez‐Vega, R., & Wirtz, J. (2022) · Psychology & Marketing · doi:10.1002/mar.21619 · Cited by 631
Personalization in personalized marketing: Trends and ways forward
Chandra, S., Verma, S., Lim, W. M., Kumar, S., & Donthu, N. (2022) · Psychology & Marketing · doi:10.1002/mar.21670 · Cited by 595
Advancing Theory with Review Articles
Post, C., Sarala, R., Gatrell, C., & Prescott, J. E. (2020) · Journal of Management Studies · doi:10.1111/joms.12549 · Cited by 548
Artificial intelligence applications in supply chain management
Pournader, M., Ghaderi, H., Hassanzadegan, A., & Fahimnia, B. (2021) · International Journal of Production Economics · doi:10.1016/j.ijpe.2021.108250 · Cited by 519
Virtual Work: Bridging Research Clusters
Raghuram, S., Hill, N. S., Gibbs, J. L., & Maruping, L. M. (2019) · Academy of Management Annals · doi:10.5465/annals.2017.0020 · Cited by 426
Wang, Q., & Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.003 · Cited by 417
Identifying emerging topics in science and technology
Small, H., Boyack, K. W., & Klavans, R. (2014) · Research Policy · doi:10.1016/j.respol.2014.02.005 · Cited by 378
Self-citationWomen Entrepreneurship: A Systematic Review to Outline the Boundaries of Scientific Literature
Cardella, G. M., Hernández-Sánchez, B. R., & Sánchez-García, J. C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01557 · Cited by 362
Virtual reality applications for the built environment: Research trends and opportunities
Zhang, Y., Liu, H., Kang, S.-C., & Al-Hussein, M. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103311 · Cited by 361
Document co-citation analysis to enhance transdisciplinary research
Trujillo, C. M., & Long, T. M. (2018) · Science Advances · doi:10.1126/sciadv.1701130 · Cited by 350
Klavans, R., & Boyack, K. W. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23734 · Cited by 334
Self-citationChang, Y.-W., Huang, M.-H., & Lin, C.-W. (2015) · Scientometrics · doi:10.1007/s11192-015-1762-8 · Cited by 330
Secundo, G., Ndou, V., Vecchio, P. D., & De Pascale, G. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.119917 · Cited by 324
Blockchain applications in management: A bibliometric analysis and literature review
Tandon, A., Kaur, P., Mäntymäki, M., & Dhir, A. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.120649 · Cited by 312
A Review of the Existing and Emerging Topics in the Supply Chain Risk Management Literature
Pournader, M., Kach, A., & Talluri, S. (. (2020) · Decision Sciences · doi:10.1111/deci.12470 · Cited by 306
Mapping the luxury research landscape: A bibliometric citation analysis
Gurzki, H., & Woisetschläger, D. M. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2016.11.009 · Cited by 302
Springer Handbook of Science and Technology Indicators
(2019) · Springer Handbooks · doi:10.1007/978-3-030-02511-3 · Cited by 300
Entrepreneurial universities: A bibliometric analysis within the business and management domains
Forliano, C., De Bernardi, P., & Yahiaoui, D. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.120522 · Cited by 298
Alexa, what do we know about conversational commerce? Insights from a systematic literature review.
Lim, W. M., Kumar, S., Verma, S., & Chaturvedi, R. (2022) · Psychology & Marketing · doi:10.1002/mar.21654 · Cited by 293
International research collaboration: An emerging domain of innovation studies?
Chen, K., Zhang, Y., & Fu, X. (2019) · Research Policy · doi:10.1016/j.respol.2018.08.005 · Cited by 293
Mariani, M., & Borghi, M. (2019) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2019.119752 · Cited by 291
Blockchain in supply chain management: a review, bibliometric, and network analysis
Moosavi, J., Naeni, L. M., Fathollahi-Fard, A. M., & Fiore, U. (2021) · Environmental Science and Pollution Research · doi:10.1007/s11356-021-13094-3 · Cited by 290
RetractedYan, E., & Ding, Y. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22680 · Cited by 282
Crisis leadership: A review and future research agenda
Wu, Y. L., Shao, B., Newman, A., & Schwarz, G. (2021) · The Leadership Quarterly · doi:10.1016/j.leaqua.2021.101518 · Cited by 280
A bibliometric review of the innovation adoption literature
van Oorschot, J. A. W. H., Hofman, E., & Halman, J. I. M. (2018) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2018.04.032 · Cited by 280
Boyack, K. W., Newman, D., Duhon, R. J., Klavans, R., Patek, M., Biberstine, J. R., Schijvenaars, B., Skupin, A., Ma, N., & Börner, K. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018029 · Cited by 271
Self-citationXia, F., Wang, W., Bekele, T. M., & Liu, H. (2017) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2016.2641460 · Cited by 266
Rossoni, A. L., de Vasconcellos, E. P. G., & de Castilho Rossoni, R. L. (2024) · Management Review Quarterly · doi:10.1007/s11301-023-00349-1 · Cited by 258
An overview of scientometric mapping for the safety science community: Methods, tools, and framework
Li, J., Goerlandt, F., & Reniers, G. (2021) · Safety Science · doi:10.1016/j.ssci.2020.105093 · Cited by 254
Citation analysis: A social and dynamic approach to knowledge organization
Hjørland, B. (2013) · Information Processing & Management · doi:10.1016/j.ipm.2013.07.001 · Cited by 244
Social companionship with artificial intelligence: Recent trends and future avenues
Chaturvedi, R., Verma, S., Das, R., & Dwivedi, Y. K. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122634 · Cited by 244
Ledro, C., Nosella, A., & Vinelli, A. (2022) · Journal of Business & Industrial Marketing · doi:10.1108/jbim-07-2021-0332 · Cited by 216
AI advertising: An overview and guidelines
Ford, J., Jain, V., Wadhwani, K., & Gupta, D. G. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.114124 · Cited by 176
Virtual Reality Aided Therapy towards Health 4.0: A Two-Decade Bibliometric Analysis
Liu, Z., Ren, L., Xiao, C., Zhang, K., & Demian, P. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19031525 · Cited by 142
“It is mechanical with no subjective scientific knowledge or judgment of the content [34], and it has a higher accuracy of cluster analysis than other bibliometric methods [35].”
ChatGPT in higher education - a synthesis of the literature and a future research agenda
Bhullar, P. S., Joshi, M., & Chugh, R. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12723-x · Cited by 139
Improving the accuracy of co-citation clustering using full text
Boyack, K. W., Small, H., & Klavans, R. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22896 · Cited by 117
Self-citationComparing Journal and Paper Level Classifications of Science
Shu, F., Julien, C.-A., Zhang, L., Qiu, J., Zhang, J., & Larivière, V. (2019) · Journal of Informetrics · doi:10.1016/j.joi.2018.12.005 · Cited by 95
A visual analytic study of retracted articles in scientific literature
Chen, C., Hu, Z., Milbank, J., & Schultz, T. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22755 · Cited by 75
On the Stability of Citation-Based Journal Rankings
Pajić, D. (2015) · Journal of Informetrics · doi:10.1016/j.joi.2015.08.005 · Cited by 62
(2021) · doi:10.1007/s43441-021-00355-z · Cited by 11
Metadata
- Authors
- Boyack, K. W., & Klavans, R.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2010-12
- Volume
- 61
- Issue
- 12
- Pages
- 2389-2404
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W4255497883
- Cited by
- 1,427
- References
- 24
- FWCI
- 14.89
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.