The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Visualizing a field of research: A methodology of systematic scientometric reviews
Open accessAbstract
Systematic scientometric reviews, empowered by computational and visual analytic approaches, offer opportunities to improve the timeliness, accessibility, and reproducibility of studies of the literature of a field of research. On the other hand, effectively and adequately identifying the most representative body of scholarly publications as the basis of subsequent analyses remains a common bottleneck in the current practice. What can we do to reduce the risk of missing something potentially significant? How can we compare different search strategies in terms of the relevance and specificity of topical areas covered? In this study, we introduce a flexible and generic methodology based on a significant extension of the general conceptual framework of citation indexing for delineating the literature of a research field. The method, through cascading citation expansion, provides a practical connection between studies of science from local and global perspectives. We demonstrate an application of the methodology to the research of literature-based discovery (LBD) and compare five datasets constructed based on three use scenarios and corresponding retrieval strategies, namely a query-based lexical search (one dataset), forward expansions starting from a groundbreaking article of LBD (two datasets), and backward expansions starting from a recently published review article by a prominent expert in LBD (two datasets). We particularly discuss the relevance of areas captured by expansion processes with reference to the query-based scientometric visualization. The method used in this study for comparing bibliometric datasets is applicable to comparative studies of search strategies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Software survey: VOSviewer, a computer program for bibliometric mapping
van Eck, N. J., & Waltman, L. (2010) · Scientometrics · doi:10.1007/s11192-009-0146-3 · Cited by 21,484 · cited 4×
“as with CiteSpace (3, 4) and VOSviewer (5).”
BackgroundMethodInfluentialWordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 2×
“Search systems have utilized additional resources such as WordNet (36) and domain ontologies (37, 38) to enhance users’ original terms with their synonyms and/or closely related concepts.”
BackgroundIndexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Chen, C. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20317 · Cited by 6,433
Self-citationThe unified medical language system (UMLS): integrating biomedical terminology
Bodenreider, O. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh061 · Cited by 4,356
Science mapping software tools: Review, analysis, and cooperative study among tools
Cobo, M. J., López-Herrera, A. G., Herrera-Viedma, E., & Herrera, F. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21525 · Cited by 3,242
Price, D. J. D. S. (1965) · Science · doi:10.1126/science.149.3683.510 · Cited by 3,122
Searching for intellectual turning points: progressive knowledge domain visualization
Chen, C. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307513100 · Cited by 2,791
Self-citationScience Mapping: A Systematic Review of the Literature
Chen, C. (2017) · Journal of Data and Information Science · doi:10.1515/jdis-2017-0006 · Cited by 1,925
Self-citation5.7 The WORDNET lexical database of English
(2019) · Computer Corpus Lexicography · doi:10.1515/9781474471459-050 · Cited by 1,865
Börner, K., Chen, C., & Boyack, K. W. (2003) · Annual Review of Information Science and Technology · doi:10.1002/aris.1440370106 · Cited by 1,812
Self-citationPriorities in Scientific Discovery: A Chapter in the Sociology of Science
Merton, R. K. (1957) · American Sociological Review · doi:10.2307/2089193 · Cited by 1,593
The structure and dynamics of cocitation clusters: A multiple‐perspective cocitation analysis
Chen, C., Ibekwe‐SanJuan, F., & Hou, J. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21309 · Cited by 1,585
Self-citationAn overview of MetaMap: historical perspective and recent advances
Aronson, A. R., & Lang, F.-M. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.002733 · Cited by 1,519
Emerging trends in regenerative medicine: a scientometric analysis in CiteSpace
Chen, C., Hu, Z., Liu, S., & Tseng, H. (2012) · Expert Opinion on Biological Therapy · doi:10.1517/14712598.2012.674507 · Cited by 1,364
Self-citationFish Oil, Raynaud's Syndrome, and Undiscovered Public Knowledge
Swanson, D. R. (1986) · Perspectives in Biology and Medicine · doi:10.1353/pbm.1986.0087 · Cited by 866
Connectivity in a citation network: The development of DNA theory
Hummon, N. P., & Dereian, P. (1989) · Social Networks · doi:10.1016/0378-8733(89)90017-8 · Cited by 821
What Is Citizen Science? – A Scientometric Meta-Analysis
Kullenberg, C., & Kasperowski, D. (2016) · PLOS ONE · doi:10.1371/journal.pone.0147152 · Cited by 716
Chen, C., & Leydesdorff, L. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.22968 · Cited by 637
Self-citationA global map of science based on the ISI subject categories
Leydesdorff, L., & Rafols, I. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20967 · Cited by 506
An interactive system for finding complementary literatures: a stimulus to scientific discovery
Swanson, D. R., & Smalheiser, N. R. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00008-8 · Cited by 462
Garfield, E. (2009) · Journal of Informetrics · doi:10.1016/j.joi.2009.03.009 · Cited by 456
Citation Indexing for Studying Science
GARFIELD, E. (1970) · Nature · doi:10.1038/227669a0 · Cited by 391
Migraine and Magnesium: Eleven Neglected Connections
Swanson, D. R. (1988) · Perspectives in Biology and Medicine · doi:10.1353/pbm.1988.0009 · Cited by 382
Swanson, D. R. (1986) · The Library Quarterly · doi:10.1086/601720 · Cited by 370
Climate Change Research in View of Bibliometrics
Haunschild, R., Bornmann, L., & Marx, W. (2016) · PLOS ONE · doi:10.1371/journal.pone.0160393 · Cited by 341 · cited 1×
“Similarly, VOSviewer was used in reviews of topics such as citizen science [16] and climate change [17].”
MethodPredictive effects of structural variation on citation counts
Chen, C. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21694 · Cited by 312
Self-citationWeeber, M., Klein, H., de Jong‐van den Berg, L. T. W., & Vos, R. (2001) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.1104 · Cited by 265
Design and Update of a Classification System: The UCSD Map of Science
Börner, K., Klavans, R., Patek, M., Zoss, A. M., Biberstine, J. R., Light, R. P., Larivière, V., & Boyack, K. W. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039464 · Cited by 246
Toward a consensus map of science
Klavans, R., & Boyack, K. W. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20991 · Cited by 219
Using ARROWSMITH: a computer-assisted approach to formulating and assessing scientific hypotheses
Smalheiser, N. R., & Swanson, D. R. (1998) · Computer Methods and Programs in Biomedicine · doi:10.1016/s0169-2607(98)00033-9 · Cited by 218
Four stages of a scientific discipline; four types of scientist
Shneider, A. M. (2009) · Trends in Biochemical Sciences · doi:10.1016/j.tibs.2009.02.002 · Cited by 195
Scatter/gather browsing communicates the topic structure of a very large text collection
Pirolli, P., Schank, P., Hearst, M., & Diehl, C. (1996) · Proceedings of the SIGCHI conference on Human factors in computing systems common ground - CHI '96 · doi:10.1145/238386.238489 · Cited by 194
Two medical literatures that are logically but not bibliographically connected
Swanson, D. R. (1987) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(198707)38:4<228::aid-asi2>3.0.co;2-g · Cited by 189
Greenhouse Gas Emissions from Landfills: A Review and Bibliometric Analysis
Zhang, C., Xu, T., Feng, H., & Chen, S. (2019) · Sustainability · doi:10.3390/su11082282 · Cited by 188
Gordon, M. D., & Lindsay, R. K. (1996) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199602)47:2<116::aid-asi3>3.0.co;2-1 · Cited by 173
Zitt, M., & Bassecoulard, E. (2006) · Information Processing & Management · doi:10.1016/j.ipm.2006.03.016 · Cited by 170
Li, M., Porter, A. L., & Suominen, A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2017.09.032 · Cited by 170
Asymptomatic Carriage of Plasmodium in Urban Dakar: The Risk of Malaria Should Not Be Underestimated
Diallo, A., Ndam, N. T., Moussiliou, A., Dos Santos, S., Ndonky, A., Borderon, M., Oliveau, S., Lalou, R., & Le Hesran, J.-Y. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031100 · Cited by 154
Huang, Y., Schuehle, J., Porter, A. L., & Youtie, J. (2015) · Scientometrics · doi:10.1007/s11192-015-1638-y · Cited by 135
Linking estrogen to Alzheimer's disease: An informatics approach
Smalheiser, N. R., & Swanson, D. R. (1996) · Neurology · doi:10.1212/wnl.47.3.809 · Cited by 103
Literature-based discovery of new candidates for drug repurposing
Yang, H., Ju, J.-H., Wong, Y.-T., Shmulevich, I., & Chiang, J.-H. (2016) · Briefings in Bioinformatics · doi:10.1093/bib/bbw030 · Cited by 89
Rediscovering Don Swanson:The Past, Present and Future of Literature-based Discovery
Smalheiser, N. R. (2017) · Journal of Data and Information Science · doi:10.1515/jdis-2017-0019 · Cited by 89
Owen, J. M., Weeber, M., & Bruza, P. (2008) · Information science and knowledge management · doi:10.1007/978-3-540-68690-3 · Cited by 83
Using global mapping to create more accurate document-level maps of research fields
Klavans, R., & Boyack, K. W. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21444 · Cited by 82
Literature-Related Discovery (LRD): Introduction and background
Kostoff, R. N. (2007) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2007.11.004 · Cited by 76
Visualized analysis of developing trends and hot topics in natural disaster research
Shen, S., Cheng, C., Yang, J., & Yang, S. (2018) · PLoS ONE · doi:10.1371/journal.pone.0191250 · Cited by 68
Emerging approaches in literature-based discovery: techniques and performance review
Sebastian, Y., Siew, E.-G., & Orimaye, S. O. (2017) · The Knowledge Engineering Review · doi:10.1017/s0269888917000042 · Cited by 60
Literature-based automated discovery of tumor suppressor p53 phosphorylation and inhibition by NEK2
Choi, B.-K., Dayaram, T., Parikh, N., Wilkins, A. D., Nagarajan, M., Novikov, I. B., Bachman, B. J., Jung, S. Y., Haas, P. J., Labrie, J. J., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806643115 · Cited by 58
Technical structure of the global nanoscience and nanotechnology literature
Kostoff, R. N., Koytcheff, R. G., & Lau, C. G. Y. (2007) · Journal of Nanoparticle Research · doi:10.1007/s11051-007-9224-8 · Cited by 55
Citations with different levels of relevancy: Tracing the main paths of legal opinions
Liu, J. S., Chen, H., Ho, M. H., & Li, Y. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23135 · Cited by 41
Representing Scientific Knowledge: The Role of Uncertainty
Chen, C., & Song, M. (2017) · International Linear Collider · doi:10.1007/978-3-319-62543-0 · Cited by 29
Self-citationA context-based ABC model for literature-based discovery
Kim, Y. H., & Song, M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0215313 · Cited by 20
Self-citation
Cited by
Application of Nanoparticles Alleviates Heavy Metals Stress and Promotes Plant Growth: An Overview
Zhou, P., Adeel, M., Shakoor, N., Guo, M., Hao, Y., Azeem, I., Li, M., Liu, M., & Rui, Y. (2020) · Nanomaterials · doi:10.3390/nano11010026 · Cited by 304
Huo, S., Sheng, L., Xue, W., Wang, L., Xu, H., Zhang, H., & He, X. (2023) · InfoMat · doi:10.1002/inf2.12394 · Cited by 256
Deep Learning-Based Applications for Safety Management in the AEC Industry: A Review
Hou, L., Chen, H., Zhang, G. (., & Wang, X. (2021) · Applied Sciences · doi:10.3390/app11020821 · Cited by 76
Visual Analysis of Colorectal Cancer Immunotherapy: A Bibliometric Analysis From 2012 to 2021
Ma, L., Ma, J., Teng, M., & Li, Y. (2022) · Frontiers in Immunology · doi:10.3389/fimmu.2022.843106 · Cited by 72
A bibliometric analysis of the advance of artificial intelligence in medicine
Lin, M., Lin, L., Lin, L., Lin, Z., & Yan, X. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1504428 · Cited by 36
“A significant impact of this analysis is in relation to the appraisal of academic performance, research productivity, and distribution of resources (15, 16).”
Metadata
- Authors
- Chen, C., & Song, M.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-10-31
- Volume
- 14
- Issue
- 10
- Pages
- e0223994
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2989530049
- Cited by
- 1,333
- References
- 54
- FWCI
- 16.39
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.