Citation mining: Integrating text mining and bibliometrics for research user profiling
The DOI matches its Crossref record.
Abstract
Identifying the users and impact of research is important for research performers, managers, evaluators, and sponsors. It is important to know whether the audience reached is the audience desired. It is useful to understand the technical characteristics of the other research/development/applications impacted by the originating research, and to understand other characteristics (names, organizations, countries) of the users impacted by the research. Because of the many indirect pathways through which fundamental research can impact applications, identifying the user audience and the research impacts can be very complex and time consuming. The purpose of this article is to describe a novel approach for identifying the pathways through which research can impact other research, technology development, and applications, and to identify the technical and infrastructure characteristics of the user population. A novel literature‐based approach was developed to identify the user community and its characteristics. The research performed is characterized by one or more articles accessed by the Science Citation Index (SCI) database, beccause the SCI's citation‐based structure enables the capability to perform citation studies easily. The user community is characterized by the articles in the SCI that cite the original research articles, and that cite the succeeding generations of these articles as well. Text mining is performed on the citing articles to identify the technical areas impacted by the research, the relationships among these technical areas, and relationships among the technical areas and the infrastructure (authors, journals, organizations). A key component of text mining, concept clustering, was used to provide both a taxonomy of the citing articles' technical themes and further technical insights based on theme relationships arising from the grouping process. Bibliometrics is performed on the citing articles to profile the user characteristics. Citation Mining, this integration of citation bibliometrics and text mining, is applied to the 307 first generation citing articles of a fundamental physics article on the dynamics of vibrating sand‐piles. Most of the 307 citing articles were basic research whose main themes were aligned with those of the cited article. However, about 20% of the citing articles were research or development in other disciplines, or development within the same discipline. The text mining alone identified the intradiscipline applications and extradiscipline impacts and applications; this was confirmed by detailed reading of the 307 abstracts. The combination of citation bibliometrics and text mining provides a synergy unavailable with each approach taken independently. Furthermore, text mining is a REQUIREMENT for a feasible comprehensive research impact determination. The integrated multigeneration citation analysis required for broad research impact determination of highly cited articles will produce thousands or tens or hundreds of thousands of citing article Abstracts. Text mining allows the impacts of research on advanced development categories and/or extradiscipline categories to be obtained without having to read all these citing article Abstracts. The multifield bibliometrics provide multiple documented perspectives on the users of the research, and indicate whether the documented audience reached is the desired target audience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
How to normalize cooccurrence data? An analysis of some well‐known similarity measures
Eck, N. J. V., & Waltman, L. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21075 · Cited by 966
Bibliometric Methods: Pitfalls and Possibilities
Wallin, J. A. (2005) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/j.1742-7843.2005.pto_139.x · Cited by 884
Informetrics at the beginning of the 21st century—A review
Bar-Ilan, J. (2008) · Journal of Informetrics · doi:10.1016/j.joi.2007.11.001 · Cited by 466
Disruptive technology roadmaps
Kostoff, R. N., Boylan, R., & Simons, G. R. (2004) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(03)00048-9 · Cited by 417
Self-citationMeasuring researcher interdisciplinarity
Porter, A. L., Cohen, A. S., David Roessner, J., & Perreault, M. (2007) · Scientometrics · doi:10.1007/s11192-007-1700-5 · Cited by 394
Shibata, N., Kajikawa, Y., Takeda, Y., & Matsushima, K. (2008) · Technovation · doi:10.1016/j.technovation.2008.03.009 · Cited by 338
Morris, S. A., & Van der Veer Martens, B. (2008) · Annual Review of Information Science and Technology · doi:10.1002/aris.2008.1440420113 · Cited by 280
Xia, F., Wang, W., Bekele, T. M., & Liu, H. (2017) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2016.2641460 · Cited by 266
KOSTOFF, R. N. (2002) · BioScience · doi:10.1641/0006-3568(2002)052[0937:os]2.0.co;2 · Cited by 39
Self-citation(2021) · doi:10.1007/s43441-021-00355-z · Cited by 11
Metadata
- Authors
- Kostoff, R. N., del Río, J. A., Humenik, J. A., García, E. O., & Ramírez, A. M.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2001-01
- Volume
- 52
- Issue
- 13
- Pages
- 1148-1156
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W2155943803
- Cited by
- 122
- References
- 0
- FWCI
- 9.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.