A novel approach for estimating the omitted‐citation rate of bibliometric databases with an application to the field of bibliometrics
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
One of the most significant inaccuracies of bibliometric databases is that of omitted citations, namely, missing electronic links between a paper of interest and some citing papers, which are (or should be) covered by the database. This paper proposes a novel approach for estimating a database's omitted‐citation rate, based on the combined use of 2 or more bibliometric databases. A statistical model is also presented for (a) estimating the “true” number of citations received by individual papers or sets of papers, and (b) defining an appropriate confidence interval. The proposed approach could represent a first step towards the definition of a standard for evaluating the accuracy level of databases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Comparing bibliometric statistics obtained from the Web of Science and Scopus
Archambault, É., Campbell, D., Gingras, Y., & Larivière, V. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21062 · Cited by 833
Three options for citation tracking: Google Scholar, Scopus and Web of Science
Bakkalbasi, N., Bauer, K., Glover, J., & Wang, L. (2006) · Biomedical Digital Libraries · doi:10.1186/1742-5581-3-7 · Cited by 752
Michaleff, Z. A., Costa, L. O. P., Moseley, A. M., Maher, C. G., Elkins, M. R., Herbert, R. D., & Sherrington, C. (2011) · Physical Therapy · doi:10.2522/ptj.20100116 · Cited by 108 · cited 1×
“…addition to this colossal multidisciplinary database, other database platforms dedicated to specific scientific fields have blossomed over the years: for example, MEDLINE and EMBASE in medicine, PsycINFO for psychology, MathSciNet in mathematics , etc. (Gavel & Iselid 2008; Michaleff et al., 2011).”
BackgroundAccuracy of Cited References: The Role of Citation Databases
Buchanan, R. A. (2006) · College & Research Libraries · doi:10.5860/crl.67.4.292 · Cited by 66 · cited 6×
“According to a classification by Buchanan (2006) there are two main categories: (a) author errors and (b) database mapping errors (for more details, see Table 1).”
BackgroundMethodResultInfluentialErrors in Bibliographic Citations: A Continuing Problem
Sweetland, J. H. (1989) · The Library Quarterly · doi:10.1086/602160 · Cited by 64 · cited 1×
“Just as an example, consider the contributions of Sweetland (1989) and Abt (1992).”
Background
Cited by
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
Empirical Analysis and Classification of Database Errors in Scopus and Web of Science
Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.07.003 · Cited by 225
“In our previous researches (Franceschini et al., 2013, 2014, 2015a, 2016a), we analyzed the Scopus and WoS omitted citations, studying the influence of several factors, such as journal or publisher of cited papers, issue year of citing papers, date of database queries, etc..”
BackgroundMethodInfluentialSelf-citationEvaluation of the citation matching algorithms of CWTS and i FQ in comparison to the Web of science
Olensky, M., Schmidt, M., & van Eck, N. J. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23590 · Cited by 56
Influence of Omitted Citations on the Bibliometric Statistics of the Major Manufacturing Journals
Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2015) · Scientometrics · doi:10.1007/s11192-015-1583-9 · Cited by 34
Self-citationDo Scopus and WoS Correct “Old” Omitted Citations?
Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2016) · Scientometrics · doi:10.1007/s11192-016-1867-8 · Cited by 31
“For this evaluation, we use a new procedure, derived from the automated algorithm by Franceschini et al. (2013).”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Franceschini, F., Maisano, D., & Mastrogiacomo, L.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2013-08-21
- Volume
- 64
- Issue
- 10
- Pages
- 2149-2156
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W2112256138
- Cited by
- 31
- References
- 5
- FWCI
- 5.38
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A novel approach for estimating the omitted‐citation rate of bibliometric databases with an application to the field of bibliometrics. https://app.cochat.ai/papers/10.1002/asi.22898
- The paper
- Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2013). A novel approach for estimating the omitted‐citation rate of bibliometric databases with an application to the field of bibliometrics. Journal of the American Society for Information Science and Technology. https://doi.org/10.1002/asi.22898
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.