The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Can we use Google Scholar to identify highly-cited documents?
Open accessAbstract
The main objective of this paper is to empirically test whether the identification of highly-cited documents through Google Scholar is feasible and reliable. To this end, we carried out a longitudinal analysis (1950–2013), running a generic query (filtered only by year of publication) to minimise the effects of academic search engine optimisation. This gave us a final sample of 64,000 documents (1000 per year). The strong correlation between a document’s citations and its position in the search results (r=−0.67) led us to conclude that Google Scholar is able to identify highly-cited papers effectively. This, combined with Google Scholar’s unique coverage (no restrictions on document type and source), makes the academic search engine an invaluable tool for bibliometric research relating to the identification of the most influential scientific documents. We find evidence, however, that Google Scholar ranks those documents whose language (or geographical web domain) matches with the user’s interface language higher than could be expected based on citations. Nonetheless, this language effect and other factors related to the Google Scholar’s operation, i.e. the proper identification of versions and the date of publication, only have an incidental impact. They do not compromise the ability of Google Scholar to identify the highly-cited papers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meho, L. I., & Yang, K. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20677 · Cited by 974
Online collaboration: Scientists and the social network
Van Noorden, R. (2014) · Nature · doi:10.1038/512126a · Cited by 654 · cited 1×
“…how the quality and the usefulness of the product is perceived by different types of users, such as students (Carpenter, 2012), academics (Schonfeld & Housewright, 2010; Housewright et al, 2013; Van Noorden, 2014) and information professionals (Giles, 2005; Giustini & Barsky, 2005; Ettinger, 2008).”
BackgroundGoogle Scholar: the pros and the cons
Jacsó, P. (2005) · Online Information Review · doi:10.1108/14684520510598066 · Cited by 383 · cited 2×
“This research has focused primarily on assessing the quality of the bibliographic and bibliometric data provided (Jacsó 2005; 2006; Bar-Ilan, 2010; Jacsó 2008a; 2008b; 2012) and its correlation with the indicators developed by Web of Science and Scopus (Bakkalbasi et al, 2006; Bar-Ilan, 2007;…”
BackgroundMethodIs the coverage of google scholar enough to be used alone for systematic reviews
Gehanno, J.-F., Rollin, L., & Darmoni, S. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-7 · Cited by 357 · cited 1×
“…information search tools, such as catalogues, bibliographic databases, and discovery tools (Callicott & Vaughn, 2005; Gardner & Eng, 2005; Giustini, 2005; Levine-Clark & Kraus, 2007; Meier & Conkling, 2008; Bramer et al, 2013; Gehanno, Rollin & Darmoni, 2013; Stirbu et al, 2015; Breeding, 2015).”
Empirical Analysis and Classification of Database Errors in Scopus and Web of Science
Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.07.003 · Cited by 225
Deflated, inflated and phantom citation counts
Jacso, P. (2006) · Online Information Review · doi:10.1108/14684520610675816 · Cited by 156
Bramer, W. M., Giustini, D., Kramer, B. M., & Anderson, P. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-115 · Cited by 139
Cited by
Martín-Martín, A., Thelwall, M., Orduna-Malea, E., & Delgado López-Cózar, E. (2021) · Scientometrics · doi:10.1007/s11192-020-03690-4 · Cited by 1,018
Self-citationGusenbauer, M. (2019) · Scientometrics · doi:10.1007/s11192-018-2958-5 · Cited by 687
Dimensions: A competitor to Scopus and the Web of Science?
Thelwall, M. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.03.006 · Cited by 294
Zhang, C., Fan, C., Yao, W., Hu, X., & Mostafavi, A. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.04.004 · Cited by 293
Krieglstein, F., Beege, M., Rey, G. D., Ginns, P., Krell, M., & Schneider, S. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09683-4 · Cited by 118
Metadata
- Authors
- Martin-Martin, A., Orduna-Malea, E., Harzing, A.-W., & Delgado López-Cózar, E.
- Venue
- Journal of Informetrics
- Publisher
- Elsevier BV
- Published
- 2017-02
- Volume
- 11
- Issue
- 1
- Pages
- 152-163
- ISSN
- 1751-1577 (ISSN-L)
- OpenAlex
- W2563792373
- Cited by
- 183
- References
- 7
- FWCI
- 14.67
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Can we use Google Scholar to identify highly-cited documents? https://app.cochat.ai/papers/10.1016/j.joi.2016.11.008
- The paper
- Martin-Martin, A., Orduna-Malea, E., Harzing, A.-W., & Delgado López-Cózar, E. (2017). Can we use Google Scholar to identify highly-cited documents? Journal of Informetrics. https://doi.org/10.1016/j.joi.2016.11.008
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.