Google Scholar como una fuente de evaluación científica: una revisión bibliográfica sobre errores de la base de datos
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Google Scholar es un motor de búsqueda académico y herramienta de descubrimiento lanzada por Google (ahora Alphabet) en noviembre de 2004. El hecho de que para cada registro bibliográfico se proporcione información acerca del número de citas recibidas por dicho registro desde el resto de registros indizados en el sistema (independientemente de su fuente) ha propiciado su utilización en análisis bibliométricos y en procesos de evaluación de la actividad académica, especialmente en Ciencias Sociales y Humanidades. No obstante, la existencia de errores, en ocasiones de gran magnitud, ha provocado su rechazo y crítica por una parte de la comunidad científica. Este trabajo pretende precisamente realizar una revisión bibliográfica exhaustiva de todos los estudios que de forma monográfica o colateral proporcionan alguna evidencia empírica sobre cuáles son los errores cometidos por Google Scholar (y productos derivados, como Google Scholar Metrics y Google Scholar Citations). Los resultados indican que el corpus bibliográfico dedicado a los errores en Google Scholar es todavía escaso (n= 49), excesivamente fragmentado, disperso, con resultados obtenidos sin metodologías sistemáticas y en unidades no comparables entre sí, por lo que su cuantificación y su efecto real no pueden ser caracterizados con precisión. Ciertas limitaciones del propio buscador (tiempo requerido de limpieza de datos, límite de citas por registro y resultados por consulta) podrían ser la causa de esta ausencia de trabajos empíricos.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The role of google scholar in evidence reviews and its applicability to grey literature searching
Haddaway, N. R., Collins, A. M., Coughlin, D., & Kirk, S. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138237 · Cited by 2,387
Google Scholar, Scopus and the Web of Science: A Longitudinal and Cross-Disciplinary Comparison
Harzing, A.-W., & Alakangas, S. (2016) · Scientometrics · doi:10.1007/s11192-015-1798-9 · Cited by 1,784 · cited 1×
“In most cases, matching errors are derived from parsing errors, since small variations in a reference can lead to duplicate records (Harzing and Alakangas, 2016), although they are sometimes errors in themselves.”
BackgroundGoogle Scholar: the pros and the cons
Jacsó, P. (2005) · Online Information Review · doi:10.1108/14684520510598066 · Cited by 383 · cited 15×
“Jacsó (2005a) found that by clicking on the link to an article published in 2005 on Infection and Immunity, the system took him to the full text of another article published 25 years before in PNAS .”
BackgroundMethodInfluentialWeb of Science, Scopus and Google Scholar: A content comprehensiveness comparison
S. Adriaanse, L., & Rensleigh, C. (2013) · The Electronic Library · doi:10.1108/el-12-2011-0174 · Cited by 284
Jacsó, P. (2008) · Online Information Review · doi:10.1108/14684520810866010 · Cited by 206 · cited 26×
“This is something that has been strongly criticised by Jacsó (2006a; 2008c; 2012b), while Meho and Yang (2007) have already criticised the excessive time required to clean up the data.”
BackgroundMethodResultInfluentialDeflated, inflated and phantom citation counts
Jacso, P. (2006) · Online Information Review · doi:10.1108/14684520610675816 · Cited by 156
An ego-centric citation analysis of the works of Michael O. Rabin based on multiple citation indexes
Bar-Ilan, J. (2006) · Information Processing & Management · doi:10.1016/j.ipm.2006.03.019 · Cited by 57
Research works printed but not linked: 3
- White, B. (2006). Examining the claims of Google Scholar as a serious information source. New Zealand Library & Information Management Journal, 50 (1), 11-24.
- Wleklinski, J.M. (2005). Studying Google Scholar: wall to wall coverage?. Online, 29 (3), 22-26.
- 10.1002/meet.14504301185 · DOI · Paper page
Cited by
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696
Martín-Martín, A., Thelwall, M., Orduna-Malea, E., & Delgado López-Cózar, E. (2021) · Scientometrics · doi:10.1007/s11192-020-03690-4 · Cited by 1,018
Self-citationGusenbauer, M. (2019) · Scientometrics · doi:10.1007/s11192-018-2958-5 · Cited by 687
Search where you will find most: Comparing the disciplinary coverage of 56 bibliographic databases
Gusenbauer, M. (2022) · Scientometrics · doi:10.1007/s11192-022-04289-7 · Cited by 211
Metadata
- Authors
- Orduna-Malea, E., Martín-Martín, A., & Delgado López-Cózar, E.
- Venue
- Revista Española de Documentación Científica
- Publisher
- Editorial CSIC
- Published
- 2017-12-30
- Volume
- 40
- Issue
- 4
- Pages
- e185
- ISSN
- 0210-0614 (ISSN-L)
- 1988-4621
- OpenAlex
- W2770649074
- Cited by
- 55
- References
- 7
- FWCI
- 4.09
- Type
- journal article
- Language
- es
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Google Scholar como una fuente de evaluación científica: una revisión bibliográfica sobre errores de la base de datos. https://app.cochat.ai/papers/10.3989/redc.2017.4.1500
- The paper
- Orduna-Malea, E., Martín-Martín, A., & Delgado López-Cózar, E. (2017). Google Scholar como una fuente de evaluación científica: una revisión bibliográfica sobre errores de la base de datos. Revista Española de Documentación Científica. https://doi.org/10.3989/redc.2017.4.1500
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.