The DOI matches its Crossref record; 99 of the 100 references it cites were found in a registry or an index.
Accuracy and completeness of publication and citation records in the Web of Science, PsycINFO, and Google Scholar: A case study for the computation of h indices in Psychology
Abstract
Hirsch's h index is becoming the standard measure of an individual's research accomplishments. The aggregation of individuals' measures is also the basis for global measures at institutional or national levels. To investigate whether the h index can be reliably computed through alternative sources of citation records, the Web of Science (WoS), PsycINFO and Google Scholar (GS) were used to collect citation records for known publications of four Spanish psychologists. Compared with WoS, PsycINFO included a larger percentage of publication records, whereas GS outperformed WoS and PsycINFO in this respect. Compared with WoS, PsycINFO retrieved a larger number of citations in unique areas of psychology, but it retrieved a smaller number of citations in areas that are close to statistics or the neurosciences, whereas GS retrieved the largest numbers of citations in all cases. Incorrect citations were scarce in Wos (0.3%), more prevalent in PsycINFO (1.1%), and overwhelming in GS (16.5%). All platforms retrieved unique citations, the largest set coming from GS. WoS and PsycINFO cover distinct areas of psychology unevenly, thus applying different penalties on the h index of researches working in different fields. Obtaining fair and accurate h indices required the union of citations retrieved by all three platforms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Studies have shown that reference and citation errors are often neglected in different specialty journals”
From How accurate are cited references in Iranian peer-reviewed journals? (2016) · cites this paper as García-Pérez, 2010
Citations
Cites
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses
Falagas, M. E., Pitsouni, E. I., Malietzis, G. A., & Pappas, G. (2008) · The FASEB Journal · doi:10.1096/fj.07-9492lsf · Cited by 5,039
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
Meho, L. I., & Yang, K. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20677 · Cited by 974
Alonso, S., Cabrerizo, F. J., Herrera‐Viedma, E., & Herrera, F. (2009) · Journal of Informetrics · doi:10.1016/j.joi.2009.04.001 · Cited by 841
Kulkarni, A. V. (2009) · JAMA · doi:10.1001/jama.2009.1307 · Cited by 821
Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review
Nederhof, A. J. (2006) · Scientometrics · doi:10.1007/s11192-006-0007-2 · Cited by 785
Three options for citation tracking: Google Scholar, Scopus and Web of Science
Bakkalbasi, N., Bauer, K., Glover, J., & Wang, L. (2006) · Biomedical Digital Libraries · doi:10.1186/1742-5581-3-7 · Cited by 752
Journal impact factor: a brief review.
Garfield, E. (1999) · PubMed · Cited by 744
Comparing alternatives to the web of science for coverage of the social sciences’ literature
Norris, M., & Oppenheim, C. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2006.12.001 · Cited by 733
Which h-index? — A comparison of WoS, Scopus and Google Scholar
Bar‐Ilan, J. (2007) · Scientometrics · doi:10.1007/s11192-008-0216-y · Cited by 720
Google Scholar as a new source for citation analysis
Harzing, A.-W. K., & van der Wal, R. (2007) · Ethics in Science and Environmental Politics · doi:10.3354/esep00076 · Cited by 677
A comparison of Scopus and Web of Science for a typical university
Vieira, E. S., & Gomes, J. A. N. F. (2009) · Scientometrics · doi:10.1007/s11192-009-2178-0 · Cited by 625
New developments in the use of citation analysis in research evaluation
Moed, H. F. (2009) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-009-0001-5 · Cited by 507
Bornmann, L., Mutz, R., & Daniel, H. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20806 · Cited by 462
Bornmann, L., & Daniel, H. (2008) · EMBO Reports · doi:10.1038/embor.2008.233 · Cited by 396
Web of Science and Scopus: a journal title overlap study
Gavel, Y., & Iselid, L. (2008) · Online Information Review · doi:10.1108/14684520810865958 · Cited by 384
Meho, L. I., & Rogers, Y. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20874 · Cited by 383
Editors, T. P. M. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030291 · Cited by 373
Bornmann, L., Mutz, R., Neuhaus, C., & Daniel, H. (2007) · Ethics in Science and Environmental Politics · doi:10.3354/esep00084 · Cited by 351
Lawrence, P. A. (2007) · Current Biology · doi:10.1016/j.cub.2007.06.014 · Cited by 296
The impact-factors debate: the ISI's uses and limits
Moed, H. F. (2002) · Nature · doi:10.1038/415731a · Cited by 289
Citations and journal impact factors: questionable indicators of research quality
Seglen, P. O. (1997) · Allergy · doi:10.1111/j.1398-9995.1997.tb00175.x · Cited by 268
The top-ten in journal impact factor manipulation
Falagas, M. E., & Alexiou, V. G. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0024-5 · Cited by 262
Rossner, M., Epps, H. V., & Hill, E. (2007) · The Journal of Cell Biology · doi:10.1083/jcb.200711140 · Cited by 248
An Examination of Citation Counts in a New Scholarly Communication Environment
Bauer, K., & Bakkalbasi, N. (2005) · D-Lib Magazine · doi:10.1045/september2005-bauer · Cited by 215
Jacsó, P. (2008) · Online Information Review · doi:10.1108/14684520810866010 · Cited by 206
Trends in the Usage of ISI Bibliometric Data: Uses, Abuses, and Implications
Cameron, B. (2005) · portal Libraries and the Academy · doi:10.1353/pla.2005.0003 · Cited by 199
Huang, M., & Chang, Y. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20885 · Cited by 193
Simons, K. (2008) · Science · doi:10.1126/science.1165316 · Cited by 178
Comparing test searches in PubMed and Google Scholar
Shultz, M. (2007) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.95.4.442 · Cited by 174
Kousha, K., & Thelwall, M. A. (2007) · Scientometrics · doi:10.1007/s11192-008-0217-x · Cited by 169
Data sources for performing citation analysis: an overview
Neuhaus, C., & Daniel, H. (2008) · Journal of Documentation · doi:10.1108/00220410810858010 · Cited by 159
Deflated, inflated and phantom citation counts
Jacso, P. (2006) · Online Information Review · doi:10.1108/14684520610675816 · Cited by 156
The Depth and Breadth of Google Scholar: An Empirical Study
Neuhaus, C., Neuhaus, E., Asher, A., & Wrede, C. (2006) · portal: Libraries and the Academy · doi:10.1353/pla.2006.0026 · Cited by 156
Campbell, P. R. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00078 · Cited by 150
A Comparative Citation Analysis of Web of Science, Scopus, and Google Scholar
Levine‐Clark, M., & Gil, E. L. (2008) · Journal of Business & Finance Librarianship · doi:10.1080/08963560802176348 · Cited by 141
Challenging the tyranny of impact factors
Colquhoun, D. (2003) · Nature · doi:10.1038/423479a · Cited by 141
(2005) · Nature · doi:10.1038/4351003b · Cited by 140
Comparative citation rankings of authors in monographic and journal literature: a study of sociology
Cronin, B., Snyder, H. W., & Atkins, H. (1997) · Journal of Documentation · doi:10.1108/eum0000000007200 · Cited by 134
The pros and cons of computing the h‐index using Google Scholar
Jacsó, P. (2008) · Online Information Review · doi:10.1108/14684520810889718 · Cited by 122
Pauly, D. F., & Stergiou, K. (2005) · Ethics in Science and Environmental Politics · doi:10.3354/esep005033 · Cited by 117
Jacsó, P. (2008) · Library trends · doi:10.1353/lib.0.0011 · Cited by 104
Bornmann, L., Marx, W., Schier, H., Rahm, E., Thor, A., & Daniel, H. (2008) · Journal of Informetrics · doi:10.1016/j.joi.2008.11.001 · Cited by 100
A quantitative analysis of indicators of scientific performance
Lehmann, S., Jackson, A. D., & Lautrup, B. E. (2008) · Scientometrics · doi:10.1007/s11192-007-1868-8 · Cited by 100
Validating research performance metrics against peer rankings
Harnad, S. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00088 · Cited by 96
Baneyx, A. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0043-0 · Cited by 96
Google Scholar Search Performance: Comparative Recall and Precision
Walters, W. H. (2009) · portal Libraries and the Academy · doi:10.1353/pla.0.0034 · Cited by 93
Measuring the research contribution of management academics using the Hirsch-index
Mingers, J. (2008) · Journal of the Operational Research Society · doi:10.1057/jors.2008.94 · Cited by 81
Misleading, unscientific, and unjust: the United Kingdom's research assessment exercise
Williams, G. (1998) · BMJ · doi:10.1136/bmj.316.7137.1079 · Cited by 80
Hidden dangers of a ‘citation culture’
Todd, P., & Ladle, R. J. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00091 · Cited by 79
Corruption of journal Impact Factors
AGRAWAL, A. (2005) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2005.02.002 · Cited by 73
A comparative analysis of social sciences citation tools
Levine‐Clark, M., & Gil, E. L. (2009) · Online Information Review · doi:10.1108/14684520911001954 · Cited by 71
Is the impact of journal impact factors decreasing?
Reedijk, J., & Moed, H. F. (2008) · Journal of Documentation · doi:10.1108/00220410810858001 · Cited by 71
The h‐index for countries in Web of Science and Scopus
Jacsó, P. (2009) · Online Information Review · doi:10.1108/14684520910985756 · Cited by 69
Impactitis: new cures for an old disease
van Diest, P. J., Holzel, H., Burnett, D., & Crocker, J. (2001) · Journal of Clinical Pathology · doi:10.1136/jcp.54.11.817 · Cited by 67
Manipulating impact factor: an unethical issue or an Editors choice?
Sevinç, A. (2004) · Swiss Medical Weekly · doi:10.4414/smw.2004.10761 · Cited by 67
The pros and cons of computing the h‐index using Web of Science
Jacsó, P. (2008) · Online Information Review · doi:10.1108/14684520810914043 · Cited by 65
Worshiping False Idols: The Impact Factor Dilemma
Brumback, R. A. (2008) · Journal of Child Neurology · doi:10.1177/0883073808315170 · Cited by 61
The influence of missing publications on the Hirsch index
Rousseau, R. (2006) · Journal of Informetrics · doi:10.1016/j.joi.2006.05.001 · Cited by 61
The use of bibliometric indicators to help peer-review assessment
Haeffner‐Cavaillon, N., & Graillot-Gak, C. (2009) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-009-0004-2 · Cited by 60
An ego-centric citation analysis of the works of Michael O. Rabin based on multiple citation indexes
Bar-Ilan, J. (2006) · Information Processing & Management · doi:10.1016/j.ipm.2006.03.019 · Cited by 57
The pros and cons of computing the h‐index using Scopus
Jacsó, P. (2008) · Online Information Review · doi:10.1108/14684520810897403 · Cited by 56
Rise and Fall of the Thomson Impact Factor
Wilcox, A. J. (2008) · Epidemiology · doi:10.1097/ede.0b013e31816a1293 · Cited by 53
Rogers, L. F. (2002) · American Journal of Roentgenology · doi:10.2214/ajr.178.3.1780541 · Cited by 53
The self-cited rate of scientific journals and the manipulation of their impact factors
Yu, G., & Wang, L. (2007) · Scientometrics · doi:10.1007/s11192-007-1779-8 · Cited by 51
Unscientific practice flourishes in science
Smith, R. W. (1998) · BMJ · doi:10.1136/bmj.316.7137.1036 · Cited by 50
Impact Factor Wars: Episode V—The Empire Strikes Back
Brumback, R. A. (2009) · Journal of Child Neurology · doi:10.1177/0883073808331366 · Cited by 47
Multi-authors' self-citation: A further impact factor bias?
Sala, S. D., & Brooks, J. L. (2008) · Cortex · doi:10.1016/j.cortex.2008.07.001 · Cited by 45
A multidimensional extension to Hirsch’s h-index
García-Pérez, M. Á. (2009) · Scientometrics · doi:10.1007/s11192-009-2290-1 · Cited by 45
Self-citationReaction of Folia Phoniatrica et Logopaedica on the Current Trend of Impact Factor Measures
Schutte, H. K., & Švec, J. G. (2007) · Folia Phoniatrica et Logopaedica · doi:10.1159/000108334 · Cited by 44
Epidemiologists (of All People) Should Question Journal Impact Factors
Hernán, M. Á. (2008) · Epidemiology · doi:10.1097/ede.0b013e31816a9e28 · Cited by 42
Irreproducible results: a response to Thomson Scientific
Rossner, M., Epps, H. V., & Hill, E. (2008) · The Journal of Cell Biology · doi:10.1083/jcb.200801036 · Cited by 42
Analysis of Scifinder Scholar and Web of Science citation searches
Whitley, K. M. (2002) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10192 · Cited by 41
Revisitinghmeasured on UK LIS and IR academics
Sanderson, M. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20771 · Cited by 41
Jacsó, P. (2009) · Online Information Review · doi:10.1108/14684520910951276 · Cited by 40
CMAJ's impact factor: room for recalculation.
Joseph, K. S., & Hoey, J. (1999) · Europe PMC (PubMed Central) · Cited by 38
Pointing Users Toward Citation Searching: Using Google Scholar and Web of Science
Schroeder, R. A. (2007) · portal Libraries and the Academy · doi:10.1353/pla.2007.0022 · Cited by 36
The emergence of competitors to the Science Citation Index and the Web of Science
Roth, D. L. (2005) · CaltechAUTHORS (California Institute of Technology) · Cited by 34
Unfamiliar citations breed mistakes
Kotiaho, J. S., Tomkins, J. L., & Simmons, L. W. (1999) · Nature · doi:10.1038/22405 · Cited by 32
Intradisciplinary differences in database coverage and the consequences for bibliometric research
Frandsen, T. F., & Nicolaisen, J. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20817 · Cited by 31
Playing the system to give low-impact journal more clout
Opatrný, T. (2008) · Nature · doi:10.1038/455167b · Cited by 17
The Hirsch h Index in a Non-Mainstream Area: Methodology of the Behavioral Sciences in Spain
García-Pérez, M. Á. (2009) · The Spanish Journal of Psychology · doi:10.1017/s1138741600002201 · Cited by 16
Self-citationHow Come Scientists Uncritically Adopt and Embody Thomson's Bibliographic Impact Factor?
Porta, M. S., & Álvarez‐Dardet, C. (2008) · Epidemiology · doi:10.1097/ede.0b013e31816b73ab · Cited by 16
Papers vanish in mis-citation black hole
Kotiaho, J. S. (1999) · Nature · doi:10.1038/17898 · Cited by 16
Brumback, R. A. (2008) · Journal of Child Neurology · doi:10.1177/0883073808322331 · Cited by 13
Falagas, M. E., & Alexiou, V. G. (2007) · International Journal of Impotence Research · doi:10.1038/sj.ijir.3901583 · Cited by 12
Name Authority Challenges for Indexing and Abstracting Databases
Bennett, D. B., & Williams, P. (2006) · Evidence Based Library and Information Practice · doi:10.18438/b81596 · Cited by 11
Carrió, I. (2008) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-008-0790-5 · Cited by 11
The race for the impact factor
Lavie, P. (2009) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2009.00778.x · Cited by 11
Software issues related to cited references
Jacsó, P. (2007) · Online Information Review · doi:10.1108/14684520710841838 · Cited by 11
What's in a name (or a number or a date)?
Price, N. C. (1998) · Nature · doi:10.1038/26838 · Cited by 10
(2005) · Nature · doi:10.1038/436889b · Cited by 8
A commentary on misuses of the impact factor
Wróblewski, A. K. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0038-x · Cited by 7
Citation rate unrelated to journals' impact factors
Waheed, A. A. (2003) · Nature · doi:10.1038/426495c · Cited by 7
Citation searching: New players, new tools
Ballard, S., & Henry, M. (2006) · CSUN ScholarWorks (California State University, Northridge) · Cited by 6
García-Pérez, M. Á. (2001) · The Spanish Journal of Psychology · doi:10.1017/s1138741600005710 · Cited by 6
Self-citationOn the trail of the prolific Dr Path
Brown, N. L. (1999) · Nature · doi:10.1038/19176 · Cited by 4
Garfield, E. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0048-8 · Cited by 1
Flagged first, then by citations
1 of the 100 references couldn’t be matched to a known paper.
Research works printed but not linked: 8
- Jacsó P., 2005, As we may search – Comparison of major features of the Web of Science, Scopus, and Google Scholar citation‐b ased and citation‐e nhanced databases, Current Science, 89, 1537
- Jacsó P., 2005, Digital libraries: Implementing strategies and sharing experiences (pp. 360–369)
- Osca‐Lluch J., 2009, Consecuencias de los errores en las referencias bibliográficas [Consequences of the error in bibliographical references: The specific case of the journal Psicothema], El caso de la revista Psicothema. Psicothema, 300
- Salgado J.F., 2007, La productividad científica y el índice h de Hirsch de la psicología social española: Convergencia entre indicadores de productividad y comparación con otrasáreas [Scientific productivity and Hirsch's h Index of Spanish social psychology: Convergence between productivity indexes and comparison with other areas], Psicothema, 19, 179
- Shadbolt N., 2006, Open access: Key strategic, technical and economic aspects (pp. 195–206)
- Topo Universitario. (2008) Factor de impacto del International Journal of Clinical and Health Psychology [Impact factor of the International Journal of Clinical and Health Psychology]. Retrieved May 19 2010 fromhttp://unnombrealazar.blogspot.com/2008/09/factor‐de‐impacto‐del‐international.html
- Vaughan L., 2008, A new look at evidence of scholarly citation in citation indexes and from university, Scientometrics, 81, 587
- Walters W.H., 2007, Google Scholar coverage of a multidisciplinary field. Information Processing and Management, 43Web sources, Scientometrics, 74, 317
Cited by
Sorted by citations
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
A Review of Theory and Practice in Scientometrics
Mingers, J., & Leydesdorff, L. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.04.002 · Cited by 1,002
Visser, M., van Eck, N. J., & Waltman, L. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00112 · Cited by 865
Halevi, G., Moed, H., & Bar-Ilan, J. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.06.005 · Cited by 488
The Use of Bibliometrics to Measure Research Performance in Education Sciences
Diem, A., & Wolter, S. C. (2012) · Research in Higher Education · doi:10.1007/s11162-012-9264-5 · Cited by 338
Metadata
- Authors
- García‐Pérez, M. A.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2010-09-15
- Volume
- 61
- Issue
- 10
- Pages
- 2070-2085
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W4250137533
- Cited by
- 101
- References
- 100
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 4 · 2023: 6 · 2022: 11 · 2021: 8 · 2020: 4 · 2019: 3 · 2018: 10 · 2017: 5 · 2016: 7 · 2015: 5 · 2014: 9 · 2013: 7 · 2012: 6
- FWCI
- 6.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Society for Information Science and Technology (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Keywords
- h-index, citation analysis, citation indexes, Web of Science, PsycINFO, Google Scholar, citation accuracy, publication records, research evaluation, psychology, bibliographic databases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review