Accuracy and completeness of publication and citation records in the Web of Science, PsycINFO, and Google Scholar: A case study for the computation of h indices in Psychology
Abstract
Hirsch's h index is becoming the standard measure of an individual's research accomplishments. The aggregation of individuals' measures is also the basis for global measures at institutional or national levels. To investigate whether the h index can be reliably computed through alternative sources of citation records, the Web of Science (WoS), PsycINFO and Google Scholar (GS) were used to collect citation records for known publications of four Spanish psychologists. Compared with WoS, PsycINFO included a larger percentage of publication records, whereas GS outperformed WoS and PsycINFO in this respect. Compared with WoS, PsycINFO retrieved a larger number of citations in unique areas of psychology, but it retrieved a smaller number of citations in areas that are close to statistics or the neurosciences, whereas GS retrieved the largest numbers of citations in all cases. Incorrect citations were scarce in Wos (0.3%), more prevalent in PsycINFO (1.1%), and overwhelming in GS (16.5%). All platforms retrieved unique citations, the largest set coming from GS. WoS and PsycINFO cover distinct areas of psychology unevenly, thus applying different penalties on the h index of researches working in different fields. Obtaining fair and accurate h indices required the union of citations retrieved by all three platforms.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Studies have shown that reference and citation errors are often neglected in different specialty journals.
“Studies have shown that reference and citation errors are often neglected in different specialty journals”
From How accurate are cited references in Iranian peer-reviewed journals? (2016) · cites this paper as García-Pérez, 2010
Cites
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669 · see citing works
Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses
Falagas, M. E., Pitsouni, E. I., Malietzis, G. A., & Pappas, G. (2008) · The FASEB Journal · doi:10.1096/fj.07-9492lsf · Cited by 5,039 · see citing works
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447 · see citing works
Meho, L. I., & Yang, K. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20677 · Cited by 974 · see citing works
Alonso, S., Cabrerizo, F. J., Herrera‐Viedma, E., & Herrera, F. (2009) · Journal of Informetrics · doi:10.1016/j.joi.2009.04.001 · Cited by 841 · see citing works
Kulkarni, A. V. (2009) · JAMA · doi:10.1001/jama.2009.1307 · Cited by 821 · see citing works
Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review
Nederhof, A. J. (2006) · Scientometrics · doi:10.1007/s11192-006-0007-2 · Cited by 785 · see citing works
Three options for citation tracking: Google Scholar, Scopus and Web of Science
Bakkalbasi, N., Bauer, K., Glover, J., & Wang, L. (2006) · Biomedical Digital Libraries · doi:10.1186/1742-5581-3-7 · Cited by 752 · see citing works
Journal impact factor: a brief review.
Garfield, E. (1999) · PubMed · Cited by 744 · see citing works
Comparing alternatives to the web of science for coverage of the social sciences’ literature
Norris, M., & Oppenheim, C. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2006.12.001 · Cited by 733 · see citing works
Which h-index? — A comparison of WoS, Scopus and Google Scholar
Bar‐Ilan, J. (2007) · Scientometrics · doi:10.1007/s11192-008-0216-y · Cited by 720 · see citing works
Google Scholar as a new source for citation analysis
Harzing, A.-W. K., & van der Wal, R. (2007) · Ethics in Science and Environmental Politics · doi:10.3354/esep00076 · Cited by 677 · see citing works
A comparison of Scopus and Web of Science for a typical university
Vieira, E. S., & Gomes, J. A. N. F. (2009) · Scientometrics · doi:10.1007/s11192-009-2178-0 · Cited by 625 · see citing works
New developments in the use of citation analysis in research evaluation
Moed, H. F. (2009) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-009-0001-5 · Cited by 507 · see citing works
Bornmann, L., Mutz, R., & Daniel, H. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20806 · Cited by 462 · see citing works
Bornmann, L., & Daniel, H. (2008) · EMBO Reports · doi:10.1038/embor.2008.233 · Cited by 396 · see citing works
Web of Science and Scopus: a journal title overlap study
Gavel, Y., & Iselid, L. (2008) · Online Information Review · doi:10.1108/14684520810865958 · Cited by 384 · see citing works
Meho, L. I., & Rogers, Y. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20874 · Cited by 383 · see citing works
Editors, T. P. M. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030291 · Cited by 373 · see citing works
Bornmann, L., Mutz, R., Neuhaus, C., & Daniel, H. (2007) · Ethics in Science and Environmental Politics · doi:10.3354/esep00084 · Cited by 351 · see citing works
Lawrence, P. A. (2007) · Current Biology · doi:10.1016/j.cub.2007.06.014 · Cited by 296 · see citing works
The impact-factors debate: the ISI's uses and limits
Moed, H. F. (2002) · Nature · doi:10.1038/415731a · Cited by 289 · see citing works
Citations and journal impact factors: questionable indicators of research quality
Seglen, P. O. (1997) · Allergy · doi:10.1111/j.1398-9995.1997.tb00175.x · Cited by 268 · see citing works
The top-ten in journal impact factor manipulation
Falagas, M. E., & Alexiou, V. G. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0024-5 · Cited by 251 · see citing works
Rossner, M., Epps, H. V., & Hill, E. (2007) · The Journal of Cell Biology · doi:10.1083/jcb.200711140 · Cited by 248 · see citing works
Comparing test searches in PubMed and Google Scholar
Shultz, M. (2007) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.95.4.442 · Cited by 231 · see citing works
An Examination of Citation Counts in a New Scholarly Communication Environment
Bauer, K., & Bakkalbasi, N. (2005) · D-Lib Magazine · doi:10.1045/september2005-bauer · Cited by 215 · see citing works
Jacsó, P. (2008) · Online Information Review · doi:10.1108/14684520810866010 · Cited by 206 · see citing works
Trends in the Usage of ISI Bibliometric Data: Uses, Abuses, and Implications
Cameron, B. (2005) · portal Libraries and the Academy · doi:10.1353/pla.2005.0003 · Cited by 199 · see citing works
Huang, M., & Chang, Y. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20885 · Cited by 193 · see citing works
Simons, K. (2008) · Science · doi:10.1126/science.1165316 · Cited by 178 · see citing works
Kousha, K., & Thelwall, M. A. (2007) · Scientometrics · doi:10.1007/s11192-008-0217-x · Cited by 169 · see citing works
Data sources for performing citation analysis: an overview
Neuhaus, C., & Daniel, H. (2008) · Journal of Documentation · doi:10.1108/00220410810858010 · Cited by 159 · see citing works
Deflated, inflated and phantom citation counts
Jacso, P. (2006) · Online Information Review · doi:10.1108/14684520610675816 · Cited by 156 · see citing works
The Depth and Breadth of Google Scholar: An Empirical Study
Neuhaus, C., Neuhaus, E., Asher, A., & Wrede, C. (2006) · portal: Libraries and the Academy · doi:10.1353/pla.2006.0026 · Cited by 156 · see citing works
Campbell, P. R. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00078 · Cited by 150 · see citing works
A Comparative Citation Analysis of Web of Science, Scopus, and Google Scholar
Levine‐Clark, M., & Gil, E. L. (2008) · Journal of Business & Finance Librarianship · doi:10.1080/08963560802176348 · Cited by 141 · see citing works
Challenging the tyranny of impact factors
Colquhoun, D. (2003) · Nature · doi:10.1038/423479a · Cited by 141 · see citing works
(2005) · Nature · doi:10.1038/4351003b · Cited by 140 · see citing works
Comparative citation rankings of authors in monographic and journal literature: a study of sociology
Cronin, B., Snyder, H. W., & Atkins, H. (1997) · Journal of Documentation · doi:10.1108/eum0000000007200 · Cited by 134 · see citing works
The pros and cons of computing the h‐index using Google Scholar
Jacsó, P. (2008) · Online Information Review · doi:10.1108/14684520810889718 · Cited by 122 · see citing works
Pauly, D. F., & Stergiou, K. (2005) · Ethics in Science and Environmental Politics · doi:10.3354/esep005033 · Cited by 117 · see citing works
Jacsó, P. (2008) · Library trends · doi:10.1353/lib.0.0011 · Cited by 104 · see citing works
A quantitative analysis of indicators of scientific performance
Lehmann, S., Jackson, A. D., & Lautrup, B. E. (2008) · Scientometrics · doi:10.1007/s11192-007-1868-8 · Cited by 100 · see citing works
Bornmann, L., Marx, W., Schier, H., Rahm, E., Thor, A., & Daniel, H. (2008) · Journal of Informetrics · doi:10.1016/j.joi.2008.11.001 · Cited by 99 · see citing works
Validating research performance metrics against peer rankings
Harnad, S. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00088 · Cited by 96 · see citing works
Baneyx, A. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0043-0 · Cited by 96 · see citing works
Google Scholar Search Performance: Comparative Recall and Precision
Walters, W. H. (2009) · portal Libraries and the Academy · doi:10.1353/pla.0.0034 · Cited by 93 · see citing works
Measuring the research contribution of management academics using the Hirsch-index
Mingers, J. (2008) · Journal of the Operational Research Society · doi:10.1057/jors.2008.94 · Cited by 81 · see citing works
Misleading, unscientific, and unjust: the United Kingdom's research assessment exercise
Williams, G. (1998) · BMJ · doi:10.1136/bmj.316.7137.1079 · Cited by 80 · see citing works
Hidden dangers of a ‘citation culture’
Todd, P., & Ladle, R. J. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00091 · Cited by 78 · see citing works
Corruption of journal Impact Factors
AGRAWAL, A. (2005) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2005.02.002 · Cited by 73 · see citing works
A comparative analysis of social sciences citation tools
Levine‐Clark, M., & Gil, E. L. (2009) · Online Information Review · doi:10.1108/14684520911001954 · Cited by 71 · see citing works
Is the impact of journal impact factors decreasing?
Reedijk, J., & Moed, H. F. (2008) · Journal of Documentation · doi:10.1108/00220410810858001 · Cited by 71 · see citing works
The h‐index for countries in Web of Science and Scopus
Jacsó, P. (2009) · Online Information Review · doi:10.1108/14684520910985756 · Cited by 69 · see citing works
Impactitis: new cures for an old disease
van Diest, P. J., Holzel, H., Burnett, D., & Crocker, J. (2001) · Journal of Clinical Pathology · doi:10.1136/jcp.54.11.817 · Cited by 67 · see citing works
Manipulating impact factor: an unethical issue or an Editors choice?
Sevinç, A. (2004) · Swiss Medical Weekly · doi:10.4414/smw.2004.10761 · Cited by 67 · see citing works
The pros and cons of computing the h‐index using Web of Science
Jacsó, P. (2008) · Online Information Review · doi:10.1108/14684520810914043 · Cited by 65 · see citing works
Worshiping False Idols: The Impact Factor Dilemma
Brumback, R. A. (2008) · Journal of Child Neurology · doi:10.1177/0883073808315170 · Cited by 61 · see citing works
The influence of missing publications on the Hirsch index
Rousseau, R. (2006) · Journal of Informetrics · doi:10.1016/j.joi.2006.05.001 · Cited by 61 · see citing works
The use of bibliometric indicators to help peer-review assessment
Haeffner‐Cavaillon, N., & Graillot-Gak, C. (2009) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-009-0004-2 · Cited by 60 · see citing works
An ego-centric citation analysis of the works of Michael O. Rabin based on multiple citation indexes
Bar-Ilan, J. (2006) · Information Processing & Management · doi:10.1016/j.ipm.2006.03.019 · Cited by 57 · see citing works
The pros and cons of computing the h‐index using Scopus
Jacsó, P. (2008) · Online Information Review · doi:10.1108/14684520810897403 · Cited by 56 · see citing works
Rise and Fall of the Thomson Impact Factor
Wilcox, A. J. (2008) · Epidemiology · doi:10.1097/ede.0b013e31816a1293 · Cited by 53 · see citing works
Rogers, L. F. (2002) · American Journal of Roentgenology · doi:10.2214/ajr.178.3.1780541 · Cited by 53 · see citing works
The self-cited rate of scientific journals and the manipulation of their impact factors
Yu, G., & Wang, L. (2007) · Scientometrics · doi:10.1007/s11192-007-1779-8 · Cited by 51 · see citing works
Unscientific practice flourishes in science
Smith, R. W. (1998) · BMJ · doi:10.1136/bmj.316.7137.1036 · Cited by 50 · see citing works
Impact Factor Wars: Episode V—The Empire Strikes Back
Brumback, R. A. (2009) · Journal of Child Neurology · doi:10.1177/0883073808331366 · Cited by 47 · see citing works
Multi-authors' self-citation: A further impact factor bias?
Sala, S. D., & Brooks, J. L. (2008) · Cortex · doi:10.1016/j.cortex.2008.07.001 · Cited by 45 · see citing works
A multidimensional extension to Hirsch’s h-index
García-Pérez, M. Á. (2009) · Scientometrics · doi:10.1007/s11192-009-2290-1 · Cited by 45 · see citing works
Self-citationReaction of Folia Phoniatrica et Logopaedica on the Current Trend of Impact Factor Measures
Schutte, H. K., & Švec, J. G. (2007) · Folia Phoniatrica et Logopaedica · doi:10.1159/000108334 · Cited by 44 · see citing works
Epidemiologists (of All People) Should Question Journal Impact Factors
Hernán, M. Á. (2008) · Epidemiology · doi:10.1097/ede.0b013e31816a9e28 · Cited by 42 · see citing works
Irreproducible results: a response to Thomson Scientific
Rossner, M., Epps, H. V., & Hill, E. (2008) · The Journal of Cell Biology · doi:10.1083/jcb.200801036 · Cited by 42 · see citing works
Analysis of Scifinder Scholar and Web of Science citation searches
Whitley, K. M. (2002) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10192 · Cited by 41 · see citing works
Revisitinghmeasured on UK LIS and IR academics
Sanderson, M. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20771 · Cited by 41 · see citing works
Jacsó, P. (2009) · Online Information Review · doi:10.1108/14684520910951276 · Cited by 40 · see citing works
CMAJ's impact factor: room for recalculation.
Joseph, K. S., & Hoey, J. (1999) · Europe PMC (PubMed Central) · Cited by 38 · see citing works
Pointing Users Toward Citation Searching: Using Google Scholar and Web of Science
Schroeder, R. A. (2007) · portal Libraries and the Academy · doi:10.1353/pla.2007.0022 · Cited by 36 · see citing works
The emergence of competitors to the Science Citation Index and the Web of Science
Roth, D. L. (2005) · CaltechAUTHORS (California Institute of Technology) · Cited by 34 · see citing works
Unfamiliar citations breed mistakes
Kotiaho, J. S., Tomkins, J. L., & Simmons, L. W. (1999) · Nature · doi:10.1038/22405 · Cited by 32 · see citing works
Intradisciplinary differences in database coverage and the consequences for bibliometric research
Frandsen, T. F., & Nicolaisen, J. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20817 · Cited by 31 · see citing works
Playing the system to give low-impact journal more clout
Opatrný, T. (2008) · Nature · doi:10.1038/455167b · Cited by 17 · see citing works
The Hirsch h Index in a Non-Mainstream Area: Methodology of the Behavioral Sciences in Spain
García-Pérez, M. Á. (2009) · The Spanish Journal of Psychology · doi:10.1017/s1138741600002201 · Cited by 16 · see citing works
Self-citationHow Come Scientists Uncritically Adopt and Embody Thomson's Bibliographic Impact Factor?
Porta, M. S., & Álvarez‐Dardet, C. (2008) · Epidemiology · doi:10.1097/ede.0b013e31816b73ab · Cited by 16 · see citing works
Papers vanish in mis-citation black hole
Kotiaho, J. S. (1999) · Nature · doi:10.1038/17898 · Cited by 16 · see citing works
Brumback, R. A. (2008) · Journal of Child Neurology · doi:10.1177/0883073808322331 · Cited by 13 · see citing works
Falagas, M. E., & Alexiou, V. G. (2007) · International Journal of Impotence Research · doi:10.1038/sj.ijir.3901583 · Cited by 12 · see citing works
Name Authority Challenges for Indexing and Abstracting Databases
Bennett, D. B., & Williams, P. (2006) · Evidence Based Library and Information Practice · doi:10.18438/b81596 · Cited by 11 · see citing works
Carrió, I. (2008) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-008-0790-5 · Cited by 11 · see citing works
The race for the impact factor
Lavie, P. (2009) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2009.00778.x · Cited by 11 · see citing works
Software issues related to cited references
Jacsó, P. (2007) · Online Information Review · doi:10.1108/14684520710841838 · Cited by 11 · see citing works
What's in a name (or a number or a date)?
Price, N. C. (1998) · Nature · doi:10.1038/26838 · Cited by 10 · see citing works
(2005) · Nature · doi:10.1038/436889b · Cited by 8 · see citing works
A commentary on misuses of the impact factor
Wróblewski, A. K. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0038-x · Cited by 7 · see citing works
Citation rate unrelated to journals' impact factors
Waheed, A. A. (2003) · Nature · doi:10.1038/426495c · Cited by 7 · see citing works
Citation searching: New players, new tools
Ballard, S., & Henry, M. (2006) · CSUN ScholarWorks (California State University, Northridge) · Cited by 6 · see citing works
García-Pérez, M. Á. (2001) · The Spanish Journal of Psychology · doi:10.1017/s1138741600005710 · Cited by 6 · see citing works
Self-citationOn the trail of the prolific Dr Path
Brown, N. L. (1999) · Nature · doi:10.1038/19176 · Cited by 4 · see citing works
Garfield, E. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0048-8 · Cited by 1 · see citing works
Flagged first, then by citations
1 of the 100 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356 · see citing works
A Review of Theory and Practice in Scientometrics
Mingers, J., & Leydesdorff, L. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.04.002 · Cited by 1,002 · see citing works
Visser, M., van Eck, N. J., & Waltman, L. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00112 · Cited by 865 · see citing works
Halevi, G., Moed, H., & Bar-Ilan, J. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.06.005 · Cited by 488 · see citing works
The Use of Bibliometrics to Measure Research Performance in Education Sciences
Diem, A., & Wolter, S. C. (2012) · Research in Higher Education · doi:10.1007/s11162-012-9264-5 · Cited by 338 · see citing works
Klavans, R., & Boyack, K. W. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23734 · Cited by 338 · see citing works
Is Google Scholar useful for bibliometrics? A webometric analysis
Aguillo, I. F. (2011) · Scientometrics · doi:10.1007/s11192-011-0582-8 · Cited by 302 · see citing works
The expansion of Google Scholar versus Web of Science: a longitudinal study
de Winter, J., ZADPOOR, A. A., & Dodou, D. (2013) · Scientometrics · doi:10.1007/s11192-013-1089-2 · Cited by 270 · see citing works
Harzing, A.-W. K. (2012) · Scientometrics · doi:10.1007/s11192-012-0777-7 · Cited by 222 · see citing works
Boeker, M., Vach, W., & Motschall, E. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-131 · Cited by 225 · see citing works
Empirical Analysis and Classification of Database Errors in Scopus and Web of Science
Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.07.003 · Cited by 225 · see citing works
Search where you will find most: Comparing the disciplinary coverage of 56 bibliographic databases
Gusenbauer, M. (2022) · Scientometrics · doi:10.1007/s11192-022-04289-7 · Cited by 211 · see citing works
Martín-Martín, A., Orduña-Malea, E., & López-Cózar, E. D. (2018) · Scientometrics · doi:10.1007/s11192-018-2820-9 · Cited by 228 · see citing works
Attig, C., & Franke, T. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.08.025 · Cited by 187 · see citing works
Mingers, J., & Yang, L. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.07.058 · Cited by 184 · see citing works
Bornmann, L., & Marx, W. (2013) · Scientometrics · doi:10.1007/s11192-013-1161-y · Cited by 143 · see citing works
Fedderke, J. W., & Goldschmidt, M. (2014) · Research Policy · doi:10.1016/j.respol.2014.09.009 · Cited by 98 · see citing works
A bibliometric visualization of the economics and sociology of wealth inequality: a world apart?
Korom, P. (2019) · Scientometrics · doi:10.1007/s11192-018-03000-z · Cited by 91 · see citing works
Deduplicating records in systematic reviews: there are free, accurate automated ways to do so
Guimarães, N. S., Ferreira, A. J. F., Ribeiro‐Silva, R. D. C., de Paula, A. A., Lisboa, C. S., Magno, L., Ichiara, M. Y., & Barreto, M. L. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.10.009 · Cited by 77 · see citing works
Barrot, J. S. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12295 · Cited by 72 · see citing works
The h‐index, h‐core citation rate and the bibliometric profile of the Scopus database
Jacsó, P. (2011) · Online Information Review · doi:10.1108/14684521111151487 · Cited by 66 · see citing works
Evans, S. C., Amaro, C. M., Herbert, R. S., Blossom, J. B., & Roberts, M. C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0192219 · Cited by 57 · see citing works
Graf, B., & Antoni, C. H. (2023) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2022.2118051 · Cited by 52 · see citing works
Graf, B., & Antoni, C. H. (2020) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2020.1813111 · Cited by 57 · see citing works
The Landscape of Research on Prior Knowledge and Learning: a Bibliometric Analysis
Bittermann, A., McNamara, D. S., Simonsmeier, B. A., & Schneider, M. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09775-9 · Cited by 62 · see citing works
Are there gender differences among researchers from industrial/organizational psychology?
König, C. J., Fell, C., Kellnhofer, L., & Schui, G. (2015) · Scientometrics · doi:10.1007/s11192-015-1646-y · Cited by 40 · see citing works
Graduate students appreciate Google Scholar, but still find use for libraries
Wu, M., & Chen, S.-C. (2014) · The Electronic Library · doi:10.1108/el-08-2012-0102 · Cited by 44 · see citing works
Using Google Scholar institutional level data to evaluate the quality of university research
Mingers, J., O’Hanley, J. R., & Okunola, M. (2017) · Scientometrics · doi:10.1007/s11192-017-2532-6 · Cited by 36 · see citing works
Abrizah, A., & Thelwall, M. A. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23145 · Cited by 31 · see citing works
Do Scopus and WoS Correct “Old” Omitted Citations?
Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2016) · Scientometrics · doi:10.1007/s11192-016-1867-8 · Cited by 31 · see citing works
Chirici, G. (2012) · iForest - Biogeosciences and Forestry · doi:10.3832/ifor0613-005 · Cited by 34 · see citing works
Benefits to the Spanish research community of regional content expansion in Web of Science
Purnell, P. J., & Quevedo-Blasco, R. (2013) · International Journal of Clinical and Health Psychology · doi:10.1016/s1697-2600(13)70018-8 · Cited by 29 · see citing works
Types of Errors Hiding in Google Scholar Data
Sauvayre, R. (2022) · Journal of Medical Internet Research · doi:10.2196/28354 · Cited by 26 · see citing works
Strange attractors in the Web of Science database
García-Pérez, M. Á. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.07.006 · Cited by 24 · see citing works
Self-citationSandnes, F. E. (2021) · Scientometrics · doi:10.1007/s11192-021-03940-z · Cited by 24 · see citing works
A simple back-of-the-envelope test for self-citations using Google Scholar author profiles
Sandnes, F. E. (2020) · Scientometrics · doi:10.1007/s11192-020-03521-6 · Cited by 23 · see citing works
Rokach, L., Kalech, M., Blank, I., & Stern, R. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21638 · Cited by 20 · see citing works
Limited validity of equations to predict the future h index
García-Pérez, M. Á. (2013) · Scientometrics · doi:10.1007/s11192-013-0979-7 · Cited by 20 · see citing works
Self-citationAinsworth, S., & Russell, J. M. (2018) · Scientometrics · doi:10.1007/s11192-018-2725-7 · Cited by 18 · see citing works
García-Pérez, M. Á. (2012) · Journal of Informetrics · doi:10.1016/j.joi.2012.07.004 · Cited by 18 · see citing works
Self-citationFedderke, J. W. (2013) · Scientometrics · doi:10.1007/s11192-013-0981-0 · Cited by 18 · see citing works
Jacsó, P. (2011) · Online Information Review · doi:10.1108/14684521111176525 · Cited by 17 · see citing works
Sandnes, F. E. (2021) · Universal Access in the Information Society · doi:10.1007/s10209-021-00834-y · Cited by 14 · see citing works
Eika, E., & Sandnes, F. E. (2022) · Scientometrics · doi:10.1007/s11192-022-04521-4 · Cited by 15 · see citing works
Research performance of academic psychologists in the United Kingdom
Lai, K. A., Saxena, G., & Allen, P. (2022) · Scientometrics · doi:10.1007/s11192-022-04424-4 · Cited by 13 · see citing works
Schilling, H. R., Wittner, B., & Kauffeld, S. (2022) · Education sciences · doi:10.3390/educsci12080551 · Cited by 13 · see citing works
Data inaccuracy quantification and uncertainty propagation for bibliometric indicators
Donner, P. (2024) · Research Evaluation · doi:10.1093/reseval/rvae047 · Cited by 12 · see citing works
Maisano, D. A., Mastrogiacomo, L., Ferrara, L., & Franceschini, F. (2025) · Scientometrics · doi:10.1007/s11192-025-05244-y · Cited by 11 · see citing works
A literature review of overnight work travel within individual, family and social contexts
Borowski, S. C., Naar, J. J., Zvonkovic, A., & Swenson, A. R. (2018) · Community Work & Family · doi:10.1080/13668803.2018.1463970 · Cited by 11 · see citing works
Calver, M., Bryant, K. A., & Wardell‐Johnson, G. (2018) · Scientometrics · doi:10.1007/s11192-018-2692-z · Cited by 10 · see citing works
Rodrigues, D., Lopes, A. L., & Batista, F. (2025) · Journal of Information Science · doi:10.1177/01655515251330579 · Cited by 9 · see citing works
Gantman, E. R., & Dabos, M. P. (2018) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24020 · Cited by 9 · see citing works
Scholarly productivity and citation impact of Australian academic psychologists
Mazzucchelli, T. G., Burton, E., & Roberts, L. D. (2019) · Australian Journal of Psychology · doi:10.1111/ajpy.12248 · Cited by 8 · see citing works
Weinberger, M., & Zhitomirsky‐Geffet, M. (2021) · Scientometrics · doi:10.1007/s11192-020-03823-9 · Cited by 8 · see citing works
Citation analysis of Ph.D. theses with data from Scopus and Google Books
Donner, P. (2021) · Scientometrics · doi:10.1007/s11192-021-04173-w · Cited by 8 · see citing works
Outside the Classroom and Beyond Psychology
Tomcho, T. J., Foels, R., Walter, M. I., Yerkes, K., Brady, B., Erdman, M., Dantoni, L., Venables, M., & Manry, A. (2014) · Teaching of Psychology · doi:10.1177/0098628314562661 · Cited by 8 · see citing works
Ortega, J. L. (2015) · Revista española de Documentación Científica · doi:10.3989/redc.2015.4.1225 · Cited by 8 · see citing works
Scaling Scientometrics: Dimensions on Google BigQuery as an Infrastructure for Large-Scale Analysis
Hook, D. W., & Porter, S. J. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.656233 · Cited by 8 · see citing works
Hodge, D. R., Victor, B. G., Grogan‐Kaylor, A. C., & Perron, B. E. (2017) · Journal of the Society for Social Work and Research · doi:10.1086/691463 · Cited by 7 · see citing works
Lost & Forgotten: An Index of the Famous Works Which Sociology Has Left Behind
McGail, A. (2021) · The American Sociologist · doi:10.1007/s12108-021-09490-4 · Cited by 7 · see citing works
Boggs, M. A., Rapp, J. T., Cook, J. L., Richling, S. M., & Mohamed, R. (2025) · Behavior Analysis in Practice · doi:10.1007/s40617-025-01051-2 · Cited by 6 · see citing works
The silver jubilee of the Nitric Oxide journal: From 1997 to 2021
Hassan, W., Zafar, M., Duarte, A. E., Kamdem, J. P., & da Rocha, J. B. T. (2022) · Nitric Oxide · doi:10.1016/j.niox.2022.05.003 · Cited by 6 · see citing works
On the meaningful and non-meaningful use of reference sets in bibliometrics
Bornmann, L., & Loet Leydesdorff, A. (2014) · Journal of Informetrics · doi:10.1016/j.joi.2013.12.006 · Cited by 6 · see citing works
Jiang, J., Woosnam, K. M., & Draper, J. (2014) · Tourism Management Perspectives · doi:10.1016/j.tmp.2014.06.004 · Cited by 6 · see citing works
Scholarish: Google Scholar and its Value to the Sciences
Gray, J. E., Hamilton, M. C., Hauser, A., Janz, M. M., Peters, J. P., & Taggart, F. (2012) · Issues in Science and Technology Librarianship · doi:10.29173/istl1559 · Cited by 6 · see citing works
Reichmann, G., & Schlögl, C. (2022) · Scientometrics · doi:10.1007/s11192-022-04377-8 · Cited by 5 · see citing works
How accurate are cited references in Iranian peer-reviewed journals?
Ghane, M. R. (2016) · Learned Publishing · doi:10.1002/leap.1000 · Cited by 4 · see citing works
Misreferencing Practice of Scientists: Inside Researchers’ Sociological and Bibliometric Profiles
Sauvayre, R. (2022) · Social Epistemology · doi:10.1080/02691728.2021.2022807 · Cited by 4 · see citing works
Identifying trends in information security and privacy concern research
Weinberger, M., & Bouhnik, D. (2023) · IFLA Journal · doi:10.1177/03400352231172805 · Cited by 4 · see citing works
Calciphylaxis and the Persistence of Medical Misinformation in the Era of Google
Granter, S. R., Laga, A. C., & Larson, A. R. (2015) · American Journal of Clinical Pathology · doi:10.1309/ajcpdmwvgkw9n1cu · Cited by 4 · see citing works
Framing gay men’s sexual relationships: A rapid review of the literature from 2011–2018
Lemay, K. R., McKie, R. M., Braham, J., Levere, D. D., Furman, E., Sasso, T., Coleman, T. A., & Travers, R. (2020) · The Canadian Journal of Human Sexuality · doi:10.3138/cjhs.2019-0008 · Cited by 3 · see citing works
Citation-Based Findings are (Largely) a Function of Method of Analysis: A Comment on Black (2012)
Piotrowski, C. (2012) · Psychological Reports · doi:10.2466/09.13.17.pr0.111.6.711-716 · Cited by 4 · see citing works
Oceja, J., Villanueva‐Blasco, V. J., Vázquez‐Martínez, A., Villanueva-Silvestre, V., & Al‐Halabí, S. (2023) · Sustainability · doi:10.3390/su15021456 · Cited by 3 · see citing works
The evolution of scientific literature as metastable knowledge states
Koneru, S., McCauley, D. R., Smith, M. C., Guarrera, D., Robinson, J., & Rajtmajer, S. M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287226 · Cited by 3 · see citing works
Online supplemental information: a sizeable black hole for citations
García-Pérez, M. Á. (2014) · Scientometrics · doi:10.1007/s11192-014-1348-x · Cited by 3 · see citing works
Self-citationDabos, M. P., Gantman, E. R., & Rodríguez, C. J. F. (2018) · Minerva · doi:10.1007/s11024-018-9358-0 · Cited by 3 · see citing works
de Jesús‐Navarrete, A., Gómez-Morales, J. S., Zacarías-de-León, G., & Jacobson, B. (2023) · Investigación Bibliotecológica Archivonomía Bibliotecología e Información · doi:10.22201/iibi.24488321xe.2023.95.58710 · Cited by 3 · see citing works
Martín‐Martín, A., Orduña‐Malea, E., & López‐Cózar, E. D. (2018) · doi:10.31235/osf.io/hcx27 · Cited by 3 · see citing works
Norouzi, A., Parsaei-Mohammadi, P., Zare‐Farashbandi, F., Zare–Farashbandi, E., & Geraei, E. (2024) · Journal of Information Science · doi:10.1177/01655515241293761 · Cited by 2 · see citing works
Zhu, Y. (2025) · Journal of Information Science · doi:10.1177/01655515251379429 · Cited by 3 · see citing works
An Investigation of Information Usefulness of Google Scholar in Comparison with Web of Science
Kim, H.-J. (2014) · Journal of the Korean BIBLIA Society for library and Information Science · doi:10.14699/kbiblia.2014.25.3.215 · Cited by 2 · see citing works
Cook, S., Cochrane, L., & Corbett, J. (2020) · International Journal of E-Planning Research · doi:10.4018/ijepr.2020100102 · Cited by 2 · see citing works
Google Scholar as a data source for research assessment in the social sciences
Doğan, G. (2022) · Edward Elgar Publishing eBooks · doi:10.4337/9781800372559.00018 · Cited by 2 · see citing works
Arad, D., Pe’er, O., & Ofri, R. (2023) · Veterinary Ophthalmology · doi:10.1111/vop.13097 · Cited by 2 · see citing works
Interviewing Highly Eminent Creators
Nakamura, J., & Fajans, J. (2014) · doi:10.1002/9781118367377.ch3 · Cited by 2 · see citing works
Errors in document-type classification: a focus on engineering publications and their publishers
Maisano, D., Ferrara, L., & Franceschini, F. (2025) · Scientometrics · doi:10.1007/s11192-025-05444-6 · Cited by 1 · see citing works
Paylı, M., Çevik, O., & Yakar, M. (2025) · Kültürel Miras Araştırmaları · doi:10.59127/kulmira.1798570 · Cited by 1 · see citing works
Maisano, D. A., Ferrara, L., & Franceschini, F. (2026) · Scientometrics · doi:10.1007/s11192-026-05602-4 · Cited by 1 · see citing works
Inovação Social nas Ciências Sociais: Uma Análise Bibliométrica de 2007 à 2017
Mukendi, J. T., Welchen, V., da Costa, L. F., Machado, V. D. C., Molle, F. D., Candaten, L., Comin, J., Chais, C., Fortes, V. M. M., Ganzer, P. P., et al. (2017) · Mostra de Iniciação Científica, Pós-graduação, Pesquisa e Extensão da UCS · doi:10.18226/610001/mostraxvii.2017.65 · Cited by 1 · see citing works
(2016) · Wiley eBooks · doi:10.1002/9783527681969.biblio
Bibliographic databases: Is The Journal of Wildlife Management being found?
(2015) · Journal of Wildlife Management · doi:10.1002/jwmg.898
Inovação Social nas Ciências Sociais: Uma Análise Bibliométrica de 2007 à 2017
Mukendi, J. T., Welchen, V., da Costa, L. F., Machado, V. D. C., Molle, F. D., Candaten, L., Comin, J., Chais, C., Fortes, V. M. M., Ganzer, P. P., et al. (2017) · Mostra de Iniciação Científica, Pós-graduação, Pesquisa e Extensão · doi:10.18226/35353535.v6.2017.66
Shehata, B., Tlili, A., & Huang, R. (2021) · International Conference on ICT & Accessibility (ICTA) · doi:10.1109/icta54582.2021.9809429
Twenty years of Collaborative Design, Visualization and Engineering: A Bibliometric Exploration
Sandnes, F. E. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-71315-6_31
Use of Hypochlorous Acid in Infections: Bibliometric Analysis of Scientific LiteraturePreprint
ATEŞ, F. M. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.11.06.622311
Examining scholar-level publishing performance across bibliometric databases by cluster analysis
Pişirgen, A., Öztunç, F., & Peker, S. (2025) · Information Discovery and Delivery · doi:10.1108/idd-02-2024-0031
Mohamed, R., Cook, J. L., Boggs, M. A., & Rapp, J. T. (2026) · Behavioral Interventions · doi:10.1002/bin.70104
Exploring the Links Between Ageism and Career Outcomes: A Systematic Review
Yu, Y., Beigi, M., & Parry, J. (2026) · Human Resource Development Review · doi:10.1177/15344843261451382
- Authors
- García‐Pérez, M. A.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2010-09-15
- Volume
- 61
- Issue
- 10
- Pages
- 2070-2085
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W4250137533
- Cited by
- 101
- References
- 100
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 4 · 2023: 6 · 2022: 11 · 2021: 8 · 2020: 4 · 2019: 3 · 2018: 10 · 2017: 5 · 2016: 7 · 2015: 5 · 2014: 9 · 2013: 7 · 2012: 6
- FWCI
- 6.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Society for Information Science and Technology (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Keywords
- h-index, citation analysis, citation indexes, Web of Science, PsycINFO, Google Scholar, citation accuracy, publication records, research evaluation, psychology, bibliographic databases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review