The Assessment of Science: The Relative Merits of Post-Publication Review, the Impact Factor, and the Number of Citations
Open accessThe DOI matches its Crossref record; 17 of the 18 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
The assessment of scientific publications is an integral part of the scientific process. Here we investigate three methods of assessing the merit of a scientific paper: subjective post-publication peer review, the number of citations gained by a paper, and the impact factor of the journal in which the article was published. We investigate these methods using two datasets in which subjective post-publication assessments of scientific publications have been made by experts. We find that there are moderate, but statistically significant, correlations between assessor scores, when two assessors have rated the same paper, and between assessor score and the number of citations a paper accrues. However, we show that assessor score depends strongly on the journal in which the paper is published, and that assessors tend to over-rate papers published in journals with high impact factors. If we control for this bias, we find that the correlation between assessor scores and between assessor score and the number of citations is weak, suggesting that scientists have little ability to judge either the intrinsic merit of a paper or its likely impact. We also show that the number of citations a paper receives is an extremely error-prone measure of scientific merit. Finally, we argue that the impact factor is likely to be a poor measure of merit, since it depends on subjective assessment. We conclude that the three measures of scientific merit considered here are poor; in particular subjective assessments are an error-prone, biased, and expensive method by which to assess merit. We argue that the impact factor may be the most satisfactory of the methods we have considered, since it is a form of pre-publication review. However, we emphasise that it is likely to be a very error-prone measure of merit that is qualitative, not quantitative.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“False positives, on the other hand, are notoriously difficult for peer reviewers to assess [75,76].”
From The natural selection of bad science (2016) · cites this paper as [76]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
A Principal Component Analysis of 39 Scientific Impact Measures
Bollen, J., Van de Sompel, H., Hagberg, A., & Chute, R. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006022 · Cited by 572
Editors, T. P. M. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030291 · Cited by 373
What determines the citation frequency of ecological papers?
LEIMU, R., & KORICHEVA, J. (2005) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2004.10.010 · Cited by 367
Baldi, S. (1998) · American Sociological Review · doi:10.2307/2657504 · Cited by 335
Sense and nonsense about the impact factor
Opthof, T. (1997) · Cardiovascular Research · doi:10.1016/s0008-6363(96)00215-5 · Cited by 286
Causal relationship between article citedness and journal impact
Seglen, P. O. (1994) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199401)45:1<1::aid-asi1>3.0.co;2-y · Cited by 239
The impact factor's Matthew Effect: A natural experiment in bibliometrics
Larivière, V., & Gingras, Y. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21232 · Cited by 230
Allen, L., Jones, C., Dolby, K., Lynn, D., & Walport, M. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005910 · Cited by 167
WHO CITES WOMEN? WHOM DO WOMEN CITE?: AN EXPLORATION OF GENDER AND SCHOLARLY CITATION IN SOCIOLOGY
Davenport, E., & Snyder, H. W. (1995) · Journal of Documentation · doi:10.1108/eb026958 · Cited by 77
Cited by
Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677
Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories
Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019) · Sage Open · doi:10.1177/2158244019829575 · Cited by 1,257
“For example, Eyre-Walker and Stoletzki (2013) argued, “In particular subjective peer review is error prone, biased, and expensive; we must therefore question whether using peer review in exercises such as the research assessment exercise (RAE) and the Research Excellence Framework (REF) is worth…”
BackgroundChu, C., Buchman-Schmitt, J. M., Stanley, I. H., Hom, M. A., Tucker, R. P., Hagan, C. R., Rogers, M. L., Podlogar, M. C., Chiurliza, B., Ringer, F. B., et al. (2017) · Psychological Bulletin · doi:10.1037/bul0000123 · Cited by 1,231
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“False positives, on the other hand, are notoriously difficult for peer reviewers to assess (MacArthur, 2012; Eyre-Walker & Stoletzki, 2013).”
BackgroundScholarly use of social media and altmetrics: A review of the literature
Sugimoto, C. R., Work, S., Larivière, V., & Haustein, S. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23833 · Cited by 569
Reporting animal research: Explanation and Elaboration for the ARRIVE guidelines 2019
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/703355 · Cited by 559
Roldan-Valadez, E., Salazar-Ruiz, S. Y., Ibarra-Contreras, R., & Rios, C. (2019) · Irish Journal of Medical Science (1971 -) · doi:10.1007/s11845-018-1936-5 · Cited by 443
Using publication metrics to highlight academic productivity and research impact
Carpenter, C. R., Cone, D. C., & Sarli, C. C. (2014) · Academic Emergency Medicine · doi:10.1111/acem.12482 · Cited by 377
“Excellence R Us”: university research and the fetishisation of excellence
Moore, S., Neylon, C., Paul Eve, M., Paul O’Donnell, D., & Pattinson, D. (2017) · Palgrave Communications · doi:10.1057/palcomms.2016.105 · Cited by 264
Causes for the Persistence of Impact Factor Mania
Casadevall, A., & Fang, F. C. (2014) · mBio · doi:10.1128/mbio.00064-14 · Cited by 196
Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media
Erdt, M., Nagarajan, A., Sin, S.-C. J., & Theng, Y.-L. (2016) · Scientometrics · doi:10.1007/s11192-016-2077-0 · Cited by 191
Teixeira da Silva, J. A., & Dobránszki, J. (2015) · Accountability in Research · doi:10.1080/08989621.2014.899909 · Cited by 158
Chapman, C. A., Bicca‐Marques, J. C., Calvignac‐Spencer, S., Fan, P., Fashing, P. J., Gogarten, J. F., Guo, S., Hemingway, C. A., Leendertz, F. H., Li, B., et al. (2019) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2019.2047 · Cited by 155
Publications as predictors of racial and ethnic differences in NIH research awards
Ginther, D. K., Basner, J., Jensen, U., Schnell, J., Kington, R., & Schaffer, W. T. (2018) · PLOS ONE · doi:10.1371/journal.pone.0205929 · Cited by 131
Boeuf, B., & Fritsch, O. (2016) · Ecology and Society · doi:10.5751/es-08411-210219 · Cited by 173
Use of the journal impact factor for assessing individual articles: Statistically flawed or not?
Waltman, L., & Traag, V. A. (2021) · F1000Research · doi:10.12688/f1000research.23418.2 · Cited by 97
Ten Simple Rules for a Successful Cross-Disciplinary Collaboration
Knapp, B., Bardenet, R., Bernabéu, M. O., Bordas, R., Bruna, M., Calderhead, B., Cooper, J., Fletcher, A. G., Groen, D., Kuijper, B., et al. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004214 · Cited by 109
The 100 most-cited articles in neuroimaging: A bibliometric analysis
Kim, H. J., Yoon, D. Y., Kim, E. S., Lee, K., Bae, J. S., & Lee, J.-H. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.029 · Cited by 94
Bibliometric evaluation vs. informed peer review: Evidence from Italy
Bertocchi, G., Gambardella, A., Jappelli, T., Nappi, C. A., & Peracchi, F. (2015) · Research Policy · doi:10.1016/j.respol.2014.08.004 · Cited by 86
Low replicability can support robust and efficient science
Lewandowsky, S., & Oberauer, K. (2020) · Nature Communications · doi:10.1038/s41467-019-14203-0 · Cited by 79
Swanepoel, L. H., Swanepoel, C. M., Brown, P., Eiseb, S. J., Goodman, S. M., Keith, M., Kirsten, F., Leirs, H., Mahlaba, T. A. M., Makundi, R. H., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0174554 · Cited by 89
Web indicators for research evaluation. Part 2: Social media metrics
Thelwall, M. A., & Kousha, K. (2015) · El Profesional de la Informacion · doi:10.3145/epi.2015.sep.09 · Cited by 99
Thelwall, M., & Kousha, K. (2015) · El Profesional de la Información · doi:10.3145/epi.2015.sep.08 · Cited by 75
Changing research on research evaluation: A critical literature review to revisit the agenda
Thomas, D. A., Nedeva, M., Tirado, M. M., & Jacob, M. (2020) · Research Evaluation · doi:10.1093/reseval/rvaa008 · Cited by 98
The crisis of peer review: Part of the evolution of science
Horta, H., & Jung, J. (2024) · Higher Education Quarterly · doi:10.1111/hequ.12511 · Cited by 96
COVID-19 will stimulate a new coronavirus research breakthrough: a 20-year bibliometric analysis
Tao, Z., Zhou, S., Yao, R.-Q., Wen, K., Da, W., Meng, Y., Yang, K., Liu, H., & Tao, L. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2020.04.26 · Cited by 74
Reviewing post-publication peer review
Knoepfler, P. (2015) · Trends in Genetics · doi:10.1016/j.tig.2015.03.006 · Cited by 73
Baek, S., Yoon, D. Y., Lim, K. J., Cho, Y. K., Seo, Y. L., & Yun, E. J. (2018) · European Radiology · doi:10.1007/s00330-018-5423-1 · Cited by 104
Digital Technology and the Practices of Humanities Research
Publishers, O. B., & Edmond, J. (2019) · Open Book Publishers · doi:10.11647/obp.0192 · Cited by 92
Top 100 most‐cited papers in core dental public health journals: bibliometric analysis
Mattos, F. D. F., Perazzo, M. F., Vargas‐Ferreira, F., Martins‐Júnior, P. A., & Paiva, S. M. (2020) · Community Dentistry And Oral Epidemiology · doi:10.1111/cdoe.12572 · Cited by 63
Hundred top-cited articles focusing on acute kidney injury: a bibliometric analysis
Liu, Y.-H., Wang, S., Xue, J., Liu, Y., Chen, J., Li, G., He, P., & Tan, N. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011630 · Cited by 61
The Top 100 Most-Cited Papers in Cariology: A Bibliometric Analysis
Baldiotti, A. L. P., Amaral‐Freitas, G., Barcelos, J. F., Freire-Maia, J., Perazzo, M. F., Freire-Maia, F. B., Paiva, S. M., Ferreira, F. M., & Martins‐Júnior, P. A. (2020) · Caries Research · doi:10.1159/000509862 · Cited by 71
The 100 most cited publications in cardiac surgery: a bibliometric analysis
O'Sullivan, K., Kelly, J. C., & Hurley, J. P. (2014) · Irish Journal of Medical Science (1971 -) · doi:10.1007/s11845-014-1193-1 · Cited by 61
Peer review in forensic science
Ballantyne, K. N., Edmond, G., & Found, B. J. (2017) · Forensic Science International · doi:10.1016/j.forsciint.2017.05.020 · Cited by 59
A bibliometric analysis of the 103 top-cited articles in endodontics
Yılmaz, B., Dinçol, M. E., & Yalçın, T. Y. (2019) · Acta Odontologica Scandinavica · doi:10.1080/00016357.2019.1621378 · Cited by 66
Zhou, S., Tao, Z., Zhu, Y., & Tao, L. (2019) · PeerJ · doi:10.7717/peerj.8145 · Cited by 55
Crossick, G. (2016) · Insights the UKSG journal · doi:10.1629/uksg.280 · Cited by 52
Web Indicators for Research Evaluation: A Practical Guide
Thelwall, M. A. (2016) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s00733ed1v01y201609icr052 · Cited by 49
Inferring the causal effect of journals on citations
Traag, V. A. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00128 · Cited by 59
Métricas de impacto y evaluación de la ciencia
Nassi-Calò, L. (2022) · Revista Peruana de Medicina Experimental y Salud Pública · doi:10.17843/rpmesp.2022.392.11171 · Cited by 96
Tao, L., Zhou, S., Tao, Z., Wen, K., Da, W., Meng, Y., & Zhu, Y. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2020.02.67 · Cited by 41
Xia, D., Yao, R.-Q., Wang, S., Chen, G., & Wang, Y. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.713487 · Cited by 39
Braithwaite, J., Herkes, J., Churruca, K., Long, J. C., Pomare, C., Boyling, C., Bierbaum, M., Clay‐Williams, R., Rapport, F., Shih, P., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025320 · Cited by 38
Trang, P. N. T., Le, A. N. H., Tan, L. P., & Cheng, J. M.-S. (2023) · Journal of Business-to-Business Marketing · doi:10.1080/1051712x.2023.2188134 · Cited by 41
Sharing Neuron Data: Carrots, Sticks, and Digital Records
Ascoli, G. A. (2015) · PLoS Biology · doi:10.1371/journal.pbio.1002275 · Cited by 36
Who is Actually Harmed by Predatory Publishers?
Eve, M. P., & Priego, E. (2017) · tripleC Communication Capitalism & Critique Open Access Journal for a Global Sustainable Information Society · doi:10.31269/triplec.v15i2.867 · Cited by 41
Article-level assessment of influence and translation in biomedical research
Santangelo, G. M. (2017) · Molecular Biology of the Cell · doi:10.1091/mbc.e16-01-0037 · Cited by 36
Altmetrics in Plastic Surgery Journals: Does It Correlate With Citation Count?
Asaad, M., Howell, S., Rajesh, A., Meaike, J. D., & Tran, N. V. (2020) · Aesthetic Surgery Journal · doi:10.1093/asj/sjaa158 · Cited by 36
Systemic Manifestations of the Periodontal Disease: A Bibliometric Review
Ahmad, P., Arshad, A. I., Bella, E. D., Khurshid, Z., & Stoddart, M. J. (2020) · Molecules · doi:10.3390/molecules25194508 · Cited by 37
Han, Q., Li, Z., Fu, Y., Liu, H., Guo, H., Guan, X., Niu, M., & Zhang, C. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1256188 · Cited by 36
Huang, P., Feng, Z., Shu, X., Wu, A., Wang, Z., Hu, T., Cao, Y., Tu, Y., & Li, Z. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1077539 · Cited by 34
Science policies: How should science funding be allocated? An evolutionary biologists’ perspective
Meirmans, S., Butlin, R. K., Charmantier, A., Engelstädter, J., Groot, A. T., King, K. C., Kokko, H., Reid, J. M., & Neiman, M. (2019) · Journal of Evolutionary Biology · doi:10.1111/jeb.13497 · Cited by 38
Hughes, A. C., Dorey, J. B., Bossert, S., Qiao, H., & Orr, M. C. (2024) · Ecography · doi:10.1111/ecog.07115 · Cited by 41
Kim, E. S., Yoon, D. Y., Kim, H. J., Jeon, H. J., Lee, J. Y., Cho, B. M., & Lee, K. (2016) · Journal of NeuroInterventional Surgery · doi:10.1136/neurintsurg-2016-012399 · Cited by 33
What are we measuring? Refocusing on some fundamentals in the age of desktop bibliometrics
Rowlands, I. (2018) · FEMS Microbiology Letters · doi:10.1093/femsle/fny059 · Cited by 36
Evidence appraisal: a scoping review, conceptual framework, and research agenda
Goldstein, A., Venker, E., & Weng, C. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx050 · Cited by 30
Xu, D., Liu, B., Wang, J., & Zhang, Z. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2022.998298 · Cited by 38
Nagendrababu, V., Jaćimović, J., Jakovljević, A., Rossi‐Fedele, G., & Dummer, P. M. H. (2021) · International Endodontic Journal · doi:10.1111/iej.13668 · Cited by 41
Charting Past, Present, and Future Research in the Semantic Web and Interoperability
Rejeb, A., Keogh, J. G., Martindale, W., Dooley, D., Smart, E., Simske, S., Wamba, S. F., Breslin, J. G., Bandara, K. Y., Thakur, S., et al. (2022) · Future Internet · doi:10.3390/fi14060161 · Cited by 30
Fan, T., Wang, X., Song, X., Zhao, G., & Zhang, Z. (2023) · JMIR Serious Games · doi:10.2196/41091 · Cited by 38
The Top 100 Most Cited Articles Published in Dentistry: 2020 Update
Asiri, F. Y. I., Kruger, E., & Tennant, M. (2021) · Healthcare · doi:10.3390/healthcare9030356 · Cited by 28
Li, T., Yang, A., Liu, G., Zou, S., Chen, Y., Ni, B., Liu, Y., & Fan, J. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.744308 · Cited by 28
Kim, H. J., Yoon, D. Y., Kim, E. S., Yun, E. J., Jeon, H. J., Lee, J. Y., & Cho, B. M. (2018) · Journal of NeuroInterventional Surgery · doi:10.1136/neurintsurg-2018-014368 · Cited by 26
Moon, J. Y., Yun, E. J., Yoon, D. Y., Seo, Y. L., Cho, Y. K., Lim, K. J., & Hong, J. H. (2020) · Japanese Journal of Radiology · doi:10.1007/s11604-020-00946-0 · Cited by 26
Autism spectrum disorder research: knowledge mapping of progress and focus between 2011 and 2022
Jiang, M., Lu, T., Yang, K., Li, X., Zhao, L., Zhang, D., Li, J., & Wang, L. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1096769 · Cited by 32
Academic knowledge quality differentials and the quality of firm innovation
Zahringer, K., Kolympiris, C., & Kalaitzandonakes, N. (2016) · Industrial and Corporate Change · doi:10.1093/icc/dtw050 · Cited by 34
Análisis bibliométrico de la revista investigación en educación médica. Período 2012-2016
Corrales-Reyes, I. E., Fornaris-Cedeño, Y., & Reyes-Pérez, J. J. (2017) · Investigación en Educación Médica · doi:10.1016/j.riem.2017.02.003 · Cited by 37
The Value of Clinical Colorectal Cancer Registries in Colorectal Cancer Research
MacCallum, C., Skandarajah, A. R., Gibbs, P., & Hayes, I. (2018) · JAMA Surgery · doi:10.1001/jamasurg.2018.1635 · Cited by 25
Tantengco, O. A. G., Aquino, I. M. C., Asis, J. L. B., Tan, J. J. E., Uy, M. N. A. R., & Paz-Pacheco, E. T. (2021) · Diabetes & Metabolic Syndrome Clinical Research & Reviews · doi:10.1016/j.dsx.2021.102202 · Cited by 24
Strategies towards Evaluation beyond Scientific Impact. Pathways not only for Agricultural Research
Wolf, B., Häring, A. M., & Heß, J. (2015) · Organic Farming · doi:10.12924/of2015.01010003 · Cited by 30
Kim, E. S., Yoon, D. Y., Kim, H. J., Lee, K., Kim, Y., Bae, J. S., & Lee, J.-H. (2019) · Acta Radiologica · doi:10.1177/0284185119843226 · Cited by 23
Gender and Underrepresented Minority Differences in Research Funding
Castro, L. C., Ginther, D. K., & Menéndez, L. S. (2022) · Edward Elgar Publishing eBooks · doi:10.4337/9781800883086.00025 · Cited by 31
Huang, W., Wang, J., Kuang, M., Xiao, Z., Fan, B., Sun, G., & Tan, Z. (2023) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2023.1271473 · Cited by 26
Top-100 Highest-Cited Original Articles in Ischemic Stroke: A Bibliometric Analysis
Malhotra, K., Saeed, O., Goyal, N., Katsanos, A. H., & Tsivgoulis, G. K. (2017) · World Neurosurgery · doi:10.1016/j.wneu.2017.12.140 · Cited by 23
Hong, J. H., Yoon, D. Y., Lim, K. J., Moon, J. Y., Baek, S., Seo, Y. L., & Yun, E. J. (2020) · Healthcare · doi:10.3390/healthcare8040492 · Cited by 24
Large-scale assessment of research outputs through a weighted combination of bibliometric indicators
Anfossi, A., Ciolfi, A., Costa, F., Giorgio Parisi, A., & Benedetto, S. (2016) · Scientometrics · doi:10.1007/s11192-016-1882-9 · Cited by 25
A Falsification of the Citation Impediment in the Taxonomic Literature
Steiner, F. M., Pautasso, M., Zettel, H., Moder, K., Arthofer, W., & Schlick-Steiner, B. C. (2015) · Systematic Biology · doi:10.1093/sysbio/syv026 · Cited by 25
The 100 Most Cited Articles on Lumbar Spinal Stenosis: A Bibliometric Analysis
Yin, M., Xu, C., & Mo, W. (2020) · Global Spine Journal · doi:10.1177/2192568220952074 · Cited by 22
Feng, H., Chen, J., Zhang, Z., Lou, Y., Zhang, S., & Yang, W. (2023) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2023.1174936 · Cited by 22
dos Reis‐Prado, A. H., Maia, C. A., Nunes, G. P., de Arantes, L. C., Abreu, L. G., Duncan, H. F., Bottino, M. C., & Benetti, F. (2024) · International Endodontic Journal · doi:10.1111/iej.14117 · Cited by 33
Luo, P., Xu, D., Wu, J., Chen, Y., Pfeifer, R., & Pape, H. (2017) · Injury · doi:10.1016/j.injury.2017.10.014 · Cited by 21
Should I stay or should I go? Alternative infrastructures in scholarly publishing
Lagoze, C., Edwards, P. N., Sandvig, C., & Plantin, J. (2015) · International journal of communication · Cited by 20
Short-Termism in Science: Evidence from the UK Research Excellence Framework
Groen-Xu, M., Bös, G. E., Teixeira, P. A., Voigt, T., & Knapp, B. (2017) · Research Policy · doi:10.1016/j.respol.2023.104729 · Cited by 30
Bibliometric and visual analysis of vaccination hesitancy research from 2013 to 2022
Chen, C., Yang, Q., Tian, H., Wu, J., Chen, L., Ji, Z., Zheng, D., Chen, Y., Li, Z., & Lu, H. (2023) · Human Vaccines & Immunotherapeutics · doi:10.1080/21645515.2023.2226584 · Cited by 23
The 100 most-cited articles in Parkinson’s disease
Xue, J., Hu, Z., Lai, P., Cai, D.-Q., & Wen, E. (2018) · Neurological Sciences · doi:10.1007/s10072-018-3450-y · Cited by 24
Dunleavy, D. J. (2022) · European Journal for Philosophy of Science · doi:10.1007/s13194-022-00492-8 · Cited by 21
A Bibliometric Analysis of Primary Aldosteronism Research From 2000 to 2020
Wang, C., Jing, H., Sun, Z., Yao, J., Zhang, X., Liu, T., & Wu, Y. (2021) · Frontiers in Endocrinology · doi:10.3389/fendo.2021.665912 · Cited by 20
Future Trends in the Kinesiology Sciences
Knudson, D. V. (2016) · Quest · doi:10.1080/00336297.2016.1184171 · Cited by 25
Zhao, P., Jiao, Y.-N., Ma, Z.-F., Yang, Y., Li, Y., Hu, S.-D., Li, S.-Y., & Du, X. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.947658 · Cited by 17
What makes some fisheries references highly cited?
Branch, T. A., & Linnell Allison, E. (2016) · Fish and Fisheries · doi:10.1111/faf.12160 · Cited by 21
Quality and Impact of Survey Research Among Anesthesiologists: A Systematic Review
Geyer, E. D., Miller, R., Kim, S. S., Tobias, J. D., Nafiu, O. O., & Tumin, D. (2020) · Advances in Medical Education and Practice · doi:10.2147/amep.s259908 · Cited by 20
Ngah, V., Mazingisa, A. V., Zunza, M., & Wiysonge, C. S. (2020) · Vaccines · doi:10.3390/vaccines8040770 · Cited by 19
Emerging Trends and Research Foci in Cataract Genes: A Bibliometric and Visualized Study
Zhu, H., & Zhang, Z. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2021.610728 · Cited by 17
Du, J., Tang, X., & Wu, Y. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23548 · Cited by 17
Shanahan, D. R. (2016) · PeerJ · doi:10.7717/peerj.1887 · Cited by 19
Conflict of interest policies and disclosure requirements in neurosurgical journals
de Lotbiniere-Bassett, M. P., Riva-Cambrin, J. K., & McDonald, P. J. (2018) · Journal of neurosurgery · doi:10.3171/2018.4.jns172751 · Cited by 17
Bonn, N. A., & Bouter, L. M. (2021) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/82rmj · Cited by 20
Predictors of Citation Rate in Psychology: Inconclusive Influence of Effect and Sample Size
Hanel, P. H. P., & Haase, J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01160 · Cited by 19
Wang, M., Li, W., Tao, Y., & Zhao, L. (2019) · PeerJ · doi:10.7717/peerj.7115 · Cited by 17
Wang, S., Xia, D., Zhang, Z., Zhang, J., Meng, W., Zhang, Y., & Xu, S. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.764642 · Cited by 16
Metadata
- Authors
- Eyre-Walker, A., & Stoletzki, N.
- ORCID
- Stoletzki, Nina
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-10-08
- Volume
- 11
- Issue
- 10
- Pages
- e1001675
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC3792863
- OpenAlex
- W2081438176
- Cited by
- 297
- References
- 18
- Citations by year
- 2026: 9 · 2025: 16 · 2024: 30 · 2023: 33 · 2022: 24 · 2021: 26 · 2020: 36 · 2019: 25 · 2018: 12 · 2017: 20 · 2016: 31 · 2015: 20 · 2014: 12 · 2013: 3
- FWCI
- 23.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Sussex Research Online (University of Sussex) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Wellcome Trust
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- impact factor, citation analysis, post-publication peer review, pre-publication review
- MeSH terms
- Humans, Periodicals as Topic, Science, Peer Review, Research, Databases as Topic, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.