The DOI matches its Crossref record; 130 of the 130 references it cites were found in a registry or an index.
“Excellence R Us”: university research and the fetishisation of excellence
Open accessAbstract
The rhetoric of “excellence” is pervasive across the academy. It is used to refer to research outputs as well as researchers, theory and education, individuals and organizations, from art history to zoology. But does “excellence” actually mean anything? Does this pervasive narrative of “excellence” do any good? Drawing on a range of sources we interrogate “excellence” as a concept and find that it has no intrinsic meaning in academia. Rather it functions as a linguistic interchange mechanism. To investigate whether this linguistic function is useful we examine how the rhetoric of excellence combines with narratives of scarcity and competition to show that the hyper-competition that arises from the performance of “excellence” is completely at odds with the qualities of good research. We trace the roots of issues in reproducibility, fraud, and homophily to this rhetoric. But we also show that this rhetoric is an internal, and not primarily an external, imposition. We conclude by proposing an alternative rhetoric based on soundness and capacity-building. In the final analysis, it turns out that that “excellence” is not excellent. Used in its current unqualified form it is a pernicious and dangerous rhetoric that undermines the very foundations of good research and scholarship. This article is published as part of a collection on the future of research assessment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Retraction policies of top scientific journals ranked by impact factor
Resnik, D. B., Wager, E., & Kissling, G. E. (2015) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.103.3.006 · Cited by 77
RetractedThe Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
The Structure of Scientific Revolutions: 50th Anniversary Edition
Kuhn, T. S., & Hacking, I. (2012) · doi:10.7208/chicago/9780226458144.001.0001 · Cited by 21,170
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Science in Action: How to Follow Scientists and Engineers through Society
Bijker, W. E., & Latour, B. (1988) · Technology and Culture · doi:10.2307/3105094 · Cited by 10,767
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
(1987) · Cited by 8,955
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Laboratory Life: The Construction of Scientific Facts
Latour, B. (1986) · DigitalGeorgetown (Georgetown University Library) · Cited by 7,491
Improving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal Research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000412 · Cited by 7,300
The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720 · cited 1×
“…work that is not fraudulent or the result of misconduct (Bishop, 2013; as its etymology implies, the “Matthew effect” predates today’s hypercompetition, see Merton, 1968, 1988)1: it increases the stakes of the competition for resources and, as a result, encourages gamesmanship; creates a bias…”
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
Journal of the American Statistical Association
Koehler, A. B. (1995) · International Journal of Forecasting · doi:10.1016/0169-2070(95)90067-5 · Cited by 5,337
(1968) · PubMed · Cited by 4,803
Journal of the American Statistical Association
Fildes, R. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90106-4 · Cited by 3,874
READINGS, B. (1997) · Harvard University Press eBooks · doi:10.2307/j.ctv1cbn3kn · Cited by 1,964
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 4×
“Hypercompetition in turn leads to greater (we might even say more shameless, see Anderson et al., 2007; Fanelli, 2009; Tijdink et al., 2014; Chubb and Watermeyer, 2016) attempts to perform this “excellence”, driving a circular conservatism and reification of existing power structures while harming rather than improvin…”
BackgroundInfluentialGenesis and Development of a Scientific Fact.
Pickering, A., Fleck, L., Trenn, T. J., Merton, R. K., & Bradley, F. (1982) · Contemporary Sociology · doi:10.2307/2067139 · Cited by 1,750
Uncertainty and Quality in Science for Policy
Funtowicz, S. O., & Ravetz, J. R. (1990) · doi:10.1007/978-94-009-0621-1 · Cited by 1,575
Stirling, A. (2008) · Science, Technology, & Human Values · doi:10.1177/0162243907311265 · Cited by 1,567
Genesis and Development of a Scientific Fact
McDermott, J. J. (1980) · Interdisciplinary Science Reviews · doi:10.1179/030801880789767459 · Cited by 1,524
Star, S. L. (1989) · Distributed Artificial Intelligence · doi:10.1016/b978-1-55860-092-8.50006-x · Cited by 1,484
The Matthew Effect in Science, II: Cumulative Advantage and the Symbolism of Intellectual Property
Merton, R. K. (1988) · Isis · doi:10.1086/354848 · Cited by 1,397
Punished by Rewards: The Trouble with Gold Stars, Incentive Plans, A'S, Praise, and Other Bribes
Kohn, A. (1999) · Cited by 1,356
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Negative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · cited 1×
“As various studies have concluded, reported instances of both fraud and error (as measured through retractions) are on the rise (Claxton, 2005; Dobbs, 2006; Steen, 2011; Fang et al., 2012; Grieneisen and Zhang, 2012; Yong, 2012b; Chen et al., 2013; Andrade, 2016).”
BackgroundLord, R. G., de Vader, C. L., & Alliger, G. M. (1986) · Journal of Applied Psychology · doi:10.1037/0021-9010.71.3.402 · Cited by 1,230
A general framework for analysing diversity in science, technology and society
Stirling, A. (2007) · Journal of The Royal Society Interface · doi:10.1098/rsif.2007.0213 · Cited by 1,151
How Professors Think: Inside the Curious World of Academic Judgment
Lamont, M. (2009) · doi:10.4159/9780674054158 · Cited by 1,086
Peer-review practices of psychological journals: The fate of published articles, submitted again
Peters, D. P., & Ceci, S. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011183 · Cited by 1,079 · cited 1×
“In a somewhat controversial work, Peters and Ceci submitted papers in slightly disguised form to journals that had previously accepted them for publication (Peters and Ceci, 1982; see Weller, 2001 for a critique).”
BackgroundTolerance for Failure and Corporate Innovation
Tian, X., & Wang, T. Y. (2014) · Review of Financial Studies · doi:10.1093/rfs/hhr130 · Cited by 993
Sterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.1080/01621459.1959.10501497 · Cited by 964 · cited 2×
“…this need to perform “excellence” is can be illustrated by the wellknown bias towards positive results in scientific publication (for example, Dickersin et al., 1987, 2005; Sterling, 1959; Kennedy, 2004; Young and Bang, 2004; Bertamini and Munafò, 2012; Rothstein, 2014; Psych Filedrawer, 2016).”
BackgroundLarsen, P. O., & von Ins, M. (2010) · Scientometrics · doi:10.1007/s11192-010-0202-z · Cited by 964
Stephan, P. (2012) · Harvard University Press eBooks · doi:10.4159/harvard.9780674062757 · Cited by 934
Shock Waves in Condensed Matter 1983
(1984) · Elsevier eBooks · doi:10.1016/c2009-0-12196-7 · Cited by 907
Bem, D. J. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0021524 · Cited by 893
Scientific Knowledge and its Social Problems.
Lyon, A., & Ravetz, J. R. (1973) · The Philosophical Quarterly · doi:10.2307/2218013 · Cited by 849
Wiley StatsRef: Statistics Reference Online
(2014) · Wiley eBooks · doi:10.1002/9781118445112 · Cited by 780
The Origin of Chemical Elements
Alpher, R. A., Bethe, H., & Gamow, G. (1948) · Physical Review · doi:10.1103/physrev.73.803 · Cited by 743
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715
Contingencies of Value: Alternative Perspectives for Critical Theory
Shusterman, R., & Smith, B. H. (1989) · The Journal of Aesthetics and Art Criticism · doi:10.2307/431835 · Cited by 709
Cognitive surplus: creativity and generosity in a connected age
(2010) · Choice Reviews Online · doi:10.5860/choice.48-0947 · Cited by 676
Aggregation of Predators and Insect Parasites and its Effect on Stability
Hassell, M. P., & May, R. M. (1974) · The Journal of Animal Ecology · doi:10.2307/3384 · Cited by 662
Incentives and creativity: evidence from the academic life sciences
Azoulay, P., Graff Zivin, J. S., & Manso, G. (2011) · The RAND Journal of Economics · doi:10.1111/j.1756-2171.2011.00140.x · Cited by 648
Reinventing discovery: the new era of networked science
(2012) · Choice Reviews Online · doi:10.5860/choice.49-4420 · Cited by 645
How professors think: inside the curious world of academic judgment
(2009) · Choice Reviews Online · doi:10.5860/choice.47-1492 · Cited by 601
Wiley StatsRef: Statistics Reference Online
Özkale, M. (2016) · doi:10.1002/9781118445112.stat02204.pub2/abstract · Cited by 569
Why Current Publication Practices May Distort Science
Young, N. S., Ioannidis, J. P. A., & Al-Ubaydli, O. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050201 · Cited by 502
Cicchetti, D. V. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065675 · Cited by 496
Innovation and Incentives: Evidence from Corporate R&D
Lerner, J., & Wulf, J. (2007) · Review of Economics and Statistics · doi:10.1162/rest.89.4.634 · Cited by 482
Graur, D., Zheng, Y., Price, N., Azevedo, R. B. R., Zufall, R. A., & Elhaik, E. (2013) · Genome Biology and Evolution · doi:10.1093/gbe/evt028 · Cited by 478
de Solla Price, D. J., & Page, T. (1961) · American Journal of Physics · doi:10.1119/1.1937650 · Cited by 444
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
Retractions in the scientific literature: is the incidence of research fraud increasing?
Steen, R. G. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.040923 · Cited by 405
Yong, E. (2012) · Nature · doi:10.1038/485298a · Cited by 405
How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists
Gans, J. S., & Shepherd, G. B. (1994) · Journal of Economic Perspectives · doi:10.1257/jep.8.1.165 · Cited by 389
The Perverse Effects of Competition on Scientists’ Work and Relationships
Anderson, M. S., Ronning, E. A., De Vries, R., & Martinson, B. C. (2007) · Science and Engineering Ethics · doi:10.1007/s11948-007-9042-5 · Cited by 384
A Comprehensive Survey of Retracted Articles from the Scholarly Literature
Grieneisen, M. L., & Zhang, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044118 · Cited by 355
Men Set Their Own Cites High: Gender and Self-citation across Fields and over TimePreprint
King, M. M., Bergstrom, C. T., Correll, S. J., Jacquet, J., & West, J. D. (n.d.) · OSF Preprints (OSF Preprints) · Cited by 341
Measuring the effectiveness of scientific gatekeeping
Siler, K., Lee, K., & Bero, L. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1418218112 · Cited by 333
Unpublished results hide the decline effect
Schooler, J. (2011) · Nature · doi:10.1038/470437a · Cited by 333
Eyre-Walker, A., & Stoletzki, N. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001675 · Cited by 297
Lawrence, P. A. (2007) · Current Biology · doi:10.1016/j.cub.2007.06.014 · Cited by 296
Publication Bias: Recognizing the Problem, Understanding Its Origins and Scope, and Preventing Harm
Dickersin, K. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch2 · Cited by 291
Vessuri, H., Guédon, J.-C., & Cetto, A. M. (2014) · Current Sociology · doi:10.1177/0011392113512839 · Cited by 277
Men Set Their Own Cites High: Gender and Self-citation across Fields and over Time
King, M. M., Bergstrom, C. T., Correll, S. J., Jacquet, J., & West, J. D. (2017) · Socius: Sociological Research for a Dynamic World · doi:10.1177/2378023117738903 · Cited by 275
Kaul, S., & Diamond, G. A. (2010) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2009.06.065 · Cited by 269
Vinkers, C. H., Tijdink, J. K., & Otte, W. M. (2015) · BMJ · doi:10.1136/bmj.h6467 · Cited by 237
(2001) · DigitalGeorgetown (Georgetown University Library) · Cited by 231
Publication Pressure and Scientific Misconduct in Medical Scientists
Tijdink, J. K., Verbeke, R., & Smulders, Y. M. (2014) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264614552421 · Cited by 221
Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say 'Usually Not'
Chang, A. C., & Li, P. (2015) · doi:10.2139/ssrn.2669564 · Cited by 217 · cited 4×
“…others (that is, being accurate and reproducible, and/ or non-fraudulent) rises considerably (Dean, 1989; Burman et al., 2010; Lehrer, 2010; Bem, 2011; Goldacre, 2011; Yong, 2012b; Rehman, 2013; Resnik and Dinse, 2013; Hill and Pitt, 2014; Chang and Li, 2015; Open Science Collaboration, 2015).”
BackgroundInfluentialIs Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say "Usually Not"
Chang, A. C., & Li, P. (2015) · Finance and Economics Discussion Series · doi:10.17016/feds.2015.083 · Cited by 211
Speciation and phylogeography of Hawaiian terrestrial arthropods
Roderick, G. K., & Gillespie, R. G. (1998) · Molecular Ecology · doi:10.1046/j.1365-294x.1998.00309.x · Cited by 201
Russell, E. S. (2009) · Cited by 197
Big Science vs. Little Science: How Scientific Impact Scales with Funding
Fortin, J.-M., & Currie, D. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065263 · Cited by 188
Chubb, J., & Watermeyer, R. (2017) · Studies in Higher Education · doi:10.1080/03075079.2016.1144182 · Cited by 184
Nicholson, J. M., & Ioannidis, J. P. A. (2012) · Nature · doi:10.1038/492034a · Cited by 169
An Introduction to Registered Replication Reports at Perspectives on Psychological Science
Simons, D. J., Holcombe, A. O., & Spellman, B. A. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614543974 · Cited by 167
Estimates of the Continuously Publishing Core in the Scientific Workforce
Ioannidis, J. P. A., Boyack, K. W., & Klavans, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0101698 · Cited by 160
Flows of Research Manuscripts Among Scientific Journals Reveal Hidden Submission Patterns
Calcagno, V., Demoinet, É., Gollner, K., Guidi, L., Ruths, D. A., & de Mazancourt, C. (2012) · Science · doi:10.1126/science.1227833 · Cited by 159
On the time spent preparing grant proposals: an observational study of Australian researchers
Herbert, D. L., Barnett, A. G., Clarke, P., & Graves, N. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-002800 · Cited by 156
Rejecting and resisting Nobel class discoveries: accounts by Nobel Laureates
Campanario, J. M. (2009) · Scientometrics · doi:10.1007/s11192-008-2141-5 · Cited by 142
Lundh, A., Barbateskovic, M., Hróbjartsson, A., & Gøtzsche, P. C. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000354 · Cited by 133
Fitzpatrick, K. (2011) · New York University Press eBooks · doi:10.18574/nyu/9780814728970.001.0001 · Cited by 133
Excellence in university academic staff evaluation: a problematic reality?
O’Connor, P., & O’Hagan, C. (2015) · Studies in Higher Education · doi:10.1080/03075079.2014.1000292 · Cited by 131
Research Misconduct: The Poisoning of the Well
Smith, R. W. (2006) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.99.5.232 · Cited by 128
Bibliometrics: Is your most cited work your best?
Ioannidis, J. P. A., Boyack, K. W., Small, H. G., Sorensen, A. A., & Klavans, R. (2014) · Nature · doi:10.1038/514561a · Cited by 126
Claxton, L. D. (2004) · Mutation Research/Reviews in Mutation Research · doi:10.1016/j.mrrev.2004.07.003 · Cited by 126
NIH peer review percentile scores are poorly predictive of grant productivity
Fang, F. C., Bowen, A. D., & Casadevall, A. (2016) · eLife · doi:10.7554/elife.13323 · Cited by 114
Ely, A., van Zwanenberg, P., & Stirling, A. (2013) · Research Policy · doi:10.1016/j.respol.2013.09.004 · Cited by 112
Birney, E. (2012) · Nature · doi:10.1038/489049a · Cited by 107
Have referees rejected some of the most-cited articles of all times?
Campanario, J. M. (1996) · Journal of the American Society for Information Science · Cited by 103
Scientific retractions and corrections related to misconduct findings
Resnik, D. B., & Dinse, G. E. (2012) · Journal of Medical Ethics · doi:10.1136/medethics-2012-100766 · Cited by 100
Reproducibility: The risks of the replication drive
Bissell, M. (2013) · Nature · doi:10.1038/503333a · Cited by 99
Consolation for the Scientist: Sometimes it is Hard to Publish Papers that are Later Highly-Cited
Campanario, M. A. G. (1993) · Social Studies of Science · doi:10.1177/030631293023002005 · Cited by 94
Taking stock of participatory geographies: envisioning the communiversity
Kinpaisby, M. (2008) · Transactions of the Institute of British Geographers · doi:10.1111/j.1475-5661.2008.00313.x · Cited by 88
Gonon, F., Konsman, J. P., Cohen, D., & Boraud, T. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044275 · Cited by 86
A survey of authors publishing in four megajournals
Solomon, D. (2014) · PeerJ · doi:10.7717/peerj.365 · Cited by 85
Research Misconduct: The Poisoning of the Well
Smith, R. W. (2006) · Journal of the Royal Society of Medicine · doi:10.1177/014107680609900514 · Cited by 85
Roberts, L. (2001) · Science · doi:10.1126/science.291.5507.1182a · Cited by 83
Ike Antkare one of the great stars in the scientific firmament
Antkare, I. (2010) · Cited by 83
Bollen, J., Crandall, D., Junk, D., Ding, Y., & Börner, K. (2014) · EMBO Reports · doi:10.1002/embr.201338068 · Cited by 80
A visual analytic study of retracted articles in scientific literature
Chen, C., Hu, Z., Milbank, J., & Schultz, T. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22755 · Cited by 75 · cited 1×
“As various studies have concluded, reported instances of both fraud and error (as measured through retractions) are on the rise (Claxton, 2005; Dobbs, 2006; Steen, 2011; Fang et al., 2012; Grieneisen and Zhang, 2012; Yong, 2012b; Chen et al., 2013; Andrade, 2016).”
BackgroundBias Against Novelty in Science: A Cautionary Tale for Users of Bibliometric IndicatorsPreprint
Wang, J., Veugelers, R., & Stephan, P. E. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2710572 · Cited by 72
Bite-size science and its undesired side effects
Bertamini, M., & Munafò, M. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611429353 · Cited by 62
Campanario, J. M., & Acedo, E. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20556 · Cited by 62
Bias in genetic association studies and impact factor
Munafò, M. R., Stothart, G., & Flint, J. (2009) · Molecular Psychiatry · doi:10.1038/mp.2008.77 · Cited by 60
Open Access and the Humanities: Contexts, Controversies, and the Future
(2017) · doi:10.31229/osf.io/d79yu · Cited by 59
Research groups: How big should they be?
Cook, I., Grange, S., & Eyre-Walker, A. (2015) · PeerJ · doi:10.7717/peerj.989 · Cited by 58
Campanario, J. M. (1995) · Science Communication · doi:10.1177/1075547095016003004 · Cited by 58
Gordon, R., & Poulin, B. J. (2009) · Accountability in Research · doi:10.1080/08989620802689821 · Cited by 55
Open Access and the Humanities: Contexts, Controversies and the Future
Eve, M. P. (2015) · Online Information Review · doi:10.1108/oir-07-2015-0229 · Cited by 49
Goodrich, D. W. (1945) · American Sociological Review · doi:10.2307/2085841 · Cited by 44
Bias against Novelty in Science: A Cautionary Tale for Users of Bibliometric Indicators
Wang, J., Veugelers, R., & Stephan, P. E. (2016) · National Bureau of Economic Research · doi:10.3386/w22180 · Cited by 42
Kennedy, D. (2004) · Science · doi:10.1126/science.305.5683.451 · Cited by 38
Casadevall, A., & Fang, F. C. (2012) · Scientific American · doi:10.1038/scientificamerican0812-13 · Cited by 35 · cited 1×
“Since the earliest days of science, bragging rights to a discovery have gone to the person who first reports it” (Casadevall and Fang, 2012: 13).”
BackgroundCostello, L. C. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181d74256 · Cited by 34
Examining the predictive validity of NIH peer review scores
Lindner, M. D., & Nakamura, R. K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126938 · Cited by 24
Combating the scientific decline effect with confidence (intervals)
Groppe, D. M. (2016) · Psychophysiology · doi:10.1111/psyp.12616 · Cited by 23
The File-Drawer Problem, Revisited
Young, S. S., & Bang, H. (2004) · Science · doi:10.1126/science.306.5699.1133d · Cited by 22
A paradigm shift in the medical literature
Atkin, P. A. (2002) · BMJ · doi:10.1136/bmj.325.7378.1450 · Cited by 21
Editors, Publishers, Impact Factors, and Reprint Income
Marcovitch, H. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000355 · Cited by 19
American Idol and NIH Grant Review
Pagano, M. (2006) · Cell · doi:10.1016/j.cell.2006.08.004 · Cited by 17
MacCallum, C. (2011) · PLoS Biology · doi:10.1371/journal.pbio.1001235 · Cited by 16
Structural constraints and the publications dilemma: A review and some proposals
Dean, D. G. (1989) · The American Sociologist · doi:10.1007/bf02691857 · Cited by 10
Citation opportunity cost of the high impact factor obsession
Şekercioğlu, Ç. H. (2013) · Current Biology · doi:10.1016/j.cub.2013.07.065 · Cited by 10
Best Practices for Evaluating Mutation Prediction Methods
Rogan, P. K., & Zou, G. (2013) · Human Mutation · doi:10.1002/humu.22401 · Cited by 7
A Journal is a Club: A New Economic Model for Scholarly PublishingPreprint
Potts, J., Hartley, J., Montgomery, L., Neylon, C., & Rennie, E. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2763975 · Cited by 7
Self-citationFailure to Replicate: A Sign of Scientific Misconduct?
Hill, H. Z., & Pitt, J. (2014) · Publications · doi:10.3390/publications2030071 · Cited by 5
Cited by
What is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.1 · Cited by 232
“Finally, factors like the pursuit of “impact” and “excellence” (Moore et al., 2017) mean that editors and reviewers seem primed to prefer positive results over negative or neutral ones (Bardy, 1998; Dickersin et al., 1992; Fanelli, 2010; Ioannidis, 1998), and to disfavour replication studies…”
BackgroundChanging how we evaluate research is difficult, but not impossible
Hatch, A., & Curry, S. (2020) · eLife · doi:10.7554/elife.58654 · Cited by 55
Regional and institutional trends in assessment for academic promotion
Lim, B. H., D’Ippoliti, C., Dominik, M., Hernández-Mondragón, A. C., Vermeir, K., Chong, K. K., Hussein, H., Morales-Salgado, V. S., Cloete, K. J., Kimengsi, J. N., et al. (2025) · Nature · doi:10.1038/s41586-024-08422-9 · Cited by 53
Kirkpatrick, R. H., Munoz, D. P., Khalid-Khan, S., & Booij, L. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.11.023 · Cited by 41
Metadata
- Authors
- Moore, S., Neylon, C., Paul Eve, M., Paul O’Donnell, D., & Pattinson, D.
- Venue
- Palgrave Communications
- Published
- 2017-01-19
- Volume
- 3
- Issue
- 1
- ISSN
- 2055-1045 (ISSN-L)
- OpenAlex
- W2417800084
- Cited by
- 264
- References
- 130
- FWCI
- 45.52
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.