Nobel and novice: Author prominence affects peer review
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index; 8 of the 36 sources its claims cite were checked for support.
Abstract
Peer review is a well-established cornerstone of the scientific process, yet it is not immune to biases like status bias, which we explore in this paper. Merton described this bias as prominent researchers getting disproportionately great credit for their contribution, while relatively unknown researchers get disproportionately little credit [R. K. Merton, Science 159, 56–63 (1968)]. We measured the extent of this bias in the peer-review process through a preregistered field experiment. We invited more than 3,300 researchers to review a finance research paper jointly written by a prominent author (a Nobel laureate) and by a relatively unknown author (an early career research associate), varying whether reviewers saw the prominent author’s name, an anonymized version of the paper, or the less-well-known author’s name. We found strong evidence for the status bias: More of the invited researchers accepted to review the paper when the prominent name was shown, and while only 23% recommended “reject” when the prominent researcher was the only author shown, 48% did so when the paper was anonymized, and 65% did when the little-known author was the only author shown. Our findings complement and extend earlier results on double-anonymized vs. single-anonymized review [R. Blank, Am. Econ. Rev. 81, 1041–1067 (1991); M. A. Ucci, F. D’Antonio, V. Berghella, Am. J. Obstet. Gynecol. MFM 4, 100645 (2022)].
Overview
CoChat Summary
TL;DR
In a preregistered field experiment, reviewers evaluating the same finance manuscript were strongly influenced by whether the corresponding author was Nobel laureate Vernon L. Smith, an early-career researcher, or anonymized. Prominent authorship increased willingness to review and produced more favorable recommendations, while less prominent authorship produced less favorable assessments.
Key findings
- Review-invitation acceptance was higher when the Nobel laureate was named: 38.5% in HH vs. 30.7% in anonymized conditions and 28.5% in LL; HH vs. anonymized P = 0.0031, HH vs. LL P = 0.0011, while anonymized vs. LL was not significant (P = 0.3243).
- Manuscript recommendations differed sharply: “reject” was recommended by 65.4% when the less prominent author was shown (AL), 48.2% when anonymized (AA), and 22.6% when the prominent author was shown (AH); “accept” or “minor revision” was recommended by 9.9%, 23.6%, and 58.8%, respectively, with all pairwise differences significant.
- The abstract reports that more than 20% of reviewers recommended “accept” when the Nobel laureate was shown as author, but less than 2% did so when the research associate was shown.
- For all six reviewer quality items, ratings shifted significantly upward when the prominent author was shown vs. anonymized and less prominent conditions (all z ≥ 4.260, all P ≤ 0.0001); the negative component was statistically significant only for items on information being new, conclusions supported by data, and figures/SI Appendix being appropriate.
Methods
- Preregistered field experiment using one unpublished finance manuscript coauthored by Nobel laureate V. L. Smith and early-career S. Inoua, submitted to the Journal of Behavioral and Experimental Finance; more than 3,300 review invitations were sent, yielding 2,611 responses and 534 review reports.
- Five conditions varied whether a corresponding author name appeared in the invitation email and/or on the manuscript: LL (less prominent), AA (anonymized), HH (high prominence), AL, and AH; the second author’s name was never shown.
- Main analyses used two-sided Fisher’s exact tests for invitation acceptance, Mann–Whitney U tests for recommendations and six Likert-scale quality items, and tests of proportions; preregistered hypotheses covered positive and negative components of status bias at invitation and assessment stages.
Limitations
- Stated: GDPR/ethics-required informed consent may have introduced selection or moral-hazard effects for the manuscript-assessment data, though the paper reports no significant reviewer-characteristic differences between consenters and nonconsenters.
- Stated: both authors shared the same institution and gender, but differed in name origin and skin tone, so discrimination based on name or colorism cannot be ruled out.
- Stated: the study used only one paper in one field (finance/financial economics), so the authors cannot unambiguously generalize to other fields; the paper also states it was not designed to identify the motivational drivers of the bias.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
4 Valid · 1 Not valid · 4 Not checked · 59 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In SI Appendix, we show that those reviewers that accepted the invitation to review the paper, despite having been informed that the corresponding author was the less prominent researcher (in condition LL), were milder in their judgements than reviewers that responded to the anonymized invitation.”
§ Nobel and novice: Author prominence affects peer review > Manuscript Assessment
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The pairwise differences between conditions were all significant: The P value for AL vs. AA is 0.0120 (two-sided test of proportions, z = 2.512), that for AA vs. AH is 0.0001 (z=3.885), and that for AL vs. AH is <0.0001 (z=6.144; the α-threshold corrected for three tests was 0.05).”
§ Nobel and novice: Author prominence affects peer review > Manuscript Assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The pairwise differences between conditions were all highly significant: The P value for AL vs. AA was 0.008 (two-sided test of proportions, z=−2.650), that for AA vs. AH was <0.0001 (z=−5.213), and that for AL vs. AH was <0.0001 (z=−7.332; α-threshold corrected for three tests was 0.05).”
§ Nobel and novice: Author prominence affects peer review > Manuscript Assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For all six items, we observed a significant upward shift of the distribution of ratings when the manuscript showed the highly prominent corresponding author compared to both the anonymized manuscript and the manuscript showing the relatively unknown author (AH vs. AA/AL: all z≥4.260 and all P≤0.0001, two-sided Mann–Whitney U tests).”
§ Nobel and novice: Author prominence affects peer review > Manuscript Assessment
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the differences between the acceptance rate in HH and the acceptance rates in each of the other two settings (AL, AA, and AH pooled; and LL) were highly significant, the difference between the anonymized conditions (pooled) and LL was not.”
§ Nobel and novice: Author prominence affects peer review > Willingness to Review
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
14 more claims
Create a free account to see all 68 claims and every source verdict.
- Probably not a substantial claim. 38
- It may state two separate claims as one. 23
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentz = -2.172reported p = .03 · recomputed p = .030
“z=−2.172, p = .030”
- Consistentz = 0.774reported p = .439 · recomputed p = .439
“z = 0.774, p = .439”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Nobel and novice: Author prominence affects peer review > Materials and Methods > Identification Strategy.
“Since we found statistically significant differences (AL vs. LL: z=−2.172, P = 0.030; AH vs. HH: z = 0.774, P = 0.439; two-sided Mann–Whitney U tests), we refrained from pooling”
§ Nobel and novice: Author prominence affects peer review > Materials and Methods > Statistical Tests.
“For our preregistered hypothesis tests, we did not apply multiple hypothesis-testing corrections and took 0.05 as the α-threshold.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Nobel and novice: Author prominence affects peer review > Manuscript Assessment
“6) the figures and tables appropriate.”
§ Nobel and novice: Author prominence affects peer review > Manuscript Assessment
“6) on the figures and SI Appendix being appropriate.”
Citations
Cites
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720
(1968) · PubMed · Cited by 4,803
A constant error in psychological ratings.
Thorndike, E. L. (1920) · Journal of Applied Psychology · doi:10.1037/h0071663 · Cited by 2,163
The halo effect: Evidence for unconscious alteration of judgments.
Nisbett, R. E., & Wilson, T. D. (1977) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.35.4.250 · Cited by 2,021
Understanding current causes of women's underrepresentation in science
Ceci, S. J., & Williams, W. M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014871108 · Cited by 1,114 · cited 1×
“While both authors have the same gender (7), we could not hold race and name origin constant, since the Nobel laureate only had one project to write a paper about with a suitable junior researcher at the time.”
BackgroundPeer-review practices of psychological journals: The fate of published articles, submitted again
Peters, D. P., & Ceci, S. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011183 · Cited by 1,079
Field Experiments of Discrimination in the Market Place
Riach, P. A., & Rich, J. (2002) · The Economic Journal · doi:10.1111/1468-0297.00080 · Cited by 911
Reviewer bias in single- versus double-blind peer review
Tomkins, A., Zhang, M., & Heavlin, W. D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1707323114 · Cited by 605
A large-scale analysis of racial disparities in police stops across the United States
Pierson, E., Simoiu, C., Overgoor, J., Corbett-Davies, S., Jenson, D., Shoemaker, A., Ramachandran, V., Barghouty, P., Phillips, C., Shroff, R., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0858-1 · Cited by 552 · cited 1×
“, colorism) has long been identified as among the most salient markers for discrimination (10, 11).”
Background
Research works printed but not linked: 1
- Clarivate Analytics Journal citation reports (2019). https://clarivate.com/webofsciencegroup/web-of-science-journal-citation-reports-2022-infographic/.
Cited by
Systemic racial disparities in funding rates at the National Science Foundation
Chen, C. Y., Kahanamoku, S. S., Tripati, A., Alegado, R. A., Morris, V. R., Andrade, K., & Hosbey, J. (2022) · eLife · doi:10.7554/elife.83071 · Cited by 127
Double‐blind peer review affects reviewer ratings and editor decisions at an ecology journal
Fox, C. W., Meyer, J., & Aimé, E. (2023) · Functional Ecology · doi:10.1111/1365-2435.14259 · Cited by 128
Prosocial motives underlie scientific censorship by scientists: A perspective and research agenda
Clark, C. J., Jussim, L. J., Frey, K., Stevens, S. T., al‐Gharbi, M., Aquino, K. F., Bailey, J. M., Barbaro, N., Baumeister, R. F., Bleske-Rechek, A. L., et al. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2301642120 · Cited by 129
Gender inequality and self-publication are common among academic editors
Liu, F. M., Holme, P., Chiesa, M., AlShebli, B. K., & Rahwan, T. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01498-1 · Cited by 77
How to improve scientific peer review: four schools of thought
Waltman, L., Kaltenbrunner, W., Pinfield, S., & Woods, H. B. (2023) · Learned Publishing · doi:10.1002/leap.1544 · Cited by 71
“Recent work on ‘status bias’, with reviewers favouring prominent researchers in their field when author identities are known, has been presented as supporting the case for double-anonymous peer review (Huber et al., 2022).”
BackgroundRethinking academia in a time of climate crisis
Urai, A. E., & Kelly, C. A. M. (2023) · eLife · doi:10.7554/elife.84991 · Cited by 98
“84991 10 of 16 Point of View | Rethinking academia in a time of climate crisis distance themselves from scientific evidence (Huber, 2022).”
BackgroundUse of artificial intelligence and the future of peer review
Bauchner, H., & Rivara, F. P. (2024) · Health Affairs Scholar · doi:10.1093/haschl/qxae058 · Cited by 66
Scientific sinkhole: estimating the cost of peer review based on survey data with snowball sampling
LeBlanc, A. G., Barnes, J. D., Saunders, T. J., Tremblay, M. S., & Chaput, J. (2023) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00128-2 · Cited by 30
“For example, an hourly pay for grant evaluations has been proposed [21] and a recent study on double blind peer review in the finance field stated that it is standard practice for the journal to pay reviewers US$50 for review, regardless of hours needed to do the work or country of origin [22].”
BackgroundReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewing
Liu, R., & Shah, N. B. (2023) · arXiv · doi:10.48550/arxiv.2306.00622 · Cited by 23
Citation manipulation through citation mills and pre-print servers
Ibrahim, H., Liu, F., Zaki, Y., & Rahwan, T. (2025) · Scientific Reports · doi:10.1038/s41598-025-88709-7 · Cited by 84
A guide for social science journal editors on easing into open science
Silverstein, P., Elman, C., Montoya, A. K., McGillivray, B., Pennington, C. R., Harrison, C. H., Steltenpohl, C. N., Röer, J. P., Corker, K. S., Charron, L., et al. (2024) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00141-5 · Cited by 29
“In particular, it is possible that peer review with open identities (where the identities of reviewers are disclosed) could lead to reviewers being treated unfairly for giving unfavorable reviews, or to opening up the potential for bias or retaliation [90–92].”
BackgroundWho is publishing in ecology and evolution? the underrepresentation of women and the Global South
Hughes, A. C., Than, K. Z., Tanalgo, K. C., Agung, A. P., Alexander, T., Kane, Y., Bhadra, S., Chornelia, A., Sritongchuay, T., Simla, P., et al. (2023) · Frontiers in Environmental Science · doi:10.3389/fenvs.2023.1211211 · Cited by 32
“, see Retractionwatch, 2023), such as the few waiver deals available in Latin America relative to the numbers of “high impact researchers” from the region may actively reverse progress in publishing in these regions, and reducing the ability to publish may reduce the competitiveness of these researchers at accessing i…”
BackgroundOn Class and Elitism in Archaeology
Ribeiro, A., & Giamakis, C. (2023) · Open Archaeology · doi:10.1515/opar-2022-0309 · Cited by 28
“Of those who reviewed the version authored by the Nobel Laureate, 23% recommended rejection; when the paper was anonymised, 48% recommended rejection; and the version containing the name of a lesser-known author received 65% rejections (Huber et al., 2022).”
BackgroundSystemic racial disparities in funding rates at the National Science FoundationPreprint
Chen, C. Y., Kahanamoku, S. S., Tripati, A., et al. (2022) · doi:10.31219/osf.io/xb57u · Cited by 19
Oppong, S. (2023) · Psychology and Developing Societies · doi:10.1177/09713336231152301 · Cited by 25
“, co-authoring with Nobel Laureates) leads to more favourable peer reviews and increases the chance of a manuscript being accepted (Huber et al., 2022).”
BackgroundReviewer training for improving grant and journal peer review
Hesselberg, J.-O., Dalsbø, T. K., Strømme, H., Svege, I. C., & Fretheim, A. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000056.pub2 · Cited by 29
The academic status of reviewers predicts their language use
Sun, Z., Cao, C. C., Ma, C., & Li, Y. (2023) · Journal of Informetrics · doi:10.1016/j.joi.2023.101449 · Cited by 16
Geographical diversity of peer reviewers shapes author success
Dumlao, J. M. Z., & Teplitskiy, M. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2507394122 · Cited by 15
“Double - anonymization has proven effective in reducing prestige bias ( 17 , 22 , 31 , 34 , 44 , 45 ), but evidence on whether it reduces country homophily was lacking until now.”
Sun, Z. (2024) · Journal of Informetrics · doi:10.1016/j.joi.2024.101501 · Cited by 17
Parmanne, P., Laajava, J., Järvinen, N., Harju, T. H., MARTTUNEN, M. J., & Saloheimo, P. (2023) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00140-6 · Cited by 13
“Huber et al. found that the reviewers significantly more often accepted the review invitation when the prominent researcher was shown as corresponding author [6].”
BackgroundBehavioral optimization in Scientific PublishingPreprint
Watve, M. (2023) · Qeios · doi:10.32388/8w10nd · Cited by 11
“Many flaws and limitations of the review process are recognized (Campanario 1998, Kelly et al 2014, Huber et al 2022), but most scholars seem to think that in spite of the problems, the review system generally serves a useful purpose for scientific publishing and cannot be spared or replaced…”
BackgroundUttley, L., Falzon, L., Byrne, J. A., Tricco, A. C., Munafo, M. R., Moher, D., Stoeger, T., Matandika, L., Labbé, C., & Naudet, F. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111616 · Cited by 16
Submit-to-Accept Times in Accounting: Determinants and Comparisons to Other Business Disciplines
Hurley, P. J., Gal‐Or, R., Knechel, W. R., & Pesch, H. L. (2024) · The Accounting Review · doi:10.2308/tar-2022-0574 · Cited by 13
The fading of status bias during the open peer review process
Sun, Z., Pang, K. L., & Li, Y. (2024) · Journal of Informetrics · doi:10.1016/j.joi.2024.101528 · Cited by 15
Trends and biases in the social cost of carbon
Tol, R. S. J. (2025) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.15340 · Cited by 21
The Creative Brain: Myths and Truths
Abraham, A. (2024) · The MIT Press eBooks · doi:10.7551/mitpress/14313.001.0001 · Cited by 20
Reviewing manuscripts for behavior‐analytic journals: A primer
Cengher, M., & Leblanc, L. A. (2023) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.1034 · Cited by 11
Dadhich, M., Gyamfi, B. A., Bekun, F. V., et al. (2025) · Quality & Quantity · doi:10.1007/s11135-025-02221-8 · Cited by 8
Meta-HCI: First Workshop on Meta-Research in HCI
Oppenlaender, J., Malacria, S., Fang, X., van Berkel, N., Chevalier, F., Yatani, K., & Hosio, S. J. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3706723 · Cited by 15
A harm reduction approach to improving peer review by acknowledging its imperfections
Cooke, S. J., Young, N., Peiman, K. S., Roche, D. G., Clements, J. C., Kadykalo, A. N., Provencher, J. F., Raghavan, R., DeRosa, M. C., Lennox, R. J., et al. (2024) · FACETS · doi:10.1139/facets-2024-0102 · Cited by 12
“It occurs because the perceptions and decisions of editors and reviewers can be biased due to their own biases and also due to an author’s prestige/status (Huber et al. 2022), institutional affiliation, race (Strauss et al. 2023), nationality, language, or gender (Lee et al. 2013).”
Angry scientists, angry analysts and angry novelists
Doi, S. A. R., & Abdulmajeed, J. (2023) · Diabetologia · doi:10.1007/s00125-023-05917-4 · Cited by 8
“Additionally, many peer reviewers and first-line editors are not seasoned researchers, and their decision making may be influenced by institutional or author reputation [11], which may not align with key skills in clinical epidemiology [12].”
BackgroundHow to improve scientific peer review: Four schools of thoughtPreprint
Waltman, L., Kaltenbrunner, W., Pinfield, S., et al. (2022) · doi:10.31235/osf.io/v8ghj · Cited by 8
Zhu, J., Zhou, J., Pan, J., Гу, Ф., & Guo, J. (2025) · Big Data and Cognitive Computing · doi:10.3390/bdcc9020030 · Cited by 10
Examining uncertainty in journal peer reviewers’ recommendations: a cross-sectional study
Barnett, A., Allen, L., Aldcroft, A., Lash, T. L., & McCreanor, V. (2024) · Royal Society Open Science · doi:10.1098/rsos.240612 · Cited by 10
“Women were associated with more uncertainty at one journal, and protocol papers were associated with more uncertainty at one journal.”
BackgroundChanging the Culture of Peer Review for a More Inclusive and Equitable Psychological SciencePreprint
Aly, M., Colunga, E., Crockett, M. J., et al. (2022) · doi:10.31234/osf.io/435xz · Cited by 7
Threats to grant peer review: a qualitative study
Sims‐Gould, J., Lasinsky, A. M., Mota, A., Khan, K. M., & Ardern, C. L. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-091666 · Cited by 9
Siler, K., & Larivière, V. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24844 · Cited by 7
“Numerous studies have identified influences of personal and institutional status on academic evaluations (e.g., Leahey, 2004; Peters & Ceci, 1982; Simcoe & Waguespack, 2011; Tomkins et al., 2017; Huber et al., 2022; Si et al., 2023).”
BackgroundZhang, G., Wang, L., Yin, Y., & Wang, X. (2025) · Accountability in Research · doi:10.1080/08989621.2025.2521083 · Cited by 6
“Several experiments (Huber et al. 2022; Okike et al. 2016; Peters and Ceci 1982) support the view that peer review is not solely guided by the manuscript itself but also by the academic influence of author.”
Writing in community: Relationship building and accountability in knowledge production
Prince, J. A. R., Blackwood, E. M., Landrum, M., Milton, E. B. P., Rodgers, E. L., Barnes, M., Chin, E. J., Craven, C., Douglass, K., Torres, M. J. F., et al. (2025) · American Anthropologist · doi:10.1111/aman.28070 · Cited by 5
Double-blind peer review is detrimental to scientific integrity
Mebane, C. A. (2025) · Environmental Toxicology and Chemistry · doi:10.1093/etojnl/vgae046 · Cited by 10
Evaluating use of evidence in U.S. state governments: A conjoint analysis
Xu, C., Cheng, Y., Wang, S., Merrick, W., & Carter, P. (2024) · Public Administration Review · doi:10.1111/puar.13903 · Cited by 7
“Existing causal evidence also shows a strong “ author effect ” on experts ’ evaluation of studies with equivalent quality (Blank, 1991; Huber et al., 2022).”
Cultural distance, gender and praise in peer review
Zhang, G., Wang, L., & Wang, X. (2024) · Accountability in Research · doi:10.1080/08989621.2024.2409310 · Cited by 5
“Several empirical studies suggest that papers authored by prestigious individuals are more likely to receive favorable evaluations (Huber et al. 2022; Okike et al. 2016).”
Fang, D., & Maglio, S. J. (2024) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2024.104365 · Cited by 9
The effect of reviewer geographical diversity on evaluations is reduced by anonymizing submissionsPreprint
Dumlao, J. M. Z., & Teplitskiy, M. (2023) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/754e3 · Cited by 6
Fuente-Ballesteros, A., & Zuin, V. G. (2026) · Green Analytical Chemistry · doi:10.1016/j.greeac.2026.100349 · Cited by 7
The Challenges and Future of Peer Review
Bauchner, H., & Rivara, F. P. (2025) · Critical Care Medicine · doi:10.1097/ccm.0000000000006642 · Cited by 4
Giannakakos, V. P., Karanfilian, T. S., Dimopoulos, A. D., & Barmettler, A. (2024) · Scientometrics · doi:10.1007/s11192-024-05213-x · Cited by 10
“Five studies were ranked as level II evidence (Alam et al., 2011; Fisher et al., 1994; Huber et al., 2022; Hultgren et al., 2024; Solans-Domènech et al., 2017).”
Cox, A. L., & Mole, S. (2024) · BBA Advances · doi:10.1016/j.bbadva.2024.100114 · Cited by 4
Are Economics Conferences Gender‐Neutral? Evidence from Ireland*
Samahita, M., & Devereux, K. (2023) · Oxford Bulletin of Economics and Statistics · doi:10.1111/obes.12575 · Cited by 4
Behavioral optimization in Scientific PublishingPreprint
Watve, M. (2023) · Qeios · doi:10.32388/8w10nd.2 · Cited by 4
Sunlight not shadows: Double-anonymized peer review is not the progressive answer to status biasPreprint
Horbach, S. P. J. M., Ross‐Hellauer, T., & Waltman, L. (2022) · doi:10.31219/osf.io/fqb5c · Cited by 3
Navigating the AI frontier: Balancing efficiency and integrity in orthopaedic peer review
Vaish, A., & Jain, V. K. (2025) · Journal of Clinical Orthopaedics and Trauma · doi:10.1016/j.jcot.2025.103183 · Cited by 5
Zug, R., Foitzik, S., & Kokko, H. (2025) · Journal of Evolutionary Biology · doi:10.1093/jeb/voaf094 · Cited by 3
The persistence of very low correlations between NIH research funding and disease burdens
Carter, A. J. R., & Gevorkian, M. (2024) · Public Health in Practice · doi:10.1016/j.puhip.2024.100580 · Cited by 5
“Peer reviews from external parties tend to fixate on scientific merit in addition to the burden of disease and papers with well-established authors are more likely to be accepted by journals than those of identical quality by less-established authors [23].”
Accelerated acceptance time for preprint submissions: a comparative analysis based on PubMed
Tian, D., Liu, X., & Li, J. (2024) · Scientometrics · doi:10.1007/s11192-024-05056-6 · Cited by 5
“The peer review process is susceptible to author status bias, leading to differential treatment when the same study is submitted by a Nobel laureate compared to an academic novice (Huber et al., 2022).”
Universalism and particularism in the recommendations of the nobel prize for science
Ko, B.-K., Jang, Y., & Yang, J. (2024) · Scientometrics · doi:10.1007/s11192-023-04921-0 · Cited by 3
“Studies have revealed that peer review is not free from bias; this is true in the contexts of publications, grants, research fellowships, and even scientific policy (Bornmann & Daniel, 2005; Casnici et al., 2017; Cole et al., 1981; Huber et al., 2022; Langfeldt, 2006; Pier et al., 2018).”
Author Country of Origin and Attention on Open Science Platforms: Evidence from COVID-19 Preprints
Fry, C., & MacGarvie, M. J. (2023) · National Bureau of Economic Research · doi:10.3386/w31565 · Cited by 3
The role of author identities in peer review
Shah, N. B. (2023) · PLOS ONE · doi:10.1371/journal.pone.0286206 · Cited by 6
Chin, J. M., Zeiler, K., Dilevski, N., Holcombe, A. O., Gatfield-Jeffries, R., Bishop, R., Vazire, S., & Schiavone, S. R. (2023) · F1000Research · doi:10.12688/f1000research.127563.1 · Cited by 8
“Madrian, Applying Insights from Behavioral Economics to Policy Design, 6 ANNU. REV. ECONOM. 663 (2014). (23)Cabinet Office Behavioural Insights Team, Applying behavioural insights to reduce fraud, error and debt (2012), https://vng.”
MethodFreitas, G., Ünal, I., Goldust, M., & Grant-Kels, J. M. (2026) · JAAD reviews. · doi:10.1016/j.jdrv.2026.03.003 · Cited by 5
From Merton to market: Normative tensions in Canadian science
Bogard, H. J. K., & Barrett, L. (2026) · Quantitative Science Studies · doi:10.1162/qss.a.480 · Cited by 2
Reinforcement generates systematic differences without heterogeneity
Gelastopoulos, A., Sage, L., & van de Rijt, A. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2408163122 · Cited by 5
Fleerackers, A., Moorhead, L. L., Alperín, J. P., Riedlinger, M. E., & Maggio, L. A. (2025) · PLoS ONE · doi:10.1371/journal.pone.0309274 · Cited by 4
“This view of peer review aligns with that of many researchers [78] despite criticisms that peer review is not a reliable quality control system and can, at times, introduce biases [39,50].”
Redesigning Academia: A Citizens’ Perspective I. Diagnosis
Watve, M. (2025) · doi:10.29195/dsss.08.01.91 · Cited by 1
Testing for reviewer anchoring in peer review: A randomized controlled trial
Liu, R., Jecmen, S., Conitzer, V., Fang, F., & Shah, N. B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0301111 · Cited by 10
“…studies on confirmation bias (Mahoney, 1977), commensuration bias (Lee, 2015), the effects of revealing author identities to reviewers (Blank, 1991; Huber et al., 2022; Manzoor and Shah, 2021; Tomkins et al., 2017), reviewer herding (Stelmakh et al., 2020), resubmission bias (Stelmakh et al.,…”
Economics Peer-Review: Problems, Recent Developments, and Reform Proposals
Siemroth, C. (2023) · The American Economist · doi:10.1177/05694345241269484 · Cited by 7
“These studies provide very credible evidence of a bias, because they hold manuscript quality constant and exogenously vary author identity: Huber et al. (2022) ran a fi eld experiment at a fi nance journal with a manuscript written by a Nobel Prize winner and a mostly unknown early career researcher.”
Buljan, I., García-Costa, D., Grimaldo, F., Klein, R. A., Bakker, M., & Marušić, A. (2024) · Journal of Informetrics · doi:10.1016/j.joi.2024.101555 · Cited by 4
Ribeiro, M. D., & Vasconcelos, S. M. R. (2024) · Anais da Academia Brasileira de Ciências · doi:10.1590/0001-3765202420240038 · Cited by 3
Unpacking P-Hacking and Publication Bias
Brodeur, A., Carrell, S., Figlio, D., & Lusher, L. R. (2023) · National Bureau of Economic Research · doi:10.3386/w31548 · Cited by 3
Behavioral Optimization in Scientific PublishingPreprint
Watve, M. (2023) · Qeios · doi:10.32388/8w10nd.3 · Cited by 3
What Do Blind Evaluations Reveal? How Discrimination Shapes Representation and QualityPreprint
Uchida, H. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3767565 · Cited by 2
Why Management Scholars Should Learn to Stop Worrying and Love Journal Rankings
Sinnicks, M. (2026) · Academy of Management Learning and Education · doi:10.5465/amle.2025.0106 · Cited by 1
Zhou, L., Zhang, R., Dai, X., Hershcovich, D., & Li, H. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.114988 · Cited by 12
Dore, M. P., Merola, E., Lasaracina, G., & Pes, G. M. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15062215 · Cited by 4
“Decades of evidence demonstrate systemic bias and favoritism: famous authors consistently receive higher acceptance rates and better reviews [11], and “nepotistic” journals are documented in which editors rapidly publish their own work [12].”
Ilkal, V., Shettar, A. K., Hoskeri, J. H., et al. (2026) · Total Environment Microbiology · doi:10.1016/j.temicr.2026.100061 · Cited by 1
Kohrs, F. E., Kazezian, V., Bagley, R. K., et al. (2025) · Learned Publishing · doi:10.1002/leap.2028 · Cited by 2
“They may experience systemic bias due to these factors and their career stage (Huber et al. 2022; Receveur et al. 2024).”
Rethinking Stardom: A Relativistic Approach to Studying the Absolute Best Performers
O’Boyle, E. H., & Götz, M. (2025) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-020924-065909 · Cited by 2
Citing Decisions in Psychology: A Roadblock to Cumulative and Inclusive Science
Lawson, K. M., Murphy, B. A., Azpeitia, J., Lombard, E. J., & Pope, T. J. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251351287 · Cited by 6
“Given structural inequities within academic psychology and the implicit biases of individual researchers (e.g., see Huber et al., 2022), such characteristics may be worth weighing; however, citing decisions should ultimately be driven by the relevance of the ideas to the citing work.”
Trained AI as “Experiment Participants”: theory and practice
Bian, Y., Fang, Z., & Li, D. (2025) · Current Psychology · doi:10.1007/s12144-025-08082-6 · Cited by 4
“23 percent recommend"reject"when a Nobel laureate (Vernon L. Smith) is the only author shown, 48 percent do so when the paper is anonymized, and 65 percent recommend"reject"when Sabiou Inoua, an early-career research associate, is the only author shown (Huber et al., 2022 ).”
Machine-Learning Assisted Screening for Evidence Synthesis: A Case Study of Using the ASReview ToolPreprint
Boesen, K., Hemkens, L. G., Janiaud, P., & Hirt, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5125681 · Cited by 1
Generative AI-assisted Peer Review in Medical Publications: Opportunities Or Trap (Preprint)Preprint
Li, Z., Shen, C., Cao, F., Xiang, C. J., Fei, Y., & Liu, J. (2024) · doi:10.2196/preprints.66022 · Cited by 1
Reimagining Peer Review Needs Publishers and Institutions to Collaborate More
King, S. R. F. (2024) · Exchanges The Interdisciplinary Research Journal · doi:10.31273/eirj.v11i3.1519
No Peeking: Peer Review and Presumptive Blinding
Ballantyne, N., & Celniker, J. B. (2024) · Canadian Journal of Philosophy · doi:10.1017/can.2024.25 · Cited by 1
“After all, discussions of blinding practices often emphasize that an author ’ s identity or name could be biasing (Huber et al., 2022; Largent & Snodgrass, 2016; Weller, 2001, chapter 7).”
Goh, J. X. (2024) · doi:10.31234/osf.io/p9gxr · Cited by 1
Evaluating Use of Evidence in U.S. State Governments: A Conjoint AnalysisPreprint
Xu, C., Yuan, C., Wang, S., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4693327 · Cited by 1
Impact of peer review type and editor gender on women authorships in mathematics
Lozano, G. I., MacArthur, K. R., & Barr, B. (2024) · Quantitative Science Studies · doi:10.1162/qss_a_00318 · Cited by 1
“Yet, both experimental (Huber et al., 2022) and data-backed studies continue to suggest the practice may substantially enhance equity and diversity in particular scientific disciplines or contexts, including medicine (Okike et al., 2016) and computer science (Seeber & Bacchelli, 2017; Tomkins et…”
BackgroundDelphi and consensus in science: necessary reflections
Rebustini, F. (2024) · Geriatrics Gerontology and Aging · doi:10.53886/gga.e000edt2_en · Cited by 2
Delphi e o consenso nas ciências: reflexões necessárias
Rebustini, F. (2024) · Geriatrics Gerontology and Aging · doi:10.53886/gga.e000edt2_pt · Cited by 1
Chen, C., Zhang, J., Ye, T., Roth, D., & Zhang, B. (2024) · Journal of Causal Inference · doi:10.1515/jci-2023-0052 · Cited by 3
On the state of financial research: Is it in a silo?
Azad, A. S. M. S., Chazi, A., Khallaf, A., & Zantout, Z. Z. (2023) · Accounting and Finance · doi:10.1111/acfi.13210 · Cited by 1
Nobel begets Nobel in economics
Tol, R. S. J. (2023) · Journal of Informetrics · doi:10.1016/j.joi.2023.101457 · Cited by 2
Can Our Claims be Verified? Open Science Practices in Information Systems ResearchPreprint
Parry, D. A. (2022) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/u295h · Cited by 1
Tactical Refereeing and Signaling by PublishingPreprint
Popov, S. V. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4166875 · Cited by 1
Müller, S., Okasa, G., Strinzel, M., Jorstad, A., Milzow, K., & Egger, M. (2026) · PLoS ONE · doi:10.1371/journal.pone.0352900
Krumsvik, R. J., & Johansen, M. O. (2026) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2026.1874986
The Consequences of Peer Review Bias for Academic Careers and the Progress of SciencePreprint
Watve, M. (2026) · Qeios · doi:10.32388/pqixfw.2
Open science, closed peer review?
Charness, G., Dreber, A., Evans, D., Gill, A., & Toussaert, S. (2026) · Journal of the Economic Science Association · doi:10.1017/esa.2026.10030
“𝜕 b ( r , t ) 𝜕 r > 0 implies more favorable reviews for influential authors due to, e.g., status bias (Huber et al., 2022) or expected reciprocity/retaliation.”
Nilius, H., Kuster, L., Boss, R., Boschetti, L., Mihalek, N., Ferreira, A. S., Naas, S., Jegerlehner, S. N., Largiadèr, C. R., NAKAS, C., et al. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112270
Research Productivity of Behavior-Analytic Programs and Faculty: An Update
Kranak, M. P., Shawler, L. A., Andzik, N. R., Kroll, H., Horning, M., & Perez, N. (2026) · Behavior Analysis in Practice · doi:10.1007/s40617-026-01168-y
Metadata
- Authors
- Huber, J., Inoua, S., Kerschbamer, R., König-Kersting, C., Palan, S., & Smith, V. L.
- Affiliations
- Universität Innsbruck (AT)
- Chapman University (US)
- University of Graz (AT)
- Corresponding author
- Huber, Jürgen
- Smith, Vernon L.
- ORCID
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2022-10-04
- Volume
- 119
- Issue
- 41
- Pages
- e2205779119-e2205779119
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC9564227
- OpenAlex
- W4301374049
- Cited by
- 148
- References
- 25
- Citations by year
- 2026: 23 · 2025: 37 · 2024: 37 · 2023: 38 · 2022: 12
- FWCI
- 28.47
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by)
- SSRN Electronic Journal (publishedVersion)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Chapman University Digital Commons (Chapman University) (submittedVersion)
- Funders
- Austrian Science Fund (F63)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- peer review, double-blind review, single-blind review, early-career researchers, Nobel laureates, research credit, publication bias
- MeSH terms
- Humans, Peer Review, Research Personnel, Writing, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.