The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Research Funding: the Case for a Modified Lottery
Open accessAbstract
The time-honored mechanism of allocating funds based on ranking of proposals by scientific peer review is no longer effective, because review panels cannot accurately stratify proposals to identify the most meritorious ones. Bias has a major influence on funding decisions, and the impact of reviewer bias is magnified by low funding paylines. Despite more than a decade of funding crisis, there has been no fundamental reform in the mechanism for funding research. This essay explores the idea of awarding research funds on the basis of a modified lottery in which peer review is used to identify the most meritorious proposals, from which funded applications are selected by lottery. We suggest that a modified lottery for research fund allocation would have many advantages over the current system, including reducing bias and improving grantee diversity with regard to seniority, race, and gender.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720
Knee-deep in the big muddy: a study of escalating commitment to a chosen course of action
Staw, B. M. (1976) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(76)90005-2 · Cited by 2,061
Diagnosing the decline in pharmaceutical R&D efficiency
Scannell, J. W., Blanckley, A., Boldon, H., & Warrington, B. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3681 · Cited by 1,981
Expert political judgment: how good is it? how can we know?
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3634 · Cited by 1,260 · cited 1×
“In this regard, the University of Pennsylvania psychologist Philip Tetlock showed that experts not only fared poorly in attempting to predict the future but also overrated their own abilities to do so (15).”
Principles for allocation of scarce medical interventions
Persad, G., Wertheimer, A., & Emanuel, E. J. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60137-9 · Cited by 929
Chance and Consensus in Peer Review
Cole, S., Cole, J. R., & Simon, G. A. (1981) · Science · doi:10.1126/science.7302566 · Cited by 623 · cited 1×
“found that the odds of a proposal submitted to the National Science Foundation (NSF) getting funded were largely based on chance—the chance that specific reviewers would be chosen (26).”
Gender differences in grant peer review: A meta-analysis
BORNMANN, L., MUTZ, R., & DANIEL, H. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2007.03.001 · Cited by 337
Marsh, H. W., Jayasinghe, U. W., & Bond, N. W. (2008) · American Psychologist · doi:10.1037/0003-066x.63.3.160 · Cited by 299 · cited 1×
“An analysis of applications to the Australian Research Council found interrater reliability for reviews to be poor (12), and researchers in Finland did not find that the reliability of grant peer review is improved by panel discussions (13).”
Big names or big ideas: Do peer-review panels select the best science proposals?
Li, D., & Agha, L. (2015) · Science · doi:10.1126/science.aaa0185 · Cited by 227
Reforming Science: Methodological and Cultural Reforms
Casadevall, A., & Fang, F. C. (2012) · Infection and Immunity · doi:10.1128/iai.06183-11 · Cited by 156 · cited 1×
“However, this low-yield endeavor has consistently improved the lot of humanity since the scientific revolution of the 17th century and remains humanity’s best bet for finding solutions to deal with such challenges as climate change, pandemics and disease, a faltering green revolution, and the need for new energy sourc…”
Self-citation
Cited by
Edwards, M. A., & Roy, S. (2017) · Environmental Engineering Science · doi:10.1089/ees.2016.0223 · Cited by 688
Low agreement among reviewers evaluating the same NIH grant applications
Pier, E. L., Brauer, M., Filut, A., Kaatz, A., Raclaw, J., Nathan, M. J., Ford, C. E., & Carnes, M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1714379115 · Cited by 210
Grant writing and grant peer review as questionable research practices
Conix, S., De Block, A., & Vaesen, K. (2021) · F1000Research · doi:10.12688/f1000research.73893.1 · Cited by 23
Metadata
- Authors
- Fang, F. C., & Casadevall, A.
- Venue
- mBio
- Publisher
- American Society for Microbiology
- Published
- 2016-05-04
- Volume
- 7
- Issue
- 2
- Pages
- e00422-16
- ISSN
- 2150-7511 (ISSN-L)
- 2161-2129
- OpenAlex
- W2337901800
- Cited by
- 160
- References
- 12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Research Funding: the Case for a Modified Lottery. https://app.cochat.ai/papers/10.1128/mbio.00422-16
- The paper
- Fang, F. C., & Casadevall, A. (2016). Research Funding: the Case for a Modified Lottery. mBio. https://doi.org/10.1128/mbio.00422-16
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.