Grants Peer Review in Theory and Practice
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Grants peer review is a family of ex ante methods used by federal agencies to select research proposalsforfunding. This article draws on Chubin and Hackett's 1990 book, Peerless Science: Peer Review and U.S. Science Policy, to examine both the assumptions and theory underlying peer review as an evaluation methodology and the issues that arise in the operation of peer-based systems at the National Science Foundation (NSF) and the National Institutes of Health (NIH). The article discusses criticisms of peer review, the various criteria that agencies must balance in interpreting evaluations of expert peers, and outstanding issues to be addressed in the refinement and reform of peer review systems. The article concludes with suggestions on how to redress the shortcomings of peer review in decision making, especially the allocation of scarce public monies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chance and Consensus in Peer Review
Cole, S., Cole, J. R., & Simon, G. A. (1981) · Science · doi:10.1126/science.7302566 · Cited by 623 · cited 1×
“Evidence indicates that chance, for example, who is selected to review a research proposal, plays a key role in peer-based decision making (Cole, Cole, and Simon 1981).”
Background
Cited by
Predictive effects of structural variation on citation counts
Chen, C. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21694 · Cited by 312
Marsh, H. W., Jayasinghe, U. W., & Bond, N. W. (2008) · American Psychologist · doi:10.1037/0003-066x.63.3.160 · Cited by 299
“In psychology departments and other academic settings, peer review is used to evaluate grant proposals, journal submissions, job applications, promotions, tenure, monographs, textbooks, doctoral theses, doctoral and postdoctoral applications, and other academic products (Bornmann & Daniel, 2005; Chubin, 1994; Cicchett…”
BackgroundMarsh, H. W., Bornmann, L., Mutz, R., Daniel, H.-D., & O’Mara, A. (2009) · Review of Educational Research · doi:10.3102/0034654309334143 · Cited by 174
Bias in Research Grant Evaluation Has Dire Consequences for Small Universities
Murray, D. L., Morris, D., Lavoie, C., Leavitt, P. R., MacIsaac, H., Masson, M. E. J., & Villard, M.-A. (2016) · PLOS ONE · doi:10.1371/journal.pone.0155876 · Cited by 87
Peer review in the funding of research in higher education: The Australian experience
Jayasinghe, U. W., Marsh, H. W., & Bond, N. (2001) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737023004343 · Cited by 58
“theses, and a variety of other academic products (Chubin, 1994; Cicchetti, 199 a, 1991b).”
BackgroundInfluential
Metadata
- Authors
- Chubin, D. E.
- Venue
- Evaluation Review
- Publisher
- SAGE Publications
- Published
- 1994-02
- Volume
- 18
- Issue
- 1
- Pages
- 20-30
- ISSN
- 0145-4692 (ISSN-L)
- 0193-841X
- 1552-3926
- OpenAlex
- W1995897266
- Cited by
- 51
- References
- 1
- FWCI
- 11.89
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Grants Peer Review in Theory and Practice. https://app.cochat.ai/papers/10.1177/0193841x9401800103
- The paper
- Chubin, D. E. (1994). Grants Peer Review in Theory and Practice. Evaluation Review. https://doi.org/10.1177/0193841x9401800103
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.