Improving the Efficiency of Grant and Journal Peer Review: Registered Reports Funding
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Peer review—the process whereby scientific research is evaluated by independent experts within the field—remains a cornerstone of scientific research, and acts as a critical gatekeeper in relation to both grant funding and publication.1 However, as the scientific community grows and the number of journals proliferates, the burden of peer review has grown considerably. At the same time, the ongoing debate around reproducibility and waste in research has identified non-publication of “unexciting” (ie, null) results and the incentive structures that promote the publication of novel, eye-catching findings that convey a clean narrative, as major contributors to the poor reproducibility of much biomedical research.2 In recent years, Nicotine & Tobacco Research has introduced a number of innovations intended to improve the quality and robustness of the work we publish,3,4 and has also adopted the Transparency and Openness in Reporting guidelines.5 One proposed solution intended to improve the quality of published research is the Registered Reports model,6 which was created in 2013 and to date has been adopted by 50 journals (see https://cos.io/rr/). In contrast to conventional research articles, publishing decisions for Registered Reports are based on the importance of the research question and the methods proposed to answer that question. Critically, this decision is made before data collection has begun. This has the important advantage of reducing opportunity and incentives for biased research practices (eg, leveraging analytical flexibility to achieve statistical “significance”), raising standards of methodological disclosure and statistical power, and avoiding publication bias (by offering in principle acceptance before the results are known). Nicotine & Tobacco Research recently announced that it would accept Registered Report submissions, with a particular focus on attempts to replicate important findings in the field.7 However, we are also keen to explore other innovations in how science is conducted that may improve the efficiency and quality of scientific research. To this end, with Cancer Research UK—a large UK-based non-profit funder—we are piloting an extension of the Registered Reports model that integrates the model into the grant funding process. In this two-stage process, the funder first decides on whether or not to fund a project, based on a conventional grant application. An editor from Nicotine & Tobacco Research will be co-opted into this process, and grants recommended for funding will then passed on to us. In the second stage, the applicants submit a more detailed protocol for consideration as a Registered Report. The editor who was co-opted into the grant review process will oversee the review of the protocol, using the same reviewers who reviewed the grant. The advantage of this is that those reviewers will already be familiar with the material, and the incremental effort required will therefore be modest. Moreover, they will be able to be constructively critical at this stage in a way that is less likely in the current funding climate where any critical comment may be perceived as likely to undermine a grant that one would otherwise like to see funded. Combining grant funding and publication decisions into a single, two-stage process promises to dramatically reduce the burden on reviewers, and also serve to reduce questionable research practices and publication bias. It therefore will benefit several stages of the research process (in particular publication and reporting, but also design and conduct). Working in partnership with Cancer Research UK’s Tobacco Advisory Group to pilot this model, we hope to demonstrate that the model is feasible and acceptable to our community of researchers. We are confident that this process will reduce research waste considerably. Obviously the extent of this reduction will depend on the uptake of this model, and this may take several years. However, the fact that we have secured one partnership willing to pilot the model is, in our opinion, an extremely important first step. We are confident that other partnerships will coalesce following this initial pilot.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Modelling the effects of subjective and objective decision making in scientific peer review
Park, I.-U., Peacey, M. W., & Munafò, M. R. (2014) · Nature · doi:10.1038/nature12786 · Cited by 103
Cited by
The past, present and future of Registered Reports
Chambers, C. D., & Tzavella, L. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01193-7 · Cited by 499
Marsden, E., Morgan‐Short, K., Thompson, S., & Abugaber, D. (2018) · Language Learning · doi:10.1111/lang.12286 · Cited by 268
What’s next for Registered Reports?
Chambers, C. (2019) · Nature · doi:10.1038/d41586-019-02674-6 · Cited by 154
The Replication Crisis Has Led to Positive Structural, Procedural, and Community Changes
Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., Elsherif, M., Breznau, N., Robertson, O., Kalandadze, T., et al. (2023) · Communications Psychology · doi:10.1038/s44271-023-00003-2 · Cited by 137
“Evaluation of researchers in academic settings has historically been focused on the quantity of papers they publish in high-impact journals 45 , despite criticism of the impact factor metric 71 , and their ability to secure grants 85,92 .”
BackgroundThe Registered Reports Revolution Lessons in Cultural Reform
Chambers, C. (2019) · Significance · doi:10.1111/j.1740-9713.2019.01299.x · Cited by 43
Metadata
- Authors
- Munafò, M. R.
- Venue
- Nicotine & Tobacco Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-04-06
- Volume
- 19
- Issue
- 7
- Pages
- 773-773
- ISSN
- 1462-2203 (ISSN-L)
- 1469-994X
- OpenAlex
- W2604630507
- Cited by
- 34
- References
- 3
- FWCI
- 7.88
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Improving the Efficiency of Grant and Journal Peer Review: Registered Reports Funding. https://app.cochat.ai/papers/10.1093/ntr/ntx081
- The paper
- Munafò, M. R. (2017). Improving the Efficiency of Grant and Journal Peer Review: Registered Reports Funding. Nicotine & Tobacco Research. https://doi.org/10.1093/ntr/ntx081
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.