CoChat

Improving the Efficiency of Grant and Journal Peer Review: Registered Reports Funding

Open access
Munafò, Marcus R. · 2017 · Nicotine & Tobacco Research
Cited by 34

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Abstract

Peer review—the process whereby scientific research is evaluated by independent experts within the field—remains a cornerstone of scientific research, and acts as a critical gatekeeper in relation to both grant funding and publication.1 However, as the scientific community grows and the number of journals proliferates, the burden of peer review has grown considerably. At the same time, the ongoing debate around reproducibility and waste in research has identified non-publication of “unexciting” (ie, null) results and the incentive structures that promote the publication of novel, eye-catching findings that convey a clean narrative, as major contributors to the poor reproducibility of much biomedical research.2 In recent years, Nicotine & Tobacco Research has introduced a number of innovations intended to improve the quality and robustness of the work we publish,3,4 and has also adopted the Transparency and Openness in Reporting guidelines.5 One proposed solution intended to improve the quality of published research is the Registered Reports model,6 which was created in 2013 and to date has been adopted by 50 journals (see https://cos.io/rr/). In contrast to conventional research articles, publishing decisions for Registered Reports are based on the importance of the research question and the methods proposed to answer that question. Critically, this decision is made before data collection has begun. This has the important advantage of reducing opportunity and incentives for biased research practices (eg, leveraging analytical flexibility to achieve statistical “significance”), raising standards of methodological disclosure and statistical power, and avoiding publication bias (by offering in principle acceptance before the results are known). Nicotine & Tobacco Research recently announced that it would accept Registered Report submissions, with a particular focus on attempts to replicate important findings in the field.7 However, we are also keen to explore other innovations in how science is conducted that may improve the efficiency and quality of scientific research. To this end, with Cancer Research UK—a large UK-based non-profit funder—we are piloting an extension of the Registered Reports model that integrates the model into the grant funding process. In this two-stage process, the funder first decides on whether or not to fund a project, based on a conventional grant application. An editor from Nicotine & Tobacco Research will be co-opted into this process, and grants recommended for funding will then passed on to us. In the second stage, the applicants submit a more detailed protocol for consideration as a Registered Report. The editor who was co-opted into the grant review process will oversee the review of the protocol, using the same reviewers who reviewed the grant. The advantage of this is that those reviewers will already be familiar with the material, and the incremental effort required will therefore be modest. Moreover, they will be able to be constructively critical at this stage in a way that is less likely in the current funding climate where any critical comment may be perceived as likely to undermine a grant that one would otherwise like to see funded. Combining grant funding and publication decisions into a single, two-stage process promises to dramatically reduce the burden on reviewers, and also serve to reduce questionable research practices and publication bias. It therefore will benefit several stages of the research process (in particular publication and reporting, but also design and conduct). Working in partnership with Cancer Research UK’s Tobacco Advisory Group to pilot this model, we hope to demonstrate that the model is feasible and acceptable to our community of researchers. We are confident that this process will reduce research waste considerably. Obviously the extent of this reduction will depend on the uptake of this model, and this may take several years. However, the fact that we have secured one partnership willing to pilot the model is, in our opinion, an extremely important first step. We are confident that other partnerships will coalesce following this initial pilot.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/ntr/ntx081

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Cited by

See all 34

Metadata

Authors
Munafò, M. R.
Venue
Nicotine & Tobacco Research
Published
2017-04-06
Volume
19
Issue
7
Pages
773-773
ISSN
  • 1462-2203 (ISSN-L)
  • 1469-994X
OpenAlex
W2604630507
Cited by
34
References
3
FWCI
7.88
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Improving the Efficiency of Grant and Journal Peer Review: Registered Reports Funding. https://app.cochat.ai/papers/10.1093/ntr/ntx081
The paper
Munafò, M. R. (2017). Improving the Efficiency of Grant and Journal Peer Review: Registered Reports Funding. Nicotine & Tobacco Research. https://doi.org/10.1093/ntr/ntx081

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.