The Registered Reports Revolution Lessons in Cultural Reform
Abstract
The rise of the “registered report” – a type of research article that is reviewed and accepted before results are known – offers lessons for the current debate surrounding p-values and significance. By Chris Chambers
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Registered Reports are designed to address biases in the standard publishing model and improve the quality of research.
“Registered Reports (RRs) are designed to address these biases and improve the quality of research 1-3 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [2]
Registered Reports were conceived to alter the incentives for authors and journals away from producing novel, positive, clean findings and toward conducting and publishing rigorous research on important questions.
“Registered Reports were conceived to alter the incentives for authors and journals away from producing novel, positive, clean findings and toward conducting and publishing rigorous research on important questions 1-3 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [2]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The ASA Statement on <i>p</i> -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306 · see citing works
Scientists rise up against statistical significance
Amrhein, V., Greenland, S., & McShane, B. (2019) · Nature · doi:10.1038/d41586-019-00857-9 · Cited by 2,983 · see citing works
Redefine statistical significance
Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0189-z · Cited by 2,772 · see citing works
Self-citationBayesian inference for psychology. Part II: Example applications with JASP
Wagenmakers, E., Love, J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Selker, R., Gronau, Q. F., Dropmann, D., boutin, B., et al. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1323-7 · Cited by 1,705 · see citing works
Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications
Wagenmakers, E., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Love, J., Selker, R., Gronau, Q. F., Šmíra, M., Epskamp, S., et al. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1343-3 · Cited by 1,652 · see citing works
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301 · see citing works
Abandon Statistical Significance
McShane, B. B., Gal, D., Gelman, A., Robert, C. P., & Tackett, J. L. (2019) · The American Statistician · doi:10.1080/00031305.2018.1527253 · Cited by 852 · see citing works
Open science challenges, benefits and tips in early career and beyond
Allen, C., & Mehler, D. M. A. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000246 · Cited by 608 · see citing works
Lakens, D., Adolfi, F., Albers, C. J., Anvari, F., Apps, M. A. J., Argamon, S., Baguley, T. S., Becker, R. B., Benning, S. D., Bradford, D. E., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0311-x · Cited by 472 · see citing works
Abandon Statistical SignificancePreprint
McShane, B. B., Gal, D., Gelman, A., Robert, C. P., & Tackett, J. L. (2019) · HAL · Cited by 449 · see citing works
Wasserstein, R., & Lazar, N. A. (2016) · Figshare · doi:10.6084/m9.figshare.3085162 · Cited by 348 · see citing works
Redefine statistical significancePreprint
Benjamin, D. J., Berger, J., Johannesson, M., Nosek, B. A., Wagenmakers, E., Berk, R. A., Bollen, K. A., Brembs, B., Brown, L., Camerer, C. F., et al. (2017) · doi:10.31234/osf.io/mky9j · Cited by 247 · see citing works
Self-citationScientific Utopia: II. Restructuring incentives and practices to promote truth over publishabilityPreprint
Nosek, B. A., Spies, J. R., & Motyl, M. S. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.4251 · Cited by 199 · see citing works
Mapping the universe of registered reports
Hardwicke, T. E., & Ioannidis, J. P. A. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0444-y · Cited by 147 · see citing works
Improving the Efficiency of Grant and Journal Peer Review: Registered Reports Funding
Munafo, M. R. (2017) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntx081 · Cited by 34 · see citing works
Protocol transparency is vital for registered reports
Chambers, C. D., & Mellor, D. T. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0449-6 · Cited by 20 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Soderberg, C. K., Errington, T. M., Schiavone, S. R., Bottesini, J., Thorn, F. S., Vazire, S., Esterling, K. M., & Nosek, B. A. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01142-4 · Cited by 289 · see citing works
- Authors
- Chambers, C.
- Affiliations
- Cardiff University (GB)
- Corresponding author
- Chambers, Chris
- ORCID
- Chambers, Chris
- Venue
- Significance
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-07-24
- Volume
- 16
- Issue
- 4
- Pages
- 23-27
- ISSN
- 1740-9705 (ISSN-L)
- 1740-9713
- OpenAlex
- W2962813562
- Cited by
- 43
- References
- 16
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2023: 4 · 2022: 4 · 2021: 12 · 2020: 12 · 2019: 4
- FWCI
- 9.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Significance (publishedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- pre-registered study, p-values, statistical significance, scholarly publishing, research integrity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
