Protocol transparency is vital for registered reports
Open accessPublished version of a preprint
Abstract
Hardwicke, T. E. & Ioannidis, J. P. A. Nat. Hum. Behav . https://doi.org/10.1038/s41562-018-0444-y (2018). Goldacre, B. et al. The COMPare Trials Project http://compare-trials.org/ (2016). Registered reports template editorial policy. Center for Open Science https://osf.io/pukzy/ (2018). Simple registered report protocol preregistration. Center for Open Science http://osf.io/rr/ (2018). Registered reports: policy on publishing at stage 1 and stage 2. Wiley https://authorservices.wiley.com/author-resources/Journal-Authors/submission-peer-review/registered-reports-policy.html (2018). Hummer, L., Nosek, B. & Errington, T. Preprint at https://doi.org/10.31219/osf.io/5y8w7 (2018). Scheel, A. M., Henderson, E., Chambers, C. & Lakens, D. Assessment of effect sizes and the prevalence of “positive” results in RRs and preregistered studies. Center for Open Science https://osf.io/zyhf6/ (2018). Murray, H. Transparency meets transparency. F1000Research Blog https://blog.f1000com/2017/10/12/transparency-meets-transparency/ (2017). Munafò, M. R. Nicotine Tob. Res. 19 , 773 (2017). Article Google Scholar News and announcements. GRAND Awards Program http://www.grandawardsprogram.org/news/news-and-announcements.html (2017). First funding cycle of the Drug Discovery Initiative Registered Report (DDIRR) Awards announced. Children’s Tumor Foundation http://www.ctf.org/news/first-funding-cycle-of-the-ddirr-awards-announced (2018). Tan, F. E., Perfito, N. & Lomax, J. Prostate Cancer Foundation — Movember Foundation Reproducibility Initiative. Center for Open Science https://osf.io/ih9qt/ (2018). Download references
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The maximum attainable power is heavily influenced by the effect size and the proportion of the random variation due to the between-article variance.
“the maximum attainable power is heavily influenced on the effect size and the proportion of the random variation due to the between-article variance 35”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [35]
Cites
Mapping the universe of registered reports
Hardwicke, T. E., & Ioannidis, J. P. A. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0444-y · Cited by 147 · see citing works
Improving the Efficiency of Grant and Journal Peer Review: Registered Reports Funding
Munafo, M. R. (2017) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntx081 · Cited by 34 · see citing works
Evaluating Registered Reports: A Naturalistic Comparative Study of Article Impact
Hopun, L. T., Singleton Thorn, F., Nosek, B. A., & Errington, T. M. (2017) · doi:10.31219/osf.io/5y8w7 · Cited by 29 · see citing works
Prostate Cancer Foundation-Movember Foundation Reproducibility InitiativePreprint
Tan, F. E., Perfito, N., & Lomax, J. (2015) · OSF Preprints (OSF Preprints) · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The past, present and future of Registered Reports
Chambers, C. D., & Tzavella, L. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01193-7 · Cited by 499 · see citing works
Self-citationSoderberg, C. K., Errington, T. M., Schiavone, S. R., Bottesini, J., Thorn, F. S., Vazire, S., Esterling, K. M., & Nosek, B. A. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01142-4 · Cited by 289 · see citing works
The Value of Preregistration for Psychological Science: A Conceptual AnalysisPreprint
Lakens, D. (2019) · doi:10.31234/osf.io/jbh4w · Cited by 130 · see citing works
Calibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98 · see citing works
Making ERP research more transparent: Guidelines for preregistration
Paul, M., Govaart, G., & Schettino, A. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.02.016 · Cited by 66 · see citing works
Wyatt, T. D. (2020) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2019.0262 · Cited by 50 · see citing works
Ten simple rules for good research practice
Schwab, S., Janiaud, P., Dayan, M., Amrhein, V., Panczak, R., Palagi, P. M., Hemkens, L. G., Ramon, M., Rothen, N., Senn, S. J., et al. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010139 · Cited by 48 · see citing works
The Registered Reports Revolution Lessons in Cultural Reform
Chambers, C. (2019) · Significance · doi:10.1111/j.1740-9713.2019.01299.x · Cited by 43 · see citing works
Self-citationOpening the Door to Registered Reports: Census of Journals Publishing Registered Reports (2013–2020)
Montoya, A. K., Krenzer, W. L. D., & Fossum, J. L. (2021) · Collabra Psychology · doi:10.1525/collabra.24404 · Cited by 22 · see citing works
Shaw, S. R., & Pecsi, S. (2021) · Psychology in the Schools · doi:10.1002/pits.22537 · Cited by 10 · see citing works
Science in flux: Registered reports and beyond at the <i>European Journal of Neuroscience</i>
Chambers, C. D., Forstmann, B., & Pruszynski, J. A. (2019) · European Journal of Neuroscience · doi:10.1111/ejn.14319 · Cited by 8 · see citing works
Self-citationLiu, H., Yang, X., Shao, W., & Yu, X. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10062-y · Cited by 7 · see citing works
Opening Doors to Open Science and Scholarship for School Psychology Research, Training, and PracticePreprint
Roberson, A. J., Farmer, R. L., Shaw, S. R., Upton, S. R., & Zaheer, I. (2020) · doi:10.31234/osf.io/su53p · Cited by 3 · see citing works
NSF Science of Science Proposal: Randomized Trial of Registered ReportsPreprint
Nosek, B. A., Mellor, D. T., Errington, T. M., Soderberg, C. K., Krall, T., Grasty, F. L., Brooks, R. E., Davis, R., Kousta, S. T., Swaminathan, S., et al. (2020) · doi:10.31222/osf.io/jvxab · Cited by 3 · see citing works
Self-citationSilva, F. M., Adegboye, A. R. A., Curioni, C. C., Gomes, F. D. S., Collins, P. G. S., Kac, G., Cook, J. A., Ismail, L. C., Page, M. J., Khandpur, N., et al. (2023) · medRxiv · doi:10.1101/2023.06.08.23291109 · Cited by 3 · see citing works
Strengthening the Evidence Base in Suicide Prevention
Pirkis, J. (2020) · Crisis · doi:10.1027/0227-5910/a000693 · Cited by 2 · see citing works
Silva, F. M., Adegboye, A. R. A., Naude, C. E., Curioni, C. C., Gomes, F. D. S., Collins, P. G. S., Kac, G., de Beyer, J. A., Cook, J. A., Ismail, L. C., et al. (2025) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2025.01.016 · Cited by 1 · see citing works
Ten simple rules for good research practicePreprint
Schwab, S., Janiaud, P., Dayan, M., Amrhein, V., Panczak, R., Palagi, P. M., Hemkens, L. G., Ramon, M., Rothen, N., Senn, S. J., et al. (2021) · doi:10.31219/osf.io/am5ck · Cited by 1 · see citing works
How Researchers Use Open SciencePreprint
Permut, S., Saccardo, S., & Chapman, G. B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4838469
Advancing Mental Health Equity Through Policies
Yang, Y. T. (2024) · doi:10.1002/9781394263752.ch11
- Authors
- Chambers, C. D., & Mellor, D. T.
- Affiliations
- Center for Open Science (US)
- ORCID
- Mellor, David T.
- Venue
- Nature Human Behaviour
- Published
- 2018-10-01
- Volume
- 2
- Issue
- 11
- Pages
- 791-792
- ISSN
- 2397-3374 (ISSN-L)
- OpenAlex
- W2893262294
- Cited by
- 20
- References
- 4
- Citations by year
- 2025: 2 · 2024: 2 · 2023: 1 · 2022: 1 · 2021: 6 · 2020: 4 · 2019: 3 · 2018: 1
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- Locations
- Nature Human Behaviour (publishedVersion)
- PubMed (publishedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- protocol transparency, preregistration, research reproducibility, research integrity, open science
- MeSH terms
- Registries
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
