Preregistration of exploratory research: Learning from the golden age of discovery
Open accessThe DOI matches its Crossref record; 9 of the 10 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Preregistration of study protocols and, in particular, Registered Reports are novel publishing formats that are currently gaining substantial traction. Besides rating the research question and soundness of methodology over outstanding significance of the results, they can help with antagonizing inadequate statistical power, selective reporting of results, undisclosed analytic flexibility, as well as publication bias. Preregistration works well when a clear hypothesis, primary outcome, and mode of analysis can be formulated. But is it also applicable and useful in discovery research, which develops theories and hypotheses, measurement techniques, and generates evidence that justifies further research? I will argue that only slight modifications are needed to harness the potential of preregistration and make exploratory research more trustworthy and useful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In disciplines beyond clinical trials, preregistration has yet to become standard practice.”
From Open Science 2.0: Towards a truly collaborative research ecosystem (2023) · cites this paper as [44]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“in preclinical research, one of the main registries has only 161 registrations as of September 2023 [42–44].”
From Open Science 2.0: Towards a truly collaborative research ecosystem (2023) · cites this paper as [44]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robust research needs many lines of evidence
Munafò, M. R., & Davey Smith, G. (2018) · Nature · doi:10.1038/d41586-018-01023-3 · Cited by 666
Distinguishing between exploratory and confirmatory preclinical research will improve translation
Kimmelman, J., Mogil, J. S., & Dirnagl, U. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001863 · Cited by 236 · cited 1×
“Exploration develops theories and hypotheses, measurement techniques, and generates evidence that justifies further research or selects a manageable number of interventions to carry forward [5].”
BackgroundSelf-citationTracking the popularity and outcomes of all bioRxiv preprints
Abdill, R. J., & Blekhman, R. (2019) · eLife · doi:10.7554/elife.45133 · Cited by 196 · cited 1×
“About one third of preprints posted at Biorxiv never get published in a peer-reviewed journal [3].”
BackgroundWhat’s next for Registered Reports?
Chambers, C. (2019) · Nature · doi:10.1038/d41586-019-02674-6 · Cited by 154
Strech, D., & Dirnagl, U. (2019) · BMJ Open Science · doi:10.1136/bmjos-2018-000048 · Cited by 120
Self-citationAssessing Value in Biomedical Research: The PQRST of Appraisal and Reward
Ioannidis, J. P. A., & Khoury, M. J. (2014) · JAMA · doi:10.1001/jama.2014.6932 · Cited by 92
The past, present, and future of Registered ReportsPreprint
Chambers, C., & Tzavella, L. (2020) · doi:10.31222/osf.io/43298 · Cited by 63
Open laboratory notebooks: good for science, good for society, good for scientists
Schapira, M., & Harding, R. (2019) · F1000Research · doi:10.12688/f1000research.17710.2 · Cited by 47
Rethinking research reproducibility
Dirnagl, U. (2019) · The EMBO Journal · doi:10.15252/embj.2018101117 · Cited by 35
Self-citationWhat should a modern scientific infrastructure look like?
Brembs, B. (2015) · doi:10.59350/nw4ky-36005 · Cited by 1
Research works printed but not linked: 3
- ASAPbio. Preprint info center [Internet]. San Francisco: ASAPbio. [cited 11 Feb 2020]. https://asapbio.org/preprint-info
- C Chambers, 2020, Registered Reports: Past, Present and Future, MetaArXiv
- A Gelman, 2013, The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time
Cited by
Exploratory research in sport and exercise science: Perceptions, challenges, and recommendations
Ditroilo, M., Mesquida, C., Abt, G., & Lakens, D. (2025) · Journal of Sports Sciences · doi:10.1080/02640414.2025.2486871 · Cited by 135
The benefits of preregistration and Registered Reports
Lakens, D., Mesquida, C., Rasti, S., & Ditroilo, M. (2024) · Evidence-Based Toxicology · doi:10.1080/2833373x.2024.2376046 · Cited by 104
Open Science 2.0: Towards a truly collaborative research ecosystem
Thibault, R. T., Amaral, O. B., Argolo, F., Bandrowski, A. E., Davidson, A. R., & Drude, N. I. (2023) · PLOS Biology · doi:10.1371/journal.pbio.3002362 · Cited by 72
Making ERP research more transparent: Guidelines for preregistration
Paul, M., Govaart, G., & Schettino, A. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.02.016 · Cited by 71
Biosecurity in an age of open science
Smith, J. A., & Sandbrink, J. B. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001600 · Cited by 64
Metadata
- Authors
- Dirnagl, U.
- Affiliations
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin (DE)
- Corresponding author
- Dirnagl, Ulrich
- ORCID
- Dirnagl, Ulrich
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-03-26
- Volume
- 18
- Issue
- 3
- Pages
- e3000690
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC7098547
- OpenAlex
- W3013367531
- Cited by
- 81
- References
- 9
- Citations by year
- 2026: 7 · 2025: 10 · 2024: 8 · 2023: 13 · 2022: 23 · 2021: 15 · 2020: 4
- FWCI
- 13.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- preregistration, exploratory research, discovery research, hypothesis generation, statistical power, selective reporting, publication bias, research transparency, research trustworthiness
- MeSH terms
- Humans, Publishing, Research Design, Peer Review, Research, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.