The DOI matches its Crossref record; 50 of the 51 references it cites were found in a registry or an index.
Registered Reports: A Method to Increase the Credibility of Published Results
Open accessAbstract
Ignoring replications and negative results is bad for science. This special issue presents a novel publishing format – Registered Reports – as a partial solution. Peer review occurs prior to data collection, design and analysis plans are preregistered, and results are reported regardless of outcome. Fourteen Registered Reports of replications of important published results in social psychology are reported with strong confirmatory tests. Further, the articles demonstrate open science practices such as open data, open materials, and disclosure of research process, conflicts of interest, and contributions. The credibility of published science will increase with cultural shifts that accept replications and negative results as viable research outcomes, and when transparency and reproducibility are part of standard research practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Akin to the approach taken for clinical trials, protocol registration has emerged as a mechanism that is likely to improve the transparency of animal research [232,237,238].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [238]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Registered Reports (RRs) are designed to address these biases and improve the quality of research 1-3 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“Registered Reports were conceived to alter the incentives for authors and journals away from producing novel, positive, clean findings and toward conducting and publishing rigorous research on important questions 1-3 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“Therefore, not finding a predicted effect in a large study may indicate more about the likelihood that an effect is true than finding a predicted effect in a small study , because the former is statistically less likely if an effect is true (Button et al., 2013; Lakens & Evers, in press).”
BackgroundSelf-citationJournal of social behavior and personality
(1986) · Personality and Individual Differences · doi:10.1016/0191-8869(86)90025-5 · Cited by 6,706
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Journal of The American Statistical Association
Fienberg, S. E. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,125
At what sample size do correlations stabilize?
Schönbrodt, F. D., & Perugini, M. (2013) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.05.009 · Cited by 2,232 · cited 1×
“At the same time, effects size estimates in small samples – common in original research – can vary considerably and are more likely to elicit an exaggerated effect size than results from larger sample sizes (Schçnbrodt & Perugini, 2013).”
ResultHARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Investigating Variation in Replicability: A “Many Labs” Replication Project
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., et al. (2014) · Social Psychology · doi:10.1027/1864-9335/a000178 · Cited by 1,208 · cited 1×
“Finally, Many Labs replication project (Klein et al., 2014) was a large international collaboration that amassed 36 samples and 6,344 participants to assess variation in rep-licability across samples and settings of 13 effects.”
BackgroundSelf-citationShall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
Schmidt, S. (2009) · Review of General Psychology · doi:10.1037/a0015108 · Cited by 1,125 · cited 1×
“A direct replication is the attempt to duplicate the conditions and procedure that existing theory and evidence anticipate as necessary for obtaining the effect (Open Science Collaboration, 2012, 2013; Schmidt, 2009).”
BackgroundAn Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042 · cited 2×
“Confirmatory results follow a preregistered analysis plan and thereby ensure interpretability of the reported p -values (Wagenmakers et al., 2012).”
Background
Research works printed but not linked: 3
- 10.1027/1864-9335/a000184 · DOI
- Neuliep J. W., 1993, Journal of Social Behavior and Personality, 8, 21
- Open Science Collaboration, 2013, Implementing reproducible computational research (a volume in the r series)
Cited by
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
“Direct replication is the attempt to recreate the conditions believed sufficient for obtaining a previously observed finding ( 7 , 8 ) and is the means of establishing reproducibility of a finding with new data.”
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Self-citationReporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677
The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998
“io/rr/) is offered by dozens of journals to facilitate preregistration (59, 60).”
BackgroundSelf-citationChoosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,916
“This appreciation is most evident in the numerous recent calls for routine preregistration of studies (Chambers & Munafo, 2013; Nosek & Lakens, 2014), where a sharp distinction is to be drawn between the exploratory (where flexibility is encouraged) and confirmatory (where flexibility is denied)…”
BackgroundResult
Metadata
- Authors
- Nosek, B. A., & Lakens, D.
- Affiliations
- Center for Open Science (US)
- Eindhoven University of Technology (NL)
- Venue
- Social Psychology
- Publisher
- Hogrefe Publishing Group
- Published
- 2014-05-01
- Volume
- 45
- Issue
- 3
- Pages
- 137-141
- ISSN
- 1864-9335 (ISSN-L)
- 2151-2590
- OpenAlex
- W2113085067
- Cited by
- 716
- References
- 51
- Citations by year
- 2026: 31 · 2025: 44 · 2024: 48 · 2023: 52 · 2022: 71 · 2021: 87 · 2020: 124 · 2019: 65 · 2018: 66 · 2017: 46 · 2016: 33 · 2015: 30 · 2014: 18
- FWCI
- 58.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Social Psychology (publishedVersion, cc-by-nc-nd)
- TU/e Research Portal (submittedVersion, other-oa)
- TU/e Research Portal (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- preregistration, replication, negative results, open science, research transparency, reproducibility, peer review, research credibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Registered Reports: A Method to Increase the Credibility of Published Results. https://app.cochat.ai/papers/10.1027/1864-9335/a000192
- The paper
- Nosek, B. A., & Lakens, D. (2014). Registered Reports: A Method to Increase the Credibility of Published Results. Social Psychology. https://doi.org/10.1027/1864-9335/a000192
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.