Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 208 of the 208 references it cites were found in a registry or an index.

The replication crisis has led to positive structural, procedural, and community changes

Open access

Abstract

The emergence of large-scale replication projects yielding successful rates substantially lower than expected caused the behavioural, cognitive, and social sciences to experience a so-called ‘replication crisis’. In this Perspective, we reframe this ‘crisis’ through the lens of a credibility revolution, focusing on positive structural, procedural and community-driven changes. Second, we outline a path to expand ongoing advances and improvements. The credibility revolution has been an impetus to several substantive changes which will have a positive, long-term impact on our research environment.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s44271-023-00003-2

Cites

208 of 208 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Modes of change towards scientific credibility. This figure presents an overview of the three modes of change proposed in this article: structural change is often evoked at the institutional level and expressed by new norms and rules; procedural change refers to behaviours and sets of commonly used practices in the research process; community change encompasses how work and collaboration within the scientific community evolves.
Fig. 1 Modes of change towards scientific credibility. This figure presents an overview of the three modes of change proposed in this article: structural change is often evoked at the institutional level and expressed by new norms and rules; procedural change refers to behaviours and sets of commonly used practices in the research process; community change encompasses how work and collaboration within the scientific community evolves.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 204 references

Research works printed but not linked: 10

  1. Azevedo, F. et al. Introducing a framework for open and reproducible research training (FORRT). Preprint at https://osf.io/bnh7p/ (2019). This paper describes the importance of integrating open scholarship into higher education, its benefits and challenges, as well as about FORRT initiatives aiming to support educators in this endeavor.
  2. Pownall, M. et al. The impact of open and reproducible scholarship on students’ scientific literacy, engagement, and attitudes towards science: a review and synthesis of the evidence. Roy. Soc. Open Sci., 10, 221255 (2023). This review article describes the available (empirical) evidence of the impact (and importance) of integrating open scholarship into higher education, its benefits and challenges on three specific areas: students’ (a) scientific literacy; (b) engagement with science; and (c) attitudes towards science.
  3. Elife. https://elifesciences.org/for-the-press/b2329859/elife-ends-accept-reject-decisions-following-peer-review (2023).
  4. Higgins, J. P. et al. Cochrane Handbook for Systematic Reviews of Interventions (John Wiley & Sons, 2022).
  5. Humphreys, L., Lewis Jr, N. A., Sender, K. & Won, A. S. Integrating qualitative methods and open science: five principles for more trustworthy research. J. Commun. 71, 855–874 (2021).
  6. Bergmann, C. How to integrate open science into language acquisition research? Student workshop at BUCLD 43 (2018).
  7. Candela, A. G. Exploring the function of member checking. Qual. Rep. 24, 619–628 (2019).
  8. Checchi, D., De Fraja, G. & Verzillo, S. Incentives and careers in academia: theory and empirical analysis. Rev. Econ. Stat. 103, 786–802 (2021).
  9. Grove, L. The Effects of Funding Policies on Academic Research. Ph.D. thesis, University College London (2017).
  10. Devezer, B. & Buzbas, E. Minimum viable experiment to replicate (2021). Preprint at http://philsci-archive.pitt.edu/21475/.

Cited by

See all 137

Metadata

Authors
Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., Elsherif, M., Breznau, N., Robertson, O., Kalandadze, T., Yu, S., Baker, B. J., O’Mahony, A., Olsnes, J. Ø. S., Shaw, J. J., Gjoneska, B., Yamada, Y., Röer, J. P., Murphy, J., Alzahawi, S., Grinschgl, S., Oliveira, C. M., Wingen, T., Yeung, S. K., Liu, M., König, L. M., Albayrak-Aydemir, N., Lecuona, O., Micheli, L., & Evans, T.
Affiliations
  • Oslo University Hospital (NO)
  • Aston University (GB)
  • Essen University Hospital (DE)
  • University of Leeds (GB)
  • Ashland University (US)
  • University of Birmingham (GB)
  • University of Bremen (DE)
  • University of Oxford (GB)
  • Østfold University of Applied Sciences (NO)
  • Temple University (US)
  • Cardiff University (GB)
  • Norwegian University of Science and Technology (NO)
  • De Montfort University (GB)
  • Macedonian Academy of Sciences and Arts (MK)
  • Kyushu University (JP)
  • Witten/Herdecke University (DE)
  • Technological University Dublin (IE)
  • Stanford University (US)
  • University of Graz (AT)
  • University of York (GB)
  • University of Bonn (DE)
  • Chinese University of Hong Kong (HK)
  • University of Cambridge (GB)
  • University of Bayreuth (DE)
  • Universidad Rey Juan Carlos (ES)
  • University of Greenwich (GB)
Venue
Communications Psychology
Published
2023-07-25
Volume
1
Issue
1
Pages
3-3
ISSN
2731-9121 (ISSN-L)
OpenAlex
W4385240232
Cited by
137
References
204
Citations by year
2026: 36 · 2025: 64 · 2024: 27 · 2023: 10
FWCI
5.80
Type
journal article
Language
en
Open access
Licence
Locations
  • Communications Psychology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Leiden Repository (Leiden University) (publishedVersion, cc-by)
  • Edge Hill University Research Information Repository (Edge Hill University) (publishedVersion, cc-by)
  • ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion, other-oa)
  • Open Research Online (The Open University) (acceptedVersion, other-oa)
  • London School of Economics and Political Science Research Online (London School of Economics and Political Science) (acceptedVersion, other-oa)
  • University of Birmingham Research Portal (University of Birmingham) (submittedVersion, other-oa)
  • Leiden Repository (Leiden University) (submittedVersion, cc-by)
  • NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
Keywords
replication crisis, credibility revolution, replication study, research credibility, research practices

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The replication crisis has led to positive structural, procedural, and community changes. https://app.cochat.ai/papers/10.1038/s44271-023-00003-2
The paper
Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., Elsherif, M., Breznau, N., Robertson, O., Kalandadze, T., Yu, S., Baker, B. J., O’Mahony, A., Olsnes, J. Ø. S., Shaw, J. J., Gjoneska, B., Yamada, Y., Röer, J. P., Murphy, J., . . . Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. Communications Psychology. https://doi.org/10.1038/s44271-023-00003-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.