The best time to argue about what a replication means? Before you do it

Registered Reports: A Method to Increase the Credibility of Published Results

Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716 · see citing works

What is replication?

Nosek, B. A., & Errington, T. M. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000691 · Cited by 401 · see citing works

An open investigation of the reproducibility of cancer biology research

Errington, T. M., Iorns, E., Gunn, W., Tan, F. E., Lomax, J., & Nosek, B. A. (2014) · eLife · doi:10.7554/elife.04333 · Cited by 312 · see citing works

What’s next for Registered Reports?

Chambers, C. (2019) · Nature · doi:10.1038/d41586-019-02674-6 · Cited by 154 · see citing works

Experiences of collaborative research

Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.723 · Cited by 149 · see citing works

The effect of horizontal eye movements on free recall: A preregistered adversarial collaboration.

Matzke, D., Nieuwenhuis, S., van Rijn, H., Slagter, H. A., van der Molen, M. W., & Wagenmakers, E. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000038 · Cited by 114 · see citing works

Scientists’ Reputations Are Based on Getting It Right, Not Being Right

Ebersole, C. R., Axt, J. R., & Nosek, B. A. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002460 · Cited by 67 · see citing works

Adversarial alignment enables competing models to engage in cooperative theory building toward cumulative science

Ellemers, N., Fiske, S. T., Abele, A. E., Koch, A. S., & Yzerbyt, V. Y. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1906720117 · Cited by 54 · see citing works

A Replication Attempt of Stereotype Susceptibility ()

Gibson, C. E., Losee, J. E., & Vitiello, C. A. (2014) · Social Psychology · doi:10.1027/1864-9335/a000184 · Cited by 52 · see citing works

A Secondary Replication Attempt of Stereotype Susceptibility ()

Moon, A., & Roeder, S. S. (2014) · Social Psychology · doi:10.1027/1864-9335/a000193 · Cited by 32 · see citing works

Replication of the Superstition and Performance Study by

Calin-Jageman, R. J., & Caldwell, T. L. (2014) · Social Psychology · doi:10.1027/1864-9335/a000190 · Cited by 27 · see citing works

Replication Study: Inhibition of BET recruitment to chromatin as an effective treatment for MLL-fusion leukaemia

Shan, X., Fung, J. J., Kosaka, A. H., Danet-Desnoyers, G. A., & Reproducibility Project: Cancer Biology (2017) · eLife · doi:10.7554/elife.25306 · Cited by 18 · see citing works

Registered report: Inhibition of BET recruitment to chromatin as an effective treatment for MLL-fusion leukemia

Fung, J. J., Kosaka, A. H., Shan, X., Danet-Desnoyers, G. A., Gormally, M. V., Owen, K. A., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.08997 · Cited by 11 · see citing works

Replicability, Robustness, and Reproducibility in Psychological Science

Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., et al. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-114157 · Cited by 770 · see citing works

Investigating the replicability of preclinical cancer biology

Errington, T. M., Mathur, M., Soderberg, C. K., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.71601 · Cited by 393 · see citing works

Challenges for assessing replicability in preclinical cancer biology

Errington, T. M., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.67995 · Cited by 323 · see citing works

Initial evidence of research quality of registered reports compared with the standard publishing model

Soderberg, C. K., Errington, T. M., Schiavone, S. R., Bottesini, J., Thorn, F. S., Vazire, S., Esterling, K. M., & Nosek, B. A. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01142-4 · Cited by 289 · see citing works

#EEGManyLabs: Investigating the replicability of influential EEG experiments

Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C., Beste, C., Bland, A. R., Bradford, D. E., Bublatzky, F., Busch, N. A., et al. (2021) · Cortex · doi:10.1016/j.cortex.2021.03.013 · Cited by 136 · see citing works

Many Labs 4: Failure to Replicate Mortality Salience Effect With and Without Original Author Involvement

Klein, R. A., Cook, C. L., Ebersole, C. R., Vitiello, C., Nosek, B. A., Hilgard, J., Ahn, P. H., Brady, A. J., Chartier, C. R., Christopherson, C. D., et al. (2022) · Collabra Psychology · doi:10.1525/collabra.35271 · Cited by 193 · see citing works

<scp>CMM</scp>—An enhanced platform for interactive validation of metal binding sites

Gucwa, M., Lenkiewicz, J., Zheng, H., Cymborowski, M., Cooper, D. R., Murzyn, K., & Minor, W. (2023) · Protein Science · doi:10.1002/pro.4525 · Cited by 69 · see citing works

Improving preclinical studies through replications

Drude, N., Martinez‐Gamboa, L., Danziger, M., Dirnagl, U., & Toelch, U. (2021) · eLife · doi:10.7554/elife.62101 · Cited by 54 · see citing works

Strategic ambiguity in the social sciences

Frankenhuis, W. E., Panchanathan, K., & Smaldino, P. E. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9923 · Cited by 56 · see citing works

Understanding Replication in a Way That Is True to Science

Haig, B. D. (2021) · Review of General Psychology · doi:10.1177/10892680211046514 · Cited by 33 · see citing works

Epidemiological characteristics and prevalence rates of research reproducibility across disciplines: A scoping review of articles published in 2018-2019

Cobey, K. D., Fehlmann, C. A., Franco, M. C., Ayala, A. P., Sikora, L., Rice, D. B., Xu, C., Ioannidis, J. P. A., Lalu, M. M., Ménard, A., et al. (2023) · eLife · doi:10.7554/elife.78518 · Cited by 24 · see citing works

Effects of selective attention on the C1 ERP component: A systematic review and meta‐analysis

Qin, N., Wiens, S., Rauss, K. S., & Pourtois, G. (2022) · Psychophysiology · doi:10.1111/psyp.14123 · Cited by 24 · see citing works

Center for Open Science: Strategic PlanPreprint

Nosek, B. A., Shaw, L. C., Errington, T. M., Pfeiffer, N., & Zaringhalam, M. (2017) · doi:10.31219/osf.io/x2w9h · Cited by 28 · see citing works

#EEGManyLabs: Investigating the Replicability of Influential EEG ExperimentsPreprint

Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C., Beste, C., Bland, A. R., Bradford, D. E., Bublatzky, F., Busch, N. A., et al. (2020) · Cortex; a journal devoted to the study of the nervous system and behavior · doi:10.31234/osf.io/528nr · Cited by 25 · see citing works

Ideas and perspectives: When ocean acidification experiments are not the same, repeatability is not tested

Williamson, P. C., Pörtner, H., Widdicombe, S., & Gattuso, J. (2021) · Biogeosciences · doi:10.5194/bg-18-1787-2021 · Cited by 21 · see citing works

Doing better leadership science via replications and registered reports

Carsten, M. K., Clapp‐Smith, R., Haslam, S. A., Bastardoz, N., Gooty, J., Connelly, S., & Spain, S. M. (2023) · The Leadership Quarterly · doi:10.1016/j.leaqua.2023.101712 · Cited by 22 · see citing works

How failure to falsify in high-volume science contributes to the replication crisis

Rajtmajer, S. M., Errington, T. M., & Hillary, F. G. (2022) · eLife · doi:10.7554/elife.78830 · Cited by 16 · see citing works

CheckMyMetal ( CMM ): validating metal-binding sites in X-ray and cryo-EM data

Gucwa, M., Bijak, V., Zheng, H., Murzyn, K., & Minor, W. (2024) · IUCrJ · doi:10.1107/s2052252524007073 · Cited by 15 · see citing works

Sharing the Recipe: Reproducibility and Replicability in Research Across Disciplines

Rahal, R.-M., Hamann, H., Brohmer, H., & Pethig, F. (2022) · Research Ideas and Outcomes · doi:10.3897/rio.8.e89980 · Cited by 14 · see citing works

Effects of the Generic Masculine and Its Alternatives in Germanophone Countries: A Multi-Lab Replication and Extension of Stahlberg, Sczesny, and Braun (2001)

Brohmer, H., Hofer, G., Bauch, S. A., Beitner, J., Berkessel, J. B., Corcoran, K., García, D., Gruber, F. M., Giuliani, F., Jauk, E., et al. (2024) · International Review of Social Psychology · doi:10.5334/irsp.522 · Cited by 13 · see citing works

Strategic ambiguity in the social sciencesPreprint

Frankenhuis, W. E., Panchanathan, K., & Smaldino, P. E. (2022) · doi:10.31222/osf.io/kep5b · Cited by 12 · see citing works

A framework for assessing the trustworthiness of scientific research findings

Nosek, B. A., Allison, D. B., Jamieson, K. H., Mcnutt, M. K., Nielsen, A. B., & Wolf, S. M. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2536736123 · Cited by 11 · see citing works

Evidence for goal‐ and mixed evidence for false belief‐based action prediction in 2‐ to 4‐year‐old children: A large‐scale longitudinal anticipatory looking replication study

Kaltefleiter, L. J., Schuwerk, T., Wiesmann, C. G., Kristen, S., Jarvers, I., & Sodian, B. (2021) · Developmental Science · doi:10.1111/desc.13224 · Cited by 8 · see citing works

Establishing ground truth in the traumatic brain injury literature: if replication is the answer, then what are the questions?

Priestley, D. R., Staph, J., Koneru, S., Rajtmajer, S. M., Cwiek, A. P., Vervoordt, S. M., & Hillary, F. G. (2022) · Brain Communications · doi:10.1093/braincomms/fcac322 · Cited by 7 · see citing works

Direct Replication in Psychological Assessment Research

Allen, M. S., Iliescu, D., & Greiff, S. (2023) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000755 · Cited by 4 · see citing works

How open science can benefit bilingualism research: A lesson in six tales

Ben, R. D., Brouillard, M., Gonzalez‐Barrero, A. M., Killam, H., Kremin, L. V., Quirk, E., Sander‐Montant, A., Schott, E., Tsui, R. K. Y., & Byers‐Heinlein, K. (2022) · Bilingualism Language and Cognition · doi:10.1017/s1366728922000256 · Cited by 4 · see citing works

Can failure be made productive also in Bayesian reasoning? A conceptual replication study

Loibl, K., & Leuders, T. (2024) · Instructional Science · doi:10.1007/s11251-024-09670-y · Cited by 3 · see citing works

Science, misinformation and digital technology during the Covid-19 pandemic

Astobiza, A. M. (2021) · History & Philosophy of the Life Sciences · doi:10.1007/s40656-021-00424-4 · Cited by 3 · see citing works

Code sharing and reproducibility in survey-based social research: evidence from a large-scale audit

Krähmer, D., Schächtele, L., & Auspurg, K. (2026) · Royal Society Open Science · doi:10.1098/rsos.251997 · Cited by 2 · see citing works

Interdisciplinary perspectives on ethics and integrity in Europe: acknowledging differences to foster mutual understanding

Spyrakou, E., Kavouras, P., Markakis, V., Rami, M. B., & Charitidis, C. A. (2022) · Policy Press eBooks · doi:10.51952/9781447363972.ch005 · Cited by 2 · see citing works

Voicing Disagreement in Science: Missing Women

Klinowski, D. (2023) · The Review of Economics and Statistics · doi:10.1162/rest_a_01322 · Cited by 2 · see citing works

Resistance to Critiques in the Academic Literature: An Example from Physics Education Research

Reichhardt, C. M., Small, A., Nisoli, C., & Reichhardt, C. J. O. (2023) · European Review · doi:10.1017/s1062798723000352 · Cited by 2 · see citing works

Focus (on) replication: Focus processing in L1 and L2 English using the fidelity, refinement, and exploratory extension (FiREE) replication framework

Bramlett, A. A., & Wiener, S. (2025) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2025.100275 · Cited by 1 · see citing works

A proposal to advance theory and promote collaboration in tropical biology by supporting replications

Bruna, E. M., Chazdon, R. L., Errington, T. M., & Nosek, B. A. (2021) · Biotropica · doi:10.1111/btp.12912 · Cited by 1 · see citing works

How often are replication attempts questioned?

Hensel, P. G. (2023) · Accountability in Research · doi:10.1080/08989621.2023.2198126 · Cited by 1 · see citing works

New Year, New Initiatives for the Journal of Sex Research

Sakaluk, J. K., & Graham, C. A. (2022) · The Journal of Sex Research · doi:10.1080/00224499.2022.2032571 · Cited by 1 · see citing works

Replication

Hirschhorn, R., & Schönberg, T. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-820480-1.00014-0 · Cited by 1 · see citing works

Reply to SC3 (McCoy)

Williamson, P. (2021) · Biogeosciences · doi:10.5194/bg-2020-394-ac3

Response by Dichek to Letter Regarding Article, “Jugular Vein Injection of High-Titer Lentiviral Vectors Does Not Transduce the Aorta”

Dichek, D. A. (2021) · Arteriosclerosis Thrombosis and Vascular Biology · doi:10.1161/atvbaha.121.315965

Reply to RC2

Williamson, P. (2021) · Biogeosciences · doi:10.5194/bg-2020-394-ac6

Dissociation Between Speech and Emotion Effects in Short-Term Memory: A Data Reanalysis.

Wiens, S. (2021) · Meta-Psychology · doi:10.15626/mp.2019.1635

Five takeaways from Mitchell’s Artificial Intelligence: A guide for to thinking humansPreprint

Ho, T. M. (2020) · doi:10.31219/osf.io/9svk3

Năm điều rút ra từ cuốn sách Trí tuệ nhân tạo: Hướng dẫn về tư duy con ngườiPreprint

Ho, T. M. (2021) · doi:10.31219/osf.io/tc453

Ethical research in public policy

Spicker, P. (2022) · Policy Press eBooks · doi:10.2307/j.ctv2tbwqd5.12

Ethical research in public policy

Spicker, P. (2022) · Policy Press eBooks · doi:10.56687/9781447363972-010

Effects of the Generic Masculine and its Alternatives in Germanophone countries - A Multi-lab Replication and Extension of Stahlberg, Sczesny, and Braun, 2001Preprint

Brohmer, H., Hofer, G., Bauch, S. A., Beitner, J., Berkessel, J. B., Corcoran, K., García, D., Gruber, F. M., Giuliani, F., Jauk, E., et al. (2024) · doi:10.31219/osf.io/q56rk

Trends of replication studies in Applied Linguistics journals: A systematic review over half a century

Marefat, F., Farahanynia, M., Hamidi, F., Najjarpour, M., Banitalebi, Z., & Alamdar, P. (2025) · Canadian Journal of Applied Linguistics · doi:10.37213/cjal.2024.33477

Evidence for goal‐ and mixed evidence for false belief‐based action prediction in 2‐ to 4‐year‐old children: A large‐scale longitudinal anticipatory looking replication studyPreprint

Sodian, B., Schuwerk, T., Kristen, S., Kaltefleiter, L. J., Jarvers, I., & Wiesmann, C. G. (2022) · OSF Preprints (OSF Preprints)

Beyond Advocacy: A Design Space for Replication-Related Studies

Liang, Y., Marriot, K., & Purchase, H. C. (2026) · Eurographics · doi:10.2312/10.2312/evs.20261001

The importance of exact conceptual replications

Petty, R. E. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000821 · Cited by 6 · see citing works

Replication studies in engineering design – a feasibility study

Rode, J., Jonuschies, I., Matthiesen, S., & Gericke, K. (2024) · Proceedings of the Design Society · doi:10.1017/pds.2024.14 · Cited by 1 · see citing works

Executing and writing up your replication study

Porte, G. K., & McManus, K. (2018) · Routledge eBooks · doi:10.4324/9781315621395-7

Reply to commentary on designing research with in-built differentiated replication

Uncles, M., & Kwok, S. (2012) · Journal of Business Research · doi:10.1016/j.jbusres.2012.05.007 · Cited by 5 · see citing works