The DOI matches its Crossref record; 256 of the 256 references it cites were found in a registry or an index.
Replicability, Robustness, and Reproducibility in Psychological Science
Open accessPublished version of a preprint
Abstract
Replication—an important, uncommon, and misunderstood practice—is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings and observed surprising failures to replicate many published findings. Replication efforts highlighted sociocultural challenges such as disincentives to conduct replications and a tendency to frame replication as a personal attack rather than a healthy scientific practice, and they raised awareness that replication contributes to self-correction. Nevertheless, innovation in doing and understanding replication and its cousins, reproducibility and robustness, has positioned psychology to improve research practices and accelerate progress.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By using a common approach to analyze data from multiple informants, time points, and developmental domains, we can address concerns about the robustness of scientific findings (20,21).”
From A Comprehensive Multilevel Analysis of the Bucharest Early Intervention Project: Causal Effects on Recovery From Early Severe Deprivation (2023) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In psychology, across 307 systematic replications and multisite replications, 64% reported statistically significant evidence in the same direction and effect sizes 68% as large as the original experiments”
From Investigating the replicability of preclinical cancer biology (2021) · cites this paper as Nosek et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research into replicability in other disciplines has also found that findings with stronger initial evidence (such as larger effect sizes and/or smaller p-values) is more likely to replicate”
From Investigating the replicability of preclinical cancer biology (2021) · cites this paper as Nosek et al., 2021
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Independent verification is central to the scientific method (Nosek et al., 2022).”
From Read the Paper, Write the Code: Agentic Reproduction of Social-Science Results (2026) · cites this paper as Nosek et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“A substantial proportion of replications in recent largescale efforts have failed to support the original finding (Nosek et al., 2022).”
From Many Labs 4: Failure to Replicate Mortality Salience Effect With and Without Original Author Involvement (2022) · cites this paper as Nosek et al., 2022
In the citing paper
“This means that even when updates address and mitigate detected biases, they also introduce the potential for “process reproducibility failure” (98) in the generated data and impede reproducibility, critical for scientific rigor (15, 100, 101).”
From Perils and opportunities in using large language models in psychological research (2024) · cites this paper as [98]
In the citing paper
“However, particular challenges arise when applying these principles to LLMs, particularly proprietary ones, whose black-box nature impedes the reproducibility of findings that pertain to them.”
From Perils and opportunities in using large language models in psychological research (2024) · cites this paper as [98]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,559
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
(2002) · Cited by 13,211
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Self-citation
Research works printed but not linked: 17
- Artner R, 2020, Psychol. Methods.
- Cent. Open Sci, 2020, Center for Open Science
- Cohen J., 1973, Am. Educ. Res. J., 10, 225
- 10.1037/0033-2909.112.1.155 · DOI · Paper page
- Crisp RJ, 2014, Soc. Psychol., 45, 303
- Epskamp S, 2018, Statistical Software
- Errington TM, 2021, eLife
- Ferguson MJ, 2014, Soc. Psychol., 45, 301
- Gelman A, 2013, The garden of forking paths: why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time
- Marcus A, 2020, WIRED
- Meyer MN, 2014, Slate Magazine
- Mischel W., 2008, APS Observer
- Nosek B., 2019, Center for Open Science
- Nosek B., 2019, Center for Open Science
- Schwarz N, 2014, Soc. Psychol., 45, 305
- Sterling TD., 1959, J. Am. Stat. Assoc., 54, 30
- Yong E, 2012, National Geo-graphic
Cited by
Sorted by citations
Items 501–600 of 772
Dwa głosy o kryzysie wiarygodności w psychologii
Białek, A., & Wolski, P. (2023) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.9455 · Cited by 1
The status quo, challenges, and recommendations of pre-registration in psychological science
Jiawei, Z. H. A. O., Tao, X. I. A., & Chuan-Peng, H. (2024) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2024.00715 · Cited by 2
Persönlichkeit in Alltag, Wissenschaft und Praxis
Neyer, F. J., & Asendorpf, J. B. (2024) · Springer eBooks · doi:10.1007/978-3-662-67385-0_1 · Cited by 2
Seda, L., Martins, I. T. C., Lisbôa, T. L. R. D. C., Batistuzzo, M. C., & Fatori, D. (2024) · Collabra Psychology · doi:10.1525/collabra.122158 · Cited by 4
Shaw, S. R., & Kang, Y. H. (2024) · Canadian Journal of School Psychology · doi:10.1177/08295735241272689 · Cited by 1
Løhre, E., Høstaker, M., & Hoprekstad, Ø. L. (2024) · Social Psychological Bulletin · doi:10.32872/spb.12875 · Cited by 1
Witte, E. H., & Ponocny, I. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1377336 · Cited by 2
Itzkovich, Y. (2024) · Current Psychology · doi:10.1007/s12144-024-06792-x · Cited by 1
The fundamentals of AI ethics in medical imaging
Amann, J., Bürger, V. K., Livne, M., Bui, C. K. T., & Madai, V. I. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-323761-4.00010-9 · Cited by 3
Proulx, J. D. E., Castaneto, K. K., Cash, T. A., & Aknin, L. B. (2025) · Discover Psychology · doi:10.1007/s44202-025-00327-6 · Cited by 1
Gerpheide, K., Bierwirth, P., Unterschemmann, S., Panitz, C., Gross, J. J., & Mueller, E. M. (2025) · Biological Psychology · doi:10.1016/j.biopsycho.2025.109040 · Cited by 1
Revisiting the psychology of waste: Replication and extensions Registered Report of Arkes (1996)
Zhu, Z., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.250367
A Tutorial on Representational Similarity Analysis for Research in Social Cognition
Xie, S. Y., Zheng, R., Lin, C., & Hehman, E. (2025) · Social Cognition · doi:10.1521/soco.2025.43.3.167 · Cited by 1
Introducing the Journal Editors Discussion Interface
Bottesini, J. G., Silverstein, P., Karcher, S., & Elman, C. (2025) · IASSIST Quarterly · doi:10.29173/iq1146 · Cited by 1
Ding, K., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.250669
Expanding the toolbox: 25 years of methodological change in infant research
Alessandroni, N., Fibla, L., Díaz, M. G., Gong, X., Killam, H., Pérez, M. L., Moore, C., Paquette, A., Sander‐Montant, A., & Byers‐Heinlein, K. (2025) · Infant Behavior and Development · doi:10.1016/j.infbeh.2025.102105 · Cited by 1
Bajraktari, R., Booth, F., Munafo, M. R., & Beazley‐Long, N. (2025) · F1000Research · doi:10.12688/f1000research.161819.2
Whamond, A., Vazire, S., Clarke, B., Moodie, N., Schiavone, S. R., Thibault, R. T., & Hardwicke, T. E. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251366102 · Cited by 1
Self-citationIntroduction to the Special Series: Examining the Special Education Research Base
Cook, B. G., & Therrien, W. J. (2025) · Remedial and Special Education · doi:10.1177/07419325251379789 · Cited by 1
The “‘Crisis’ Crisis” in psychology
Medaglia, J. D., & Fernandez, K. A. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000364 · Cited by 1
McGann, M. (2022) · Adaptive Behavior · doi:10.1177/10597123221094360 · Cited by 1
Open Science in der deutschsprachigen Sportpsychologie
Englert, C., & Klatt, S. (2023) · Zeitschrift für Sportpsychologie · doi:10.1026/1612-5010/a000404
La inclusión de métodos y relaciones deductivas para fortalecer la teoría en ciencias sociales
Hernández, N. A. N. (2024) · Euphyía - Revista de Filosofía · doi:10.33064/33euph6525 · Cited by 1
New Year, New Initiatives for the Journal of Sex Research
Sakaluk, J. K., & Graham, C. A. (2022) · The Journal of Sex Research · doi:10.1080/00224499.2022.2032571 · Cited by 1
Hiraishi, K., & Nakamura, D. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/r72vt · Cited by 1
Open Science in Developmental SciencePreprint
Gennetian, L. A., Frank, M. C., & Tamis‐LeMonda, C. S. (2022) · doi:10.31234/osf.io/uqjf9 · Cited by 1
Priestley, D. R., Staph, J., Koneru, S., Rajtmajer, S. M., & Hillary, F. G. (2022) · doi:10.31234/osf.io/rb32d · Cited by 1
Reproducibility in small-N treatment research: a tutorial using examples from aphasiologyPreprint
Cavanaugh, R., Quique, Y. M., Swiderski, A. M., Kallhoff, L., Terhorst, L. A., Wambaugh, J. L., Hula, W. D., & Evans, W. S. (2022) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/exyqp · Cited by 1
Analysis reproducibility in mental health research: challenges and solutionsPreprint
Botvinik‐Nezer, R., & Wager, T. D. (2022) · doi:10.31219/osf.io/ujnmp · Cited by 1
Lukács, G., Huber, N., Talypova, D., & Miccoli, M. R. (2023) · doi:10.31234/osf.io/rebqd · Cited by 1
Publication Bias in Psychology
Kühberger, A. (2023) · Oxford University Press eBooks · doi:10.1093/obo/9780199828340-0307 · Cited by 2
Hirschhorn, R., & Schönberg, T. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-820480-1.00014-0 · Cited by 1
Hitsuwari, J., & Nomura, M. (2023) · Research Square · doi:10.21203/rs.3.rs-2713826/v1 · Cited by 1
Zanatta, A., Siew, J., der Paelt, S. V., Warreyn, P., & Roeyers, H. (2023) · doi:10.31234/osf.io/ey9zc · Cited by 1
Heino, M. T. J. (2023) · doi:10.31234/osf.io/qxa4n · Cited by 1
When expert predictions failPreprint
Grossmann, I., Varnum, M. E. W., Hutcherson, C. A. C., & Mandel, D. R. (2023) · doi:10.31234/osf.io/my24e · Cited by 1
Studying individual differences in experimental psychology: A tutorialPreprint
Brysbaert, M. (2023) · doi:10.31234/osf.io/e2hfc · Cited by 1
Black, M. H., Buitelaar, J. K., Charman, T., Ecker, C., Gallagher, L., Hens, K., Jones, E. J. H., Murphy, D., Schaer, M., Sadaka, Y., et al. (2023) · Research Square · doi:10.21203/rs.3.rs-3672113/v1 · Cited by 1
Replication of De Vries et al. (2015) - Perceptions of greenwashingPreprint
Løhre, E., Høstaker, M., & Hoprekstad, Ø. L. (2024) · doi:10.31234/osf.io/9d8g7 · Cited by 1
Issues in Grounded Cognition and how to solve them – The Minimalist AccountPreprint
Friedrich, J., Fischer, M. H., & Raab, M. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9wp8g · Cited by 2
Uncertainty, expertise, and persuasion: A replication and extension of Karmarkar and Tormala (2010)Preprint
Løhre, E., Chandrashekar, S. P., Mayiwar, L., & Hærem, T. (2024) · doi:10.31234/osf.io/gjxyh · Cited by 1
A Systematic Review of Aphantasia: Concept, Measurement, Neural Basis, and Theory DevelopmentPreprint
Jin, F., Hsu, S., & Li, Y. (2024) · Preprints.org · doi:10.20944/preprints202407.0680.v1 · Cited by 2
Editorial to special issue on direct replications in legal and criminological psychology
Meijer, E. H., & Verschuère, B. (2024) · Legal and Criminological Psychology · doi:10.1111/lcrp.12267 · Cited by 1
Hitsuwari, J., & Nomura, M. (2024) · Research Square · doi:10.21203/rs.3.rs-2713826/v3 · Cited by 1
Kutscher, T., Sengewald, M.-A. D.-P., Gnambs, T., Carstensen, C. H., & Aßmann, C. (2024) · Large-scale Assessments in Education · doi:10.1186/s40536-024-00221-y · Cited by 1
Noise Versus Signal: What Can One Conclude When a Classic Finding Fails to Replicate?
Cyrus-Lai, W., Tierney, W., & Uhlmann, E. L. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241268293 · Cited by 2
Mojtahedi, D. (2025) · Journal of Criminal Psychology · doi:10.1108/jcp-02-2025-137 · Cited by 1
Testing the Psychological Distinctiveness of Proscriptive and Prescriptive Moral NormsPreprint
Miles, A., Samim, Y., & Khan, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5500177 · Cited by 1
Robust and replicable effects of ageing on resting-state brain electrophysiology measured with MEGPreprint
Quinn, A. J., Pitt, J., Kohl, O., Gohil, C., van Es, M. W. J., Nobre, A. C., & Woolrich, M. W. (2025) · eLife · doi:10.7554/elife.108829 · Cited by 2
Stopping and Changing Expected and Unexpected MovementsPreprint
Weber, S., Vucak, N., Salomoni, S. E., Ross, A. J., Coleman, E., & Hinder, M. R. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.16.706101 · Cited by 1
Editorial Journal of Psycholinguistic Research
Brysbaert, M., & Folk, J. R. (2026) · Journal of Psycholinguistic Research · doi:10.1007/s10936-026-10208-1 · Cited by 1
Ambroise, C. (2024) · theses.fr (ABES) · doi:10.70675/d2529d35z93e6z4d60zb2c5z752d5f0edda3 · Cited by 1
Proulx, J., de Vondervoort, J. W. V., Hamlin, J. K., Helliwell, J. F., & Aknin, L. B. (2021) · doi:10.31234/osf.io/z7fra
The Pervasive Impact of IgnorancePreprint
Kirfel, L., & Phillips, J. (2022) · doi:10.31234/osf.io/xbrnj
Meier, M., Lonsdorf, T. B., LUPIEN, S. J., Tobias Stalder, A., Laufer, S., Sicorello, M., Linz, R., & Puhlmann, L. M. C. (2022) · doi:10.31234/osf.io/d2zvc
Jin, H. (2022) · doi:10.31234/osf.io/t5hv3 · Cited by 1
Grammatical Gender and Thought: A Partial Replication of Philips & Boroditsky (2003)Preprint
FINLEY, S. C., Arnold, S., Cao, T., Chorman, D., Deifel, M., Farrer, C., Kpobo, C., Menon, T. L., Sandoval, S., Schmidt, E. J., et al. (2022) · doi:10.31219/osf.io/ah8ct
Kim, I. K. (2022) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.21220838
Sadeh, Y., Denejkina, A., Karyotaki, E., et al. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr8
Sadeh, Y., Denejkina, A., Karyotaki, E., et al. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr10
Sadeh, Y., Denejkina, A., Karyotaki, E., et al. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr7
Sadeh, Y. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr6
Sadeh, Y., Denejkina, A., Karyotaki, E., et al. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr9
Sadeh, Y., Denejkina, A., Karyotaki, E., et al. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr5
Sadeh, Y., Denejkina, A., Karyotaki, E., et al. (2022) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr2
Sadeh, Y., Denejkina, A., Karyotaki, E., et al. (2022) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr3
Sadeh, Y., Denejkina, A., Karyotaki, E., et al. (2022) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr4
Sadeh, Y. (2022) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.7.pr1
Perfectionism, Goal Orientation, and Emerging Adults’ Identity Processing Styles
Rice, K. G., Lopez, F. G., & Wang, Q. (2023) · Emerging Adulthood · doi:10.1177/21676968231166715
Cognitive Metascience: A New Approach to the Study of TheoriesPreprint
Miłkowski, M. (2023) · doi:10.31234/osf.io/xvyz3
Transparency and Reproducibility in the Journal of Contextual Behavioral Science (preprint)Preprint
Lear, M. K., Spata, A., Tittler, M. V., Fishbein, J. N., Arch, J. J., & Luoma, J. B. (2023) · doi:10.31219/osf.io/ugcwd
Preprint_vanAert_etal_Covid19Preprint
van Aert, R. C. M., Nuijten, M. B., Olsson-Collentine, A., Stoevenbelt, A. H., van den Akker, O. R., Klein, R. A., & Wicherts, J. M. (2023) · doi:10.31234/osf.io/asbfd
Self-citationPrasad, N., & Yadav, B. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1236750
Spanos, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4508545
Verrina, E. (2023) · Journal of the Economic Science Association · doi:10.1007/s40881-023-00136-4 · Cited by 1
Veri Toplamaya Hala Gerek Var Mı? Yoksa Ulusal Pazarlama Akademisi HARKING Tehlikesi Altında Mı?
Doğan, V., VATANDAEŞ, T., & MIHOĞLU, B. A. (2023) · Tüketici ve tüketim araştırmaları dergisi · doi:10.15659/ttad.15.1.170
Znanstvena reforma i replikacijska kriza u psihologiji
Flis, I. (2023) · Psihologijske teme · doi:10.31820/pt.32.2.1 · Cited by 1
Cognitive Models of Intelligence and Information Processing
Haier, R. J., Colom, R., & Hunt, E. B. (2023) · Cambridge University Press eBooks · doi:10.1017/9781108569576.005
Martuza, J., & Aslan, E. (2023) · SSRN Electronic Journal · doi:10.31234/osf.io/nz2fy
Delfin, C. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1253452 · Cited by 7
Statistical reporting errors in economicsPreprint
Bruns, S. B., Herwartz, H., Ioannidis, J. P. A., Islam, C.-G., & Raters, F. H. C. (2023) · doi:10.31222/osf.io/mbx62
Re-assessing the role of operational definitions in psychologyPreprint
Kvam, P. D., & Alaukik, A. (2023) · doi:10.31234/osf.io/9tcd5
Toward open science in PLS-SEM: Assessing the state of the art and future perspectivesPreprint
Adler, S. J., Sharma, P. N., & Radomir, L. (2023) · doi:10.31219/osf.io/sbpe9
On prospective resilience methods and precision medicine approaches
Cosco, T. D., Best, J. R., & Hopper, S. (2023) · International Psychogeriatrics · doi:10.1017/s1041610223000972
A recipe for extremely reproducible enrichment analysis (and why we need it)Preprint
Bora, A., & Ziemann, M. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/r6kxg
Empirische Forschung und Theorie-Entwicklung
Eisend, M., & Kuß, A. (2023) · Springer eBooks · doi:10.1007/978-3-658-42690-3_9
Two Voices on the Credibility Crisis in Psychology
Białek, A., & Wolski, P. (2023) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.9679
Open Science in der deutschsprachigen Sportpsychologie
Englert, C., & Klatt, S. (2023) · Zeitschrift für Sportpsychologie · doi:10.1026/1612-5010/a000407
Waste Not Want Not: Computational Methods to Maximise Attendance in Group ResearchPreprint
Mayer, L., Bocheva, D., Hinds, J. M., Brown, O., Piwek, L., & Ellis, D. A. (2024) · doi:10.31234/osf.io/re9db
Are the Signs of Factor Loadings Arbitrary in Confirmatory Factor Analysis? Problems and SolutionsPreprint
Tang, D., Boker, S. M., & Tong, X. (2024) · doi:10.31219/osf.io/b7h6d
Brown, M., & Sacco, D. F. (2024) · Politics and the Life Sciences · doi:10.1017/pls.2023.28
The promise and pitfalls of studying the neurophysiological correlates of automatic imitationPreprint
Darda, K. M., & Ramsey, R. (2024) · doi:10.31234/osf.io/yfxdn
Questionable Metascience PracticesPreprint
Rubin, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4706575
Zanatta, A., Siew, J., der Paelt, S. V., Warreyn, P., & Roeyers, H. (2024) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-024-00437-2 · Cited by 2
Integration of Research into EMDR Practice
Osborne, A. K., Gates, J. R., Mann, E., & Wilson, G. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780192898357.013.41
Mandl, M. M., Hoffmann, S., Bieringer, S., Jacob, A. E., Kraft, M., Lemster, S., & Boulesteix, A. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011936
Opening Up: Interdisciplinary Guidance for Managing Open EcosystemsPreprint
Meluso, J., Chambers, C. R., Littauer, R., Llamas, N. A., Lingo, E. L., Mhangami, M., Pitt, B., Splitter, V., & Wang, H. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4821969
Metadata
- Authors
- Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., Rohrer, J. M., Romero, F., Scheel, A. M., Scherer, L. D., Schönbrodt, F. D., & Vazire, S.
- Affiliations
- Center for Open Science (US)
- University of Amsterdam (NL)
- University of Wisconsin–Madison (US)
- University of California, Davis (US)
- Grand Valley State University (US)
- Stockholm School of Economics (SE)
- The University of Melbourne (AU)
- Illinois State University (US)
- Center for Open Science, Charlottesville, Virginia 22903, USA
- Tilburg University (NL)
- Leipzig University (DE)
- University of Groningen (NL)
- Eindhoven University of Technology (NL)
- University of Colorado Anschutz (US)
- Ludwig-Maximilians-Universität München (DE)
- ORCID
- Venue
- Annual Review of Psychology
- Publisher
- Annual Reviews
- Published
- 2022-01-04
- Volume
- 73
- Issue
- 1
- Pages
- 719-748
- ISSN
- 0066-4308 (ISSN-L)
- 1545-2085
- OpenAlex
- W3161588210
- Cited by
- 770
- References
- 253
- Citations by year
- 2026: 109 · 2025: 192 · 2024: 180 · 2023: 177 · 2022: 92
- FWCI
- 19.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Annual Review of Psychology (publishedVersion)
- PubMed (publishedVersion)
- Research portal (Tilburg University) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- HAL (submittedVersion)
- Minerva Access (University of Melbourne) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, other-oa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Funders
- John Templeton Foundation
- Patient-Centered Outcomes Research Institute
- Arnold Ventures
- European Commission (HORIZON2020, 841188)
- University of Melbourne
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Templeton World Charity Foundation
- Templeton Religion Trust
- National Institutes of Health
- Agency for Healthcare Research and Quality
- Australian Research Council (FT150100297)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- replication, replicability, reproducibility, robustness, research practices, replication study, research incentives
- MeSH terms
- Humans, Research Design, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
