The DOI matches its Crossref record; 256 of the 256 references it cites were found in a registry or an index.
Replicability, Robustness, and Reproducibility in Psychological Science
Open accessPublished version of a preprint
Abstract
Replication—an important, uncommon, and misunderstood practice—is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings and observed surprising failures to replicate many published findings. Replication efforts highlighted sociocultural challenges such as disincentives to conduct replications and a tendency to frame replication as a personal attack rather than a healthy scientific practice, and they raised awareness that replication contributes to self-correction. Nevertheless, innovation in doing and understanding replication and its cousins, reproducibility and robustness, has positioned psychology to improve research practices and accelerate progress.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By using a common approach to analyze data from multiple informants, time points, and developmental domains, we can address concerns about the robustness of scientific findings (20,21).”
From A Comprehensive Multilevel Analysis of the Bucharest Early Intervention Project: Causal Effects on Recovery From Early Severe Deprivation (2023) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In psychology, across 307 systematic replications and multisite replications, 64% reported statistically significant evidence in the same direction and effect sizes 68% as large as the original experiments”
From Investigating the replicability of preclinical cancer biology (2021) · cites this paper as Nosek et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research into replicability in other disciplines has also found that findings with stronger initial evidence (such as larger effect sizes and/or smaller p-values) is more likely to replicate”
From Investigating the replicability of preclinical cancer biology (2021) · cites this paper as Nosek et al., 2021
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Independent verification is central to the scientific method (Nosek et al., 2022).”
From Read the Paper, Write the Code: Agentic Reproduction of Social-Science Results (2026) · cites this paper as Nosek et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“A substantial proportion of replications in recent largescale efforts have failed to support the original finding (Nosek et al., 2022).”
From Many Labs 4: Failure to Replicate Mortality Salience Effect With and Without Original Author Involvement (2022) · cites this paper as Nosek et al., 2022
In the citing paper
“This means that even when updates address and mitigate detected biases, they also introduce the potential for “process reproducibility failure” (98) in the generated data and impede reproducibility, critical for scientific rigor (15, 100, 101).”
From Perils and opportunities in using large language models in psychological research (2024) · cites this paper as [98]
In the citing paper
“However, particular challenges arise when applying these principles to LLMs, particularly proprietary ones, whose black-box nature impedes the reproducibility of findings that pertain to them.”
From Perils and opportunities in using large language models in psychological research (2024) · cites this paper as [98]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,559
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
(2002) · Cited by 13,211
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Self-citation
Research works printed but not linked: 17
- Artner R, 2020, Psychol. Methods.
- Cent. Open Sci, 2020, Center for Open Science
- Cohen J., 1973, Am. Educ. Res. J., 10, 225
- 10.1037/0033-2909.112.1.155 · DOI · Paper page
- Crisp RJ, 2014, Soc. Psychol., 45, 303
- Epskamp S, 2018, Statistical Software
- Errington TM, 2021, eLife
- Ferguson MJ, 2014, Soc. Psychol., 45, 301
- Gelman A, 2013, The garden of forking paths: why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time
- Marcus A, 2020, WIRED
- Meyer MN, 2014, Slate Magazine
- Mischel W., 2008, APS Observer
- Nosek B., 2019, Center for Open Science
- Nosek B., 2019, Center for Open Science
- Schwarz N, 2014, Soc. Psychol., 45, 305
- Sterling TD., 1959, J. Am. Stat. Assoc., 54, 30
- Yong E, 2012, National Geo-graphic
Cited by
Sorted by citations
Items 401–500 of 772
Psychopathy, neuroscience, and critical issues: A legal primer
Danagher, L. (2025) · International Journal of Law and Psychiatry · doi:10.1016/j.ijlp.2025.102139 · Cited by 5
Legacy communal family systems in entrepreneurship: a migrant entrepreneurship phenomenon in Europe
Simba, A., Braune, É., Boncori, A., & Jones, P. K. (2025) · Entrepreneurship and Regional Development · doi:10.1080/08985626.2025.2567937 · Cited by 2
Zacher, H. (2025) · Personality and Individual Differences · doi:10.1016/j.paid.2025.113495 · Cited by 2
Introduction to Research Methodology
Almusaed, A., Almssad, A., & Yitmen, İ. (2025) · Springer eBooks · doi:10.1007/978-3-031-97393-2_1 · Cited by 2
Travers, J. C., Dowdy, A., Tincani, M., & Slocum, T. (2025) · Remedial and Special Education · doi:10.1177/07419325251375992 · Cited by 2
Relational Databases for Behavior Science
Soto, P. L. (2025) · Perspectives on Behavior Science · doi:10.1007/s40614-025-00486-w · Cited by 2
Transformational leadership and employee suicidal ideation: evidence from a three-wave panel model
Wang, L., & Kelloway, K. E. (2025) · Work & Stress · doi:10.1080/02678373.2025.2607499 · Cited by 2
Smart and International Campuses in Research Collaborations
Mukminin, A., Marzulina, L., Abdrazakova, A., Harto, K., Fridiyanto, F., Erlina, D., & Amir, R. Z. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-6831-3.ch012 · Cited by 2
The Perks and Perils of Replicability
Vaesen, K., & Hussain, S. T. (2026) · American Antiquity · doi:10.1017/aaq.2025.10146 · Cited by 2
Afamefuna, K., Schweiker, M., & Harmsen, J. (2026) · European Review of Applied Psychology · doi:10.1016/j.erap.2025.101140 · Cited by 2
Gerpott, F. H. (2026) · Zeitschrift für Arbeits- und Organisationspsychologie A&O · doi:10.1026/0932-4089/a000464 · Cited by 2
Leve, L. D., Neiderhiser, J. M., & Ganiban, J. M. (2026) · Twin Research and Human Genetics · doi:10.1017/thg.2026.10058 · Cited by 2
Aportes para la Promoción de mayor Transparencia en los Estudios Psicométricos
Flores-Kanter, P. E., & Mosquera, M. (2022) · PSIQUEMAG/ Revista Científica Digital de Psicología · doi:10.18050/psiquemag.v11i2.2064 · Cited by 2
Individualism–collectivism and organ donation intentions
Li, J., Zang, R., & Niu, X. (2023) · Asian Journal Of Social Psychology · doi:10.1111/ajsp.12572 · Cited by 2
Televantou, I., Marsh, H. W., Xu, K. M., Guo, J., & Dicke, T. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09816-3 · Cited by 2
Trail making test B in postoperative delirium: a replication study
Fislage, M., Feinkohl, I., Borchers, F., Heinrich, M., Pischon, T., Veldhuijzen, D. S., Slooter, A. J. C., Spies, C., Winterer, G., & Zacharias, N. (2023) · BJA Open · doi:10.1016/j.bjao.2023.100239 · Cited by 2
Observing Parental Need Supporting Behaviors Toward Adolescents: Comparing Four Coding Strategies
Ratelle, C. F., Châteauvert, G. B., Bourret, M., & Duchesne, S. (2023) · Journal of Child and Family Studies · doi:10.1007/s10826-023-02726-6 · Cited by 2
The State of Open Science Practices in Psychometric Studies of Suicide: A Systematic Review
Flores-Kanter, P. E., & Alvarado, J. M. (2024) · Assessment · doi:10.1177/10731911241236315 · Cited by 4
Exploring the multiverse of analysis options for the alcohol Stroop
Jones, A., Stafford, T., & Petrovskaya, E. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02377-5 · Cited by 2
Integrating measures of replicability into scholarly search: Challenges and opportunities
Wu, C., Chakravorti, T., Carroll, J. M., & Rajtmajer, S. M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3643043 · Cited by 3
A Replicable and Generalizable Neuroimaging‐Based Indicator of Pain Sensitivity Across Individuals
Zhang, L., Lu, X., Zhang, H.-J., Wei, Z., Kong, Y., Tu, Y., Iannetti, G. D., & Hu, L. (2025) · Advanced Science · doi:10.1101/2024.06.08.597884 · Cited by 2
SuperAging functional connectomics from resting-state functional MRI
Diamond, B. R., Sridhar, J., Maier, J., Martersteck, A., & Rogalski, E. J. (2024) · Brain Communications · doi:10.1093/braincomms/fcae205 · Cited by 2
Экспериментальный анализ моральной конформности в ситуации пассивного социального давления
Fedorov, A. A. (2024) · Психология Журнал Высшей школы экономики · doi:10.17323/1813-8918-2024-2-277-305 · Cited by 4
Rengasamy, M. L., & Price, R. B. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.116190 · Cited by 3
Beyond the matrix: Experimental approaches to studying cognitive agents in social-ecological systems
Hertz, U., Koster, R., Janssen, M. A., & Leibo, J. Z. (2024) · Cognition · doi:10.1016/j.cognition.2024.105993 · Cited by 2
The ENIGMA-Neuromodulation working group – A mission statement
Kuhn, T. P., Indahlastari, A., Vila‐Rodriguez, F., Fonzo, G. A., Petersen, N., Rotstein, N., Davis, T., Halavi, S., Mehler, D., Repple, J., et al. (2025) · Brain stimulation · doi:10.1016/j.brs.2024.12.1477 · Cited by 2
McNamee, B., Forscher, P. S., & Lenczner, M. (2024) · New Directions for Evaluation · doi:10.1002/ev.20624 · Cited by 2
The missing link: Theory in social psychology as key contribution to transdisciplinary research
Ellemers, N. (2025) · European Review of Social Psychology · doi:10.1080/10463283.2025.2489867 · Cited by 2
Replication of experiments and the canonisation of incorrect conclusions
West, S. A., & Burton-Chellew, M. N. (2025) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2025.106749 · Cited by 2
Sharing is caring for developmental psychology
Veldkamp, C. L. S., & Kemner, C. (2023) · Infant and Child Development · doi:10.1002/icd.2438 · Cited by 2
Ten Years of Psychology's Replicability Crisis:
Hiraishi, K., & Nakamura, D. (2022) · Kagaku tetsugaku · doi:10.4216/jpssj.54.2_27 · Cited by 4
Rajčáni, J., Vargová, L., Adamkovic, M., & Kačmár, P. (2023) · Studia Psychologica · doi:10.31577/sp.2023.01.866 · Cited by 2
Haim, A., Shaw, S. T., & Heffernan, N. T. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-36336-8_11 · Cited by 2
Psychology’s reform movement needs a reconceptualization of scientific expertise
Tunç, D. U., & Tunç, M. N. (2023) · Social Psychological Bulletin · doi:10.32872/spb.10303 · Cited by 3
Ivory, J. (2024) · Media and Communication · doi:10.17645/mac.7852 · Cited by 2
The Cultural Evolution of SciencePreprint
Wu, J., O’Connor, C., & Smaldino, P. E. (2022) · doi:10.31222/osf.io/2ekcr · Cited by 2
Thompson, J., Dreber, A., Gaunt, T. R., Gordon, M., Holzmeister, F., Huber, J., Johannesson, M., Kirchler, M., Lyon, M., Penton‐Voak, I. S., et al. (2022) · doi:10.31222/osf.io/gsc8f · Cited by 1
Self-citationThe Social Psychology of Everyday LifePreprint
Hofmann, W., & Grigoryan, L. K. (2023) · doi:10.31234/osf.io/bvga5 · Cited by 2
Is biomedical research self-correcting? Modeling insights on the persistence of spurious sciencePreprint
Grimes, D. R. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.17.549436 · Cited by 2
Youyou, W., Yang, Y., & Uzzi, B. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2308195120 · Cited by 2
Hitsuwari, J., & Nomura, M. (2023) · Research Square · doi:10.21203/rs.3.rs-2713826/v2 · Cited by 2
Chou, E., Westberg, D. W., Nguyen, P. L. L., & Syed, M. (2023) · doi:10.31234/osf.io/w3rxe · Cited by 2
A Taxonomy of Data Synthesis: A TutorialPreprint
Beck, E. D., Willroth, E. C., Delius, J. A. M., Bennett, D. A., Barnes, L. L., James, B. D., Lipton, R. B., Katz, M. J., Hassing, L. B., Huisman, M. A., et al. (2024) · doi:10.31234/osf.io/m3ywe · Cited by 2
Brauer, K. (2024) · International Journal of Applied Positive Psychology · doi:10.1007/s41042-024-00204-y · Cited by 2
Read the Paper, Write the Code: Agentic Reproduction of Social-Science Results
Kohler, B., Zollikofer, D., Einsiedler, J., Hoyle, A., & Ash, E. (2026) · arXiv · doi:10.48550/arxiv.2604.21965 · Cited by 1
Psychology and Law, Meet Open Science
McAuliff, B. D., Fessinger, M. B., Perillo, A. D., & Perillo, J. T. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197649138.013.5 · Cited by 1
Gender, age and depressive symptoms in adolescence
Sánchez-Hernández, Ó., Méndez, F. X., & Marín‐Martínez, F. (2023) · Behavioral Psychology/Psicología Conductual · doi:10.51668/bp.8323201n · Cited by 1
Hawas, S. K. A. A. A. (2023) · Journal of Propulsion Technology · doi:10.52783/tjjpt.v44.i4.1884 · Cited by 1
Fletcher, D., Houghton, R. J., & Spence, A. (2024) · PLoS ONE · doi:10.1371/journal.pone.0301781 · Cited by 2
Hensel, P. G., & Kacprzak, A. (2024) · Journal of Organizational Change Management · doi:10.1108/jocm-10-2023-0436 · Cited by 1
Open science practices in demographic research: An appraisal
Basellini, U. (2024) · Demographic Research · doi:10.4054/demres.2024.50.43 · Cited by 2
Has philosophy become more ‘Scientific’? A citation analysis
Rehren, P., & Armbruster, T. (2025) · Synthese · doi:10.1007/s11229-024-04896-2 · Cited by 1
Meta-analyzing nonpreregistered and preregistered studies.
van Aert, R. C. M. (2025) · Psychological Methods · doi:10.1037/met0000719 · Cited by 3
Online Moral Conformity Revisited
Fedorov, A. A., & Steshova, A. A. (2025) · International Journal of Psychology · doi:10.1002/ijop.70033 · Cited by 2
Beffara, B., Veyrie, M., Mauduit, L., Bardi, L., & Cristofori, I. (2025) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218251326569 · Cited by 1
Search term validation in agricultural economics: conceptual background and application
Völker, R., Hirschauer, N., Lind, F., & Grüner, S. (2025) · Q Open · doi:10.1093/qopen/qoaf012 · Cited by 1
Meirmans, S., Luijken, K., Bruijning-Verhagen, P. C. J. L., Groenwold, R. H. H., & de Boer, A. R. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111785 · Cited by 1
Chan, C. W., Lim, H. C., Lau, F. Y., Ip, W., Lui, C. F. S., Tam, K. Y. Y., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.250508 · Cited by 2
Lee, S. C., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.250908 · Cited by 2
Fradet, M. (2025) · Psychoactives · doi:10.3390/psychoactives4030021 · Cited by 1
The Gödel case and beyond: Reassessing the cross-cultural style of semantics
Li, J., Tao, L., & Mei, J. (2025) · Philosophical Studies · doi:10.1007/s11098-025-02362-4 · Cited by 1
Liu, X., Li, W., Zhang, Q., Lei, J., Han, X., Wang, Y., Shen, C., Yu, Z., Li, Y., Shi, L., et al. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf238 · Cited by 1
Robust and replicable effects of ageing on resting-state brain electrophysiology measured with MEG
Quinn, A. J., Pitt, J., Kohl, O., Gohil, C., van Es, M. W. J., Nobre, A. C., & Woolrich, M. W. (2026) · eLife · doi:10.1101/2025.08.01.668093 · Cited by 2
Knee extensor training in patients with patellofemoral pain: a systematic review and synthesis
Gunhamn, T., Pojskić, H., & Augustsson, S. R. (2025) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2025.1641054 · Cited by 3
Hughes, G. K., Barton, C., & Vassar, M. B. (2025) · American Journal of Clinical Pathology · doi:10.1093/ajcp/aqaf103 · Cited by 1
Hasso, T., Brosnan, M., Ali, S., & Chai, D. (2026) · Pacific-Basin Finance Journal · doi:10.1016/j.pacfin.2026.103166 · Cited by 1
Advancing the Science of Disability Research in Sport and Exercise
Martin, J. J. (2025) · Kinesiology Review · doi:10.1123/kr.2025-0041 · Cited by 1
Experimental Design and Causal Inference
Almusaed, A., Almssad, A., & Yitmen, İ. (2025) · Springer eBooks · doi:10.1007/978-3-031-97393-2_16 · Cited by 1
Reciprocal escalation of violent extremism: Experimental and longitudinal evidence from Denmark
Obaidi, M., Bergh, R., & Dovidio, J. F. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf338 · Cited by 1
Otto, M. W., Long, L. J., Papini, S., Culver, T., Taylor, C. T., Rubin, M., Fitzgerald, H. E., Liu, Q., Smits, J. A. J., Anderson, R., et al. (2025) · JMIR Research Protocols · doi:10.2196/80010 · Cited by 1
Social Norms and Charitable Giving: A Meta-Analytic Review
Chapman, C. M., Spence, J. L., Dixon, L. J., Smith, A. E., & Hornsey, M. J. (2025) · Personality and Social Psychology Bulletin · doi:10.1177/01461672251383996 · Cited by 3
Brief empathy interventions online can decrease but not increase empathic tendencies
Tagesson, A., Wallin, A., & Pärnamets, P. (2025) · Communications Psychology · doi:10.1038/s44271-025-00364-w · Cited by 1
The Virtual Supermarket Test: A New Tool for Assessing Planning in Adults From Buenos Aires
Seivane, M. S., & Brenlla, M. E. (2025) · Assessment · doi:10.1177/10731911251390381 · Cited by 1
Bagchi, A. D., Hargwood, P., Jadotte, Y. T., Saravana, A., & DiBello, A. M. (2025) · JBI Evidence Synthesis · doi:10.11124/jbies-24-00322 · Cited by 1
Dowdy, A., Kang, H. K., Karwa, V., & McAlinn, K. (2025) · Journal of Behavioral Education · doi:10.1007/s10864-025-09610-x · Cited by 1
Myers, A. M., Jo, D., Spencer, S. D., Guzick, A. G., Palo, A. D., Berry, L. N., & Storch, E. A. (2025) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-025-10262-4 · Cited by 1
How to change research culture with participatory workshops
Urai, A. E., Veer, A. E. V. ’., Fried, E. I., & Kelly, C. A. M. (2026) · Nature Human Behaviour · doi:10.1038/s41562-025-02391-3 · Cited by 1
Long, J. S., Logan, M. W., & Zhu, S. (2026) · Evidence Base · doi:10.1080/30679125.2025.2606820 · Cited by 1
Camacho, N. L., & Gaffrey, M. S. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.121328 · Cited by 1
Experimentally falsifying ghost criminology: exercising rigor, exorcising residue
Adams, I. T. (2026) · Theory and Society · doi:10.1007/s11186-025-09676-6 · Cited by 1
Saad, G. (2026) · Theory and Society · doi:10.1007/s11186-025-09674-8 · Cited by 1
Bonifaz, J. B., Landeta-López, P., Guevara‐Vega, C., & Quiña‐Mera, A. (2026) · Applied Sciences · doi:10.3390/app16073147 · Cited by 2
Hofreiter, S., Kerschreiter, R., & Spörrle, M. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2645875 · Cited by 1
Krieweth, C., Kruse, S., Short, J. C., Schrameier, L. R. M., & Brettel, M. (2026) · Entrepreneurship Theory and Practice · doi:10.1177/10422587261415935 · Cited by 1
Measuring geopolitics: the promise and limits of UNGA voting data for IB research
Adarkwah, G. K., Sabel, C. A., & Zilja, F. (2026) · Journal of International Business Policy · doi:10.1057/s42214-025-00237-3 · Cited by 1
Harper, A. L., Sarver, D. E., & Sly, K. F. (2026) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-026-07330-3 · Cited by 1
Neuroimaging studies of extra-sensory perception: A systematic and critical review
Acunzo, D. J., Denton, A. H., Weiler, M., & Kelly, E. F. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.121937 · Cited by 2
Validation of the Satisfaction with Life Scale in Japan: A Large Sample Study
Asano, R., Ito, K., Sato, K., Hitokoto, H., & Oishi, S. (2026) · Journal of Personality Assessment · doi:10.1080/00223891.2026.2657971 · Cited by 1
Hernández, J. R. H. (2026) · Mathematics · doi:10.3390/math14112002 · Cited by 1
Robustness Analysis in Quantitative Management Research: A Review and Recommendations
Yuan, S., Hartog, D. N. D., Liu, Y., Hoogh, A. H. B. D., Sun, L. (., Zhao, D., Riisla, K., & Belschak, F. D. (2026) · Journal of Management · doi:10.1177/01492063261440210 · Cited by 1
Dannlowski, U., Winter, N. R., Meinert, S., Grotegerd, D., Kraus, A., Flinkenflügel, K., Leehr, E. J., Böhnlein, J., Borgers, T., Fisch, L., et al. (2026) · Neuropsychopharmacology · doi:10.1038/s41386-026-02491-2 · Cited by 5
Siegrist, M., Wassmann, B., Berthold, A., Hässig-Wegmann, A., Luchsinger, L., Michel, F., & Zhou, X. (2026) · Food Quality and Preference · doi:10.1016/j.foodqual.2026.106062 · Cited by 1
Gonzalez, M. F., & Cheban, Y. (2022) · Industrial and Organizational Psychology · doi:10.1017/iop.2022.55 · Cited by 1
A multi‐analyses approach of inductive/deductive asymmetry in the affective priming paradigm
Foroni, F., Marmolejo‐Ramos, F., Wilcox, R. R., Bastiani, F. D., & Semin, G. R. (2023) · British Journal of Psychology · doi:10.1111/bjop.12634 · Cited by 1
Assessing Data Science's Application to Economic Theory
Baldelovar, M. A. (2022) · Technoarete Transactions on Advances in Data Science and Analytics · doi:10.36647/ttadsa/01.02.a005 · Cited by 1
How often are replication attempts questioned?
Hensel, P. G. (2023) · Accountability in Research · doi:10.1080/08989621.2023.2198126 · Cited by 1
Koppel, L., Andersson, D., Tinghög, G., Västfjäll, D., & Feldman, G. (2023) · Meta-Psychology · doi:10.15626/mp.2021.2932 · Cited by 1
Decision-Making in Patients with Vasovagal Syncope: A Preliminary Study
Méchenin, M., & Fortrat, J. (2023) · Biology · doi:10.3390/biology12070930 · Cited by 1
A Roadmap for Future Interactions Between Research on Personality and Learning
Houwer, J. D., Perugini, M., Boddez, Y., & Sava, F. A. (2023) · Collabra Psychology · doi:10.1525/collabra.88334 · Cited by 1
Metanauka poznawcza: nowe podejście do badania teorii
Miłkowski, M. (2023) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.9459 · Cited by 1
Metadata
- Authors
- Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., Rohrer, J. M., Romero, F., Scheel, A. M., Scherer, L. D., Schönbrodt, F. D., & Vazire, S.
- Affiliations
- Center for Open Science (US)
- University of Amsterdam (NL)
- University of Wisconsin–Madison (US)
- University of California, Davis (US)
- Grand Valley State University (US)
- Stockholm School of Economics (SE)
- The University of Melbourne (AU)
- Illinois State University (US)
- Center for Open Science, Charlottesville, Virginia 22903, USA
- Tilburg University (NL)
- Leipzig University (DE)
- University of Groningen (NL)
- Eindhoven University of Technology (NL)
- University of Colorado Anschutz (US)
- Ludwig-Maximilians-Universität München (DE)
- ORCID
- Venue
- Annual Review of Psychology
- Publisher
- Annual Reviews
- Published
- 2022-01-04
- Volume
- 73
- Issue
- 1
- Pages
- 719-748
- ISSN
- 0066-4308 (ISSN-L)
- 1545-2085
- OpenAlex
- W3161588210
- Cited by
- 770
- References
- 253
- Citations by year
- 2026: 109 · 2025: 192 · 2024: 180 · 2023: 177 · 2022: 92
- FWCI
- 19.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Annual Review of Psychology (publishedVersion)
- PubMed (publishedVersion)
- Research portal (Tilburg University) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- HAL (submittedVersion)
- Minerva Access (University of Melbourne) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, other-oa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Funders
- John Templeton Foundation
- Patient-Centered Outcomes Research Institute
- Arnold Ventures
- European Commission (HORIZON2020, 841188)
- University of Melbourne
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Templeton World Charity Foundation
- Templeton Religion Trust
- National Institutes of Health
- Agency for Healthcare Research and Quality
- Australian Research Council (FT150100297)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- replication, replicability, reproducibility, robustness, research practices, replication study, research incentives
- MeSH terms
- Humans, Research Design, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review