The DOI matches its Crossref record; 256 of the 256 references it cites were found in a registry or an index.
Replicability, Robustness, and Reproducibility in Psychological Science
Open accessPublished version of a preprint
Abstract
Replication—an important, uncommon, and misunderstood practice—is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings and observed surprising failures to replicate many published findings. Replication efforts highlighted sociocultural challenges such as disincentives to conduct replications and a tendency to frame replication as a personal attack rather than a healthy scientific practice, and they raised awareness that replication contributes to self-correction. Nevertheless, innovation in doing and understanding replication and its cousins, reproducibility and robustness, has positioned psychology to improve research practices and accelerate progress.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By using a common approach to analyze data from multiple informants, time points, and developmental domains, we can address concerns about the robustness of scientific findings (20,21).”
From A Comprehensive Multilevel Analysis of the Bucharest Early Intervention Project: Causal Effects on Recovery From Early Severe Deprivation (2023) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This means that even when updates address and mitigate detected biases, they also introduce the potential for “process reproducibility failure” (98) in the generated data and impede reproducibility, critical for scientific rigor (15, 100, 101).”
From Perils and opportunities in using large language models in psychological research (2024) · cites this paper as [98]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In psychology, across 307 systematic replications and multisite replications, 64% reported statistically significant evidence in the same direction and effect sizes 68% as large as the original experiments”
From Investigating the replicability of preclinical cancer biology (2021) · cites this paper as Nosek et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research into replicability in other disciplines has also found that findings with stronger initial evidence (such as larger effect sizes and/or smaller p-values) is more likely to replicate”
From Investigating the replicability of preclinical cancer biology (2021) · cites this paper as Nosek et al., 2021
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Independent verification is central to the scientific method (Nosek et al., 2022).”
From Read the Paper, Write the Code: Agentic Reproduction of Social-Science Results (2026) · cites this paper as Nosek et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“A substantial proportion of replications in recent largescale efforts have failed to support the original finding (Nosek et al., 2022).”
From Many Labs 4: Failure to Replicate Mortality Salience Effect With and Without Original Author Involvement (2022) · cites this paper as Nosek et al., 2022
In the citing paper
“However, particular challenges arise when applying these principles to LLMs, particularly proprietary ones, whose black-box nature impedes the reproducibility of findings that pertain to them.”
From Perils and opportunities in using large language models in psychological research (2024) · cites this paper as [98]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,559
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
(2002) · Cited by 13,211
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Self-citation
Research works printed but not linked: 17
- Artner R, 2020, Psychol. Methods.
- Cent. Open Sci, 2020, Center for Open Science
- Cohen J., 1973, Am. Educ. Res. J., 10, 225
- 10.1037/0033-2909.112.1.155 · DOI · Paper page
- Crisp RJ, 2014, Soc. Psychol., 45, 303
- Epskamp S, 2018, Statistical Software
- Errington TM, 2021, eLife
- Ferguson MJ, 2014, Soc. Psychol., 45, 301
- Gelman A, 2013, The garden of forking paths: why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time
- Marcus A, 2020, WIRED
- Meyer MN, 2014, Slate Magazine
- Mischel W., 2008, APS Observer
- Nosek B., 2019, Center for Open Science
- Nosek B., 2019, Center for Open Science
- Schwarz N, 2014, Soc. Psychol., 45, 305
- Sterling TD., 1959, J. Am. Stat. Assoc., 54, 30
- Yong E, 2012, National Geo-graphic
Cited by
Sorted by citations
Items 201–300 of 772
Contextualizing Social Psychology Through Cultural Syndromes: The Case of Brazilian Jeitinho
Pilati, R., & Fischer, R. D. (2025) · Personality and Social Psychology Review · doi:10.1177/10888683251346521 · Cited by 9
Boukrouh, S., Rharad, A. A., Alia, O. A. E., Hornick, J., & Faye, B. (2026) · Small Ruminant Research · doi:10.1016/j.smallrumres.2026.107773 · Cited by 8
Martínez‐Huertas, J. Á., Moreno, J. D., Olmos, R., Martínez-Mingo, A., & Jorge‐Botana, G. (2022) · Psych · doi:10.3390/psych4040059 · Cited by 9
Priestley, D. R., Staph, J., Koneru, S., Rajtmajer, S. M., Cwiek, A. P., Vervoordt, S. M., & Hillary, F. G. (2022) · Brain Communications · doi:10.1093/braincomms/fcac322 · Cited by 7
Kianersi, S., Grant, S., Naaman, K., Henschel, B., Mellor, D. T., Apte, S., Deyoe, J. E., Eze, P., Huo, C., Lavender, B. L., et al. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221149735 · Cited by 11
How do you Behave as a Psychometrician? Research Conduct in the Context of Psychometric Research
Flores-Kanter, P. E., & Mosquera, M. (2023) · The Spanish Journal of Psychology · doi:10.1017/sjp.2023.14 · Cited by 8
The positive–negative–competence (PNC) model of psychological responses to representations of robots
Krpan, D., Booth, J. E., & Damien, A. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01705-7 · Cited by 10
The Experience Sampling Method in the Research on Achievement-Related Emotions and Motivation
Moeller, J., Dietrich, J., & Baars, J. (2023) · Routledge eBooks · doi:10.4324/9781003303473-14 · Cited by 8
Theoretical false positive psychology
Wilson, B. M., Harris, C. R., & Wixted, J. T. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02098-w · Cited by 13
Adoption of Transparency and Openness Promotion (TOP) Guidelines across Journals
Patarčić, I., & Stojanovski, J. (2022) · Publ. · doi:10.3390/publications10040046 · Cited by 5
Haim, A., Shaw, S. T., & Heffernan, N. T. (2023) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3576050.3576071 · Cited by 10
Perils and Opportunities in Using Large Language Models in Psychological ResearchPreprint
Abdurahman, S., Atari, M., Karimi-Malekabadi, F., Xue, M. J., Trager, J. P., Park, P. S., Golazizian, P., Omrani, A., & Dehghani, M. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/d695y · Cited by 8
Investigations of decision processes at the intersection of psychology and economics
Lohse, J., Rahal, R.-M., Schulte‐Mecklenbeck, M., Sofianos, A., & Wollbrant, C. E.-P. (2024) · Journal of Economic Psychology · doi:10.1016/j.joep.2024.102741 · Cited by 8
Sharing practices of software artefacts and source code for reproducible research
Jean-Quartier, C., Jeanquartier, F., Stryeck, S., Simon, J., Söser, B., & Hasani‐Mavriqi, I. (2024) · International Journal of Data Science and Analytics · doi:10.1007/s41060-024-00617-7 · Cited by 7
Revisiting the domain of suggestion: A meta-analysis of suggestibility across different contexts
Stein, M. V., Faerman, A., Thompson, T., Kirsch, I., Lynn, S. J., & Terhune, D. B. (2025) · Personality and Individual Differences · doi:10.1016/j.paid.2025.113181 · Cited by 7
Reproducibility of meta-analytic results in systematic reviews of interventions: meta-research study
Nguyen, P., McKenzie, J. E., Alqaidoom, Z., Hamilton, D. G., Moher, D., & Page, M. J. (2025) · BMJ Medicine · doi:10.1136/bmjmed-2025-002024 · Cited by 9
Proulx, J. D. E., de Vondervoort, J. W. V., Hamlin, J. K., Helliwell, J. F., & Aknin, L. B. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20054403 · Cited by 8
Petrov, N. B., Chan, Y. K. M., Lau, C. N., Kwok, T. H., Chow, L. C. E., Lo, W. Y., Song, W., & Feldman, G. (2023) · International Review of Social Psychology · doi:10.5334/irsp.883 · Cited by 7
Nickson, D., Singmann, H., Meyer, C., Toro, C. T., & Walasek, L. (2023) · Diagnostic and Prognostic Research · doi:10.1186/s41512-023-00160-2 · Cited by 7
Uncertainty, expertise, and persuasion: A replication and extension of
Løhre, E., Chandrashekar, S. P., Mayiwar, L., & Hærem, T. (2024) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2024.104619 · Cited by 10
Dietvorst, E., de Vries, L. P., van Eijl, S., Mesman, E., Legerstee, J. S., Keijsers, L., Hillegers, M. H. J., & Vreeker, A. (2024) · Digital Health · doi:10.1177/20552076241294105 · Cited by 9
Altenmüller, M. S., & Gollwitzer, M. (2021) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2021.08.011 · Cited by 7
Promoting and Enabling Reproducible Data Science Through a Reproducibility Challenge
Liu, J., Carlson, J., Josh Pasek, B., Puchala, B., Rao, A., & Jagadish, H. V. (2022) · Harvard Data Science Review · doi:10.1162/99608f92.9624ea51 · Cited by 9
Maulina, D., Siregar, E. S., Rachma, T. A., Nashria, S. A., & Irwanda, D. Y. (2022) · IATSS Research · doi:10.1016/j.iatssr.2022.11.002 · Cited by 9
Umanath, S., Coane, J. H., Huff, M. J., Cimenian, T., & Chang, K. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-022-00458-7 · Cited by 8
Facing the Unknown Unknowns of Data Analysis
Wagenmakers, E., Sarafoglou, A., & Aczél, B. (2023) · Current Directions in Psychological Science · doi:10.1177/09637214231168565 · Cited by 7
Shaw, S. D., & Nave, G. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.114129 · Cited by 8
Novel mechanism-based treatments for pediatric anxiety and depressive disorders
Sylvester, C. M., Luby, J. L., & Pine, D. S. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-023-01709-x · Cited by 7
Lan, H., Suo, X., Zuo, C., Pan, N., Zhang, X., Kemp, G. J., Gong, Q., & Wang, S. (2023) · Cerebral Cortex · doi:10.1093/cercor/bhad372 · Cited by 8
Brown, D. M. Y., & Meca, A. (2024) · Measurement in Physical Education and Exercise Science · doi:10.1080/1091367x.2024.2401860 · Cited by 6
Good Scientific Practice in MEEG Research: Progress and PerspectivesPreprint
Niso, G., Krol, L. R., Combrisson, E., Dubarry, A., Elliott, M., Clément, F., Héjja‐Brichard, Y., Herbst, S. K., Jerbi, K., Ković, V., et al. (2021) · doi:10.31219/osf.io/n2ryp · Cited by 7
Renton, A., Dao, T. T., Abbott, D. F., Amos, T. J., Bollmann, S., Botting, A., Campbell, M. E. J., Chang, J., Civier, O., Close, T., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.12.23.521691 · Cited by 7
Beyond dissonance: the transformative power of thought analysis in philosophical practice
Ding, X., Xie, C., & Yu, F. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-04143-6 · Cited by 10
Timmer, K., Wolna, A., & Wodniecka, Z. (2024) · Bilingualism Language and Cognition · doi:10.1017/s1366728924000841 · Cited by 8
Chuan-Peng, H., Xu, Z., Lazić, A., Bhattacharya, P., Seda, L., Hossain, S., Jeftić, A., Özdoğru, A. A., Amaral, O. B., Miljković, N., et al. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251357565 · Cited by 11
Goltermann, J., Winter, N. R., Meinert, S., Grotegerd, D., Kraus, A., Flinkenflügel, K., Altegoer, L., Krieger, J., Leehr, E. J., Böhnlein, J., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-62374-w · Cited by 8
Reproducibility of Published Meta-Analyses on Clinical-Psychological Interventions
López‐Nicolás, R., Lakens, D., López-López, J. A., Rubio‐Aparicio, M., Sandoval‐Lentisco, A., López‐Ibáñez, C., Blázquez-Rincón, D., & Sánchez‐Meca, J. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231202929 · Cited by 6
Let’s talk about language—and its role for replicability
Schmalz, X., Breuer, J., Haim, M., Hildebrandt, A., Knöpfle, P., Leung, A. Y., & Roettger, T. B. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04381-2 · Cited by 7
Are we all on the same page? Subfield differences in open science practices in psychology
Rochios, C., & Richmond, J. L. (2022) · Infant and Child Development · doi:10.1002/icd.2361 · Cited by 7
Multiverse-style analysis: Introduction and application
Shunsen, H., Chen, H., Xiaoxiong, L., Xinran, D., & Yun, W. (2022) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2023.00196 · Cited by 6
The Pragmatic American Revisited: A Direct Replication of Pickett and Baker (2014)
Jones, A. M., & Roche, S. P. (2022) · International Journal of Offender Therapy and Comparative Criminology · doi:10.1177/0306624x221133007 · Cited by 6
Camerer, C. F. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2216020119 · Cited by 8
Luo, Y., Deng, Y., Ma, T., & Jiang, Y. N. (2023) · Psychology in the Schools · doi:10.1002/pits.22867 · Cited by 7
Segerstrom, S. C., Diefenbach, M. A., Hamilton, K., O'Connor, D. B., Tomiyama, A. J., Bacon, S., Bennett, G. G., Brondolo, E. N., Czajkowski, S. M., Davidson, K. W., et al. (2023) · Annals of Behavioral Medicine · doi:10.1093/abm/kaac044 · Cited by 14
Segerstrom, S. C., Diefenbach, M. A., Hamilton, K., O'Connor, D. B., & Tomiyama, A. J. (2023) · Health Psychology · doi:10.1037/hea0001236 · Cited by 7
van Aert, R. C. M., Nuijten, M. B., Olsson-Collentine, A., Stoevenbelt, A. H., van den Akker, O. R., Klein, R. A., & Wicherts, J. M. (2023) · Royal Society Open Science · doi:10.1098/rsos.202326 · Cited by 6
Self-citationEvaluating false positive rates of standard and hierarchical measures of metacognitive accuracy
Rausch, M., & Zehetleitner, M. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09353-y · Cited by 9
Methner, N., Dahme, B., & Menzel, C. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9665 · Cited by 9
Fieldwork Experiences Researching Cybercriminals
Moneva, A., Leukfeldt, R., & Romagna, M. (2023) · Springer eBooks · doi:10.1007/978-3-031-41574-6_27 · Cited by 6
Polyviou, M., Rungtusanatham, M. J., Reczek, R. W., Dooley, K. J., & Knemeyer, A. M. (2024) · Decision Sciences · doi:10.1111/deci.12623 · Cited by 6
Inhibiting orofacial mimicry affects authenticity perception in vocal emotions.
Vilaverde, R. F., Horchak, O. V., Pinheiro, A. P., Scott, S. K., Korb, S., & Lima, C. F. (2024) · Emotion · doi:10.1037/emo0001361 · Cited by 7
Direct Replication in Experimental Communication Science: A Conceptual and Practical Exploration
Vermeulen, I., Masur, P. K., Beukeboom, C. J., & Johnson, B. K. (2024) · Media and Communication · doi:10.17645/mac.7971 · Cited by 6
The Problem-Ladenness of Theory
Levenstein, D., Santo, A. D., Heijnen, S., Narayan, M., Maatman, F. O., Rawski, J., & Wright, C. (2024) · Computational Brain & Behavior · doi:10.1007/s42113-024-00219-3 · Cited by 6
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0005 · Cited by 6
Asselmann, E., Garthus‐Niegel, S., & Martini, J. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.814152 · Cited by 6
Torka, A., Mazei, J., & Hüffmeier, J. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9695 · Cited by 8
On Methods and Marshmallows: A Roadmap for Science That Is Openly Feminist and Radically Open
Gervais, S. J., Baildon, A. E., & Lorenz, T. K. (2021) · Psychology of Women Quarterly · doi:10.1177/03616843211032632 · Cited by 7
Peters, H., Götz, F. M., Ebert, T., Müller, S. R., Rentfrow, P. J., Gosling, S. D., Obschonka, M., Ames, D., Potter, J., & Matz, S. (2020) · doi:10.31234/osf.io/sqh98 · Cited by 6
Dimant, E., Pieper, D. J., Clemente, E. G., Dreber, A., & Gelfand, M. J. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3915256 · Cited by 6
Self-citationSegerstrom, S. C., Diefenbach, M. A., Hamilton, K., O'Connor, D. B., & Tomiyama, A. J. (2022) · doi:10.31234/osf.io/dj3xe · Cited by 6
Kohrs, F. E., Auer, S., Bannach‐Brown, A., Fiedler, S., Haven, T. L., Heise, V., Holman, C., Azevedo, F., Bernard, R., Bleier, A., et al. (2023) · doi:10.31219/osf.io/kcvra · Cited by 6
Barry, K. R., & Bick, J. R. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-96023-6.00073-7 · Cited by 7
Nuijten, M. B., & Wicherts, J. M. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241258945 · Cited by 6
Self-citationChen, L., Benjamin, R., Guo, Y., Lai, A., & Heine, S. J. (2023) · Research Square · doi:10.21203/rs.3.rs-1254756/v1 · Cited by 5
DeRosa, J., Friedman, N. P., Calhoun, V. D., & Banich, M. T. (2024) · NeuroImage · doi:10.1016/j.neuroimage.2024.120827 · Cited by 5
An initiative for living evidence synthesis in clinical psychedelic research
Singleton, S. P., Sevchik, B. L., Vandekar, S., Strain, E. C., Nayak, S. M., Dworkin, R. H., Scott, J. C., & Satterthwaite, T. D. (2025) · Nature Mental Health · doi:10.1038/s44220-024-00373-4 · Cited by 5
Phan, J., Middleton, S. L., Azevedo, F., Iley, B. J., Grose-Hodge, M. S., Tyler, S. L., Kapp, S. K., Yeung, S. K., Shaw, J. J., Hartmann, H., et al. (2025) · Journal of Social Issues · doi:10.1111/josi.70035 · Cited by 8
AI adoption among young Indians: an analysis using a MIMIC model
Bera, S., Bera, I., & Rahut, D. B. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-026-06583-8 · Cited by 8
Short-Scale Construction Using Meta-Analytic Ant Colony Optimization
Schroeders, U., Morgenstern, M., Jankowsky, K., & Gnambs, T. (2024) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000818 · Cited by 11
Schimmelpfennig, R., Spicer, R., White, C., Gervais, W. M., Norenzayan, A., Heine, S. J., Henrich, J., & Muthukrishna, M. (2024) · Communications Psychology · doi:10.1038/s44271-024-00135-z · Cited by 5
Agential realism as an alternative philosophy of science perspective for quantitative psychology
Scholz, J. F. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1410047 · Cited by 8
Some Contributions from Embodied Cognition to Psychonarratology
Reali, F., Cevasco, J., & Marmolejo‐Ramos, F. (2024) · Journal of Psycholinguistic Research · doi:10.1007/s10936-024-10110-8 · Cited by 5
Cliff, D. (2024) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2024.115702 · Cited by 7
Fink, L., & Marcus, J. (2024) · Economic Inquiry · doi:10.1111/ecin.13267 · Cited by 5
Pre-Service Teachers’ Perception of Programming Education
Sanusi, I. T., Cudjoe, E. S., Ayanwale, M. A., & Adepoju, B. (2025) · SAGE Open · doi:10.1177/21582440251327019 · Cited by 5
Chakravorti, T., Koneru, S., & Rajtmajer, S. M. (2025) · PLoS ONE · doi:10.1371/journal.pone.0319334 · Cited by 10
The Theory Crisis in Criminology: Causes, Consequences, and Solutions
Ducate, C. S., Bostrom, S. R., Proctor, K. R., & Niemeyer, R. E. (2024) · Theoretical Criminology · doi:10.1177/13624806251372169 · Cited by 9
Predicted as observed? How to identify empirically adequate theoretical constructs
Witte, E. H., Stanciu, A., & Zenker, F. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.980261 · Cited by 6
Segerstrom, S. C., Diefenbach, M. A., Hamilton, K., O'Connor, D. B., & Tomiyama, A. J. (2023) · Psychosomatic Medicine · doi:10.1097/psy.0000000000001186 · Cited by 5
Swallow Reaction Time in Healthy Adults
Ambrocio, K. R., Beall, J., & Garand, K. L. (2023) · Perspectives of the ASHA Special Interest Groups · doi:10.1044/2023_persp-22-00221 · Cited by 5
Is Social Work Research in Crisis?
Dunleavy, D. J., & Lacasse, J. R. (2023) · Research on Social Work Practice · doi:10.1177/10497315231188684 · Cited by 5
Oppenheimer, K. E., Lee, J., Huang, Y. T., & Ratner, N. B. (2023) · Journal of Speech Language and Hearing Research · doi:10.1044/2023_jslhr-23-00173 · Cited by 5
Götz, M., & O’Boyle, E. H. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0742-730120230000041004 · Cited by 8
Tran, J., & Getz, L. M. (2023) · Music Perception An Interdisciplinary Journal · doi:10.1525/mp.2023.41.1.59 · Cited by 5
Aligning organisational priorities and implementation science for cancer research
Best, S., Thursky, K., Buzza, M., Klaic, M., Peters, S., Guccione, L., Trainer, A. H., & Francis, J. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-10801-x · Cited by 7
Bonifay, W. E., Winter, S. D., Skoblow, H., & Watts, A. L. (2024) · Assessment · doi:10.1177/10731911241234118 · Cited by 5
Keenan, H. E., Czippel, A., Heydari, S., Gawryluk, J. R., & Mazerolle, E. L. (2024) · Aging Brain · doi:10.1016/j.nbas.2024.100114 · Cited by 5
Mayiwar, L., Wan, K. H., Løhre, E., & Feldman, G. (2024) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241255916 · Cited by 6
Riesthuis, P., & Otgaar, H. (2024) · Journal of Criminal Psychology · doi:10.1108/jcp-04-2024-0031 · Cited by 5
Mock juries, real trials: how to solve (some) problems with jury science
Ross, L. D. (2024) · Journal of Law and Society · doi:10.1111/jols.12494 · Cited by 5
Hasso, T., Brosnan, M., Ali, S., & Chai, D. (2024) · Pacific-Basin Finance Journal · doi:10.1016/j.pacfin.2024.102564 · Cited by 5
Bakker, B. N., & Schumacher, G. (2025) · Edward Elgar Publishing eBooks · doi:10.4337/9781803924830.00030 · Cited by 5
Common-sense approaches to sharing tabular data alongside publication
Tierney, N. J., & Ram, K. (2021) · Patterns · doi:10.1016/j.patter.2021.100368 · Cited by 5
Prichard, E. C., & Turner, K. A. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1049660 · Cited by 5
Tressoldi, P. E., Rock, A. J., Pederzoli, L., & Houran, J. (2021) · doi:10.31234/osf.io/pr364 · Cited by 5
Röseler, L., Gendlina, T., Krapp, J., Labusch, N., & Schütz, A. (2022) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/8psw2 · Cited by 7
Goedderz, A., Azad, Z. R., & Hahn, A. (2023) · doi:10.31234/osf.io/frwcy · Cited by 5
Network Analysis in Psychopathology: Theoretical Perspectives and Practical Challenges
Serafim, P. H. M., Hasse-Sousa, M., & Czepielewski, L. S. (2025) · Trends in Psychology · doi:10.1007/s43076-025-00438-y · Cited by 4
Decolonising the psychology curriculum: perspectives from faculty at a UK university
de Lucas, I. M., Kent, C. D., Ahmed, N., Ozguc, U., Downey, G., & Allen, P. (2025) · Teaching in Higher Education · doi:10.1080/13562517.2025.2571902 · Cited by 4
A Systematic Scoping Review of Fully Idiographic Network Analysis in Mental Health
Andreoli, G., Rafanelli, C., Hofmann, S. G., & Casu, G. (2025) · Cognitive Therapy and Research · doi:10.1007/s10608-025-10674-2 · Cited by 5
Metadata
- Authors
- Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., Rohrer, J. M., Romero, F., Scheel, A. M., Scherer, L. D., Schönbrodt, F. D., & Vazire, S.
- Affiliations
- Center for Open Science (US)
- University of Amsterdam (NL)
- University of Wisconsin–Madison (US)
- University of California, Davis (US)
- Grand Valley State University (US)
- Stockholm School of Economics (SE)
- The University of Melbourne (AU)
- Illinois State University (US)
- Center for Open Science, Charlottesville, Virginia 22903, USA
- Tilburg University (NL)
- Leipzig University (DE)
- University of Groningen (NL)
- Eindhoven University of Technology (NL)
- University of Colorado Anschutz (US)
- Ludwig-Maximilians-Universität München (DE)
- ORCID
- Venue
- Annual Review of Psychology
- Publisher
- Annual Reviews
- Published
- 2022-01-04
- Volume
- 73
- Issue
- 1
- Pages
- 719-748
- ISSN
- 0066-4308 (ISSN-L)
- 1545-2085
- OpenAlex
- W3161588210
- Cited by
- 770
- References
- 253
- Citations by year
- 2026: 109 · 2025: 192 · 2024: 180 · 2023: 177 · 2022: 92
- FWCI
- 19.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Annual Review of Psychology (publishedVersion)
- PubMed (publishedVersion)
- Research portal (Tilburg University) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- HAL (submittedVersion)
- Minerva Access (University of Melbourne) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, other-oa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Funders
- John Templeton Foundation
- Patient-Centered Outcomes Research Institute
- Arnold Ventures
- European Commission (HORIZON2020, 841188)
- University of Melbourne
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Templeton World Charity Foundation
- Templeton Religion Trust
- National Institutes of Health
- Agency for Healthcare Research and Quality
- Australian Research Council (FT150100297)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- replication, replicability, reproducibility, robustness, research practices, replication study, research incentives
- MeSH terms
- Humans, Research Design, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
