The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
The Value of Direct Replication
Abstract
Reproducibility is the cornerstone of science. If an effect is reliable, any competent researcher should be able to obtain it when using the same procedures with adequate statistical power. Two of the articles in this special section question the value of direct replication by other laboratories. In this commentary, I discuss the problematic implications of some of their assumptions and argue that direct replication by multiple laboratories is the only way to verify the reliability of an effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“almost none of the findings in the literature underwent direct replication attempts”
From Is there a Publication Bias in Behavioural Intranasal Oxytocin Research on Humans? Opening the File Drawer of One Laboratory (2016) · cites this paper as [26]
Citations
Cites
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Recommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M. T., Fruyt, F. D., Houwer, J. D., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R. M., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 876
The Replication Recipe: What makes for a convincing replication?
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner‐Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & Veer, A. V. '. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.10.005 · Cited by 758
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734
Is the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697
Research works printed but not linked: 1
- Roediger H. L., 2012, Observer, 25, 27
Cited by
Sorted by citations
Items 301–400 of 634
Bell, R., Komar, G. F., Mieth, L., & Buchner, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-46169-x · Cited by 11
Many nonnormalities, one simulation: Do different data generation algorithms affect study results?
Fairchild, A. J., Yin, Y., Baraldi, A. N., Astivia, O. L. O., & Shi, D. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02364-w · Cited by 15
Thou Shalt Be Reproducible! A Technology Perspective
Mair, P. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01079 · Cited by 12
Vrijhof, C. I., van der Voort, A., van IJzendoorn, M. H., & Euser, S. (2017) · Journal of Family Psychology · doi:10.1037/fam0000345 · Cited by 11
Reporting in Experimental Philosophy: Current Standards and Recommendations for Future Practice
Polonioli, A., Vega‐Mendoza, M., Blankinship, B., & Carmel, D. (2018) · Review of Philosophy and Psychology · doi:10.1007/s13164-018-0414-3 · Cited by 12
Open Science in Data-Intensive Psychology and Cognitive Science
Paxton, A., & Tullett, A. M. (2019) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732218790283 · Cited by 11
Krepel, N., van Dijk, H., Sack, A. T., Swatzyna, R. J., & Arns, M. (2021) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108188 · Cited by 11
Regenwetter, M., Robinson, M. M., & Wang, C. (2022) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221074653 · Cited by 11
Thinking About God Causes Internal Reflection in Believers and Unbelievers of God
Kitchens, M. B. (2015) · Self and Identity · doi:10.1080/15298868.2015.1072108 · Cited by 11
Does testing impair relational processing? Failed attempts to replicate the negative testing effect.
Rawson, K. A., Wissman, K. T., & Vaughn, K. E. (2015) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000127 · Cited by 11
The replicability of the negative testing effect: differences across participant populations
Mulligan, N. W., Rawson, K. A., Peterson, D. J., & Wissman, K. T. (2018) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000490 · Cited by 10
Perspectives: replication is more than meets the eye
Bergkvist, L., Keyzer, F. D., & Buzeta, C. (2023) · International Journal of Advertising · doi:10.1080/02650487.2023.2245278 · Cited by 11
Windshield Bias, Car Brain, Motornormativity: Different Names, Same Obscured Public Health Hazard
Goddard, T. (2024) · Findings · doi:10.32866/001c.122974 · Cited by 10
Estimating the replicability of technology education research
Buckley, J., Hyland, T., & Seery, N. (2022) · International Journal of Technology and Design Education · doi:10.1007/s10798-022-09787-6 · Cited by 11
Winter, K., Menne, N. M., Bell, R., & Buchner, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-33424-4 · Cited by 11
A weight‐related growth mindset increases negative attitudes toward obese people
Hooper, N., Crumpton, A., Robinson, M. D., & Meier, B. P. (2018) · Journal of Applied Social Psychology · doi:10.1111/jasp.12528 · Cited by 11
Witherby, A. E., Tauber, S. K., Rhodes, M. G., & Castel, A. D. (2018) · Psychology and Aging · doi:10.1037/pag0000322 · Cited by 10
Temporal Discounting in Software Engineering: A Replication Study
Fagerholm, F., Becker, C., Chatzigeorgiou, A., Betz, S., Duboc, L., Penzenstadler, B., Mohanani, R., & Venters, C. C. (2019) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2019.8870161 · Cited by 10
Successive relearning improves performance on a high‐stakes exam in a difficult biopsychology course
Janes, J. L., Dunlosky, J. T., Rawson, K. A., & Jasnow, A. M. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3699 · Cited by 10
The effect of question type on resistance to misinformation about present and absent details
Brubacher, S. P., Sharman, S. J., Scoboria, A., & Powell, M. B. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3742 · Cited by 10
Trust in Science and Scientists: Implications for (Higher) Education
Vaupotič, N., Kienhues, D., & Jucks, R. (2021) · Springer eBooks · doi:10.1007/978-3-030-72945-5_10 · Cited by 13
Design-Based Approaches to Causal Replication Studies
Wong, V. C., Anglin, K., & Steiner, P. M. (2021) · Prevention Science · doi:10.1007/s11121-021-01234-7 · Cited by 13
Ten simple rules for designing and conducting undergraduate replication projects
Moreau, D., & Wiebels, K. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010957 · Cited by 14
Modeling verbal short-term memory: A walk around the neighborhood.
Saint‐Aubin, J., Poirier, M., Yearsley, J. M., Robichaud, J., & Guitard, D. (2023) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001226 · Cited by 9
Keener, S. K., Kepes, S., & Torka, A. (2023) · Acta Psychologica · doi:10.1016/j.actpsy.2023.104005 · Cited by 12
A Plea for Preregistration in Personality Disorders Research: The Case of Psychopathy
Verschuère, B., Yasrebi, F., van Zelm, I., & Lilienfeld, S. O. (2019) · Journal of Personality Disorders · doi:10.1521/pedi_2019_33_426 · Cited by 10
Investigation of collaborative inhibition for key‐term definitions
Wissman, K. T. (2019) · Applied Cognitive Psychology · doi:10.1002/acp.3606 · Cited by 11
Cho, K. W. (2022) · Journal of Psychoeducational Assessment · doi:10.1177/07342829211063286 · Cited by 9
Matching and Behavioral Contrast in a Two‐Option Repeated Investment Simulation
Hantula, D. A., & Crowell, C. R. (2015) · Managerial and Decision Economics · doi:10.1002/mde.2717 · Cited by 9
Reflections on the Replication Corner: In Praise of Conceptual Replications
Lynch, J. G., Bradlow, E. T., Huber, J. C., & Lehmann, D. R. (2015) · Springer eBooks · doi:10.1007/978-3-031-88060-5_20 · Cited by 9
Anicich, E. M. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614549772 · Cited by 9
Cook, B. G. (2016) · Behavioral Disorders · doi:10.17988/0198-7429-41.3.161 · Cited by 9
Mayiwar, L., & Lai, L. M. H. (2019) · Social Psychology · doi:10.1027/1864-9335/a000388 · Cited by 9
Grahe, J. E., & Cuccolo, K. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009000796.014 · Cited by 9
Using meta-analysis for evidence synthesis: The case of incomplete neutralization in GermanPreprint
Nicenboim, B., Roettger, T. B., & Vasishth, S. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/p5a4z · Cited by 9
Charting the Constellation of Science Reform
Field, S. M. (2022) · Liberate Science GmbH eBooks · doi:10.53962/meeb-2ktd · Cited by 11
Body image flexibility and exercise motivation: A two-sample replication study
Leung, K. K., Sick, K., Huellemann, K. L., & Pila, E. (2023) · Body Image · doi:10.1016/j.bodyim.2023.06.006 · Cited by 10
Does oxytocin shield against negative effects of ostracism? A replication and extension
Pfundmair, M., & Echterhoff, G. (2021) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108128 · Cited by 11
Martin, J. J., & Martin, D. (2021) · Kinesiology Review · doi:10.1123/kr.2020-0067 · Cited by 8
Ziano, I., Xiao, Q., Yeung, S. K., Wong, C. Y., Cheung, M. Y., Lo, C. Y. J., Yan, H. C., Narendra, G. I., Kwan, L. W., Chow, C. S., et al. (2021) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2021.104222 · Cited by 9
Hernández-Martínez, J., Cerda, M. A. C., Vera-Assaoka, T. F., Carter-Thuillier, B. I., Herrera-Valenzuela, T., Guzmán-Muñoz, E., Branco, B. H. M., Jofré‐Saldía, E., & Valdés-Badilla, P. A. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192013335 · Cited by 8
Robinson, M. D., Irvin, R. L., Pringle, T. A., & Klein, R. J. (2023) · Intelligence · doi:10.1016/j.intell.2023.101760 · Cited by 9
Collaborative Retrieval Practice Reduces Mind-Wandering During Learning
Knopps, A. G., & Wissman, K. T. (2023) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000589 · Cited by 11
TDCS over PPC or DLPFC does not improve visual working memory capacity
Jiang, S., Jones, M., & von Bastian, C. C. (2024) · Communications Psychology · doi:10.1038/s44271-024-00067-8 · Cited by 9
Persich, M. R., Bair, J. L., Steinemann, B., Nelson, S., Fetterman, A. K., & Robinson, M. D. (2018) · Cognition & Emotion · doi:10.1080/02699931.2018.1504746 · Cited by 8
On the failure to replicate past findings regarding positive affirmations and self-esteem
Flynn, M. K., & Bordieri, M. J. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.03.003 · Cited by 8
Are affective factors related to individual differences in facial expression recognition?
Alharbi, S. A. H., Button, K. S., Zhang, L., O’Shea, K. J., Fasolt, V., Lee, A. J., DeBruine, L. M., & Jones, B. C. (2020) · Royal Society Open Science · doi:10.1098/rsos.190699 · Cited by 8
Daley, N., & Rawson, K. A. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09553-x · Cited by 8
Milot‐Lapointe, F., Corff, Y. L., & Savard, R. (2021) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2021.1959518 · Cited by 8
Preregistration: Practical Considerations for Speech, Language, and Hearing Research
Brown, V. A., & Strand, J. F. (2022) · Journal of Speech Language and Hearing Research · doi:10.1044/2022_jslhr-22-00317 · Cited by 10
Accessing acute medical care to protect health: the utility of community treatment orders
Segal, S. P., Badran, L., & Rimes, L. (2022) · General Psychiatry · doi:10.1136/gpsych-2022-100858 · Cited by 8
Harman, J., Giancarlo, C., Lorandos, D., & Ludmer, B. (2023) · Children and Youth Services Review · doi:10.1016/j.childyouth.2023.107187 · Cited by 12
Replication in experimental management accounting research - an editorial
Brüggen, A., Maas, V. S., & den Abbeele, A. G. H. L. V. (2021) · Journal of Management Control · doi:10.1007/s00187-021-00324-5 · Cited by 8
Chester, D. S., & DeWall, C. N. (2017) · doi:10.31234/osf.io/4w95m · Cited by 8
Charting the Constellation of Science Reform
Field, S. M. (2022) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.229114775 · Cited by 23
Kleinberg, B., Warmelink, L., Arntz, A. R., & Verschuère, B. (2018) · Applied Cognitive Psychology · doi:10.1002/acp.3439 · Cited by 7
Individual differences in working memory capacity and visual search while reading
Redden, R. S., Eady, K., Klein, R. M., & Saint‐Aubin, J. (2022) · Memory & Cognition · doi:10.3758/s13421-022-01357-4 · Cited by 7
Pendrous, R., Hulbert‐Williams, L., Hochard, K. D., & Hulbert-Williams, N. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.02.003 · Cited by 9
Kim, Y. A. (2020) · World Patent Information · doi:10.1016/j.wpi.2020.101987 · Cited by 7
Arousal affects short-term serial recall.
Landry, É. R., Guitard, D., & Saint‐Aubin, J. (2022) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/cep0000272 · Cited by 7
Baur, J., Krohmer, K., Naumann, E., & Svaldi, J. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2022.104210 · Cited by 9
Open‐hearted: Preferences for openness in the agreeableness domain
Robinson, M. D., Lindquist, J. A., & Irvin, R. L. (2023) · Journal of Personality · doi:10.1111/jopy.12829 · Cited by 7
Nickel, L. B., Iveniuk, J., & Roberts, B. (2016) · Social Psychology and Personality Science · doi:10.1177/1948550616662026 · Cited by 8
Does Power Increase Self-Control? Episodic Priming May Not Provide the Answer
Heller, S., & Ullrich, J. (2017) · Collabra Psychology · doi:10.1525/collabra.48 · Cited by 7
Elaborations in Expository Text Impose a Substantial Time Cost but Do Not Enhance Learning
Daley, N., & Rawson, K. A. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9451-9 · Cited by 7
The power motive as a predictor of receptiveness to nonverbal behavior in sport
Furley, P., Schweizer, G., & Wegner, M. (2019) · Motivation and Emotion · doi:10.1007/s11031-019-09788-4 · Cited by 7
Unburdening the Shoulders of Giants: A Quest for Disconnected Academic Psychology
Krpan, D. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620904775 · Cited by 8
Risky Tests of Etiological Models in Psychopathology Research: The Need for Meta-Methodology
Lilienfeld, S. O., & Pinto, M. D. (2015) · Psychological Inquiry · doi:10.1080/1047840x.2015.1039920 · Cited by 7
Chatard, A., Bocage-Barthélémy, Y., Selimbegović, L., & Guimond, S. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/p7kfh · Cited by 6
Continuous-Time Deconvolutional Regression for Psycholinguistic ModelingPreprint
Shain, C., & Schuler, W. (2019) · doi:10.31234/osf.io/whvk5 · Cited by 6
A Case for Cognitive Models in Visualization ResearchPreprint
Padilla, L. (2019) · doi:10.31234/osf.io/sgykb · Cited by 7
Holbrook, A., Park, B., Baldwin, S. A., Riesel, A., Larson, M. J., & Clayson, P. (2025) · Psychophysiology · doi:10.1111/psyp.70042 · Cited by 6
Wen, Y., & Grainger, J. (2025) · Language Cognition and Neuroscience · doi:10.1080/23273798.2025.2496910 · Cited by 6
Majority Members’ Feelings About Political Representation of Muslim Immigrants
Verkuyten, M., Hindriks, P., & Coenders, M. (2016) · Social Psychology · doi:10.1027/1864-9335/a000279 · Cited by 6
Bijlstra, G., Furley, P., & Nieuwenhuys, A. (2019) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2019.101612 · Cited by 7
Miller, A. L., Wissman, K. T., & Peterson, D. J. (2022) · Applied Cognitive Psychology · doi:10.1002/acp.3939 · Cited by 7
Psychology: Where history, culture, and biology meet
Newton, T. (2022) · Theory & Psychology · doi:10.1177/09593543221131782 · Cited by 21
Changing views: the effect of explicit perception-focus instructions on perspective-taking
Damen, D., van Amelsvoort, M., van der Wijst, P., & Krahmer, E. (2019) · Journal of Cognitive Psychology · doi:10.1080/20445911.2019.1606000 · Cited by 6
The probability of conceptual replication and the variability of effect size
Ward, M., & Kemp, S. P. T. (2019) · Methods in Psychology · doi:10.1016/j.metip.2019.100002 · Cited by 6
Carney, M., & Davies, B. (2020) · Journal of Computer Applications in Archaeology · doi:10.5334/jcaa.52 · Cited by 6
Genopolitics: introductory remarks
Wajzer, M. (2020) · Interdisciplinary Science Reviews · doi:10.1080/03080188.2020.1791504 · Cited by 6
Playground for multi-level modeling constructs
Somogyi, F. A., Mezei, G., Theisz, Z., Bácsi, S., & Palatinszky, D. (2021) · Software & Systems Modeling · doi:10.1007/s10270-021-00900-2 · Cited by 6
Bilingualism, executive function, and beyond
Алексеевна, С. И., Spradlin, L., & Valian, V. V. (2019) · Studies in bilingualism · doi:10.1075/sibil.57.01sek · Cited by 6
Bilingualism and executive function
Алексеевна, С. И., & Spradlin, L. (2016) · Linguistic Approaches to Bilingualism · doi:10.1075/lab.16031.sek · Cited by 6
Wissman, K. T., & Rawson, K. A. (2017) · Memory & Cognition · doi:10.3758/s13421-017-0752-x · Cited by 6
Liang, G., Newell, B. R., Rakow, T., & Yechiam, E. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01594-w · Cited by 6
Dialect Interference in Lexical Processing: Effects of Familiarity and Social Stereotypes
Clopper, C. G. (2016) · Phonetica · doi:10.1159/000446809 · Cited by 7
Half a century of Lighting Research & Technology: A bibliometric review
Chen, Q., Ru, T., Zhai, D., Huang, X., Li, Y., Qian, L., Wang, Y., & Zhou, G. (2019) · Lighting Research & Technology · doi:10.1177/1477153519857788 · Cited by 6
The Influence of Naive and Media-Informed Beliefs on Juror Evaluations of Forensic Science Evidence
Lawson, V. Z. (2014) · CUNY Academic Works (City University of New York) · Cited by 5
Honeycutt, N., Careem, A., Lewis, N. A., & Jussim, L. J. (2020) · doi:10.31234/osf.io/ezp6d · Cited by 5
Reproducible Research in R: A Tutorial on how to Do the Same Thing More Than OncePreprint
Peikert, A., Lissa, C. J. V., & Brandmaier, A. M. (2021) · doi:10.31234/osf.io/fwxs4 · Cited by 6
Priming Resistance to Persuasion decreases adherence to Conspiracy TheoriesPreprint
Bonetto, É., Adam‐Troian, J., Varet, F., Monaco, G. L., & Girandola, F. (2018) · doi:10.31234/osf.io/3dh59 · Cited by 6
Benefits of Open and High-Powered Research Outweigh CostsPreprint
LeBel, E. P., Campbell, L., & Loving, T. J. (2016) · doi:10.31234/osf.io/fcxge · Cited by 6
A Philosophy of the Humanities
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · doi:10.1093/9780197749647.001.0001 · Cited by 5
Bertin, P., & Nera, K. (2025) · International Review of Social Psychology · doi:10.5334/irsp.979 · Cited by 6
Signorelli, A., Morganti, A., & Pascoletti, S. (2021) · Form re - Open Journal per la formazione in rete · doi:10.36253/form-12127 · Cited by 7
Skowronski, J. J., Crouch, J. L., & Milner, J. S. (2022) · Psychological Reports · doi:10.1177/00332941221084901 · Cited by 6
Testing an Evaluation Tool to Facilitate Police Officers’ Peer Review of Child Interviews
Danby, M. C., Sharman, S. J., & Guadagno, B. L. (2022) · Journal of Police and Criminal Psychology · doi:10.1007/s11896-022-09516-8 · Cited by 5
Milot‐Lapointe, F., & Corff, Y. L. (2023) · Journal of Employment Counseling · doi:10.1002/joec.12215 · Cited by 5
Zajonz, P., Vaughan, R. S., & Laborde, S. (2024) · The Sport Psychologist · doi:10.1123/tsp.2023-0118 · Cited by 10
Metadata
- Authors
- Simons, D. J.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Corresponding author
- Simons, Daniel J.
- ORCID
- Simons, Daniel J.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2014-01
- Volume
- 9
- Issue
- 1
- Pages
- 76-80
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2077240377
- Cited by
- 630
- References
- 18
- Citations by year
- 2026: 18 · 2025: 36 · 2024: 29 · 2023: 44 · 2022: 51 · 2021: 69 · 2020: 91 · 2019: 75 · 2018: 67 · 2017: 47 · 2016: 36 · 2015: 48 · 2014: 18
- FWCI
- 48.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Perspectives on Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- direct replication, reproducibility, statistical power, replication study, research credibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review