The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
The Value of Direct Replication
Abstract
Reproducibility is the cornerstone of science. If an effect is reliable, any competent researcher should be able to obtain it when using the same procedures with adequate statistical power. Two of the articles in this special section question the value of direct replication by other laboratories. In this commentary, I discuss the problematic implications of some of their assumptions and argue that direct replication by multiple laboratories is the only way to verify the reliability of an effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“almost none of the findings in the literature underwent direct replication attempts”
From Is there a Publication Bias in Behavioural Intranasal Oxytocin Research on Humans? Opening the File Drawer of One Laboratory (2016) · cites this paper as [26]
Citations
Cites
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Recommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M. T., Fruyt, F. D., Houwer, J. D., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R. M., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 876
The Replication Recipe: What makes for a convincing replication?
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner‐Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & Veer, A. V. '. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.10.005 · Cited by 758
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734
Is the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697
Research works printed but not linked: 1
- Roediger H. L., 2012, Observer, 25, 27
Cited by
Sorted by citations
Items 401–500 of 634
Imam, A. A. (2018) · European Journal of Behavior Analysis · doi:10.1080/15021149.2018.1463123 · Cited by 5
Witmer, J. S., Aeschlimann, E. A., Metz, A. J., Troche, S. J., & Rammsayer, T. H. (2018) · Brain Sciences · doi:10.3390/brainsci8080152 · Cited by 5
Adjusting Sample Sizes for Different Categories of Embodied Cognition Research
Skulmowski, A., & Rey, G. D. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02384 · Cited by 5
Reliability of Inference: Analogs of Replication in Qualitative Research
Fairfield, T., & Charman, A. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.012 · Cited by 6
Napolitano, S. C., Lane, S. P., Hepp, J., McDonald, A. E., Trumbower, C., & Trull, T. J. (2021) · Personality Disorders Theory Research and Treatment · doi:10.1037/per0000513 · Cited by 5
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.001 · Cited by 6
Torka, A., Mazei, J., & Hüffmeier, J. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9695 · Cited by 8
Exposure to Media on Perceptions of Violence as a Function of Trait Aggression and Athletic Status
Gross, C. D., & Mendoza, A. T. O. (2018) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn23.2.147 · Cited by 5
Tello, N., Jaafari, N., & Chatard, A. (2020) · Alcohol and Alcoholism · doi:10.1093/alcalc/agaa009 · Cited by 5
Introduction to the Special Issue on Open Science Practices: Badges of Honor
Rouse, S. V. (2018) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn23.2.94 · Cited by 5
Anchoring Effects: Resolving the Contradictions of Personality Moderator Research
Röseler, L. (2021) · doi:10.20378/irb-49951 · Cited by 5
Replication research in education: is the tide turning?
Banerjee, R. (2022) · Educational Research and Evaluation · doi:10.1080/13803611.2021.2022311 · Cited by 4
When and Why to Replicate: As Easy as 1, 2, 3?Preprint
Field, S. M., Hoekstra, R., Bringmann, L. F., & van Ravenzwaaij, D. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/h7js8 · Cited by 6
Goedderz, A., Azad, Z. R., & Hahn, A. (2023) · doi:10.31234/osf.io/frwcy · Cited by 5
Calderon, S., Giolla, E. M., Ask, K., Adler, S. J., Agerström, J., Akpınar, B., Albayrak‐Aydemir, N., Alparone, F. R., Amin, S., Aquino, A., et al. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251401177 · Cited by 9
How generalizable are findings from police surveys? A review of multi-agency studies
Kearns, E. M., & Nix, J. (2023) · Police Practice and Research · doi:10.1080/15614263.2023.2214282 · Cited by 4
Prowten, S. D., Walker, E., London, B., Pearce, E., Napoli, A., Chenevert, B., Clevenger, C. T., & Smith, A. R. (2024) · Psychological Science · doi:10.1177/09567976241257255 · Cited by 4
Replication for Quantitative Research
Jeremy Freese, A., & Peterson, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.010 · Cited by 4
Matarese, V. (2023) · Inquiry · doi:10.1080/0020174x.2023.2278032 · Cited by 8
Laurent, V., Kosinski, T., & Rusinek, S. (2023) · Acta Psychologica · doi:10.1016/j.actpsy.2023.104094 · Cited by 4
Xu, J., & Zhang, R. (2024) · Media and Communication · doi:10.17645/mac.7666 · Cited by 4
Bot, W., & Verkuyten, M. (2018) · Journal of Social and Political Psychology · doi:10.5964/jspp.v6i2.901 · Cited by 4
Transparency and Reproducibility: Conceptualizing the Problem
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.006 · Cited by 4
Measurement Replication in Qualitative and Quantitative Studies
Reiter, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.011 · Cited by 4
Crowdsourcing Global Perspectives in Ecology Using Social Media
Graham, E. B., & Smith, A. P. (2021) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2021.588894 · Cited by 5
The Influence of Affective Priming on the Affective Response During Exercise: A Replication Study
Timme, S., Hutchinson, J., Regorius, A., & Brand, R. (2022) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.2022-0025 · Cited by 4
Comparative Urban Research From Theory To Practice
Riise, J., Palmer, H., & Simon, D. (2020) · Policy Press eBooks · doi:10.51952/9781447354093 · Cited by 12
Kato, T. (2018) · The Japanese Journal of Personality · doi:10.2132/personality.27.2.11 · Cited by 6
Hulbert-Williams, N., Leslie, M. R., Hulbert‐Williams, L., Koczwara, B., Watson, E. K., Hall, P. S., Ashley, L., Coulson, N., Jackson, R., Millington, S., et al. (2021) · JMIR Research Protocols · doi:10.2196/31976 · Cited by 5
Comparative Urban Research From Theory To Practice
Simon, D., Palmer, H., & Riise, J. (2020) · Policy Press eBooks · doi:10.56687/9781447354093 · Cited by 4
Drouin, H., & Davidson, P. S. R. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000102 · Cited by 4
Greenaway, K. H., Fisk, K., & Branscombe, N. R. (2017) · Journal of Applied Social Psychology · doi:10.1111/jasp.12482 · Cited by 4
Hardwicke, T. E. (2017) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/r4c32 · Cited by 4
Reflecting on the Evidence: A Reply to Knight, McShane, et al. (2020)
Nave, G., Daviet, R., Nadler, A., Zava, D. T., & Camerer, C. F. (2020) · Psychological Science · doi:10.1177/0956797620930966 · Cited by 3
Research data management for open science
Lefebvre, A. (2021) · Utrecht University Repository (Utrecht University) · doi:10.33540/447 · Cited by 4
Syntactic influences on numerical processing in adults: Limited but detectablePreprint
Cipora, K., Loenneker, H. D., Soltanlou, M., Lipowska, K., Domahs, F., Goebel, S. M., Haman, M., & Nuerk, H. (2019) · doi:10.31234/osf.io/ewtd4 · Cited by 4
Being accurate about verbal credibility assessmentPreprint
Kleinberg, B., Arntz, A. R., & Verschuère, B. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/h6pxt · Cited by 4
New statistical metrics for multisite replication projectsPreprint
Mathur, M. B., & VanderWeele, T. J. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/w89s5 · Cited by 4
Tello, N., Harika‐Germaneau, G., Serra, W., Jaafari, N., & Chatard, A. (2018) · doi:10.31234/osf.io/esgf5 · Cited by 4
Sætrevik, B., & Hystad, S. W. (2019) · doi:10.31219/osf.io/y6jsa · Cited by 4
Direct Replication in Psychological Assessment Research
Allen, M. S., Iliescu, D., & Greiff, S. (2023) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000755 · Cited by 4
Hardwicke, T. E., Thibault, R. T., Clarke, B., Moodie, N., Crüwell, S., Schiavone, S. R., Handcock, S. A., Nghiem, K. A., Mody, F., Eerola, T., et al. (2024) · doi:10.31234/osf.io/t2zs9 · Cited by 4
Trust in science amid a replication crisis
Hendriks, F. (2025) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2025.102250 · Cited by 3
Three strategies for claiming research progress
Gal, D., Calder, B. J., & Sternthal, B. (2026) · Journal of Consumer Psychology · doi:10.1002/jcpy.70033 · Cited by 3
Lucier‐Greer, M., O’Neal, C. W., & Mancini, J. A. (2023) · Journal of Family Nursing · doi:10.1177/10748407231163588 · Cited by 3
The Production Effect Becomes Spatial
Saint‐Aubin, J., Poirier, M., Yearsley, J. M., & Guitard, D. (2024) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000609 · Cited by 3
Cox, S. K., Root, J. R., McConomy, A., & Davis, K. (2024) · Exceptional Children · doi:10.1177/00144029241259013 · Cited by 4
Investigative Interviewers’ Peer Feedback On a Child Forensic Interview
Sharman, S. J., & Danby, M. C. (2025) · Journal of Police and Criminal Psychology · doi:10.1007/s11896-025-09727-9 · Cited by 3
Sætrevik, B., & Hystad, S. W. (2021) · Scandinavian Journal of Work and Organizational Psychology · doi:10.16993/sjwop.96 · Cited by 3
Psychological Science Accelerator: A Promising Resource for Clinical Psychological Science
Beshears, J. E., Gjoneska, B., Schmidt, K., Pfuhl, G., Saari, T. T., McAuliffe, W. H. B., Steltenpohl, C. N., Onie, S., Chartier, C. R., & Moshontz, H. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_19 · Cited by 4
Alvi, T., Rosenfield, D., Sunahara, C. S., Wallmark, Z., Lee, J., & Tabak, B. A. (2022) · Clinical Psychological Science · doi:10.1177/21677026221104735 · Cited by 3
Conceptual replication study of fifteen JDM effects: Insights from the Polish sample
Sobków, A., Sobczak, A., Latacz, K., Gambuś, P., Tyc, A., Goryczka, K., Barcik, K., Janosz, A., Hetmańczuk, W., Gonczar, T., et al. (2022) · Polish Psychological Bulletin · doi:10.24425/ppb.2022.141862 · Cited by 5
Growth From Uncertainty: Understanding the Replication ‘Crisis’ in Infant Cognition
Lavelle, J. S. (2023) · Philosophy of Science · doi:10.1017/psa.2023.157 · Cited by 3
Can a Good Theory Be Built Using Bad Ingredients?
Field, S. M., Kaznatcheev, A., van Dongen, N. N. N., Warmelink, L., & Wright, C. (2024) · Computational Brain & Behavior · doi:10.1007/s42113-024-00220-w · Cited by 4
Testing the effect of cooperative/competitive priming on the Prisoner’s Dilemma. A replication study
Belaus, A., Reyna, C., & Freidín, E. (2018) · PLoS ONE · doi:10.1371/journal.pone.0209263 · Cited by 4
Seeking Protection, Finding Despair: Closed Preferences as a Model of Neuroticism-Linked Distress
Robinson, M. D., & Irvin, R. L. (2022) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2022.41.3.264 · Cited by 3
Smit, W., Durakovic, E., Sitas, R., Johansson, M. I., Haysom, G., Dymitrow, M., Ingelhag, K., & Kotze, S. (2020) · Policy Press eBooks · doi:10.51952/9781447354093.ch004 · Cited by 3
A technological framework for running and analyzing animal head turning experiments
Oh, J., Hoeschele, M., Reber, S. A., Šlipogor, V., Bugnyar, T., & Fitch, W. T. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0934-2 · Cited by 3
Does a Working Memory Load Really Influence Semantic Priming? A Self-replication Attempt
Heyman, T., Goossens, K., Hutchison, K. A., & Storms, G. (2017) · Collabra Psychology · doi:10.1525/collabra.96 · Cited by 3
Retrieval activates related words more than presentation
Hausman, H., & Rhodes, M. G. (2018) · Memory · doi:10.1080/09658211.2018.1453934 · Cited by 3
Role of Self-Compassion on College Students’ Social Self-Evaluations and Affect Across Two Domains
Saeed, Z., & Sonnentag, T. L. (2018) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn23.2.132 · Cited by 4
Investigating the replicability and generalizability of the negative testing effect.
Wissman, K. T., & Peterson, D. J. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.05.002 · Cited by 3
Schumm, W. R., Crawford, D. W., Higgins, M., Lockett, L., AlRashed, A., & bin Ateeq, A. (2018) · Marriage & Family Review · doi:10.1080/01494929.2018.1500128 · Cited by 3
Habit Reversal to Decrease Filled Pauses in Public Speaking: A Partial Replication
Bördlein, C., & Sander, A. (2019) · Research on Social Work Practice · doi:10.1177/1049731519894663 · Cited by 4
Les pratiques de recherche ouvertes en psychologie
Lantian, A. (2020) · Psychologie Française · doi:10.1016/j.psfr.2020.09.001 · Cited by 6
On Klatzky and Creswell (2014)
Schwartz, B. N. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691614567717 · Cited by 3
Avoiding Bias in the Search for Implicit Bias
Cyrus-Lai, W., Tierney, W., du Plessis, C., Nguyen, M., Schaerer, M., Clemente, E. G., & Uhlmann, E. L. (2022) · Psychological Inquiry · doi:10.1080/1047840x.2022.2106762 · Cited by 3
Clinical Science and the Replicability CrisisPreprint
Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2016) · doi:10.31234/osf.io/uwus7 · Cited by 3
Rae, J. R., Reimer, N. K., Calanchini, J., Lai, C. K., Rivers, A. M., Dasgupta, N., Hewstone, M., & Schmid, K. (2020) · doi:10.31234/osf.io/h4nxd · Cited by 3
Lessons from a “failed” replication: The importance of taking action in explorationPreprint
Sadeghiyeh, H., Wang, S., & Wilson, R. C. (2018) · doi:10.31234/osf.io/ue7dx · Cited by 3
Faster when Fed: Satiated Individuals Inhibit (Food) Pictures Better Than WordsPreprint
Ostende, M. M. V. D. H., Schwarz, U., Gawrilow, C., Kaup, B., & Svaldi, J. (2022) · doi:10.31219/osf.io/m4feq · Cited by 3
Replicating & reproducing policing research
Monk, K. M., & Koziarski, J. (2023) · Police Practice and Research · doi:10.1080/15614263.2023.2221075 · Cited by 3
Wood, J., & van Schalkwyk, I. (2025) · Journal of Transportation Technologies · doi:10.4236/jtts.2025.151010 · Cited by 2
Blanchard, M. D., Aidman, E., Stankov, L., & Kleitman, S. (2025) · Cognitive Research Principles and Implications · doi:10.1186/s41235-025-00655-0 · Cited by 2
Transparency and Reproducibility: Potential Solutions
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.007 · Cited by 2
Programas de intervención y replicabilidad: consideraciones sobre su evaluación en psicología
Romo, J. F. M. (2021) · Revista Iberoamericana de Psicología · doi:10.33881/2027-1786.hrip.14108 · Cited by 4
Personality Traits and Owner-Dog Attachment in a Canadian Sample
Ryan, M. G., Storey, A. E., Anderson, R. E., & Walsh, C. J. (2020) · Human-animal interaction bulletin · doi:10.1079/hai.2020.0018 · Cited by 2
Noisy speech impairs retention of previously heard information only at short time scales
Brown, V. A., Sewell, K., Villanueva, J., & Strand, J. F. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01583-y · Cited by 2
Morgulev, E. (2024) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2024.102759 · Cited by 4
Gerring, J., Karcher, S., & Apfeld, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.015 · Cited by 3
Cognitive reserve in the healthy elderly: cognitive and psychological factors
Zihl, J., Pargent, F., Schmid, A., Almeida, O. F. X., Sousa, N., Walther, K., & Fink, T. (2015) · ScienceOpen Research · doi:10.14293/s2199-1006.1.sor-socsci.a5kkma.v2 · Cited by 2
Cognitive reserve in the healthy elderly: cognitive and psychological factors
Zihl, J., Schmid, A., Almeida, O. F. X., Sousa, N., Walther, K., & Fink, T. (2014) · ScienceOpen Research · doi:10.14293/s2199-1006.1.sor-socsci.adkhnx.v1 · Cited by 2
What’s Wrong with Replicating the Old Boys’ Networks?
Teele, D. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.016 · Cited by 2
Multiplicity Control vs Replication
Hunter, A., Beribisky, N., Farmus, L., & Cribbie, R. A. (2020) · Meta-Psychology · doi:10.15626/mp.2019.1992 · Cited by 2
Khoo, S. Y. (2020) · Journal for Reproducibility in Neuroscience · doi:10.31885/jrn.1.2020.1318 · Cited by 3
Using Class Pass Intervention to Decrease Disruptive Behavior in Young Children
Zuniga, A. N., & Cividini‐Motta, C. (2021) · Journal of Behavioral Education · doi:10.1007/s10864-020-09411-4 · Cited by 2
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.013 · Cited by 2
Lieberman, E. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.003 · Cited by 2
On Mainstreaming Philosophy of Science in Psychology Through “Psychological Theoretics
Oppong, S. (2022) · Roczniki Psychologiczne · doi:10.18290/rpsych2022.0002 · Cited by 2
Preregistration and increased transparency will benefit science
Mellor, D. T. (2017) · European Science Editing · doi:10.31219/osf.io/xsfam · Cited by 3
Shayman, C. S., Stefanucci, J. K., Fino, P. C., & Creem-Regehr, S. H. (2022) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct57072.2022.00062 · Cited by 2
Psychology’s reform movement needs a reconceptualization of scientific expertise
Tunç, D. U., & Tunç, M. N. (2023) · Social Psychological Bulletin · doi:10.32872/spb.10303 · Cited by 3
Ivory, J. (2024) · Media and Communication · doi:10.17645/mac.7852 · Cited by 2
Participant Attentiveness to Consent Forms
Baker, D., & Chartier, C. R. (2018) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn23.2.141 · Cited by 4
Parental Attachment Predicting Emotions and Stress During Positive Life Events
Camden, A. A., & Hughes, J. L. (2018) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn23.2.119 · Cited by 4
Tunca, B., Ziano, I., & Wenting, X. (2022) · Meta-Psychology · doi:10.15626/mp.2020.2538 · Cited by 2
Bullon, P. F. M. (2015) · ScholarWorks - WMU (Western Michigan University) · Cited by 2
Australian and Italian Psychologists’ View of ReplicationPreprint
Fidler, F. M., Fraser, H. S., Thorn, F. S., & Agnoli, F. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ks48e · Cited by 2
The Effect of Haptic and Ambient Temperature Experience on Prosocial BehaviorPreprint
Lynott, D., Corker, K. S., Connell, L., & O’Brien, K. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jk967 · Cited by 2
Aarts, A. A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4176917 · Cited by 2
Metadata
- Authors
- Simons, D. J.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Corresponding author
- Simons, Daniel J.
- ORCID
- Simons, Daniel J.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2014-01
- Volume
- 9
- Issue
- 1
- Pages
- 76-80
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2077240377
- Cited by
- 630
- References
- 18
- Citations by year
- 2026: 18 · 2025: 36 · 2024: 29 · 2023: 44 · 2022: 51 · 2021: 69 · 2020: 91 · 2019: 75 · 2018: 67 · 2017: 47 · 2016: 36 · 2015: 48 · 2014: 18
- FWCI
- 48.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Perspectives on Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- direct replication, reproducibility, statistical power, replication study, research credibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review