The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
The Value of Direct Replication
Abstract
Reproducibility is the cornerstone of science. If an effect is reliable, any competent researcher should be able to obtain it when using the same procedures with adequate statistical power. Two of the articles in this special section question the value of direct replication by other laboratories. In this commentary, I discuss the problematic implications of some of their assumptions and argue that direct replication by multiple laboratories is the only way to verify the reliability of an effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“almost none of the findings in the literature underwent direct replication attempts”
From Is there a Publication Bias in Behavioural Intranasal Oxytocin Research on Humans? Opening the File Drawer of One Laboratory (2016) · cites this paper as [26]
Citations
Cites
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Recommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M. T., Fruyt, F. D., Houwer, J. D., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R. M., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 876
The Replication Recipe: What makes for a convincing replication?
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner‐Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & Veer, A. V. '. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.10.005 · Cited by 758
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734
Is the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697
Research works printed but not linked: 1
- Roediger H. L., 2012, Observer, 25, 27
Cited by
Sorted by citations
Items 201–300 of 634
Kallitsounaki, A., Williams, D. M., & Lind, S. E. (2020) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-020-04626-w · Cited by 34
Chinman, M., Acosta, J., Ebener, P. A., & Shearer, A. L. (2021) · Prevention Science · doi:10.1007/s11121-021-01286-9 · Cited by 26
Size (mostly) doesn’t matter: the role of set size in object substitution masking
Filmer, H. L., Mattingley, J. B., & Dux, P. E. (2014) · Attention Perception & Psychophysics · doi:10.3758/s13414-014-0692-5 · Cited by 25
Braun, L., Göllner, R., Rieger, S., Trautwein, U., & Spengler, M. (2020) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000295 · Cited by 27
Using more different and more familiar targets improves the detection of concealed information
Suchotzki, K., Houwer, J. D., Kleinberg, B., & Verschuère, B. (2018) · Acta Psychologica · doi:10.1016/j.actpsy.2018.01.010 · Cited by 23
In Search Of True Things Worth Knowing: Considerations For A New Article Prototype
Tullett, A. M. (2015) · Social and Personality Psychology Compass · doi:10.1111/spc3.12166 · Cited by 24
Kang, J., & Girouard, A. (2022) · ACM Transactions on Computing Education · doi:10.1145/3517132 · Cited by 24
Does Language Matter? Exploring Chinese–Korean Differences in Holistic Perception
Rhode, A. K., Voyer, B. G., & Gleibs, I. H. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01508 · Cited by 25
Zamary, A., & Rawson, K. A. (2016) · Educational Psychology Review · doi:10.1007/s10648-016-9396-9 · Cited by 24
The interaction effect of mobile phone screen and product orientation on perceived product size
Schmidt, L., & Maier, E. (2019) · Psychology and Marketing · doi:10.1002/mar.21214 · Cited by 25
Positive Disability Identity Predicts Sense of Belonging in Emerging Adults With a Disability
Raver, A., Murchake, H., & Chalk, H. M. (2018) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn23.2.157 · Cited by 31
Underscoring the F in FoMO: How does anxiety sensitivity contribute to fear of missing out?
Fitzgerald, H. E., Lubin, R. E., Duncan, T., Hiserodt, M., & Otto, M. W. (2022) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2022.2131619 · Cited by 25
Overview authors rarely defined systematic reviews that are included in their overviews
Faggion, C. M., & Diaz, K. T. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.01.004 · Cited by 23
Rubin, M. (2019) · Synthese · doi:10.1007/s11229-019-02433-0 · Cited by 26
Changing the logic of replication: A case from infant studies
Margoni, F., & Shepperd, M. (2020) · Infant Behavior and Development · doi:10.1016/j.infbeh.2020.101483 · Cited by 22
Moeller, J., Dietrich, J., Neubauer, A. B., Brose, A., Kühnel, J., Dehne, M., Jaehne, M. F., Schmiedek, F., Bellhäuser, H., Malmberg, L., et al. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5wsna · Cited by 26
Predicting the Replicability of Social Science Lab ExperimentsPreprint
Altmejd, A., Dreber, A., Forsell, E., Ho, T., Huber, J., Imai, T., Johannesson, M., Kirchler, M., Nave, G., & Camerer, C. F. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/zamry · Cited by 23
Practices and attitudes toward replication in empirical translation and interpreting studies
Olalla-Soler, C. (2019) · Target International Journal of Translation Studies · doi:10.1075/target.18159.ola · Cited by 24
Effects of decision-making on indoor bouldering performances: A multi-experimental study approach
Medernach, J. P., & Memmert, D. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250701 · Cited by 22
Većkalov, B., Gligorić, V., & Petrović, M. (2024) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2023.104549 · Cited by 14
A New Replication Norm for Psychology
LeBel, E. P. (2015) · Collabra · doi:10.1525/collabra.23 · Cited by 27
Furley, P., Schnuerch, R., & Gibbons, H. (2016) · Social Neuroscience · doi:10.1080/17470919.2016.1182586 · Cited by 22
Using tests to reduce mind-wandering during learning review
Peterson, D. J., & Wissman, K. T. (2020) · Memory · doi:10.1080/09658211.2020.1748657 · Cited by 25
Why does collaborative retrieval improve memory? Enhanced relational and item-specific processing
Wissman, K. T., & Rawson, K. A. (2015) · Journal of Memory and Language · doi:10.1016/j.jml.2015.05.003 · Cited by 23
Overcoming the 99mTc shortage: are options being overlooked?
Pillai, M. R. A., & Knapp, F. F. (2011) · PubMed · Cited by 22
Heitland, I., Groenink, L., van Gool, J. M. G., Domschke, K., Reif, A., & Baas, J. M. P. (2015) · Genes Brain & Behavior · doi:10.1111/gbb.12276 · Cited by 23
An overview of applied robust methods
Yuan, K., & Gomer, B. (2021) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12230 · Cited by 21
The Relationship Between Immorality and Cleansing
Siev, J., Zuckerman, S. E., & Siev, J. J. (2018) · Social Psychology · doi:10.1027/1864-9335/a000349 · Cited by 23
Situational experience around the world: A replication and extension in 62 countries
Lee, D. I., Gardiner, G., Baranski, E. N., Members of The International Situations Project, & Funder, D. C. (2020) · Journal of Personality · doi:10.1111/jopy.12558 · Cited by 21
Efendić, E., & van Zyl, L. E. (2019) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v45i0.1607 · Cited by 26
Linares, C., & Sellier, A.-L. (2021) · PLoS ONE · doi:10.1371/journal.pone.0251451 · Cited by 23
Decision time and confidence predict choosers' identification performance in photographic showups
Sauerland, M., Σαγανά, Ά., Sporer, S. L., & Wixted, J. T. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190416 · Cited by 20
Psychologists’ psychologies of psychologists in a time of crisis.
Morawski, J. G. (2020) · History of Psychology · doi:10.1037/hop0000140 · Cited by 22
Tunç, D. U., & Tunç, M. N. (2020) · doi:10.31234/osf.io/pdm7y · Cited by 20
Israel, T., Goodman, J. A., Merrill, C. R. S., Lin, Y.-J. R., Kary, K. G., Matsuno, E. G., & Choi, A. Y. (2020) · Journal of Homosexuality · doi:10.1080/00918369.2020.1804262 · Cited by 20
Davies, S. T., Lloyd, C. D., & Polaschek, D. L. L. (2021) · Assessment · doi:10.1177/1073191121993216 · Cited by 19
Is the Mind Inherently Predicting? Exploring Forward and Backward Looking in Language Processing
Onnis, L., Lim, A., Cheung, S., & Huettig, F. (2022) · Cognitive Science · doi:10.1111/cogs.13201 · Cited by 18
The Contagion of Interstate Violence
Li, M., Leidner, B., Euh, H., & Choi, H. (2016) · Personality and Social Psychology Bulletin · doi:10.1177/0146167216649609 · Cited by 19
Klein, R. J., Liu, T., Diehl, D., & Robinson, M. D. (2017) · Journal of Research in Personality · doi:10.1016/j.jrp.2017.07.006 · Cited by 22
Ironic efficiency in automation-aided signal detection
Bartlett, M. L., & McCarley, J. S. (2020) · Ergonomics · doi:10.1080/00140139.2020.1809716 · Cited by 20
Ferguson, M. J., Carter, T. J., & Hassin, R. R. (2014) · Cited by 19
Denning, E. C., Brannan, D., Murphy, L. A., Losco, J. A., & Payne, D. (2018) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn23.2.166 · Cited by 22
Anier, N., Roebroeck, É., Kleinlogel, E. P., Badea, C., Nugier, A., Berthon, M., & Guimond, S. (2019) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2019.07.006 · Cited by 18
Judgments of learning enhance recall for category-cued but not letter-cued items
Rivers, M. L., Dunlosky, J. T., Janes, J. L., Witherby, A. E., & Tauber, S. K. (2023) · Memory & Cognition · doi:10.3758/s13421-023-01417-3 · Cited by 19
Interference between face and non-face domains of perceptual expertise: a replication and extension
Curby, K. M., & Gauthier, L. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00955 · Cited by 18
Many Replications Do Not Causal Inferences Make
Larzelere, R. E., Cox, R. B., & Swindle, T. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691614567904 · Cited by 17
An examination of job embeddedness and organizational commitment in the context of HRD practices
Philip, J., & Medina‐Craven, M. N. (2022) · Management Research Review · doi:10.1108/mrr-03-2021-0224 · Cited by 17
Comparing retrieval-based practice and peer instruction in physics learning
Zu, T., Munsell, J., & Rebello, N. S. (2019) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.15.010105 · Cited by 17
Quality of Life in Youth With Chronic Pain
Lee, S., McMurtry, C., Summers, C., Edwards, K., Elik, N., & Lumley, M. N. (2020) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000820 · Cited by 13
Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective
Reischer, H. N., & Cowan, H. R. (2020) · Collabra Psychology · doi:10.1525/collabra.284 · Cited by 22
Hypotension and Environmental Noise: A Replication Study
Lercher, P., Widmann, U., & Thudium, J. (2014) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph110908661 · Cited by 17
Hindriks, P., Verkuyten, M., & Coenders, M. (2016) · Political Psychology · doi:10.1111/pops.12356 · Cited by 17
The effect of haptic and ambient temperature experience on prosocial behavior.
Lynott, D., Corker, K. S., Connell, L., & O’Brien, K. (2017) · Archives of Scientific Psychology · doi:10.1037/arc0000031 · Cited by 19
Campbell’s Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating
Klonsky, E. D. (2024) · Assessment · doi:10.1177/10731911241253430 · Cited by 23
Are Provided Examples or Faded Examples More Effective for Declarative Concept Learning?
Zamary, A., & Rawson, K. A. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9433-y · Cited by 16
Furley, P., & Memmert, D. (2020) · Journal of Nonverbal Behavior · doi:10.1007/s10919-020-00342-2 · Cited by 16
Revisiting “money illusion”: Replication and extension of Shafir, Diamond, and Tversky (1997)
Ziano, I., Li, J., Tsun, S. M., Lei, H. C., Kamath, A. A., Cheng, B., & Feldman, G. (2020) · Journal of Economic Psychology · doi:10.1016/j.joep.2020.102349 · Cited by 15
Optimizing Expectations via Mobile Apps: A New Approach for Examining and Enhancing Placebo Effects
Gruszka, P., Burger, C., & Jensen, M. P. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00365 · Cited by 15
Maier, E. (2019) · International Journal of Electronic Commerce · doi:10.1080/10864415.2018.1512281 · Cited by 16
Robinson, M. D., Bair, J. L., Liu, T., Scott, M. J., & Penzel, I. B. (2016) · Sex Roles · doi:10.1007/s11199-016-0706-y · Cited by 16
Individual differences in emotional distress and susceptibility to inattentional blindness.
Bredemeier, K., Hur, J., Berenbaum, H., Heller, W., & Simons, D. J. (2014) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000032 · Cited by 15
Self-citationEvaluating the Replicability of Social Priming Studies
Giolla, E. M., Karlsson, S., Neequaye, D. A., & Bergquist, M. (2024) · Meta-Psychology · doi:10.15626/mp.2022.3308 · Cited by 23
Hardwicke, T. E., Thibault, R. T., Clarke, B., Moodie, N., Crüwell, S., Schiavone, S. R., Handcock, S. A., Nghiem, K. A., Mody, F., Eerola, T., et al. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241283477 · Cited by 29
Davis, C. N., Slutske, W. S., Martin, N. G., Arpana Agrawal, A., & Lynskey, M. T. (2018) · Psychological Medicine · doi:10.1017/s0033291718002325 · Cited by 14
Lawrence, A. V., Cardoza, J. A., & Ryan, L. (2020) · Hippocampus · doi:10.1002/hipo.23203 · Cited by 13
Making Research Data Accessible
Kapiszewski, D., & Karcher, S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.008 · Cited by 15
Does testing increase spontaneous mediation in learning semantically related paired associates?
Cho, K. W., Neely, J. H., Brennan, M. K., Vitrano, D., & Crocco, S. (2017) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000414 · Cited by 14
When does practice testing promote transfer on deductive reasoning tasks?
Wissman, K. T., Zamary, A., & Rawson, K. A. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.03.002 · Cited by 14
Dual-hormone regulation of psychopathy: Evidence from mass spectrometry
Roy, A. R. K., Cook, T., Carré, J. M., & Welker, K. M. (2018) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2018.09.006 · Cited by 14
Brown, G., & Harris, L. R. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316832134.007 · Cited by 14
Kekecs, Z., Pálfi, B., Szászi, B., Szécsi, P., Zrubka, M., Kovács, M., Bakos, B. E., Cousineau, D., Tressoldi, P. E., Schmidt, K., et al. (2019) · doi:10.31234/osf.io/uwk7y · Cited by 14
Does Power Reduce Temporal Discounting? Commentary on Joshi and Fast (2013)
Zhang, M., & Smith, P. K. (2018) · Psychological Science · doi:10.1177/0956797617754219 · Cited by 13
Seiler, K., Schweizer, G., & Seiler, R. (2017) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2017.12.007 · Cited by 13
Sharman, S. J., Coomber, K., Mayshak, R., Curtis, A., Hyder, S., Walker, A., Liknaitzky, P., & Miller, P. G. (2019) · Journal of Interpersonal Violence · doi:10.1177/0886260519881006 · Cited by 13
Improving the reproducibility of findings by updating research methodology
Klein, J. (2021) · Quality & Quantity · doi:10.1007/s11135-021-01196-6 · Cited by 19
A multilingual preregistered replication of the semantic mismatch effect on serial recall.
Röer, J. P., Bell, R., Buchner, A., Saint‐Aubin, J., Sonier, R.-P., Marsh, J. E., Moore, S. B., Kershaw, M., Ljung, R., & Arnström, S. (2021) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001066 · Cited by 12
Does testing enhance new learning because it insulates against proactive interference?
Ahn, D., & Chan, J. C. K. (2022) · Memory & Cognition · doi:10.3758/s13421-022-01273-7 · Cited by 12
Epistemic Functions of Replicability in Experimental Sciences: Defending the Orthodox View
Sikorski, M., & Andreoletti, M. (2023) · Foundations of Science · doi:10.1007/s10699-023-09901-4 · Cited by 16
Fiset, C., Rioux, F. M., Surette, M. E., & Fiset, S. (2015) · PLoS ONE · doi:10.1371/journal.pone.0133168 · Cited by 15
Banerjee, R., Movahedazarhouligh, S., Millen, K., & Luckner, J. L. (2018) · Topics in Early Childhood Special Education · doi:10.1177/0271121417748197 · Cited by 12
A Case for Cognitive Models in Visualization Research : Position paper
Padilla, L. (2018) · IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV) · doi:10.1109/beliv.2018.8634267 · Cited by 13
Leipold, S., Oderbolz, C., Greber, M., & Jäncke, L. (2019) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2018.12.016 · Cited by 13
Szymczak, H., Keller, L., Debbeler, L. J., Kollmann, J., Lages, N. C., Gollwitzer, P. M., Schupp, H. T., & Renner, B. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01530 · Cited by 14
How to True Psychology’s Objects
Morawski, J. G. (2021) · Review of General Psychology · doi:10.1177/10892680211046518 · Cited by 14
Waldman, I., & Lilienfeld, S. (2015) · Psychometrika · doi:10.1007/s11336-015-9447-z
Dewidar, O., Riddle, A. Y., Ghogomu, E. T., Hossain, A., Arora, P., Bhutta, Z. A., Black, R. E., Cousens, S., Gaffey, M. F., Mathew, C. M., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.05.007 · Cited by 13
Moralization and moral trade‐offs explain (in)tolerance of Muslim minority behaviours
Adelman, L., Verkuyten, M., & Yogeeswaran, K. (2021) · European Journal of Social Psychology · doi:10.1002/ejsp.2792 · Cited by 12
Objectivity for the research worker
van Dongen, N. N. N., & Sikorski, M. (2021) · European Journal for Philosophy of Science · doi:10.1007/s13194-021-00400-6 · Cited by 21
Falsificationist Treatment of Auxiliary Hypotheses in Social and Behavioral Sciences
Tunç, D. U., & Tunç, M. N. (2023) · Meta-Psychology · doi:10.15626/mp.2021.2756 · Cited by 32
Wissman, K. T., & Rawson, K. A. (2017) · Memory · doi:10.1080/09658211.2017.1350717 · Cited by 12
Zheng, A., Tucker–Drob, E. M., & Briley, D. A. (2019) · Psychological Science · doi:10.1177/0956797619835768 · Cited by 12
Leighton, D. C., Legate, N., LePine, S., Anderson, S. F., & Grahe, J. E. (2018) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn23.2.98 · Cited by 15
Reviews in Research on Adolescence: Genres, Trends, and Challenges
Levesque, R. J. R. (2015) · Adolescent Research Review · doi:10.1007/s40894-015-0022-8 · Cited by 12
Sakaluk, J. K., & Graham, C. A. (2017) · The Journal of Sex Research · doi:10.1080/00224499.2017.1395387 · Cited by 12
Nicht replizieren: publizieren!?
Rost, D. H., & Bienefeld, M. A. (2019) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652/a000253 · Cited by 13
Graded sensitivity to structure and meaning throughout the human language networkPreprint
Shain, C., Kean, H., Casto, C., Lipkin, B., Affourtit, J., Siegelman, M., Mollica, F., & Fedorenko, E. G. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.12.467812 · Cited by 12
Why do cognitive prompts hurt learning in older adults?
Kraiger, K., Cavanagh, T. M., & Willis, C. M. G. (2020) · International Journal of Training and Development · doi:10.1111/ijtd.12169 · Cited by 12
When Sufficiently Processed, Semantically Related Distractor Pictures Hamper Picture Naming
Matushanskaya, A., Mädebach, A., Müller, M. M., & Jescheniak, J. D. (2016) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000340 · Cited by 11
Jacobsen, T. C., Wiskirchen, K. H., & Ditchkoff, S. S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242328 · Cited by 11
Suppression-induced forgetting: a pre-registered replication of the think/no-think paradigm
Wiechert, S., Loewy, L. H. S., Wessel, I., Fawcett, J. M., Ben‐Shakhar, G., Pertzov, Y., & Verschuère, B. (2023) · Memory · doi:10.1080/09658211.2023.2208791 · Cited by 11
Metadata
- Authors
- Simons, D. J.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Corresponding author
- Simons, Daniel J.
- ORCID
- Simons, Daniel J.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2014-01
- Volume
- 9
- Issue
- 1
- Pages
- 76-80
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2077240377
- Cited by
- 630
- References
- 18
- Citations by year
- 2026: 18 · 2025: 36 · 2024: 29 · 2023: 44 · 2022: 51 · 2021: 69 · 2020: 91 · 2019: 75 · 2018: 67 · 2017: 47 · 2016: 36 · 2015: 48 · 2014: 18
- FWCI
- 48.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Perspectives on Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- direct replication, reproducibility, statistical power, replication study, research credibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review