Cited by 634Meta-analysis and systematic reviewsPsychology Research and BibliometricsAcademic and Historical Perspectives in Psychology

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

The Value of Direct Replication

Simons, Daniel J.·2014·Perspectives on Psychological Science

DOI 10.1177/1745691613514755

Open this paper in CoChat — free account

Abstract

Reproducibility is the cornerstone of science. If an effect is reliable, any competent researcher should be able to obtain it when using the same procedures with adequate statistical power. Two of the articles in this special section question the value of direct replication by other laboratories. In this commentary, I discuss the problematic implications of some of their assumptions and argue that direct replication by multiple laboratories is the only way to verify the reliability of an effect.

Integrity signals

Registry

Crossref · 10.1177/1745691613514755

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
Editors’ Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Recommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M. T., Fruyt, F. D., Houwer, J. D., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R. M., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 876
The Replication Recipe: What makes for a convincing replication?
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner‐Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & Veer, A. V. '. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.10.005 · Cited by 758
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734
Is the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697

Show all 18 references

Research works printed but not linked: 1

Roediger H. L., 2012, Observer, 25, 27

Sorted by citations

Items 101–200 of 634

Forecasting a fatal decision: Direct replication of the predictive validity of the Suicide–Implicit Association Test
Tello, N., Harika-Germaneau, G., Serra, W., Jaafari, N., & Chatard, A. (2020) · Psychological Science · doi:10.1177/0956797619893062 · Cited by 54
Reproducibility in the Social Sciences
Moody, J. W., Keister, L. A., & Ramos, M. C. (2022) · Annual Review of Sociology · doi:10.1146/annurev-soc-090221-035954 · Cited by 63
Teaching and research: Specificity and congruence of university faculty achievement goals
Daumiller, M. H., & Dresel, M. (2020) · International Journal of Educational Research · doi:10.1016/j.ijer.2019.08.002 · Cited by 62
Behind the ethnic–civic distinction: Public attitudes towards immigrants’ political rights in the Netherlands
Verkuyten, M., & Martinović, B. (2015) · Social Science Research · doi:10.1016/j.ssresearch.2015.05.002 · Cited by 54
Does Neonatal Imitation Exist? Insights From a Meta-Analysis of 336 Effect Sizes
Davis, J., Redshaw, J., Suddendorf, T., Nielsen, M., Kennedy‐Costantini, S., Oostenbroek, J., & Slaughter, V. P. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620959834 · Cited by 63
Not all choices are created equal: Task-relevant choices enhance motor learning compared to task-irrelevant choices
Carter, M. J., & Ste‐Marie, D. M. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1250-7 · Cited by 55
A creative destruction approach to replication: Implicit work and sex morality across cultures
Tierney, W., Hardy, J. H., Ebersole, C. R., Viganola, D., Clemente, E. G., Gordon, M., Hoogeveen, S., Haaf, J. M., Dreber, A., Johannesson, M., et al. (2020) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2020.104060 · Cited by 54
Intergroup threat, social dominance, and the malleability of ideology: The importance of conceptual replication
Roebroeck, É., & Guimond, S. (2017) · European Journal of Social Psychology · doi:10.1002/ejsp.2311 · Cited by 59
Spontaneous Giving under Structural Inequality: Intuition Promotes Cooperation in Asymmetric Social Dilemmas
Lotz, S. (2015) · PLoS ONE · doi:10.1371/journal.pone.0131562 · Cited by 51
A Replication by Any Other Name
Cook, B. G., Collins, L. W., Cook, S. C., & Cook, L. (2016) · Remedial and Special Education · doi:10.1177/0741932516637198 · Cited by 52
The role of mediator strength in learning from retrieval
Carpenter, S. K., & Yeung, K. L. (2016) · Journal of Memory and Language · doi:10.1016/j.jml.2016.06.008 · Cited by 57
Distributed Sensitivity to Syntax and Semantics throughout the Language Network
Shain, C., Kean, H., Casto, C., Lipkin, B., Affourtit, J., Siegelman, M., Mollica, F., & Fedorenko, E. G. (2024) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_02164 · Cited by 69
Revisiting Trust and Privacy Concern in Consumers’ Perceptions of Marketing Information Management Practices: Replication and Extension
Swani, K., Milne, G. R., & Slepchuk, A. N. (2021) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2021.03.001 · Cited by 54
A Concise Set of Core Recommendations to Improve the Dependability of Psychological Research
Lishner, D. A. (2015) · Review of General Psychology · doi:10.1037/gpr0000028 · Cited by 49
Seven Pervasive Statistical Flaws in Cognitive Training Interventions
Moreau, D., Kirk, I. J., & Waldie, K. E. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00153 · Cited by 54
P-curving the fusiform face area: Meta-analyses support the expertise hypothesis
Burns, E. J., Arnold, T., & Bukach, C. M. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.07.003 · Cited by 51
Are questionable research practices facilitating new discoveries in sport and exercise medicine? The proportion of supported hypotheses is implausibly high
Büttner, F., Toomey, E. C., McClean, S., Roe, M., & Delahunt, E. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-101863 · Cited by 56
Using meta-analysis for evidence synthesis: The case of incomplete neutralization in German
Nicenboim, B., Roettger, T. B., & Vasishth, S. (2018) · Journal of Phonetics · doi:10.1016/j.wocn.2018.06.001 · Cited by 45
Priming Resistance to Persuasion decreases adherence to Conspiracy Theories*
Bonetto, E., Troian, J., Varet, F., Monaco, G. L., & Girandola, F. (2018) · Social Influence · doi:10.1080/15534510.2018.1471415 · Cited by 35
Health information-seeking behavior in the time of COVID-19: information horizons methodology to decipher source path during a global pandemic
Zimmerman, M. S. (2021) · Journal of Documentation · doi:10.1108/jd-01-2021-0022 · Cited by 46
A practical guide for transparency in psychological sciencePreprint
Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H., Nilsonne, G., Vanpaemel, W., & Frank, M. C. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/rtygm · Cited by 46
Can psychological features predict antidepressant response to rTMS? A Discovery–Replication approach
Krepel, N., Rush, A. J., Iseger, T. A., Sack, A. T., & Arns, M. (2019) · Psychological Medicine · doi:10.1017/s0033291718004191 · Cited by 45
Precarious manhood and muscularity: Effects of threatening men’s masculinity on reported strength and muscle dissatisfaction
Frederick, D. A., Shapiro, L., Williams, T. R., Seoane, C. M., McIntosh, R. T., & Fischer, E. W. (2017) · Body Image · doi:10.1016/j.bodyim.2017.07.002 · Cited by 43
Self-regulated learning of principle-based concepts: Do students prefer worked examples, faded examples, or problem solving?
Foster, N. L., Rawson, K. A., & Dunlosky, J. T. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.10.002 · Cited by 53
The woman who wasn't there: Converging evidence that subliminal social comparison affects self-evaluation
Chatard, A., Bocage-Barthélémy, Y., Selimbegović, L., & Guimond, S. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.05.005 · Cited by 51
Racial discrimination and posttraumatic stress: examining emotion dysregulation as a mediator in an African American community sample
Mekawi, Y., Watson‐Singleton, N. N., Kuzyk, E., Dixon, H. D., Carter, S. E., Bradley, B., Fani, N., Michopoulos, V., & Powers, A. D. (2020) · European Journal of Psychotraumatology · doi:10.1080/20008198.2020.1824398 · Cited by 42
America and the Age of Genocide
Leidner, B. (2015) · Personality and Social Psychology Bulletin · doi:10.1177/0146167215607195 · Cited by 42
Personality correlates of revenge‐seeking: Multidimensional links to physical aggression, impulsivity, and aggressive pleasure
Chester, D. S., & DeWall, C. N. (2017) · Aggressive Behavior · doi:10.1002/ab.21746 · Cited by 41
A Causal Replication Framework for Designing and Assessing Replication Efforts
Steiner, P. M., Wong, V. C., & Anglin, K. (2019) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000385 · Cited by 47
Estimating the Replicability of Sports and Exercise Science Research
Murphy, J., Caldwell, A. R., Mesquida, C., Ladell, A. J. M., Martínez, A. E., Tual, A., Denys, A. T., Cameron, B., Hooren, B. V., Parr, B., et al. (2025) · Sports Medicine · doi:10.1007/s40279-025-02201-w · Cited by 51
How Effective is Example Generation for Learning Declarative Concepts?
Rawson, K. A., & Dunlosky, J. T. (2016) · Educational Psychology Review · doi:10.1007/s10648-016-9377-z · Cited by 41
Do delayed judgements of learning reduce metamemory illusions? A meta-analysis
Luna, K., Мартин-Луенго, Б., & Albuquerque, P. B. (2017) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2017.1343362 · Cited by 43
Prime Numbers: Anchoring and its Implications for Theories of Behavior Priming
Newell, B. R., & Shanks, D. R. (2014) · Social Cognition · doi:10.1521/soco.2014.32.supp.88 · Cited by 42
The shooter bias: Replicating the classic effect and introducing a novel paradigm
Essien, I., Stelter, M., Kalbe, F., Koehler, A., Mangels, J., & Meliß, S. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2016.12.009 · Cited by 39
The endorsement of unity in diversity: The role of political orientation, education and justifying beliefs
Verkuyten, M., Martinović, B., Smeekes, A., & Kros, M. (2016) · European Journal of Social Psychology · doi:10.1002/ejsp.2210 · Cited by 38
How accurately can students evaluate the quality of self-generated examples of declarative concepts? Not well, and feedback does not help
Zamary, A., Rawson, K. A., & Dunlosky, J. T. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.08.002 · Cited by 40
Explicating Exact versus Conceptual Replication
Hudson, R. G. S. (2021) · Erkenntnis · doi:10.1007/s10670-021-00464-z · Cited by 39
On the automatic link between affect and tendencies to approach and avoid: Chen and Bargh (1999) revisited
Rotteveel, M., Gierholz, A., Koch, G., van Aalst, C., Pinto, Y., Matzke, D., Steingroever, H., Verhagen, J., Beek, T. F., Selker, R., et al. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00335 · Cited by 41
The role of replication in psychological science
Fletcher, S. C. (2021) · European Journal for Philosophy of Science · doi:10.1007/s13194-020-00329-2 · Cited by 45
Questioning Psychological Constructs: Current Issues and Proposed Changes
de Boeck, P. A. L., Pek, J. C. X., Walton, K. M., Wegener, D. T., Turner, B. M., Andersen, B. L., Beauchaine, T. P., Lecavalier, L., Myung, J. I., & Petty, R. E. (2023) · Psychological Inquiry · doi:10.1080/1047840x.2023.2274429 · Cited by 45
The Multicultural Jigsaw Puzzle
Verkuyten, M., Martinović, B., & Smeekes, A. (2014) · Personality and Social Psychology Bulletin · doi:10.1177/0146167214549324 · Cited by 37
Does covert retrieval benefit learning of key-term definitions?
Tauber, S. K., Witherby, A. E., Dunlosky, J. T., Rawson, K. A., Putnam, A. L., & Roediger, H. L., III (2017) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2016.10.004 · Cited by 37
Cognitive and emotional empathy in patients with schizophrenia spectrum disorders: A replication and extension study
Berger, P., Bitsch, F., Jakobi, B., Nagels, A., Straube, B., & Falkenberg, I. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.04.015 · Cited by 37
Reproducible Research in R: A Tutorial on How to Do the Same Thing More Than Once
Peikert, A., Lissa, C. J. V., & Brandmaier, A. M. (2021) · Psych · doi:10.3390/psych3040053 · Cited by 39
On Feeling Warm and Being Warm
Fetterman, A. K., Wilkowski, B. M., & Robinson, M. D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617712032 · Cited by 39
Investigating and explaining the effects of successive relearning on long-term retention.
Rawson, K. A., Vaughn, K. E., Walsh, M., & Dunlosky, J. (2018) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000146 · Cited by 36
Proposal of a Selection Protocol for Replication of Studies in Sports and Exercise Science
Murphy, J., Mesquida, C., Caldwell, A. R., Earp, B. D., & Warne, J. P. (2022) · Sports Medicine · doi:10.1007/s40279-022-01749-1 · Cited by 44
How can preregistration contribute to research in our field?
Jonas, K. J., & Cesario, J. (2015) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2015.1070611 · Cited by 38
Undisclosed Flexibility in Computing and Reporting Structural Equation Models in Communication Science
Seaman, C., & Weber, R. (2015) · Communication Methods and Measures · doi:10.1080/19312458.2015.1096329 · Cited by 35
Internal conceptual replications do not increase independent replication success
Kunert, R. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1030-9 · Cited by 35
Cultural evolutionary behavioural science in public policy
Schimmelpfennig, R., & Muthukrishna, M. (2023) · Behavioural Public Policy · doi:10.1017/bpp.2022.40 · Cited by 36
Reproducibility in Psychological Science: When Do Psychological Phenomena Exist?
Iso‐Ahola, S. E. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00879 · Cited by 41
Does the conclusion follow from the evidence? Recommendations for improving research
Hales, A. H. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.09.011 · Cited by 54
Lack of progress in tourist information search research: a critique of citation behaviour and knowledge development
Zarezadeh, Z. Z., Benckendorff, P. J., & Ulrike Gretzel, B. (2018) · Current Issues in Tourism · doi:10.1080/13683500.2018.1459511 · Cited by 34
Lateral Eye Movements Do Not Increase False-Memory Rates: A Failed Direct-Replication Study
van Schie, K., & Leer, A. (2019) · Clinical Psychological Science · doi:10.1177/2167702619859335 · Cited by 34
Example-based learning: should learners receive closed-book or open-book self-explanation prompts?
Hiller, S., Rumann, S., Berthold, K., & Roelle, J. (2020) · Instructional Science · doi:10.1007/s11251-020-09523-4 · Cited by 35
Do past-focused environmental messages promote pro-environmentalism to conservatives? A pre-registered replication
Kim, I., Hammond, M. D., & Milfont, T. L. (2020) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2020.101547 · Cited by 36
Coping Strategies as Moderators of the Association Between Combat Exposure and Posttraumatic Stress Disorder Symptoms
Britt, T. W., Adler, A. B., Sawhney, G., & Bliese, P. D. (2017) · Journal of Traumatic Stress · doi:10.1002/jts.22221 · Cited by 34
Which egg features predict egg rejection responses in American robins? Replicating Rothstein's (1982) study
Luro, A. B., Igic, B., Croston, R., López, A. V., Shawkey, M. D., & Hauber, M. E. (2018) · Ecology and Evolution · doi:10.1002/ece3.3759 · Cited by 33
Mechanisms underlying the spacing effect in learning: A comparison of three computational models.
Walsh, M. M., Gluck, K. A., Glenn Gunzelmann, A., Jastrzembski, T. S., Krusmark, M., Myung, J. I., Pitt, M. A., & Zhou, R. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000416 · Cited by 36
A conceptual replication of the Strategic Training Initiative in Community Supervision (STICS)
Bonta, J. L., Rugge, T., Bourgon, G., & Wanamaker, K. A. (2019) · Journal of Experimental Criminology · doi:10.1007/s11292-019-09371-4 · Cited by 34
How to Teach Open Science Principles in the Undergraduate Curriculum—The Hagen Cumulative Science Project
Jekel, M., Fiedler, S., Torras, R. A., Mischkowski, D., Dorrough, A. R., & Glöckner, A. (2019) · Psychology Learning & Teaching · doi:10.1177/1475725719868149 · Cited by 33
Passion in the pit: the effects of harmonious and obsessive passion on nurse burnout
Landay, K., Arena, D. F., & King, D. A. (2021) · Journal of Managerial Psychology · doi:10.1108/jmp-03-2021-0181 · Cited by 36
That's Interesting! A Flawed Article Has Influenced Generations of Management Researchers
Tsang, E. W. K. (2021) · Journal of Management Inquiry · doi:10.1177/10564926211048708 · Cited by 33
Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project
Kekecs, Z., Pálfi, B., Szászi, B., Szécsi, P., Zrubka, M., Kovács, M., Bakos, B. E., Cousineau, D., Tressoldi, P. E., Schmidt, K., et al. (2023) · Royal Society Open Science · doi:10.1098/rsos.191375 · Cited by 63
Eye Tracking as a Behavioral Biomarker for Psychiatric Conditions: The Road Ahead
Shic, F. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.02.002 · Cited by 33
Testing the generalizability of the white leadership standard in the post-Obama era
Ubaka, A., Lü, X., & Gutierrez, L. J. (2022) · The Leadership Quarterly · doi:10.1016/j.leaqua.2021.101591 · Cited by 34
The evaluation of immigrants’ political acculturation strategies
Hindriks, P., Verkuyten, M., & Coenders, M. (2015) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2015.04.002 · Cited by 32
The threatening nature of “rap” music.
Dunbar, A., Kubrin, C. E., & Scurich, N. (2016) · Psychology Public Policy and Law · doi:10.1037/law0000093 · Cited by 35
The Use of Concrete Examples Enhances the Learning of Abstract Concepts: A Replication Study
Micallef, A., & Newton, P. M. (2022) · Teaching of Psychology · doi:10.1177/00986283211058069 · Cited by 31
A Replication Agenda for Composition Studies
Raucci, J. (2021) · College Composition and Communication · doi:10.58680/ccc202131162 · Cited by 31
Parental emotion coaching moderates the effects of family stress on internalizing symptoms in middle childhood and adolescence
Lobo, F. M., Lunkenheimer, E. S., Lucas‐Thompson, R. G., & Seiter, N. S. (2021) · Social Development · doi:10.1111/sode.12519 · Cited by 31
Anticipating words during spoken discourse comprehension: A large-scale, pre-registered replication study using brain potentials
Nieuwland, M. S., Arkhipova, Y., & Rodríguez-Gómez, P. (2020) · Cortex · doi:10.1016/j.cortex.2020.09.007 · Cited by 35
In a Flash: Thin Slice Judgment Accuracy of Leading and Trailing in Sports
Furley, P., & Schweizer, G. (2015) · Journal of Nonverbal Behavior · doi:10.1007/s10919-015-0225-5 · Cited by 30
Reducing gender identity bias through imagined intergroup contact
Moss-Racusin, C. A., & Rabasco, H. (2018) · Journal of Applied Social Psychology · doi:10.1111/jasp.12525 · Cited by 32
What Crowdsourcing Can Offer to Cross-Cultural Psychological Science
Cuccolo, K., Irgens, M. S., Zlokovich, M. S., Grahe, J. E., & Edlund, J. E. (2020) · Cross-Cultural Research · doi:10.1177/1069397120950628 · Cited by 38
Two Challenges to “Embodied Cognition” Research And How to Overcome Them
Zwaan, R. A. (2021) · Journal of Cognition · doi:10.5334/joc.151 · Cited by 38
Replicating five pupillometry studies of Eckhard Hess
de Winter, J., Petermeijer, S. M., Kooijman, L., & Dodou, D. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.03.003 · Cited by 32
Understanding Replication in a Way That Is True to Science
Haig, B. D. (2021) · Review of General Psychology · doi:10.1177/10892680211046514 · Cited by 36
Guessing right: Preconscious processing in inattentional blindness
Kreitz, C., Pugnaghi, G., & Memmert, D. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820911324 · Cited by 32
How replication studies can improve doctoral student education
Schwab, A., Aguinis, H., Bamberger, P. A., Hodgkinson, G. P., Shapiro, D. L., Starbuck, W. H., & Tsui, A. S. (2023) · Journal of Management Scientific Reports · doi:10.1177/27550311231156880 · Cited by 29
The contribution of LM to the neuroscience of movement vision
Zihl, J., & Heywood, C. A. (2015) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2015.00006 · Cited by 31
New Statistical Metrics for Multisite Replication Projects
Mathur, M. B., & VanderWeele, T. J. (2020) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/rssa.12572 · Cited by 29
Being accurate about accuracy in verbal deception detection
Kleinberg, B., Arntz, A. R., & Verschuère, B. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220228 · Cited by 32
Saving Science Through Replication Studies
Edlund, J. E., Cuccolo, K., Irgens, M. S., Wagge, J., & Zlokovich, M. S. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620984385 · Cited by 36
Continuous-time deconvolutional regression for psycholinguistic modeling
Shain, C., & Schuler, W. (2021) · Cognition · doi:10.1016/j.cognition.2021.104735 · Cited by 28
Pre-registration and Results-Free Review in Observational and Qualitative Research
Jacobs, A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.009 · Cited by 30
Will behavioral treatments for cognitive impairment in multiple sclerosis become standards-of-care?
Sandroff, B. M., & DeLuca, J. (2019) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2019.02.010 · Cited by 28
Trustworthiness in e-commerce: A replication study of competing measures
Hallikainen, H., & Laukkanen, T. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2019.12.033 · Cited by 31
Would you like to learn more? Retrieval practice plus feedback can increase motivation to keep on studying
Abel, M., & Bäuml, K. T. (2020) · Cognition · doi:10.1016/j.cognition.2020.104316 · Cited by 38
The mechanisms of minimization: How interrogation tactics suggest lenient sentencing through pragmatic implication.
Luke, T. J., & Alceste, F. (2020) · Law and Human Behavior · doi:10.1037/lhb0000410 · Cited by 28
The keyword effect: A conceptual replication, effects on bias, and an optimization
Waldeyer, J., & Roelle, J. (2020) · Metacognition and Learning · doi:10.1007/s11409-020-09235-7 · Cited by 28
Smart but Evil? Student-Teachers’ Perception of Educational Researchers’ Epistemic Trustworthiness
Merk, S., & Rosman, T. (2019) · AERA Open · doi:10.1177/2332858419868158 · Cited by 28
The effect of personality traits and knowledge on the quality of decisions in supply chains
Erjavec, J., Popovič, A., & Trkman, P. (2019) · Economic Research-Ekonomska Istraživanja · doi:10.1080/1331677x.2019.1642788 · Cited by 31
Social Organization in Prison: A Social Network Analysis of Interpersonal Relationships among Dutch prisoners
Sentse, M., Kreager, D. A., Bosma, A. Q., Nieuwbeerta, P., & Palmen, H. M. H. (2019) · Justice Quarterly · doi:10.1080/07418825.2019.1700298 · Cited by 27
The Evaluation of a Mind-Body Intervention (MBT-T) for Stress Reduction in Academic Settings: A Pilot Study
Cozzolino, M., Vivo, D. R., Girelli, L., Limone, P., & Celia, G. (2020) · Behavioral Sciences · doi:10.3390/bs10080124 · Cited by 27
The Undoing Effect of Positive Emotions: A Meta-Analytic Review
Behnke, M., Pietruch, M., Chwiłkowska, P., Wessel, E., Kaczmarek, L. D., Assink, M., & Gross, J. J. (2022) · Emotion Review · doi:10.1177/17540739221104457 · Cited by 34
Do Easterners and Westerners Differ in Visual Cognition? A Preregistered Examination of Three Visual Cognition Tasks
Hakim, N., Simons, D. J., Zhao, H., & Wan, X. I. (2016) · Social Psychological and Personality Science · doi:10.1177/1948550616667613 · Cited by 27
Self-citation
The Effect of Cognitive Control on Different Types of Auditory Distraction
Bell, R., Röer, J. P., Marsh, J. E., Storch, D., & Buchner, A. (2017) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000372 · Cited by 27
Theory, the Final Frontier? A Corpus-Based Analysis of the Role of Theory in Psychological Articles
Beller, S., & Bender, A. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00951 · Cited by 33

Authors: Simons, D. J.
Affiliations: University of Illinois Urbana-Champaign (US)
Corresponding author: Simons, Daniel J.
ORCID: Simons, Daniel J.
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2014-01
Volume: 9
Issue: 1
Pages: 76-80
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691613514755
OpenAlex: W2077240377
Cited by: 630
References: 18
Citations by year: 2026: 18 · 2025: 36 · 2024: 29 · 2023: 44 · 2022: 51 · 2021: 69 · 2020: 91 · 2019: 75 · 2018: 67 · 2017: 47 · 2016: 36 · 2015: 48 · 2014: 18
FWCI: 48.59
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
Keywords: direct replication, reproducibility, statistical power, replication study, research credibility

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The Value of Direct Replication

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks