Cited by 634Meta-analysis and systematic reviewsPsychology Research and BibliometricsAcademic and Historical Perspectives in Psychology

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

The Value of Direct Replication

Simons, Daniel J.·2014·Perspectives on Psychological Science

DOI 10.1177/1745691613514755

Open this paper in CoChat — free account

Abstract

Reproducibility is the cornerstone of science. If an effect is reliable, any competent researcher should be able to obtain it when using the same procedures with adequate statistical power. Two of the articles in this special section question the value of direct replication by other laboratories. In this commentary, I discuss the problematic implications of some of their assumptions and argue that direct replication by multiple laboratories is the only way to verify the reliability of an effect.

Integrity signals

Registry

Crossref · 10.1177/1745691613514755

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
Editors’ Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Recommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M. T., Fruyt, F. D., Houwer, J. D., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R. M., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 876
The Replication Recipe: What makes for a convincing replication?
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner‐Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & Veer, A. V. '. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.10.005 · Cited by 758
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734
Is the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697

Show all 18 references

Research works printed but not linked: 1

Roediger H. L., 2012, Observer, 25, 27

Sorted by citations

Is psychology suffering from a replication crisis? What does “failure to replicate” really mean?
Maxwell, S. E., Lau, M. Y., & Howard, G. S. (2015) · American Psychologist · doi:10.1037/a0039400 · Cited by 1,102
Constraints on Generality (COG): A Proposed Addition to All Empirical Papers
Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617708630 · Cited by 986
Self-citation
Replicability, Robustness, and Reproducibility in Psychological Science
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., et al. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-114157 · Cited by 770
Psychology's Renaissance
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548
Do angry birds make for angry children? a meta-analysis of video game influences on children’s and adolescents’ aggression, mental health, prosocial behavior, and academic performance.
Ferguson, C. J. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615592234 · Cited by 524
Applications of transcranial direct current stimulation for understanding brain function
Filmer, H. L., Dux, P. E., & Mattingley, J. B. (2014) · Trends in Neurosciences · doi:10.1016/j.tins.2014.08.003 · Cited by 539
Bilingualism and cognition
Valian, V. V. (2014) · Bilingualism Language and Cognition · doi:10.1017/s1366728914000522 · Cited by 514
Insufficient effort responding: Examining an insidious confound in survey data.
Huang, J. L. W., Liu, M., & Bowling, N. A. (2014) · Journal of Applied Psychology · doi:10.1037/a0038510 · Cited by 421
Contextual sensitivity in scientific reproducibility
Van Bavel, J. J., Mende-Siedlecki, P., Brady, W. J., & Reinero, D. A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521897113 · Cited by 398
Exploratory Research
Swedberg, R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.002 · Cited by 471
The Psychological Science Accelerator: Advancing Psychology Through a Distributed Collaborative Network
Moshontz, H., Campbell, L., Ebersole, C. R., IJzerman, H., Urry, H. L., Forscher, P. S., Grahe, J. E., McCarthy, R. J., Musser, E. D., Antfolk, J., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918797607 · Cited by 377
Replicating patterns of prospect theory for decision under risk
Ruggeri, K., Alì, S., Berge, M. L., Bertoldo, G., Bjørndal, L. D., Cortijos‐Bernabeu, A., Davison, C., Demić, E., Serna, C. E., Friedemann, M., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0886-x · Cited by 364
Does Oxytocin Increase Trust in Humans? A Critical Review of Research
Nave, G., Camerer, C., & McCullough, M. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615600138 · Cited by 316
Green consumerism: The influence of product attributes and values on purchasing intentions
Schuitema, G., & de Groot, J. I. M. (2014) · Journal of Consumer Behaviour · doi:10.1002/cb.1501 · Cited by 261
It’s Time to Broaden the Replicability Conversation: Thoughts for and From Clinical Psychological Science
Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617690042 · Cited by 251
A Practical Guide for Transparency in Psychological Science
Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H., Nilsonne, G., Vanpaemel, W., & Frank, M. C. (2018) · Collabra Psychology · doi:10.1525/collabra.158 · Cited by 251
Musical Preferences Predict Personality: Evidence From Active Listening and Facebook Likes
Nave, G., Minxha, J., Greenberg, D. M., Kosiński, M., Stillwell, D. J., & Rentfrow, P. J. (2018) · Psychological Science · doi:10.1177/0956797618761659 · Cited by 209
Play It Again, Sam! An Analysis of Constructive Replication in the Organizational Sciences
Köhler, T., & Cortina, J. M. (2019) · Journal of Management · doi:10.1177/0149206319843985 · Cited by 212
Best research practices in psychology: Illustrating epistemological and pragmatic considerations with the case of relationship science.
Finkel, E. J., Eastwick, P. W., & Reis, H. T. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000007 · Cited by 208
The case for formal methodology in scientific reform
Devezer, B., Navarro, D., Vandekerckhove, J., & Buzbas, E. O. (2021) · Royal Society Open Science · doi:10.1098/rsos.200805 · Cited by 204
Estimating the Prevalence of Transparency and Reproducibility-Related Research Practices in Psychology (2014–2017)
Hardwicke, T. E., Thibault, R. T., Kosie, J. E., Wallach, J. D., Kidwell, M. C., & Ioannidis, J. P. A. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620979806 · Cited by 187
Methodological reporting behavior, sample sizes, and statistical power in studies of event‐related potentials: Barriers to reproducibility and replicability
Clayson, P. E., Carbine, K. A., Baldwin, S. A., & Larson, M. J. (2019) · Psychophysiology · doi:10.1111/psyp.13437 · Cited by 205
Establishing an infrastructure for collaboration in primate cognition research
(2019) · doi:10.1371/journal.pone.0223675 · Cited by 178
Scientific Utopia III: Crowdsourcing Science
Uhlmann, E. L., Ebersole, C. R., Chartier, C. R., Errington, T. M., Kidwell, M. C., Lai, C. K., McCarthy, R. J., Riegelman, A., Silberzahn, R., & Nosek, B. A. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619850561 · Cited by 191
Crowdsourcing hypothesis tests: Making transparent how design choices shape research results.
Landy, J. F., Jia, M. (., Ding, I. L., Viganola, D., Tierney, W., Dreber, A., Johannesson, M., Pfeiffer, T., Ebersole, C. R., Gronau, Q. F., et al. (2020) · Psychological Bulletin · doi:10.1037/bul0000220 · Cited by 168
There’s more than one way to conduct a replication study: Beyond statistical significance.
Anderson, S. F., & Maxwell, S. E. (2016) · Psychological Methods · doi:10.1037/met0000051 · Cited by 167
Conceptualizing and evaluating the replication of research results
Fabrigar, L. R., & Wegener, D. T. (2015) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.07.009 · Cited by 168
Reconceptualizing replication as a sequence of different studies: A replication typology
Hüffmeier, J., Mazei, J., & Schultze, T. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.09.009 · Cited by 177
Strategic Intelligence: The Cognitive Capability to Anticipate Competitor Behavior
Levine, S. S., Bernard, M. M., & Nagel, R. (2017) · Strategic Management Journal · doi:10.1002/smj.2660 · Cited by 167
Construct validity and the validity of replication studies: A systematic review.
Flake, J. K., Davidson, I. J., Wong, O. C. Y., & Pek, J. C. X. (2022) · American Psychologist · doi:10.1037/amp0001006 · Cited by 154
Heterogeneity of Research Results: A New Perspective From Which to Assess and Promote Progress in Psychological Science
Linden, A. H., & Hönekopp, J. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620964193 · Cited by 159
Is there a Publication Bias in Behavioural Intranasal Oxytocin Research on Humans? Opening the File Drawer of One Laboratory
Lane, A., Luminet, O., Nave, G., & Mikolajczak, M. (2016) · Journal of Neuroendocrinology · doi:10.1111/jne.12384 · Cited by 129
On Replication in Communication Science
McEwan, B. L., Carpenter, C. J., & Westerman, D. (2018) · Communication Studies · doi:10.1080/10510974.2018.1464938 · Cited by 134
Addressing the “Replication Crisis”: Using Original Studies to Design Replication Studies with Appropriate Statistical Power
Anderson, S. F., & Maxwell, S. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1289361 · Cited by 116
Strengthening the Practice of Exercise and Sport-Science Research
Halperin, I., Vigotsky, A. D., Foster, C., & Pyne, D. B. (2017) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2017-0322 · Cited by 147
The Production of Knowledge
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519 · Cited by 154
Replication is important for educational psychology: Recent developments and key issues
Plucker, J. A., & Makel, M. C. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1895796 · Cited by 138
Reflections on the replication corner: In praise of conceptual replications
Lynch, J. G., Bradlow, E. T., Huber, J. C., & Lehmann, D. R. (2015) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2015.09.006 · Cited by 134
No Replication, No Trust? How Low Replicability Influences Trust in Psychology
Wingen, T., Berkessel, J. B., & Englich, B. (2019) · Social Psychological and Personality Science · doi:10.1177/1948550619877412 · Cited by 140
Replicating Studies in Which Samples of Participants Respond to Samples of Stimuli
Westfall, J., Judd, C. M., & Kenny, D. A. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614564879 · Cited by 133
Increasing clarity where it is needed most: articulating and evaluating theoretical contributions
DeAndrea, D. C., & Holbert, R. L. (2017) · Annals of the International Communication Association · doi:10.1080/23808985.2017.1304163 · Cited by 123
Recommendations for Replication Research in Special Education
Coyne, M. D., Cook, B. G., & Therrien, W. J. (2016) · Remedial and Special Education · doi:10.1177/0741932516648463 · Cited by 120
Are Psychology Journals Anti-replication? A Snapshot of Editorial Practices
Martin, G., & Clarke, R. M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00523 · Cited by 116
On the Other Side of the Mirror: Priming in Cognitive and Social Psychology
Doyen, S., Klein, O., Simons, D. J., & Axel Cleeremans, B. (2014) · Social Cognition · doi:10.1521/soco.2014.32.supp.12 · Cited by 119
Self-citation
Disfluent fonts don’t help people solve math problems.
Meyer, A., Frederick, S., Burnham, T. C., Pinto, J. D. G., Boyer, T. W., Ball, L. J., Pennycook, G., Ackerman, R., Thompson, V. A., & Schuldt, J. P. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000049 · Cited by 109
How Much Mightier Is the Pen than the Keyboard for Note-Taking? A Replication and Extension of Mueller and Oppenheimer (2014)
Morehead, K., Dunlosky, J. T., & Rawson, K. A. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09468-2 · Cited by 109
Low power individuals in social power research: A quantitative review, theoretical framework, and empirical test
Schaerer, M., du Plessis, C., Yap, A. J., & Thau, S. (2018) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.08.004 · Cited by 105
Definitely maybe: can unconscious processes perform the same functions as conscious processes?
Hesselmann, G., & Moors, P. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00584 · Cited by 101
Why did I do that? Explaining actions activated outside of awareness
Gantman, A. P., Adriaanse, M. A., Gollwitzer, P. M., & Oettingen, G. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1260-5 · Cited by 97
Predicting the replicability of social science lab experiments
Altmejd, A., Dreber, A., Forsell, E., Huber, J., Imai, T., Johannesson, M., Kirchler, M., Nave, G., & Camerer, C. F. (2019) · PLoS ONE · doi:10.1371/journal.pone.0225826 · Cited by 94
What Is a Replication?
Machery, É. (2020) · Philosophy of Science · doi:10.1086/709701 · Cited by 99
Effects of different intracranial volume correction methods on univariate sex differences in grey matter volume and multivariate sex prediction
Sanchis‐Segura, C., Ibáñez, M. V., Aguirre, N., Cruz-Gómez, Á. J., & Forn, C. (2020) · Scientific Reports · doi:10.1038/s41598-020-69361-9 · Cited by 98
Arrested Theory Development: The Misguided Distinction Between Exploratory and Confirmatory Research
Szollosi, A., & Donkin, C. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620966796 · Cited by 107
From crossing cultures to straddling them: An empirical examination of outcomes for multicultural employees
Fitzsimmons, S. R., Liao, Y., & Thomas, D. C. (2016) · Journal of International Business Studies · doi:10.1057/s41267-016-0053-9 · Cited by 95
Understanding Priming Effects in Social Psychology: An Overview and Integration
Molden, D. C. (2014) · Social Cognition · doi:10.1521/soco.2014.32.supp.243 · Cited by 93
A Validity-Based Framework for Understanding Replication in Psychology
Fabrigar, L. R., Wegener, D. T., & Petty, R. E. (2020) · Personality and Social Psychology Review · doi:10.1177/1088868320931366 · Cited by 114
On the trajectory of discrimination: A meta-analysis and forecasting survey capturing 44 years of field experiments on gender and hiring decisions
Schaerer, M., du Plessis, C., Nguyen, M. H. B., van Aert, R. C. M., Tiokhin, L., Lakens, D., Giulia Clemente, E., Pfeiffer, T., Dreber, A., Johannesson, M., et al. (2023) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2023.104280 · Cited by 87
Family-centered practices and the parental well-being of young children with disabilities and developmental delay
Mas, J. M., Dunst, C. J., Balcells‐Balcells, A., García‐Ventura, S., Giné, C. G., & Cañadas, M. (2019) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2019.103495 · Cited by 86
Postretrieval new learning does not reliably induce human memory updating via reconsolidation
Hardwicke, T. E., Taqi, M., & Shanks, D. R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1601440113 · Cited by 90
Deciding what to replicate: A decision model for replication study selection under resource and knowledge constraints.
Isager, P. M., van Aert, R. C. M., Bahník, Š., Brandt, M. J., DeSoto, K. A., Giner‐Sorolla, R., Krueger, J. I., Perugini, M., Ropovik, I., Veer, A. V. '., et al. (2021) · Psychological Methods · doi:10.1037/met0000438 · Cited by 94
We do publish (conceptual) replications (sometimes): publication trends in communication science, 2007–2016
Keating, D. M., & Totzkay, D. (2019) · Annals of the International Communication Association · doi:10.1080/23808985.2019.1632218 · Cited by 76
Backlash against gender stereotype-violating preschool children
Sullivan, J. L., Moss-Racusin, C. A., Lopez, M. J., & Williams, K. N. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195503 · Cited by 79
From Repeatability to Reproducibility and Corroboration
Feitelson, D. G. (2015) · ACM SIGOPS Operating Systems Review · doi:10.1145/2723872.2723875 · Cited by 75
Concreteness norms for 1,659 French words: Relationships with other psycholinguistic variables and word recognition times
Bonin, P., Méot, A., & Bugaïska, A. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1014-y · Cited by 77
Individual alpha frequency proximity associated with repetitive transcranial magnetic stimulation outcome: An independent replication study from the ICON-DB consortium
Roelofs, C. L., Krepel, N., Corlier, J., Carpenter, L. L., Fitzgerald, P. B., Daskalakis, Z. J., Tendolkar, I., Wilson, A. C., Downar, J. H., Bailey, N. W., et al. (2020) · Clinical Neurophysiology · doi:10.1016/j.clinph.2020.10.017 · Cited by 78
National nostalgia: A group-based emotion that benefits the in-group but hampers intergroup relations
Smeekes, A. (2015) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2015.07.001 · Cited by 74
Replication crisis = trust crisis? The effect of successful vs failed replications on laypeople’s trust in researchers and research
Hendriks, F., Kienhues, D., & Bromme, R. (2020) · Public Understanding of Science · doi:10.1177/0963662520902383 · Cited by 87
Academic tracking is related to gains in students' intelligence over four years: Evidence from a propensity score matching study
Guill, K., Lüdtke, O., & Köller, O. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.10.001 · Cited by 86
Effect of a Community Agency–Administered Nurse Home Visitation Program on Program Use and Maternal and Infant Health Outcomes: A Randomized Clinical Trial
Dodge, K. A., Goodman, W. B., Bai, Y., O’Donnell, K., & Murphy, R. A. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.14522 · Cited by 72
Do subtle reminders of money change people’s political views?
Rohrer, D., Pashler, H., & Harris, C. R. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000058 · Cited by 72
The malleability of developmental trends in neutral and negative memory illusions.
Otgaar, H., Howe, M. L., Brackmann, N., & Smeets, T. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000127 · Cited by 77
Right-wing political orientation, national identification and the acceptance of immigrants and minorities
Verkuyten, M., Kollar, R., Gale, J., & Yogeeswaran, K. (2021) · Personality and Individual Differences · doi:10.1016/j.paid.2021.111217 · Cited by 72
The replication crisis: How might philosophy and theory of psychology be of use?
Morawski, J. G. (2019) · Journal of Theoretical and Philosophical Psychology · doi:10.1037/teo0000129 · Cited by 78
Replicating and fixing failed replications: The case of need for cognition and argument quality
Luttrell, A., Petty, R., & Xu, M.-R. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2016.09.006 · Cited by 64
Multisite Replication in Second Language Acquisition Research: Attention to Form During Listening and Reading Comprehension
Morgan‐Short, K., Marsden, E. J., Heil, J., Issa, B. I., Leow, R. P., Mikhaylova, A., Mikołajczak, S., Moreno, N., Slabakova, R., & Szudarski, P. (2018) · Language Learning · doi:10.1111/lang.12292 · Cited by 70
Creative destruction in science
Tierney, W., Hardy, J. H., Ebersole, C. R., Leavitt, K., Viganola, D., Clemente, E. G., Gordon, M., Dreber, A., Johannesson, M., Pfeiffer, T., et al. (2020) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2020.07.002 · Cited by 67
A replication study of the credit card effect on spending behavior and an extension to mobile payments
Liu, Y., & Dewitte, S. (2021) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2021.102472 · Cited by 65
Romance, risk, and replication: Can consumer choices and risk-taking be primed by mating motives?
Shanks, D. R., Vadillo, M. A., Riedel, B., Clymo, A., Govind, S., Hickin, N., Tamman, A. J. F., & Puhlmann, L. M. C. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000116 · Cited by 67
The role and value of replication in empirical software engineering results
Shepperd, M., Ajienka, N., & Counsell, S. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2018.01.006 · Cited by 67
Does the benefit of testing depend on lag, and if so, why? Evaluating the elaborative retrieval hypothesis
Rawson, K. A., Vaughn, K. E., & Carpenter, S. K. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0477-z · Cited by 70
Rate and success of study replication in ecology and evolution
Kelly, C. D. (2019) · PeerJ · doi:10.7717/peerj.7654 · Cited by 60
Benefits of Open and High-Powered Research Outweigh Costs
LeBel, E. P., Campbell, L., & Loving, T. J. (2016) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000049 · Cited by 67
Failed Replication of Oxytocin Effects on Trust: The Envelope Task Case
Lane, A., Mikolajczak, M., Treinen, E., Samson, D., Corneille, O., de Timary, P., & Luminet, O. (2015) · PLOS ONE · doi:10.1371/journal.pone.0137000 · Cited by 60
“Replication studies add great value to science [34; 35; 36] and are crucially needed in the OT research field if we want to dispose of a solid theoretical background for interpreting the significant and non-significant effects of OT.”
Background
Insufficient Effort Survey Responding: An Under‐Appreciated Problem in Work and Organisational Health Psychology Research
McGonagle, A. K., Huang, J. L. W., & Walsh, B. M. (2015) · Applied Psychology · doi:10.1111/apps.12058 · Cited by 61
Increasing propensity to mind‐wander by transcranial direct current stimulation? A registered report
Boayue, N. M., Csifcsák, G., Aslaksen, P. M., Turi, Z., Antal, A., Groot, J. M., Hawkins, G. E., Forstmann, B. U., Opitz, A., Thielscher, A., et al. (2019) · European Journal of Neuroscience · doi:10.1111/ejn.14347 · Cited by 62
Working memory capacity is equally unrelated to auditory distraction by changing-state and deviant sounds
Körner, U., Röer, J. P., Buchner, A., & Bell, R. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2017.05.005 · Cited by 62
Strengthening the foundation of educational psychology by integrating construct validation into open science reform
Flake, J. K. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1898962 · Cited by 58
Strategy mediation in working memory training in younger and older adults
Forsberg, A., Fellman, D., Laine, M., Johnson, W., & Logie, R. H. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820915107 · Cited by 62
‘MusiMath’ and ‘Academic Music’ – Two music‐based intervention programs for fractions learning in fourth grade students
Azaryahu, L., Courey, S. J., Elkoshi, R., & Adi‐Japha, E. (2019) · Developmental Science · doi:10.1111/desc.12882 · Cited by 58
Injunctive Norms and Alcohol Consumption: A Revised Conceptualization
Krieger, H., Neighbors, C., Lewis, M. A., LaBrie, J. W., Foster, D. W., & Larimer, M. E. (2016) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13037 · Cited by 58
Better together: Advancing life course research through multi-cohort analytic approaches
O’Connor, M., Spry, E., Patton, G. C., Moreno‐Betancur, M., Arnup, S. J., Downes, M., Goldfeld, S. R., Burgner, D. P., & Olsson, C. A. (2022) · Advances in Life Course Research · doi:10.1016/j.alcr.2022.100499 · Cited by 53
Theory Building, Replication, and Behavioral Priming
Locke, E. A. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691614567231 · Cited by 58
Open Science Promotes Diverse, Just, and Sustainable Research and Educational Outcomes
Grahe, J. E., Cuccolo, K., Leighton, D. C., & Alvarez, L. D. C. (2019) · Psychology Learning & Teaching · doi:10.1177/1475725719869164 · Cited by 63
Science is not a signal detection problem
Wilson, B. M., Harris, C. R., & Wixted, J. T. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1914237117 · Cited by 56
Examining the generalizability of research findings from archival data
Delios, A., Clemente, E. G., Wu, T., Tan, H., Wang, Y., Gordon, M., Viganola, D., Chen, Z., Dreber, A., Johannesson, M., et al. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2120377119 · Cited by 66
Does an option to review instructional explanations enhance example-based learning? It depends on learners’ academic self-concept.
Roelle, J., & Renkl, A. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000365 · Cited by 60
The perils of murky emotions: Emotion differentiation moderates the prospective relationship between naturalistic stress exposure and adolescent depression.
Starr, L. R., Hershenberg, R., Shaw, Z. A., Li, Y. I., & Santee, A. C. (2019) · Emotion · doi:10.1037/emo0000630 · Cited by 73
Testing Robustness of Child STEPs Effects with Children and Adolescents: A Randomized Controlled Effectiveness Trial
Weisz, J. R., Bearman, S. K., Ugueto, A. M., Herren, J., Evans, S. C., Cheron, D. M., Alleyne, A., Weissman, A. S., Tweed, J. L., Pollack, A. A., et al. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2019.1655757 · Cited by 60
The limits of replicability
Güttinger, S. (2020) · European Journal for Philosophy of Science · doi:10.1007/s13194-019-0269-1 · Cited by 72
The protective role of self-compassion for women’s positive body image: an open replication and extension
Siegel, J. A., Huellemann, K. L., Hillier, C. C., & Campbell, L. (2019) · Body Image · doi:10.1016/j.bodyim.2019.12.003 · Cited by 70

Authors: Simons, D. J.
Affiliations: University of Illinois Urbana-Champaign (US)
Corresponding author: Simons, Daniel J.
ORCID: Simons, Daniel J.
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2014-01
Volume: 9
Issue: 1
Pages: 76-80
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691613514755
OpenAlex: W2077240377
Cited by: 630
References: 18
Citations by year: 2026: 18 · 2025: 36 · 2024: 29 · 2023: 44 · 2022: 51 · 2021: 69 · 2020: 91 · 2019: 75 · 2018: 67 · 2017: 47 · 2016: 36 · 2015: 48 · 2014: 18
FWCI: 48.59
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
Keywords: direct replication, reproducibility, statistical power, replication study, research credibility

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The Value of Direct Replication

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks