Cited by 455Meta-analysis and systematic reviewsPsychology Research and BibliometricsStatistical Methods and Bayesian Inference

The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.

The ironic effect of significant results on the credibility of multiple-study articles.

Schimmack, Ulrich·2012·Psychological Methods

DOI 10.1037/a0029487

Open this paper in CoChat — free account

Abstract

Cohen (1962) pointed out the importance of statistical power for psychology as a science, but statistical power of studies has not increased, while the number of studies in a single article has increased. It has been overlooked that multiple studies with modest power have a high probability of producing nonsignificant results because power decreases as a function of the number of statistical tests that are being conducted (Maxwell, 2004). The discrepancy between the expected number of significant results and the actual number of significant results in multiple-study articles undermines the credibility of the reported results, and it is likely that questionable research practices have contributed to the reporting of too many significant results (Sterling, 1959). The problem of low power in multiple-study articles is illustrated using Bem's (2011) article on extrasensory perception and Gailliot et al.'s (2007) article on glucose and self-regulation. I conclude with several recommendations that can increase the credibility of scientific evidence in psychological journals. One major recommendation is to pay more attention to the power of studies to produce positive results without the help of questionable research practices and to request that authors justify sample sizes with a priori predictions of effect sizes. It is also important to publish replication studies with nonsignificant results if these studies have high power to replicate a published finding.

Integrity signals

Registry

Crossref · 10.1037/a0029487

Cites

79 of 79 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
A power primer.
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
GPOWER: A general power analysis program
Erdfelder, E., Faul, F., & Buchner, A. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203630 · Cited by 4,864
Required sample size to detect the mediated effect
Fritz, M. S., & MacKinnon, D. P. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01882.x · Cited by 4,810
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 5×
“Achieve 80% Power to Produce Significant Results in All”
BackgroundResultInfluential

Flagged first, then by citations

Show all 76 references

Sorted by citations

An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381
Why self-control seems (but may not be) limited
Inzlicht, M., Schmeichel, B. J., & Macrae, C. N. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.12.009 · Cited by 1,026
Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli.
Westfall, J., Kenny, D. A., & Judd, C. M. (2014) · Journal of Experimental Psychology: General · doi:10.1037/xge0000014 · Cited by 928
Recommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M. T., Fruyt, F. D., Houwer, J. D., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R. M., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 876
Replicability, Robustness, and Reproducibility in Psychological Science
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., et al. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-114157 · Cited by 770
Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis
Shrout, P. E., & Rodgers, J. L. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011845 · Cited by 830
Using design thinking to improve psychological interventions: The case of the growth mindset during the transition to high school.
Yeager, D. S., Romero, C., Paunesku, D., Hulleman, C. S., Schneider, B., Hinojosa, C., Lee, H. Y., O'Brien, J., Flint, K., Roberts, A., et al. (2016) · Journal of Educational Psychology · doi:10.1037/edu0000098 · Cited by 691
Facts Are More Important Than Novelty: Replication in the Education Sciences
Makel, M. C., & Plucker, J. A. (2014) · Educational Researcher · doi:10.3102/0013189x14545513 · Cited by 609
Psychology's Renaissance
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548
A series of meta-analytic tests of the depletion effect: Self-control does not seem to rely on a limited resource.
Carter, E. C., Kofler, L. M., Forster, D. E., & McCullough, M. E. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000083 · Cited by 594
On Integrating the Components of Self-Control
Kotabe, H., & Hofmann, W. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615593382 · Cited by 522
National Hiring Experiments Reveal 2:1 Faculty Preference for Women on Stem Tenure Track
Williams, W. M., & Ceci, S. J. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1418878112 · Cited by 435
The N-Pact Factor: Evaluating the Quality of Empirical Journals with Respect to Sample Size and Statistical Power
Fraley, R. C., & Vazire, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109019 · Cited by 409
Breaking the cycle of mistrust: Wise interventions to provide critical feedback across the racial divide.
Yeager, D. S., Purdie-Vaughns, V. J., Garcia, J., Apfel, N. H., Brzustoski, P., Master, A., Hessert, W. T., Williams, M. E., & Cohen, G. L. (2013) · Journal of Experimental Psychology General · doi:10.1037/a0033906 · Cited by 434
The far-reaching effects of believing people can change: Implicit theories of personality shape stress, health, and achievement during adolescence.
Yeager, D. S., Johnson, R., Spitzer, B. J., Trzesniewski, K. H., Powers, J., & Dweck, C. S. (2014) · Journal of Personality and Social Psychology · doi:10.1037/a0036335 · Cited by 389
Implications of the Credibility Revolution for Productivity, Creativity, and Progress
Vazire, S. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617751884 · Cited by 398
A weak scientific basis for gaming disorder: Let us err on the side of caution
van Rooij, A. J., Ferguson, C. J., Colder Carras, M., Kardefelt-Winther, D., Shi, J., Aarseth, E., Bean, A. M., Bergmark, K. H., Brus, A., Coulson, M., et al. (2018) · Journal of Behavioral Addictions · doi:10.1556/2006.7.2018.19 · Cited by 346
A meta-analysis and review of holistic face processing.
Richler, J. J., & Gauthier, I. (2014) · Psychological Bulletin · doi:10.1037/a0037004 · Cited by 340
Implementing Reproducible Research
Stodden, V. (2014) · doi:10.1201/b16868 · Cited by 314
Continuously Cumulating Meta-Analysis and Replicability
Braver, S. L., Thoemmes, F. J., & Rosenthal, R. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614529796 · Cited by 308
Initial evidence of research quality of registered reports compared with the standard publishing model
Soderberg, C. K., Errington, T. M., Schiavone, S. R., Bottesini, J., Thorn, F. S., Vazire, S., Esterling, K. M., & Nosek, B. A. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01142-4 · Cited by 295
It’s Time to Broaden the Replicability Conversation: Thoughts for and From Clinical Psychological Science
Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617690042 · Cited by 251
Qualitative Research Methods
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.010 · Cited by 279
A Large Scale Test of the Effect of Social Class on Prosocial Behavior
Korndörfer, M., Egloff, B., & Schmukle, S. C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0133193 · Cited by 255
A Short (Personal) Future History of Revolution 2.0
Spellman, B. A. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615609918 · Cited by 213
Improving the Dependability of Research in Personality and Social Psychology
Funder, D. C., Levine, J. M., Mackie, D. M., Morf, C. C., Sansone, C., Vazire, S., & West, S. G. (2013) · Personality and Social Psychology Review · doi:10.1177/1088868313507536 · Cited by 299
Publication bias and the limited strength model of self-control: has the evidence for ego depletion been overestimated?
Carter, E. C., & McCullough, M. E. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00823 · Cited by 381
The Psychology of Replication and Replication in Psychology
Francis, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459520 · Cited by 249
Do the disadvantaged legitimize the social system? A large-scale test of the status–legitimacy hypothesis.
Brandt, M. J. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0031751 · Cited by 248
On the reproducibility of meta-analyses: six practical recommendations
Lakens, D., Hilgard, J., & Staaks, J. P. C. (2016) · BMC Psychology · doi:10.1186/s40359-016-0126-3 · Cited by 238
A meta-analysis of the facial feedback literature: Effects of facial feedback on emotional experience are small and variable.
Coles, N. A., Larsen, J. T., & Lench, H. C. (2019) · Psychological Bulletin · doi:10.1037/bul0000194 · Cited by 255
Trending Norms: A Lever for Encouraging Behaviors Performed by the Minority
Mortensen, C. R., Neel, R., Cialdini, R. B., Jaeger, C. M., Jacobson, R. P., & Ringel, M. M. (2019) · Social Psychological and Personality Science · doi:10.1177/1948550617734615 · Cited by 221
Power to Detect What? Considerations for Planning and Evaluating Sample Size
Giner‐Sorolla, R., Montoya, A. K., Reifman, A. S., Carpenter, T., Lewis, N. A., Aberson, C. L., Bostyn, D. H., Conrique, B. G., Ng, B., Schoemann, A. M., et al. (2024) · Personality and Social Psychology Review · doi:10.1177/10888683241228328 · Cited by 324
Publication bias and the failure of replication in experimental psychology
Francis, G. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0322-y · Cited by 243
Best research practices in psychology: Illustrating epistemological and pragmatic considerations with the case of relationship science.
Finkel, E. J., Eastwick, P. W., & Reis, H. T. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000007 · Cited by 208
Meta-analyses are no substitute for registered replications: a skeptical perspective on religious priming
van Elk, M., Matzke, D., Gronau, Q. F., Guan, M., Vandekerckhove, J., & Wagenmakers, E. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01365 · Cited by 197
Six Questions for the Resource Model of Control (and Some Answers)
Inzlicht, M., & Berkman, E. T. (2015) · Social and Personality Psychology Compass · doi:10.1111/spc3.12200 · Cited by 201
The I3 Model
Finkel, E. J. (2013) · Advances in experimental social psychology · doi:10.1016/b978-0-12-800052-6.00001-9 · Cited by 180
Crowdsourcing hypothesis tests: Making transparent how design choices shape research results.
Landy, J. F., Jia, M. (., Ding, I. L., Viganola, D., Tierney, W., Dreber, A., Johannesson, M., Pfeiffer, T., Ebersole, C. R., Gronau, Q. F., et al. (2020) · Psychological Bulletin · doi:10.1037/bul0000220 · Cited by 168
Reconceptualizing replication as a sequence of different studies: A replication typology
Hüffmeier, J., Mazei, J., & Schultze, T. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.09.009 · Cited by 177
Conceptualizing and evaluating the replication of research results
Fabrigar, L. R., & Wegener, D. T. (2015) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.07.009 · Cited by 168
Preventing Symptoms of Depression by Teaching Adolescents That People Can Change: Effects of a Brief Incremental Theory of Personality Intervention at 9-Month Follow-Up
Miu, A. S., & Yeager, D. S. (2015) · Clinical Psychological Science · doi:10.1177/2167702614548317 · Cited by 164
Questionable research practices among italian research psychologists
Agnoli, F., Wicherts, J. M., Veldkamp, C. L. S., Albiero, P., & Cubelli, R. (2017) · PLoS ONE · doi:10.1371/journal.pone.0172792 · Cited by 173
Power Posing: P- Curving the Evidence
Simmons, J. P., & Simonsohn, U. (2017) · Psychological Science · doi:10.1177/0956797616658563 · Cited by 179
On Attenuated Interactions, Measurement Error, and Statistical Power: Guidelines for Social and Personality Psychologists
Blake, K. R., & Gangestad, S. (2020) · Personality and Social Psychology Bulletin · doi:10.1177/0146167220913363 · Cited by 159
Let’s Put Our Money Where Our Mouth Is
Maner, J. K. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614528215 · Cited by 151
No Evidence of the Ego-Depletion Effect across Task Characteristics and Individual Differences: A Pre-Registered Study
Lurquin, J., Michaelson, L., Barker, J. E., Gustavson, D. E., von Bastian, C. C., Carruth, N. P., & Miyake, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0147770 · Cited by 171
Too True to be Bad
Lakens, D., & Etz, A. (2017) · Social Psychology and Personality Science · doi:10.1177/1948550617693058 · Cited by 110
Philosophy of science and the replicability crisis
Romero, F. (2019) · Philosophy Compass · doi:10.1111/phc3.12633 · Cited by 166
Robust Bayesian meta‐analysis: Model‐averaging across complementary publication bias adjustment methods
Bartos̆, F., Maier, M., Wagenmakers, E., Doucouliagos, H., & Stanley, T. D. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1594 · Cited by 156
The Longitudinal Association between Self–Esteem and Depressive Symptoms in Adolescents: Separating Between–Person Effects from Within–Person Effects
Masselink, M., Van Roekel, E., Hankin, B. L., Keijsers, L., Lodder, G. M. A., Vanhalst, J., Verhagen, M., Young, J. F., & Oldehinkel, A. J. (2018) · European Journal of Personality · doi:10.1002/per.2179 · Cited by 141
A meta-analysis of blood glucose effects on human decision making.
Orquin, J. L., & Kurzban, R. (2015) · Psychological Bulletin · doi:10.1037/bul0000035 · Cited by 147
Research Practices That Can Prevent an Inflation of False-Positive Rates
Murayama, K., Pekrun, R., & Fiedler, K. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868313496330 · Cited by 124
The temporal dynamics of opportunity costs: A normative account of cognitive fatigue and boredom.
Agrawal, M., Mattar, M. G., Cohen, J. D., & Daw, N. D. (2021) · Psychological Review · doi:10.1037/rev0000309 · Cited by 134
The frequency of excess success for articles in Psychological Science
Francis, G. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0601-x · Cited by 130
Replication, statistical consistency, and publication bias
Francis, G. (2013) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2013.02.003 · Cited by 126
Replicating Studies in Which Samples of Participants Respond to Samples of Stimuli
Westfall, J., Judd, C. M., & Kenny, D. A. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614564879 · Cited by 133
The (mis)measurement of the Dark Triad Dirty Dozen: exploitation at the core of the scale
Kajonius, P., Persson, B. N., Rosenberg, P., & Garcia, D. (2016) · PeerJ · doi:10.7717/peerj.1748 · Cited by 122
Replicability Crisis in Social Psychology: Looking at the Past to Find New Pathways for the Future
Świątkowski, W., & Dompnier, B. (2017) · International Review of Social Psychology · doi:10.5334/irsp.66 · Cited by 132
Is ego depletion too incredible? Evidence for the overestimation of the depletion effect
Carter, E. C., & McCullough, M. E. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13000952 · Cited by 109
The state of social and personality science: Rotten to the core, not so bad, getting better, or getting worse?
Motyl, M. S., Demos, A. P., Carsel, T. S., Hanson, B. E., Melton, Z. J., Mueller, A. B., Prims, J., Sun, J., Washburn, A. N., Wong, K., et al. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000084 · Cited by 114
The Bitter Truth About Sugar and Willpower
Vadillo, M. A., Gold, N., & Osman, M. (2016) · Psychological Science · doi:10.1177/0956797616654911 · Cited by 107
Fairness violations elicit greater punishment on behalf of another than for oneself
FeldmanHall, O., Sokol-Hessner, P., Van Bavel, J. J., & Phelps, E. A. (2014) · Nature Communications · doi:10.1038/ncomms6306 · Cited by 106
The Hidden Talents Approach: Theoretical and Methodological Challenges
Frankenhuis, W. E., Young, E. S., & Ellis, B. J. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.03.007 · Cited by 119
Age and gender differences in narcissism: A comprehensive study across eight measures and over 250,000 participants.
Weidmann, R., Chopik, W. J., Ackerman, R. A., Allroggen, M., Bianchi, E. C., Brecheen, C., Campbell, W. K., Gerlach, T. M., Geukes, K., Grijalva, E. J., et al. (2023) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000463 · Cited by 129
Longitudinal changes in attachment orientation over a 59-year period.
Chopik, W. J., Edelstein, R. S., & Grimm, K. J. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000167 · Cited by 106
The crisis of confidence in research findings in psychology: Is lack of replication the real problem? Or is it something else?
Schmidt, F. L., & Oh, I.-S. (2016) · Archives of Scientific Psychology · doi:10.1037/arc0000029 · Cited by 145
The Ergonomics of Dishonesty
Yap, A. J., Wazlawek, A. S., Lucas, B. J., Cuddy, A. J. C., & Carney, D. R. (2013) · Psychological Science · doi:10.1177/0956797613492425 · Cited by 110
The propagation of self-control: Self-control in one domain simultaneously improves self-control in other domains.
Tuk, M. A., Zhang, K., & Sweldens, S. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000065 · Cited by 96
Event-related potentials and cognition in Parkinson’s disease: An integrative review
Seer, C., Lange, F., Georgiev, D., Jahanshahi, M., & Kopp, B. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.08.003 · Cited by 100
Dispatching the wandering mind? Toward a laboratory method for cuing “spontaneous” off-task thought
McVay, J. C., & Kane, M. J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00570 · Cited by 110
A meta-analysis of criterion effects for the Implicit Relational Assessment Procedure (IRAP) in the clinical domain
Vahey, N. A., Nicholson, E., & Barnes-Holmes, D. (2015) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2015.01.004 · Cited by 92
The problem of latent attentional capture: Easy visual search conceals capture by task-irrelevant abrupt onsets.
Gaspelin, N., Ruthruff, E. D., & Lien, M.-C. (2016) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000214 · Cited by 93
Sweet delusion. Glucose drinks fail to counteract ego depletion
Lange, F., & Eggert, F. (2014) · Appetite · doi:10.1016/j.appet.2013.12.020 · Cited by 101
Z-curve 2.0: Estimating Replication Rates and Discovery Rates
Bartos̆, F., & Schimmack, U. (2022) · Meta-Psychology · doi:10.15626/mp.2021.2720 · Cited by 106
Self-citation
Statistical learning and dyslexia: a systematic review
Schmalz, X., Altoè, G., & Mulatti, C. (2016) · Annals of Dyslexia · doi:10.1007/s11881-016-0136-0 · Cited by 99
Replications in Comparative Cognition: What Should We Expect and How Can We Improve?
Farrar, B. G., Boeckle, M., & Clayton, N. S. (2020) · Animal Behavior and Cognition · doi:10.26451/abc.07.01.02.2020 · Cited by 90
Editorial
Vazire, S. (2015) · Social Psychological and Personality Science · doi:10.1177/1948550615603955 · Cited by 90
Evaluating the evidential value of empirically supported psychological treatments (ESTs): A meta-scientific review.
Sakaluk, J. K., Williams, A. J., Kilshaw, R. E., & Rhyner, K. T. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000421 · Cited by 95
Change Goals Robustly Predict Trait Growth: A Mega-Analysis of a Dozen Intensive Longitudinal Studies Examining Volitional Change
Hudson, N. W., Fraley, R. C., Chopik, W. J., & Briley, D. A. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619878423 · Cited by 89
How much distance do humans keep toward robots? Literature review, meta-analysis, and theoretical considerations on personal space in human-robot interaction
Leichtmann, B., & Nitsch, V. (2020) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2019.101386 · Cited by 89
A Validity-Based Framework for Understanding Replication in Psychology
Fabrigar, L. R., Wegener, D. T., & Petty, R. E. (2020) · Personality and Social Psychology Review · doi:10.1177/1088868320931366 · Cited by 114
Evidence-Based Management and the Trustworthiness of Our Cumulative Scientific Knowledge: Implications for Teaching, Research, and Practice
Kepes, S., Bennett, A. A., & McDaniel, M. A. (2014) · Academy of Management Learning and Education · doi:10.5465/amle.2013.0193 · Cited by 99
Climate control: The relationship between social identity threat and cues to an identity-safe culture.
Hall, W. M., Schmader, T., Aday, A. E., Inness, M., & Croft, E. A. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000137 · Cited by 92
Pathways to ethnic-racial identity development and psychological adjustment: The differential associations of cultural socialization by parents and peers.
Nelson, S. C., Syed, M., Tran, A. G. T. T., Hu, A. W., & Lee, R. M. (2018) · Developmental Psychology · doi:10.1037/dev0000597 · Cited by 103
The apology mismatch: Asymmetries between victim's need for apologies and perpetrator's willingness to apologize
Leunissen, J. M., Cremer, D. D., Folmer, C. R., & van Dijke, M. (2012) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2012.12.005 · Cited by 83
Research Design in Clinical Psychology
Kazdin, A. E. (2021) · doi:10.1017/9781108993647 · Cited by 240
A comprehensive meta-analysis of money priming.
Lodder, P., Ong, H. H., Grasman, R. P. P. P., & Wicherts, J. M. (2019) · Journal of Experimental Psychology General · doi:10.1037/xge0000570 · Cited by 86
Escaping Paternalism
Rizzo, M. J., & Whitman, G. (2019) · Cambridge University Press eBooks · doi:10.1017/9781139061810 · Cited by 132
Virtual reality check: Statistical power, reported results, and the validity of research on the psychology of virtual reality and immersive environments
Lanier, M., Waddell, T. F., Elson, M., Tamul, D. J., Ivory, J., & Przybylski, A. K. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.06.015 · Cited by 79
Estimating Population Mean Power Under Conditions of Heterogeneity and Selection for Significance
Brunner, J., & Schimmack, U. (2020) · Meta-Psychology · doi:10.15626/mp.2018.874 · Cited by 76
Self-citation
A depleted mind feels inefficacious: Ego‐depletion reduces self‐efficacy to exert further self‐control
Chow, J. T.-S., Hui, C. M., & Lau, S. (2015) · European Journal of Social Psychology · doi:10.1002/ejsp.2120 · Cited by 75
Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events
Bem, D., Tressoldi, P. E., Rabeyron, T., & Duggan, M. (2016) · F1000Research · doi:10.12688/f1000research.7177.2 · Cited by 84
Hypocritical flip-flop, or courageous evolution? When leaders change their moral minds.
Kreps, T. A., Laurin, K., & Merritt, A. C. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000103 · Cited by 78
Invalid Claims About the Validity of Implicit Association Tests by Prisoners of the Implicit Social-Cognition Paradigm
Schimmack, U. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691621991860 · Cited by 84
Self-citation
Dyadic measurement invariance and its importance for replicability in romantic relationship science
Sakaluk, J. K., Fisher, A. N., & Kilshaw, R. E. (2021) · Personal Relationships · doi:10.1111/pere.12341 · Cited by 74
Open Science Is Liberating and Can Foster Creativity
Frankenhuis, W. E., & Nettle, D. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691618767878 · Cited by 74
The quest for an optimal alpha
Miller, J. O., & Ulrich, R. (2019) · PLoS ONE · doi:10.1371/journal.pone.0208631 · Cited by 84
The impact of self-control depletion on social preferences in the ultimatum game
Achtziger, A., Alós‐Ferrer, C., & Wagner, A. K. (2015) · Journal of Economic Psychology · doi:10.1016/j.joep.2015.12.005 · Cited by 79
Using mouse cursor tracking to investigate online cognition: Preserving methodological ingenuity while moving toward reproducible science
Schoemann, M., O’Hora, D. P., Dale, R. A. C., & Scherbaum, S. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01851-3 · Cited by 70

Authors: Schimmack, U.
Affiliations: University of Toronto (CA)
Corresponding author: Schimmack, Ulrich
ORCID: Schimmack, Ulrich
Venue: Psychological Methods
Publisher: American Psychological Association (APA)
Published: 2012
Volume: 17
Issue: 4
Pages: 551-566
ISSN: 1082-989X (ISSN-L)
1939-1463
DOI: 10.1037/a0029487
OpenAlex: W2164150544
Cited by: 455
References: 76
Citations by year: 2026: 8 · 2025: 10 · 2024: 14 · 2023: 15 · 2022: 24 · 2021: 55 · 2020: 27 · 2019: 56 · 2018: 36 · 2017: 47 · 2016: 42 · 2015: 48 · 2014: 38 · 2013: 29 · 2012: 5
FWCI: 43.66
Type: journal article
Language: en
Open access: closed
Locations: Psychological Methods (publishedVersion)
PubMed (publishedVersion)
Funders: Social Sciences and Humanities Research Council of Canada
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: statistical power, research credibility, questionable research practices, non-significant results, sample size justification, replication study, extrasensory perception
MeSH terms: Humans, Psychology, Research Design, Statistics as Topic, Publication Bias, Sample Size

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The ironic effect of significant results on the credibility of multiple-study articles.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks