Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size
Open accessThe DOI matches its Crossref record; 64 of the 65 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The p value obtained from a significance test provides no information about the magnitude or importance of the underlying phenomenon. Therefore, additional reporting of effect size is often recommended. Effect sizes are theoretically independent from sample size. Yet this may not hold true empirically: non-independence could indicate publication bias. METHODS: We investigate whether effect size is independent from sample size in psychological research. We randomly sampled 1,000 psychological articles from all areas of psychological research. We extracted p values, effect sizes, and sample sizes of all empirical papers, and calculated the correlation between effect size and sample size, and investigated the distribution of p values. RESULTS: We found a negative correlation of r = -.45 [95% CI: -.53; -.35] between effect size and sample size. In addition, we found an inordinately high number of p values just passing the boundary of significance. Additional data showed that neither implicit nor explicit power analysis could account for this pattern of findings. CONCLUSION: The negative correlation between effect size and samples size, and the biased distribution of p values indicate pervasive publication bias in the entire field of psychology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The correlation between sample size and ES was estimated to be as high as -0.52 in tests of mean difference,40 indicating that studies with larger samples produce smaller ESs.”
From Psychological interventions for depression and anxiety: a systematic review and meta-analysis of Iranian chronic pain trials. (2020) · cites this paper as [40]
In the citing paper
“Because many effects in the biomedical, behavioural and social sciences are small [60–62], it is important for studies to be sufficiently high-powered.”
From The natural selection of bad science (2016) · cites this paper as [62]
In the citing paper
“As an impact of a high risk of bias11 and a low sample size12 of the studies included into meta-analyses is known, these potential confounders should be considered in dose-response-analyses, likewise.”
From Dose-response-relationship of stabilisation exercises in patients with chronic non-specific low back pain: a systematic review with meta-regression (2020) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Consequently, a substantial part of what we think is secure knowledge might actually be (statistical) errors [46–49].”
BackgroundPublication Manual of the American Psychological Association
DeCleene, K. E., & Fogo, J. (2012) · Occupational Therapy In Health Care · doi:10.3109/07380577.2011.629024 · Cited by 3,167
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
(2011) · Cited by 2,025
On the Use of Beta Coefficients in Meta-Analysis.
Peterson, R. A., & Brown, S. P. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.175 · Cited by 1,643 · cited 1×
“ES for regression analysis were converted according to Peterson and Brown [37].”
MethodContradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Clinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
Cited by
Power Analysis and Effect Size in Mixed Effects Models: A Tutorial
Brysbaert, M., & Stevens, M. (2018) · Journal of Cognition · doi:10.5334/joc.10 · Cited by 1,420
“Because such p-values require large observed effect sizes in small designs, the effects sizes reported in the literature tend to be inflated, also those from studies that can be replicated (Kuhberger et al., 2014; Open Science Collaboration, 2015; Vasishth & Gelman, 2017).”
ResultThe natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
Brysbaert, M. (2019) · Journal of Cognition · doi:10.5334/joc.72 · Cited by 996
Yarkoni, T. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20001685 · Cited by 701
Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods
Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847196 · Cited by 588
The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections
Epstein, R., & Robertson, R. E. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1419828112 · Cited by 577
Zwaan, R. A., Etz, A., Lucas, R. E., & Donnellan, M. B. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x17001972 · Cited by 444
Meta-analysis of pro-environmental behaviour spillover
Maki, A., Carrico, A. R., Raimi, K. T., Truelove, H. B., Araujo, B., & Yeung, K. L. (2019) · Nature Sustainability · doi:10.1038/s41893-019-0263-9 · Cited by 377
Four reasons to prefer Bayesian analyses over significance testing
Dienes, Z., & Mclatchie, N. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1266-z · Cited by 354
The role of administrative data in the big data revolution in social science research
Connelly, R., Playford, C. J., Gayle, V., & Dibben, C. (2016) · Social Science Research · doi:10.1016/j.ssresearch.2016.04.015 · Cited by 330
Sample Size Guideline for Correlation Analysis
Bujang, M. A., & Baharum, N. (2016) · World Journal of Social Science Research · doi:10.22158/wjssr.v3n1p37 · Cited by 310
Psychological Determinants of Whole-Body Endurance Performance
McCormick, A., Meijen, C., & Marcora, S. (2015) · Sports Medicine · doi:10.1007/s40279-015-0319-6 · Cited by 290
Steffens, N. K., Munt, K. A., van Knippenberg, D., Platow, M. J., & Haslam, S. A. (2021) · Organizational Psychology Review · doi:10.1177/2041386620962569 · Cited by 267
Steffens, N. K., LaRue, C. J., Haslam, C., Walter, Z. C., Cruwys, T., Munt, K. A., Haslam, S. A., Jetten, J., & Tarrant, M. (2021) · Health Psychology Review · doi:10.1080/17437199.2019.1669481 · Cited by 259
Yarkoni, T. (2019) · doi:10.31234/osf.io/jqw35 · Cited by 244
What meta-analyses reveal about the replicability of psychological research.
Stanley, T. D., Carter, E. C., & Doucouliagos, H. (2018) · Psychological Bulletin · doi:10.1037/bul0000169 · Cited by 307
Vandenbroucke, L., Spilt, J., Verschueren, K., Piccinin, C., & Baeyens, D. (2018) · Review of Educational Research · doi:10.3102/0034654317743200 · Cited by 225
Finkel, E. J., Eastwick, P. W., & Reis, H. T. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000007 · Cited by 202
Effect sizes for nonparametric tests
Fiel Peres, F. (2026) · Biochemia medica · doi:10.11613/bm.2026.010101 · Cited by 159
The impact of word prevalence on lexical decision times: Evidence from the Dutch Lexicon Project 2.
Brysbaert, M., Stevens, M., Mandera, P., & Keuleers, E. (2016) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000159 · Cited by 164
Owens, M. M., Potter, A., Hyatt, C. S., Albaugh, M., Thompson, W. K., Jernigan, T., Yuan, D., Hahn, S., Allgaier, N., & Garavan, H. (2021) · PLOS ONE · doi:10.1371/journal.pone.0257535 · Cited by 156
Tutorial: Power Analyses for Interaction Effects in Cross-Sectional Regressions
Baranger, D. A. A., Finsaas, M. C., Goldstein, B. L., Vize, C. E., Lynam, D. R., & Olino, T. M. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231187531 · Cited by 275
Effects of competition outcome on testosterone concentrations in humans: An updated meta-analysis
Geniole, S. N., Bird, B. M., Ruddick, E. L., & Carré, J. M. (2016) · Hormones and Behavior · doi:10.1016/j.yhbeh.2016.10.002 · Cited by 172
Linden, A. H., & Hönekopp, J. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620964193 · Cited by 180
Espírito‐Santo, H., & Daniel, F. (2015) · Revista Portuguesa de Investigação Comportamental e Social · doi:10.7342/ismt.rpics.2015.1.1.14 · Cited by 285
Brown, N. J. L., & Heathers, J. A. J. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550616673876 · Cited by 127
The search for human pheromones: The lost decades and the necessity of returning to first principles
Wyatt, T. D. (2015) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2014.2994 · Cited by 123
Backx, R., Skirrow, C., Dente, P., Barnett, J. H., & Cormack, F. K. (2020) · Journal of Medical Internet Research · doi:10.2196/16792 · Cited by 127
Mitić, M., Woodcock, K. A., Amering, M., Krammer, I., Stiehl, K. A. M., Zehetmayer, S., & Schrank, B. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.589403 · Cited by 202
#EEGManyLabs: Investigating the replicability of influential EEG experiments
Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S. Y., Beste, C., Bland, A. R., Bradford, D. E., Bublatzky, F., Busch, N. A., et al. (2021) · Cortex · doi:10.1016/j.cortex.2021.03.013 · Cited by 127
National parochialism is ubiquitous across 42 nations around the world
Romano, A., Sutter, M., Liu, J. H.-F., Yamagishi, T., & Balliet, D. P. (2021) · Nature Communications · doi:10.1038/s41467-021-24787-1 · Cited by 148
P-hacking and publication bias interact to distort meta-analytic effect size estimates
Friese, M., & Frankenbach, J. (2020) · Psychological Methods · doi:10.1037/met0000246 · Cited by 122
Lovreglio, R., Dillies, E., Kuligowski, E. D., Rahouti, A., & Haghani, M. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104452 · Cited by 128
A kinked meta‐regression model for publication bias correction
Bom, P. R. D., & Rachinger, H. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1352 · Cited by 133
Does psychotherapy work? An umbrella review of meta‐analyses of randomized controlled trials
Dragioti, E., Karathanos, V. T., Gerdle, B. U. C., & Εvangelou, Ε. (2017) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12713 · Cited by 125
Feeling Bodies: Embodying Psychology
Cromby, J. (2015) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137380586 · Cited by 122
Making 'null effects' informative: statistical techniques and inferential frameworks
Harms, C., & Lakens, D. (2018) · Journal of Clinical and Translational Research · doi:10.18053/jctres.03.2017s2.007 · Cited by 133
Making 'Null Effects' Informative: Statistical Techniques and Inferential Frameworks
Harms, C., & Lakens, D. (2018) · doi:10.31234/osf.io/48zca · Cited by 99
Cybulski, Ł., Mayo‐Wilson, E., & Grant, S. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000115 · Cited by 95
Distributions of p -values smaller than .05 in psychology: what is going on?
Hartgerink, C. H. J., van Aert, R. C. M., Nuijten, M. B., Wicherts, J. M., & van Assen, M. A. L. M. (2016) · PeerJ · doi:10.7717/peerj.1935 · Cited by 89
Antipsychotic polypharmacy and metabolic syndrome in schizophrenia: a review of systematic reviews
Ijaz, S., Bolea-Alamanac, B. M., Davies, S., Savović, J., Richards, A., Sullivan, S. A., & Moran, P. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1848-y · Cited by 115
A Meta-Analytic Re-Appraisal of the Framing Effect
Steiger, A., & Kühberger, A. (2018) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000321 · Cited by 106
Self-citationAllen, K., Higgins, S., & Adams, J. W. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09470-8 · Cited by 106
Testing the idea of privileged awareness of self-relevant information.
Stein, T., Siebold, A., & van Zoest, W. (2016) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000197 · Cited by 85
What is the evidence on the best way to get evidence into use in education?
Gorard, S. A. C., See, B. H., & Siddiqui, N. (2020) · Review of Education · doi:10.1002/rev3.3200 · Cited by 142
Digital training for building resilience: systematic review, meta-analysis, and meta-regression
Ang, W. H. D., Chew, H. S. J., Dong, J., Yi, H., Mahendren, R., & Lau, Y. (2022) · Stress and Health · doi:10.1002/smi.3154 · Cited by 83
“Secondly, half of the included trials (n = 11) had a small sample size, this parameter could have potentially inflated the effect size (Kühberger et al., 2014).”
BackgroundInzlicht, M., Gervais, W., & Berkman, E. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2659409 · Cited by 82
Yang, Y., Sánchez‐Tójar, A., O’Dea, R. E., Noble, D. W. A., Koricheva, J., Jennions, M. D., Parker, T. H., Lagisz, M., & Nakagawa, S. (2023) · BMC Biology · doi:10.1186/s12915-022-01485-y · Cited by 119
The study of followers in leadership research: A systematic and critical review
Oc, B., Chintakananda, K., Bashshur, M. R., & Day, D. V. (2023) · The Leadership Quarterly · doi:10.1016/j.leaqua.2022.101674 · Cited by 117
Laterality 2020: entering the next decade
Ocklenburg, S., Berretz, G., Packheiser, J., & Friedrich, P. (2020) · Laterality Asymmetries of Body Brain and Cognition · doi:10.1080/1357650x.2020.1804396 · Cited by 77
Psychological treatments in adult ADHD: a systematic review
Fullen, T., Jones, S. L., Emerson, L. M., & Adamou, M. (2020) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-020-09794-8 · Cited by 73
Mueller, J., & Niederer, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-73954-9 · Cited by 72
Sanjida, S., McPhail, S. M., Shaw, J., Couper, J., Kissane, D., Price, M. A., & Janda, M. (2018) · Psycho-Oncology · doi:10.1002/pon.4794 · Cited by 74
Making Replication MainstreamPreprint
Zwaan, R. A., Etz, A. J., Lucas, R. E., & Donnellan, B. M. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4tg9c · Cited by 92
Tutorial: Power analyses for interaction effects in cross-sectional regressionsPreprint
Baranger, D. A. A., Finsaas, M. C., Goldstein, B. L., Vize, C. E., Lynam, D. R., & Olino, T. M. (2022) · doi:10.31234/osf.io/5ptd7 · Cited by 73
Wild, H. A., Kyröläinen, A.-J., & Kuperman, V. (2022) · PLoS ONE · doi:10.1371/journal.pone.0271191 · Cited by 94
de Winter, J. C., & Dodou, D. (2015) · PeerJ · doi:10.7717/peerj.733 · Cited by 78
Effects of the Jigsaw method on student educational outcomes: systematic review and meta-analyses
Drouet, O., Lentillon‐Kaestner, V., & Margas, N. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1216437 · Cited by 162
The significance fallacy in inferential statistics
Kühberger, A., Fritz, A., Lermer, E., & Scherndl, T. (2015) · BMC Research Notes · doi:10.1186/s13104-015-1020-4 · Cited by 85
Self-citationMatthes, J., Marquart, F., Naderer, B., Arendt, F., Schmuck, D., & Adam, K. (2015) · Communication Methods and Measures · doi:10.1080/19312458.2015.1096334 · Cited by 74
Indahlastari, A., Hardcastle, C., Albizu, A., Alvarez-Alvarado, S., Boutzoukas, E. M., Evangelista, N. D., Hausman, H. K., Kraft, J., Langer, K., & Woods, A. J. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s259499 · Cited by 64
Landy, M. S. H., Davey, C. J., Quintero, D., Pecora, A., & McShane, K. E. (2016) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2015.08.004 · Cited by 66
Bartos̆, F., Maier, M., Wagenmakers, E., Nippold, F., Doucouliagos, H., Ioannidis, J. P. A., Otte, W. M., Sladekova, M., Deresssa, T. K., Bruns, S. B., et al. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1703 · Cited by 94
Comment: What p-hacking really looks like: A comment on Masicampo and LaLande (2012)
Lakens, D. (2015) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.982664 · Cited by 56
Barker, J. B., Slater, M. J., Pugh, G., Mellalieu, S. D., McCarthy, P. J., Jones, M. V., & Moran, A. P. (2020) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2020.101746 · Cited by 78
Renkewitz, F., & Keiner, M. (2019) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000386 · Cited by 55
Reproducibility in the Social Sciences
Moody, J. W., Keister, L. A., & Ramos, M. C. (2022) · Annual Review of Sociology · doi:10.1146/annurev-soc-090221-035954 · Cited by 67
Belief Updating and Paranoia in Individuals With Schizophrenia
Sheffield, J. M., Suthaharan, P., Leptourgos, P., & Corlett, P. R. (2022) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2022.03.013 · Cited by 54
Bornmann, L., Wray, K. B., & Haunschild, R. (2019) · Scientometrics · doi:10.1007/s11192-019-03326-2 · Cited by 71
Making 'Null Effects' Informative: Statistical Techniques and Inferential Frameworks
Harms, C., & Lakens, D. (2018) · Europe PMC (PubMed Central) · doi:10.17605/osf.io/48zca · Cited by 52
Open science, closed doors: The perils and potential of open science for research in practice
Guzzo, R. A., Schneider, B., & Nalbantian, H. R. (2022) · Industrial and Organizational Psychology · doi:10.1017/iop.2022.61 · Cited by 61
Guay, F., Valois, P., Falardeau, É., & Lessard, V. (2016) · Learning and Individual Differences · doi:10.1016/j.lindif.2015.11.014 · Cited by 50
Donnelly, N.-A., Hickey, A., Burns, A., Murphy, P., & Doyle, F. (2015) · PLOS ONE · doi:10.1371/journal.pone.0128213 · Cited by 49
Television, Continuity, and Change: A Meta-Analysis of Five Decades of Cultivation Research
Hermann, E., Morgan, M., & Shanahan, J. E. (2021) · Journal of Communication · doi:10.1093/joc/jqab014 · Cited by 70
A meta-analysis of contingent-capture effects
Büsel, C., Voracek, M., & Ulrich Ansorge, A. (2018) · Psychological Research · doi:10.1007/s00426-018-1087-3 · Cited by 52
Reporting errors and biases in published empirical findings: Evidence from innovation research
Bruns, S. B., Asanov, I., Bode, R., Dunger, M., Funk, C., Hassan, S. M., Hauschildt, J., Heinisch, D. P., Kempa, K., König, J., et al. (2019) · Research Policy · doi:10.1016/j.respol.2019.05.005 · Cited by 61
Spalek, K., Fastenrath, M., Ackermann, S., Auschra, B., Coynel, D., Frey, J. N., Gschwind, L., Hartmann, F., van der Maarel, N., Papassotiropoulos, A., et al. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2384-14.2015 · Cited by 64
Park, S., & Schott, N. (2021) · Applied Neuropsychology Adult · doi:10.1080/23279095.2020.1864374 · Cited by 52
On the challenges of drawing conclusions from p -values just below 0.05
Lakens, D. (2015) · PeerJ · doi:10.7717/peerj.1142 · Cited by 44
Gender Differences in Anti-Gay Prejudice: Evidence for Stability and Change
Kite, M. E., Whitley, B. E., Buxton, K., & Ballas, H. (2021) · Sex Roles · doi:10.1007/s11199-021-01227-4 · Cited by 52
Effect size and statistical power in the rodent fear conditioning literature – A systematic review
Carneiro, C. F. D., Moulin, T. C., Macleod, M. R., & Amaral, O. B. (2018) · PLoS ONE · doi:10.1371/journal.pone.0196258 · Cited by 54
Ferguson, C. J. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615593353 · Cited by 42
Vermeulen, I., Beukeboom, C. J., Batenburg, A., Avrămiea, A.-E., Stoyanov, D., van de Velde, B., & Oegema, D. (2015) · Communication Methods and Measures · doi:10.1080/19312458.2015.1096333 · Cited by 39
The Evolution of Behavior Analysis: Toward a Replication Crisis?
Locey, M. L. (2020) · Perspectives on Behavior Science · doi:10.1007/s40614-020-00264-w · Cited by 47
Magnotti, J. F., Mallick, D. B., Feng, G. Y., Zhou, B., Zhou, W., & Beauchamp, M. S. (2015) · Experimental Brain Research · doi:10.1007/s00221-015-4324-7 · Cited by 44
RetractedConditional equivalence testing: An alternative remedy for publication bias
Campbell, H., & Gustafson, P. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195145 · Cited by 46
A 20-Year Review of Outcome Reporting Bias in Moderated Multiple Regression
O’Boyle, E. H., Banks, G. C., Carter, K., Walter, S. L., & Yuan, Z. (2018) · Journal of Business and Psychology · doi:10.1007/s10869-018-9539-8 · Cited by 43
Meta‐synthesis and comparative meta‐analysis of education research findings: some risks and benefits
Higgins, S. (2016) · Review of Education · doi:10.1002/rev3.3067 · Cited by 44
Terruzzi, S., Albini, F., Massetti, G., Etzi, R., Gallace, A., & Vallar, G. (2023) · Neuropsychology Review · doi:10.1007/s11065-023-09586-3 · Cited by 46
Knight, J. R., Sherritt, L., Gibson, E. B., Levinson, J. A., Grubb, L. K., Samuels, R. C., Silva, T., Vernacchio, L., Wornham, W. L., & Harris, S. K. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.6258 · Cited by 44
Hare, R. M., Schlatter, S., Rhodes, G., & Simmons, L. W. (2017) · Royal Society Open Science · doi:10.1098/rsos.160831 · Cited by 41
Facial affect processing in incarcerated violent males: A systematic review
Chapman, H., Gillespie, S. M., & Mitchell, I. (2017) · Aggression and Violent Behavior · doi:10.1016/j.avb.2017.10.006 · Cited by 51
Interpreting t-Statistics Under Publication Bias: Rough Rules of Thumb
Winship, C., & Zhuo, X. (2018) · Journal of Quantitative Criminology · doi:10.1007/s10940-018-9387-8 · Cited by 46
Results Blind Science Publishing
Locascio, J. J. (2017) · Basic and Applied Social Psychology · doi:10.1080/01973533.2017.1336093 · Cited by 45
Ang, W. R., Ang, W. H. D., Cham, S. Q. G., Mel, S. D., Chew, H. S. J., & Devi, M. K. (2023) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2023.102446 · Cited by 45
Behavioral and brain signatures of substance use vulnerability in childhood
Rapuano, K. M., Rosenberg, M. D., Maza, M. T., Dennis, N. J., Dorji, M., Greene, A. S., Horien, C. L., Scheinost, D., Constable, R. T., & Casey, B. J. (2020) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2020.100878 · Cited by 43
Ehring, T. W., Limburg, K., Kunze, A. E., Wittekind, C. E., Werner, G. G., Wolkenstein, L., Guzey, M., & Cludius, B. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102163 · Cited by 49
Goltermann, J., Winter, N. R., Meinert, S., Sindermann, L., Lemke, H., Leehr, E. J., Grotegerd, D., Winter, A., Thiel, K., Waltemate, L., et al. (2022) · Psychological Medicine · doi:10.1017/s0033291722001623 · Cited by 37
Koch, J., Drazic, I., & Schermuly, C. C. (2023) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12429 · Cited by 54
Zunhammer, M., Geis, S., Busch, V., Eichhammer, P., & Greenlee, M. W. (2016) · Scientific Reports · doi:10.1038/srep31606 · Cited by 38
Metadata
- Authors
- Kühberger, A., Fritz, A., & Scherndl, T.
- Affiliations
- University of Salzburg (AT)
- Corresponding author
- Kühberger, Anton
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-09-05
- Volume
- 9
- Issue
- 9
- Pages
- e105825
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4156299
- OpenAlex
- W1998410565
- Cited by
- 399
- References
- 65
- Citations by year
- 2026: 10 · 2025: 36 · 2024: 27 · 2023: 44 · 2022: 45 · 2021: 44 · 2020: 38 · 2019: 35 · 2018: 35 · 2017: 29 · 2016: 23 · 2015: 30 · 2014: 2
- FWCI
- 27.31
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Österreichischen Akademie der Wissenschaften
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, effect size, sample size, p-values, statistical significance, power analysis, negative correlation, p-value distribution, psychology research
- MeSH terms
- Mental Disorders, Humans, Psychology, Research, Epidemiologic Research Design, Publication Bias, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.