Cited by 774Meta-analysis and systematic reviewsPsychology Research and BibliometricsPsychometric Methodologies and Testing

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases

Open access

Schäfer, Thomas, Schwarz, Marcus A.·2019·Frontiers in Psychology

DOI 10.3389/fpsyg.2019.00813PMC PMC6470248

Open this paper in CoChat — free account Open PDF

Abstract

Effect sizes are the currency of psychological research. They quantify the results of a study to answer the research question and are used to calculate statistical power. The interpretation of effect sizes—when is an effect small, medium, or large?—has been guided by the recommendations Jacob Cohen gave in his pioneering writings starting in 1962: Either compare an effect with the effects found in past research or use certain conventional benchmarks. The present analysis shows that neither of these recommendations is currently applicable. From past publications without pre-registration, 900 effects were randomly drawn and compared with 93 effects from publications with pre-registration, revealing a large difference: Effects from the former (median r = .36) were much larger than effects from the latter (median r = .16). That is, certain biases, such as publication bias or questionable research practices, have caused a dramatic inflation in published effects, making it difficult to compare an actual effect with the real population effects (as these are unknown). In addition, there were very large differences in the mean effects between psychological sub-disciplines and between different study designs, making it impossible to apply any global benchmarks. Many more pre-registered studies are needed in the future to derive a reliable picture of real population effects.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.3389/fpsyg.2019.00813

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
A power primer.
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Effect size guidelines for individual differences researchers
Gignac, G. E., & Szodorai, E. T. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.06.069 · Cited by 2,860

Flagged first, then by citations

Show all 43 references

Research works printed but not linked: 5

2001, Publication Manual of the American Psychological Association
2010, Publication Manual of the American Psychological Association
Cohen, 1977, Statistical Power Analysis for the Behavioral Sciences (revised Edn.).
Keppel, 1991, Design and Analysis: A Researcher’s Handbook.
Lehrer, 2010, The Truth Wears Off., 29

Sorted by citations

Interpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281
Effect Size Guidelines, Sample Size Calculations, and Statistical Power in Gerontology
Brydges, C. R. (2019) · Innovation in Aging · doi:10.1093/geroni/igz036 · Cited by 826
What is the test–retest reliability of common task-functional MRI measures? New empirical evidence and a meta-analysis
Elliott, M. L., Knodt, A. R., Ireland, D., Morris, M. L., Poulton, R., Ramrakha, S., Sison, M. L., Moffitt, T. E., Caspi, A., & Hariri, A. R. (2020) · Psychological Science · doi:10.1177/0956797620916786 · Cited by 714
Empirically derived guidelines for effect size interpretation in social psychology
Lovakov, A. V., & Рафиковна, А. Е. (2021) · European Journal of Social Psychology · doi:10.1002/ejsp.2752 · Cited by 755
Small Effects: The Indispensable Foundation for a Cumulative Psychological Science
Götz, F. M., Gosling, S. D., & Rentfrow, P. J. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620984483 · Cited by 610
Evaluation of a decided sample size in machine learning applications
Rajput, D., Wang, W.-J., & Chen, C.-C. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05156-9 · Cited by 411
Comparing meta-analyses and preregistered multiple-laboratory replication projects
Kvarven, A., Strømland, E., & Johannesson, M. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0787-z · Cited by 271
A Meta-Analytic Review of Preschool Social and Emotional Learning Interventions
Murano, D. M., Sawyer, J., & Lipnevich, A. A. (2020) · Review of Educational Research · doi:10.3102/0034654320914743 · Cited by 344
Meaningful associations in the adolescent brain cognitive development study
Dick, A. S., Lopez, D. A., Watts, A. L., Heeringa, S. G., Reuter, C., Bartsch, H., Fan, C. C., Kennedy, D. N., Palmer, C. E., Marshall, A. T., et al. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118262 · Cited by 240
How Many Participants Do I Need to Test an Interaction? Conducting an Appropriate Power Analysis and Achieving Sufficient Power to Detect an Interaction
Sommet, N., Weissman, D. L., Cheutin, N., & Elliot, A. J. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231178728 · Cited by 313
Power to Detect What? Considerations for Planning and Evaluating Sample Size
Giner‐Sorolla, R., Montoya, A. K., Reifman, A. S., Carpenter, T., Lewis, N. A., Aberson, C. L., Bostyn, D. H., Conrique, B. G., Ng, B., Schoemann, A. M., et al. (2024) · Personality and Social Psychology Review · doi:10.1177/10888683241228328 · Cited by 324
An Agenda for Open Science in Communication
Dienlin, T., Johannes, N., Bowman, N. D., Masur, P. K., Engesser, S., Kümpel, A. S., Lukito, J., Bier, L. M., Zhang, R., Johnson, B. K., et al. (2020) · Journal of Communication · doi:10.1093/joc/jqz052 · Cited by 252
Nudging: Progress to date and future directions
Beshears, J. L., & Kosowsky, H. (2020) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2020.09.001 · Cited by 223
Editorial Perspective: When is a ‘small effect’ actually large and impactful?
Carey, E., Ridler, I., Ford, T. J., & Stringaris, A. K. (2023) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13817 · Cited by 198
Protecting against researcher bias in secondary data analysis: challenges and potential solutions
Baldwin, J. R., Pingault, J.-B., Schoeler, T., Sallis, H. M., & Munafò, M. R. (2022) · European Journal of Epidemiology · doi:10.1007/s10654-021-00839-0 · Cited by 178
Effect sizes for nonparametric tests
Peres, F. F. (2025) · Biochemia Medica · doi:10.11613/bm.2026.010101 · Cited by 262
“Rarely safe to assume”: Evaluating the use and interpretation of manipulation checks in experimental social psychology
Ejelöv, E., & Luke, T. J. (2019) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2019.103937 · Cited by 175
Avoid Cohen’s ‘Small’, ‘Medium’, and ‘Large’ for Power Analysis
Correll, J., Mellinger, C., McClelland, G. H., & Judd, C. M. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.12.009 · Cited by 189
The Potential of Functional Near-Infrared Spectroscopy-Based Neurofeedback—A Systematic Review and Recommendations for Best Practice
Kohl, S. H., Mehler, D. M. A., Lührs, M., Thibault, R. T., Konrad, K., & Sorger, B. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00594 · Cited by 171
Moving beyond belief: A narrative review of potential biomarkers for transcutaneous vagus nerve stimulation
Burger, A. M., D’Agostini, M., Verkuil, B., & Diest, I. V. (2020) · Psychophysiology · doi:10.1111/psyp.13571 · Cited by 160
Recalibrating expectations about effect size: A multi-method survey of effect sizes in the ABCD study
Owens, M. M., Potter, A., Hyatt, C. S., Albaugh, M. D., Thompson, W. K., Jernigan, T. L., Yuan, D., Hahn, S., Allgaier, N. A., & Garavan, H. (2021) · PLoS ONE · doi:10.1371/journal.pone.0257535 · Cited by 157
How Firm Are the Foundations of Mind-Set Theory? The Claims Appear Stronger Than the Evidence
Burgoyne, A. P., Hambrick, D. Z., & Macnamara, B. N. (2020) · Psychological Science · doi:10.1177/0956797619897588 · Cited by 164
#EEGManyLabs: Investigating the replicability of influential EEG experiments
Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C., Beste, C., Bland, A. R., Bradford, D. E., Bublatzky, F., Busch, N. A., et al. (2021) · Cortex · doi:10.1016/j.cortex.2021.03.013 · Cited by 148
How shall we all live together?: Meta‐analytical review of the mutual intercultural relations in plural societies project
Berry, J. W., Lepshokova, Z. K., & Grigoryev, D. S. (2021) · Applied Psychology · doi:10.1111/apps.12332 · Cited by 149
Reconsidering the Link Between Self-Reported Personality Traits and Political Preferences
Bakker, B. N., Yphtach Lelkes, B., & Malka, A. (2021) · American Political Science Review · doi:10.1017/s0003055421000605 · Cited by 129
Personal Stories Can Shift Climate Change Beliefs and Risk Perceptions: The Mediating Role of Emotion
Gustafson, A., Ballew, M. T., Goldberg, M. H., Cutler, M., Rosenthal, S. A., & Leiserowitz, A. (2020) · Communication Reports · doi:10.1080/08934215.2020.1799049 · Cited by 124
Mask wearing in community settings reduces SARS-CoV-2 transmission
Leech, G., Smith, D., Monrad, J. T., Sandbrink, J. B., Snodin, B., Zinkov, R., Rader, B. M., Brownstein, J. S., Gal, Y., Bhatt, S., et al. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2119266119 · Cited by 118
Influence of long-term thermal history on thermal comfort and preference
Jowkar, M., de Dear, R., & Brusey, J. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.109685 · Cited by 116
The Effects of Spaced Practice on Second Language Learning: A Meta‐Analysis
Kim, S. K., & Webb, S. (2022) · Language Learning · doi:10.1111/lang.12479 · Cited by 119
Training for Wisdom: The Distanced-Self-Reflection Diary Method
Grossmann, I., Dorfman, A., Oakes, H., Santos, H. C., Vohs, K. D., & Scholer, A. A. (2021) · Psychological Science · doi:10.1177/0956797620969170 · Cited by 110
Visual Reasoning Strategies for Effect Size Judgments and Decisions
Kale, A., Kay, M., & Hullman, J. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030335 · Cited by 109
Brain Dynamics Underlying Cognitive Flexibility Across the Lifespan
Kupis, L. B., Goodman, Z. T., Kornfeld, S., Hoang, S., Romero, C., Dirks, B., Dehoney, J., Chang, C., Spreng, R. N., Nomi, J. S., et al. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab156 · Cited by 107
Open and reproducible neuroimaging: From study inception to publication
Niso, G., Botvinik‐Nezer, R., Appelhoff, S., de la Vega, A. I., Estéban, O., Etzel, J. A., Finc, K., Ganz, M., Gau, R., Halchenko, Y. O., et al. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119623 · Cited by 112
Leveraging Social Science to Generate Lasting Engagement with Climate Change Solutions
Goldberg, M. H., Gustafson, A., & van der Linden, S. (2020) · One Earth · doi:10.1016/j.oneear.2020.08.011 · Cited by 108
A Meta-analysis on Children’s Trust in Social Robots
Stower, R. E., Calvo-Barajas, N., Castellano, G., & Kappas, A. (2021) · International Journal of Social Robotics · doi:10.1007/s12369-020-00736-8 · Cited by 107
Replication concerns in sports and exercise science: a narrative review of selected methodological issues in the field
Mesquida, C., Murphy, J., Lakens, D., & Warne, J. P. (2022) · Royal Society Open Science · doi:10.1098/rsos.220946 · Cited by 110
How much distance do humans keep toward robots? Literature review, meta-analysis, and theoretical considerations on personal space in human-robot interaction
Leichtmann, B., & Nitsch, V. (2020) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2019.101386 · Cited by 89
Methods for Heart Rate Variability Biofeedback (HRVB): A Systematic Review and Guidelines
Lalanza, J. F., Lorente, S., Bullich, R., García, C., Losilla, J.-M., & Capdevila, L. (2023) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-023-09582-6 · Cited by 111
Digital training for building resilience: systematic review, meta-analysis, and meta-regression
Ang, W. H. D., Chew, H. S. J., Dong, J., Yi, H., Mahendren, R., & Lau, Y. (2022) · Stress and Health · doi:10.1002/smi.3154 · Cited by 83
“This suggests a need to look beyond the existing categorisation of effect sizes and locate other suitable indicators that may subsequently inform practice and policy (Kraft, 2020; Schäfer & Schwarz, 2019).”
Background
Identifying regions in prefrontal cortex related to working memory improvement: A novel meta-analytic method using electric field modeling
Wischnewski, M., Mantell, K. E., & Opitz, A. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.08.017 · Cited by 78
Enhancing precision in human neuroscience
Nebe, S., Reutter, M., Baker, D. H., Bölte, J., Domes, G., Gamer, M., Gärtner, A., Gießing, C., Gurr, C., Hilger, K., et al. (2023) · eLife · doi:10.7554/elife.85980 · Cited by 81
A survey on how preregistration affects the research workflow: better science but more work
Sarafoglou, A., Kovács, M., Bakos, B. E., Wagenmakers, E., & Aczél, B. (2022) · Royal Society Open Science · doi:10.1098/rsos.211997 · Cited by 83
How photo editing in social media shapes self-perceived attractiveness and self-esteem via self-objectification and physical appearance comparisons
Ozimek, P., Lainas, S., Bierhoff, H., & Rohmann, E. (2023) · BMC Psychology · doi:10.1186/s40359-023-01143-0 · Cited by 118
How representative are student convenience samples? A study of literacy and numeracy skills in 32 countries
Wild, H. A., Kyröläinen, A.-J., & Kuperman, V. (2022) · PLoS ONE · doi:10.1371/journal.pone.0271191 · Cited by 72
Effects of the Jigsaw method on student educational outcomes: systematic review and meta-analyses
Drouet, O., Lentillon‐Kaestner, V., & Margas, N. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1216437 · Cited by 143
What is the test-retest reliability of common task-fMRI measures? New empirical evidence and a meta-analysisPreprint
Elliott, M. L., Knodt, A. R., Ireland, D. R., Morris, M. L., Poulton, R., Ramrakha, S., Sison, M. L., Moffitt, T. E., Caspi, A., & Hariri, A. R. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/681700 · Cited by 71
The effects of performance feedback on organizational citizenship behaviour: a systematic review and meta-analysis
Tagliabue, M., Sigurjonsdottir, S. S., & Sandaker, I. (2020) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2020.1796647 · Cited by 101
Crisis ahead? Why human-robot interaction user studies may have replicability problems and directions for improvement
Leichtmann, B., Nitsch, V., & Mara, M. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2022.838116 · Cited by 66
A Guide for Calculating Study-Level Statistical Power for Meta-Analyses
Quintana, D. S. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221147260 · Cited by 95
The Relation Between Preference for Predictability and Autistic Traits
Goris, J., Braß, M., Cambier, C., Delplanque, J., Wiersema, J. R., & Braem, S. (2019) · Autism Research · doi:10.1002/aur.2244 · Cited by 74
Scientific-Consensus Communication About Contested Science: A Preregistered Meta-Analysis
van Stekelenburg, A., Schaap, G., Veling, H., Riet, J. V. ‘., & Buijzen, M. (2022) · Psychological Science · doi:10.1177/09567976221083219 · Cited by 69
The benefits of preregistration and Registered Reports
Lakens, D., Mesquida, C., Rasti, S., & Ditroilo, M. (2024) · Evidence-Based Toxicology · doi:10.1080/2833373x.2024.2376046 · Cited by 93
Are Small Effects the Indispensable Foundation for a Cumulative Psychological Science? A Reply to Götz et al. (2022)
Primbs, M. A., Pennington, C. R., Lakens, D., Silan, M. A. A., Lieck, D., Forscher, P. S., Buchanan, E. M., & Westwood, S. J. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221100420 · Cited by 72
Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology
van den Akker, O. R., van Assen, M. A. L. M., Bakker, M., Elsherif, M. M., Wong, T. K., & Wicherts, J. M. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02277-0 · Cited by 84
Effectiveness of Psychobiotics in the Treatment of Psychiatric and Cognitive Disorders: A Systematic Review of Randomized Clinical Trials
Mosquera, F. E. C., Martinez, S. L., & Liscano, Y. (2024) · Nutrients · doi:10.3390/nu16091352 · Cited by 75
Transformation of the media landscape: Infotainment versus expository narrations for communicating science in online videos
Davis, L. S., León, B., Bourk, M. J., & Finkler, W. (2020) · Public Understanding of Science · doi:10.1177/0963662520945136 · Cited by 61
A tutorial on using the paired t test for power calculations in repeated measures ANOVA with interactions
Langenberg, B., Janczyk, M., Koob, V., Kliegl, R. M., & Mayer, A. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01902-8 · Cited by 88
The dark side of going green: Dark triad traits predict organic consumption through virtue signaling, status signaling, and praise from others
Konuk, F. A., & Otterbring, T. (2023) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2023.103531 · Cited by 68
Predicting the moral consideration of artificial intelligences
Pauketat, J. V. T., & Anthis, J. R. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107372 · Cited by 60
Testing the association of growth mindset and grades across a challenging transition: Is growth mindset associated with grades?
Li, Y., & Bates, T. C. (2020) · Intelligence · doi:10.1016/j.intell.2020.101471 · Cited by 73
Treatment biomarkers for ADHD: Taking stock and moving forward
Michelini, G., Norman, L. J., Shaw, P., & Loo, S. K. (2022) · Translational Psychiatry · doi:10.1038/s41398-022-02207-2 · Cited by 65
Power to Detect What? Considerations for Planning and Evaluating Sample SizePreprint
Giner‐Sorolla, R., Montoya, A. K., Aberson, C. L., Carpenter, T., Lewis, N. A., Bostyn, D. H., Conrique, B. G., Ng, B., Reifman, A. S., Schoemann, A. M., et al. (2023) · doi:10.31234/osf.io/rv3kw · Cited by 62
Formative assessment, growth mindset, and achievement: examining their relations in the East and the West
Yan, Z., King, R. B., & Haw, J. Y. (2021) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2021.1988510 · Cited by 78
From lab to life: challenges and perspectives of fNIRS for haemodynamic-based neurofeedback in real-world environments
Klein, F., Kohl, S. H., Lührs, M., Mehler, D. M. A., & Sorger, B. (2024) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2023.0087 · Cited by 62
Help or flight? Increased threat imminence promotes defensive helping in humans
Vieira, J. B., Schellhaas, S., Enström, E., & Olsson, A. (2020) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2020.1473 · Cited by 61
Statistical power in network neuroscience
Helwegen, K., Libedinsky, I., & van den Heuvel, M. P. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.12.011 · Cited by 59
Externalizing Behavior Problems and Low Academic Achievement: Does a Causal Relation Exist?
Kulkarni, T., Sullivan, A. L., & Kim, J. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09582-6 · Cited by 71
The interplay between parenting and environmental sensitivity in the prediction of children’s externalizing and internalizing behaviors during COVID-19
Lionetti, F., Spinelli, M., Moscardino, U. M. M., Ponzetti, S., Garito, M. C., Dellagiulia, A., Aureli, T., Fasolo, M., & Pluess, M. (2022) · Development and Psychopathology · doi:10.1017/s0954579421001309 · Cited by 59
The Effect of Mindfulness-Based Intervention on Brain-Derived Neurotrophic Factor (BDNF): A Systematic Review and Meta-Analysis of Controlled Trials
Gomutbutra, P., Yingchankul, N., Chattipakorn, N., Chattipakorn, S. C., & Srisurapanont, M. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.02209 · Cited by 57
The Effect of Trust in Science and Media Use on Public Belief in Anthropogenic Climate Change: A Meta-analysis
Bogert, J. M., Buczny, J., Harvey, J. A., & Ellers, J. (2023) · Environmental Communication · doi:10.1080/17524032.2023.2280749 · Cited by 63
Peer presence promotes popular choices: A “Spicy” field study on social influence and brand choice
Otterbring, T. (2021) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2021.102594 · Cited by 54
Time and skeptical opinion content erode the effects of science coverage on climate beliefs and attitudes
Nyhan, B. J., Porter, E. V., & Wood, T. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2122069119 · Cited by 47
Who seeks help online? Comparing online and offline help-seeking preferences amongst youths with suicidal ideation
Wong, K. T. C., Chan, C. S., Chan, M. Y. H., Wong, C. L. H., Cheng, Q., Xiong, C., & Yip, P. S. F. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.05.056 · Cited by 47
Publication bias, statistical power and reporting practices in the Journal of Sports Sciences: potential barriers to replicability
Mesquida, C., Murphy, J., Lakens, D., & Warne, J. P. (2023) · Journal of Sports Sciences · doi:10.1080/02640414.2023.2269357 · Cited by 57
Maternal and Paternal Parenting and Child Prosocial Behavior: A Meta-Analysis Using a Structural Equation Modeling Design
van der Storm, L., Lissa, C. J. V., Lucassen, N., Helmerhorst, K. O. W., & Keizer, R. (2021) · Marriage & Family Review · doi:10.1080/01494929.2021.1927931 · Cited by 50
Self-Control Dynamics in Daily Life: The Importance of Variability Between Self-Regulatory Strategies and Strategy Differentiation
Wenzel, M., Bürgler, S., Rowland, Z., & Hennecke, M. (2021) · European Journal of Personality · doi:10.1177/08902070211043023 · Cited by 51
Transparent communication of evidence does not undermine public trust in evidence
Kerr, J. R., Schneider, C. R., Freeman, A. L. J., Marteau, T. M., & van der Linden, S. (2022) · PNAS Nexus · doi:10.1093/pnasnexus/pgac280 · Cited by 42
Tears evoke the intention to offer social support: A systematic investigation of the interpersonal effects of emotional crying across 41 countries
Zickfeld, J., van de Ven, N., Pich, O., Schubert, T. W., Berkessel, J. B., Pizarro, J. J., Bhushan, B., Mateo, N. J., Barbosa, S., Sharman, L. S., et al. (2021) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2021.104137 · Cited by 48
Aggressive video games research emerges from its replication crisis (Sort of)
Ferguson, C. J. (2020) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2020.01.002 · Cited by 49
Thirty Years of Psychological Wisdom Research: What We Know About the Correlates of an Ancient Concept
Dong, M., Weststrate, N. M., & Fournier, M. A. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221114096 · Cited by 51
Efficacy of Transcranial Alternating Current Stimulation in the Enhancement of Working Memory Performance in Healthy Adults: A Systematic Meta-Analysis
Nissim, N. R., McAfee, D., Edwards, S., Prato, A., Lin, J. X., Lu, Z., Coslett, H. B., & Hamilton, R. H. (2023) · Neuromodulation Technology at the Neural Interface · doi:10.1016/j.neurom.2022.12.014 · Cited by 38
Effort beats effectiveness in emotion regulation choice: Differences between suppression and distancing in subjective and physiological measures
Scheffel, C., Graupner, S., Gärtner, A., Zerna, J., Strobel, A., & Dörfel, D. (2021) · Psychophysiology · doi:10.1111/psyp.13908 · Cited by 42
A How-to Guide for Open-Science Practices in Special Education Research
Cook, B. G., Fleming, J. I., Hart, S. A., Lane, K. L., Therrien, W. J., van Dijk, W., & Wilson, S. E. (2021) · Remedial and Special Education · doi:10.1177/07419325211019100 · Cited by 42
Beliefs about Whether Spending Implies Wealth
Kappes, H., Gladstone, J., & Hershfield, H. E. (2020) · Journal of Consumer Research · doi:10.1093/jcr/ucaa060 · Cited by 24
An exploratory investigation on spatiotemporal parameters, margins of stability, and their interaction in bilateral vestibulopathy
Herssens, N., Saeys, W., Vereeck, L., Meijer, K., van de Berg, R., Rompaey, V. V., McCrum, C. L., & Hallemans, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-85870-7 · Cited by 37
Exercise behavior change revisited: Affective-reflective theory
Brand, R., & Panteleimon Ekkekakis, A. (2021) · Society for Transparency, Openness, and Replication in Kinesiology eBooks · doi:10.51224/b1004 · Cited by 43
How many participants do I need to test an interaction? Conducting an appropriate power analysis and achieving sufficient power to detect an interaction
Sommet, N., Weissman, D. L., Cheutin, N., & Elliot, A. (2022) · doi:10.31219/osf.io/xhe3u · Cited by 36
Burnout syndrome in dentists: Work-related factors
Gómez‐Polo, C., Casado, A. M. M., & Montero, J. (2022) · Journal of Dentistry · doi:10.1016/j.jdent.2022.104143 · Cited by 70
Symptom improvement and remission in untreated adults seeking treatment for obsessive-compulsive disorder: A systematic review and meta-analysis
Melkonian, M., McDonald, S., Scott, A. J., Karin, E., Dear, B. F., & Wootton, B. M. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.08.037 · Cited by 37
Improving the utility of non-significant results for educational research: A review and recommendations
Edelsbrunner, P. A., & Thurn, C. (2023) · Educational Research Review · doi:10.1016/j.edurev.2023.100590 · Cited by 53
Diffusion tensor imaging analysis along the perivascular space in the UK biobank
Clark, O. J., Delgado-Sánchez, A., Cullell, N., Corrêa, S. A. L., Krupiński, J., & Ray, N. J. (2024) · Sleep Medicine · doi:10.1016/j.sleep.2024.05.007 · Cited by 36
Adherence to 24-h movement behavior guidelines and psychosocial functioning in young children: a longitudinal analysis
Taylor, R. W., Haszard, J. J., Healey, D. M., Meredith-Jones, K. A., Taylor, B. J., & Galland, B. C. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01185-w · Cited by 40
Seven steps to enhance Open Science practices in animal science
Muñoz‐Tamayo, R., Nielsen, B. L., Gagaoua, M., Gondret, F., Krause, E. T., Morgavi, D., Olsson, I. A. S., Pastell, M., Taghipoor, M., Tedeschi, L. O., et al. (2022) · PNAS Nexus · doi:10.1093/pnasnexus/pgac106 · Cited by 41
Anxiety and Depression in Gifted Individuals: A Systematic and Meta-Analytic Review
Duplenne, L., Bourdin, B., Fernandez, D., Blondelle, G., & Aubry, A. (2023) · Gifted Child Quarterly · doi:10.1177/00169862231208922 · Cited by 51
Risk and resilience among Asian American youth: Ramifications of discrimination and low authenticity in self-presentations.
Luthar, S. S., Ebbert, A. M., & Kumar, N. L. (2021) · American Psychologist · doi:10.1037/amp0000764 · Cited by 36
The Influence of Diagnostic Labels on the Evaluation of Students: a Multilevel Meta-Analysis
Franz, D. J., Richter, T., Lenhard, W., Marx, P., Stein, R., & Ratz, C. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09716-6 · Cited by 43
School-based interventions to prevent anxiety, depression and conduct disorder in children and young people: a systematic review and network meta-analysis
Caldwell, D. M., Davies, S. R., Thorn, J. C., Palmer, J. C., Caro, P., Hetrick, S. E., Gunnell, D., Anwer, S., López-López, J. A., French, C. E., et al. (2021) · Public Health Research · doi:10.3310/phr09080 · Cited by 41
A systematic review of meta-analyses in second language research: current practices, issues, and recommendations
Vuogan, A., & Li, S. (2023) · Applied Linguistics Review · doi:10.1515/applirev-2022-0192 · Cited by 35
A Multilab Replication of the Induced-Compliance Paradigm of Cognitive Dissonance
Vaidis, D. C., Sleegers, W. W. A., van Leeuwen, F., DeMarree, K. G., Sætrevik, B., Ross, R. M., Schmidt, K., Protzko, J., Morvinski, C., Ghasemi, O., et al. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231213375 · Cited by 40
AI-Driven Mediation Strategies for Audience Depolarisation in Online Debates
Govers, J., Velloso, E., Kostakos, V., & Gonçalves, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642322 · Cited by 49

Authors: Schäfer, T., & Schwarz, M. A.
Affiliations: Chemnitz University of Technology (DE)
Corresponding author: Schäfer, Thomas
ORCID: Schäfer, Thomas
Schwarz, Marcus A.
Venue: Frontiers in Psychology
Publisher: Frontiers Media SA
Published: 2019-04-11
Volume: 10
Pages: 813-813
ISSN: 1664-1078 (ISSN-L)
DOI: 10.3389/fpsyg.2019.00813
PMC: PMC6470248
OpenAlex: W2937326640
Cited by: 774
References: 43
Citations by year: 2026: 73 · 2025: 105 · 2024: 101 · 2023: 123 · 2022: 149 · 2021: 127 · 2020: 75 · 2019: 18
FWCI: 61.73
Type: journal article
Language: en
Open access: gold
doi.org
Licence: cc-by
creativecommons.org/licenses/by/4.0/ (vor)
Locations: Frontiers in Psychology (publishedVersion, cc-by)
Europe PMC (PubMed Central) (publishedVersion, cc-by)
PubMed Central (publishedVersion, cc-by)
PubMed (publishedVersion)
DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Qucosa (Saxon State and University Library Dresden) (submittedVersion, cc-by)
Funders: Technische Universität Chemnitz
Deutsche Forschungsgemeinschaft
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords: effect size, Cohen's d, publication bias, questionable research practices, preregistration, effect size inflation, statistical power

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks