Of apples and oranges, file drawers and garbage: Why validity issues in meta-analysis will not go away

The file drawer problem and tolerance for null results.

Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · see citing works

Primary, Secondary, and Meta-Analysis of Research

GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · see citing works

Meta-Analytic Procedures for Social Research

Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635 · see citing works

The earth is round (p < .05).

Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003 · see citing works

Meta-analysis of psychotherapy outcome studies.

Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154 · see citing works

The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.

Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033 · see citing works

A method for assessing the quality of a randomized control trial

Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349 · see citing works

Writing meta-analytic reviews.

Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108 · see citing works

Consequences of prejudice against the null hypothesis.

Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · see citing works

THEORY TESTING: COMBINING PSYCHOMETRIC META‐ANALYSIS AND STRUCTURAL EQUATIONS MODELING

VISWESVARAN, C., & ONES, D. S. (1995) · Personnel Psychology · doi:10.1111/j.1744-6570.1995.tb01784.x · Cited by 926 · see citing works

Do studies of statistical power have an effect on the power of studies?

Sedlmeier, P., & Gigerenzer, G. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.2.309 · Cited by 748 · see citing works

What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.

Schmidt, F. L. (1992) · American Psychologist · doi:10.1037/0003-066x.47.10.1173 · Cited by 564 · see citing works

Sexual offender recidivism revisited: A meta-analysis of recent treatment studies

Hall, G. C. N. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.63.5.802 · Cited by 532 · see citing works

A meta-analysis of treatment outcome for panic disorder

Gould, R. A., Ott, M. W., & Pollack, M. H. (1995) · Clinical Psychology Review · doi:10.1016/0272-7358(95)00048-8 · Cited by 520 · see citing works

Hypnosis as an adjunct to cognitive-behavioral psychotherapy: A meta-analysis.

Kirsch, I., Montgomery, G., & Sapirstein, G. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.63.2.214 · Cited by 480 · see citing works

Modeling Publication Selection Effects in Meta-Analysis

Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359 · see citing works

Efficacy of psychosocial treatments for geriatric depression: A quantitative review.

Scogin, F., & McElreath, L. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.1.69 · Cited by 342 · see citing works

Psychological distress associated with interpersonal violence: A meta-analysis

Weaver, T. L., & Clum, G. A. (1995) · Clinical Psychology Review · doi:10.1016/0272-7358(95)00004-9 · Cited by 200 · see citing works

Hypertrophic Scarring and Keloids: Pathomechanisms and Current and Emerging Treatment Strategies

Gauglitz, G. G., Korting, H. C., Pavicic, T., Ruzicka, T., & Jeschke, M. G. (2011) · Molecular Medicine · doi:10.2119/molmed.2009.00153 · Cited by 1,462 · see citing works

The relationship between nature connectedness and happiness: a meta-analysis

Capaldi, C. A., Dopko, R. L., & Zelenski, J. M. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00976 · Cited by 1,183 · see citing works

Examining the impact of culture’s consequences: A three-decade, multilevel, meta-analytic review of Hofstede’s cultural value dimensions

Taras, V., Kirkman, B. L., & Steel, P. (2010) · Journal of Applied Psychology · doi:10.1037/a0018938 · Cited by 1,160 · see citing works

Physical activity for cancer survivors: meta-analysis of randomised controlled trials

Fong, D. Y. T., Ho, J. W. C., Hui, B. P. H., Lee, A. M., Macfarlane, D. J., Leung, S. S. K., Cerin, E., Chan, W. Y. Y., Leung, I. P. F., Lam, S. H. S., et al. (2012) · BMJ · doi:10.1136/bmj.e70 · Cited by 782 · see citing works

Innovative technology-based interventions for autism spectrum disorders: a meta-analysis

Grynszpan, O., Weiss, P. L. (., Perez-Diaz, F., & Gal, E. (2014) · Autism · doi:10.1177/1362361313476767 · Cited by 621 · see citing works

Psychology's Renaissance

Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548 · see citing works

A meta-analysis and model of the relationship between sleep and depression in adolescents: recommendations for future research and clinical practice

Lovato, N., & Gradisar, M. (2014) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2014.03.006 · Cited by 594 · see citing works

Meta-analysis in ecology

Gurevitch, J., Curtis, P. S., & Jones, M. H. (2001) · Advances in Ecological Research · doi:10.1016/s0065-2504(01)32013-5 · Cited by 421 · see citing works

Effects of dance movement therapy and dance on health-related psychological outcomes. a meta-analysis update

Koch, S. C., Riege, R. F. F., Tisborn, K., Biondo, J., Martin, L., & Beelmann, A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01806 · Cited by 418 · see citing works

Publication Bias (The "File-Drawer Problem") in Scientific Inference

Scargle, J. D. (1999) · arXiv · doi:10.48550/arxiv.physics/9909033 · Cited by 313 · see citing works

An initial meta-analysis of acceptance and commitment therapy for treating substance use disorders

Lee, E. B., An, W., Levin, M. E., & Twohig, M. P. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.08.004 · Cited by 271 · see citing works

A systematic review of social support interventions for caregivers of people with dementia: Are they doing what they promise?

Dam, A. E. H., de Vugt, M. E., Klinkenberg, I. P. M., Verhey, F. R. J., & van Boxtel, M. P. J. (2016) · Maturitas · doi:10.1016/j.maturitas.2015.12.008 · Cited by 263 · see citing works

Efficacy of short-term psychotherapy for multiple medically unexplained physical symptoms: a meta-analysis

Kleinstäuber, M., Witthöft, M., & Hiller, W. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.001 · Cited by 212 · see citing works

Variables that affect the process and outcome of feedback, relevant for medical training: a meta‐review

van de Ridder, J. M. M., McGaghie, W. C., Stokking, K. M., & ten Cate, O. T. J. (2015) · Medical Education · doi:10.1111/medu.12744 · Cited by 154 · see citing works

The added impact of parenting education in early childhood education programs: A meta-analysis

Grindal, T., Bowne, J. B., Yoshikawa, H., Schindler, H. S., Duncan, G. J., Magnuson, K., & Shonkoff, J. P. (2016) · Children and Youth Services Review · doi:10.1016/j.childyouth.2016.09.018 · Cited by 127 · see citing works

A systematic review and meta-analysis of CBT interventions based on the Fennell model of low self-esteem

Kolubinski, D. C., Frings, D., Nikčević, A. V., Lawrence, J. A., & Spada, M. M. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.06.025 · Cited by 118 · see citing works

Anxiety-linked attentional bias and its modification: illustrating the importance of distinguishing processes and procedures in experimental psychopathology research

MacLeod, C., & Grafton, B. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.07.005 · Cited by 90 · see citing works

Guidelines for Meta-Analyses of Counseling Psychology Research

Quintana, S. M., & Minami, T. (2006) · The Counseling Psychologist · doi:10.1177/0011000006286991 · Cited by 83 · see citing works

A systematic review of telecounselling and its effectiveness in managing depression amongst minority ethnic communities

Dorstyn, D. S., Saniotis, A., & Sobhanian, F. (2013) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x13501767 · Cited by 31 · see citing works

UNDERUTILIZATION OF SHORT-TERM GROUP THERAPY: ENIGMATIC OR UNDERSTANDABLE?

Piper, W. E. (2008) · Psychotherapy Research · doi:10.1080/10503300701867512 · Cited by 32 · see citing works

Synthesizing the Evidence

(2006) · Systematic Reviews in the Social Sciences · doi:10.1002/9780470754887.ch6 · Cited by 12 · see citing works