The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Abstract
Meta-analysis collects and synthesizes results from individual studies to estimate an overall effect size. If published studies are chosen, say through a literature review, then an inherent selection bias may arise, because, for example, studies may tend to be published more readily if they are statistically significant, or deemed to be more “interesting” in terms of the impact of their outcomes. We develop a simple rank-based data augmentation technique, formalizing the use of funnel plots, to estimate and adjust for the numbers and outcomes of missing studies. Several nonparametric estimators are proposed for the number of missing studies, and their properties are developed analytically and through simulations. We apply the method to simulated and epidemiological datasets and show that it is both effective and consistent with other criteria in the literature.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Publication bias was investigated by applying the trim and fill method, where effect sizes are recalculated to adjust for supposed publication biases (Duval & Tweedie, 2000).”
From Taking stock: A meta-analysis of the effects of foreign language enjoyment (2022) · cites this paper as Duval & Tweedie, 2000
In the citing paper
“The trim‐and‐fill procedure determined that nine studies should be added to create symmetry.”
From Problem-oriented policing for reducing crime and disorder: An updated systematic review and meta-analysis (2020) · cites this paper as Duval and Tweedie (2000)
In the citing paper
“Like many systematic reviews, our meta‐analyses used the trim‐and‐fill procedure to explore whether publication bias might be affecting the results and to estimate how the reported effects would change if the bias were to be removed (Duval & Tweedie, 2000; Duval, 2005).”
From Hot spots policing of small geographic areas effects on crime (2019) · cites this paper as Duval & Tweedie, 2000
In the citing paper
“When we encountered publication bias, we conducted a trim and fill adjusted analysis 25 to remove the most extreme small studies from the positive side of the funnel plot, and recalculated the effect size iteratively, until the funnel plot was symmetrical around the (new) effect size.”
From Diabetes mellitus in people with schizophrenia, bipolar disorder and major depressive disorder: a systematic review and large scale meta‐analysis (2016) · cites this paper as [25]
In the citing paper
“Variations in the risk for glucose abnormalities are evident in the literature, with the highest risk being associated with clozapine, olanzapine and quetiapine in carefully designed studies 25,34,35 .”
From Diabetes mellitus in people with schizophrenia, bipolar disorder and major depressive disorder: a systematic review and large scale meta‐analysis (2016) · cites this paper as [25]
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Self-citationWasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
Casella, G., & Berger, R. L. (1993) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,835
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“The negative binomial forms here are reminiscent of those used by Eberly and Casella (1999) and Givens et al.”
MethodSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,486
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,422
Research works printed but not linked: 10
- 1983, British Medical Journal, 280, 508
- Cooper H., 1998, Synthesizing Research
- Dear K., 1997, Statistical Science, 12, 245
- DuMouchel W., 1997, Statistical Science, 12, 244
- Duval S. J., 1999, “Effects of Publication Bias in Meta-Analysis,”
- Duval S. J., “Robustness of the ‘Trim and Fill’ publication bias approach to different mechanisms for study suppression,”
- Eberly L. E., 1999, Journal of Official Statistics, 15
- Hedges L., 1985, Statistical Methods for Meta-Analysis
- Sugita M., 1994, Tokai Journal of Experimental and Clinical Medicine, 19, 29
- Sutton A. J., 1999, “The Impact of Publication Bias on Meta-Analyses Within the Cochrane Database of Systematic Reviews,”
Cited by
Sorted by citations
Items 101–200 of 1,059
Behavior Problems and Mental Health Referrals of International Adoptees
Juffer, F., & van IJzendoorn, M. H. (2005) · JAMA · doi:10.1001/jama.293.20.2501 · Cited by 652
Perceived Racism and Mental Health Among Black American Adults: A Meta-Analytic Review
Pieterse, A. L., Todd, N. R., Neville, H. A., & Carter, R. T. (2012) · Journal of Counseling Psychology · doi:10.1037/a0026208 · Cited by 649
Groh, A. M., Roisman, G. I., van IJzendoorn, M. H., Bakermans-Kranenburg, M. J., & Fearon, R. P. (2012) · Child Development · doi:10.1111/j.1467-8624.2011.01711.x · Cited by 638
Mol, S. E., Bus, A. G., & de Jong, M. T. (2009) · Review of Educational Research · doi:10.3102/0034654309332561 · Cited by 635
Association Between Time to Initiation of Adjuvant Chemotherapy and Survival in Colorectal Cancer
Biagi, J. J., Raphael, M. J., Mackillop, W. J., Kong, W., King, W. D., & Booth, C. M. (2011) · JAMA · doi:10.1001/jama.2011.749 · Cited by 631
McDonald, S. D., Han, Z., Mulla, S. M., Beyene, J., & on behalf of the Knowledge Synthesis Group (2010) · BMJ · doi:10.1136/bmj.c3428 · Cited by 664
Inhibitory control and psychopathology: A meta-analysis of studies using the stop signal task
LIPSZYC, J., & SCHACHAR, R. (2010) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617710000895 · Cited by 627
Structure! Agency! (And Other Quarrels): A Meta-Analysis Of Institutional Theories Of Organization
Heugens, P. P. M. A. R., & Lander, M. W. (2009) · Academy of Management Journal · doi:10.5465/amj.2009.36461835 · Cited by 650
Quraishi, M. N., Widlak, M., Bhala, N., Moore, D., Price, M., Sharma, N., & Iqbal, T. H. (2017) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.14201 · Cited by 617
Publication bias in reports of animal stroke studies leads to major overstatement of efficacy
Sena, E. S., van der Worp, H. B., Bath, P. M. W., Howells, D. W., & Macleod, M. R. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000344 · Cited by 600
“For each intervention, and for all interventions together (with individual experiments being pooled for a global analysis), the prevalence of publication bias was assessed using funnel plotting [36], Egger regression [37], and the Duval and Tweedie nonparametric trim-and-fill approach [27] (enabled in METATRIM, an add…”
MethodBruce, N. (2008) · Bulletin of the World Health Organization · doi:10.2471/blt.07.044529 · Cited by 610
Organic farming enhances soil microbial abundance and activity—A meta-analysis and meta-regression
Lori, M., Symanczik, S., Mader, P. M., Deyn, G. B. D., & Gattinger, A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0180442 · Cited by 691
Risk Factors for School Absenteeism and Dropout: A Meta-Analytic Review
Gubbels, J., van der Put, C. E., & Assink, M. (2019) · Journal of Youth and Adolescence · doi:10.1007/s10964-019-01072-5 · Cited by 596
Parent Involvement in Homework: A Research Synthesis
Patall, E. A., Cooper, H. M., & Robinson, J. C. (2008) · Review of Educational Research · doi:10.3102/0034654308325185 · Cited by 615
Meta-evaluation of meta-analysis: ten appraisal questions for biologists
Nakagawa, S., Noble, D. W. A., Senior, A. M., & Lagisz, M. (2017) · BMC Biology · doi:10.1186/s12915-017-0357-7 · Cited by 579
Positive but variable effects of crop diversification on biodiversity and ecosystem services
Beillouin, D., Ben‐Ari, T., Malézieux, E., Seufert, V., & Makowski, D. (2021) · Global Change Biology · doi:10.1111/gcb.15747 · Cited by 590
Socioeconomic Status and Bullying: A Meta-Analysis
Tippett, N., & Dieter Wolke, C. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.301960 · Cited by 664
Social Relationships and Mortality Risk: A Meta-analytic Review
Holt-Lunstad, J., Smith, T., & Layton, J. (2010) · SciVee · doi:10.4016/19865.01 · Cited by 613
Recent developments in meta‐analysis
Sutton, A. J., & Higgins, J. P. T. (2007) · Statistics in Medicine · doi:10.1002/sim.2934 · Cited by 601
Koch, A. J., D'Mello, S. D., & Sackett, P. R. (2014) · Journal of Applied Psychology · doi:10.1037/a0036734 · Cited by 664
Physical Activity and Physical Self-Concept in Youth: Systematic Review and Meta-Analysis
Babic, M., Morgan, P. J., Plotnikoff, R. C., Lonsdale, C., White, R. L., & Lubans, D. R. (2014) · Sports Medicine · doi:10.1007/s40279-014-0229-z · Cited by 669
How to unring the bell: A meta-analytic approach to correction of misinformation
Walter, N., & Murphy, S. T. (2018) · Communication Monographs · doi:10.1080/03637751.2018.1467564 · Cited by 561
Prevalence and determinants of adolescent pregnancy in Africa: a systematic review and Meta-analysis
Kassa, G. M., Arowojolu, A. O., Odukogbe, A.-T. A., & Worku, A. (2018) · Reproductive Health · doi:10.1186/s12978-018-0640-2 · Cited by 593
Newby, J. M., McKinnon, A., Kuyken, W., Gilbody, S., & Dalgleish, T. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.06.002 · Cited by 545
A systematic review of intravenous ketamine for postoperative analgesia
Laskowski, K., Stirling, A., McKay, W. P. S., & Lim, H. J. (2011) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-011-9560-0 · Cited by 575
Meta‐analysis of digit ratio 2D:4D shows greater sex difference in the right hand
Hönekopp, J., & Watson, S. J. (2010) · American Journal of Human Biology · doi:10.1002/ajhb.21054 · Cited by 566
A meta-analysis of 50 years of ruptured abdominal aortic aneurysm repair
Bown, M. J., Sutton, A. J., BELL, P. R. F., & Sayers, R. D. (2002) · British journal of surgery · doi:10.1046/j.1365-2168.2002.02122.x · Cited by 561
The many faces of the Still-Face Paradigm: A review and meta-analysis
Mesman, J., van IJzendoorn, M. H., & Bakermans‐Kranenburg, M. J. (2009) · Developmental Review · doi:10.1016/j.dr.2009.02.001 · Cited by 557
The relations between parents’ Big Five personality factors and parenting: A meta-analytic review.
Prinzie, P., Stams, G. J. J. M., Deković, M., Reijntjes, A. H. A., & Belsky, J. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015823 · Cited by 615
Kyndt, E., Raes, E., Lismont, B., Timmers, F., Cascallar, E. C., & Dochy, F. J. R. C. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.02.002 · Cited by 705
Parental correlates in child and adolescent physical activity: a meta-analysis
Yao, C. A., & Rhodes, R. E. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0163-y · Cited by 540
Carter, E. C., Kofler, L. M., Forster, D. E., & McCullough, M. E. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000083 · Cited by 594
Effects of music interventions on stress-related outcomes: a systematic review and two meta-analyses
de Witte, M., Spruit, A., van Hooren, S., Moonen, X., & Stams, G.-J. (2020) · Health Psychology Review · doi:10.1080/17437199.2019.1627897 · Cited by 539
A Review and Evaluation of Meta-Analysis Practices in Management Research
Geyskens, I., Krishnan, R., Steenkamp, J. E. M., & Cunha, P. V. (2008) · Journal of Management · doi:10.1177/0149206308328501 · Cited by 547
Human handedness: A meta-analysis.
Παπαδάτου-Παστού, Μ., Ntolka, E., Schmitz, J., Martin, M., Munafo, M. R., Ocklenburg, S., & Paracchini, S. (2020) · Psychological Bulletin · doi:10.1037/bul0000229 · Cited by 534
Psychosis as a risk factor for violence to others: A meta-analysis.
Douglas, K. S., Guy, L. S., & Hart, S. D. (2009) · Psychological Bulletin · doi:10.1037/a0016311 · Cited by 548
Han, Z., Mulla, S. M., Beyene, J., Liao, G., & McDonald, S. D. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyq195 · Cited by 525
An Assessment of Resource-Based Theorizing on Firm Growth and Suggestions for the Future
Nason, R. S., & Wiklund, J. (2015) · Journal of Management · doi:10.1177/0149206315610635 · Cited by 516
Afshin, A., Micha, R., Khatibzadeh, S., & Mozaffarian, D. (2014) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.076901 · Cited by 509
The Effectiveness of Customer Participation in New Product Development: A Meta-Analysis
Chang, W., & Taylor, S. A. (2015) · Journal of Marketing · doi:10.1509/jm.14.0057 · Cited by 515
Groh, A. M., Fearon, R. P., Bakermans-Kranenburg, M. J., van IJzendoorn, M. H., Steele, R. D., & Roisman, G. I. (2014) · Attachment & Human Development · doi:10.1080/14616734.2014.883636 · Cited by 495
“We used the “trim and fill” method (Duval & Tweedie, 2000a, 2000b) to calculate the effect of potential data censoring or publication bias on the outcome of the meta-analyses.”
BackgroundMethodSocial attention in ASD: A review and meta-analysis of eye-tracking studies
Chita-Tegmark, M. (2015) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2015.10.011 · Cited by 530
van IJzendoorn, M. H., Juffer, F., & Poelhuis, C. W. K. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.2.301 · Cited by 488
Terrin, N. C., Schmid, C. H., & Lau, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.006 · Cited by 502
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Vevea, J. L., & Woods, C. M. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.428 · Cited by 461
L2 Reading Comprehension and Its Correlates: A Meta‐Analysis
Jeon, E., & Yamashita, J. (2014) · Language Learning · doi:10.1111/lang.12034 · Cited by 570
Worthington, E. L., Hook, J. N., Davis, D. E., & McDaniel, M. A. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20760 · Cited by 484
Comparing the efficacy of stimulants for ADHD in children and adolescents using meta-analysis
Faraone, S. V., & Buitelaar, J. (2010) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-009-0054-3 · Cited by 485
Thankful for the little things: A meta-analysis of gratitude interventions.
Davis, D. E., Choe, E. J. Y., Meyers, J. P., Wade, N. G., Varjas, K. M., Gifford, A., Quinn, A., Hook, J. N., Tongeren, D. R. V., Griffin, B. J., et al. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000107 · Cited by 544
Hispanic Mortality Paradox: A Systematic Review and Meta-Analysis of the Longitudinal Literature
Ruiz, J. M., Steffen, P. R., & Smith, T. B. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.301103 · Cited by 477
Fostering security? A meta-analysis of attachment in adopted children
van den Dries, L., Juffer, F., van IJzendoorn, M. H., & Bakermans‐Kranenburg, M. J. (2008) · Children and Youth Services Review · doi:10.1016/j.childyouth.2008.09.008 · Cited by 536
SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META‐ANALYSIS
McDaniel, M. A., Hartman, N. S., Whetzel, D. L., & Grubb, W. L. (2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00065.x · Cited by 512
Worldwide prevalence of oral lichen planus: A systematic review and meta‐analysis
González‐Moles, M. Á., Warnakulasuriya, S., González‐Ruiz, I., González‐Ruiz, L., Ayén, Á., Lenouvel, D., Ruiz‐Ávila, I., & Ramos‐García, P. (2020) · Oral Diseases · doi:10.1111/odi.13323 · Cited by 479
A Meta-Analysis of Massage Therapy Research.
Moyer, C. A., Rounds, J., & Hannum, J. W. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.1.3 · Cited by 665
Dyadic coping and relationship satisfaction: A meta-analysis
Falconier, M. K., Jackson, J. B., Hilpert, P., & Bodenmann, G. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.07.002 · Cited by 539
Empirical Comparison of Publication Bias Tests in Meta-Analysis
Lin, L., Chu, H., Murad, M. H., Hong, C., Qu, Z., Cole, S. R., & Chen, Y. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4425-7 · Cited by 464
Dynamic Capabilities and Organizational Performance: A Meta‐Analytic Evaluation and Extension
Fainshmidt, S., Pezeshkan, A., Frazier, M. L., Nair, A., & Markowski, E. P. (2016) · Journal of Management Studies · doi:10.1111/joms.12213 · Cited by 538
A systematic review of drug court effects on recidivism
Wilson, D. B., Mitchell, O., & MacKenzie, D. L. (2006) · Journal of Experimental Criminology · doi:10.1007/s11292-006-9019-4 · Cited by 466
A meta-analysis on age differences in risky decision making: Adolescents versus children and adults.
Defoe, I. N., Dubas, J. S., Figner, B., & van Aken, M. A. G. (2014) · Psychological Bulletin · doi:10.1037/a0038088 · Cited by 491
Methods for testing publication bias in ecological and evolutionary meta‐analyses
Nakagawa, S., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Sánchez‐Tójar, A., Yang, Y., & O'Dea, R. E. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13724 · Cited by 399
REVIEW: Can retention forestry help conserve biodiversity? A meta‐analysis
Fedrowitz, K., Koricheva, J., Baker, S. C., Lindenmayer, D. B., Palik, B. J., Rosenvald, R., Beese, W. J., Franklin, J. F., Kouki, J., Macdonald, S. E., et al. (2014) · Journal of Applied Ecology · doi:10.1111/1365-2664.12289 · Cited by 479
Buscemi, N., Vandermeer, B., Hooton, N., Pandya, R., Tjosvold, L., Hartling, L., Vohra, S., Klassen, T. P., & Baker, G. (2006) · BMJ · doi:10.1136/bmj.38731.532766.f6 · Cited by 454
The actor-observer asymmetry in attribution: A (surprising) meta-analysis.
Malle, B. F. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.6.895 · Cited by 486
The effects of acute stress on episodic memory: A meta-analysis and integrative review.
Shields, G. S., Sazma, M. A., McCullough, A. M., & Yonelinas, A. P. (2017) · Psychological Bulletin · doi:10.1037/bul0000100 · Cited by 450
The Efficacy and Safety of Drug Treatments for Chronic Insomnia in Adults: A Meta-Analysis of RCTs
Buscemi, N., Vandermeer, B., Friesen, C., Bialy, L., Tubman, M., Ospina, M., Klassen, T. P., & Witmans, M. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0251-z · Cited by 448
Investigating and Dealing with Publication and Other Biases
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch11 · Cited by 449
Improving Crop Yield and Nutrient Use Efficiency via Biofertilization—A Global Meta-analysis
Schütz, L., Gattinger, A., Meier, M., Müller, A. W., Boller, T., Mader, P. M., & Mathimaran, N. (2018) · Frontiers in Plant Science · doi:10.3389/fpls.2017.02204 · Cited by 489
The prevalence of elder abuse in institutional settings: a systematic review and meta-analysis
Yon, Y., Ramiro-González, M. D., Mikton, C., Huber, M., & Sethi, D. D. (2018) · European Journal of Public Health · doi:10.1093/eurpub/cky093 · Cited by 458
Kawabata, Y., Alink, L. R. A., Tseng, W.-L., van IJzendoorn, M. H., & Crick, N. R. (2011) · Developmental Review · doi:10.1016/j.dr.2011.08.001 · Cited by 445
Not So Subtle: A Meta-Analytic Investigation of the Correlates of Subtle and Overt Discrimination
Jones, K. P., Peddie, C. I., Gilrane, V. L., King, E. B., & Gray, A. L. (2016) · Journal of Management · doi:10.1177/0149206313506466 · Cited by 445
Music therapy for stress reduction: a systematic review and meta-analysis
de Witte, M., Pinho, A. D. S., Stams, G.-J., Moonen, X., Bos, A. E. R., & van Hooren, S. (2022) · Health Psychology Review · doi:10.1080/17437199.2020.1846580 · Cited by 444
Stoltenborgh, M., Bakermans‐Kranenburg, M. J., van IJzendoorn, M. H., & Alink, L. R. A. (2013) · International Journal of Psychology · doi:10.1080/00207594.2012.697165 · Cited by 480
Assessing human mirror activity with EEG mu rhythm: A meta-analysis.
Fox, N. A., Bakermans‐Kranenburg, M. J., Yoo, K. H., Bowman, L. C., Cannon, E. N., Vanderwert, R. E., Ferrari, P. F., & van IJzendoorn, M. H. (2015) · Psychological Bulletin · doi:10.1037/bul0000031 · Cited by 466
Why Don’t We Practice What We Preach? A Meta-Analytic Review of Religious Racism
Hall, D. L., Matz, D. C., & Wood, W. (2010) · Personality and Social Psychology Review · doi:10.1177/1088868309352179 · Cited by 431
Lung Cancer and Exposure to Nitrogen Dioxide and Traffic: A Systematic Review and Meta-Analysis
Hamra, G. B., Laden, F., Cohen, A., Raaschou‐Nielsen, O., Brauer, M. D., & LOOMIS, D. P. (2015) · Environmental Health Perspectives · doi:10.1289/ehp.1408882 · Cited by 430
Currier, J. M., Neimeyer, R. A., & Berman, J. S. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.5.648 · Cited by 431
Shifting ability predicts math and reading performance in children: a meta-analytical study
Yeniad, N., Malda, M., Mesman, J., van IJzendoorn, M. H., & Pieper, S. (2013) · Learning and Individual Differences · doi:10.1016/j.lindif.2012.10.004 · Cited by 420
Chen, Z., King, W. D., Pearcey, R. G., Kerba, M., & Mackillop, W. J. (2007) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2007.11.016 · Cited by 421
Yap, M. B. H., & Jorm, A. F. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.01.050 · Cited by 474
Depression in epilepsy: A systematic review and meta-analysis
Fiest, K. M., Dykeman, J., Patten, S. B., Wiebe, S., Kaplan, G. G., Maxwell, C. J., Bulloch, A. G. M., & Jette, N. (2013) · Neurology · doi:10.1212/wnl.0b013e31827b1ae0 · Cited by 424
Agnew‐Blais, J. C., & Danese, A. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00544-1 · Cited by 446
McShane, B. B., Böckenholt, U., & Hansen, K. T. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616662243 · Cited by 398
Zeegers, M. A. J., Colonnesi, C., Stams, G. J. J. M., & Meins, E. (2017) · Psychological Bulletin · doi:10.1037/bul0000114 · Cited by 478
Liu, J., Varghese, B. M., Hansen, A., Xiang, J., Zhang, Y., Dear, K., Gourley, M., Driscoll, T., Morgan, G., Capon, A., et al. (2021) · Environment International · doi:10.1016/j.envint.2021.106533 · Cited by 406
Overgeneral autobiographical memory as a predictor of the course of depression: A meta-analysis
Sumner, J. A., Griffith, J. W., & Mineka, S. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.03.013 · Cited by 414
Body size and composition and prostate cancer risk: systematic review and meta-regression analysis
MacInnis, R. J., & English, D. R. (2006) · Cancer Causes & Control · doi:10.1007/s10552-006-0049-z · Cited by 418
Jim, H., Phillips, K. M., Chait, S. R., Faul, L. A., Popa, M. A., Lee, Y., Cases, M. G., Jacobsen, P. B., & Small, B. J. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.39.5640 · Cited by 411
Brown, J. C., Huedo-Medina, T. B., Pescatello, L. S., Pescatello, S. M., Ferrer, R. A., & Johnson, B. T. (2011) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-10-0988 · Cited by 404
Lee, Y. L., Ragguett, R., Mansur, R. B., Boutilier, J. J., Rosenblat, J. D., Trevizol, A. P., Brietzke, E. M., Lin, K., Pan, Z., Subramaniapillai, M., et al. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.08.073 · Cited by 418
Takacs, Z. K., Swart, E. K., & Bus, A. G. (2015) · Review of Educational Research · doi:10.3102/0034654314566989 · Cited by 403
Bureau, J. S., Howard, J. L., Chong, J. X. Y., & Guay, F. (2022) · Review of Educational Research · doi:10.3102/00346543211042426 · Cited by 414
“Trim and Fill procedures were applied to examine the symmetry of observed effects and determine if studies were likely to be missing due to publication bias (Duval & Tweedie, 2000).”
BackgroundMethod(2001) · Europe PMC (PubMed Central) · Cited by 393
Publication Bias in the Organizational Sciences
Kepes, S., Banks, G. C., McDaniel, M. A., & Whetzel, D. L. (2012) · Organizational Research Methods · doi:10.1177/1094428112452760 · Cited by 416
Peter, J. V., Moran, J. L., Phillips-Hughes, J., Graham, P. L., & Bersten, A. D. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68506-1 · Cited by 395
Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2013) · Translational Psychiatry · doi:10.1038/tp.2013.34 · Cited by 383
The Effects of Hot Spots Policing on Crime
Braga, A. A. (2001) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/000271620157800107 · Cited by 390
Egg size and offspring quality: a meta‐analysis in birds
Krist, M. (2011) · Biological Reviews · doi:10.1111/j.1469-185x.2010.00166.x · Cited by 472
Multidimensional Perfectionism and Burnout: A Meta-Analysis
Hill, A. P., & Curran, T. (2016) · Personality and Social Psychology Review · doi:10.1177/1088868315596286 · Cited by 389
Identification of and correction for publication bias
Andrews, I., & Kasy, M. (2019) · American Economic Review · doi:10.1257/aer.20180310 · Cited by 388
Faraone, S. V., & Glatt, S. J. (2010) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.08m04902pur · Cited by 387
Metadata
- Authors
- Duval, S., & Tweedie, R.
- Affiliations
- Colorado State University (US)
- University of Minnesota (US)
- ORCID
- Duval, Sue
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2000-03
- Volume
- 95
- Issue
- 449
- Pages
- 89-98
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2043565183
- Cited by
- 2,955
- References
- 40
- Citations by year
- 2026: 106 · 2025: 167 · 2024: 189 · 2023: 171 · 2022: 233 · 2021: 275 · 2020: 259 · 2019: 179 · 2018: 184 · 2017: 160 · 2016: 142 · 2015: 149 · 2014: 128 · 2013: 91 · 2012: 101
- FWCI
- 21.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, trim and fill, missing studies, funnel plot, nonparametric estimators, selection bias, meta-analysis, effect size estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
