The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Abstract
Meta-analysis collects and synthesizes results from individual studies to estimate an overall effect size. If published studies are chosen, say through a literature review, then an inherent selection bias may arise, because, for example, studies may tend to be published more readily if they are statistically significant, or deemed to be more “interesting” in terms of the impact of their outcomes. We develop a simple rank-based data augmentation technique, formalizing the use of funnel plots, to estimate and adjust for the numbers and outcomes of missing studies. Several nonparametric estimators are proposed for the number of missing studies, and their properties are developed analytically and through simulations. We apply the method to simulated and epidemiological datasets and show that it is both effective and consistent with other criteria in the literature.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Publication bias was investigated by applying the trim and fill method, where effect sizes are recalculated to adjust for supposed publication biases (Duval & Tweedie, 2000).”
From Taking stock: A meta-analysis of the effects of foreign language enjoyment (2022) · cites this paper as Duval & Tweedie, 2000
In the citing paper
“The trim‐and‐fill procedure determined that nine studies should be added to create symmetry.”
From Problem-oriented policing for reducing crime and disorder: An updated systematic review and meta-analysis (2020) · cites this paper as Duval and Tweedie (2000)
In the citing paper
“Like many systematic reviews, our meta‐analyses used the trim‐and‐fill procedure to explore whether publication bias might be affecting the results and to estimate how the reported effects would change if the bias were to be removed (Duval & Tweedie, 2000; Duval, 2005).”
From Hot spots policing of small geographic areas effects on crime (2019) · cites this paper as Duval & Tweedie, 2000
In the citing paper
“When we encountered publication bias, we conducted a trim and fill adjusted analysis 25 to remove the most extreme small studies from the positive side of the funnel plot, and recalculated the effect size iteratively, until the funnel plot was symmetrical around the (new) effect size.”
From Diabetes mellitus in people with schizophrenia, bipolar disorder and major depressive disorder: a systematic review and large scale meta‐analysis (2016) · cites this paper as [25]
In the citing paper
“Variations in the risk for glucose abnormalities are evident in the literature, with the highest risk being associated with clozapine, olanzapine and quetiapine in carefully designed studies 25,34,35 .”
From Diabetes mellitus in people with schizophrenia, bipolar disorder and major depressive disorder: a systematic review and large scale meta‐analysis (2016) · cites this paper as [25]
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Self-citationWasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
Casella, G., & Berger, R. L. (1993) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,835
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“The negative binomial forms here are reminiscent of those used by Eberly and Casella (1999) and Givens et al.”
MethodSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,486
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,422
Research works printed but not linked: 10
- 1983, British Medical Journal, 280, 508
- Cooper H., 1998, Synthesizing Research
- Dear K., 1997, Statistical Science, 12, 245
- DuMouchel W., 1997, Statistical Science, 12, 244
- Duval S. J., 1999, “Effects of Publication Bias in Meta-Analysis,”
- Duval S. J., “Robustness of the ‘Trim and Fill’ publication bias approach to different mechanisms for study suppression,”
- Eberly L. E., 1999, Journal of Official Statistics, 15
- Hedges L., 1985, Statistical Methods for Meta-Analysis
- Sugita M., 1994, Tokai Journal of Experimental and Clinical Medicine, 19, 29
- Sutton A. J., 1999, “The Impact of Publication Bias on Meta-Analyses Within the Cochrane Database of Systematic Reviews,”
Cited by
Sorted by citations
Items 501–600 of 1,059
Smoking and Suicide: A Meta-Analysis
Poorolajal, J., & Darvishi, N. (2016) · PLoS ONE · doi:10.1371/journal.pone.0156348 · Cited by 197
Parenting and Self-Control Across Early to Late Adolescence: A Three-Level Meta-Analysis
Li, J., Willems, Y. E., Stok, F. M., Deković, M., Bartels, M., & Finkenauer, C. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619863046 · Cited by 199
ADHD and relative risk of accidents in road traffic: a meta-analysis
Vaa, T. (2014) · Accident Analysis & Prevention · doi:10.1016/j.aap.2013.10.003 · Cited by 179
Personality Consistency in Dogs: A Meta-Analysis
Fratkin, J. L., Sinn, D. L., Patall, E. A., & Gosling, S. D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0054907 · Cited by 179
Debreczeni, F. A., & Bailey, P. E. (2020) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbaa069 · Cited by 199
Gajendran, R. S., Ponnapalli, A. R., Wang, C., & Javalagi, A. A. (2024) · Personnel Psychology · doi:10.1111/peps.12641 · Cited by 225
Xie, C., Zhu, R., Tian, Y., & Wang, K. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013983 · Cited by 180
A systematic review and meta-analysis of longitudinal hippocampal atrophy in healthy human ageing
Fraser, M. A., Shaw, M. E., & Cherbuin, N. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.03.035 · Cited by 175
Phenolic Compound Induction in Plant-Microbe and Plant-Insect Interactions: A Meta-Analysis
Wallis, C. M., & Galarneau, E. (2020) · Frontiers in Plant Science · doi:10.3389/fpls.2020.580753 · Cited by 178
Hiel, A. V., Onraet, E., & Pauw, S. S. W. D. (2010) · Journal of Personality · doi:10.1111/j.1467-6494.2010.00669.x · Cited by 181
Ruan, H., Xun, P., Cai, W., He, K., & Tang, Q. (2015) · Scientific Reports · doi:10.1038/srep16160 · Cited by 178
Body mass index, physical activity, and colorectal cancer by anatomical subsites
Robsahm, T. E., Aagnes, B., Hjartåker, A., Langseth, H., Bray, F., & Larsen, I. K. (2013) · European Journal of Cancer Prevention · doi:10.1097/cej.0b013e328360f434 · Cited by 176
Liu, J., Zhao, S., Chen, X., Falk, E., & Albarracín, D. (2017) · Psychological Bulletin · doi:10.1037/bul0000113 · Cited by 176
Human fluctuating asymmetry in relation to health and quality: a meta-analysis
Dongen, S. V., & Gangestad, S. W. (2011) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2011.03.002 · Cited by 175
Zhang, S., Li, G., Tian, L., Guo, Q., & Pan, X. (2016) · Environmental Research · doi:10.1016/j.envres.2016.03.008 · Cited by 175
Obesity and incidence of lung cancer: A meta‐analysis
Yang, Y., Dong, J.-Y., Sun, K., Zhao, L. B., Zhao, F., Wang, L., & Jiao, Y. (2012) · International Journal of Cancer · doi:10.1002/ijc.27719 · Cited by 183
Hackshaw, A. K., Harmer, C., Mallick, U. K., Haq, M. S., & Franklyn, J. A. (2006) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2006-1345 · Cited by 174
Wilson, S. J., Tanner-Smith, E. E., Lipsey, M. W., Steinka-Fry, K., & Morrison, J. (2011) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2011.8 · Cited by 173
Intolerance of uncertainty in eating disorders: a systematic review and meta-analysis
Brown, M., Robinson, L., Campione, G. C., Wuensch, K., Hildebrandt, T., & Micali, N. (2017) · European Eating Disorders Review · doi:10.1002/erv.2523 · Cited by 173
THE EFFECTIVENESS OF ACTIVE LABOR MARKET POLICIES: A META‐ANALYSIS
Vooren, M., Haelermans, C., Groot, W. N. J., & van den Brink, H. M. (2018) · Journal of Economic Surveys · doi:10.1111/joes.12269 · Cited by 173
Wolfowicz, M., Litmanovitz, Y., Weisburd, D. L., & Hasisi, B. (2021) · Campbell Systematic Reviews · doi:10.1002/cl2.1174 · Cited by 234
Ezekowitz, J. A., Rowe, B. H., Dryden, D. M., Hooton, N., Vandermeer, B., Spooner, C., & McAlister, F. A. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-4-200708210-00007 · Cited by 172
The relation between empathy and offending: A meta-analysis
van Langen, M. A. M., Wissink, I. B., van Vugt, E. S., Van der Stouwe, T., & Stams, G. J. J. M. (2014) · Aggression and Violent Behavior · doi:10.1016/j.avb.2014.02.003 · Cited by 172
A meta-analysis of neuropsychological functioning in first-episode bipolar disorders
Lee, R. S. C., Hermens, D. F., Scott, J. L., Hodge, M. A., Naismith, S. L., Lagopoulos, J., Griffiths, K. R., Porter, M. A., & Hickie, I. B. (2014) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2014.06.019 · Cited by 181
Shvedko, A. V., Phillips, A. C., Thompson, J. L., & Greig, C. A. (2017) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2017.10.003 · Cited by 194
Effects of anthropogenic disturbances on bird functional diversity: A global meta-analysis
Matuoka, M. A., Benchimol, M., de Almeida‐Rocha, J. M., & Morante‐Filho, J. C. (2020) · Ecological Indicators · doi:10.1016/j.ecolind.2020.106471 · Cited by 181
Anxiety in youth with asthma: a meta-analysis
Dudeney, J., Sharpe, L., Jaffe, A., Jones, E. B., & Hunt, C. (2017) · Pediatric Pulmonology · doi:10.1002/ppul.23689 · Cited by 169
Hooper, L. M., DeCoster, J., White-Chapman, N., & Voltz, M. L. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20807 · Cited by 192
The Effect of Drama-Based Pedagogy on PreK–16 Outcomes
Lee, B. K., Patall, E. A., Cawthon, S. W., & Steingut, R. R. (2014) · Review of Educational Research · doi:10.3102/0034654314540477 · Cited by 219
McCary, M. A., Mores, R., Farfan, M., & Wise, D. H. (2016) · Ecology Letters · doi:10.1111/ele.12562 · Cited by 168
Quiet Eye and Performance in Sport: A Meta-Analysis
Lebeau, J.-C., Liu, S., Sáenz‐Moncaleano, C., Sanduvete‐Chaves, S., Moscoso, S. C., Becker, B. J., & Tenenbaum, G. (2016) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.2015-0123 · Cited by 171
A quantitative review of MHC ‐based mating preference: the role of diversity and dissimilarity
Kamiya, T., O’Dwyer, K., Westerdahl, H., Senior, A. M., & Nakagawa, S. (2014) · Molecular Ecology · doi:10.1111/mec.12934 · Cited by 170
Social cognitive functioning in prodromal psychosis: A meta-analysis
Lee, T. Y., Hong, S. B., Shin, N. Y., & Kwon, J. S. (2015) · Schizophrenia Research · doi:10.1016/j.schres.2015.02.008 · Cited by 170
Overcoming Resistance Through Narratives: Findings from a Meta-Analytic Review
Ratcliff, C. L., & Sun, Y. (2020) · Human Communication Research · doi:10.1093/hcr/hqz017 · Cited by 170
Zhang, C., Qin, Y., Wei, X., Yu, F., Zhou, Y., & He, J. (2014) · European Journal of Epidemiology · doi:10.1007/s10654-014-9960-x · Cited by 168
Tang, K. L., Rashid, R., Godley, J., & Ghali, W. A. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010137 · Cited by 169
Preti, A., & Cella, M. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2010.07.026 · Cited by 167
Does incarceration-based drug treatment reduce recidivism? A meta-analytic synthesis of the research
Mitchell, O., Wilson, D. B., & MacKenzie, D. L. (2007) · Journal of Experimental Criminology · doi:10.1007/s11292-007-9040-2 · Cited by 168
Assessing Publication Bias in Meta-Analyses in the Presence of Between-Study Heterogeneity
Peters, J., Sutton, A. J., Jones, D. R., Abrams, K. R., Rushton, L., & Moreno, S. G. (2010) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2009.00629.x · Cited by 169
Assessing publication bias in genetic association studies: evidence from a recent meta-analysis
Munafo, M. R., Clark, T. G., & Flint, J. (2004) · Psychiatry Research · doi:10.1016/j.psychres.2004.06.011 · Cited by 168
Self‐objectification and disordered eating: A meta‐analysis
Schaefer, L. M., & Thompson, J. K. (2018) · International Journal of Eating Disorders · doi:10.1002/eat.22854 · Cited by 168
Coronavirus disease 2019 and prevalence of chronic liver disease: A meta‐analysis
Mantovani, A., Beatrice, G., & Dalbeni, A. (2020) · Liver International · doi:10.1111/liv.14465 · Cited by 168
Boehm, J. K., Chen, Y., Koga, H., Mathur, M. B., Vie, L. L., & Kubzansky, L. D. (2018) · Circulation Research · doi:10.1161/circresaha.117.310828 · Cited by 194
Confidence intervals for random effects meta-analysis and robustness to publication bias
Henmi, M., & Copas, J. B. (2010) · Statistics in Medicine · doi:10.1002/sim.4029 · Cited by 167
A meta-analysis indicates reduced predation pressure with increasing urbanization
Eötvös, C. B., Magura, T., & Löveï, G. L. (2018) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2018.08.010 · Cited by 167
How environmental innovation influences firm performance: A meta‐analytic review
Hizarci‐Payne, A. K., İpek, İ., & Gümüş, G. K. (2020) · Business Strategy and the Environment · doi:10.1002/bse.2678 · Cited by 191
Probiotics in Helicobacter pylori eradication therapy: A systematic review and meta-analysis
Zhang, M. (2015) · World Journal of Gastroenterology · doi:10.3748/wjg.v21.i14.4345 · Cited by 184
Loyens, S. M. M., van Meerten, J. E., Schaap, L., & Wijnia, L. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09757-x · Cited by 370
Kothgassner, O. D., Robinson, K., Goreis, A., Ougrin, D., & Plener, P. L. (2020) · Borderline Personality Disorder and Emotion Dysregulation · doi:10.1186/s40479-020-00123-9 · Cited by 163
A historical review of publication bias
Marks‐Anglin, A., & Chen, Y. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1452 · Cited by 165
More Than Numbers: The Power of Graphs in Meta-Analysis
Bax, L., Ikeda, N., Fukui, N., Yaju, Y., Tsuruta, H., & Moons, K. G. M. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn340 · Cited by 166
High-frequency oscillations in epilepsy and surgical outcome. A meta-analysis
Höller, Y., Kutil, R. H., Klaffenböck, L., Thomschewski, A. C., Höller, P., Bathke, A. C., Jacobs, J., Taylor, A. C., Nardone, R., & Trinka, E. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00574 · Cited by 165
Meditation, Mindfulness, and Attention: a Meta-analysis
Sumantry, D., & Stewart, K. E. (2021) · Mindfulness · doi:10.1007/s12671-021-01593-w · Cited by 192
Peer attachment and self-esteem: A meta-analytic review
Gorrese, A., & Ruggieri, R. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2013.04.025 · Cited by 164
A Meta-Analysis of Interventions for Bereaved Children and Adolescents
Rosner, R., Kruse, J., & Hagl, M. (2010) · Death Studies · doi:10.1080/07481180903492422 · Cited by 164
Mathie, R. T., Ramparsad, N., Legg, L. A., Clausen, J., Moss, S., Davidson, J. R. T., Messow, C., & McConnachie, A. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0445-3 · Cited by 164
Sexual dimorphism in immunity across animals: a meta‐analysis
Kelly, C. D., Stoehr, A. M., Nunn, C. L., Smyth, K., & Prokop, Z. M. (2018) · Ecology Letters · doi:10.1111/ele.13164 · Cited by 162
Tharp, M. D., Bernstein, J. A., Kavati, A., Ortiz, B. D., MacDonald, K., Denhaerynck, K., Abraham, I. L., & Lee, C. S. (2018) · JAMA Dermatology · doi:10.1001/jamadermatol.2018.3447 · Cited by 164
Remote cognitive-behavior therapy for obsessive-compulsive symptoms: A meta-analysis.
Wootton, B. M. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.10.001 · Cited by 162
Hinkle, J. C., Weisburd, D., Telep, C. W., & Petersen, K. (2020) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.1089 · Cited by 194
IQ of Children Growing Up in Children's Homes: A Meta-Analysis on IQ Delays in Orphanages
van IJzendoorn, M. H., Luijk, M. P. C. M., & Juffer, F. (2008) · Merrill-Palmer Quarterly · doi:10.1353/mpq.0.0002 · Cited by 160
Kemmler, W., Shojaa, M., Kohl, M., & von Stengel, S. (2020) · Calcified Tissue International · doi:10.1007/s00223-020-00744-w · Cited by 161
Kahathuduwa, C. N., West, B. D., Blume, J., Dharavath, N., Moustaid‐Moussa, N., & Mastergeorge, A. (2019) · Obesity Reviews · doi:10.1111/obr.12933 · Cited by 162
Willeit, P., Freitag, D. F., Laukkanen, J. A., Chowdhury, S., Gobin, R., Mayr, M., Angelantonio, E. D., & Chowdhury, R. (2015) · Journal of the American Heart Association · doi:10.1161/jaha.115.001833 · Cited by 161
Bolger, P. C. (2014) · American Journal of Criminal Justice · doi:10.1007/s12103-014-9278-y · Cited by 161
Schoors, M. V., Caes, L., Knoble, N. B., Goubert, L., Verhofstadt, L., & Alderfer, M. A. (2016) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsw070 · Cited by 166
Gallagher, R. W., & Polanin, J. R. (2014) · Nurse Education Today · doi:10.1016/j.nedt.2014.10.021 · Cited by 175
A meta-analysis on critical thinking and community college student achievement
Fong, C. J., Kim, Y., Davis, C., Hoang, T., & Kim, Y. W. (2017) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2017.06.002 · Cited by 207
Li, X., Laplante, D. P., Paquin, V., Lafortune, S., Elgbeili, G., & King, S. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102129 · Cited by 143
Levine, T. R., Asada, K. J. K., & Carpenter, C. (2009) · Communication Monographs · doi:10.1080/03637750903074685 · Cited by 170
The Separation Anxiety Hypothesis of Panic Disorder Revisited: A Meta-Analysis
Kossowsky, J., Pfaltz, M. C., Schneider, S., Taeymans, J., Locher, C., & Gaab, J. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12070893 · Cited by 159
Arriagada, N. B., Horsley, J. A., Palmer, A. J., Morgan, G. G., Tham, R., & Johnston, F. H. (2019) · Environmental Research · doi:10.1016/j.envres.2019.108777 · Cited by 165
Effect of diurnal fasting on sleep during Ramadan: a systematic review and meta-analysis
Faris, M. E., Jahrami, H., Alhayki, F. A., Alkhawaja, N. A., Ali, A. M., Aljeeb, S. H., Abdulghani, I. H., & BaHammam, A. S. (2019) · Sleep And Breathing · doi:10.1007/s11325-019-01986-1 · Cited by 159
The effects of urbanization on pollinators and pollination: A meta‐analysis
Liang, H., He, Y., Theodorou, P., & Yang, C. (2023) · Ecology Letters · doi:10.1111/ele.14277 · Cited by 163
Effects of Hot Spots Policing on Crime
Braga, A. A. (2007) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2007.1 · Cited by 157
Badal, S., Bajgain, K. T., Badal, S., Thapa, R., Bajgain, B. B., & Santana, M. (2020) · Journal of Clinical Virology · doi:10.1016/j.jcv.2020.104715 · Cited by 162
Ionising radiation and cardiovascular disease: systematic review and meta-analysis
Little, M. P., Azizova, T. V., Richardson, D. B., Tapio, S., Bernier, M., Kreuzer, M., Cucinotta, F. A., Bаzyка, D., Chumak, V. V., Ivanov, V. K., et al. (2023) · BMJ · doi:10.1136/bmj-2022-072924 · Cited by 203
Pearl, S. B., & Norton, P. J. (2017) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.07.004 · Cited by 156
Publication Bias in Meta-Analysis: Confidence Intervals for Rosenthal’s Fail-Safe Number
Fragkos, K. C., Tsagris, M., & Frangos, C. C. (2014) · International Scholarly Research Notices · doi:10.1155/2014/825383 · Cited by 159
The crisis of minimal self-awareness in schizophrenia: A meta-analytic review
Hur, J., Kwon, J. S., Lee, T. Y., & Park, S. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2013.08.042 · Cited by 166
Rubin, M. (2011) · Journal of Diversity in Higher Education · doi:10.1037/a0026162 · Cited by 186
Belluco, S., Mancin, M., Conficoni, D., Simonato, G., Pietrobelli, M., & Ricci, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0153856 · Cited by 156
Concussion Guidelines Step 2: Evidence for Subtype Classification
Lumba‐Brown, A., Teramoto, M., Bloom, O. J., Brody, D. L., Chesnutt, J. C., Clugston, J. R., Collins, M. W., Gioia, G. A., Kontos, A. P., Lal, A., et al. (2019) · Neurosurgery · doi:10.1093/neuros/nyz332 · Cited by 166
Changing Norms: A Meta-Analytic Integration of Research on Social Norms Appeals
Rhodes, N. D., Shulman, H. C., & McClaran, N. (2020) · Human Communication Research · doi:10.1093/hcr/hqz023 · Cited by 157
Liu, X., Cheng, D., Kuang, Q., Liu, G., & Xu, W. (2013) · The Pharmacogenomics Journal · doi:10.1038/tpj.2013.10 · Cited by 155
Elvik, R. (2003) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/1847-01 · Cited by 155
Methods of Instructional Improvement in Algebra
Rakes, C. R., Valentine, J. C., McGatha, M. B., & Ronau, R. N. (2010) · Review of Educational Research · doi:10.3102/0034654310374880 · Cited by 156
Rhodes, R. E., Kaushal, N., & Quinlan, A. (2016) · Health Psychology Review · doi:10.1080/17437199.2016.1143334 · Cited by 176
Individual and cultural factors in teachers’ attitudes towards inclusion: A meta-analysis
van Steen, T., & Wilson, C. (2020) · Teaching and Teacher Education · doi:10.1016/j.tate.2020.103127 · Cited by 155
Heavy metals in agricultural soil in China: A systematic review and meta-analysis
Wen, M., Ma, Z., Gingerich, D. B., Zhao, X. Y., & Zhao, D. (2022) · Eco-Environment & Health · doi:10.1016/j.eehl.2022.10.004 · Cited by 157
Berry, C. M., Lelchook, A. M., & Clark, M. A. (2011) · Journal of Organizational Behavior · doi:10.1002/job.778 · Cited by 154
Onraet, E., Hiel, A. V., Dhont, K., Hodson, G., Schittekatte, M., & Pauw, S. S. W. D. (2015) · European Journal of Personality · doi:10.1002/per.2027 · Cited by 156
Lam, K. K. L., & Zhou, M. (2019) · Psychology in the Schools · doi:10.1002/pits.22302 · Cited by 192
Is the Dodo bird endangered in the 21st century? A meta-analysis of treatment comparison studies
Marcus, D. K., O'Connell, D., Norris, A. L., & Sawaqdeh, A. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.08.001 · Cited by 148
Myles, H., Myles, N., & Large, M. M. B. (2015) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867415599846 · Cited by 153
Dalton, D. R., Aguinis, H., Dalton, C. M., Bosco, F. A., & Pierce, C. A. (2012) · Personnel Psychology · doi:10.1111/j.1744-6570.2012.01243.x · Cited by 157
Attachment in institutionalized children: A review and meta-analysis
Lionetti, F., Pastore, M., & Barone, L. (2015) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.02.013 · Cited by 181
Hunter, A., Tussis, L., & MacBeth, A. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.004 · Cited by 153
The relation between parents' mental state talk and children's social understanding: A meta‐analysis
Tompkins, V., Benigno, J. P., Lee, B. K., & Wright, B. M. (2018) · Social Development · doi:10.1111/sode.12280 · Cited by 153
Grace, J. B., Scheiner, S. M., & Schoolmaster, D. R. (2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199672547.003.0009 · Cited by 160
Metadata
- Authors
- Duval, S., & Tweedie, R.
- Affiliations
- Colorado State University (US)
- University of Minnesota (US)
- ORCID
- Duval, Sue
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2000-03
- Volume
- 95
- Issue
- 449
- Pages
- 89-98
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2043565183
- Cited by
- 2,955
- References
- 40
- Citations by year
- 2026: 106 · 2025: 167 · 2024: 189 · 2023: 171 · 2022: 233 · 2021: 275 · 2020: 259 · 2019: 179 · 2018: 184 · 2017: 160 · 2016: 142 · 2015: 149 · 2014: 128 · 2013: 91 · 2012: 101
- FWCI
- 21.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, trim and fill, missing studies, funnel plot, nonparametric estimators, selection bias, meta-analysis, effect size estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
