The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Abstract
Meta-analysis collects and synthesizes results from individual studies to estimate an overall effect size. If published studies are chosen, say through a literature review, then an inherent selection bias may arise, because, for example, studies may tend to be published more readily if they are statistically significant, or deemed to be more “interesting” in terms of the impact of their outcomes. We develop a simple rank-based data augmentation technique, formalizing the use of funnel plots, to estimate and adjust for the numbers and outcomes of missing studies. Several nonparametric estimators are proposed for the number of missing studies, and their properties are developed analytically and through simulations. We apply the method to simulated and epidemiological datasets and show that it is both effective and consistent with other criteria in the literature.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Publication bias was investigated by applying the trim and fill method, where effect sizes are recalculated to adjust for supposed publication biases (Duval & Tweedie, 2000).”
From Taking stock: A meta-analysis of the effects of foreign language enjoyment (2022) · cites this paper as Duval & Tweedie, 2000
In the citing paper
“The trim‐and‐fill procedure determined that nine studies should be added to create symmetry.”
From Problem-oriented policing for reducing crime and disorder: An updated systematic review and meta-analysis (2020) · cites this paper as Duval and Tweedie (2000)
In the citing paper
“Like many systematic reviews, our meta‐analyses used the trim‐and‐fill procedure to explore whether publication bias might be affecting the results and to estimate how the reported effects would change if the bias were to be removed (Duval & Tweedie, 2000; Duval, 2005).”
From Hot spots policing of small geographic areas effects on crime (2019) · cites this paper as Duval & Tweedie, 2000
In the citing paper
“When we encountered publication bias, we conducted a trim and fill adjusted analysis 25 to remove the most extreme small studies from the positive side of the funnel plot, and recalculated the effect size iteratively, until the funnel plot was symmetrical around the (new) effect size.”
From Diabetes mellitus in people with schizophrenia, bipolar disorder and major depressive disorder: a systematic review and large scale meta‐analysis (2016) · cites this paper as [25]
In the citing paper
“Variations in the risk for glucose abnormalities are evident in the literature, with the highest risk being associated with clozapine, olanzapine and quetiapine in carefully designed studies 25,34,35 .”
From Diabetes mellitus in people with schizophrenia, bipolar disorder and major depressive disorder: a systematic review and large scale meta‐analysis (2016) · cites this paper as [25]
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Self-citationWasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
Casella, G., & Berger, R. L. (1993) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,835
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“The negative binomial forms here are reminiscent of those used by Eberly and Casella (1999) and Givens et al.”
MethodSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,486
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,422
Research works printed but not linked: 10
- 1983, British Medical Journal, 280, 508
- Cooper H., 1998, Synthesizing Research
- Dear K., 1997, Statistical Science, 12, 245
- DuMouchel W., 1997, Statistical Science, 12, 244
- Duval S. J., 1999, “Effects of Publication Bias in Meta-Analysis,”
- Duval S. J., “Robustness of the ‘Trim and Fill’ publication bias approach to different mechanisms for study suppression,”
- Eberly L. E., 1999, Journal of Official Statistics, 15
- Hedges L., 1985, Statistical Methods for Meta-Analysis
- Sugita M., 1994, Tokai Journal of Experimental and Clinical Medicine, 19, 29
- Sutton A. J., 1999, “The Impact of Publication Bias on Meta-Analyses Within the Cochrane Database of Systematic Reviews,”
Cited by
Sorted by citations
Items 401–500 of 1,059
Hot spots policing of small geographic areas effects on crime
Braga, A. A., Turchan, B., Papachristos, A. V., & Hureau, D. M. (2019) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.1046 · Cited by 260
Kelley, G. A., Kelley, K. S., & Tran, Z. V. (2004) · Journal of Women's Health · doi:10.1089/jwh.2004.13.1148 · Cited by 225
How can self-efficacy be increased? Meta-analysis of dietary interventions
Prestwich, A., Kellar, I., Parker, R. A., MacRae, S., Learmonth, M., Sykes‐Muskett, B., Taylor, N. J., & Castle, H. (2013) · Health Psychology Review · doi:10.1080/17437199.2013.813729 · Cited by 240
Type 2 Diabetes Mellitus in Youth Exposed to Antipsychotics
Galling, B., Roldán, A., Nielsen, R. E., Nielsen, J., Gerhard, T., Carbon, M., Stubbs, B., Vancampfort, D., Binder, M. D., Olfson, M., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2923 · Cited by 229
Safety-in-numbers: A systematic review and meta-analysis of evidence
Elvik, R., & Bjørnskau, T. (2015) · Safety Science · doi:10.1016/j.ssci.2015.07.017 · Cited by 240
A Comprehensive Meta-analysis of Handwriting Instruction
Santangelo, T., & Graham, S. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9335-1
Meron, D., Hedger, N., Garner, M., & Baldwin, D. S. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.07.012 · Cited by 220
How to conduct a meta-analysis in eight steps: A practical guide
Hansen, C., Steinmetz, H., & Block, J. (2022) · Management Review Quarterly · doi:10.1007/s11301-021-00247-4 · Cited by 218
Central coherence in eating disorders: An updated systematic review and meta-analysis
Lang, K., López, C., Stahl, D. R., Tchanturia, K., & Treasure, J. L. (2014) · The World Journal of Biological Psychiatry · doi:10.3109/15622975.2014.909606 · Cited by 220
Coronavirus disease 2019 (COVID-19) in children and/or adolescents: a meta-analysis
Mantovani, A., Rinaldi, E., Zusi, C., Beatrice, G., Saccomani, M. D., & Dalbeni, A. (2020) · Pediatric Research · doi:10.1038/s41390-020-1015-2 · Cited by 218
Motivational climate interventions in physical education: A meta-analysis
Braithwaite, R. E., Spray, C. M., & Warburton, V. E. (2011) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2011.06.005 · Cited by 219
Team creativity/innovation in culturally diverse teams: A meta‐analysis
Wang, J., Cheng, G. H. ‐., Chen, T., & Leung, K. Y. (2019) · Journal of Organizational Behavior · doi:10.1002/job.2362 · Cited by 252
Eichner, C., & Berna, F. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv225 · Cited by 218
Dykiert, D., Der, G., Starr, J. M., & Deary, I. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0045759 · Cited by 218
Multicultural education in the mental health professions: A meta-analytic review.
Smith, T. B., Constantine, M. G., Dunn, T. W., Dinehart, J. M., & Montoya, J. A. (2006) · Journal of Counseling Psychology · doi:10.1037/0022-0167.53.1.132 · Cited by 217
City sicker? A meta‐analysis of wildlife health and urbanization
Murray, M. H., Sánchez, C. A., Becker, D. J., Byers, K. A., Worsley‐Tonks, K. E. L., & Craft, M. E. (2019) · Frontiers in Ecology and the Environment · doi:10.1002/fee.2126 · Cited by 213
Influencer marketing effectiveness: A meta-analytic review
Pan, M., Blut, M., Ghiassaleh, A., & Lee, Z. W. Y. (2024) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-024-01052-7 · Cited by 265
Publication bias as a threat to the validity of meta-analytic results
Rothstein, H. R. (2008) · Journal of Experimental Criminology · doi:10.1007/s11292-007-9046-9 · Cited by 216
Meta-analysis of the effect of road safety campaigns on accidents
Phillips, R. O., Ulleberg, P., & Vaa, T. (2011) · Accident Analysis & Prevention · doi:10.1016/j.aap.2011.01.002 · Cited by 216
Role of affective attitudes and anticipated affective reactions in predicting health behaviors.
Conner, M. T., McEachan, R., Taylor, N. J., O'Hara, J. K., & Lawton, R. (2014) · Health Psychology · doi:10.1037/hea0000143 · Cited by 216
Poppy, G. D., Rabiee, A. R., Lean, I. J., Sanchez, W. K., Dorton, K. L., & Morley, P. S. (2012) · Journal of Dairy Science · doi:10.3168/jds.2012-5577 · Cited by 226
Children's elevated cortisol levels at daycare: A review and meta-analysis
Vermeer, H. J., & van IJzendoorn, M. H. (2006) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2006.07.004 · Cited by 216
Effects of Behavioral Marital Therapy: A Meta-Analysis of Randomized Controlled Trials.
Shadish, W. R., & Baldwin, S. A. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.6 · Cited by 230
Nigg, J. T., Johnstone, J. M., Musser, E. D., Long, H. G., Willoughby, M. T., & Shannon, J. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.11.005 · Cited by 202
Kleinstäuber, M., Witthöft, M., & Hiller, W. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.001 · Cited by 212
Livesey, G., Taylor, R., Livesey, H. F., & Liu, S. (2013) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.041467 · Cited by 213
Antecedents and Effects of Parasocial Relationships: A Meta-Analysis
Tukachinsky, R., Walter, N., & Saucier, C. J. (2020) · Journal of Communication · doi:10.1093/joc/jqaa034 · Cited by 212
Publication bias in meta‐analyses from the Cochrane Database of Systematic Reviews
Kiciński, M., Springate, D. A., & Kontopantelis, E. (2015) · Statistics in Medicine · doi:10.1002/sim.6525 · Cited by 232
Van IJzendoorn, M. H., Bakermans-Kranenburg, M. J., & Juffer, F. (2007) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/dbp.0b013e31811320aa · Cited by 210
Perceived workplace racial discrimination and its correlates: A meta‐analysis
Triana, M. D. C., Jayasinghe, M. M., & Pieper, J. R. (2015) · Journal of Organizational Behavior · doi:10.1002/job.1988 · Cited by 213
Understanding Meta-Analysis: A Review of the Methodological Literature
Shelby, L. B., & Vaske, J. J. (2008) · Leisure Sciences · doi:10.1080/01490400701881366 · Cited by 218
Driessen, E., Hollon, S. D., Bockting, C. L. H., Cuijpers, P., & Turner, E. H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0137864 · Cited by 208
Newby, J. M., Twomey, C., Yuan Li, S. S., & Andrews, G. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.03.018 · Cited by 189
Borst, R. T., Kruyen, P. M., Lako, C. J., & de VRIES, M. S. (2019) · Review of Public Personnel Administration · doi:10.1177/0734371x19840399 · Cited by 250
DOMINGUES, A. R., PIRES, S. M., HALASA, T., & HALD, T. (2012) · Epidemiology and Infection · doi:10.1017/s0950268811002676 · Cited by 207
A Meta-Analysis of Perfectionism and Academic Achievement
Madigan, D. J. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09484-2 · Cited by 249
Acculturation to western society as a risk factor for high blood pressure: a meta-analytic review
Steffen, P. R., Smith, T. B., Larson, M., & Butler, L. (2006) · Psychosomatic Medicine · doi:10.1097/01.psy.0000221255.48190.32 · Cited by 204
A Meta-Analysis of Job Satisfaction Correlates in the Public Administration Literature
Cantarelli, P., Belardinelli, P., & Bellè, N. (2015) · Review of Public Personnel Administration · doi:10.1177/0734371x15578534 · Cited by 206
D2Receptor Genetic Variation and Clinical Response to Antipsychotic Drug Treatment: A Meta-Analysis
Zhang, J., Lencz, T., & Malhotra, A. K. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.09040598 · Cited by 205
Remission from substance use disorders: A systematic review and meta-analysis
Fleury, M., Djouini, A., Huỳnh, C., Tremblay, J., Ferland, F., Ménard, J.-M., & Belleville, G. (2016) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2016.08.625 · Cited by 219
Association of trauma exposure with proinflammatory activity: a transdiagnostic meta-analysis
Tursich, M., Neufeld, R. W. J., Frewen, P. A., Harricharan, S., Kibler, J. L., Rhind, S. G., & Lanius, R. A. (2014) · Translational Psychiatry · doi:10.1038/tp.2014.56 · Cited by 204
The Effects of “Pulling Levers” Focused Deterrence Strategies on Crime
Braga, A. A., & Weisburd, D. L. (2012) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2012.6 · Cited by 204
The link between school climate and violence in school: A meta-analytic review
Steffgen, G., Recchia, S., & Viechtbauer, W. (2012) · Aggression and Violent Behavior · doi:10.1016/j.avb.2012.12.001 · Cited by 239
OWNERSHIP CONCENTRATION AND FIRM PERFORMANCE IN EMERGING MARKETS: A META‐ANALYSIS
Wang, K. T., & Shailer, G. (2013) · Journal of Economic Surveys · doi:10.1111/joes.12048 · Cited by 207
Diagnostic Stability of ICD/DSM First Episode Psychosis Diagnoses: Meta-analysis
Fusar‐Poli, P., Cappucciati, M., Rutigliano, G., Heslin, M., Stahl, D. R., Brittenden, Z., Caverzasi, E., McGuire, P. K., & Carpenter, W. T. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw020 · Cited by 220
Alcohol intake and risk of stroke: a dose-response meta-analysis of prospective studies
Zhang, C., Qin, Y.-Y., Chen, Q., Jiang, H., Chen, X.-Z., Xu, C.-L., Mao, P.-J., He, J., & Zhou, Y.-H. (2014) · International Journal of Cardiology · doi:10.1016/j.ijcard.2014.04.225 · Cited by 203
The effect of publication bias magnitude and direction on the certainty in evidence
Murad, M. H., Chu, H., Lin, L., & Wang, Z. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2018-110891 · Cited by 210
The effects of imagery interventions in sports: a meta-analysis
Simonsmeier, B. A., Andronie, M., Buecker, S., & Frank, C. (2020) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2020.1780627 · Cited by 233
The efficacy of exercise in reducing depressive symptoms among cancer survivors: a meta-analysis
Brown, J. C., Huedo-Medina, T. B., Pescatello, L. S., Ryan, S. M., Pescatello, S. M., Moker, E., LaCroix, J. M., Ferrer, R. A., & Johnson, B. T. (2012) · PLoS ONE · doi:10.1371/journal.pone.0030955 · Cited by 201
Emotion socialization and child conduct problems: A comprehensive review and meta-analysis
Johnson, A. M., Hawes, D. J., Eisenberg, N., Kohlhoff, J. R., & Dudeney, J. E. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.04.001 · Cited by 234
He is a Stud, She is a Slut! A Meta-Analysis on the Continued Existence of Sexual Double Standards
Endendijk, J. J., van Baar, A. L., & Deković, M. (2020) · Personality and Social Psychology Review · doi:10.1177/1088868319891310 · Cited by 200
The Effects of Family Therapies for Adolescent Delinquency and Substance Abuse: A Meta‐analysis
Baldwin, S. A., Christian, S., Berkeljon, A., & Shadish, W. R. (2012) · Journal of Marital and Family Therapy · doi:10.1111/j.1752-0606.2011.00248.x · Cited by 244
Juffer, F., & van IJzendoorn, M. H. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.6.1067 · Cited by 197
Høye, A. K. (2018) · Accident Analysis & Prevention · doi:10.1016/j.aap.2018.03.026 · Cited by 199
Soltani, S., Jayedi, A., Shab‐Bidar, S., Becerra‐Tomás, N., & Salas‐Salvadó, J. (2019) · Advances in Nutrition · doi:10.1093/advances/nmz041 · Cited by 198
Postmenopausal Estrogen Replacement and Risk for Venous Thromboembolism
Miller, J., Chan, B. K. S., & Nelson, H. D. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-9-200205070-00011 · Cited by 203
Moving from cognition to behavior: What the research says.
Johnson, R. E., Chang, C.-H., & Lord, R. G. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.381 · Cited by 193
Disinfection by-products in drinking water and colorectal cancer: a meta-analysis
Rahman, M. B., Driscoll, T., Cowie, C., & Armstrong, B. K. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyp371 · Cited by 196
Adult attachment representations and depressive symptoms: A meta-analysis
Dagan, O., Facompré, C. R., & Bernard, K. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.04.091 · Cited by 228
A meta-analysis of cytokine concentrations in eating disorders
Dalton, B., Bartholdy, S., Robinson, L., Solmi, M., Ibrahim, M. A. A., Breen, G., Schmidt, U., & Himmerich, H. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.06.002 · Cited by 197
Auty, K. M., Cope, A., & Liebling, A. (2017) · International Journal of Offender Therapy and Comparative Criminology · doi:10.1177/0306624x15602514 · Cited by 196
Kraan, T. C., Velthorst, E., Smit, F., de Haan, L., & van der Gaag, M. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.11.026 · Cited by 196
Huang, S., Nalos, M., & McLean, A. S. (2013) · Critical Care · doi:10.1186/cc12741 · Cited by 196
Cavender, M. A., & Sabatine, M. S. (2014) · The Lancet · doi:10.1016/s0140-6736(14)61216-2 · Cited by 196
Effectiveness of Literacy Programs Balancing Reading and Writing Instruction: A Meta‐Analysis
Graham, S., Liu, X., Aitken, A. A., Ng, C., Bartlett, B. J., Harris, K. R., & Holzapfel, J. (2017) · Reading Research Quarterly · doi:10.1002/rrq.194 · Cited by 196
Agarwal, S., Bajaj, N. S., Kumbhani, D. J., Tuzcu, E. M., & Kapadia, S. R. (2012) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2012.02.021 · Cited by 195
Elvik, R., Vadeby, A., Hels, T., & van Schagen, I. (2018) · Accident Analysis & Prevention · doi:10.1016/j.aap.2018.11.014 · Cited by 221
A meta-analytic review of the relationship between dispositional gratitude and well-being
Portocarrero, F. F., Gonzalez, K., & Ekema-Agbaw, M. L. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2020.110101 · Cited by 228
The association of folate and depression: A meta-analysis
Bender, A., Hagan, K. E., & Kingston, N. (2017) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2017.07.019 · Cited by 194
Are the parts as good as the whole? A meta-analysis of component treatment studies.
Bell, E. C., Marcus, D. K., & Goodlad, J. K. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033004 · Cited by 192
Sedentary behaviour and risk of anxiety: A systematic review and meta-analysis
Allen, M. S., Walter, E. E., & Swann, C. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.08.081 · Cited by 192
Euser, S., Alink, L. R. A., Stoltenborgh, M., Bakermans‐Kranenburg, M. J., & van IJzendoorn, M. H. (2015) · BMC Public Health · doi:10.1186/s12889-015-2387-9 · Cited by 209
Outdoor Particulate Matter Exposure and Lung Cancer: A Systematic Review and Meta-Analysis
Hamra, G. B., Guha, N., Cohen, A., Laden, F., Raaschou‐Nielsen, O., Samet, J. M., Vineis, P., Forastiere, F., Saldiva, P. H. N., Yorifuji, T., et al. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1408092 · Cited by 191
Hönekopp, J., & Schuster, M. (2009) · Personality and Individual Differences · doi:10.1016/j.paid.2009.08.009 · Cited by 189
Outcome selection bias in meta-analysis
Williamson, P. R., Gamble, C., Altman, D. G., & Hutton, J. L. (2005) · Statistical Methods in Medical Research · doi:10.1191/0962280205sm415oa · Cited by 188
Pierdomenico, S. D., Pierdomenico, A. M., Cuccurullo, F., & Iacobellis, G. (2013) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2012.08.044 · Cited by 187
Does Training Improve the Detection of Deception? A Meta-Analysis
Hauch, V., Sporer, S. L., Michael, S. W., & Meissner, C. A. (2014) · Communication Research · doi:10.1177/0093650214534974 · Cited by 202
Han, Z., Lutsiv, O., Mulla, S. M., ROSEN, A., Beyene, J., McDonald, S. D., & on behalf of the Knowledge Synthesis Group (2011) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/j.1600-0412.2011.01185.x · Cited by 187
Psychological Treatment of Recurrent Headache in Children and Adolescents - A Meta-Analysis
Trautmann, E., Lackschewitz, H., & Kröner‐Herwig, B. (2006) · Cephalalgia · doi:10.1111/j.1468-2982.2006.01226.x · Cited by 187
Fischer, P. A., Greitemeyer, T., Kastenmüller, A., Vogrincic-Haselbacher, C., & Sauer, A. (2011) · Psychological Bulletin · doi:10.1037/a0022267 · Cited by 198
Kishimoto, T., Hagi, K., Nitta, M., Leucht, S., Olfson, M., Kane, J. M., & Correll, C. U. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx090 · Cited by 186
Hot spots policing effects on crime
Braga, A., Papachristos, A., & Hureau, D. (2012) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2012.8 · Cited by 189
Mills, I., Atkinson, R. W., Kang, S., Walton, H., & Anderson, H. R. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-006946 · Cited by 188
Guay, J. M. Y., Nishimori, M., & Kopp, S. L. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001893.pub2 · Cited by 186
Quantitative sensory testing in patients with migraine: a systematic review and meta-analysis
Nahman‐Averbuch, H., Shefi, T., Schneider, V. J., Li, D., Ding, L., King, C. D., & Coghill, R. C. (2018) · Pain · doi:10.1097/j.pain.0000000000001231 · Cited by 185
Moreno, S. G., Sutton, A. J., Turner, E. H., Abrams, K. R., Cooper, N. J., Palmer, T. M., & Ades, A. E. (2009) · BMJ · doi:10.1136/bmj.b2981 · Cited by 184
What Causes Unethical Behavior? A Meta‐Analysis to Set an Agenda for Public Administration Research
Bellè, N., & Cantarelli, P. (2017) · Public Administration Review · doi:10.1111/puar.12714 · Cited by 187
Kim, J. H., & Park, H. (2019) · Asian Nursing Research · doi:10.1016/j.anr.2019.01.005 · Cited by 196
Tiede, G., & Walton, K. M. (2019) · Autism · doi:10.1177/1362361319836371 · Cited by 180
Nierhoff, J., Ortiz, A. C., Herrmann, E. M., Zeuzem, S., & Friedrich‐Rust, M. (2013) · European Radiology · doi:10.1007/s00330-013-2927-6 · Cited by 183
Behavioral factors influencing childhood obesity: a systematic review and meta-analysis
Poorolajal, J., Sahraei, F., Mohamdadi, Y., Doosti‐Irani, A., & Moradi, L. (2020) · Obesity Research & Clinical Practice · doi:10.1016/j.orcp.2020.03.002 · Cited by 189
(2015) · doi:10.1093/acprof:oso/9780199672547.001.0001 · Cited by 192
Assessing the effectiveness of mental health courts: A quantitative review
Sarteschi, C. M., Vaughn, M. G., & Kim, K. S. (2011) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2010.11.003 · Cited by 182
Qureshi, W., Nasir, U., Alqalyoobi, S., O’Neal, W. T., Mawri, S., Sabbagh, S., Soliman, E. Z., & Al-Mallah, M. H. (2015) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2015.08.046 · Cited by 184
Platz, F., & Kopiez, R. (2012) · Music Perception An Interdisciplinary Journal · doi:10.1525/mp.2012.30.1.71 · Cited by 191
Zhang, J., Lencz, T., Zhang, R. X., Nitta, M., Maayan, L. A., John, M., Robinson, D. G., Fleischhacker, W. W., Kahn, R. S., Ophoff, R. A., et al. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw058 · Cited by 186
The relationship between cognitive ability and chess skill: a comprehensive meta-analysis.
Burgoyne, A. P., Sala, G., Gobet, F., Macnamara, B. N., Campitelli, G., & Hambrick, D. Z. (2016) · Intelligence · doi:10.1016/j.intell.2016.08.002 · Cited by 181
The challenge–skill balance and antecedents of flow: A meta-analytic investigation
Fong, C. J., Zaleski, D. J., & Leach, J. K. (2014) · The Journal of Positive Psychology · doi:10.1080/17439760.2014.967799 · Cited by 205
Anxiety sensitivity and suicidal ideation/suicide risk: A meta-analysis.
Stanley, I. H., Boffa, J. W., Rogers, M. L., Hom, M. A., Albanese, B. J., Chu, C., Capron, D. W., Schmidt, N. B., & Joiner, T. E. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000342 · Cited by 184
Miller, R. E., Wankerl, M., Stalder, T., Kirschbaum, C., & Alexander, N. (2012) · Molecular Psychiatry · doi:10.1038/mp.2012.124 · Cited by 187
Metadata
- Authors
- Duval, S., & Tweedie, R.
- Affiliations
- Colorado State University (US)
- University of Minnesota (US)
- ORCID
- Duval, Sue
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2000-03
- Volume
- 95
- Issue
- 449
- Pages
- 89-98
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2043565183
- Cited by
- 2,955
- References
- 40
- Citations by year
- 2026: 106 · 2025: 167 · 2024: 189 · 2023: 171 · 2022: 233 · 2021: 275 · 2020: 259 · 2019: 179 · 2018: 184 · 2017: 160 · 2016: 142 · 2015: 149 · 2014: 128 · 2013: 91 · 2012: 101
- FWCI
- 21.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, trim and fill, missing studies, funnel plot, nonparametric estimators, selection bias, meta-analysis, effect size estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review