The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Abstract
Meta-analysis collects and synthesizes results from individual studies to estimate an overall effect size. If published studies are chosen, say through a literature review, then an inherent selection bias may arise, because, for example, studies may tend to be published more readily if they are statistically significant, or deemed to be more “interesting” in terms of the impact of their outcomes. We develop a simple rank-based data augmentation technique, formalizing the use of funnel plots, to estimate and adjust for the numbers and outcomes of missing studies. Several nonparametric estimators are proposed for the number of missing studies, and their properties are developed analytically and through simulations. We apply the method to simulated and epidemiological datasets and show that it is both effective and consistent with other criteria in the literature.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Publication bias was investigated by applying the trim and fill method, where effect sizes are recalculated to adjust for supposed publication biases (Duval & Tweedie, 2000).”
From Taking stock: A meta-analysis of the effects of foreign language enjoyment (2022) · cites this paper as Duval & Tweedie, 2000
In the citing paper
“The trim‐and‐fill procedure determined that nine studies should be added to create symmetry.”
From Problem-oriented policing for reducing crime and disorder: An updated systematic review and meta-analysis (2020) · cites this paper as Duval and Tweedie (2000)
In the citing paper
“Like many systematic reviews, our meta‐analyses used the trim‐and‐fill procedure to explore whether publication bias might be affecting the results and to estimate how the reported effects would change if the bias were to be removed (Duval & Tweedie, 2000; Duval, 2005).”
From Hot spots policing of small geographic areas effects on crime (2019) · cites this paper as Duval & Tweedie, 2000
In the citing paper
“When we encountered publication bias, we conducted a trim and fill adjusted analysis 25 to remove the most extreme small studies from the positive side of the funnel plot, and recalculated the effect size iteratively, until the funnel plot was symmetrical around the (new) effect size.”
From Diabetes mellitus in people with schizophrenia, bipolar disorder and major depressive disorder: a systematic review and large scale meta‐analysis (2016) · cites this paper as [25]
In the citing paper
“Variations in the risk for glucose abnormalities are evident in the literature, with the highest risk being associated with clozapine, olanzapine and quetiapine in carefully designed studies 25,34,35 .”
From Diabetes mellitus in people with schizophrenia, bipolar disorder and major depressive disorder: a systematic review and large scale meta‐analysis (2016) · cites this paper as [25]
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Self-citationWasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
Casella, G., & Berger, R. L. (1993) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,835
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“The negative binomial forms here are reminiscent of those used by Eberly and Casella (1999) and Givens et al.”
MethodSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,486
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,422
Research works printed but not linked: 10
- 1983, British Medical Journal, 280, 508
- Cooper H., 1998, Synthesizing Research
- Dear K., 1997, Statistical Science, 12, 245
- DuMouchel W., 1997, Statistical Science, 12, 244
- Duval S. J., 1999, “Effects of Publication Bias in Meta-Analysis,”
- Duval S. J., “Robustness of the ‘Trim and Fill’ publication bias approach to different mechanisms for study suppression,”
- Eberly L. E., 1999, Journal of Official Statistics, 15
- Hedges L., 1985, Statistical Methods for Meta-Analysis
- Sugita M., 1994, Tokai Journal of Experimental and Clinical Medicine, 19, 29
- Sutton A. J., 1999, “The Impact of Publication Bias on Meta-Analyses Within the Cochrane Database of Systematic Reviews,”
Cited by
Sorted by citations
Items 301–400 of 1,059
Healy, S., Nacario, A., Braithwaite, R. E., & Hopper, C. A. (2018) · Autism Research · doi:10.1002/aur.1955 · Cited by 327
Owen, M. B., Curry, W. B., Kerner, C., Newson, L., & Fairclough, S. J. (2017) · Preventive Medicine · doi:10.1016/j.ypmed.2017.09.018 · Cited by 280
Ullsperger, J. M., & Nikolas, M. A. (2017) · Psychological Bulletin · doi:10.1037/bul0000106 · Cited by 293
Fatigue in Parkinson's disease: A systematic review and meta‐analysis
Siciliano, M., Trojano, L., Santangelo, G., Micco, R. D., Tedeschi, G., & Tessitore, A. (2018) · Movement Disorders · doi:10.1002/mds.27461 · Cited by 313
A Meta-Analysis on Antecedents and Outcomes of Detachment from Work
Wendsche, J., & Lohmann-Haislah, A. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.02072 · Cited by 292
Meta-analysis of the efficacy of psychological and medical treatments for binge-eating disorder
Hilbert, A., Petroff, D., Herpertz, S., Pietrowsky, R., Tuschen-Caffier, B., Vocks, S., & Schmidt, R. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000358 · Cited by 283
Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis
Rücker, G., Schwarzer, G., Carpenter, J. R., Binder, H., & Schumacher, M. C. (2010) · Biostatistics · doi:10.1093/biostatistics/kxq046 · Cited by 295
Conde‐Agudelo, A., & Romero, R. J. (2021) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2021.07.009 · Cited by 300
Kothgassner, O. D., Goreis, A., Robinson, K., Huscsava, M. M., Schmahl, C., & Plener, P. L. (2021) · Psychological Medicine · doi:10.1017/s0033291721001355 · Cited by 288
“Egger ’ s regressions were conducted to estimate publication bias (Sterne & Egger, 2005), with adjusted effect sizes calculated using trim-and-fill analyses and, based on funnel plot asymmetry, numbers of imputed missing studies (Duval & Tweedie, 2000).”
Identification of behaviour change techniques to reduce excessive alcohol consumption
Michie, S., Whittington, C., Hamoudi, Z., Zarnani, F., Tober, G., & West, R. (2012) · Addiction · doi:10.1111/j.1360-0443.2012.03845.x · Cited by 288
Modelling publication bias in meta-analysis: a review
Sutton, A. J., Song, F., Gilbody, S. M., & Abrams, K. R. (2000) · Statistical Methods in Medical Research · doi:10.1177/096228020000900503 · Cited by 288
Salkeld, D. J., Padgett, K. A., & Jones, J. H. (2013) · Ecology Letters · doi:10.1111/ele.12101 · Cited by 301
Detecting Selection Bias in Meta-Analyses with Multiple Outcomes: A Simulation Study
Fernández‐Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Noortgate, W. V. D. (2019) · The Journal of Experimental Education · doi:10.1080/00220973.2019.1582470 · Cited by 312
Tomaso, C. C., Johnson, A. B., & Nelson, T. D. (2021) · SLEEP · doi:10.1093/sleep/zsaa289 · Cited by 282
The Effectiveness of School-Based Anti-Bullying Programs
Ferguson, C. J., Miguel, C. S., Kilburn, J. C., & Sanchez, P. (2007) · Criminal Justice Review · doi:10.1177/0734016807311712 · Cited by 326
Meta-analysis of Cohen’s kappa
Sun, S. (2011) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-011-0077-3 · Cited by 282
Global effects of non‐native tree species on multiple ecosystem services
Castro‐Díez, P., Vaz, A. S., Silva, J. S., van Loo, M., Alonso, Á., Aponte, C., Bayón, Á., Bellingham, P. J., Chiuffo, M. C., DiManno, N., et al. (2019) · Biological Reviews · doi:10.1111/brv.12511 · Cited by 281
Demands, control, and support: A meta-analytic review of work characteristics interrelationships.
Luchman, J. N., & González‐Morales, M. G. (2013) · Journal of Occupational Health Psychology · doi:10.1037/a0030541 · Cited by 325
Yperen, N. W. V., Blaga, M., & Postmes, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0093594 · Cited by 282
Socio-Cognitive Scaffolding with Computer-Supported Collaboration Scripts: a Meta-Analysis
Vogel, F., Wecker, C., Kollar, I., & Fischer, F. (2017) · Educational Psychology Review · doi:10.1007/s10648-016-9361-7 · Cited by 278
Cigarette Smoking Increases Complications Following Fracture: A Systematic Review
Scolaro, J. A., Schenker, M. L., Yannascoli, S., Baldwin, K., Mehta, S., & Ahn, J. (2014) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.m.00081 · Cited by 279
Spielmans, G. I., Berman, M. I., Linardatos, E., Rosenlicht, N. Z., Perry, A., & Tsai, A. C. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001403 · Cited by 275
Home safety education and provision of safety equipment for injury prevention
Kendrick, D., Young, B., Mason‐Jones, A. J., Ilyas, N., Achana, F. A., Cooper, N. J., Hubbard, S., Sutton, A. J., Smith, S. J., Wynn, P. M., et al. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005014.pub3 · Cited by 280
Sex differences in left-handedness: A meta-analysis of 144 studies.
Παπαδάτου-Παστού, Μ., Martin, M., Munafo, M. R., & Jones, G. V. (2008) · Psychological Bulletin · doi:10.1037/a0012814 · Cited by 282
Discacciati, A., Orsini, N., & Wolk, A. (2012) · Annals of Oncology · doi:10.1093/annonc/mdr603 · Cited by 276
Noble, M., Tregear, S., Treadwell, J. R., & Schoelles, K. M. (2008) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2007.03.015 · Cited by 274
Understanding the Third-Person Perception: Evidence From a Meta-Analysis
Sun, Y., Pan, Z., & Shen, L. (2008) · Journal of Communication · doi:10.1111/j.1460-2466.2008.00385.x · Cited by 284
How to do a good systematic review of effects in international development: a tool kit
Waddington, H., White, H., Snilstveit, B., Hombrados, J. G., Vojtkova, M., Davies, P., Bhavsar, A., Eyers, J., Koehlmoos, T. P., Petticrew, M., et al. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.711765 · Cited by 278
The intergenerational transmission of child maltreatment: A three-level meta-analysis
Assink, M., Spruit, A., Schuts, M., Lindauer, R., van der Put, C. E., & Stams, G.-J. J. M. (2018) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.07.037 · Cited by 275
Extra-pair paternity in birds: review of the genetic benefits
Akçay, E., & Roughgarden, J. E. (2007) · ScholarlyCommons (University of Pennsylvania) · Cited by 270
van der Gaag, M., Valmaggia, L. R., & Smit, F. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.03.016 · Cited by 271
Comparing meta-analyses and preregistered multiple-laboratory replication projects
Kvarven, A., Strømland, E., & Johannesson, M. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0787-z · Cited by 271
Shadish, W. R., Hedges, L. V., & Pustejovsky, J. E. (2014) · Journal of School Psychology · doi:10.1016/j.jsp.2013.11.005 · Cited by 283
The effectiveness of pair programming: A meta-analysis
Hannay, J. E., Dybå, T., Arisholm, E., & Sjøberg, D. I. K. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2009.02.001 · Cited by 268
Kim, S. W., & Hill, N. E. (2015) · Journal of Educational Psychology · doi:10.1037/edu0000023 · Cited by 331
Bernard, K., Nissim, G., Vaccaro, S., Harris, J. L., & Lindhiem, O. J. (2018) · Attachment & Human Development · doi:10.1080/14616734.2018.1430839 · Cited by 268
Låg, T., & Sæle, R. G. (2019) · AERA Open · doi:10.1177/2332858419870489 · Cited by 367
Sbarra, D. A., Law, R. W., & Portley, R. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611414724 · Cited by 285
Schrag, M., Mueller, C., Oyoyo, U. E., Smith, M. A., & Kirsch, W. M. (2011) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2011.05.001 · Cited by 266
Meta-analysis using effect size distributions of only statistically significant studies.
van Assen, M. A. L. M., van Aert, R. C. M., & Wicherts, J. M. (2015) · Psychological Methods · doi:10.1037/met0000025 · Cited by 265
Ku, P., Steptoe, A., Liao, Y., Hsueh, M., & Chen, L. (2018) · BMC Medicine · doi:10.1186/s12916-018-1062-2 · Cited by 295
Mude, W., Oguoma, V. M., Nyanhanda, T., Mwanri, L., & Njue, C. (2021) · Journal of Global Health · doi:10.7189/jogh.11.05015 · Cited by 261
Taking stock: A meta-analysis of the effects of foreign language enjoyment
Botes, E., Dewaele, J.-M., & Greiff, S. (2022) · Studies in Second Language Learning and Teaching · doi:10.14746/ssllt.2022.12.2.3 · Cited by 266
Diener, M. J., & Monroe, J. M. (2011) · Psychotherapy · doi:10.1037/a0022425 · Cited by 260
Debunking Myths and Urban Legends About Meta-Analysis
Aguinis, H., Pierce, C. A., Bosco, F. A., Dalton, D. R., & Dalton, C. M. (2010) · Organizational Research Methods · doi:10.1177/1094428110375720 · Cited by 264
Sexual orientation and the second to fourth finger length ratio: A meta-analysis in men and women.
Grimbos, T., Dawood, K., Burriss, R. P., Zucker, K. J., & Puts, D. A. (2010) · Behavioral Neuroscience · doi:10.1037/a0018764 · Cited by 271
The Nomological Net of the HEXACO Model of Personality: A Large-Scale Meta-Analytic Investigation
Zettler, I., Thielmann, I., Hilbig, B. E., & Moshagen, M. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691619895036 · Cited by 254
Burlingame, G. M., McClendon, D. T., & Alonso, J. (2011) · Psychotherapy · doi:10.1037/a0022063 · Cited by 259
Identifying Effective Components of Child Maltreatment Interventions: A Meta-analysis
van der Put, C. E., Assink, M., Gubbels, J., & van Solinge, N. F. B. (2017) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-017-0250-5 · Cited by 277
Self-Enhancement and Psychological Adjustment: A Meta-Analytic Review
Dufner, M., Gebauer, J. E., Sedikides, C., & Denissen, J. J. A. (2018) · Personality and Social Psychology Review · doi:10.1177/1088868318756467 · Cited by 279
Linking Goal Progress and Subjective Well-Being: A Meta-analysis
Klug, H. J. P., & Maier, G. W. (2015) · Journal of Happiness Studies · doi:10.1007/s10902-013-9493-0 · Cited by 257
Hartling, L., Liang, Y., & Lacaze‐Masmonteil, T. (2011) · Archives of Disease in Childhood Fetal & Neonatal · doi:10.1136/adc.2010.210187 · Cited by 255
Contour-Enhanced Funnel Plots for Meta-Analysis
Palmer, T., Sutton, A. J., Peters, J., & Moreno, S. G. (2008) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x0800800206 · Cited by 261
Yu, H.-F., Chen, H.-S., Rao, D.-P., & Gong, J. (2016) · Medicine · doi:10.1097/md.0000000000004863 · Cited by 257
Systematic review and meta-analysis: fussing and crying durations and prevalence of colic in infants
Wolke, D., Bilgin, A., & Samara, M. (2017) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2017.02.020 · Cited by 255
Prevalence of chronic pain in developing countries: systematic review and meta-analysis
Sá, K. N., Moreira, L. G., Baptista, A. F., Yeng, L. T., Teixeira, M. J., Galhardoni, R., & de Andrade, D. C. (2019) · PAIN Reports · doi:10.1097/pr9.0000000000000779 · Cited by 275
Fat mass changes during menopause: a metaanalysis
Ambikairajah, A., Walsh, E., Tabatabaei-Jafari, H., & Cherbuin, N. (2019) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2019.04.023 · Cited by 255
Meta-analytic structural equation modeling with moderating effects on SEM parameters.
Jak, S., & Cheung, M. W. L. (2020) · Psychological Methods · doi:10.1037/met0000245 · Cited by 262
Transitional Care Interventions Prevent Hospital Readmissions For Adults With Chronic Illnesses
Verhaegh, K. J., Vroomen, J. L. M., Eslami, S., Geerlings, S. E., de Rooij, S. E., & Buurman, B. M. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0160 · Cited by 273
Foster care placement instability: A meta-analytic review
Konijn, C., Admiraal, S., Baart, J., van Rooij, F., Stams, G.-J., Colonnesi, C., Lindauer, R., & Assink, M. (2019) · Children and Youth Services Review · doi:10.1016/j.childyouth.2018.12.002 · Cited by 253
Can Policing Disorder Reduce Crime? A Systematic Review and Meta-analysis
Braga, A. A., Welsh, B. C., & Schnell, C. (2015) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427815576576 · Cited by 267
Elshazli, R. M., Toraih, E. A., Elgaml, A., El‐Mowafy, M., El‐Mesery, M., Amin, M. N., Hussein, M. H., Killackey, M. T., Fawzy, M. S., & Kandil, E. H. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238160 · Cited by 261
Hot spots policing and crime prevention: A systematic review of randomized controlled trials
Braga, A. A. (2005) · Journal of Experimental Criminology · doi:10.1007/s11292-005-8133-z · Cited by 249
EEG power spectral measures of cognitive workload: A meta‐analysis
Chikhi, S., Matton, N., & Blanchet, S. (2022) · Psychophysiology · doi:10.1111/psyp.14009 · Cited by 258
Statistical methods for dealing with publication bias in meta‐analysis
Jin, Z., Zhou, X., & He, J. (2014) · Statistics in Medicine · doi:10.1002/sim.6342 · Cited by 262
What works in coping with HIV? A meta-analysis with implications for coping with serious illness.
Moskowitz, J. T., Hult, J. R., Bussolari, C. J., & Acree, M. C. (2009) · Psychological Bulletin · doi:10.1037/a0014210 · Cited by 267
Braga, A. A., Weisburd, D., & Turchan, B. (2018) · Criminology & Public Policy · doi:10.1111/1745-9133.12353 · Cited by 261
Kong, D. T., Dirks, K. T., & Ferrin, D. L. (2013) · Academy of Management Journal · doi:10.5465/amj.2012.0461 · Cited by 273
Aggarwal, R., Sentz, J., & Miller, M. A. (2007) · PEDIATRICS · doi:10.1542/peds.2006-3481 · Cited by 245
The Relationship Between Deliberate Practice and Performance in Sports: A Meta-Analysis
Macnamara, B. N., Moreau, D., & Hambrick, D. Z. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635591 · Cited by 248
Attentional bias towards threatening stimuli in children with anxiety: A meta-analysis
Dudeney, J., Sharpe, L., & Hunt, C. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.05.007 · Cited by 247
Weisburd, D., Telep, C. W., Hinkle, J. C., & Eck, J. E. (2010) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2010.00617.x · Cited by 285
Publication Bias in Empirical Sociological Research
Gerber, A. S., & Malhotra, N. (2008) · Sociological Methods & Research · doi:10.1177/0049124108318973 · Cited by 175
Virtual reality exposure therapy for posttraumatic stress disorder (PTSD): a meta-analysis
Kothgassner, O. D., Goreis, A., Kafka, J. X., Van Eickels, R. L., Plener, P. L., & Felnhofer, A. (2019) · European Journal of Psychotraumatology · doi:10.1080/20008198.2019.1654782 · Cited by 246
Puts, D. A., McDaniel, M. A., Jordan, C. L., & Breedlove, S. M. (2007) · Archives of Sexual Behavior · doi:10.1007/s10508-007-9271-3 · Cited by 248
Achievement goals and self-efficacy: A meta-analysis
Huang, C. (2016) · Educational Research Review · doi:10.1016/j.edurev.2016.07.002 · Cited by 269
Yap, M. B. H., Morgan, A. J., Cairns, K., Jorm, A. F., Hetrick, S. E., & Merry, S. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.10.003 · Cited by 242
Garbers, Y., & Konradt, U. (2013) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12039 · Cited by 289
Acute exercise and subsequent energy intake. A meta-analysis
Schubert, M. M., Desbrow, B., Sabapathy, S., & Leveritt, M. (2013) · Appetite · doi:10.1016/j.appet.2012.12.010 · Cited by 240
Galling, B., Roldán, A., Hagi, K., Rietschel, L., Walyzada, F., Zheng, W., Cao, X., Xiang, Y., Zink, M., Kane, J. M., et al. (2017) · World Psychiatry · doi:10.1002/wps.20387 · Cited by 253
Do Animals Living in Larger Groups Experience Greater Parasitism? A Meta-Analysis
Rifkin, J. L., Nunn, C. L., & Garamszegi, L. Z. (2012) · The American Naturalist · doi:10.1086/666081 · Cited by 237
Brooks, S., Prince, A., Stahl, D., Campbell, I. C., & Treasure, J. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.006 · Cited by 236
Oldershaw, A., Lavender, T., Sallis, H., Stahl, D., & Schmidt, U. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.04.005 · Cited by 222
Carlucci, L., Saggino, A., & Balsamo, M. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.101999 · Cited by 234
Research on religion/spirituality and forgiveness: A meta-analytic review.
Davis, D. E., Worthington, E. L., Hook, J. N., & Hill, P. C. (2013) · Psychology of Religion and Spirituality · doi:10.1037/a0033637 · Cited by 247
Li, J., Dou, K., & Liang, Y. (2020) · Journal of Happiness Studies · doi:10.1007/s10902-020-00230-y · Cited by 267
Lee, Y. L., Lui, L. M. W., Chen-Li, D. C. J., Liao, Y., Mansur, R. B., Brietzke, E. M., Rosenblat, J. D., Ho, R., Rodrigues, N. B., Lipsitz, O., et al. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.04.050 · Cited by 246
Wijnia, L., Noordzij, G., Arends, L. R., Rikers, R. M. J. P., & Loyens, S. M. M. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09864-3 · Cited by 579
Interpretation bias in social anxiety: A systematic review and meta-analysis
Chen, J., Short, M. A., & Kemps, E. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.07.121 · Cited by 233
Forgiving the self and physical and mental health correlates: A meta-analytic review.
Davis, D. E., Ho, M. Y., Griffin, B. J., Bell, C., Hook, J. N., Tongeren, D. R. V., DeBlaere, C., Worthington, E. L., & Westbrook, C. J. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000063 · Cited by 245
Taylor, N., Conner, M., & Lawton, R. (2012) · Health Psychology Review · doi:10.1080/17437199.2010.533441 · Cited by 223
Karna, A., Richter, A., & Riesenkampff, E. (2015) · Strategic Management Journal · doi:10.1002/smj.2379 · Cited by 235
Mozart effect–Shmozart effect: A meta-analysis
Pietschnig, J., Voracek, M., & Formann, A. K. (2010) · Intelligence · doi:10.1016/j.intell.2010.03.001 · Cited by 230
Macadam, S. A., Gandhi, R. A., Bezuhly, M., & Lefaivre, K. A. (2008) · The Journal Of Hand Surgery · doi:10.1016/j.jhsa.2008.03.006 · Cited by 230
Hoppen, T. H., Priebe, S., Vetter, I., & Nexhmedin Morina, B. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2021-006303 · Cited by 271
Hale, W. W., Crocetti, E., Raaijmakers, Q. A. W., & Meeus, W. (2010) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2010.02285.x · Cited by 241
Outcomes of religious and spiritual adaptations to psychotherapy: A meta-analytic review
Smith, T. B., Bartz, J. D., & Richards, P. S. (2007) · Psychotherapy Research · doi:10.1080/10503300701250347 · Cited by 229
Vancampfort, D., Rosenbaum, S., Schuch, F. B., Ward, P. B., Probst, M., & Stubbs, B. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.11.008 · Cited by 225
Ferguson, C. J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.11.002 · Cited by 295
Reading for Writing: A Meta-Analysis of the Impact of Reading Interventions on Writing
Graham, S., Liu, X., Bartlett, B. J., Ng, C., Harris, K. R., Aitken, A. A., Barkel, A., Kavanaugh, C., & Talukdar, J. (2017) · Review of Educational Research · doi:10.3102/0034654317746927 · Cited by 250
Metadata
- Authors
- Duval, S., & Tweedie, R.
- Affiliations
- Colorado State University (US)
- University of Minnesota (US)
- ORCID
- Duval, Sue
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2000-03
- Volume
- 95
- Issue
- 449
- Pages
- 89-98
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2043565183
- Cited by
- 2,955
- References
- 40
- Citations by year
- 2026: 106 · 2025: 167 · 2024: 189 · 2023: 171 · 2022: 233 · 2021: 275 · 2020: 259 · 2019: 179 · 2018: 184 · 2017: 160 · 2016: 142 · 2015: 149 · 2014: 128 · 2013: 91 · 2012: 101
- FWCI
- 21.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, trim and fill, missing studies, funnel plot, nonparametric estimators, selection bias, meta-analysis, effect size estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
