Publication Bias in Meta‐Analysis

Rothstein, Hannah R.; Sutton, Alexander J.; Borenstein, Michael

doi:10.1002/0470870168.ch1

Cited by 614Meta-analysis and systematic reviewsscientometrics and bibliometrics researchStatistical Methods in Epidemiology

Publication Bias in Meta‐Analysis

Rothstein, Hannah R., Sutton, Alexander J., Borenstein, Michael·2005·Publication Bias in Meta‐Analysis

DOI 10.1002/0470870168.ch1

Open this paper in CoChat — free account

Abstract

This chapter contains sections titled: Publication Bias As a Threat to Validity Organization of the Book Our Modest Proposal References

Integrity signals

Registry

Crossref · 10.1002/0470870168.ch1

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Egger's test for the direct outcomes showed no evidence of publication or small-study bias, t(57)=.87, p=.386 (2-tailed).
“This is reinforced with a diagnostic test (Egger's test run in CMA as demonstrated in Rothstein, Sutton, & Borenstein, 2005) that showed no evidence of publication or small-study bias, t(57) = .87,p = .386(2-tailed).”
From Legitimacy in Policing: A Systematic Review (2013) · cites this paper as Rothstein, Sutton, & Borenstein, 2005
Many proposed adjustment methods can lead to overcorrection and distort results.
“Many proposed adjustment methods can also lead to overcorrection and distort results72.”
From When combinations of humans and AI are useful: A systematic review and meta-analysis (2024) · cites this paper as [72]
Funnel plots, Egger tests of funnel plot asymmetry and fail-safe number tests were used to assess publication bias.
“Funnel plots, Egger tests of funnel plot asymmetry and fail-safe number tests were used to assess publication bias( 37 )”
From Higher antioxidant and lower cadmium concentrations and lower incidence of pesticide residues in organically grown crops: a systematic literature review and meta-analyses (2014) · cites this paper as [37]

Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · see citing works
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · see citing works
Untitled work
(2002) · Cited by 13,211 · see citing works
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · see citing works
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,312 · see citing works
Synthesizing Research: A Guide for Literature Reviews
Cooper, H. (1998) · Cited by 1,285 · see citing works
Publication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427 · see citing works
Self-citation
Statistically combining independent studies: A meta-analysis of sex differences in conformity research.
Cooper, H. M. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.1.131 · Cited by 413 · see citing works

Flagged first, then by citations

Sorted by citations

Travel and the Built Environment
Ewing, R., & Cervero, R. (2010) · Journal of the American Planning Association · doi:10.1080/01944361003766766 · Cited by 5,421 · see citing works
Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry
Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.010 · Cited by 2,053 · see citing works
Self-citation
The Relationship between Entrepreneurship Education and Entrepreneurial Intentions: A Meta–Analytic Review
Bae, T. J., Qian, S., Miao, C., & Fiet, J. O. (2014) · Entrepreneurship Theory and Practice · doi:10.1111/etap.12095 · Cited by 1,873 · see citing works
Anxiety Disorders in Children and Adolescents with Autistic Spectrum Disorders: A Meta-Analysis
van Steensel, F. J. A., Bögels, S. M., & Perrin, S. (2011) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-011-0097-0 · Cited by 1,463 · see citing works
“The validity of these methods, however, decreases when the number of studies under investigation is small ( Rothstein et al. 1996 ).”
Background
Effects of occupational stress management intervention programs: A meta-analysis.
Richardson, K. M., & Rothstein, H. R. (2008) · Journal of Occupational Health Psychology · doi:10.1037/1076-8998.13.1.69 · Cited by 1,374 · see citing works
Self-citation
Untitled work
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301 · see citing works
Determinants of Entrepreneurial Intent: A Meta–Analytic Test and Integration of Competing Models
Schlaegel, C., & Koenig, M. (2013) · Entrepreneurship Theory and Practice · doi:10.1111/etap.12087 · Cited by 1,308 · see citing works
The appropriateness of asymmetry tests for publication bias in meta-analyses: A large survey
Ioannidis, J. P. A., & Trikalinos, T. A. (2007) · Canadian Medical Association Journal · doi:10.1503/cmaj.060410 · Cited by 1,052 · see citing works
A systematic review on consumer acceptance of alternative proteins: Pulses, algae, insects, plant-based meat alternatives, and cultured meat
Onwezen, M. C., Bouwman, E. P., Reinders, M. J., & Dagevos, H. (2020) · Appetite · doi:10.1016/j.appet.2020.105058 · Cited by 1,093 · see citing works
The relationship between materialism and personal well-being: A meta-analysis
Dittmar, H., Bond, R., Hurst, M., & Kasser, T. (2014) · Journal of Personality and Social Psychology · doi:10.1037/a0037409 · Cited by 890 · see citing works
Childhood maltreatment and characteristics of adult depression: Meta-analysis
Nelson, J., Klumparendt, A., Doebler, P., & Ehring, T. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.180752 · Cited by 822 · see citing works
The effect of contact with natural environments on positive and negative affect: A meta-analysis
McMahan, E. A., & Estes, D. (2015) · The Journal of Positive Psychology · doi:10.1080/17439760.2014.994224 · Cited by 833 · see citing works
Short-term exposure to particulate matter (PM10 and PM2.5), nitrogen dioxide (NO2), and ozone (O3) and all-cause and cause-specific mortality: Systematic review and meta-analysis
Orellano, P. W., Reynoso, J. I., QUARANTA, N. E., Bardach, A., & Ciapponi, A. (2020) · Environment International · doi:10.1016/j.envint.2020.105876 · Cited by 801 · see citing works
<i>p</i> -Curve and Effect Size: Correcting for Publication Bias Using Only Significant Results
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614553988 · Cited by 717 · see citing works
Pretest with Caution: Event-Study Estimates after Testing for Parallel Trends
Roth, J. (2022) · American Economic Review: Insights · doi:10.1257/aeri.20210236 · Cited by 769 · see citing works
Higher antioxidant and lower cadmium concentrations and lower incidence of pesticide residues in organically grown crops: a systematic literature review and meta-analyses
Barański, M., Średnicka-Tober, D., Volakakis, N., Seal, C., Sanderson, R., Stewart, G. B., Benbrook, C., Biavati, B., Markellou, E., Giotis, C., et al. (2014) · British Journal of Nutrition · doi:10.1017/s0007114514001366 · Cited by 684 · see citing works
“tests of funnel plot asymmetry and fail-safe number tests were used to assess publication bias((37)) (see online”
Coping flexibility and psychological adjustment to stressful life changes: A meta-analytic review.
Cheng, C., Lau, H.-P. B., & Chan, M.-P. S. (2014) · Psychological Bulletin · doi:10.1037/a0037913 · Cited by 664 · see citing works
A 24-step guide on how to design, conduct, and successfully publish a systematic review and meta-analysis in medical research
Muka, T., Glišić, M., Milić, J., Verhoog, S., Bohlius, J., Bramer, W. M., Chowdhury, R., & Franco, O. H. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00576-5 · Cited by 682 · see citing works
A Meta-Analysis of School-Based Bullying Prevention Programs' Effects on Bystander Intervention Behavior
Polanin, J. R., Espelage, D. L., & Pigott, T. (2012) · School Psychology Review · doi:10.1080/02796015.2012.12087375 · Cited by 659 · see citing works
Online Privacy Concerns and Privacy Management: A Meta-Analytical Review: Privacy Concerns Meta-Analysis
Baruh, L., Secinti, E., & Cemalcilar, Z. (2017) · Journal of Communication · doi:10.1111/jcom.12276 · Cited by 618 · see citing works
When combinations of humans and AI are useful: A systematic review and meta-analysis
Vaccaro, M., Almaatouq, A., & Malone, T. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02024-1 · Cited by 570 · see citing works
The Ordinal Effects of Ostracism: A Meta-Analysis of 120 Cyberball Studies
Hartgerink, C. H. J., van Beest, I., Wicherts, J. M., & Williams, K. D. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127002 · Cited by 558 · see citing works
Alcohol use as a risk factor for tuberculosis – a systematic review
Lönnroth, K., Williams, B. G., Stadlin, S., Jaramillo, E., & Dye, C. (2008) · BMC Public Health · doi:10.1186/1471-2458-8-289 · Cited by 548 · see citing works
Compensatory control and the appeal of a structured world.
Landau, M. J., Kay, A. C., & Whitson, J. A. (2015) · Psychological Bulletin · doi:10.1037/a0038703 · Cited by 479 · see citing works
A study of the impact of project-based learning on student learning effects: a meta-analysis study
Zhang, L., & Ma, Y. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1202728 · Cited by 455 · see citing works
Not So Subtle: A Meta-Analytic Investigation of the Correlates of Subtle and Overt Discrimination
Jones, K. P., Peddie, C. I., Gilrane, V. L., King, E. B., & Gray, A. L. (2016) · Journal of Management · doi:10.1177/0149206313506466 · Cited by 445 · see citing works
What One Hundred Years of Research Says About the Effects of Ability Grouping and Acceleration on K–12 Students’ Academic Achievement: Findings of Two Second-Order Meta-Analyses
Steenbergen-Hu, S., Makel, M. C., & Olszewski-Kubilius, P. (2016) · Review of Educational Research · doi:10.3102/0034654316675417 · Cited by 429 · see citing works
Assessment of publication bias, selection bias, and unavailable data in meta-analyses using individual participant data: a database survey
Ahmed, I., Sutton, A. J., & Riley, R. D. (2012) · BMJ · doi:10.1136/bmj.d7762 · Cited by 404 · see citing works
Self-citation
Publication Bias in the Organizational Sciences
Kepes, S., Banks, G. C., McDaniel, M. A., & Whetzel, D. L. (2012) · Organizational Research Methods · doi:10.1177/1094428112452760 · Cited by 400 · see citing works
Sleep problems during COVID-19 pandemic and its’ association to psychological distress: A systematic review and meta-analysis
Alimoradi, Z., Broström, A., Tsang, H. W. H., Griffiths, M. D., Haghayegh, S., Ohayon, M. M., Lin, C., & Pakpour, A. H. (2021) · EClinicalMedicine · doi:10.1016/j.eclinm.2021.100916 · Cited by 396 · see citing works
The behavioral immune system and social conservatism: a meta-analysis
Terrizzi, J. A., Shook, N. J., & McDaniel, M. A. (2012) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2012.10.003 · Cited by 382 · see citing works
Multiple hypothesis testing in genomics
Goeman, J., & Solari, A. (2014) · Statistics in Medicine · doi:10.1002/sim.6082 · Cited by 377 · see citing works
A systematic review of the intrapersonal correlates of motivational climate perceptions in sport and physical activity
Harwood, C. G., Keegan, R. J., Smith, J. M. J., & Raine, A. S. (2015) · Psychology of Sport and Exercise · doi:10.1016/j.psychsport.2014.11.005 · Cited by 374 · see citing works
Meta-analysis of consumers' willingness to pay for sustainable food products
Li, S., & Kallas, Z. (2021) · Appetite · doi:10.1016/j.appet.2021.105239 · Cited by 359 · see citing works
Learning Disabilities and Anxiety: A Meta-Analysis
Nelson, J. M., & Harwood, H. R. (2010) · Journal of Learning Disabilities · doi:10.1177/0022219409359939 · Cited by 354 · see citing works
Working memory training revisited: A multi-level meta-analysis of n-back training studies
Soveri, A., Antfolk, J., Karlsson, L., Salo, B., & Laine, M. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1217-0 · Cited by 350 · see citing works
Prevalence and Clinical Aspects of Mild Cognitive Impairment in Parkinson's Disease: A Meta‐Analysis
Baiano, C., Barone, P., Trojano, L., & Santangelo, G. (2019) · Movement Disorders · doi:10.1002/mds.27902 · Cited by 338 · see citing works
Peer Attachment: A Meta-analytic Review of Gender and Age Differences and Associations with Parent Attachment
Gorrese, A., & Ruggieri, R. (2012) · Journal of Youth and Adolescence · doi:10.1007/s10964-012-9759-6 · Cited by 337 · see citing works
Publication bias examined in meta-analyses from psychology and medicine: A meta-meta-analysis
van Aert, R. C. M., Wicherts, J. M., & van Assen, M. A. L. M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0215052 · Cited by 345 · see citing works
Bias Modelling in Evidence Synthesis
Turner, R., Spiegelhalter, D. J., Smith, G. C. S., & Thompson, S. G. (2008) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2008.00547.x · Cited by 322 · see citing works
What works for whom in which circumstances? On the need to move beyond the ‘what works?’ question in organizational intervention research
Nielsen, K. M., & Miraglia, M. (2016) · Human Relations · doi:10.1177/0018726716670226 · Cited by 334 · see citing works
Comparison of reading performance on screen and on paper: A meta-analysis
Kong, Y., Seo, Y. S., & Zhai, L. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.05.005 · Cited by 306 · see citing works
The effects of psychological distance on abstraction: Two meta-analyses.
Soderberg, C. K., Callahan, S. P., Kochersberger, A. O., Amit, E., & Ledgerwood, A. (2014) · Psychological Bulletin · doi:10.1037/bul0000005 · Cited by 319 · see citing works
Science or Art? How Aesthetic Standards Grease the Way Through the Publication Bottleneck but Undermine Science
Giner-Sorolla, R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612457576 · Cited by 274 · see citing works
Quantifying the impacts of ecological restoration on biodiversity and ecosystem services in agroecosystems: A global meta-analysis
Barral, M. P., Beñayas, J. M. R., Meli, P., & Maceira, N. (2015) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2015.01.009 · Cited by 280 · see citing works
Meta-analysis using effect size distributions of only statistically significant studies.
van Assen, M. A. L. M., van Aert, R. C. M., & Wicherts, J. M. (2015) · Psychological Methods · doi:10.1037/met0000025 · Cited by 265 · see citing works
Female mate choice and songbird song repertoires
Byers, B. E., & Kroodsma, D. E. (2008) · Animal Behaviour · doi:10.1016/j.anbehav.2008.10.003 · Cited by 262 · see citing works
Debunking Myths and Urban Legends About Meta-Analysis
Aguinis, H., Pierce, C. A., Bosco, F. A., Dalton, D. R., & Dalton, C. M. (2010) · Organizational Research Methods · doi:10.1177/1094428110375720 · Cited by 261 · see citing works
Grain legume-cereal intercropping enhances the use of soil-derived and biologically fixed nitrogen in temperate agroecosystems. A meta-analysis
González, C. R., Carlsson, G., Englund, J., Flöhr, A., Pelzer, E., Jeuffroy, M.-H., Makowski, D., & Jensen, E. S. (2020) · European Journal of Agronomy · doi:10.1016/j.eja.2020.126077 · Cited by 263 · see citing works
Combined effects of biochar and fertilizer applications on yield: A review and meta-analysis
Bai, S. H., Omidvar, N., Gallart, M., Kämper, W., Tahmasbian, I., Farrar, M. B., Singh, K., Zhou, G., Muqaddas, B., Xu, C., et al. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.152073 · Cited by 253 · see citing works
What do randomized controlled trials say about virtual rehabilitation in stroke? A systematic literature review and meta-analysis of upper-limb and cognitive outcomes
Aminov, A., Rogers, J. M., Middleton, S., Caeyenberghs, K., & Wilson, P. H. (2018) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-018-0370-2 · Cited by 236 · see citing works
Cognitive-Behavioral Therapy for Anxiety in Children With High-Functioning Autism: A Meta-analysis
Sukhodolsky, D. G., Bloch, M. H., Panza, K. E., & Reichow, B. (2013) · Pediatrics · doi:10.1542/peds.2013-1193 · Cited by 234 · see citing works
Are Computers Effective Lie Detectors? A Meta-Analysis of Linguistic Cues to Deception
Hauch, V., Blandón‐Gitlin, I., Masip, J., & Sporer, S. L. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868314556539 · Cited by 234 · see citing works
Would border carbon adjustments prevent carbon leakage and heavy industry competitiveness losses? Insights from a meta-analysis of recent economic studies
Branger, F., & Quirion, P. (2014) · Ecological Economics · doi:10.1016/j.ecolecon.2013.12.010 · Cited by 273 · see citing works
A meta‐analysis of the cross‐cultural psychometric properties of the Screen for Child Anxiety Related Emotional Disorders (SCARED)
Hale, W. W., Crocetti, E., Raaijmakers, Q. A. W., & Meeus, W. (2010) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2010.02285.x · Cited by 229 · see citing works
Multivariate Meta-Analysis: The Effect of Ignoring Within-Study Correlation
Riley, R. D. (2009) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2008.00593.x · Cited by 227 · see citing works
Composition differences between organic and conventional meat: a systematic literature review and meta-analysis
Średnicka-Tober, D., Barański, M., Seal, C. J., Sanderson, R., Benbrook, C. M., Steinshamn, H., Gromadzka-Ostrowska, J., Rembiałkowska, E., Skwarło‐Sońta, K., Eyre, M., et al. (2016) · British Journal Of Nutrition · doi:10.1017/s0007114515005073 · Cited by 235 · see citing works
Legitimacy in Policing: A Systematic Review
Mazerolle, L., Bennett, S., Davis, J., Sargeant, E., & Manning, M. (2013) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2013.1 · Cited by 224 · see citing works
Predictors of Third Molar Impaction
Carter, K. N., & Worthington, S. (2015) · Journal of Dental Research · doi:10.1177/0022034515615857 · Cited by 223 · see citing works
The association between stressors and telomeres in non‐human vertebrates: a meta‐analysis
Chatelain, M., Drobniak, S. M., & Szulkin, M. (2019) · Ecology Letters · doi:10.1111/ele.13426 · Cited by 222 · see citing works
Meta-analytic Reviews in the Organizational Sciences: Two Meta-analytic Schools on the Way to MARS (the Meta-analytic Reporting Standards)
Kepes, S., McDaniel, M. A., Brannick, M. Τ., & Banks, G. C. (2013) · Journal of Business and Psychology · doi:10.1007/s10869-013-9300-2 · Cited by 221 · see citing works
Calculating and Synthesizing Effect Sizes
M., I. T. H., & Bernard, R. M. (2006) · Contemporary Issues in Communication Science and Disorders · doi:10.1044/cicsd_33_s_42 · Cited by 220 · see citing works
Higher PUFA andn-3 PUFA, conjugated linoleic acid,α-tocopherol and iron, but lower iodine and selenium concentrations in organic milk: a systematic literature review and meta- and redundancy analyses
Średnicka-Tober, D., Barański, M., Seal, C. J., Sanderson, R., Benbrook, C. M., Steinshamn, H., Gromadzka-Ostrowska, J., Rembiałkowska, E., Skwarło‐Sońta, K., Eyre, M., et al. (2016) · British Journal Of Nutrition · doi:10.1017/s0007114516000349 · Cited by 212 · see citing works
Obesity As a Risk Factor for Anthracyclines and Trastuzumab Cardiotoxicity in Breast Cancer: A Systematic Review and Meta-Analysis
Guénancia, C., Lefebvre, A., Cardinale, D. M., Yu, A. F., Ladoire, S., Ghiringhelli, F., Zeller, M., Rochette, L., Cottin, Y., & Vergely, C. (2016) · Journal of Clinical Oncology · doi:10.1200/jco.2016.67.4846 · Cited by 213 · see citing works
A meta-analysis of heavy metal bioavailability response to biochar aging: Importance of soil and biochar properties
Yuan, C., Gao, B., Peng, Y., Gao, X., Fan, B., & Chen, Q. (2021) · Science of The Total Environment · doi:10.1016/j.scitotenv.2020.144058 · Cited by 221 · see citing works
Do core interpersonal and affective traits of PCL-R psychopathy interact with antisocial behavior and disinhibition to predict violence?
Kennealy, P. J., Skeem, J. L., Walters, G. D., & Camp, J. (2010) · Psychological Assessment · doi:10.1037/a0019618 · Cited by 197 · see citing works
Effects of biochar application on soil nitrogen transformation, microbial functional genes, enzyme activity, and plant nitrogen uptake: A meta‐analysis of field studies
Zhang, L., Jing, Y., Chen, C. R., Xiang, Y., Rashti, M. R., Li, Y., Deng, Q., & Zhang, R. (2021) · GCB Bioenergy · doi:10.1111/gcbb.12898 · Cited by 203 · see citing works
An Assessment of the Magnitude of Effect Sizes
Paterson, T. A., Harms, P. D., Steel, P., & Credé, M. (2015) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051815614321 · Cited by 196 · see citing works
Evidence map of crop diversification strategies at the global scale
Beillouin, D., Ben-Ari, T., & Makowski, D. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab4449 · Cited by 192 · see citing works
Estimation of Behavioral Addiction Prevalence During COVID-19 Pandemic: A Systematic Review and Meta-analysis
Alimoradi, Z., Lotfi, A., Lin, C., Griffiths, M. D., & Pakpour, A. H. (2022) · Current Addiction Reports · doi:10.1007/s40429-022-00435-6 · Cited by 201 · see citing works
Novel methods to deal with publication biases: secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications
Moreno, S. G., Sutton, A. J., Turner, E. H., Abrams, K. R., Cooper, N. J., Palmer, T. M., & Ades, A. E. (2009) · BMJ · doi:10.1136/bmj.b2981 · Cited by 184 · see citing works
Self-citation
Augmented reality in vocational training: A systematic review of research and applications
Chiang, F., Shang, X., & Qiao, L. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107125 · Cited by 180 · see citing works
Effectiveness of psychological interventions in preventing recurrence of depressive disorder: Meta-analysis and meta-regression
Biesheuvel-Leliefeld, K. E. M., Kok, G. D., Bockting, C. L. H., Cuijpers, P., Hollon, S. D., van Marwijk, H. W. J., & Smit, F. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.12.016 · Cited by 175 · see citing works
Language and verbal short-term memory skills in children with Down syndrome: a meta-analytic review.
Næss, K., Lyster, S., Hulme, C., & Melby-Lervåg, M. (2011) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2011.05.014 · Cited by 193 · see citing works
Academic self-handicapping and achievement: A meta-analysis.
Schwinger, M., Wirthwein, L., Lemmer, G., & Steinmayr, R. (2014) · Journal of Educational Psychology · doi:10.1037/a0035832 · Cited by 181 · see citing works
A weight and a meta-analysis on mobile banking acceptance research
Baptista, G., & Oliveira, T. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.05.074 · Cited by 177 · see citing works
Outcomes of medial patellofemoral ligament reconstruction for patellar instability: a systematic review
Smith, T. O., Walker, J., & Russell, N. (2007) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-007-0390-0 · Cited by 173 · see citing works
Childhood body mass index and subsequent physician-diagnosed asthma: a systematic review and meta-analysis of prospective cohort studies
Egan, K. B., Ettinger, A. S., & Bracken, M. B. (2013) · BMC Pediatrics · doi:10.1186/1471-2431-13-121 · Cited by 174 · see citing works
Responses of insect herbivores and herbivory to habitat fragmentation: a hierarchical meta‐analysis
Rossetti, M. R., Tscharntke, T., Aguilar, R., & Batáry, P. (2017) · Ecology Letters · doi:10.1111/ele.12723 · Cited by 166 · see citing works
A historical review of publication bias
Marks‐Anglin, A., & Chen, Y. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1452 · Cited by 165 · see citing works
Tai Chi for Chronic Pain Conditions: A Systematic Review and Meta-analysis of Randomized Controlled Trials
Kong, L., Lauche, R., Klose, P., Bu, J.-H., Yang, X. C., Guo, C., Dobos, G. J., & Cheng, Y. W. (2016) · Scientific Reports · doi:10.1038/srep25325 · Cited by 163 · see citing works
Multinational comparison of internet gaming disorder and psychosocial problems versus well-being: Meta-analysis of 20 countries
Cheng, C., Cheung, M. W. ‐., & Wang, H.-Y. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.06.033 · Cited by 163 · see citing works
Prognostic markers in cancer: the evolution of evidence from single studies to meta-analysis, and beyond
Riley, R. D., Sauerbrei, W., & Altman, D. G. (2009) · British Journal of Cancer · doi:10.1038/sj.bjc.6604999 · Cited by 161 · see citing works
The impact of affective information on working memory: A pair of meta-analytic reviews of behavioral and neuroimaging evidence.
Schweizer, S., Satpute, A. B., Atzil, S., Field, A. P., Hitchcock, C., Black, M., Barrett, L. F., & Dalgleish, T. (2019) · Psychological Bulletin · doi:10.1037/bul0000193 · Cited by 152 · see citing works
Cultural worldviews and environmental risk perceptions: A meta-analysis
Xue, W., Hine, D. W., Loi, N. M., Thorsteinsson, E., & Phillips, W. J. (2014) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2014.07.002 · Cited by 155 · see citing works
A meta-analysis of the effects of psychotherapy with adults sexually abused in childhood
Taylor, J. E., & Harvey, S. T. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.05.008 · Cited by 156 · see citing works
Meta-analysis of quality of life in children and adolescents with ADHD: By both parent proxy-report and child self-report using PedsQL™
Lee, Y.-C., Yang, H.-J., Chen, V. C.-H., Lee, W.-T., Teng, M.-J., Lin, C.-H., & Gossop, M. (2016) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2015.11.009 · Cited by 153 · see citing works
Revisiting the file drawer problem in meta‐analysis: An assessment of published and nonpublished correlation matrices.
Dalton, D., Aguinis, H., Dalton, C. M., Bosco, F., & Pierce, C. (2012) · Personnel Psychology · doi:10.1111/j.1744-6570.2012.01243.x · Cited by 145 · see citing works
The reliability and validity of the Q‐angle: a systematic review
Smith, T. O., Hunt, N. J., & Donell, S. T. (2008) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-008-0643-6 · Cited by 156 · see citing works
Effectiveness of and dropout from outpatient cognitive behavioral therapy for adult unipolar depression: A meta-analysis of nonrandomized effectiveness studies.
Hans, E., & Hiller, W. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0031080 · Cited by 211 · see citing works
Revealed or Concealed? Transparency of Procedures, Decisions, and Judgment Calls in Meta-Analyses
Aytug, Z. G., Rothstein, H. R., Zhou, W., & Kern, M. C. (2011) · Organizational Research Methods · doi:10.1177/1094428111403495 · Cited by 145 · see citing works
Self-citation
Robust Bayesian meta‐analysis: Model‐averaging across complementary publication bias adjustment methods
Bartos̆, F., Maier, M., Wagenmakers, E., Doucouliagos, H., & Stanley, T. D. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1594 · Cited by 138 · see citing works
Robust Bayesian meta-analysis: Addressing publication bias with model-averaging.
Maier, M., Bartos̆, F., & Wagenmakers, E. (2022) · Psychological Methods · doi:10.1037/met0000405 · Cited by 144 · see citing works
The relationship between acceptance of cancer and distress: A meta-analytic review
Secinti, E., Tometich, D. B., Johns, S. A., & Mosher, C. E. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2019.05.001 · Cited by 132 · see citing works
Morphologic and Demographic Predictors of Third Molar Agenesis: A Systematic Review and Meta-analysis
Carter, K., & Worthington, S. (2015) · Journal of Dental Research · doi:10.1177/0022034515581644 · Cited by 141 · see citing works
Peer Attachment and Youth Internalizing Problems: A Meta-Analysis
Gorrese, A. (2015) · Child & Youth Care Forum · doi:10.1007/s10566-015-9333-y · Cited by 141 · see citing works
Theory of planned behavior interventions for reducing heterosexual risk behaviors: A meta-analysis.
Tyson, M., Covey, J. A., & Rosenthal, H. E. S. (2014) · Health Psychology · doi:10.1037/hea0000047 · Cited by 138 · see citing works
Passive Smoking in the Etiology of Non-Syndromic Orofacial Clefts: A Systematic Review and Meta-Analysis
Sabbagh, H. J., Hassan, M. H. A., Innes, N., Elkodary, H. M., Little, J., & Mossey, P. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0116963 · Cited by 137 · see citing works
School-Based Peer-Related Social Competence Interventions for Children with Autism Spectrum Disorder: A Meta-Analysis and Descriptive Review of Single Case Research Design Studies
Whalon, K. J., Conroy, M. A., Martínez, J. R., & Werch, B. L. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2373-1 · Cited by 137 · see citing works
Variations in the Promoter Region of the Serotonin Transporter Gene and Biased Attention for Emotional Information: A Meta-Analysis
Pergamin‐Hight, L., Bakermans‐Kranenburg, M. J., van IJzendoorn, M. H., & Bar‐Haim, Y. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.10.030 · Cited by 136 · see citing works

Authors: Rothstein, H. R., Sutton, A. J., & Borenstein, M.
Affiliations: Baruch College (US)
Long Island Jewish Medical Center (US)
ORCID: Rothstein, Hannah R.
Borenstein, Michael
Venue: Publication Bias in Meta‐Analysis
Publisher: Wiley
Published: 2005-10-07
Pages: 1-7
DOI: 10.1002/0470870168.ch1
OpenAlex: W2146302105
Cited by: 603
References: 8
Citations by year: 2026: 21 · 2025: 44 · 2024: 54 · 2023: 47 · 2022: 46 · 2021: 57 · 2020: 38 · 2019: 21 · 2018: 15 · 2017: 30 · 2016: 29 · 2015: 26 · 2014: 30 · 2013: 23 · 2012: 32
Type: other
Language: en
Open access: closed
Licence: doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords: publication bias, meta-analysis validity, research bias

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Publication Bias in Meta‐Analysis

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks