The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Abstract
Publication bias, sometimes known as the "file-drawer problem" or "funnel-plot asymmetry," is common in empirical research. The authors review the implications of publication bias for quantitative research synthesis (meta-analysis) and describe existing techniques for detecting and correcting it. A new approach is proposed that is suitable for application to meta-analytic data sets that are too small for the application of existing methods. The model estimates parameters relevant to fixed-effects, mixed-effects or random-effects meta-analysis contingent on a hypothetical pattern of bias that is fixed independently of the data. The authors illustrate this approach for sensitivity analysis using 3 data sets adapted from a commonly cited reference work on research synthesis (H. M. Cooper & L. V. Hedges, 1994).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To evaluate publication bias, selection modeling was used. This approach used a weight function model created by Vevea and Woods [44], implemented through the weightr package.”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“confirming evidence of selection bias.”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“After adjustment for potential selection bias, the two-step model (P value cutpoints=.025, .50, 1) yielded a smaller and nonsignificant change in the pooled effect (g=0.54, SE=0.26, z=2.10; P=.04, 95% CI 0.04, 1.04).”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“The unadjusted model (k=44) estimated a pooled effect size of g=0.41 (SE=0.10, z=4.24; P<.001, 95% CI 0.22, 0.60).”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“studies with P<.025* were about 3.54 times more likely to be included than those with larger P values”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“suggesting moderate publication bias favoring statistically significant findings”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“The likelihood ratio test comparing adjusted and unadjusted models was significant (χ²2=11.25, P=.004)”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“Vevea and Woods’ (2005) selection model calculated a similar estimate (g¯ = 0.119).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Vevea and Woods’ (2005)
In the citing paper
“The selection model estimate was g¯ = 0.039.”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Vevea and Woods’ (2005)
In the citing paper
“Vevea and Woods’ (2005) selection model calculated a more conservative estimate (g¯ = 0.126).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Vevea and Woods’ (2005)
In the citing paper
“Vevea and Woods’ (2005) selection model yielded a similar estimate (g¯ = -0.002).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Vevea and Woods’ (2005)
In the citing paper
“Sensitivity analysis (Vevea and Woods 2005) was also conducted to evaluate and account for the level of publication bias.”
From A meta-analytic review of the efficacy of physical exercise interventions on cognition in individuals with autism spectrum disorder and ADHD (2016) · cites this paper as Vevea and Woods 2005
In the citing paper
“Although the result of Kendall's tau is non-significant, in view of the small number of studies included in the metaanalysis, publication bias cannot be rejected and therefore a sensitivity analysis (Vevea and Woods, 2005) was conducted to estimate and account for the likelihood of publication bias.”
From A meta-analytic review of the efficacy of physical exercise interventions on cognition in individuals with autism spectrum disorder and ADHD (2016) · cites this paper as Vevea and Woods, 2005
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,840
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 2×
“…are surveyed about unpublished work (e.g., Chan, Sacks, & Chalmers, 1982; Coursol & Wagner, 1986; Dickersin, Chan, Chalmers, Sacks, & Smith, 1987; Easterbrook et al., 1991; Misakian & Bero, 1998; Rotton, Foos, Vanmeek, & Levitt, 1995; Scherer, Dickersin, & Langenberg, 1994; Shadish, Doherty, &…”
BackgroundFixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Self-citationA Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955
Research works printed but not linked: 8
- Becker, 1986, Influence again., 178
- Becker, (in press). Failsafe N of file-drawer number., 111
- Chan, 1982, The epidemiology of unpublished randomized control trials., Clinical Research, 30, 234A
- 10.2307/1165375 · DOI
- Givens, 1997b, Statistical Science, 12, 247, 10.1214/ss/1030037958 · DOI
- 10.2307/1164832 · DOI · Paper page
- 10.2307/1164836 · DOI · Paper page
- 10.1001/jama.272.2.158 · DOI · Paper page
Cited by
Sorted by citations
Items 201–300 of 460
McKay, B., Bacelar, M. F. B., Parma, J. O., Miller, M. W., & Carter, M. J. (2023) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2023.2207255 · Cited by 56
“Thus, bias-correction analyses are inherently sensitivity analyses (Mathur & VanderWeele, 2020; Sutton et al., 2000; Vevea & Woods, 2005).”
Taylor, G., Sala, G., Kołak, J., Gerhardstein, P. C., & Lingwood, J. (2024) · Educational Research Review · doi:10.1016/j.edurev.2024.100614 · Cited by 70
“Selection models (Vevea & Woods, 2005) assume that the probability of an effect size to be suppressed is a function of its statistical significance.”
Using Monte Carlo experiments to select meta‐analytic estimators
Hong, S., & Reed, W. R. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1467 · Cited by 43
A meta‐analytic review of tipping compensation practices: An agency theory perspective
Banks, G. C., Woznyj, H. M., Kepes, S., Batchelor, J. H., & McDaniel, M. A. (2018) · Personnel Psychology · doi:10.1111/peps.12261 · Cited by 49
Kepes, S., & Thomas, M. A. (2018) · European Journal of Information Systems · doi:10.1080/0960085x.2017.1390188 · Cited by 45
“…(Peters, Sutton, Jones, Abrams, & Rushton, 2008), trim and fill (Duval, 2005), cumulative meta-analysis (Kepes et al., 2012), selection models (Vevea & Woods, 2005), PET-PEESE (precision-effect test, precision effect estimate with standard error; Stanley & Doucouliagos, CR and satisfaction…”
BackgroundMethodInfluentialBresin, K., & Mekawi, Y. (2020) · Archives of Suicide Research · doi:10.1080/13811118.2020.1802378 · Cited by 41
“Finally, we assessed the influence of publication bias with selection models (Vevea & Hedges, 1995; Vevea & Woods, 2005).”
MethodMeta-analysis in Sociological Research: Power and Heterogeneity
Tong, G., & Guo, G. (2019) · Sociological Methods & Research · doi:10.1177/0049124119882479 · Cited by 41
Effects of High-Intensity Interval Training on Sleep: A Systematic Review and Meta-Analysis
Min, L., Wang, D., You, Y., Fu, Y., & Ma, X. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182010973 · Cited by 39
“Notably, the results of some sensitivity analyses need to be interpreted with caution because the Trim and Fill method may lead to overcorrection [52].”
BackgroundAssessing the Sensitivity of Meta-analysis to Selection Bias: A Multiple Imputation Approach
Carpenter, J. R., Rücker, G., & Schwarzer, G. (2010) · Biometrics · doi:10.1111/j.1541-0420.2010.01498.x · Cited by 39
“Our approach is in the spirit of Vevea and Woods (2005), who propose prespecifying, rather than estimating, the weights in Hedges’ selection model, and look at the sensitivity of the conclusions as they vary these weights.”
MethodMeta-analysis of the reduced relative feedback frequency effect on motor learning and performance
McKay, B., Hussien, J., Vinh, M.-A., Mir-Orefice, A., Brooks, H., & Ste‐Marie, D. M. (2022) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2022.102165 · Cited by 37
Pasanen, B. E., Tomkinson, J. M., Dufner, T. J., Park, C. W., Fitzgerald, J. S., & Tomkinson, G. R. (2021) · American Journal of Human Biology · doi:10.1002/ajhb.23657 · Cited by 38
“The influence of publication bias was examined using a priori weightfunction sensitivity analysis (Vevea & Woods, 2005), which corrects the pooled correlation for various publication bias models.”
MethodA Guide to Evidence-Based Group Work
Macgowan, M. J. (2008) · doi:10.1093/acprof:oso/9780195183450.001.0001 · Cited by 38
Tiruneh, D., Assefa, N., & Mengiste, B. (2021) · Maternal Health Neonatology and Perinatology · doi:10.1186/s40748-020-00120-4 · Cited by 39
Vaportzis, E., Niechcial, M. A., & Gow, A. J. (2019) · Ageing Research Reviews · doi:10.1016/j.arr.2019.01.006 · Cited by 45
“Furthermore, we conducted a weightfunction model analysis (Vevea and Hedges, 1995; Vevea and Woods, 2005).”
Berezowski, L., Ludwig, L., Martin, A., Löwe, B., & Mora, M. C. S. (2021) · Psychosomatic Medicine · doi:10.1097/psy.0000000000001011 · Cited by 44
“Psychosomatic Medicine, V 84 • 325-338 336 and tests of heterogeneity (66), and led to false-negative results in the meta-bias corrections (62,67,68).”
BackgroundA Parsimonious Weight Function for Modeling Publication Bias
Citkowicz, M., & Vevea, J. L. (2017) · Psychological methods · doi:10.1037/met0000119 · Cited by 42
Self-citationPinquart, M., & Pfeiffer, J. P. (2018) · Journal of Research on Adolescence · doi:10.1111/jora.12462 · Cited by 48
Eason, A. D., & Parris, B. A. (2019) · Psychology of Consciousness: Theory, Research, and Practice · doi:10.1037/cns0000173 · Cited by 36
“As a further test for publication bias we ran the Vevea and Woods (2005) weight function model, which is optimal for meta-analyses with small sample sizes.”
MethodNewman, D. A., Jacobs, R. R., & Bartram, D. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.5.1394 · Cited by 41
Cheng, C., Ying, W., Ebrahimi, O. V., & Wong, K. F. E. (2023) · Health Psychology Review · doi:10.1080/17437199.2023.2175015 · Cited by 44
“Finally, the stepwise weight-function approach was adopted to determine whether the meta-analytic fi ndings were at a high or low risk of publication bias (Vevea & Woods, 2005).”
MethodAction and inaction in multi-behaviour recommendations: a meta-analysis of lifestyle interventions
Albarracín, D., Wilson, K., Chan, M. S., Durantini, M. R., & Sánchez, F. (2017) · Health Psychology Review · doi:10.1080/17437199.2017.1369140 · Cited by 41
“Vevea and Woods (2005) defined the probability levels of the intervals of the effect sizes’ p-values that can be assumed to be moderately or severely biased.”
BackgroundMethodInfluentialSanada, K., Zorrilla, E. P., Iwata, Y., Ampudia, C. B., Graff‐Guerrero, A., Martínez‐Cengotitabengoa, M., & González-Pinto, A. M. (2016) · International Journal of Molecular Sciences · doi:10.3390/ijms17101766 · Cited by 36
Understanding the development of bicycling skills in children: A systematic review
Zeuwts, L., Deconinck, F. J. A., Vansteenkiste, P., Cardon, G., & Lenoir, M. (2019) · Safety Science · doi:10.1016/j.ssci.2019.104562 · Cited by 34
How robust is our cumulative knowledge on turnover?
Field, J. G., Bosco, F. A., & Kepes, S. (2020) · Journal of Business and Psychology · doi:10.1007/s10869-020-09687-3 · Cited by 38
Assessing heterogeneity and power in replications of psychological experiments.
Schauer, J. M., & Hedges, L. V. (2020) · Psychological Bulletin · doi:10.1037/bul0000232 · Cited by 35
McAllister, S., Duncan, S. F., & Hawkins, A. J. (2012) · Family Relations · doi:10.1111/j.1741-3729.2012.00736.x · Cited by 34
Chang, D. F., Donald, J. N., Whitney, J. M., Miao, I. Y., & Sahdra, B. K. (2023) · Personality and Social Psychology Bulletin · doi:10.1177/01461672231178518 · Cited by 35
“As a second test for publication bias, we ran the three-parameter selection method (3PSM; Vevea & Woods, 2005).”
The Validity of Conscientiousness Is Overestimated in the Prediction of Job Performance
Kepes, S., & McDaniel, M. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0141468 · Cited by 38
“A priori selection models were conducted in R [42] with the p-value cut-points to model moderate and severe instances of publication bias suggested by Vevea andWoods [41].”
InfluentialHagger, M. S. (2022) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1966824 · Cited by 41
“Advances in selection methods mean they can model heterogeneity in the included effect sizes (e.g. Iyengar & Greenhouse, 1988; Vevea & Hedges, 1995) and effects of moderators (Vevea & Hedges, 1995; Vevea & Woods, 2005).”
McKay, B., Yantha, Z. D., Hussien, J., Carter, M. J., & Ste‐Marie, D. M. (2022) · Meta-Psychology · doi:10.15626/mp.2021.2803 · Cited by 52
Liang, W., Xiang, W., Cheng, S., Jiao, J., Zhu, X., & Duan, Y. (2024) · Sports Medicine - Open · doi:10.1186/s40798-024-00767-9 · Cited by 35
“The weights for the weight function were selected based on those suggested by Vevea and Woods for moderate one-tailed selection [45].”
InfluentialDawtry, R. J., Callan, M. J., Harvey, A. J., & Gheorghiu, A. I. (2020) · Personality and Social Psychology Review · doi:10.1177/1088868320914208 · Cited by 33
“Nevertheless, publication bias cannot be unambiguously ruled out under any circumstances (Vevea & Woods, 2005), and the tests for publication bias reported above should be interpreted with caution due to the relatively small sample size and high levels of unexplained heterogeneity in the data,…”
InfluentialPublication bias in entrepreneurship research: An examination of dominant relations to performance
O’Boyle, E. H., Rutherford, M. W., & Banks, G. C. (2013) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2013.10.001 · Cited by 34
Effects of GenAI Interventions on Student Academic Performance: A Meta-Analysis
Gu, J., & Yan, Z. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251349620 · Cited by 30
“However, Vevea and Woods ’ (2005) selection model revealed minimal adjustment from 0.683 to 0.681.”
InfluentialSiegel, M., Legler, M., Neziraj, F., Goldberg, A. E., & Zemp, M. (2022) · Children · doi:10.3390/children9091364 · Cited by 35
Das, R., Freeman, T. P., & Kamboj, S. K. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.11.018 · Cited by 29
Yeager, D. S., Krosnick, J. A., Visser, P. S., Holbrook, A. L., & Tahk, A. M. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000171 · Cited by 31
“These differences in publication rates can be inputted into the Vevea and Woods (2005) weight-function models to adjust the present study’s meta-analytic effect size estimates.7 We call this approach the behaviorally-informed file-drawer adjustment (BIFDA).”
MethodQuality of Caregiving in Mothers With Illicit Substance Use: A Systematic Review and Meta-analysis
Hatzis, D., Dawe, S., Harnett, P., & Barlow, J. (2017) · Substance Abuse: Research and Treatment · doi:10.1177/1178221817694038 · Cited by 60
“To assess whether the publication bias would differ when adjusted for publication bias, we used the procedure by Vevea and Woods 70 as described in Field and Gillett.”
Pietschnig, J., Gerdesmann, D., Zeiler, M. D., & Voracek, M. (2022) · Royal Society Open Science · doi:10.1098/rsos.211621 · Cited by 31
“based on the four different weight functions from [200]) did not vary considerably (ranging from r = 0.”
BackgroundMoving in the presence of others – a systematic review and meta-analysis on social facilitation
van Meurs, E., Greve, J., & Strauß, B. (2022) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2022.2111663 · Cited by 29
“Publication bias was modeled with the weight function model (https://vevealab.shinyapps.io/ WeightFunctionModel/; Vevea & Woods, 2005).”
Traumatic Life Experience and Pain Sensitization
Nanavaty, N., Thompson, C. G., Meagher, M. W., McCord, C., & Mathur, V. A. (2022) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000001082 · Cited by 32
Lohmann, P. M., Pizzo, A., Bauer, J. M., Khanna, T. M., Flecke, S. L., Callaghan, M., Minx, J. C., & Reisch, L. A. (2026) · Nature Food · doi:10.1038/s43016-025-01279-9 · Cited by 35
“To produce publication bias-adjusted average effects, we used the selection model approach 87 previously developed 28,88 .”
Yang, C., Zhao, W., Yuan, B., Luo, L., & Shanks, D. R. (2022) · Review of Educational Research · doi:10.3102/00346543221094083 · Cited by 34
Zagaria, A., Ottaviani, C., Lombardo, C., & Ballesio, A. (2022) · Annals of Behavioral Medicine · doi:10.1093/abm/kaac064 · Cited by 27
Random-effects meta-analysis of correlations: Monte Carlo evaluation of mean estimators.
Hafdahl, A. (2010) · British Journal of Mathematical & Statistical Psychology · doi:10.1348/000711009x431914 · Cited by 27
A Meta-Analysis and Systematic Review of Foreign Language Anxiety Interventions Among Students
Xiong, Y., Zhang, Q., Zhao, L., Liu, S., Guan, H., Sui, Y., Feng, J., & Lee, K. M. R. (2024) · Journal of Language and Social Psychology · doi:10.1177/0261927x241291258 · Cited by 27
“Applying Vevea and Woods ’ (2005) weight-function model, this study found that the mean effect estimates were downwardly adjusted, implying that statistically non-signi fi cant effects were more likely to be reported than signi fi cant results (g = 3.29 when the cutoff point for p value is between…”
InfluentialFranklin, C., Guz, S., Zhang, A., Kim, J., Zheng, H., Hai, A. H., Cho, Y. J., & Shen, L. (2020) · Journal of the Society for Social Work and Research · doi:10.1086/712169 · Cited by 35
“This conclusion was further confirmed by the Vevea and Woods (2005) sensitivity analysis, which poses a line of the observed average treatment effect size and a line of the theoretical treatment effect size so that the funnel plot is symmetric.”
ResultThe Impact of “Scary” TV and Film on Children's Internalizing Emotions: A Meta-Analysis
Pearce, L. J., & Field, A. P. (2015) · Human Communication Research · doi:10.1111/hcre.12069 · Cited by 27
Meta-analysis of the association between rumination and reduced autobiographical memory specificity
Chiu, C. P., Griffith, J. W., Lenaert, B., Raes, F., Hermans, D., & Barry, T. J. (2018) · Memory · doi:10.1080/09658211.2018.1474928 · Cited by 26
“This was confirmed by Egger’s test (all p’s > .1) and was further confirmed by inspection of Vevea and Woods (2005) adjusted effect sizes accounting for severe twotailed bias, which were similar to the unadjusted effect sizes (Rumination: −.05; Brooding: .006; Reflection: −.066).”
MethodResultWhite, R. M. B., Pasco, M. C., Korous, K. M., & Causadías, J. M. (2019) · Journal of Adolescence · doi:10.1016/j.adolescence.2019.12.005 · Cited by 30
Video games and attitude change: A meta-analysis
Kolek, L., Ropovik, I., Šisler, V., van Oostendorp, H., & Brom, C. (2023) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2023.102225 · Cited by 43
A meta-analysis of memory ability in synaesthesia
Ward, J., Field, A. P., & Chin, T. (2019) · Memory · doi:10.1080/09658211.2019.1646771 · Cited by 24
“Secondly, Vevea and Woods (2005) proposed a method for modelling the potential impact of publication bias by recalculating effect sizes after adding a proportion of hypothetical null results.”
MethodInfluentialThe antecedents of moral identity: A meta-analytic review
Xu, X., Li, M., Kwan, H. K., & Zhang, X. (2023) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09891-8 · Cited by 36
“Additionally, if a funnel plot suggests bias, a trim-and-fill procedure can be used to estimate an average effect size subject to the assumptions of the method to correct for publication bias (Duval & Tweedie, 2000a, b; Vevea & Woods, 2005).”
Bresin, K. (2019) · Psychology of Addictive Behaviors · doi:10.1037/adb0000516 · Cited by 26
Sorting the File Drawer: A Typology for Describing Unpublished Studies
Lishner, D. A. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620979831 · Cited by 24
“…that may be used to investigate the nature of suspected publication bias include subgroup comparison and model-selection analysis (e.g., Borenstein et al., 2009; Coburn & Vevea, 2015; Jin et al., 2014; Lipsey & Wilson, 1993; McKay & McDaniel, 2006; Simonsohn et al., 2014; Vevea & Woods, 2005).”
MethodShakur, T. K. T., North, M. S., Berson, Y., & Oreg, S. (2024) · Personnel Psychology · doi:10.1111/peps.12644 · Cited by 26
Meynadier, J., Malouff, J. M., Schutte, N. S., & Loi, N. M. (2024) · Current Psychology · doi:10.1007/s12144-024-06052-y · Cited by 33
“Additionally, we used selection models (Vevea & Hedges, 1995; Vevea & Woods, 2005) to evaluate whether the results of the meta-analysis are distorted by publication bias.”
Xie, J., Cho, K. W., Wei, T., Xu, J., & Fan, M. (2025) · Learning and Motivation · doi:10.1016/j.lmot.2025.102109 · Cited by 22
Sha, S., Loveys, K., Qualter, P., Shi, H., Krpan, D., & Galizzi, M. M. (2024) · BMC Public Health · doi:10.1186/s12889-024-19153-x · Cited by 23
“Instead, algorithms provide a sensitivity analysis assuming certain parameters, and sometimes these parameters lead to flawed results, e.g., the trim-and-fill algorithm overcorrects under heterogeneity, which was the very assumption of our analysis [53].”
BackgroundHas Stereotype Threat Dissipated Over Time? A Cross-Temporal Meta-AnalysisPreprint
Lewis, N. A., & Michalak, N. M. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/w4ta2 · Cited by 25
The effects of sexual and gender minority stress on relationship functioning: A meta‐analysis
Bresin, K., Nicholas, J. K., Cowand, A., Alacha, H. F., Rodriguez, A. M., & Parrott, D. J. (2023) · Personal Relationships · doi:10.1111/pere.12511 · Cited by 24
Shen, Y., Sun, F., Zhang, A., & Wang, K. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.679541 · Cited by 23
Pinquart, M. (2022) · Infant and Child Development · doi:10.1002/icd.2364 · Cited by 21
Parameters influencing pedestrian injury and severity – A systematic review and meta-analysis
Shrinivas, V., Bastien, C., Davies, H., Daneshkhah, A., & Hardwicke, J. (2022) · Transportation Engineering · doi:10.1016/j.treng.2022.100158 · Cited by 21
“To further confirm publication bias Vevea & Woods [30] proposed a weight-function model that models publication bias using weighted distribution theory; if this test is significant ( p < 0.1) then there is publication bias.”
InfluentialRakes, C. R., Ronau, R. N., Bush, S. B., Driskell, S. O. S., Niess, M. L., & Pugalee, D. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100337 · Cited by 30
Haworth, M., Hoshika, Y., & Killi, D. (2016) · Frontiers in Plant Science · doi:10.3389/fpls.2016.01153 · Cited by 21
“Bias in the dataset was assessed using regression (Egger et al., 1997), rank correlation (Begg and Mazumdar, 1994), trim and fill (Duval and Tweedie, 2000) and weighting analysis of the studies (Vevea and Woods, 2005).”
MethodInfluentialEffect Size Estimation Fromt-Statistics in the Presence of Publication Bias
Ulrich, R., Miller, J. O., & Erdfelder, E. (2018) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000319 · Cited by 20
“…and computationally complex, and the authors say that they may only be successfully applied when the number of studies entering a meta-analysis is large (cf. Hedges & Vevea, 2005; Sutton, Song, Gilbody, & Abrams, 2000; see Vevea & Woods, 2005, for a more parsimonious version of weight models).”
BackgroundMethodInfluentialDuggan, M., & Tressoldi, P. E. (2018) · F1000Research · doi:10.12688/f1000research.14330.2 · Cited by 22
A meta-analysis of teacher well-being: A job demands and resources perspective
Li, Y., Chen, J., Lu, J., & Wang, X. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100719 · Cited by 19
The impact of open educational resources on student achievement: A meta-analysis
Cho, K. W., & Permzadian, V. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2024.102365 · Cited by 29
Sladekova, M., Webb, L. E. A., & Field, A. P. (2022) · Psychological Methods · doi:10.1037/met0000470 · Cited by 18
“While it is true that estimates adjusted for publication bias are commonly used for sensitivity analysis (Carter et al., 2019; Kim et al., 2014; Vevea & Woods, 2005), any identified difference between the adjusted and the original estimate does not contain information which would be indicative of…”
BackgroundMethodInfluentialColes, N. A., Larsen, J. T., Kuribayashi, J., & Kuelz, A. (2019) · Emotion Review · doi:10.1177/1754073919868762 · Cited by 22
“Therefore, per the recommendation of Vevea and Woods (2005), we use these methods as sensitivity analyses of whether bias is a concern rather than definitive tests of the existence or impact of bias (see also Gurevitch, Koricheva, Nakagawa, & Stewart, 2018).”
MethodNot Published Is Not Perished: Addressing Publication Bias in Meta-Analytic Studies in Communication
Sun, Y., & Pan, Z. (2020) · Human Communication Research · doi:10.1093/hcr/hqz015 · Cited by 18
“Further, multiple methods should be used (Banks, Kepes, & Banks, 2012; Vevea & Woods, 2005).”
BackgroundMethodAssessing Functional Relations in Single-Case Designs
Manolov, R., Sierra, V., Solanas, A., & Botella, J. (2014) · Behavior Modification · doi:10.1177/0145445514545679 · Cited by 18
“In that sense, publication bias, as one of the burdens of meta-analysis (Vevea & Woods, 2005), can be dealt with by always computing and reporting effect sizes.”
BackgroundSchizotypy, neuroticism, and saccadic eye movements: New data and meta‐analysis
Thomas, E. H. X., Steffens, M., Harms, C., Rossell, S. L., Gurvich, C., & Ettinger, U. (2020) · Psychophysiology · doi:10.1111/psyp.13706 · Cited by 20
Meta-analysis in Clinical Psychology Research
Field, A. P. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199793549.013.0017 · Cited by 18
Bedi, A., & Sass, M. (2022) · The Journal of Social Psychology · doi:10.1080/00224545.2022.2159302 · Cited by 23
Özdaş, F., & Batdı, V. (2017) · Journal of Education and Training Studies · doi:10.11114/jets.v5i3.2043 · Cited by 17
“In meta-analytic studies, a crucial problem may be that of publication bias in the studies included in the meta-analyses (Rothstein, Sutton & Borenstein, 2005; Vevea & Woods, 2005).”
BackgroundThe Cerebellum Links to Positive Symptoms of Psychosis: A Systematic Review and Meta-analysis
Pinheiro, A. P., Johnson, J. F., Amorim, M., Roberto, M. S., Schwartze, M., Kotz, S. A., & Shenton, M. E. (2021) · Schizophrenia Bulletin Open · doi:10.1093/schizbullopen/sgab039 · Cited by 17
“68 Publication bias was assessed with a funnel plot and complemented with an additional sensitivity analysis 69 following a weight-model function.”
A meta‐analysis of mental rotation in the first years of life
Enge, A., Kapoor, S., Kieslinger, A.-S., & Skeide, M. A. (2023) · Developmental Science · doi:10.1111/desc.13381 · Cited by 18
Relationships of Burnout with Job Attitudes and Turnover Intention among Koreans: A Meta-Analysis
박형인, Yang, E., & 남숙경 (2011) · Korean Journal of Industrial and Organizational Psychology · doi:10.24230/ksiop.24.3.201108.457 · Cited by 20
Multivariate Meta-Analysis: Contributions of Ingram Olkin
Becker, B. J. (2007) · Statistical Science · doi:10.1214/07-sts239 · Cited by 16
“Six additional students are listed who worked with Becker on meta-analytic methods (Chang, 1992; Chiu, 1999; Cho, 2000; Fahrbach, 2001; Schram, 1996; Wu, 2006) and two who were students of Vevea and who have either written dissertations on metaanalysis methods (Hafdahl, 2001) or contributed to the meta-analytic litera…”
Barry, T. J., Yeung, S. P., & Lau, J. Y. F. (2018) · Journal of Adolescence · doi:10.1016/j.adolescence.2018.08.008 · Cited by 18
Li, H., Wang, Z., Ding, L., Zhang, J., & Wang, G. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1635465 · Cited by 19
“Publication bias is the tendency for studies with certain statistically significant or favorable results to be published more frequently, while invalid or less favorable results may be overlooked or ignored (Vevea and Woods, 2005).”
Association between suicidal ideation and burnout: A meta-analysis
Esparza-Reig, J., & Julián, M. (2024) · Death Studies · doi:10.1080/07481187.2023.2300064 · Cited by 17
“This analysis complemented by the Vevea and Hedges weight-function model to address previous methods’ limitations (Vevea & Woods, 2005).”
Prevalence of Publication Bias Tests in Speech, Language, and Hearing Research
Chow, J. C. (2018) · Journal of Speech Language and Hearing Research · doi:10.1044/2018_jslhr-l-18-0098 · Cited by 15
Shi-jie, J., Zhang, A., Chen, Y., Shen, C., Currin-McCulloch, J. A., & Zhu, C. (2021) · Supportive Care in Cancer · doi:10.1007/s00520-021-06166-0 · Cited by 15
Cognitive and academic benefits of music training with children: A multilevel meta-analysisPreprint
Sala, G., & Gobet, F. R. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7s8wr · Cited by 19
Liu, Z., Wen, J., Liu, Y., & Chuan-Peng, H. (2023) · British Journal of Educational Psychology · doi:10.1111/bjep.12636 · Cited by 19
The Intervention Effects on Teacher Well-being: A Three-Level Meta-Analysis
Li, Y., Xiang, W., Chen, J., Lee, J. C., Yan, Z., & Li, J. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09966-y · Cited by 21
“If two tests detect publication bias, we would employ the selection model of Vevea and Woods (2005) for acquiring corrected overall effect size based on publication bias.”
InfluentialPietschnig, J., & Gittler, G. (2017) · Intelligence · doi:10.1016/j.intell.2016.12.006 · Cited by 15
Limited evidence for the effect of red color on cognitive performance: A meta-analysis
Gnambs, T. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01772-1 · Cited by 16
“…bias a Begg and Madzumdar (1994) b Stanley (2017) c Substitutes the sampling variances of d with a function of the sample size (Pustejovsky & Rodner, 2019) d Vevea and Woods (2005) e van Aert and van Assen (2020) in these domains as compared to those studied in the present meta-analysis.”
MethodResultA Generalized Publication Bias ModelPreprint
Schönemann, P. H., & Scargle, J. D. (2008) · arXiv (Cornell University) · doi:10.6129/cjp.2008.5001.02 · Cited by 16
Treatment for Depression in Low-Income Women: A Systematic Review and Meta-Analysis
Corcoran, J., Zhang, A., Watson-Lewis, L., & Johnson, T. (2021) · Journal of the Society for Social Work and Research · doi:10.1086/715212 · Cited by 13
“Additionally, sensitivity analysis for publication bias using a priori weight functions suggested no concern of publication bias (Vevea & Woods, 2005).”
MethodReciprocal altruism in Norway rats
Engelhardt, S. C., & Michael Taborsky, A. (2023) · Ethology · doi:10.1111/eth.13418 · Cited by 13
O’Keefe, K., Chen, M., Lesser, K., DuVall, A. S., & Dils, A. T. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21070881 · Cited by 13
“…of publication bias, both a funnel plot and the Vevea and Woods (2005) sensitivity analysis employing a weight-function model were utilized [27]. pooled treatment effect size was d = 0.19, 95% CI [0.0166, 0.364], and p = 0.0399, indicating a statistically significant treatment effect of…”
MethodInfluentialBrain network: social media and the cognitive scientist
Stafford, T., & Bell, V. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.08.001 · Cited by 13
Donald, J. N., Bradshaw, E. L., Ryan, R. M., Basarkod, G., Ciarrochi, J., Duineveld, J. J., Guo, J., & Sahdra, B. K. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5xnyr · Cited by 15
Breuer, F., Meyhöfer, I., Lencer, R., Sprenger, A., Roesmann, K., Schag, K., Dannlowski, U., & Leehr, E. J. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105840 · Cited by 15
“As it is generally advisable to use several methods to account for potential publication bias (Harrer et al., 2021), we also employed fixed weight selection models (Vevea and Woods, 2005).”
MethodPublication Bias in Meta-Analyses of Posttraumatic Stress Disorder Interventions
Niemeyer, H., van Aert, R. C. M., Schmid, S., Ülsmann, D., Knaevelsrud, C., & Schulte‐Herbrüggen, O. (2020) · Meta-Psychology · doi:10.15626/mp.2018.884 · Cited by 12
Metadata
- Authors
- Vevea, J. L., & Woods, C. M.
- Affiliations
- University of California, Santa Cruz (US)
- Washington University in St. Louis (US)
- ORCID
- Woods, Carol M.
- Venue
- Psychological Methods
- Published
- 2005-12
- Volume
- 10
- Issue
- 4
- Pages
- 428-443
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W1974479479
- Cited by
- 461
- References
- 94
- Citations by year
- 2026: 24 · 2025: 33 · 2024: 35 · 2023: 35 · 2022: 36 · 2021: 41 · 2020: 35 · 2019: 49 · 2018: 33 · 2017: 23 · 2016: 12 · 2015: 22 · 2014: 13 · 2013: 10 · 2012: 11
- FWCI
- 9.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (4r44ag024771-02)
- National Institute on Aging (AG024771)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, file drawer problem, funnel plot asymmetry, meta-analysis, sensitivity analysis, bias detection, fixed effects model, random effects models, mixed models
- MeSH terms
- Data Interpretation, Statistical, Humans, Models, Psychological, Publishing, Research, Research Design, Sensitivity and Specificity, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
