The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Abstract
Publication bias, sometimes known as the "file-drawer problem" or "funnel-plot asymmetry," is common in empirical research. The authors review the implications of publication bias for quantitative research synthesis (meta-analysis) and describe existing techniques for detecting and correcting it. A new approach is proposed that is suitable for application to meta-analytic data sets that are too small for the application of existing methods. The model estimates parameters relevant to fixed-effects, mixed-effects or random-effects meta-analysis contingent on a hypothetical pattern of bias that is fixed independently of the data. The authors illustrate this approach for sensitivity analysis using 3 data sets adapted from a commonly cited reference work on research synthesis (H. M. Cooper & L. V. Hedges, 1994).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To evaluate publication bias, selection modeling was used. This approach used a weight function model created by Vevea and Woods [44], implemented through the weightr package.”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“confirming evidence of selection bias.”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“After adjustment for potential selection bias, the two-step model (P value cutpoints=.025, .50, 1) yielded a smaller and nonsignificant change in the pooled effect (g=0.54, SE=0.26, z=2.10; P=.04, 95% CI 0.04, 1.04).”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“The unadjusted model (k=44) estimated a pooled effect size of g=0.41 (SE=0.10, z=4.24; P<.001, 95% CI 0.22, 0.60).”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“studies with P<.025* were about 3.54 times more likely to be included than those with larger P values”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“suggesting moderate publication bias favoring statistically significant findings”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“The likelihood ratio test comparing adjusted and unadjusted models was significant (χ²2=11.25, P=.004)”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [44]
In the citing paper
“Vevea and Woods’ (2005) selection model calculated a similar estimate (g¯ = 0.119).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Vevea and Woods’ (2005)
In the citing paper
“The selection model estimate was g¯ = 0.039.”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Vevea and Woods’ (2005)
In the citing paper
“Vevea and Woods’ (2005) selection model calculated a more conservative estimate (g¯ = 0.126).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Vevea and Woods’ (2005)
In the citing paper
“Vevea and Woods’ (2005) selection model yielded a similar estimate (g¯ = -0.002).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Vevea and Woods’ (2005)
In the citing paper
“Sensitivity analysis (Vevea and Woods 2005) was also conducted to evaluate and account for the level of publication bias.”
From A meta-analytic review of the efficacy of physical exercise interventions on cognition in individuals with autism spectrum disorder and ADHD (2016) · cites this paper as Vevea and Woods 2005
In the citing paper
“Although the result of Kendall's tau is non-significant, in view of the small number of studies included in the metaanalysis, publication bias cannot be rejected and therefore a sensitivity analysis (Vevea and Woods, 2005) was conducted to estimate and account for the likelihood of publication bias.”
From A meta-analytic review of the efficacy of physical exercise interventions on cognition in individuals with autism spectrum disorder and ADHD (2016) · cites this paper as Vevea and Woods, 2005
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,840
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 2×
“…are surveyed about unpublished work (e.g., Chan, Sacks, & Chalmers, 1982; Coursol & Wagner, 1986; Dickersin, Chan, Chalmers, Sacks, & Smith, 1987; Easterbrook et al., 1991; Misakian & Bero, 1998; Rotton, Foos, Vanmeek, & Levitt, 1995; Scherer, Dickersin, & Langenberg, 1994; Shadish, Doherty, &…”
BackgroundFixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Self-citationA Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955
Research works printed but not linked: 8
- Becker, 1986, Influence again., 178
- Becker, (in press). Failsafe N of file-drawer number., 111
- Chan, 1982, The epidemiology of unpublished randomized control trials., Clinical Research, 30, 234A
- 10.2307/1165375 · DOI
- Givens, 1997b, Statistical Science, 12, 247, 10.1214/ss/1030037958 · DOI
- 10.2307/1164832 · DOI · Paper page
- 10.2307/1164836 · DOI · Paper page
- 10.1001/jama.272.2.158 · DOI · Paper page
Cited by
Sorted by citations
Items 101–200 of 460
A meta-analysis of cognitive therapy for worry in generalized anxiety disorder
Hanrahan, F., Field, A. P., Jones, F. W., & Davey, G. C. L. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.10.008 · Cited by 159
Ma, T., Meter, D. J., Chen, W., & Lee, Y. (2019) · Psychological Bulletin · doi:10.1037/bul0000205 · Cited by 154
Oliveira, S., Roberto, M. S., Veiga-Simão, A. M., & Marques-Pinto, A. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09612-x · Cited by 133
Couples’ Sexual Communication and Dimensions of Sexual Function: A Meta-Analysis
Mallory, A. B., Stanton, A. M., & Handy, A. B. (2019) · The Journal of Sex Research · doi:10.1080/00224499.2019.1568375 · Cited by 138
“Instead, we assessed how much the estimates of corrected effect sizes change in the presence of moderate and severe, one- and two-tailed publication bias using the weights described in Vevea and Woods (2005).”
MethodWorking memory training in typically developing children: A multilevel meta-analysis
Sala, G., & Gobet, F. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01681-y · Cited by 148
Hai, A. H., Franklin, C., Park, S., DiNitto, D. M., & Aurelio, N. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.04.045 · Cited by 139
Understanding the effects of time perspective: A meta-analysis testing a self-regulatory framework.
Baird, H. M., Webb, T. L., Sirois, F. M., & Miller, J. G. (2020) · Psychological Bulletin · doi:10.1037/bul0000313 · Cited by 142
Do Premarital Education Programs Really Work? A Meta‐analytic Study
Fawcett, E. B., Hawkins, A. J., Blanchard, V. L., & Carroll, J. S. (2010) · Family Relations · doi:10.1111/j.1741-3729.2010.00598.x · Cited by 125
Yan, Z., Lao, H., Panadero, E., Fernández‐Castilla, B., Yang, L., & Yang, M. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100484 · Cited by 182
Kuppens, S., Moore, S. C., Gross, V., Lowthian, E., & Siddaway, A. P. (2020) · Development and Psychopathology · doi:10.1017/s0954579419000749 · Cited by 119
“Third, a sensitivity analysis was performed, which applies different a priori weight functions to correct the population effect size estimate for different types and severities of potential publication bias (Vevea & Woods, 2005).”
Collyer, H., Eisler, I., & Woolgar, M. (2020) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-018-1265-2 · Cited by 112
“The potential impact of any publication bias was estimated using a sensitivity analysis using syntax for SPSS and R [39] which computed adjusted estimates of effect size based on models estimating the impact of moderate or severe bias [40].”
MethodAvoiding Bias in Publication Bias Research: The Value of “Null” Findings
Kepes, S., Banks, G. C., & Oh, I. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-012-9279-0 · Cited by 132
“30 may only have a 75 % probability of being included in a meta-analysis (Vevea and Woods 2005).”
BackgroundResultInfluentialZhang, A., Borhneimer, L. A., Weaver, A., Franklin, C., Hai, A. H., Guz, S., & Li, S. (2019) · Journal of Behavioral Medicine · doi:10.1007/s10865-019-00046-z · Cited by 135
Designing Instructional Text in a Conversational Style: A Meta-analysis
Ginns, P., Martin, A. J., & Marsh, H. W. (2013) · Educational Psychology Review · doi:10.1007/s10648-013-9228-0 · Cited by 123
“Tests of bias using Vevea and Woods’ (2005) methods found a moderate departure from the estimated population effect (d=0.54) under moderate one-tailed selection (d=0.35) and severe two-tailed selection (d=0.42), but less of a departure under moderate two-tailed selection (d=0.49).”
BackgroundMethodInfluentialAssociation Between Shame and Posttraumatic Stress Disorder: A Meta‐Analysis
López‐Castro, T., Saraiya, T. C., Smith, K. Z., & Dambreville, N. (2019) · Journal of Traumatic Stress · doi:10.1002/jts.22411 · Cited by 117
“However, to further empirically assess the likelihood of publication bias, we applied four weight functions (Vevea & Woods, 2005) to our dataset: moderate one-tailed selection, severe one-tailed selection, moderate two-tailed selection, and severe two-tailed selection.”
BackgroundMethodInfluentialBartos̆, F., Maier, M., Quintana, D. S., & Wagenmakers, E. (2022) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221109259 · Cited by 122
“Second, selection models can be used with prespecified weight functions to perform a sensitivity analysis under different assumptions about the degree of publication bias (e.g., Mathur & VanderWeele, 2020; Vevea & Woods, 2005).”
Racial discrimination and cortisol output: A meta-analysis
Korous, K. M., Causadías, J. M., & Casper, D. M. (2017) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.09.042 · Cited by 118
Correcting for Publication Bias in a Meta-Analysis with the P-uniform* MethodPreprint
van Aert, R. C. M., & van Assen, M. A. L. M. (2018) · doi:10.31222/osf.io/zqjr9 · Cited by 108
Publication bias as a function of study characteristics.
Coburn, K. M., & Vevea, J. L. (2015) · Psychological Methods · doi:10.1037/met0000046 · Cited by 109
Self-citationComplex problem solving and intelligence: A meta-analysis
Stadler, M. J., Becker, N., Gödker, M., Leutner, D., & Greiff, S. (2015) · Intelligence · doi:10.1016/j.intell.2015.09.005 · Cited by 105
Xiao, S. X., Hashi, E. C., Korous, K. M., & Eisenberg, N. (2019) · Journal of Adolescence · doi:10.1016/j.adolescence.2019.09.003 · Cited by 128
Zhang, A., Franklin, C., Currin-McCulloch, J. A., Park, S., & Kim, J. (2017) · Journal of Behavioral Medicine · doi:10.1007/s10865-017-9888-1 · Cited by 123
HOW EFFECTIVE ARE COURT‐AFFILIATED DIVORCING PARENTS EDUCATION PROGRAMS? A META‐ANALYTIC STUDY
Fackrell, T. A., Hawkins, A. J., & Kay, N. M. (2011) · Family Court Review · doi:10.1111/j.1744-1617.2010.01356.x · Cited by 102
Rubens, S. L., Felix, E. D., & Hambrick, E. P. (2018) · Journal of Traumatic Stress · doi:10.1002/jts.22292 · Cited by 108
Sanada, K., Montero-Marin, J., Barceló-Soler, A., Ikuse, D., Ota, M., Hirata, A., Yoshizawa, A., Hatanaka, R., Valero, M. S., Demarzo, M., et al. (2020) · International Journal of Molecular Sciences · doi:10.3390/ijms21072484 · Cited by 96
“Publication bias was assessed initially through the construction of a funnel plot analysis [61].”
MethodLazarczuk, S. L., Maniar, N., Opar, D. A., Duhig, S. J., SHIELD, A. J., Barrett, R., & Bourne, M. N. (2022) · Sports Medicine · doi:10.1007/s40279-022-01695-y · Cited by 103
“Where Egger’s test indicated statistically significant bias, we used a selection model [40] to compute an adjusted SMD to ensure that our conclusions were robust.”
MethodXie, Y., Kong, Y., Yang, J., & Chen, F. (2018) · Personality and Individual Differences · doi:10.1016/j.paid.2018.11.028 · Cited by 120
Demographics as predictors of suicidal thoughts and behaviors: A meta-analysis
Huang, X., Ribeiro, J. D., Musacchio, K. M., & Franklin, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0180793 · Cited by 93
Vahey, N. A., Nicholson, E., & Barnes-Holmes, D. (2015) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2015.01.004 · Cited by 92
“2 did not display a clear funnel shape even assuming that its effects derived from an unbiased normal population (see Lau, Ioannidis, Terrin, Schmid, & Olkin, 2006; Vevea & Woods, 2005). confidence intervals (see Field & Gillett, 2010; Vevea & Woods, 2005).”
McBreen, M., & Savage, R. S. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09584-4 · Cited by 110
Bresin, K., Mekawi, Y., & Verona, E. (2018) · Psychology of Addictive Behaviors · doi:10.1037/adb0000383 · Cited by 97
“Following Vevea and Woods (2005), we interpreted the results from these analyses by looking at instability in the effect size across the different models.”
The antecedents and consequences of workplace envy: A meta-analytic review
Li, M., Xu, X., & Kwan, H. K. (2021) · Asia Pacific Journal of Management · doi:10.1007/s10490-021-09772-y · Cited by 106
“We also estimated publication bias using the following methods: fail-safe k, Egger’s test, the random-effects trim-and-fill method, and the weight-function model analysis (Vevea & Coburn, 2015; Vevea & Hedges, 1995; Vevea & Woods, 2005).”
MethodThe effect of self-assessment on academic performance and the role of explicitness: a meta-analysis
Yan, Z., Xiang, W., Boud, D. J., & Lao, H. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2021.2012644 · Cited by 173
Reyes, D. L., Dinh, J., Lacerenza, C. N., Marlow, S. L., Joseph, D. L., & Salas, E. (2019) · The Leadership Quarterly · doi:10.1016/j.leaqua.2019.101311 · Cited by 102
Consequences of Workplace Ostracism: A Meta-Analytic Review
Li, M., Xu, X., & Kwan, H. K. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.641302 · Cited by 106
Systematic Review and Meta-Analysis of Correlates of FFMQ Mindfulness Facets
Mattes, J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02684 · Cited by 88
Prosocial modeling: A meta-analytic review and synthesis.
Jung, H., Seo, E., Han, E., Henderson, M. D., & Patall, E. A. (2020) · Psychological Bulletin · doi:10.1037/bul0000235 · Cited by 80
Hosseini, F. S., Majdi, M., Naghshi, S., Sheikhhossein, F., Djafarian, K., & Shab‐Bidar, S. (2020) · Clinical Nutrition · doi:10.1016/j.clnu.2020.11.010 · Cited by 73
Wolters, C., Gerlach, A. L., & Pohl, A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0271717 · Cited by 80
“Sensitivity analysis based on Vevea and Woods [72] revealed minor changes in population effect size estimates (unadjusted rz = -.195) in case Note.”
MethodTipton, E., Bryan, C. J., Murray, J. S., McDaniel, M. A., Schneider, B., & Yeager, D. S. (2023) · Psychological Bulletin · doi:10.1037/bul0000384 · Cited by 90
The Driver Behavior Questionnaire as accident predictor; A methodological re-meta-analysis
af Wåhlberg, A. E., Barraclough, P., & Freeman, J. (2015) · QUT ePrints (Queensland University of Technology) · Cited by 74
Franklin, C., Kim, J. S., Beretvas, S. N., Zhang, A., Guz, S., Park, S., Montgomery, K. L., Chung, S., & Maynard, B. R. (2017) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-017-0235-4 · Cited by 83
The Effectiveness of Psychological Therapies for Anxiety Disorders in Adolescents: A Meta-Analysis
Baker, H. J., Lawrence, P. J., Karalus, J., Creswell, C., & Waite, P. (2021) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-021-00364-2 · Cited by 86
Zhang, A., Wang, K., Zebrack, B., Tan, C. Y., Walling, E., & Chugh, R. K. (2021) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2021.103291 · Cited by 70
“Publication bias was evaluated through both visual examination of funnel plots and the Vevea and Woods sensitivity weighting models (Vevea and Woods, 2005).”
MethodThe relation between narcissism and aggression: A meta‐analysis
Du, T. V., Miller, J. D., & Lynam, D. R. (2021) · Journal of Personality · doi:10.1111/jopy.12684 · Cited by 86
Self-Reported Trait Mindfulness and Couples’ Relationship Satisfaction: a Meta-Analysis
Quinn‐Nilas, C. (2020) · Mindfulness · doi:10.1007/s12671-020-01303-y · Cited by 78
“Vevea and Woods (2005) developed a sensitivity analysis using weighted selection models, where the weights are selected a priori to curtail some of the issues introduced by small sample sizes.”
BackgroundMethodInfluentialHealth-Related Quality of Life of Young People With and Without Chronic Conditions
Pinquart, M. (2020) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsaa052 · Cited by 76
“Funnel plot asymmetry will arise if the magnitude of effect sizes depends upon study characteristics that are not equally distributed, such as kind of chronic condition or country of residence (Vevea and Woods, 2005).”
BackgroundSelf- and Response Efficacy Information in Fear Appeals: A Meta-Analysis
Bigsby, E., & Albarracín, D. (2022) · Journal of Communication · doi:10.1093/joc/jqab048 · Cited by 72
“Of note, we considered implementing robust variance estimates instead of simply averaging effect sizes (Fisher & Tipton, 2015), but these methods have not been implemented for the Vevea and Woods ’ (2005) publication bias analysis we used in this article.”
MethodThe Replication Paradox: Combining Studies can Decrease Accuracy of Effect Size Estimates
Nuijten, M. B., van Assen, M. A. L. M., Veldkamp, C. L. S., & Wicherts, J. M. (2015) · Review of General Psychology · doi:10.1037/gpr0000034 · Cited by 73
“Another procedure that can be used to obtain unbiased effect sizes in the presence of publication bias is selection models (Copas, 2013; Hedges & Vevea, 1996, 2005; Vevea, Clements, & Hedges, 1993; Vevea & Hedges, 1995; Vevea & Woods, 2005).”
Methodde Looff, P. C., Cornet, L. J. M., de Kogel, C. H., Fernández‐Castilla, B., Embregts, P. J. C. M., Didden, R., & Nijman, H. L. I. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.11.003 · Cited by 76
“Therefore, in addition to this, sensitivity analyses were also performed, using the selection method of Vevea and Woods (2005).”
MethodInfluentialAn introduction to meta-analysis for psychotherapy outcome research
Berkeljon, A., & Baldwin, S. A. (2009) · Psychotherapy Research · doi:10.1080/10503300802621172 · Cited by 68
“Although a full discussion of these methods is beyond the scope of this article, readable discussions of these procedures can be found in Sterne et al. (2001) as well as Vevea & Woods (2005).”
MethodPavlacic, J. M., Buchanan, E. M., Maxwell, N. P., Hopke, T. G., & Schulenberg, S. E. (2019) · Review of General Psychology · doi:10.1177/1089268019831645 · Cited by 81
Bryan, A. E. B., & Arkowitz, H. (2015) · American Journal of Community Psychology · doi:10.1007/s10464-015-9718-y · Cited by 67
Benjamin, A. J., Kepes, S., & Bushman, B. J. (2017) · Personality and Social Psychology Review · doi:10.1177/1088868317725419 · Cited by 72
“…battery of methods, including trim-and-fill (Duval, 2005), cumulative meta-analysis by precision (Kepes et al., 2012), selection models (Vevea & Woods, 2005), and PETPEESE (precision-effect test, precision-effect estimate with standard error; Stanley & Doucouliagos, 2014) with a…”
BackgroundMethodResultInfluentialA Guide for Calculating Study-Level Statistical Power for Meta-Analyses
Quintana, D. S. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221147260 · Cited by 95
“Various tools have more recently been developed for detecting and/or correcting for publication bias, such as robust Bayesian meta-analysis (Bartoš et al., 2022), selection models (Maier et al., 2022; Vevea & Woods, 2005), p-curve (Simonsohn et al., 2014), and z-curve (Brunner & Schimmack, 2020).”
MethodDoes Interpersonal Discussion Increase Political Knowledge? A Meta-Analysis
Amsalem, E., & Nir, L. (2019) · Communication Research · doi:10.1177/0093650219866357 · Cited by 68
“We estimated a series of selection models, which use weights to assess the likelihood of a study being published based on a given a priori p-value (Vevea & Woods, 2005).”
MethodIversen, R. K., & Lewis, C. N. (2021) · Autism Research · doi:10.1002/aur.2468 · Cited by 71
“Since there was no sign of publication bias, we did not run a trim-and-fill analysis [Vevea & Woods, 2005].”
MethodRelation between executive functions and screen time exposure in under 6 year-olds: A meta-analysis
Bustamante, J. C., Fernández‐Castilla, B., & Alcaráz-Iborra, M. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107739 · Cited by 84
Lange, F., Brückner, C., Knebel, A., Seer, C., & Kopp, B. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.06.014 · Cited by 60
Meta-analyses of simultaneous interpreting and working memory
Mellinger, C. D., & Hanson, T. A. (2019) · Interpreting International Journal of Research and Practice in Interpreting · doi:10.1075/intp.00026.mel · Cited by 60
Sedikides, C., Gaertner, L., & Vevea, J. L. (2007) · Asian Journal Of Social Psychology · doi:10.1111/j.1467-839x.2007.00212.x · Cited by 71
“We regressed effect sizes on culture, validate and the Culture–Validate interaction, and proceeded to estimate parameters with unconditional maximum likelihood using a program developed for that purpose (Vevea & Hedges, 1995; Vevea & Woods, 2005).”
MethodSelf-citationBolen, R. M., & Gergely, K. B. (2014) · Trauma Violence & Abuse · doi:10.1177/1524838014526307 · Cited by 59
“For example, to be effective, some methods require a larger number of studies (Munafò, Clark, & Flint, 2004; Vevea & Woods, 2005).”
BackgroundMethodThreats to the validity of generalized inferences
Matt, G. E., & Cook, T. D. (2009) · Cited by 59
A meta-analytic investigation of the relation between interpersonal attraction and enacted behavior.
Montoya, R. M., Kershaw, C., & Prosser, J. L. (2018) · Psychological Bulletin · doi:10.1037/bul0000148 · Cited by 62
“The sampling variance was computed with maximum likelihood using a computer program developed for that purpose (Vevea & Woods, 2005).”
MethodTutal, Ö., & Yazar, T. (2021) · Asia Pacific Education Review · doi:10.1007/s12564-021-09706-9 · Cited by 57
Zhang, Q., Zhang, R., Xiong, Y., Sui, Y., Tong, C., & Lin, F.-H. (2025) · Journal of Medical Internet Research · doi:10.2196/78238 · Cited by 56
“This approach used a weight function model created by Vevea and Woods [44], implemented through the weightr package.”
Tod, D., & Edwards, C. (2015) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2015.1052089 · Cited by 56
“Although such a strategy may lead to an overestimation of the combined effect, such a possibility was countered by adopting Vevea and Woods’ (2005) severe two-tailed selection bias model (discussed below).”
MethodInfluentialGeneralization of trim and fill for application in meta‐regression
Weinhandl, E. D., & Duval, S. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1042 · Cited by 59
Meta‐Analysis of the Association Between Autobiographical Memory Specificity and Exposure to Trauma
Barry, T. J., Lenaert, B., Hermans, D., Raes, F., & Griffith, J. W. (2018) · Journal of Traumatic Stress · doi:10.1002/jts.22263 · Cited by 65
Donald, J. N., Bradshaw, E. L., Conigrave, J. H., Parker, P. D., Byatt, L. L., Noetel, M., & Ryan, R. M. (2021) · Psychological Bulletin · doi:10.1037/bul0000338 · Cited by 61
Kunas, S. L., Lautenbacher, L. M., Lueken, U., & Hilbert, K. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.09.092 · Cited by 59
Glišić, M., Raguindin, P. F., Gemperli, A., Taneri, P. E., Salvador, D., Voortman, T., Marques-Vidal, P. M., Papatheodorou, S., Kunutsor, S. K., Bano, A., et al. (2023) · Public health reviews · doi:10.3389/phrs.2023.1605454 · Cited by 57
“Other methods have been developed to address the limitations of existing popular approaches, such as the three-parameter selection model (64), the proportion of statistical significance test (26), and variants thereof.”
MethodRapp, R. C., Noortgate, W. V. D., Broekaert, E., & Vanderplasschen, W. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0036750 · Cited by 58
“Reporting and publication bias are potential sources of uncertainty in any meta-analysis, as they reflect the tendency for available research to favor interventions supported by study authors (Vevea & Woods, 2005).”
MethodSavva, M., Higgins, S., & Beckmann, N. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12623 · Cited by 87
Siegel, M., Eder, J. S. N., Wicherts, J. M., & Pietschnig, J. (2021) · Journal of Applied Psychology · doi:10.1037/apl0000991 · Cited by 65
Endogenous pain modulation in chronic orofacial pain: a systematic review and meta-analysis
Moana-Filho, E. J., Babiloni, A. H., & Theis-Mahon, N. R. (2018) · Pain · doi:10.1097/j.pain.0000000000001263 · Cited by 56
Garcia-Argibay, M., Li, L., Du Rietz, E., Zhang, L., Yao, H., Jendle, J., Ramos-Quiroga, J. A., Ribasés, M., Chang, Z., Brikell, I., et al. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105076 · Cited by 52
“We used a method that is not based on funnel plot asymmetry, namely a one-parameter selection model (Vevea and Woods, 2005) using a half-normal selection function.”
A Systematic Review and Meta-Analysis on the Efficacy of Self-Help Interventions in Tinnitus
Nyenhuis, N., Golm, D., & Kröner‐Herwig, B. (2013) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2013.803496 · Cited by 52
“.05 is .95 (moderate onetailed selection), .90 (severe one-tailed selection), .95 (moderate two-tailed selection), or .90 (severe two-tailed selection; see Vevea and Woods (2005) for the detailed specification of weights).”
BackgroundMethodResultInfluentialStudents’ expected and actual academic achievement – A meta-analysis
Pinquart, M., & Ebeling, M. (2020) · International Journal of Educational Research · doi:10.1016/j.ijer.2019.101524 · Cited by 51
McPhee, G. M., Downey, L. A., & Stough, C. K. K. (2020) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2020.107298 · Cited by 59
Three Decades of Research on Induced Hypocrisy: A Meta-Analysis
Priolo, D., Pelt, A., Saint-Bauzel, R., Rubens, L., Voisin, D., & Fointiat, V. (2019) · Personality and Social Psychology Bulletin · doi:10.1177/0146167219841621 · Cited by 63
“Given the limitations of funnel plot (Vevea & Woods, 2005), we applied the trim and fill method.”
MethodNeglect of publication bias compromises meta-analyses of educational research
Ropovik, I., Adamkovic, M., & Greger, D. (2021) · PLoS ONE · doi:10.1371/journal.pone.0252415 · Cited by 55
“Woods approach [60], one can fit a series of fine-grained step function models where the selection weights are not estimated but defined a prori.”
Mueller, K. F., Meerpohl, J. J., Briel, M., Antes, G., von Elm, E., Lang, B., Motschall, E., Schwarzer, G., & Bassler, D. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.015 · Cited by 48
Fong, C. J., Krou, M. R., Johnston-Ashton, K., Hoff, M. A., Lin, S., & Gonzales, C. (2021) · Educational Research Review · doi:10.1016/j.edurev.2021.100407 · Cited by 64
Fitzgerald, H. E., Hoyt, D. L., Kredlow, M. A., Smits, J. A. J., Schmidt, N. B., Edmondson, D., & Otto, M. W. (2021) · Clinical Psychology: Science and Practice · doi:10.1037/cps0000038 · Cited by 48
Pinquart, M. (2019) · Journal of Traumatic Stress · doi:10.1002/jts.22354 · Cited by 46
A comprehensive meta-analysis of character education programs
Brown, M., McGrath, R. E., Bier, M. C., Johnson, K., & Berkowitz, M. W. (2022) · Journal of Moral Education · doi:10.1080/03057240.2022.2060196 · Cited by 123
“This approach also allows for presetting the distribution of the p intervals, and Vevea and Woods (2005) suggested reasonable estimates for setting these distributions.”
BackgroundPersonality versus traffic accidents; meta-analysis of real and method effects
Wåhlberg, A., Barraclough, P., & Freeman, J. (2017) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2016.10.009 · Cited by 46
“However, these methods are not considered fully reliable (Pham, Platt, McAuley, Klassen & Moher, 2001; Song et al., 2010; Vevea & Woods, 2005), and tend to have low power (Macaskill, Walter & Irwig, 2001; Sterne, Gavaghan & Egger, 2000) and it is therefore preferable to try to actually locate…”
MethodAssociation of Schizotypy With Dimensions of Cognitive Control: A Meta-Analysis
Steffens, M., Meyhöfer, I., Faßbender, K., Ettinger, U., & Kambeitz, J. P. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby030 · Cited by 49
The “other” relationships of self-assessed intelligence: A meta-analysis
Howard, M. C., & Cogswell, J. E. (2018) · Journal of Research in Personality · doi:10.1016/j.jrp.2018.09.006 · Cited by 53
Nordgård, R., & Låg, T. (2021) · Frontiers in Virtual Reality · doi:10.3389/frvir.2021.699383 · Cited by 53
Does FDI promote entrepreneurial activities? A meta-analysis
Hong, S., Reed, W. R., Tian, B., Wu, T., & Chen, G. (2021) · World Development · doi:10.1016/j.worlddev.2021.105436 · Cited by 45
Sayour, A. A., Celeng, C., Oláh, A., Ruppert, M., Merkely, B. P., & Radovits, T. (2021) · Diabetologia · doi:10.1007/s00125-020-05359-2 · Cited by 45
“To correct the population effect estimate for moderate and severe publication bias, a priori weight functions as per Vevea and Woods [34, 35] were applied.”
BackgroundMethodInfluentialSala, G., Burgoyne, A. P., Macnamara, B. N., Hambrick, D. Z., Campitelli, G., & Gobet, F. R. (2017) · Intelligence · doi:10.1016/j.intell.2017.01.013 · Cited by 49
“We thus ran two additional publication bias analyses: (a) selection models (moderate two-tailed selection and severe two-tailed selection; 9 Vevea & Woods, 2005); and (b) PET-PEESE (Stanley & Doucouliagos, 2014).”
MethodPietschnig, J., Siegel, M., Eder, J. S. N., & Gittler, G. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02874 · Cited by 52
“, 2015), a selection model approach (Vevea and Woods, 2005), and PET-PEESE (Stanley and Doucouliagos, 2014).”
BackgroundWilliams, R. T., Citkowicz, M., Miller, D. I., Lindsay, J., & Walters, K. (2022) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2021.2009072 · Cited by 50
“…in more detail, along with results from another selective reporting analysis method (i.e., selection models; Vevea & Hedges, 1995) and sensitivity analyses that explored the consequences of varying magnitudes of selective reporting bias (Mathur & VanderWeele, 2020; see also Vevea & Woods, 2005).”
ResultAssessing Publication Bias: a 7-Step User’s Guide with Best-Practice Recommendations
Kepes, S., Wang, W., & Cortina, J. M. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09840-0 · Cited by 47
“Also, when using Vevea and Wood’s (2005) a priori selection model, the distribution of the p values should be examined, especially when the obtained results do not converge well with the results of other methods.”
BackgroundMethodResultInfluentialKepes, S., Bushman, B. J., & Anderson, C. A. (2017) · Psychological Bulletin · doi:10.1037/bul0000112 · Cited by 50
Zhang, A., Zebrack, B., Acquati, C., Roth, M. E., Levin, N. J., Wang, K., & Schwartz, S. (2021) · Journal of Adolescent and Young Adult Oncology · doi:10.1089/jayao.2021.0012 · Cited by 43
“45 A reasonably symmetric funnel plot—in which both statistically significant and in-significant effect sizes are included and analyzed—is a sign of no publication bias.”
Meta-Analysis of Anxiety in Parents of Young People with Chronic Health Conditions
Pinquart, M. (2019) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsz024 · Cited by 42
Metadata
- Authors
- Vevea, J. L., & Woods, C. M.
- Affiliations
- University of California, Santa Cruz (US)
- Washington University in St. Louis (US)
- ORCID
- Woods, Carol M.
- Venue
- Psychological Methods
- Published
- 2005-12
- Volume
- 10
- Issue
- 4
- Pages
- 428-443
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W1974479479
- Cited by
- 461
- References
- 94
- Citations by year
- 2026: 24 · 2025: 33 · 2024: 35 · 2023: 35 · 2022: 36 · 2021: 41 · 2020: 35 · 2019: 49 · 2018: 33 · 2017: 23 · 2016: 12 · 2015: 22 · 2014: 13 · 2013: 10 · 2012: 11
- FWCI
- 9.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (4r44ag024771-02)
- National Institute on Aging (AG024771)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, file drawer problem, funnel plot asymmetry, meta-analysis, sensitivity analysis, bias detection, fixed effects model, random effects models, mixed models
- MeSH terms
- Data Interpretation, Statistical, Humans, Models, Psychological, Publishing, Research, Research Design, Sensitivity and Specificity, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
