The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods
Open accessPublished version of a preprint
Abstract
Publication bias and questionable research practices in primary research can lead to badly overestimated effects in meta-analysis. Methodologists have proposed a variety of statistical approaches to correct for such overestimation. However, it is not clear which methods work best for data typically seen in psychology. Here, we present a comprehensive simulation study in which we examined how some of the most promising meta-analytic methods perform on data that might realistically be produced by research in psychology. We simulated several levels of questionable research practices, publication bias, and heterogeneity, and used study sample sizes empirically derived from the literature. Our results clearly indicated that no single meta-analytic method consistently outperformed all the others. Therefore, we recommend that meta-analysts in psychology focus on sensitivity analyses—that is, report on a variety of methods, consider the conditions under which these methods fail (as indicated by simulation studies such as ours), and then report how conclusions might change depending on which conditions are most plausible. Moreover, given the dependence of meta-analytic methods on untestable assumptions, we strongly recommend that researchers in psychology continue their efforts to improve the primary literature and conduct large-scale, preregistered replications. We provide detailed results and simulation code at https://osf.io/rf3ys and interactive figures at http://www.shinyapps.org/apps/metaExplorer/ .
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The absence of publication bias is highly unlikely unless a set of preregistered reports is examined (Carter et al. 2019).”
From The gamification of learning: a meta-analysis (2020) · cites this paper as Carter et al. 2019
In the citing paper
“The trim-and-fill method (Duval & Tweedie, 2000) tends to adjust too little when bias is strong (Carter et al., 2019), and Fail-Safe N (Rosenthal, 1979) neither tests nor adjusts for the presence of bias.”
From Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies (2023) · cites this paper as Carter et al., 2019
In the citing paper
“Bias adjustments can improve performance relative to a meta-analysis that does not adjust for publication bias (Carter et al., 2019; McShane et al., 2016; Moreno et al., 2009; Simonsohn et al., 2014).”
From Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies (2023) · cites this paper as Carter et al., 2019
In the citing paper
“negative and statistically significant SPET estimates have been observed in both simulation studies (Carter et al., 2019) and meta-analysis (Hilgard et al., 2019).”
From Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies (2023) · cites this paper as Carter et al., 2019
In the citing paper
“On the one hand, this may be an underestimate of average study power—in simulation studies, p-hacking adds large p values to the p-curve, canceling out the right skew and biasing the p-curve estimate downward (Carter et al., 2019).”
From Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies (2023) · cites this paper as Carter et al., 2019
In the citing paper
“SPET and SPEESE have a downward bias in the presence of p-hacking (Carter et al., 2019)”
From Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies (2023) · cites this paper as Carter et al., 2019
In the citing paper
“There may also be downward bias inflicted by p-hacking (Carter et al., 2019).”
From Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies (2023) · cites this paper as Carter et al., 2019
In the citing paper
“Further, PET-PEESE can underestimate the effect size when there is publication bias and when p-hacking is present (Carter et al., 2019), which are two conditions likely affecting the literature.”
From Managing the terror of publication bias: A comprehensive p-curve analysis of the Terror Management Theory literature (2023) · cites this paper as Carter et al., 2019
In the citing paper
“However, this counterintuitive finding may be explained by the fact that PET is prone to producing imprecise and biased estimates under high heterogeneity, small sample sizes, and a large proportion of p-hacking (Stanley & Doucouliagos, 2014; Stanley 2017; Carter et al., 2019).”
From Managing the terror of publication bias: A comprehensive p-curve analysis of the Terror Management Theory literature (2023) · cites this paper as Carter et al., 2019
In the citing paper
“Simulation studies by Carter et al. (2019) showed that WAAP-WLS can provide a reasonably unbiased estimate of the effect size with a high power to detect the effect given that a true underlying effect exists.”
From Managing the terror of publication bias: A comprehensive p-curve analysis of the Terror Management Theory literature (2023) · cites this paper as Carter et al. (2019)
In the citing paper
“This could lead selection model to underestimate effects in the presence of publication bias and p-hacking, as shown in simulation studies (Carter et al., 2019).”
From Managing the terror of publication bias: A comprehensive p-curve analysis of the Terror Management Theory literature (2023) · cites this paper as Carter et al., 2019
In the citing paper
“Lastly, PET-PEESE can underestimate the size of small effects in the presence of p-hacking and publication bias (Carter et al., 2019).”
From Managing the terror of publication bias: A comprehensive p-curve analysis of the Terror Management Theory literature (2023) · cites this paper as Carter et al., 2019
In the citing paper
“However, when effects are highly heterogeneous and when sample sizes are small, the PET-PEESE analysis is known to yield imprecise estimates (Stanley & Doucouliagos, 2014; Stanley, 2017; Carter et al., 2019).”
From Managing the terror of publication bias: A comprehensive p-curve analysis of the Terror Management Theory literature (2023) · cites this paper as Carter et al., 2019
In the citing paper
“there is a danger that uncritical application can lead to inappropriate conclusions being drawn 68,73,74”
From Investigating and dealing with publication bias and other reporting biases in meta-analyses of health research: a review (2021) · cites this paper as [74]
In the citing paper
“the available evidence suggests that no single method outperforms others in all scenarios”
From Investigating and dealing with publication bias and other reporting biases in meta-analyses of health research: a review (2021) · cites this paper as [74]
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,893
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Ego depletion and the strength model of self-control: a meta-analysis
Hagger, M. S., Wood, C., Stiff, C., & Chatzisarantis, N. L. D. (2010) · Psychological Bulletin · doi:10.1037/a0019486 · Cited by 2,265
Research works printed but not linked: 1
- Augusteijn H. E. M., 2019, Q, 24, 116
Cited by
Sorted by citations
Items 401–500 of 578
Tressoldi, P. E., & Storm, L. (2024) · F1000Research · doi:10.12688/f1000research.51746.3 · Cited by 5
Mack, M., Badache, A. C., Erden, A., Giannaki, C. D., Haider, S., Καλτσάτου, Α., Akik, B. K., Netz, Y., Павлова, Ю., Stavrinou, P. S., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0297348 · Cited by 5
Detecting Evidential Value and P-Hacking With the P-curve tool: A Word of Caution
Erdfelder, E., & Heck, D. W. (2019) · doi:10.23668/psycharchives.2399 · Cited by 5
Math approach training changes implicit identification with math: A close preregistered replication
Batailler, C., Dominique Muller, B., Nurra, C., Rougier, M., & Trouilloud, D. O. (2020) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2020.104059 · Cited by 5
Hosseini-Kivanani, N., Schommer, C., & Leiva, L. A. (2023) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom56612.2023.10472399 · Cited by 5
Wiernik, B. M., Allan, B. A., Cardador, M. T., Caza, B. B., Hofmans, J., & Nye, C. D. (2021) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2021.103529 · Cited by 5
Hurley, P. J. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3794259 · Cited by 5
Obtaining unbiased results in meta-analysis: the importance of correcting for statistical artefactsPreprint
Wiernik, B. M., & Dahlke, J. A. (2019) · doi:10.31234/osf.io/9mpbn · Cited by 5
Dudek, E., & Dodell‐Feder, D. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ensr9 · Cited by 5
A Meta-Analysis on the Autonomic Nervous System Correlates of Human Emotional CryingPreprint
Zickfeld, J., & Grüning, D. J. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/axjd5 · Cited by 6
Bruntsch, M., Cooper, S. E., Abend, R., Boor, M., Chalkia, A., Ehlers, M. R., Czeszumski, A., Johnson, D. C., Klingelhöfer-Jens, M., Morriss, J., et al. (2024) · doi:10.31234/osf.io/unx7w · Cited by 5
Effectiveness of the “But-you-are-free” technique
Fillon, A. A., Souchet, L., Pascual, A., & Girandola, F. (2023) · Meta-Psychology · doi:10.15626/mp.2020.2640 · Cited by 6
Anggoro, B. S., Dewantara, A. H., Suherman, S., Muhammad, R. R., & Saraswati, S. (2024) · Revista de Psicodidáctica · doi:10.1016/j.psicod.2024.500158 · Cited by 4
Lee, Y., Capranica, L., Pesce, C., Guidotti, F., Benzing, V., Hauck, J. L., & Ciaccioni, S. (2025) · PLoS ONE · doi:10.1371/journal.pone.0301949 · Cited by 4
Meta-analysis of advertising effectiveness: New insights from improved bias corrections
Korkames, J., Stanley, T. D., & Stremersch, S. (2022) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2025.04.001 · Cited by 5
Rotella, A., Jung, J., Chinn, C., & Barclay, P. (2026) · Personality and Social Psychology Bulletin · doi:10.1177/01461672251345512 · Cited by 3
Insecure attachment as a predictor of death anxiety: A meta-analysis
Cao, X., Ren, Q., Pan, Y., Zhang, H., Rowe, A. C., & Nascimento, B. D. S. (2025) · Death Studies · doi:10.1080/07481187.2025.2580257 · Cited by 4
Martijn, F. M., Blagden, N., Baguley, T. S., Leroux, E. J., Mackay, J., & Seto, M. C. (2025) · Clinical Psychology Review · doi:10.1016/j.cpr.2025.102690 · Cited by 4
Knight, R., Valappil, A. C., Bruton, A. M., & Greene, A. (2026) · Sports Biomechanics · doi:10.1080/14763141.2025.2603396 · Cited by 4
Long-term prognosis of low language proficiency in children
Hagen, Å. M. M., Rogde, K., Lervåg, A., Melby‐Lervåg, M., & Norbury, C. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015268 · Cited by 4
Majeed, R., Hamilton, K., Watts, G. F., & Hagger, M. S. (2024) · Social Science & Medicine · doi:10.1016/j.socscimed.2024.116968 · Cited by 4
Bateman, S. P., Meléndez‐Torres, G. J., Harris, D., Buckingham, G., Wilson, M., & Vine, S. J. (2026) · Educational Research Review · doi:10.1016/j.edurev.2026.100824 · Cited by 4
A p ‐curve analysis of the emotional Stroop effect among women with eating disorders
Enouy, S., Desrochers, J., Bossom, I. R. L., & Tabri, N. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23807 · Cited by 4
Botella, J., Suero, M., Durán, J. I., & Blazquez, D. (2021) · Anales de Psicología · doi:10.6018/analesps.433051 · Cited by 6
Marcu, G. M., Dumbravă, A., Bacila, C. I., Szekely‐Copîndean, R. D., & Zăgrean, A. (2023) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-023-09610-5 · Cited by 4
Allen, D., Scarinci, N., & Hickson, L. M. H. (2019) · Emerging Adulthood · doi:10.1177/2167696819883458 · Cited by 4
Bartos̆, F., Maier, M., Stanley, T. D., & Wagenmakers, E. (2022) · doi:10.31234/osf.io/d9vcg · Cited by 4
Holgado, D., Sanabria, D., Perales, J. C., & Vadillo, M. A. (2019) · doi:10.31236/osf.io/9dhb7 · Cited by 4
Action Effects on Visual Perception of Distances: A Multilevel Bayesian Meta-AnalysisPreprint
Molto, L., Nalborczyk, L., Palluel-Germain, R., & Morgado, N. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2zutq · Cited by 4
Lehtonen, M., Soveri, A., Laine, A., Järvenpää, J., de Bruin, A., & Antfolk, J. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/vwcgu · Cited by 4
Gonzalez‐Barrero, A. M., Ben, R. D., Killam, H., & Byers‐Heinlein, K. (2021) · doi:10.31234/osf.io/5dvx8 · Cited by 4
Mather, E., & Lindsay, S. (2025) · Infant and Child Development · doi:10.1002/icd.70019 · Cited by 3
Kim, Y., Kim, Y.-C., & Zhu, X. (2025) · Communication Research · doi:10.1177/00936502251403310 · Cited by 3
Zhu, T., & Liu, S. (2026) · Learning and Motivation · doi:10.1016/j.lmot.2026.102243 · Cited by 4
Seductive Details, Cognitive Load, and Learning Outcomes: A Multi-level Meta-analysis and MASEM
Cheng, C., Wu, Y., Wang, R., & Wang, Z. (2026) · Educational Psychology Review · doi:10.1007/s10648-025-10099-z · Cited by 3
Lauterbach, A. S., & Borge, R. H. (2026) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.70099 · Cited by 3
Investigating the ease-of-retrieval effect in an eyewitness context
Groncki, R., Beaudry, J. L., & Sauer, J. D. (2021) · Memory · doi:10.1080/09658211.2021.1882502 · Cited by 3
Suero, M., Botella, J., Durán, J. I., & Blázquez-Rincón, D. (2025) · Behavior Research Methods · doi:10.3758/s13428-024-02554-6 · Cited by 3
Adjusting for Publication Bias in Meta-Analysis with Continuous Outcomes: A Comparative Study
Almalik, O. (2025) · Mathematics · doi:10.3390/math13213487 · Cited by 3
Jost, L., Luttmann, C., & Jansen, P. (2024) · International Journal of Sport and Exercise Psychology · doi:10.1080/1612197x.2023.2262491 · Cited by 3
Ambrosini, E., Benavides‐Varela, S., Visalli, A., Viviani, G., & Montefinese, M. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1435338 · Cited by 3
Meta-analyzing nonpreregistered and preregistered studies.
van Aert, R. C. M. (2025) · Psychological Methods · doi:10.1037/met0000719 · Cited by 3
Proceedings from the 9th European Congress of Methodology
Baeza, A. M. H. (2021) · Universitat de València eBooks · doi:10.7203/puv-oa-438-5 · Cited by 4
Interim design analysis using Bayes factor forecasts.
Stefan, A. M., Gronau, Q. F., & Wagenmakers, E. (2024) · Psychological Methods · doi:10.1037/met0000641 · Cited by 5
The lack of robust evidence for cleansing effects
Ropovik, I., Sparacio, A., & IJzerman, H. (2021) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20000448 · Cited by 3
Tressoldi, P. E., & Storm, L. (2020) · F1000Research · doi:10.12688/f1000research.24868.1 · Cited by 3
Dissertation R.C.M. van AertPreprint
van Aert, R. C. M. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/eqhjd · Cited by 3
Deep learning for robust meta-analytic estimationPreprint
Carter, E. C. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/zad47 · Cited by 3
Self-citationPublication Bias in Meta-Analyses from Psychology and Medicine: A Meta-Meta-AnalysisPreprint
van Aert, R. C. M., Wicherts, J. M., & van Assen, M. A. L. M. (2017) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/czdp3 · Cited by 4
Wartenberg, G., Aldrup, K., Grund, S., & Klusmann, U. (2026) · Review of Educational Research · doi:10.3102/00346543261455273 · Cited by 2
Making Null Results Credible: An Overview of Design and Analytical Tools
Favero, N., Belardinelli, P., Zhu, L., & Lahey, J. (2025) · Journal of Behavioral Public Administration · doi:10.30636/jbpa.81.404 · Cited by 2
Meta-analyses in management and marketing: Current practices and inferential consequences
Wu, W., & Reed, W. R. (2026) · Australian Journal of Management · doi:10.1177/03128962261443442 · Cited by 2
Behavioral activation for depression: A comprehensive systematic review and meta-analysis
Cuijpers, P. J., Čihařová, M., Tong, L., Liu, Y., Sprenger, A. A., Miguel, C., Karyotaki, E., & Harrer, M. (2026) · Clinical Psychology Review · doi:10.1016/j.cpr.2026.102783 · Cited by 2
Integrating exploration and prediction in computational psychotherapy science: proof of concept
Fisher, H., Stone, S. J., Zilcha‐Mano, S., Goldstein, P., & Anderson, T. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1274764 · Cited by 2
A multiverse meta-analysis of oxytocin administration studies
Kang, H., Deilhaug, E., Walle, K. M., Sartorius, A. M., & Quintana, D. S. (2025) · Biological Psychology · doi:10.1016/j.biopsycho.2025.109112 · Cited by 2
Plate Clearing and Body Mass Index: A Meta‐Analysis
Meule, A., Dietlmeier, L., & Kolar, D. R. (2026) · Obesity Science & Practice · doi:10.1002/osp4.70118 · Cited by 2
Belonging and Marital Perception Variances in Emerging Adults With Differing Disability Identities
Long, O., & Chalk, H. M. (2020) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn25.1.22 · Cited by 3
Young, S. S., & Kindzierski, W. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05337 · Cited by 2
Interventionsdesign, Evaluationsverfahren und Wirksamkeit von Interventionen
Reis, D., & Meier, L. L. (2021) · Springer eBooks · doi:10.1007/978-3-658-28654-5_24-1 · Cited by 2
Remedies for three common issues in meta-analysisPreprint
Quintana, D. S. (2018) · doi:10.31219/osf.io/5skuv · Cited by 2
Fillon, A. A., Souchet, L., Pascual, A., & Girandola, F. (2020) · doi:10.31234/osf.io/3ds26 · Cited by 2
Examining Psychological Science through Systematic Meta-Method Analysis: A Call for ResearchPreprint
Elson, M. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/cfbzt · Cited by 2
Examining Psychological Science through Systematic Meta-Method Analysis: A Call for ResearchPreprint
Elson, M. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/cj7xf · Cited by 2
Suppression-induced forgetting of complex aversive scenes - A replication and meta-analysisPreprint
Meyer, A.-K., & Benoit, R. G. (2023) · doi:10.31234/osf.io/njbc8 · Cited by 2
Chernikova, O., Jansen, T., Sailer, M., & Greiff, S. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102468 · Cited by 2
León, S. P., Garrido, M. G., Martínez, I. G., & Lipnevich, A. A. (2025) · doi:10.35542/osf.io/c5qsr_v1 · Cited by 2
Mesquida, C., Warne, J. P., & Lakens, D. (2025) · doi:10.51224/srxiv.576 · Cited by 2
Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis
Mihaylova, M., Zocca, M., Kliegel, M., & Rothen, N. (2025) · Swiss Psychology Open · doi:10.5334/spo.101 · Cited by 1
The effectiveness of implementation intentions in children: A systematic review and meta‐analysis
Breitwieser, J., & Reinelt, T. (2026) · British Journal of Psychology · doi:10.1111/bjop.70065 · Cited by 1
Saved by the biodata: Meta-analytic relationships between biodata scores and student success
Speer, A. B., Tenbrink, A. P., Wegmeyer, L. J., & Sendra, C. C. (2023) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2023.103863 · Cited by 2
Weng, W., Hammer, J. H., Sadek, S. M., Aspiranti, K. B., Miller, M. E., & Stanley, A. A. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119427 · Cited by 1
The role of meta-analysis and preregistration in assessing the evidence for cleansing effects
Ross, R. M., van Aert, R. C. M., van den Akker, O. R., & van Elk, M. (2021) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20000606 · Cited by 2
Interpersonal Psychotherapy for Depression in Low- and Middle-Income Countries
Cuijpers, P. J. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197652084.003.0004 · Cited by 2
Hall, J. A., & Miller, D. I. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123.028 · Cited by 1
Construct validity of the Child Abuse Potential Inventory: A meta-analytic review
Milner, J. S., Ammar, J., Gibson, C., Menon, S. V., & Crouch, J. L. (2025) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2025.107586 · Cited by 1
What is Humility Good For? A Meta-Analysis of Humility, Health, and Well-Being
Lee, Y., McLaughlin, A. T., Bowes, S. M., Hook, J. N., Tongeren, D. R. V., Owen, J. J., & Davis, D. E. (2025) · The Counseling Psychologist · doi:10.1177/00110000251352566 · Cited by 3
Interpretation Biases in Anxiety: A Three-Level Meta-Analysis
Würtz, F., Kunna, M., Blackwell, S. E., Lindgraf, C., Abado, E., Amanvermez, Y., Margraf, J., Everaert, J., & Woud, M. L. (2026) · Clinical Psychological Science · doi:10.1177/21677026251392855 · Cited by 1
Replicating the unconscious working memory effect: a multisite Registered Report
Franco-Martínez, A., Rey-Sáez, R., Adrián‐Ventura, J., Amerio, P., Baciero, A., Bennis, A., Bergström, F., Axel Cleeremans, B., Contu, L., Dell’Acqua, R., et al. (2025) · Neuroscience of Consciousness · doi:10.1093/nc/niaf046 · Cited by 1
García-Valverde, A., Rubio‐Arias, J. Á., Oliva‐Lozano, J. M., Ribeiro, T. D., & Muyor, J. M. (2025) · Cultura Ciencia y Deporte · doi:10.12800/ccd.v20i66.2261 · Cited by 1
Williams, C. Y., Xie, Q., Muratoglu, E., & Goldberg, S. B. (2026) · Current Psychology · doi:10.1007/s12144-025-08981-8 · Cited by 1
Rethinking the link between cognitive control and emotion regulation: A meta-analytic review
Schulze, K., Mueller, I., Holt, D. V., Putz, S., Barnow, S., & Pruessner, L. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106708 · Cited by 1
Affective priming from briefly presented facial expressions: a three-level and network meta-analysis
Zhou, Y., Yangyang, T. I. A. N., Cui, Q., Yang, Y., & Jiang, Z. (2026) · BMC Psychology · doi:10.1186/s40359-026-04643-x · Cited by 1
Qu, W., Chang, Y., & Fan, H. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1856476 · Cited by 1
Poecze, F., & Tjoa, A. M. (2020) · International Conference on Informatics and Computational Sciences (ICICoS) · doi:10.1109/icicos51170.2020.9299055 · Cited by 1
Making our “meta-hypotheses” clear: heterogeneity and the role of direct replications in science
Strømland, E. (2021) · European Journal for Philosophy of Science · doi:10.1007/s13194-021-00348-7 · Cited by 1
What Is Meant by ‘Bias’ in Psychological Science?
Frisby, C. L. (2023) · Springer eBooks · doi:10.1007/978-3-031-29148-7_2 · Cited by 2
The inconsistency of p-curve: Testing its reliability using the power pose and HPA debates
Montoya, R. M., Kershaw, C., & Jurgens, C. T. (2024) · PLoS ONE · doi:10.1371/journal.pone.0305193 · Cited by 1
Protocol for a meta-analysis of stereotype threat in African Americans
Warne, R. T., & Larsen, R. (2024) · PLoS ONE · doi:10.1371/journal.pone.0306030 · Cited by 1
Publication Bias in Academic Decision-Making in Clinical Psychology
Schiekiera, L., Eichel, K., Heßelmann, F., Sachse, J., Müller, S. P., & Niemeyer, H. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251372134 · Cited by 1
Learning R Programming Language With Psi Chi
Staples, A. M., & Wagge, J. (2020) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn25.1.85 · Cited by 1
Infinite diameter confidence sets in Hedges’ publication bias model
Moss, J. (2022) · Journal of the Korean Statistical Society · doi:10.1007/s42952-022-00169-1 · Cited by 1
A meta-analysis on study and sample characteristics modulating mock earwitness performance
Leue, A., & Wichert, P. (2024) · Psychological Research · doi:10.1007/s00426-024-01991-4 · Cited by 1
Heterogeneity of research results: New perspectives on psychological science
Linden, A. H. (2019) · Northumbria Research Link (Northumbria University) · Cited by 1
Duggan, M., & Tressoldi, P. E. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3097702 · Cited by 1
Vicarious Dissonance : Meta-analysisPreprint
Jaubert, S., Fillon, A. A., Souchet, L., & Girandola, F. (2020) · doi:10.31234/osf.io/hc2n3 · Cited by 1
Körner, R., Röseler, L., & Schütz, A. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620984474 · Cited by 2
Science Abstract Model Simulation FrameworkPreprint
Abdol, A. M., & Wicherts, J. M. (2021) · doi:10.31234/osf.io/zy29t · Cited by 1
Hurley, P. J. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/hcq9e · Cited by 1
Self-Reported Trait Mindfulness and Couples’ Relationship Satisfaction: A Meta-AnalysisPreprint
Quinn‐Nilas, C. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/vfxwe · Cited by 1
Rotella, A., Jung, J., Chinn, C., & Barclay, P. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tmhe9 · Cited by 2
Metadata
- Authors
- Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J.
- Affiliations
- DEVCOM Army Research Laboratory (US)
- Ludwig-Maximilians-Universität München (DE)
- University of Kentucky (US)
- Illinois State University (US)
- Corresponding author
- Carter, Evan C.
- Venue
- Advances in Methods and Practices in Psychological Science
- Publisher
- SAGE Publications
- Published
- 2019-06
- Volume
- 2
- Issue
- 2
- Pages
- 115-144
- ISSN
- 2515-2459 (ISSN-L)
- 2515-2467
- OpenAlex
- W2781957993
- Cited by
- 588
- References
- 76
- Citations by year
- 2026: 43 · 2025: 60 · 2024: 69 · 2023: 86 · 2022: 83 · 2021: 87 · 2020: 79 · 2019: 54
- FWCI
- 50.69
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Advances in Methods and Practices in Psychological Science (publishedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- publication bias, questionable research practices, effect size overestimation, meta-analytic methods, sensitivity analysis, heterogeneity, simulation study, pre-registered replication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
