Improving transparency and replication in Bayesian statistics: The WAMBS-Checklist.
Open accessThe DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
Abstract
Bayesian statistical methods are slowly creeping into all fields of science and are becoming ever more popular in applied research. Although it is very attractive to use Bayesian statistics, our personal experience has led us to believe that naively applying Bayesian methods can be dangerous for at least 3 main reasons: the potential influence of priors, misinterpretation of Bayesian features and results, and improper reporting of Bayesian results. To deal with these 3 points of potential danger, we have developed a succinct checklist: the WAMBS-checklist (When to worry and how to Avoid the Misuse of Bayesian Statistics). The purpose of the questionnaire is to describe 10 main points that should be thoroughly checked when applying Bayesian analysis. We provide an account of "when to worry" for each of these issues related to: (a) issues to check before estimating the model, (b) issues to check after estimating the model but before interpreting results, (c) understanding the influence of priors, and (d) actions to take after interpreting results. To accompany these key points of concern, we will present diagnostic tools that can be used in conjunction with the development and assessment of a Bayesian model. We also include examples of how to interpret results when "problems" in estimation arise, as well as syntax and instructions for implementation. Our aim is to stress the importance of openness and transparency of all aspects of Bayesian estimation, and it is our hope that the WAMBS questionnaire can aid in this process. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the relative novelty of conducting Bayesian analyses in applied fields means that there are no detailed reporting standards, and this in turn may frustrate the broader adoption and proper interpretation of the Bayesian framework.”
From The JASP guidelines for conducting and reporting a Bayesian analysis (2021) · cites this paper as Depaoli & Schoot, 2017
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949 · cited 1×
“7 The idea behind the Gibbs sampler is that the conditional distribution of one set of parameters given other sets can be used to make random draws of parameter values (see for more information about the Gibbs sampler: Geman & Geman, 1984; Casella & George, 1992).”
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627 · cited 1×
“Another method that can be used to examine the similarity of results obtained across models with two sets of priors specified is to use the Gelman and Rubin (1992a, 1992b) convergence diagnostic.”
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility
Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000) · Statistics and Computing · doi:10.1023/a:1008929526011 · Cited by 5,368
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
Multilevel and Longitudinal Modeling Using Stata
(2006) · Biometrics · doi:10.1111/j.1541-0420.2006.00588_16.x · Cited by 4,236 · cited 1×
“Further, some models (e.g., mixture or multilevel models) require Bayesian methods to improve convergence issues (Depaoli & Clifton, 2015; Skrondal & Rabe-Hesketh, 2012), aid in model identification (Kim, Suh, Kim, Albanese, & Langer, 2013), and produce more accurate parameter estimates (Depaoli,…”
Gelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050
Casella, G., & George, E. I. (1992) · The American Statistician · doi:10.1080/00031305.1992.10475878 · Cited by 2,364 · cited 1×
“7 The idea behind the Gibbs sampler is that the conditional distribution of one set of parameters given other sets can be used to make random draws of parameter values (see for more information about the Gibbs sampler: Geman & Geman, 1984; Casella & George, 1992).”
On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)
Richardson, S., & Green, P. J. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00095 · Cited by 1,898
Cited by
Bayesian statistics and modelling
van de Schoot, R., Depaoli, S., King, R., Kramer, B., Märtens, K., Tadesse, M. G., Vannucci, M., Gelman, A., Veen, D., Willemsen, J., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-020-00001-2 · Cited by 1,176
Self-citationThe JASP guidelines for conducting and reporting a Bayesian analysis
van Doorn, J., van den Bergh, D., Böhm, U., Dablander, F., Derks, K., Draws, T., Etz, A., Evans, N. J., Gronau, Q. F., Haaf, J. M., et al. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01798-5 · Cited by 1,114
Brysbaert, M. (2019) · Journal of Cognition · doi:10.5334/joc.72 · Cited by 996
On Using Bayesian Methods to Address Small Sample Problems
McNeish, D. (2016) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2016.1186549 · Cited by 570
“…advantages of Bayesian methods over frequentist maximum likelihood (ML) methods with small samples (e.g., Baldwin & Fellingham, 2013; Depaoli, 2013; Depaoli & van de Schoot, 2015; Dunson, 2000; Gelman, 2006; Hox, van de Schoot, & Matthijsse, 2012; Kadane, 2015; Lambert, Sutton, Burton, Abrams, &…”
MethodBayesian Analysis Reporting Guidelines
Kruschke, J. K. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01177-7 · Cited by 440
Modeling Clustered Data with Very Few Clusters
McNeish, D., & Stapleton, L. M. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1167008 · Cited by 430
A systematic review of Bayesian articles in psychology: The last 25 years.
van de Schoot, R., Winter, S. D., Ryan, O., Zondervan-Zwijnenburg, M., & Depaoli, S. (2017) · Psychological Methods · doi:10.1037/met0000100 · Cited by 374
Self-citationNguyen, M.-H., & Jones, T. E. (2022) · Humanities and Social Sciences Communications · doi:10.1057/s41599-022-01441-9 · Cited by 286
“…complement this weakness as “Bayesian statistics is not based on large samples (i.e., the central limit theorem) and hence may produce reasonable results even with small to moderate sample sizes, especially when strong and defensible prior knowledge is available” (Depaoli and Van de Schoot, 2017).”
BackgroundSmid, S. C., McNeish, D., Miočević, M., & van de Schoot, R. (2020) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2019.1577140 · Cited by 280
“This demonstrates the relevance of investigating the impact of specified prior distributions on the posterior by performing a sensitivity analysis (see for instructions Depaoli & van de Schoot, 2017).”
Leitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., et al. (2023) · Social Science Research · doi:10.1016/j.ssresearch.2022.102805 · Cited by 271
“5 For an introduction and overview of Bayesian (SEM) analysis, we refer the interested reader to Depaoli (2021 The BAMI method provides a model that allows comparing latent variables across (many) groups while allowing for some “ wiggle room ” to accommodate minor differences in intercept and…”
Public perceptions of autonomous vehicle safety: An international comparison
Moody, J., Bailey, N., & Zhao, J. (2020) · Safety Science · doi:10.1016/j.ssci.2019.07.022 · Cited by 239
Editorial: Enhancing quantitative theory-testing entrepreneurship research
Anderson, B. S., Wennberg, K. J., & McMullen, J. S. (2019) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2019.02.001 · Cited by 184
Depaoli, S. A., Winter, S. D., & Visser, M. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.608045 · Cited by 171
“For more information on convergence and chain length, please see Sinharay (2004) or Depaoli and van de Schoot (2017).”
BackgroundInfluentialSelf-citationBayesian Meta-Analysis with Weakly Informative Prior Distributions
Williams, D. R., Rast, P., & Bürkner, P. C. (2018) · doi:10.31234/osf.io/7tbrm · Cited by 124
“Finally, since inference can be viewed as what would follow from the assumptions, all must be clearly articulated and justified (Depaoli & van de Schoot, 2017).”
BackgroundGoing Beyond Convergence in Bayesian Estimation: Why Precision Matters Too and How to Assess It
Zitzmann, S., & Hecht, M. (2019) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2018.1545232 · Cited by 122
“This is particularly interesting because Depaoli and van de Schoot (2017) warned readers against the naive use of MCMC methods.”
BackgroundZondervan-Zwijnenburg, M. A. J., Peeters, M., Depaoli, S. A., & van de Schoot, R. (2017) · Research in Human Development · doi:10.1080/15427609.2017.1370966 · Cited by 138
Self-citationEfficient Bayesian Structural Equation Modeling in Stan
Merkle, E. C., Fitzsimmons, E., Uanhoro, J., & Goodrich, B. (2021) · Journal of Statistical Software · doi:10.18637/jss.v100.i06 · Cited by 154
“…likelihood and least squares methods are most popular, Bayesian approaches to SEM and related models have received increased recent attention (e.g., Depaoli and van de Schoot 2017; Fox 2010; Jackman 2009; Kaplan 2014; Kruschke 2011; MacCallum, Edwards, and Cai 2012; Merkle and Wang 2018; Muthén…”
MethodModeling Latent Change Score Analysis and Extensions in Mplus: A Practical Guide for Researchers
Klopack, E. T., & Wickrama, K. (. A. S. ). (2020) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2018.1562929 · Cited by 102
“Researchers using Bayesian statistics should pay particular attention to the influence of prior specification and should be explicit in reporting the choices and issues that arise in their analysis (Depaoli & van de Schoot, 2017).”
MethodHoofs, H., van de Schoot, R., Jansen, N., & Kant, I. (2017) · Educational and Psychological Measurement · doi:10.1177/0013164417709314 · Cited by 127
“A BCONVERGENCE of 0.01 will, as such, result in the requirement that PSR values are below 1.02 instead of 1.10 with the default convergence criterion of 0.05 (Depaoli & Van de Schoot, 2017).”
InfluentialA review of issues about null hypothesis bayesian testing
Tendeiro, J. N., & Kiers, H. A. L. (2019) · Psychological Methods · doi:10.1037/met0000221 · Cited by 77
“…Bayesian analyses as it would be preferable (van de Schoot, Winter, Ryan, ZondervanZwijnenburg, & Depaoli, 2017), it is a valuable means of ascertaining the effect of the choice of the within-model prior on the Bayes factor and it should be routinely reported (e.g., Depaoli & van de Schoot, 2017).”
MethodAcquiring the Lexicon and Grammar of Universal Kinship
Blythe, J., Tunmuck, J., Mitchell, A., & Rácz, P. (2020) · Language · doi:10.1353/lan.2020.0044 · Cited by 96
Racial differences in institutional trust and COVID-19 vaccine hesitancy and refusal
Bagasra, A. B., Doan, S. C., & Allen, C. T. (2021) · BMC Public Health · doi:10.1186/s12889-021-12195-5 · Cited by 99
“6 software program [32] and following current best practices in Bayesian inference [33] to examine the concurrent effects of demographics and trust on vaccination hesitancy and refusal, respectively.”
MethodMcNeish, D. (2017) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2017.1280797 · Cited by 119
A multilevel investigation of predictors and outcomes of shared leadership
Klasmeier, K. N., & Rowold, J. (2020) · Journal of Organizational Behavior · doi:10.1002/job.2477 · Cited by 120
Predicting Early-Childhood Gender Transitions
Rae, J. R., Gülgöz, S., Durwood, L., DeMeules, M., Lowe, R. S., Lindquist, G., & Olson, K. R. (2019) · Psychological Science · doi:10.1177/0956797619830649 · Cited by 97
van de Schoot, R., Sijbrandij, M., Depaoli, S., Winter, S. D., Olff, M., & van Loey, N. E. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1412293 · Cited by 85
“This example follows the steps of the WAMBS-checklist (When to Worry and How to Avoid the Misuse of Bayesian Statistics; Depaoli & van de Schoot, 2017), which was used to ensure each phase of the Bayesian analysis was conducted thoroughly and correctly.”
InfluentialSelf-citationA Comparison of CFA, ESEM, and BSEM in Test Structure Analysis
Xiao, Y., Liu, H., & Hau, K. (2019) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2018.1562928 · Cited by 103
“We should be aware that all the benefits of BSEM are probably at the cost of the correctly specified priors (Depaoli & van de Schoot, 2017; Zondervan-Zwijnenburg, Peeters, Depaoli, & Van de Schoot, 2017).”
BackgroundMethodInfluentialBayesian Methods in Cognitive Modeling
Lee, M. D. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn502 · Cited by 79
Berweger, B., Born, S., & Dietrich, J. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2021.101546 · Cited by 89
Statistical modeling methods: challenges and strategies
Henley, S. S., Golden, R. M., & Kashner, T. M. (2019) · Biostatistics & Epidemiology · doi:10.1080/24709360.2019.1618653 · Cited by 87
The Bayesian Revolution in Second Language Research: An Applied Approach
Norouzian, R., de Miranda, M., & Plonsky, L. (2018) · Language Learning · doi:10.1111/lang.12310 · Cited by 75
“They just don't understand us”: The role of felt understanding in intergroup relations.
Livingstone, A. G., Fernández Rodríguez, L., & Rothers, A. (2020) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000221 · Cited by 67
Two-Level Dynamic Structural Equation Models with Small Samples
McNeish, D. (2019) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2019.1578657 · Cited by 78
“However, diffuse priors have been shown to have unintended consequences with smaller samples sizes (Depaoli & van de Schoot, 2017; McNeish, 2016a, 2017; Zondervan-Zwijnenburg, Peeters, Depaoli, & van de Schoot, 2017).”
BackgroundMaking ERP research more transparent: Guidelines for preregistration
Paul, M., Govaart, G., & Schettino, A. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.02.016 · Cited by 71
A review of some emergent quantitative analyses in sport and exercise psychology
Myers, N. D., Ntoumanis, N., Gunnell, K. E., Gucciardi, D. F., & Lee, S. (2017) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2017.1317356 · Cited by 71
Papastathopoulos, A., Ahmad, S. Z., Sabri, N. A., & Kaminakis, K. (2019) · Journal of Travel Research · doi:10.1177/0047287519874131 · Cited by 78
Predicting limiting ‘free sugar’ consumption using an integrated model of health behavior
Phipps, D. J., Hagger, M. S., & Hamilton, K. (2020) · Appetite · doi:10.1016/j.appet.2020.104668 · Cited by 72
How to use and report Bayesian hypothesis tests.
Dienes, Z. P. (2021) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000258 · Cited by 91
Bayesian statistics in educational research: a look at the current state of affairs
König, C., & van de Schoot, R. (2017) · Educational Review · doi:10.1080/00131911.2017.1350636 · Cited by 87
“Sensitivity analyses are important in small sample studies, because effects of non-informative prior distributions on small sample analyses are still unclear (Depaoli and van de Schoot 2017).”
InfluentialSpeyer, L. G., Ushakova, A., Blakemore, S., Murray, A. L., & Kievit, R. (2022) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2022.2096613 · Cited by 94
“We therefore proceeded here using classical thresholds (as advocated in Asparouhov & Muth en, 2010; Depaoli & van de Schoot, 2017; Gelman et al., 2004), which converged in a reasonable time (days), and showed virtually identical results after doubling of the number of iterations.”
MethodThe time has come: Toward Bayesian SEM estimation in tourism research
Assaf, A. G., Tsionas, E. G., & Oh, H. (2017) · Tourism Management · doi:10.1016/j.tourman.2017.07.018 · Cited by 65
Guo, J., Marsh, H. W., Parker, P. D., Dicke, T., Lüdtke, O., & Diallo, T. (2019) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2018.1554999 · Cited by 66
“In such cases, the informative priors can be chosen with smaller and smaller variances, reflecting a switch from an exploratory to confirmatory nature (also see Depaoli & van de Schoot, 2017).”
BackgroundMethodInfluentialOn the pros and cons of Bayesian kinetic modeling in food science
van Boekel, M. A. J. S. (2020) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2020.02.027 · Cited by 57
Reporting Practice in Multilevel Modeling: A Revisit After 10 Years
Luo, W., Li, H., Baek, E., Chen, S., Lam, K. H., & Semma, B. (2021) · Review of Educational Research · doi:10.3102/0034654321991229 · Cited by 76
“Researchers are recommended to refer to the checklist by Depaoli and van de Schoot (2017) to avoid potential pitfalls and to improve transparency and replicability in Bayesian analysis.”
BackgroundExpert perceptions of seaweed farming for sustainable development
Spillias, S., Cottrell, R. S., Kelly, R., O’Brien, K. R., Adams, J. C., Bellgrove, A., Kelly, B., Kilpatrick, C., Layton, C., Macleod, C. K., et al. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.133052 · Cited by 57
Multi-species occupancy modelling of a carnivore guild in wildlife management areas in the Kalahari
der Weyde, L. K. V., Mbisana, C., & Klein, R. (2018) · Biological Conservation · doi:10.1016/j.biocon.2018.01.033 · Cited by 66
An introduction to Bayesian statistics in health psychology
Depaoli, S. A., Rus, H. M., Clifton, J. P., van de Schoot, R., & Tiemensma, J. (2017) · Health Psychology Review · doi:10.1080/17437199.2017.1343676 · Cited by 61
“Depaoli and van de Schoot (2017) describe in more detail what to report in a Bayesian analysis.”
Self-citationHeinzel, S., Tschorn, M., Schulte-Hutner, M., Schäfer, F., Reese, G., Pohle, C., Peter, F., Neuber, M., Liu, S., Keller, J., et al. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1239425 · Cited by 50
“The reporting of the analyses follows the recommendations by Depaoli and van de Schoot (2017).”
BackgroundMethodInfluentialAbdellatif, S., Hladkowicz, E., Lalu, M. M., Boet, S., Gagné, S., & McIsaac, D. I. (2022) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-022-02191-7 · Cited by 52
Bazzoli, A., & Probst, T. M. (2022) · Safety Science · doi:10.1016/j.ssci.2022.105703 · Cited by 51
Albuquerque, A. M., Eckert, I. D. C., Tramujas, L., Butler‐Laporte, G., McDonald, E. G., Brophy, J. M., & Lee, T. C. (2022) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2022.07.008 · Cited by 51
“We followed the “When to worry and how to Avoid the Misuse of Bayesian Statistics” checklist for checking details about our analysis [23,36,37], confirming the convergence and adequate sampling of the models.”
Smid, S. C., & Winter, S. D. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.611963 · Cited by 60
‘The left is right’: Left and right political orientation across Eastern and Western Europe
Wójcik, A. D., Cisłak, A., & Schmidt, P. (2021) · The Social Science Journal · doi:10.1080/03623319.2021.1986320 · Cited by 60
“…shows that the scale of cultural liberalism can be used relevantly in cross-cultural settings (Radkiewicz, 2017; Wójcik & Cisłak, 2012 To test this assumption further, we have tested the scale for metric invariance (Davidov et al. 2014) using Bayesian estimator (Depaoli and van de Schoot 2017).”
Wowak, A. J., & Busenbark, J. R. (2024) · Organization Science · doi:10.1287/orsc.2022.17160 · Cited by 56
Challenging Conventional Wisdom for Multivariate Statistical Models With Small Samples
McNeish, D. (2017) · Review of Educational Research · doi:10.3102/0034654317727727 · Cited by 57
Applications of Bayesian approaches in construction management research: a systematic review
Hon, C. K. H., Sun, C., Xia, B., Jimmieson, N. L., Way, K. A., & Wu, P. P. (2021) · Engineering Construction & Architectural Management · doi:10.1108/ecam-10-2020-0817 · Cited by 55
Bentley, K. H., Coppersmith, D. D. L., Kleiman, E. M., Nook, E. C., Mair, P., Millner, A. J., Reid-Russell, A., Wang, S. B., Fortgang, R. G., Stein, M. B., et al. (2021) · Affective Science · doi:10.1007/s42761-021-00058-6 · Cited by 49
Lüdtke, O., Robitzsch, A., & Wagner, J. (2018) · Psychological Methods · doi:10.1037/met0000155 · Cited by 42
McIsaac, D. I., Talarico, R., Jerath, A., & Wijeysundera, D. N. (2021) · BMJ Quality & Safety · doi:10.1136/bmjqs-2021-013150 · Cited by 45
Held, P., Kovacevic, M., Petrey, K., Meade, E. A., Pridgen, S., Montes, M., Werner, B., Miller, M. L., Smith, D. L., Kaysen, D. L., et al. (2022) · Journal of Traumatic Stress · doi:10.1002/jts.22831 · Cited by 45
A diary study on shared leadership, team work engagement, and goal attainment
Klasmeier, K. N., & Rowold, J. (2021) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12371 · Cited by 58
Klasmeier, K. N., Schleu, J. E., Millhoff, C., Poethke, U., & Bormann, K. C. (2021) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2021.1968375 · Cited by 58
“Depaoli & van de Schoot, 2017; Kaplan & Depaoli, 2012).”
BackgroundMethodInfluentialMental toughness and behavioural perseverance: A conceptual replication and extension
Giles, B., Goods, P. S. R., Warner, D. R., Quain, D., Peeling, P., Ducker, K. J., DAWSON, B. T., & Gucciardi, D. F. (2017) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2017.10.036 · Cited by 47
“Consistent with recommendations for Bayesian analysis 18,19 , we conducted a series of analyses to examine the sensitivity of the informative priors on the posterior distribution.”
Lester, H. F., Cullen, K. L., & Walters, R. W. (2019) · Organizational Research Methods · doi:10.1177/1094428119887434 · Cited by 45
Smid, S. C., & Rosseel, Y. (2020) · Routledge eBooks · doi:10.4324/9780429273872-20 · Cited by 42
Aldoh, A., SPARKS, P. B., & Harris, P. R. (2021) · Sustainability · doi:10.3390/su13158315 · Cited by 52
“We used the WAMBSchecklist for guidance on transparent reporting of Bayesian statistics [43].”
MethodChuan-Peng, H., Kong, X., Er, I.-J., Al, E., & Peng, K. (2018) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2018.00951 · Cited by 56
Rubin, M., Muller, K., Hayhoe, M. M., & Telch, M. J. (2022) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2022.2053882 · Cited by 38
“We largely followed the WAMBS (When to worry and how to Avoid the Misuse of Bayesian Statistics) checklist (Depaoli & van de Schoot, 2017).”
MethodReis, D. (2017) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000404 · Cited by 44
Bayesian continuous-time Rasch models.
Hecht, M., Hardt, K., Driver, C., & Voelkle, M. C. (2019) · Psychological Methods · doi:10.1037/met0000205 · Cited by 42
Kerber, A., Gewehr, E., Zimmermann, J., Sachser, C., Fegert, J. M., Knaevelsrud, C., & Spitzer, C. (2023) · Personality and Mental Health · doi:10.1002/pmh.1578 · Cited by 42
Using Bayesian Statistics to Model Uncertainty in Mixture Models: A Sensitivity Analysis of Priors
Depaoli, S. A., Yang, Y., & Felt, J. M. (2016) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2016.1250640 · Cited by 41
Self-citationA Bayesian Comparison of Frailty Instruments in Noncardiac Surgery: A Cohort Study
McIsaac, D. I., Aucoin, S. D., & van Walraven, C. (2020) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000005290 · Cited by 36
Grogan‐Kaylor, A. C., Ma, J., Lee, S. J., Castillo, B., Ward, K. P., & Klein, S. M. (2018) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.10.009 · Cited by 38
Verret, M., Le, J. B. P., Lalu, M. M., Jeffers, M. S., McIsaac, D. I., Nicholls, S. G., Turgeon, A. F., Ramchandani, R., Li, H., Hutton, B., et al. (2024) · British Journal of Anaesthesia · doi:10.1016/j.bja.2024.06.007 · Cited by 49
Application and Evaluation of an Expert Judgment Elicitation Procedure for Correlations
Zondervan-Zwijnenburg, M. A. J., van de Schoot-Hubeek, W., Lek, K., Hoijtink, H., & van de Schoot, R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00090 · Cited by 43
Actual and perceived motor competence: Are children accurate in their perceptions?
Morano, M., Bortoli, L., Ruiz, M. C., Campanozzi, A., & Robazza, C. (2020) · PLoS ONE · doi:10.1371/journal.pone.0233190 · Cited by 42
“Convergence is manifested when fluctuations in the chain and trends over time of generated parameter values are stable [37].”
BackgroundFernando, S. M., MacLaren, G., Barbaro, R. P., Mathew, R., Munshi, L., Madahar, P., Fried, J., Ramanathan, K. R., Lorusso, R., Brodie, D., et al. (2023) · Intensive Care Medicine · doi:10.1007/s00134-023-07199-1 · Cited by 39
“We followed recommendations regarding conduct and reporting of both prognosis and causal inference in critical care medicine and cardiology [23, 24], and our protocol was generated considering best practice in prognostic and Bayesian analyses [25, 26].”
MethodPrior Sensitivity in Bayesian Structural Equation Modeling for Sparse Factor Loading Structures
Liang, X. (2020) · Educational and Psychological Measurement · doi:10.1177/0013164420906449 · Cited by 41
Albuquerque, A. M., Tramujas, L., Sewanan, L. R., Williams, D. R., & Brophy, J. M. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.0548 · Cited by 38
Naldi, L., Nordqvist, M., Chirico, F., Gómez‐Mejía, L. R., Ashforth, B. E., Swartz, R. J., & Мелин, Л. (2024) · Entrepreneurship and Regional Development · doi:10.1080/08985626.2024.2328294 · Cited by 47
Mediation Effects In 2-1-1 Multilevel Model: Evaluation Of Alternative Estimation Methods
Fang, J., Wen, Z., & Hau, K. (2019) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2018.1547967 · Cited by 38
“Thus, in order to avoid choosing some inappropriate prior information, a sensitivity analysis could be conducted to examine different prior information and to observe the influences of the posterior distribution (Table 8; Depaoli & van de Schoot, 2017; Miočević et al., 2017).”
MethodLüdtke, O., Ulitzsch, E., & Robitzsch, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.615162 · Cited by 38
Expert agreement in prior elicitation and its effects on Bayesian inference
Stefan, A. M., Katsimpokis, D., Gronau, Q. F., & Wagenmakers, E. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02074-4 · Cited by 42
“…prior distributions is to some extent arbitrary because it relies on the subjective opinions of single researchers or field experts, poorly justified decisions in the prior elicitation procedure, or on the idiosyncrasies of previous studies (Depaoli & van de Schoot, 2017; Stefan et al., 2020).”
Poethke, U., Klasmeier, K. N., Radaca, E., & Diestel, S. (2023) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12437 · Cited by 42
Winter, S. D., & Depaoli, S. A. (2019) · International Journal of Behavioral Development · doi:10.1177/0165025419880610 · Cited by 32
Self-citationRefalo, M. C., Helms, E. R., Robinson, Z. P., Hamilton, D. L., & Fyfe, J. J. (2024) · Journal of Sports Sciences · doi:10.1080/02640414.2024.2321021 · Cited by 29
“Model diagnostics were conducted as per the WAMBS-Checklist (Depaoli & van de Schoot, 2017) (Supplementary Table S2.”
MethodKroencke, L., Humberg, S., Breil, S. M., Geukes, K., Zoppolat, G., Balzarini, R. N., Alonso-Ferres, M., Slatcher, R. B., & Back, M. D. (2023) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000468 · Cited by 36
Predicting a Distal Outcome Variable From a Latent Growth Model: ML versus Bayesian Estimation
Smid, S. C., Depaoli, S. A., & van de Schoot, R. (2019) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2019.1604140 · Cited by 33
“For information on how to perform a sensitivity analysis, we refer to Depaoli and van de Schoot (2017), and van Erp, Mulder, and Oberski (2018).”
Self-citationKinetics of heat-induced changes in foods: A workflow proposal
van Boekel, M. A. J. S. (2021) · Journal of Food Engineering · doi:10.1016/j.jfoodeng.2021.110634 · Cited by 33
Dynamic Structural Equation Models with Missing Data: Data Requirements on N and T
Fang, Y., & Wang, L. (2024) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2023.2287967 · Cited by 34
“A possible reason is that widely used diffuse priors can be unintentionally informative with small samples (Depaoli & Van de Schoot, 2017).”
Hüsers, J., Hafer, G., Heggemann, J., Wiemeyer, S., John, S. M., & Hübner, U. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01195-x · Cited by 29
Güntner, A. V., Klasmeier, K. N., Klonek, F. E., & Kauffeld, S. (2021) · Journal of Leadership & Organizational Studies · doi:10.1177/15480518211012408 · Cited by 25
“As the autocorrelation plots revealed a high amount of autocorrelation, we thinned the posterior distribution and used only every 10th MCMC iteration (Depaoli & van de Schoot, 2017).”
MethodAllen, J., Charles, B., Fok, C. C. T., Lee, K., Grogan‐Kaylor, A., Qungasvik Team, & Rasmus, S. (2023) · American Journal of Community Psychology · doi:10.1002/ajcp.12621 · Cited by 24
“Analyses adhere to transparency guidelines for Bayesian statistics (Depaoli & van de Schoot, 2017; Kruschke, 2021).”
MethodBayesian Analytical Methods in Cardiovascular Clinical Trials: Why, When, and How
Heuts, S., Kawczynski, M. J., Sayed, A., Urbut, S., Albuquerque, A. M., Mandrola, J. M., Kaul, S., Harrell, F. E., Gabrio, A., & Brophy, J. M. (2024) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2024.11.002 · Cited by 48
Zweers, I., van de Schoot, R., Tick, N. T., Depaoli, S. A., Clifton, J. P., de Castro, B. O., & Bijstra, J. O. (2020) · International Journal of Behavioral Development · doi:10.1177/0165025420915527 · Cited by 47
“To ensure proper implementation and reporting of Bayesian methods, we followed the When to worry and how to Avoid the Misuse of Bayesian Statistics (WAMBS)- checklist of Depaoli and van de Schoot (2017).”
Self-citationFernando, S. M., Brodie, D., Barbaro, R. P., Agerstrand, C. L., Badulak, J. H., Bush, E. L., Mueller, T., Munshi, L., Fan, E., MacLaren, G., et al. (2024) · Intensive Care Medicine · doi:10.1007/s00134-024-07343-5 · Cited by 23
“We followed recommendations regarding control of confounding factors in pulmonary and critical care medicine [20], and our protocol was generated considering best practice in Bayesian analyses [21].”
Larsen, S., Kristiansen, B. S., Swinton, P. A., Wolf, M., Fredriksen, A. B., Falch, H. N., van den Tillaar, R., & Sandberg, N. Ø. (2024) · Journal of Sports Sciences · doi:10.1080/02640414.2024.2444713 · Cited by 27
“To improve accuracy, trans-parency and replication in the analyses, the WAMBS-checklist (When to worry and how to Avoid Misuse of Bayesian Statistics) was used (Depaoli & Van de Schoot, 2017) and summaries of the workflow are reported in supplementary file 3.”
Bayesian Model Averaging as an Alternative to Model Selection for Multilevel Models
Depaoli, S. A., Lai, K., & Yang, Y. (2020) · Multivariate Behavioral Research · doi:10.1080/00273171.2020.1778439 · Cited by 26
Self-citationTafvelin, S., & Stenling, A. (2020) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051820962504 · Cited by 46
Metadata
- Authors
- Depaoli, S., & van de Schoot, R.
- Affiliations
- University of California, Merced (US)
- Corresponding author
- Depaoli, Sarah
- ORCID
- Depaoli, Sarah
- Venue
- Psychological Methods
- Published
- 2017-06
- Volume
- 22
- Issue
- 2
- Pages
- 240-261
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2409860581
- Semantic Scholar
- 232cadce7992b919589966dc1e92e58a4ef4aa43
- Cited by
- 448
- References
- 97
- Citations by year
- 2026: 61 · 2025: 47 · 2024: 54 · 2023: 46 · 2022: 52 · 2021: 57 · 2020: 48 · 2019: 36 · 2018: 18 · 2017: 24
- FWCI
- 13.94
- Type
- journal article
- Language
- en
- Open access
- green
- dspace.library.uu.nl
- Licence
- other-oa
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Funders
- Netherlands Organisation for Scientific Research (NWO-VENI-451-11-008)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- Bayesian analysis, prior sensitivity, model diagnostics, research transparency, replication, Bayesian model checking
- MeSH terms
- Bayes Theorem, Data Interpretation, Statistical, Humans, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.