The DOI matches its Crossref record; 60 of the 63 references it cites were found in a registry or an index; 3 of the 43 sources its claims cite were checked for support.
The JASP guidelines for conducting and reporting a Bayesian analysis
Open accessAbstract
Despite the increasing popularity of Bayesian inference in empirical research, few practical guidelines provide detailed recommendations for how to apply Bayesian procedures and interpret the results. Here we offer specific guidelines for four different stages of Bayesian statistical reasoning in a research setting: planning the analysis, executing the analysis, interpreting the results, and reporting the results. The guidelines for each stage are illustrated with a running example. Although the guidelines are geared towards analyses performed with the open-source statistical software JASP, most guidelines extend to Bayesian inference in general.
Overview
CoChat Summary
TL;DR
This paper provides practical guidelines for planning, executing, interpreting, and reporting Bayesian analyses, illustrated with a running stereogram example and focused on JASP. It emphasizes Bayes factors for testing, posterior distributions/credible intervals for estimation, and transparent reporting of priors, robustness, and analysis files.
Key findings
- The guidelines cover four stages: planning, executing, interpreting, and reporting, with recommendations such as preregistration, assumption checks, correct Bayes factor/credible interval interpretation, and sharing annotated `.jasp` files.
- In the stereogram example, the one-sided Bayesian two-sample t test yielded BF+0 = 4.567, described as moderate evidence; the Bayesian Mann–Whitney U test yielded BF+0 = 5.191.
- For parameter estimation, the two-sided analysis gave a posterior median for δ of 0.47 with a 95% central credible interval from 0.046 to 0.904.
- The paper lists five common pitfalls, including confusing Bayes factors with posterior odds, confusing prior model probabilities with parameter prior distributions, and using credible intervals as hypothesis tests.
Methods
- Design: methodological guidelines for Bayesian statistical reasoning in research, organized into four stages and summarized in Table 1.
- Data/sample: the running example uses Frisby and Clatworthy’s (1975) stereogram data; the original sample had 103 participants, 25 were eliminated for failing an initial stereo-acuity test, leaving 78 participants (43 NV, 35 VV).
- Main analysis: the example applies a one-sided Bayesian two-sample t test for hypothesis testing, a two-sided Bayesian two-sample t test for parameter estimation, a Bayesian Mann–Whitney U test as a robustness check, and a Bayes factor robustness plot; the fuse times were log-transformed after assumption checks.
Limitations
- The paper states that for some frequentist analyses, the Bayesian counterpart has not yet been developed or implemented in JASP.
- It states that some JASP analyses currently provide only a Bayes factor and not visual posterior distributions, and that some analyses are available only with a relatively limited set of prior distributions.
- The text notes these are not principled limitations and that JASP is actively being developed; it also makes evident that the guidelines focus on standard JASP analyses, while more complex models may require custom coding in JAGS, Stan, R, or Python.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
3 Valid · 1 Not valid · 25 Not checked · 53 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In Bayesian hypothesis testing, a one-sided hypothesis yields a more diagnostic test than a two-sided alternative (e.g., Jeffreys, 1961; Wetzels, Raaijmakers, Jakab, & Wagenmakers, 2009, p.283).”
§ The JASP guidelines for conducting and reporting a Bayesian analysis > Stage 1: Planning the analysis > Specifying the statistical model.
What the sources say
- Not checked yetcites Jeffreys, 1961
- Partly supportedcites Wetzels, Raaijmakers, Jakab, & Wagenmakers, 2009 sourceExperimental — accuracy not yet measured
Our copy never states the general comparative principle that a one-sided hypothesis yields a more diagnostic test than a two-sided alternative; its motivation for the one-sided (order-restricted) SD test is applicability — the JZS two-sided test 'does not directly apply' when the alternative is directional (Introduction, p. 1; Bayesian Hypothesis Testing, p. 3). What it does supply is a worked illustration in Extension 1: Order Restrictions (p. 5), where the same data give BF01 = 6.08 under the unrestricted two-sided alternative but BF01 = 13.75 (posterior .93 vs .86) under the order-restricted one-sided alternative, i.e. a sharper quantification. So the example supports part of the claim while the general assertion attributed here is not made by this paper. (LLM, conf=0.65)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Visual inspection of the boxplots suggests that the variances of the fuse times may not be equal”
§ The JASP guidelines for conducting and reporting a Bayesian analysis > Stage 2: Executing the analysis > Stereogram example
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There also appear to be a number of potential outliers in both groups.”
§ The JASP guidelines for conducting and reporting a Bayesian analysis > Stage 2: Executing the analysis > Stereogram example
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“observed standard deviations of the NV and VV groups are 8.085 and 4.802, respectively”
§ The JASP guidelines for conducting and reporting a Bayesian analysis > Stage 2: Executing the analysis > Stereogram example
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, the Q-Q plots show that the normality assumption of the t test is untenable here.”
§ The JASP guidelines for conducting and reporting a Bayesian analysis > Stage 2: Executing the analysis > Stereogram example
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
25 more claims
Create a free account to see all 82 claims and to verify the 40 references still open.
- It may state two separate claims as one. 33
- Probably not a substantial claim. 29
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“According to common interpretive guidelines (Van Doorn et al., 2021), a Bayes Factor between 0.33 and 0.10 can be considered moderate evidence for the null, and this result falls at the upper end of that range.”
From This is not the way: global directional cues do not improve spatial learning in an immersive virtual environment (2025) · cites this paper as Van Doorn et al., 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The JASP guidelines for conducting and reporting a Bayesian analysis > Stage 3: Interpreting the results > Stereogram example
“For parameter estimation, the results of the two-sided t test are presented in Fig. 6a.”
§ The JASP guidelines for conducting and reporting a Bayesian analysis > Stage 3: Interpreting the results > Stereogram example
“The left panel shows the one-sided procedure for hypothesis testing and the right panel shows the two-sided procedure for parameter estimation.”
Citations
Cites
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
brms : An R Package for Bayesian Multilevel Models Using Stan
Bürkner, P.-C. (2017) · Journal of Statistical Software · doi:10.18637/jss.v080.i01 · Cited by 9,476 · cited 1×
“Popular packages for conducting Bayesian analyses in R are the BayesFactor package (Morey & Rouder, 2015) and the brms package (B¨urkner, 2017), among others (see https://cran.r-project.org/web/views/Bayesian.html for a more exhaustive list).”
MethodStan : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Probabilistic programming in Python using PyMC3
Salvatier, J., Wiecki, T. V., & Fonnesbeck, C. (2016) · PeerJ Computer Science · doi:10.7717/peerj-cs.55 · Cited by 2,544
Using Bayes to get the most out of non-significant results
Dienes, Z. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00781 · Cited by 1,998
Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
Diciccio, T. J., Kass, R. E., Raftery, A., & Wasserman, L. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474045 · Cited by 1,943
Research works printed but not linked: 2
- Jeffreys, H. (1939). Theory of probability, 1st. Oxford University Press.
- Jeffreys, H. (1961). Theory of probability. 3rd. Oxford University Press.
Cited by
Visualizations with statistical details: The 'ggstatsplot' approach
Patil, I. (2021) · Journal of Open Source Software · doi:10.21105/joss.03167 · Cited by 1,496
“The defaults are designed to follow best practices in both data visualization (Cleveland, 1985; Grant, 2018; Healy, 2018; Tufte, 2001; Wilke, 2019) and (frequentist/Bayesian) statistical reporting (American Psychological Association, 2019; van Doorn et al., 2020).”
MethodPsychological inoculation improves resilience against misinformation on social media
Roozenbeek, J., van der Linden, S., Goldberg, B., Rathje, S., & Lewandowsky, S. (2022) · Science Advances · doi:10.1126/sciadv.abo6254 · Cited by 472
Bayesian Analysis Reporting Guidelines
Kruschke, J. K. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01177-7 · Cited by 440
A Conceptual Introduction to Bayesian Model Averaging
Hinne, M., Gronau, Q. F., van den Bergh, D., & Wagenmakers, E.-J. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919898657 · Cited by 318
“When one is in doubt, robustness checks can verify that conclusions do not depend on arbitrary choices of priors (van Doorn et al., 2019).”
Self-citationBasol, M., Roozenbeek, J., Berriche, M., Uenal, F., McClanahan, W. P., & Linden, S. V. D. (2021) · Big Data & Society · doi:10.1177/20539517211013868 · Cited by 271
Metadata
- Authors
- van Doorn, J., van den Bergh, D., Böhm, U., Dablander, F., Derks, K., Draws, T., Etz, A., Evans, N. J., Gronau, Q. F., Haaf, J. M., Hinne, M., Kucharský, Š., Ly, A., Marsman, M., Matzke, D., Gupta, A. R. K. N., Sarafoglou, A., Stefan, A., Voelkel, J. G., & Wagenmakers, E.-J.
- Affiliations
- University of Amsterdam (NL)
- Nyenrode Business University (NL)
- University of California, Irvine (US)
- Stanford University (US)
- ORCID
- Venue
- Psychonomic Bulletin & Review
- Published
- 2020-10-09
- Volume
- 28
- Issue
- 3
- Pages
- 813-826
- ISSN
- 1069-9384 (ISSN-L)
- 1531-5320
- PMC
- PMC8219590
- OpenAlex
- W3091779368
- Semantic Scholar
- c4bca921d78c0f4fb8569eb9d5c0cb42cbb3ec0b
- Cited by
- 1,114
- References
- 63
- Citations by year
- 2026: 111 · 2025: 169 · 2024: 216 · 2023: 202 · 2022: 177 · 2021: 139 · 2020: 71
- FWCI
- 103.84
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Psychonomic Bulletin & Review (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (acceptedVersion, cc-by)
- Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Radboud Repository (Radboud University) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- National Science Foundation (1321846)
- Universiteit van Amsterdam
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (016.Vici.170.083, 406.18.559, 451-17-017)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- Bayesian inference, JASP, reporting guidelines, statistical reporting, open-source statistical software
- MeSH terms
- Bayes Theorem, Data Interpretation, Statistical, Humans, Research Design, Models, Statistical, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The JASP guidelines for conducting and reporting a Bayesian analysis. https://app.cochat.ai/papers/10.3758/s13423-020-01798-5
- The paper
- van Doorn, J., van den Bergh, D., Böhm, U., Dablander, F., Derks, K., Draws, T., Etz, A., Evans, N. J., Gronau, Q. F., Haaf, J. M., Hinne, M., Kucharský, Š., Ly, A., Marsman, M., Matzke, D., Gupta, A. R. K. N., Sarafoglou, A., Stefan, A., Voelkel, J. G., & Wagenmakers, E.-J. (2021). The JASP guidelines for conducting and reporting a Bayesian analysis. Psychonomic Bulletin & Review. https://doi.org/10.3758/s13423-020-01798-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.