Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 60 of the 63 references it cites were found in a registry or an index; 3 of the 43 sources its claims cite were checked for support.

The JASP guidelines for conducting and reporting a Bayesian analysis

Open access

Abstract

Despite the increasing popularity of Bayesian inference in empirical research, few practical guidelines provide detailed recommendations for how to apply Bayesian procedures and interpret the results. Here we offer specific guidelines for four different stages of Bayesian statistical reasoning in a research setting: planning the analysis, executing the analysis, interpreting the results, and reporting the results. The guidelines for each stage are illustrated with a running example. Although the guidelines are geared towards analyses performed with the open-source statistical software JASP, most guidelines extend to Bayesian inference in general.

Overview

CoChat Summary

TL;DR

This paper provides practical guidelines for planning, executing, interpreting, and reporting Bayesian analyses, illustrated with a running stereogram example and focused on JASP. It emphasizes Bayes factors for testing, posterior distributions/credible intervals for estimation, and transparent reporting of priors, robustness, and analysis files.

Key findings

  • The guidelines cover four stages: planning, executing, interpreting, and reporting, with recommendations such as preregistration, assumption checks, correct Bayes factor/credible interval interpretation, and sharing annotated `.jasp` files.
  • In the stereogram example, the one-sided Bayesian two-sample t test yielded BF+0 = 4.567, described as moderate evidence; the Bayesian Mann–Whitney U test yielded BF+0 = 5.191.
  • For parameter estimation, the two-sided analysis gave a posterior median for δ of 0.47 with a 95% central credible interval from 0.046 to 0.904.
  • The paper lists five common pitfalls, including confusing Bayes factors with posterior odds, confusing prior model probabilities with parameter prior distributions, and using credible intervals as hypothesis tests.

Methods

  • Design: methodological guidelines for Bayesian statistical reasoning in research, organized into four stages and summarized in Table 1.
  • Data/sample: the running example uses Frisby and Clatworthy’s (1975) stereogram data; the original sample had 103 participants, 25 were eliminated for failing an initial stereo-acuity test, leaving 78 participants (43 NV, 35 VV).
  • Main analysis: the example applies a one-sided Bayesian two-sample t test for hypothesis testing, a two-sided Bayesian two-sample t test for parameter estimation, a Bayesian Mann–Whitney U test as a robustness check, and a Bayes factor robustness plot; the fuse times were log-transformed after assumption checks.

Limitations

  • The paper states that for some frequentist analyses, the Bayesian counterpart has not yet been developed or implemented in JASP.
  • It states that some JASP analyses currently provide only a Bayes factor and not visual posterior distributions, and that some analyses are available only with a relatively limited set of prior distributions.
  • The text notes these are not principled limitations and that JASP is actively being developed; it also makes evident that the guidelines focus on standard JASP analyses, while more complex models may require custom coding in JAGS, Stan, R, or Python.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3758/s13423-020-01798-5

Cites

60 of 60 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Model misspecification is also a problem for Bayesian analyses. The four scatterplots in the top panel show Anscombe’s quartet (Anscombe, 1973); the bottom panel shows the corresponding inference, which is identical for all four scatter plots. Except for the leftmost scatterplot, all data violate the assumptions of the linear correlation analysis in important ways
Fig. 1 Model misspecification is also a problem for Bayesian analyses. The four scatterplots in the top panel show Anscombe’s quartet (Anscombe, 1973); the bottom panel shows the corresponding inference, which is identical for all four scatter plots. Except for the leftmost scatterplot, all data violate the assumptions of the linear correlation analysis in important waysCC BY · PubMed Central
Fig. 2 Descriptive plots allow a visual assessment of the assumptions of the t test for the stereogram data. The top row shows descriptive plots for the raw fuse times, and the bottom row shows descriptive plots for the log-transformed fuse times. The left column shows boxplots, including the jittered data points, for each of the experimental conditions. The middle and right columns show parQ-Q plots of the dependent variable, split by experimental condition. Here we see that the log-transformed dependent variable is more appropriate for the t test, due to its distribution and absence of outliers. Figures from JASP
Fig. 2 Descriptive plots allow a visual assessment of the assumptions of the t test for the stereogram data. The top row shows descriptive plots for the raw fuse times, and the bottom row shows descriptive plots for the log-transformed fuse times. The left column shows boxplots, including the jittered data points, for each of the experimental conditions. The middle and right columns show parQ-Q plots of the dependent variable, split by experimental condition. Here we see that the log-transformed dependent variable is more appropriate for the t test, due to its distribution and absence of outliers. Figures from JASPCC BY · PubMed Central
Fig. 3 JASP menu for the Bayesian two-sample t test. The left input panel offers the analysis options, including the specification of the alternative hypothesis and the selection of plots. The right output panel shows the corresponding analysis output. The prior and posterior plot is explained in more detail in Fig. 6. The input panel specifies the one-sided analysis for hypothesis testing; a two-sided analysis for estimation can be obtained by selecting “Group 1 ≠ Group 2” under “Alt. Hypothesis”
Fig. 3 JASP menu for the Bayesian two-sample t test. The left input panel offers the analysis options, including the specification of the alternative hypothesis and the selection of plots. The right output panel shows the corresponding analysis output. The prior and posterior plot is explained in more detail in Fig. 6. The input panel specifies the one-sided analysis for hypothesis testing; a two-sided analysis for estimation can be obtained by selecting “Group 1 ≠ Group 2” under “Alt. Hypothesis”CC BY · PubMed Central
Fig. 4 A graphical representation of a Bayes factor classification table. As the Bayes factor deviates from 1, which indicates equal support for H0 and H1, more support is gained for either H0 or H1. Bayes factors between 1 and 3 are considered to be weak, Bayes factors between 3 and 10 are considered moderate, and Bayes factors greater than 10 are considered strong evidence. The Bayes factors are also represented as probability wheels, where the ratio of white (i.e., support for H0) to red (i.e., support for H1) surface is a function of the Bayes factor. The probability wheels further underscore the continuous scale of evidence that Bayes factors represent. These classifications are heuristic and should not be misused as an absolute rule for all-or-nothing conclusions
Fig. 4 A graphical representation of a Bayes factor classification table. As the Bayes factor deviates from 1, which indicates equal support for H0 and H1, more support is gained for either H0 or H1. Bayes factors between 1 and 3 are considered to be weak, Bayes factors between 3 and 10 are considered moderate, and Bayes factors greater than 10 are considered strong evidence. The Bayes factors are also represented as probability wheels, where the ratio of white (i.e., support for H0) to red (i.e., support for H1) surface is a function of the Bayes factor. The probability wheels further underscore the continuous scale of evidence that Bayes factors represent. These classifications are heuristic and should not be misused as an absolute rule for all-or-nothing conclusionsCC BY · PubMed Central
Fig. 5 Updating the unconditional prior distribution to the unconditional posterior distribution for the stereogram example. The left panel shows the unconditional prior distribution, which is a mixture between the prior distributions under H0 and H1. The prior distribution under H0 is a spike at the null value, indicated by the dotted line; the prior distribution under H1 is a Cauchy distribution, indicated by the gray mass. The mixture proportion is determined by the prior model probabilities p(H0) and p(H1). The right panel shows the unconditional posterior distribution, after updating the prior distribution with the data D. This distribution is a mixture between the posterior distributions under H0 and H1., where the mixture proportion is determined by the posterior model probabilities p(H0∣D) and p(H1∣D). Since p(H1∣D)=0.7 (i.e., the data provide support for H1 over H0), about 70% of the unconditional posterior mass is comprised of the posterior mass under H1, indicated by the gray mass. Thus, the unconditional posterior distribution provides information about plausible values for δ, while taking into account the uncertainty of H1 being true. In both panels, the dotted line and gray mass have been rescaled such that the height of the dotted line and the highest point of the gray mass reflect the prior (left) and posterior (right) model probabilities
Fig. 5 Updating the unconditional prior distribution to the unconditional posterior distribution for the stereogram example. The left panel shows the unconditional prior distribution, which is a mixture between the prior distributions under H0 and H1. The prior distribution under H0 is a spike at the null value, indicated by the dotted line; the prior distribution under H1 is a Cauchy distribution, indicated by the gray mass. The mixture proportion is determined by the prior model probabilities p(H0) and p(H1). The right panel shows the unconditional posterior distribution, after updating the prior distribution with the data D. This distribution is a mixture between the posterior distributions under H0 and H1., where the mixture proportion is determined by the posterior model probabilities p(H0∣D) and p(H1∣D). Since p(H1∣D)=0.7 (i.e., the data provide support for H1 over H0), about 70% of the unconditional posterior mass is comprised of the posterior mass under H1, indicated by the gray mass. Thus, the unconditional posterior distribution provides information about plausible values for δ, while taking into account the uncertainty of H1 being true. In both panels, the dotted line and gray mass have been rescaled such that the height of the dotted line and the highest point of the gray mass reflect the prior (left) and posterior (right) model probabilitiesCC BY · PubMed Central
Fig. 6 Bayesian two-sample t test for the parameter δ. The probability wheel on top visualizes the evidence that the data provide for the two rival hypotheses. The two gray dots indicate the prior and posterior density at the test value (Dickey & Lientz, 1970; Wagenmakers, Lodewyckx, Kuriyal, & Grasman, 2010). The median and the 95% central credible interval of the posterior distribution are shown in the top right corner. The left panel shows the one-sided procedure for hypothesis testing and the right panel shows the two-sided procedure for parameter estimation. Both figures from JASP
Fig. 6 Bayesian two-sample t test for the parameter δ. The probability wheel on top visualizes the evidence that the data provide for the two rival hypotheses. The two gray dots indicate the prior and posterior density at the test value (Dickey & Lientz, 1970; Wagenmakers, Lodewyckx, Kuriyal, & Grasman, 2010). The median and the 95% central credible interval of the posterior distribution are shown in the top right corner. The left panel shows the one-sided procedure for hypothesis testing and the right panel shows the two-sided procedure for parameter estimation. Both figures from JASPCC BY · PubMed Central
Fig. 7 The Bayes factor robustness plot. The maximum BF+ 0 is attained when setting the prior width r to 0.38. The plot indicates BF+ 0 for the user specified prior (r=1/√2), wide prior (r = 1), and ultrawide prior (r=√2). The evidence for the alternative hypothesis is relatively stable across a wide range of prior distributions, suggesting that the analysis is robust. However, the evidence in favor of H+ is not particularly strong and will not convince a skeptic
Fig. 7 The Bayes factor robustness plot. The maximum BF+ 0 is attained when setting the prior width r to 0.38. The plot indicates BF+ 0 for the user specified prior (r=1/√2), wide prior (r = 1), and ultrawide prior (r=√2). The evidence for the alternative hypothesis is relatively stable across a wide range of prior distributions, suggesting that the analysis is robust. However, the evidence in favor of H+ is not particularly strong and will not convince a skepticCC BY · PubMed Central

Verification

Claims the paper makes

3 Valid · 1 Not valid · 25 Not checked · 53 Own results and interpretations

25 more claims

Create a free account to see all 82 claims and to verify the 40 references still open.

See all claims — free account
  • It may state two separate claims as one. 33
  • Probably not a substantial claim. 29

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 63 references

Research works printed but not linked: 2

  1. Jeffreys, H. (1939). Theory of probability, 1st. Oxford University Press.
  2. Jeffreys, H. (1961). Theory of probability. 3rd. Oxford University Press.

Cited by

See all 1,114

Metadata

Authors
van Doorn, J., van den Bergh, D., Böhm, U., Dablander, F., Derks, K., Draws, T., Etz, A., Evans, N. J., Gronau, Q. F., Haaf, J. M., Hinne, M., Kucharský, Š., Ly, A., Marsman, M., Matzke, D., Gupta, A. R. K. N., Sarafoglou, A., Stefan, A., Voelkel, J. G., & Wagenmakers, E.-J.
Affiliations
  • University of Amsterdam (NL)
  • Nyenrode Business University (NL)
  • University of California, Irvine (US)
  • Stanford University (US)
Venue
Psychonomic Bulletin & Review
Published
2020-10-09
Volume
28
Issue
3
Pages
813-826
ISSN
  • 1069-9384 (ISSN-L)
  • 1531-5320
OpenAlex
W3091779368
Cited by
1,114
References
63
Citations by year
2026: 111 · 2025: 169 · 2024: 216 · 2023: 202 · 2022: 177 · 2021: 139 · 2020: 71
FWCI
103.84
Type
journal article
Language
en
Open access
Licence
Locations
  • Psychonomic Bulletin & Review (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • UvA-DARE (University of Amsterdam) (acceptedVersion, cc-by)
  • Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
  • Radboud Repository (Radboud University) (submittedVersion)
  • PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
  • PsyArXiv (OSF Preprints) (submittedVersion)
  • Radboud Repository (Radboud University) (submittedVersion, other-oa)
Funders
  • National Science Foundation (1321846)
  • Universiteit van Amsterdam
  • Nederlandse Organisatie voor Wetenschappelijk Onderzoek (016.Vici.170.083, 406.18.559, 451-17-017)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
Keywords
Bayesian inference, JASP, reporting guidelines, statistical reporting, open-source statistical software
MeSH terms
Bayes Theorem, Data Interpretation, Statistical, Humans, Research Design, Models, Statistical, Guidelines as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The JASP guidelines for conducting and reporting a Bayesian analysis. https://app.cochat.ai/papers/10.3758/s13423-020-01798-5
The paper
van Doorn, J., van den Bergh, D., Böhm, U., Dablander, F., Derks, K., Draws, T., Etz, A., Evans, N. J., Gronau, Q. F., Haaf, J. M., Hinne, M., Kucharský, Š., Ly, A., Marsman, M., Matzke, D., Gupta, A. R. K. N., Sarafoglou, A., Stefan, A., Voelkel, J. G., & Wagenmakers, E.-J. (2021). The JASP guidelines for conducting and reporting a Bayesian analysis. Psychonomic Bulletin & Review. https://doi.org/10.3758/s13423-020-01798-5

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.