Bayesian Benefits for the Pragmatic Researcher
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
The practical advantages of Bayesian inference are demonstrated here through two concrete examples. In the first example, we wish to learn about a criminal’s IQ: a problem of parameter estimation. In the second example, we wish to quantify and track support in favor of the null hypothesis that Adam Sandler movies are profitable regardless of their quality: a problem of hypothesis testing. The Bayesian approach unifies both problems within a coherent predictive framework, in which parameters and models that predict the data successfully receive a boost in plausibility, whereas parameters and models that predict poorly suffer a decline. Our examples demonstrate how Bayesian analyses can be more informative, more elegant, and more flexible than the orthodox methodology that remains dominant within the field of psychology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Bayesian analyses offer researchers a number of pragmatic benefits (Wagenmakers, Morey, & Lee, 2016), including intuitive probability statements of inferences, the ability to compare the relative credibility of different estimates, and a full posterior distribution describing the relative plausibility that different population level atheism prevalence rates could have produced our observed data.”
From How many atheists are there? (2017) · cites this paper as Wagenmakers et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Markov Chain Monte Carlo in Practice
Gasparini, M. (1997) · Technometrics · doi:10.1080/00401706.1997.10485132 · Cited by 1,879
Bayesian Cognitive Modeling: A Practical Course
Lee, M. D., & Wagenmakers, E.-J. (2014) · doi:10.1017/cbo9781139087759 · Cited by 1,795
Self-citation(2013) · Cited by 1,351
Self-citationStatistical Rethinking: A Bayesian Course with Examples in R and Stan
McElreath, R. L. (2015) · Helmholtz Centre for Ocean Research Kiel (GEOMAR) · Cited by 996
Statistical Rethinking: a Bayesian Course with Examples in R and Stan
Hewson, P. (2016) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12221 · Cited by 850
Small Telescopes: Detectability and the Evaluation of Replication Results
Simonsohn, U. (2015) · Psychological Science · doi:10.1177/0956797614567341 · Cited by 742
Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method
Wagenmakers, E.-J., Lodewyckx, T., Kuriyal, H., & Grasman, R. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2009.12.001 · Cited by 740
Self-citationIntroduction to Statistical Decision Theory.
Schervish, M. J., Pratt, J. W., Raiffa, H., & Schlaifer, R. (1996) · Journal of the American Statistical Association · doi:10.2307/2291759 · Cited by 705 · cited 1×
“Crucially, none of the statements above—not a single one—can be arrived at within the framework of orthodox methods (e.g., Pratt et al., 1995), no matter how many tests Bob completes, and no matter what prior knowledge may or may not be available.3 Yet statements like these may be vitally important…”
MethodThe fallacy of placing confidence in confidence intervals
Morey, R. D., Hoekstra, R., Rouder, J. N., Lee, M. D., & Wagenmakers, E.-J. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0947-8 · Cited by 577
Self-citationThe BUGS Book: A Practical Introduction to Bayesian Analysis
Lunn, D. J., Jackson, C. H., Best, N., Thomas, A. C., & Spiegelhalter, D. J. (2012) · Cited by 530
The BUGS Book: A Practical Introduction to Bayesian Analysis
Lunn, D., Jackson, C., Best, N., Thomas, A., & Spiegelhalter, D. (2012) · Chapman & Hall/CRC eBooks · doi:10.1201/b13613 · Cited by 524
Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference
Dienes, Z. P. (2008) · Cited by 418
Applying Occam’s razor in modeling cognition: A Bayesian approach
Myung, I. J., & Pitt, M. A. (1997) · Psychonomic Bulletin & Review · doi:10.3758/bf03210778 · Cited by 415 · cited 1×
“A Bayesian researcher is able to enrich statistical models with prior knowledge, and this allows the models to make meaningful predictions about data (Myung & Pitt, 1997).”
MethodHow Bayes factors change scientific practice
Dienes, Z. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.10.003 · Cited by 401
Lindley, D. V. (2006) · Wiley eBooks · doi:10.1002/0470055480 · Cited by 342
The philosophy of Bayes factors and the quantification of statistical evidence
Morey, R. D., Romeijn, J.-W., & Rouder, J. N. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.11.001 · Cited by 313
Self-citationThe Weighted Likelihood Ratio, Sharp Hypotheses about Chances, the Order of a Markov Chain
Dickey, J. M., & Lientz, B. P. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697203 · Cited by 251 · cited 1×
“At ρ = 0, the posterior distribution is 4.429 times higher than the prior distribution, indicating that the data support H0 (e.g., Dickey & Lientz, 1970; Wagenmakers, Lodewyckx, Kuriyal, & Grasman, 2010).”
BackgroundInfluentialHow to quantify the evidence for the absence of a correlation
Wagenmakers, E.-J., Verhagen, J., & Ly, A. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0593-0 · Cited by 129
Self-citationMulder, J., & Wagenmakers, E. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2016.01.002 · Cited by 117
Self-citationAccumulative prediction error and the selection of time series models
Wagenmakers, E., Grünwald, P., & Steyvers, M. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2006.01.004 · Cited by 106
Self-citationThe Relevance of Stopping Rules in Statistical Inference
Berger, J. O., & Berry, D. A. (1988) · Springer eBooks · doi:10.1007/978-1-4613-8768-8_5 · Cited by 97 · cited 2×
“…below, the orthodox statistical framework is unable to address the question: It does not produce a measure of evidence, and it does not apply to data that become available over time, indefinitely, inevitably, and beyond the control of any experimenter (e.g., Berger & Berry, 1988, Example 1).”
BackgroundDuvall, J. C., & Morris, R. J. (2006) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.37.6.658 · Cited by 29 · cited 1×
“In a lastditch attempt to save Bob’s life, the defense argues that Bob is intellectually disabled, with an IQ lower than 70, meaning that he is not eligible to receive the death penalty (Duvall & Morris, 2006).”
BackgroundHow to become a Bayesian in eight easy steps: An annotated reading listPreprint
Etz, A. J., Gronau, Q. F., Dablander, F., Edelsbrunner, P. A., & Baribault, B. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ph6sw · Cited by 18
The Mentally Retarded Offender
Spruill, J., & May, J. G. (1988) · Criminal Justice and Behavior · doi:10.1177/0093854888015004005 · Cited by 17
Bayesian inference and “truth”: a comment on Hoffman, Singh, and Prakash
Feldman, J. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0795-y · Cited by 7 · cited 1×
“Importantly, this predictive interpretation of the Bayes factor shows that its interpretation does not depend on whether either of the models is true in some absolute sense (see also Feldman, 2015).”
BackgroundBarbero (2014) · doi:10.1016/j · Cited by 1
Research works printed but not linked: 2
- 12. Jeffreys, H. (1961). Theory of probability (3rd ed.). Oxford, England: Oxford University Press.
- 23. Parker, T. (Writer, Director). (2004). AWESOME-O [Television series episode]. In T. Parker, M. Stone, & A. Garefino (Producers), South Park. New York, NY: Comedy Central Productions.
Cited by
Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications
Wagenmakers, E.-J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Love, J., Selker, R., Gronau, Q. F., Šmíra, M., Epskamp, S., et al. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1343-3 · Cited by 1,627
Self-citationThe JASP guidelines for conducting and reporting a Bayesian analysis
van Doorn, J., van den Bergh, D., Böhm, U., Dablander, F., Derks, K., Draws, T., Etz, A., Evans, N. J., Gronau, Q. F., Haaf, J. M., et al. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01798-5 · Cited by 1,114
“The credible interval [ L, U ] has a x % probability that the true parameter lies in the interval that ranges from L to U (an interpretation that is often wrongly attributed to frequentist confidence intervals, see Morey, Hoekstra, Rouder, Lee, & Wagenmakers, 2016).”
Self-citationIndices of Effect Existence and Significance in the Bayesian Framework
Makowski, D., Ben-Shachar, M. S., Chen, S. H. A., & Lüdecke, D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02767 · Cited by 983
Bayes factor design analysis: Planning for compelling evidence
Schönbrodt, F. D., & Wagenmakers, E.-J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1230-y · Cited by 729
“situations common in ecology and astronomy, where nature provides data over time and sampling plans do not exist (Wagenmakers et al., 2016).”
BackgroundMethodSelf-citationUsing Bayes factor hypothesis testing in neuroscience to establish evidence of absence
Keysers, C., Gazzola, V., & Wagenmakers, E.-J. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0660-4 · Cited by 654
Self-citation
Metadata
- Authors
- Wagenmakers, E.-J., Morey, R. D., & Lee, M. D.
- Affiliations
- University of Amsterdam (NL)
- Cardiff University (GB)
- University of California, Irvine (US)
- Corresponding author
- Wagenmakers, Eric-Jan
- Venue
- Current Directions in Psychological Science
- Publisher
- SAGE Publications
- Published
- 2016-06
- Volume
- 25
- Issue
- 3
- Pages
- 169-176
- ISSN
- 0963-7214 (ISSN-L)
- 1467-8721
- OpenAlex
- W2414830033
- Semantic Scholar
- 9669c421dda25250471ae7a69beaf226236a67f1
- Cited by
- 334
- References
- 27
- Citations by year
- 2026: 13 · 2025: 14 · 2024: 27 · 2023: 31 · 2022: 49 · 2021: 36 · 2020: 43 · 2019: 36 · 2018: 39 · 2017: 32 · 2016: 13
- FWCI
- 40.51
- Type
- journal article
- Language
- en
- Open access
- green
- handle.uba.uva.nl
- Licence
- cc-by
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Current Directions in Psychological Science (publishedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion, cc-by)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Distribution Estimation and Applications
- Keywords
- Bayesian inference, parameter estimation, hypothesis testing, null hypothesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.