The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
The philosophy of Bayes factors and the quantification of statistical evidence
Open accessAbstract
A core aspect of science is using data to assess the degree to which data provide evidence for competing claims, hypotheses, or theories. Evidence is by definition something that should change the credibility of a claim in a reasonable person’s mind. However, common statistics, such as significance testing and confidence intervals have no interface with concepts of belief, and thus it is unclear how they relate to statistical evidence. We explore the concept of statistical evidence, and how it can be quantified using the Bayes factor. We also discuss the philosophical issues inherent in the use of the Bayes factor.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Jeffreys, H., Moran, P. A. P., & Chatfield, C. (1922) · Nature · doi:10.1093/oso/9780198503682.001.0001 · Cited by 7,878
Subjective probability: A judgment of representativeness
Kahneman, D., & Tversky, A. (1972) · Cognitive Psychology · doi:10.1016/0010-0285(72)90016-3 · Cited by 4,851
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Self-citationThe gender similarities hypothesis.
Hyde, J. S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.6.581 · Cited by 3,084
The Logic of Scientific Discovery
Popper, K. R., & Weiss, G. (1959) · Physics Today · doi:10.1063/1.3060577 · Cited by 2,717
An invariant form for the prior probability in estimation problems
Jeffreys, H. (1946) · Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences · doi:10.1098/rspa.1946.0056 · Cited by 2,323
Foundations of Mathematics and other Logical Essays
Ramsey, F. P. (2013) · Routledge eBooks · doi:10.4324/9781315887814 · Cited by 1,994
Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
Diciccio, T. J., Kass, R. E., Raftery, A., & Wasserman, L. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474045 · Cited by 1,943
Default Bayes factors for ANOVA designs
Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2012.08.001 · Cited by 1,800
Self-citationBayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Scientific Realism: How Science Tracks Truth
Psillos, S. (1999) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,704
Robustness in the Strategy of Scientific Model Building
Box, G. E. P. (1979) · Robustness in Statistics · doi:10.1016/b978-0-12-438150-6.50018-2 · Cited by 1,562
The SAGE Handbook of Quantitative Methodology for the Social Sciences
Kaplan, D. (2004) · doi:10.4135/9781412986311 · Cited by 1,454
Halpern, J. Y. (2017) · The MIT Press eBooks · doi:10.7551/mitpress/10951.001.0001 · Cited by 1,336
Probability, Frequency and Reasonable Expectation
Cox, R. T. (1946) · American Journal of Physics · doi:10.1119/1.1990764 · Cited by 1,308
Ramsey, F. P. (2016) · Readings in Formal Epistemology · doi:10.1007/978-3-319-20451-2_3 · Cited by 1,301
Genome evolution and adaptation in a long-term experiment with Escherichia coli
Barrick, J. E., Yu, D. S., Yoon, S. H., Jeong, H., Oh, T. K., Schneider, D., Lenski, R. E., & Kim, J. F. (2009) · Nature · doi:10.1038/nature08480 · Cited by 1,184 · cited 2×
“…evidence, whether this evidence is used to understand global climate change (Lawrimore et al., 2011), examine whether the Higgs Boson exists (Low, Lykken, & Shaughnessy, 2012), explore the evolution of bacteria (Barrick et al., 2009), or to describe human reasoning (Kahneman & Tversky, 1972).”
BackgroundReference Posterior Distributions for Bayesian Inference
Bernardo, J. M. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01066.x · Cited by 1,095
Mixtures of g Priors for Bayesian Variable Selection
Liang, F., Paulo, R., Molina, G., Clyde, M. A., & Berger, J. O. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000001337 · Cited by 1,089
Schervish, M. J. (1995) · Springer Series in Statistics · doi:10.1007/978-1-4612-4250-5 · Cited by 1,046
The Intrinsic Bayes Factor for Model Selection and Prediction
Berger, J. O., & Pericchi, L. R. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476668 · Cited by 1,007
Bogen, J., & Woodward, J. (1988) · The Philosophical Review · doi:10.2307/2185445 · Cited by 938
Philosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2011.02037.x · Cited by 825
Veltman, F. (1996) · Journal of Philosophical Logic · doi:10.1007/bf00248150 · Cited by 822
Statistical Evidence: A Likelihood Paradigm
Reeves, J. H., & Royall, R. M. (1998) · Journal of the American Statistical Association · doi:10.2307/2669869 · Cited by 814
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478397 · Cited by 775
A Nonpragmatic Vindication of Probabilism
Joyce, J. M. (1998) · Philosophy of Science · doi:10.1086/392661 · Cited by 770
Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method
Wagenmakers, E.-J., Lodewyckx, T., Kuriyal, H., & Grasman, R. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2009.12.001 · Cited by 740
The case for objective Bayesian analysis
Berger, J. (2006) · Bayesian Analysis · doi:10.1214/06-ba115 · Cited by 728
Philosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2010) · Cited by 709
van Meter, K. M. (1994) · Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique · doi:10.1177/075910639404200102 · Cited by 675
The Logic of Scientific Discovery
Jeffrey, R. C., & Popper, K. R. (1960) · Econometrica · doi:10.2307/1907578 · Cited by 674
Fractional Bayes Factors for Model Comparison
O'Hagan, A. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02017.x · Cited by 671
Dawid, A. P. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477856 · Cited by 625 · cited 1×
“It may be thought that the context-sensitivity of evidence is more pronounced in Bayesian statistics, because a Bayesian inference is closed-minded about which hypotheses can be true: after the prior has been chosen, hypotheses with zero probability cannot enter the theory (cf. Dawid, 1982).”
BackgroundBerger, J. O., & Wolpert, R. L. (1988) · doi:10.1214/lnms/1215466210 · Cited by 616
Logic of Statistical Inference.
Dempster, A. P., & Hacking, I. (1966) · Journal of the American Statistical Association · doi:10.2307/2283215 · Cited by 599
Lawrimore, J. H., Menne, M. J., Gleason, B. E., Williams, C. N., Wuertz, D. B., Vose, R. S., & Rennie, J. (2011) · Journal of Geophysical Research · doi:10.1029/2011jd016187 · Cited by 598 · cited 2×
“Researchers assume that data – if properly analyzed – provide evidence, whether this evidence is used to understand global climate change (Lawrimore et al., 2011), examine whether the Higgs Boson exists (Low, Lykken, & Shaughnessy, 2012), explore the evolution of bacteria (Barrick et al., 2009), or…”
BackgroundStatistical Methods and Scientific Induction
Fisher, R. (1955) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1955.tb00180.x · Cited by 596
Bayes factor approaches for testing interval null hypotheses.
Morey, R. D., & Rouder, J. N. (2011) · Psychological Methods · doi:10.1037/a0024377 · Cited by 582
Self-citationTesting a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.2307/2289131 · Cited by 548
Posterior odds ratios for selected regression hypotheses
Zellner, A., & Siow, A. (1980) · Trabajos de Estadistica Y de Investigacion Operativa · doi:10.1007/bf02888369 · Cited by 463
Fisher, R. A. (1930) · Mathematical Proceedings of the Cambridge Philosophical Society · doi:10.1017/s0305004100016297 · Cited by 455
Robust misinterpretation of confidence intervals
Hoekstra, R., Morey, R. D., Rouder, J. N., & Wagenmakers, E.-J. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0572-3 · Cited by 425
Self-citationStatistical Inference: A Commentary for the Social and Behavioural Sciences
Oakes, M. W. (1986) · Medical Entomology and Zoology · Cited by 388
Aitkin, M. (1991) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1991.tb01812.x · Cited by 354
The Structure of Scientific Revolutions.
Barber, B., & Kuhn, T. S. (1963) · American Sociological Review · doi:10.2307/2090620 · Cited by 336
A comment on D. V. Lindley's statistical paradox
BARTLETT, M. S. (1957) · Biometrika · doi:10.1093/biomet/44.3-4.533 · Cited by 324
Climate Change Skepticism and Denial: An Introduction
Dunlap, R. E. (2013) · American Behavioral Scientist · doi:10.1177/0002764213477097 · Cited by 295
Bayes Factors for Linear and Log‐Linear Models with Vague Prior Information
Spiegelhalter, D. J., & Smith, A. F. M. (1982) · Journal of the Royal Statistical Society: Series B (Methodological) · doi:10.1111/j.2517-6161.1982.tb01217.x · Cited by 289
On the Development of Reference Priors*
Berger, J. O., & Bernardo, J. M. (1992) · Bayesian Statistics 4 · doi:10.1093/oso/9780198522669.003.0003 · Cited by 287
Theory of Probability (3rd Edition)
Litton, C. D. (1984) · Journal of the Operational Research Society · doi:10.1057/jors.1984.141 · Cited by 282
On the use of Non-Local Prior Densities in Bayesian Hypothesis Tests
Johnson, V. E., & Rossell, D. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2009.00730.x · Cited by 279
The Weighted Likelihood Ratio, Sharp Hypotheses about Chances, the Order of a Markov Chain
Dickey, J. M., & Lientz, B. P. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697203 · Cited by 251
Misinterpretations of Significance: A Problem Students Share with Their Teachers?
Haller, H., & Krauss, S. (2002) · IPN - Institute for Science Education at the University of Kiel, Germany · doi:10.23668/psycharchives.12769 · Cited by 250
Subjective Bayesian Analysis: Principles and Practice
Goldstein, M. (2006) · Bayesian Analysis · doi:10.1214/06-ba116 · Cited by 214
The Null Ritual: What You Always Wanted to Know About Significance Testing but Were Afraid to Ask
Gigerenzer, G., Krauss, S., & Vitouch, O. (2004) · The SAGE Handbook of Quantitative Methodology for the Social Sciences · doi:10.4135/9781412986311.n21 · Cited by 205
Bayesian Versus Frequentist Inference
Wagenmakers, E.-J., Lee, M., Lodewyckx, T., & Iverson, G. J. (2008) · Bayesian Evaluation of Informative Hypotheses · doi:10.1007/978-0-387-09612-4_9 · Cited by 205
Have we observed the Higgs boson (imposter)?
Low, I., Lykken, J., & Shaughnessy, G. (2012) · Physical review. D. Particles, fields, gravitation, and cosmology/Physical review. D. Particles and fields · doi:10.1103/physrevd.86.093012 · Cited by 198
GOOD, I. J. (1979) · Biometrika · doi:10.1093/biomet/66.2.393 · Cited by 196
Matlin, M. W. (1987) · Medical Entomology and Zoology · Cited by 167
Prior sensitivity in theory testing: An apologia for the Bayes factor
Vanpaemel, W. (2010) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2010.07.003 · Cited by 164
Model Selection Based on Minimum Description Length
Grünwald, P. (2000) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1280 · Cited by 163
Bayes factors: Prior sensitivity and model generalizability
Liu, C. C., & Aitkin, M. (2008) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.03.002 · Cited by 163
Posterior Probabilities for Choosing a Regression Model
Atkinson, A. C. (1978) · Biometrika · doi:10.1093/biomet/65.1.39 · Cited by 150
Avoiding Model Selection in Bayesian Social Research
Gelman, A., & Rubin, D. B. (1995) · Sociological Methodology · doi:10.2307/271064 · Cited by 148
When decision heuristics and science collide
Yu, E. C., Sprenger, A. M., Thomas, R. P., & Dougherty, M. R. P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0495-z · Cited by 82
Evidence, Inference and Enquiry
(2011) · British Academy eBooks · doi:10.5871/bacad/9780197264843.001.0001 · Cited by 81
The frequentist implications of optional stopping on Bayesian hypothesis tests
Sanborn, A. N., & Hills, T. T. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0518-9 · Cited by 77
de Finetti, B. (1995) · Philosophical Studies · doi:10.1007/bf00996317 · Cited by 74
Logic of Statistical Inference.
Bartlett, M. S., & Hacking, I. (1966) · Biometrika · doi:10.2307/2333679 · Cited by 60
The humble Bayesian: Model checking from a fully Bayesian perspective
Morey, R. D., Romeijn, J., & Rouder, J. N. (2012) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2012.02067.x · Cited by 48
Self-citationRomeijn, J. (2014) · Stanford encyclopedia of philosophy · Cited by 39
Self-citationMayo, D. G. (2012) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2012.02064.x · Cited by 31
DeGroot, M. H. (1982) · Journal of the American Statistical Association · doi:10.2307/2287246 · Cited by 25
Pettigrew, R. (2013) · dialectica · doi:10.1111/1746-8361.12043 · Cited by 23
Romeijn, J. (2013) · Journal of Applied Logic · doi:10.1016/j.jal.2012.09.003 · Cited by 14
Self-citation
Cited by
Bayes factor design analysis: Planning for compelling evidence
Schönbrodt, F. D., & Wagenmakers, E.-J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1230-y · Cited by 729
Four reasons to prefer Bayesian analyses over significance testing
Dienes, Z., & Mclatchie, N. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1266-z · Cited by 354
Bayesian Benefits for the Pragmatic Researcher
Wagenmakers, E.-J., Morey, R. D., & Lee, M. D. (2016) · Current Directions in Psychological Science · doi:10.1177/0963721416643289 · Cited by 334
Self-citationImproving inferences about null effects with Bayes factors and equivalence tests.
Lakens, D., McLatchie, N., Isager, P. M., Scheel, A. M., & Dienes, Z. (2020) · The Journals of Gerontology: Series B · doi:10.1093/geronb/gby065 · Cited by 279
Cognitive and Neural Bases of Multi-Attribute, Multi-Alternative, Value-based Decisions
Busemeyer, J. R., Gluth, S., Rieskamp, J., & Turner, B. M. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.003 · Cited by 267
Metadata
- Authors
- Morey, R. D., Romeijn, J.-W., & Rouder, J. N.
- Venue
- Journal of Mathematical Psychology
- Publisher
- Elsevier BV
- Published
- 2016-06
- Volume
- 72
- Pages
- 6-18
- ISSN
- 0022-2496 (ISSN-L)
- OpenAlex
- W2187180375
- Cited by
- 313
- References
- 78
- FWCI
- 35.71
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.