Is the Jeffreys' scale a reliable tool for Bayesian model comparison in cosmology?
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
We are entering an era where progress in cosmology is driven by data, and alternative models will have to be compared and ruled out according to some consistent criterium. The most conservative and widely used approach is Bayesian model comparison. In this paper we explicitly calculate the Bayes factors for all models that are linear with respect to their parameters. We do this in order to test the so called Jeffreys' scale and determine analytically how accurate its predictions are in a simple case where we fully understand and can calculate everything analytically. We also discuss the case of nested models, e.g. one with M 1 and another with M 2 ⊃ M 1 parameters and we derive analytic expressions for both the Bayes factor and the figure of Merit, defined as the inverse area of the model parameter's confidence contours. With all this machinery and the use of an explicit example we demonstrate that the threshold nature of Jeffreys' scale is not a ``one size fits all'' reliable tool for model comparison and that it may lead to biased conclusions. Furthermore, we discuss the importance of choosing the right basis in the context of models that are linear with respect to their parameters and how that basis affects the parameter estimation and the derived constraints.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Probability Theory: The Logic of Science
Jaynes, E. T. (2003) · doi:10.1017/cbo9780511790423 · Cited by 4,045
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.2307/2289131 · Cited by 548
The interplay of Bayesian and frequentist analysis
Bayarri, M. J., & Berger, J. O. (2004) · Statistical Science · doi:10.1214/088342304000000116 · Cited by 525 · cited 2×
“The Jeffreys’ scale revisited In this section we will present results related to the Bayes factor Bij (see Refs [32], [33], [34], [35] and references there-in for more details) in the context of our simple model.”
Method
Cited by
Early Dark Energy can Resolve the Hubble Tension
Poulin, V., Smith, T. L., Karwal, T., & Kamionkowski, M. (2019) · Physical Review Letters · doi:10.1103/physrevlett.122.221301 · Cited by 1,014
Challenges for Λ CDM: An update
Perivolaropoulos, L., & Skara, F. (2022) · New Astronomy Reviews · doi:10.1016/j.newar.2022.101659 · Cited by 902
BeyondΛCDM: Problems, solutions, and the road ahead
Bull, P., Akrami, Y., Adamek, J., Baker, T., Bellini, E., Beltrán Jiménez, J., Bentivegna, E., Camera, S., Clesse, S., Davis, J. H., et al. (2016) · Physics of the Dark Universe · doi:10.1016/j.dark.2016.02.001 · Cited by 567
The $H_0$ Olympics: A fair ranking of proposed models
Schöneberg, N., Abellán, G. F., Sánchez, A. P., Witte, S. J., Poulin, V., & Lesgourgues, J. (2021) · arXiv · doi:10.48550/arxiv.2107.10291 · Cited by 463
The H 0 Olympics: A fair ranking of proposed models
Schöneberg, N., Abellán, G. F., Sánchez, A. P., Witte, S. J., Poulin, V., & Lesgourgues, J. (2022) · Physics Reports · doi:10.1016/j.physrep.2022.07.001 · Cited by 462
Metadata
- Authors
- Nesseris, S., & García-Bellido, J.
- Venue
- Journal of Cosmology and Astroparticle Physics
- Publisher
- IOP Publishing
- Published
- 2013-08-20
- Volume
- 2013
- Issue
- 08
- Pages
- 036-036
- ISSN
- 1475-7508 (ISSN-L)
- 1475-7516
- OpenAlex
- W2005098187
- Cited by
- 141
- References
- 4
- FWCI
- 2.55
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Is the Jeffreys' scale a reliable tool for Bayesian model comparison in cosmology? https://app.cochat.ai/papers/10.1088/1475-7516/2013/08/036
- The paper
- Nesseris, S., & García-Bellido, J. (2013). Is the Jeffreys' scale a reliable tool for Bayesian model comparison in cosmology? Journal of Cosmology and Astroparticle Physics. https://doi.org/10.1088/1475-7516/2013/08/036
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.