Likelihood-free estimation of model evidence
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Statistical methods of inference typically require the likelihood function to be computable in a reasonable amount of time. The class of "likelihood-free" methods termed Approximate Bayesian Computation (ABC) is able to eliminate this requirement, replacing the evaluation of the likelihood with simulation from it. Likelihood-free methods have gained in efficiency and popularity in the past few years, following their integration with Markov Chain Monte Carlo (MCMC) and Sequential Monte Carlo (SMC) in order to better explore the parameter space. They have been applied primarily to estimating the parameters of a given model, but can also be used to compare models. Here we present novel likelihood-free approaches to model comparison, based upon the independent estimation of the evidence of each model under study. Key advantages of these approaches over previous techniques are that they allow the exploitation of MCMC or SMC algorithms for exploring the parameter space, and that they do not require a sampler able to mix between models. We validate the proposed methods using a simple exponential family problem before providing a realistic problem from human population genetics: the comparison of different demographic models based upon genetic data from the Y chromosome.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Toni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498
Markov chain Monte Carlo without likelihoods
Marjoram, P., Molitor, J., Plagnol, V., & Tavaré, S. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0306899100 · Cited by 1,199 · cited 10×
“This is analogous to the necessity to use non-sufficient statistic in standard ABC (where sampling of parameters is the aim) when complex model and data are involved (Beaumont et al., 2002; Marjoram et al., 2003).”
BackgroundMethodInfluentialSimulation-based model selection for dynamical systems in systems and population biology
Toni, T., & Stumpf, M. P. H. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp619 · Cited by 260
Thornton, K., & Andolfatto, P. (2006) · Genetics · doi:10.1534/genetics.105.048223 · Cited by 256 · cited 2×
“Methods to test the fit of a model without explicit comparison to other models (i.e. Bayesian model criticism) have been proposed by Thornton and Andolfatto (2006) who computed posterior predictive p -values (Meng, 1994), and by Ratmann et al. (2009) who extended a model with additional error terms,…”
MethodApproximate Bayesian computation (ABC) gives exact results under the assumption of model error
Wilkinson, R. D. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2013-0010 · Cited by 247 · cited 1×
“It is interesting to note that the use of such an approximate kernel π † in the ABC Algorithm 2 can be interpreted as exact sampling under a model where uniform additive error terms exist (Wilkinson, 2008).”
ABC likelihood-free methods for model choice in Gibbs random fields
Grelaud, A., Marin, J.-M., Robert, C. P., Rodolphe, F., & Taly, J.-F. (2009) · Bayesian Analysis · doi:10.1214/09-ba412 · Cited by 119
On sequential Monte Carlo, partial rejection control and approximate Bayesian computation
Peters, G. W., Fan, Y., & Sisson, S. A. (2012) · Statistics and Computing · doi:10.1007/s11222-012-9315-y · Cited by 69 · cited 1×
“A number of sophisticated methodological techniques have been described in recent years and could be directly applied in the model selection context (Peters et al. 2008; Del Moral et al. 2008; Fearnhead and Prangle 2010).”
Method
Cited by
Approximate Bayesian computational methods
Marin, J.-M., Pudlo, P., Robert, C. P., & Ryder, R. J. (2012) · Statistics and Computing · doi:10.1007/s11222-011-9288-2 · Cited by 818
Approximate Bayesian Computation
Sunnåker, M., Busetto, A. G., Numminen, E., Corander, J., Foll, M., & Dessimoz, C. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002803 · Cited by 623
Fearnhead, P., & Prangle, D. (2012) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.01010.x · Cited by 567
Statistical inference for stochastic simulation models - theory and application
Hartig, F., Calabrese, J. M., Reineking, B., Wiegand, T., & Huth, A. (2011) · Ecology Letters · doi:10.1111/j.1461-0248.2011.01640.x · Cited by 384
Reliable ABC model choice via random forests
Pudlo, P., Marin, J.-M., Estoup, A., Cornuet, J.-M., Gautier, M., & Robert, C. P. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv684 · Cited by 384
Metadata
- Authors
- Didelot, X., Everitt, R. G., Johansen, A. M., & Lawson, D. J.
- Venue
- Bayesian Analysis
- Publisher
- Institute of Mathematical Statistics
- Published
- 2011-03-01
- Volume
- 6
- Issue
- 1
- Pages
- 49-76
- ISSN
- 1931-6690 (ISSN-L)
- 1936-0975
- OpenAlex
- W2000186700
- Cited by
- 109
- References
- 7
- FWCI
- 9.74
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.