The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Importance Nested Sampling and the MultiNest Algorithm
Open accessAbstract
Bayesian inference involves two main computational challenges. First, in estimating the parameters of some model for the data, the posterior distribution may well be highly multi-modal: a regime in which the convergence to stationarity of traditional Markov Chain Monte Carlo (MCMC) techniques becomes incredibly slow. Second, in selecting between a set of competing models the necessary estimation of the Bayesian evidence for each is, by definition, a (possibly high-dimensional) integration over the entire parameter space; again this can be a daunting computational task, although new Monte Carlo (MC) integration algorithms offer solutions of ever increasing efficiency. Nested sampling (NS) is one such contemporary MC strategy targeted at calculation of the Bayesian evidence, but which also enables posterior inference as a by-product, thereby allowing simultaneous parameter estimation and model selection. The widely-used MultiNest algorithm presents a particularly efficient implementation of the NS technique for multi-modal posteriors. In this paper we discuss importance nested sampling (INS), an alternative summation of the MultiNest draws, which can calculate the Bayesian evidence at up to an order of magnitude higher accuracy than `vanilla' NS with no change in the way MultiNest explores the parameter space. This is accomplished by treating as a (pseudo-)importance sample the totality of points collected by MultiNest, including those previously discarded under the constrained likelihood sampling of the NS algorithm. We apply this technique to several challenging test problems and compare the accuracy of Bayesian evidences obtained with INS against those from vanilla NS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PE, & Billingsley, P. (1996) · Journal of the American Statistical Association · doi:10.2307/2291440 · Cited by 6,481
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Information Theory, Inference, and Learning Algorithms
(2004) · Kybernetes · doi:10.1108/03684920410534506 · Cited by 4,937
On the Convergence Properties of the EM Algorithm
Wu, C. F. J. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346060 · Cited by 3,269
Monte Carlo Strategies in Scientific Computing
Liu, J. S. (2004) · Springer Series in Statistics · doi:10.1007/978-0-387-76371-2 · Cited by 2,690
dynesty: a dynamic nested sampling package for estimating Bayesian posteriors and evidences
Speagle, J. S. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa278 · Cited by 2,230
Nested sampling for general Bayesian computation
Skilling, J. (2006) · Bayesian Analysis · doi:10.1214/06-ba127 · Cited by 1,670
Feroz, F., & Hobson, M. P. (2008) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2007.12353.x · Cited by 1,658
Self-citationData analysis: a Bayesian tutorial
(1997) · Choice Reviews Online · doi:10.5860/choice.34-5742 · Cited by 1,630
MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physicsPreprint
Feroz, F., Hobson, M., & Bridges, M. (2013) · Cited by 1,299
Self-citationRubinstein, R. Y., & Kroese, D. P. (2004) · Medical Entomology and Zoology · Cited by 1,074
Data Analysis: A Bayesian Tutorial
Fox, E. P. (1998) · Technometrics · doi:10.1080/00401706.1998.10485200 · Cited by 647
Bayes in the sky: Bayesian inference and model selection in cosmologyPreprint
Trotta, R. (2013) · Cited by 574
polychord: nested sampling for cosmology
Handley, W. J., Hobson, M. P., & Lasenby, A. N. (2015) · Monthly Notices of the Royal Astronomical Society: Letters · doi:10.1093/mnrasl/slv047 · Cited by 505
Self-citationpolychord: next-generation nested sampling
Handley, W. J., Hobson, M. P., & Lasenby, A. N. (2015) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv1911 · Cited by 500
Self-citationStrong Consistency of $K$-Means Clustering
Pollard, D. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345339 · Cited by 454
Safe and Effective Importance Sampling
Owen, A., & Zhou, Y. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473909 · Cited by 392
Empirical Distributions in Selection Bias Models
Vardi, Y. (1985) · The Annals of Statistics · doi:10.1214/aos/1176346585 · Cited by 382
A Nested Sampling Algorithm for Cosmological Model Selection
Mukherjee, P., Parkinson, D., & Liddle, A. R. (2006) · The Astrophysical Journal · doi:10.1086/501068 · Cited by 355
Starck, J., & Murtagh, F. D. (2001) · Cited by 324
Dynamic nested sampling: an improved algorithm for parameter estimation and evidence calculation
Higson, E., Handley, W., Hobson, M., & Lasenby, A. (2019) · Statistics and Computing · doi:10.1007/s11222-018-9844-0 · Cited by 317
Self-citationBidirectional Estimators for Light Transport
Veach, E., & Guibas, L. (1995) · Springer eBooks · doi:10.1007/978-3-642-87825-1_11 · Cited by 275
Bayesian coherent analysis of in-spiral gravitational wave signals with a detector network
Veitch, J., & Vecchio, A. (2010) · Physical Review D · doi:10.1103/physrevd.81.062003 · Cited by 271
Adaptive Multiple Importance Sampling
CORNUET, J., MARIN, J., MIRA, A., & ROBERT, C. P. (2012) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2011.00756.x · Cited by 231
Dapor, M. (2014) · Springer Tracts in Modern Physics · doi:10.1007/978-3-319-03883-4_5 · Cited by 196
Theory of binless multi-state free energy estimation with applications to protein-ligand binding
Tan, Z., Gallicchio, E., Lapelosa, M., & Levy, R. M. (2012) · The Journal of Chemical Physics · doi:10.1063/1.3701175 · Cited by 179
THE HUNT FOR EXOMOONS WITH KEPLER(HEK). I. DESCRIPTION OF A NEW OBSERVATIONAL PROJECT
Kipping, D. M., Bakos, G. Á., Buchhave, L., Nesvorný, D., & Schmitt, A. (2012) · The Astrophysical Journal · doi:10.1088/0004-637x/750/2/115 · Cited by 177
A Theory of Statistical Models for Monte Carlo Integration
Kong, A., McCullagh, P. J., Meng, X., Nicolae, D. L., & Tan, Z. (2003) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/1467-9868.00404 · Cited by 144
Efficient Bayesian inference for multimodal problems in cosmology
Shaw, J. R., Bridges, M., & Hobson, M. (2007) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2007.11871.x · Cited by 131
Self-citationOn Monte Carlo methods for estimating ratios of normalizing constants
Chen, M., & Shao, Q.-M. (1997) · The Annals of Statistics · doi:10.1214/aos/1031594732 · Cited by 108
Detecting extrasolar planets from stellar radial velocities using Bayesian evidence
Feroz, F., Balan, S. T., & Hobson, M. (2011) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2011.18962.x · Cited by 106
Self-citationSobol, I. M. (1971) · Medical Entomology and Zoology · Cited by 84
Karpenka, N. V., Feroz, F., & Hobson, M. (2012) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sts412 · Cited by 64
Self-citationRecursive Pathways to Marginal Likelihood Estimation with Prior-Sensitivity Analysis
Cameron, E., & Pettitt, A. N. (2014) · Statistical Science · doi:10.1214/13-sts465 · Cited by 54
Self-citationBayesian optimal reconstruction of the primordial power spectrumPreprint
Bridges, M., Feroz, F., Hobson, M., & Lasenby, A. N. (2008) · Cited by 44
Self-citationCurrent Challenges in Bayesian Model Choice
Clyde, M. A., Berger, J. O., Bullard, F., Ford, E. B., Jefferys, W. H., Luo, R., Paulo, R., & Loredo, T. J. (2007) · ASPC · Cited by 30
Recent Results on Random Polytopes
Schneider, R. (2008) · Bollettino Della Unione Matematica Italiana · Cited by 29
Initializing adaptive importance sampling with Markov chainsPreprint
Beaujean, F., & Caldwell, A. C. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1304.7808 · Cited by 27
Bayesian constraints on dark matter halo properties using gravitationally lensed supernovae
Karpenka, N. V., March, M. C., Feroz, F., & Hobson, M. (2013) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sts700 · Cited by 20
Self-citationBayesian evidence for two companions orbiting HIP 5158Preprint
Feroz, F. (2013) · Cited by 13
Self-citation
Cited by
Planck 2018 results: X. Constraints on inflation
Planck Collaboration, Akrami, Y., Arroja, F., Ashdown, M., Aumont, J., Baccigalupi, C., Ballardini, M., Banday, A. J., Barreiro, R. B., Bartolo, N., et al. (2020) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201833887 · Cited by 2,442
dynesty: a dynamic nested sampling package for estimating Bayesian posteriors and evidences
Speagle, J. S. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa278 · Cited by 2,230
Ade, P. A. R., Aghanim, N., Arnaud, M., Arroja, F. M. A., Ashdown, M., Aumont, J., Baccigalupi, C., Ballardini, M., Banday, A. J., Barreiro, R. B., et al. (2016) · ORCA Online Research @Cardiff (Cardiff University) · doi:10.17863/cam.52 · Cited by 1,932
Self-citationPlanck 2013 results. XXII. Constraints on inflation
Planck Collaboration, Ade, P. A. R., Aghanim, N., Armitage-Caplan, C., Arnaud, M., Ashdown, M., Atrio-Barandela, F., Aumont, J., Baccigalupi, C., Banday, A. J., et al. (2014) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201321569 · Cited by 1,082
Self-citationVeitch, J., Raymond, V., Farr, B., Farr, W., Graff, P., Vitale, S., Aylott, B., Blackburn, K., Christensen, N., Coughlin, M., et al. (2015) · Physical Review D · doi:10.1103/physrevd.91.042003 · Cited by 958
Self-citation
Metadata
- Authors
- Feroz, F., Hobson, M. P., Cameron, E., & Pettitt, A. N.
- Venue
- The Open Journal of Astrophysics
- Publisher
- Maynooth University
- Published
- 2019-11-27
- Volume
- 2
- Issue
- 1
- ISSN
- 2565-6120 (ISSN-L)
- OpenAlex
- W1886713477
- Cited by
- 973
- References
- 40
- FWCI
- 79.40
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.