The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
dynesty: a dynamic nested sampling package for estimating Bayesian posteriors and evidences
Open accessAbstract
We present dynesty, a public, open-source, python package to estimate Bayesian posteriors and evidences (marginal likelihoods) using the dynamic nested sampling methods developed by Higson et al. By adaptively allocating samples based on posterior structure, dynamic nested sampling has the benefits of Markov chain Monte Carlo (MCMC) algorithms that focus exclusively on posterior estimation while retaining nested sampling’s ability to estimate evidences and sample from complex, multimodal distributions. We provide an overview of nested sampling, its extension to dynamic nested sampling, the algorithmic challenges involved, and the various approaches taken to solve them in this and previous work. We then examine dynesty’s performance on a variety of toy problems along with several astronomical applications. We find in particular problems dynesty can provide substantial improvements in sampling efficiency compared to popular MCMC approaches in the astronomical literature. More detailed statistical results related to nested sampling are also included in the appendix.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Matplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
<tt>emcee</tt>: The MCMC Hammer
Foreman-Mackey, D., Hogg, D. W., Lang, D., & Goodman, J. (2013) · Publications of the Astronomical Society of the Pacific · doi:10.1086/670067 · Cited by 12,414
The Sloan Digital Sky Survey: Technical Summary
York, D. G., Adelman, J., Anderson, Jr., Anderson, S. F., Annis, J., Bahcall, N. A., Bakken, J. A., Barkhouser, R., Bastian, S., Berman, E., et al. (2000) · The Astronomical Journal · doi:10.1086/301513 · Cited by 10,366
The NumPy Array: A Structure for Efficient Numerical Computation
van der Walt, S., Colbert, S. C., & Varoquaux, G. (2011) · Computing in Science & Engineering · doi:10.1109/mcse.2011.37 · Cited by 9,381
Gaia Data Release 2: Summary of the contents and survey properties
Gaia Collaboration, Brown, A. G. A., Vallenari, A., Prusti, T., de Bruijne, J. H. J., Babusiaux, C., Bailer-Jones, C. A. L., Biermann, M., Evans, D. W., Eyer, L., et al. (2018) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201833051 · Cited by 8,442
Stan : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754
On the mathematical foundations of theoretical statistics
Fisher, R. A. (1922) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1922.0009 · Cited by 4,039
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1285773 · Cited by 3,811
Python for scientific computing
Oliphant, T. E. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.58 · Cited by 3,303 · cited 1×
“This work has benefited from several software packages including numpy (van der Walt et al. 2011), scipy (Oliphant 2007), matplotlib (Hunter 2007), and corner (ForemanMackey 2016).”
MethodEnsemble samplers with affine invariance
Goodman, J., & Weare, J. (2010) · Communications in Applied Mathematics and Computational Science · doi:10.2140/camcos.2010.5.65 · Cited by 3,075
Handbook of Markov Chain Monte Carlo
Brooks, S., Gelman, A., Jones, G., & Meng, X.-L. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905 · Cited by 2,993
MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
Feroz, F., Hobson, M. P., & Bridges, M. (2009) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2009.14548.x · Cited by 2,958
MCMC Using Hamiltonian Dynamics
Neal, R. M. (2011) · Handbook of Markov Chain Monte Carlo · doi:10.1201/b10905-6 · Cited by 2,574
corner.py: Scatterplot matrices in Python
Foreman-Mackey, D. (2016) · The Journal of Open Source Software · doi:10.21105/joss.00024 · Cited by 2,193
Ade, P. A. R., Aghanim, N., Arnaud, M., Arroja, F. M. A., Ashdown, M., Aumont, J., Baccigalupi, C., Ballardini, M., Banday, A. J., Barreiro, R. B., et al. (2016) · ORCA Online Research @Cardiff (Cardiff University) · doi:10.17863/cam.52 · Cited by 1,932
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. (2017) · Figshare · doi:10.6084/m9.figshare.5203696 · Cited by 1,919
Vehtari, A., Gelman, A., Simpson, D., Carpenter, B., & Bürkner, P.-C. (2021) · Bayesian Analysis · doi:10.1214/20-ba1221 · Cited by 1,810
The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
Hoffman, M. D., & Gelman, A. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1111.4246 · Cited by 1,713
Nested sampling for general Bayesian computation
Skilling, J. (2006) · Bayesian Analysis · doi:10.1214/06-ba127 · Cited by 1,670
Feroz, F., & Hobson, M. P. (2008) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2007.12353.x · Cited by 1,658
Data analysis: a Bayesian tutorial
(1997) · Choice Reviews Online · doi:10.5860/choice.34-5742 · Cited by 1,630
Planck 2015 results: XX. Constraints on inflation
Planck Collaboration, Ade, P. A. R., Aghanim, N., Arnaud, M., Arroja, F., Ashdown, M., Aumont, J., Baccigalupi, C., Ballardini, M., Banday, A. J., et al. (2016) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201525898 · Cited by 1,399
Neal, R. M. (2003) · The Annals of Statistics · doi:10.1214/aos/1056562461 · Cited by 1,361
MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physicsPreprint
Feroz, F., Hobson, M., & Bridges, M. (2013) · Cited by 1,299
Bayes in the sky: Bayesian inference and model selection in cosmology
Trotta, R. (2008) · Contemporary Physics · doi:10.1080/00107510802066753 · Cited by 1,253
Bilby: A User-friendly Bayesian Inference Library for Gravitational-wave Astronomy
Ashton, G., Hübner, M., Lasky, P. D., Talbot, C., Ackley, K., Biscoveanu, S., Chu, Q., Divakarla, A., Easter, P. J., Goncharov, B., et al. (2019) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/ab06fc · Cited by 1,138
Importance Nested Sampling and the MultiNest Algorithm
Feroz, F., Hobson, M. P., Cameron, E., & Pettitt, A. N. (2019) · The Open Journal of Astrophysics · doi:10.21105/astro.1306.2144 · Cited by 973
Being Sensitive to Uncertainty
Arriola, L. M., & Hyman, J. M. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.27 · Cited by 953
Skilling, J. (2004) · AIP Conference Proceedings · doi:10.1063/1.1835238 · Cited by 925
Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
GEMAN, S., & GEMAN, D. (1987) · Readings in Computer Vision · doi:10.1016/b978-0-08-051581-6.50057-x · Cited by 750
3D-HST: A WIDE-FIELD GRISM SPECTROSCOPIC SURVEY WITH THE HUBBLE SPACE TELESCOPE
Brammer, G. B., van Dokkum, P. G., Franx, M., Fumagalli, M., Patel, S., Rix, H.-W., Skelton, R. E., Kriek, M., Nelson, E., Schmidt, K. B., et al. (2012) · The Astrophysical Journal Supplement Series · doi:10.1088/0067-0049/200/2/13 · Cited by 693
Computing Bayes factors using thermodynamic integration.
Lartillot, N., & Philippe, H. (2006) · Systematic Biology · doi:10.1080/10635150500433722 · Cited by 668
Data Analysis: A Bayesian Tutorial
Fox, E. P. (1998) · Technometrics · doi:10.1080/00401706.1998.10485200 · Cited by 647
Bayes in the sky: Bayesian inference and model selection in cosmologyPreprint
Trotta, R. (2013) · Cited by 574
How to Measure Galaxy Star Formation Histories. II. Nonparametric Models
Leja, J., Carnall, A. C., Johnson, B. D., Conroy, C., & Speagle, J. S. (2019) · The Astrophysical Journal · doi:10.3847/1538-4357/ab133c · Cited by 540
Self-citationLeja, J., Johnson, B. D., Conroy, C., Dokkum, P. G. V., & Byler, N. (2017) · The Astrophysical Journal · doi:10.3847/1538-4357/aa5ffe · Cited by 516
A Conceptual Introduction to Hamiltonian Monte Carlo
Betancourt, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.02434 · Cited by 509
polychord: nested sampling for cosmology
Handley, W. J., Hobson, M. P., & Lasenby, A. N. (2015) · Monthly Notices of the Royal Astronomical Society: Letters · doi:10.1093/mnrasl/slv047 · Cited by 505
On Resampling Algorithms for Particle Filters
Hol, J. D., Schon, T. B., & Gustafsson, F. (2006) · 2006 IEEE Nonlinear Statistical Signal Processing Workshop · doi:10.1109/nsspw.2006.4378824 · Cited by 400
An Introduction to Probability
(2018) · Probability, Decisions and Games · doi:10.1002/9781119302643.ch1 · Cited by 367
A Nested Sampling Algorithm for Cosmological Model Selection
Mukherjee, P., Parkinson, D., & Liddle, A. R. (2006) · The Astrophysical Journal · doi:10.1086/501068 · Cited by 355
juliet: a versatile modelling tool for transiting and non-transiting exoplanetary systems
Espinoza, N., Kossakowski, D., & Brahm, R. (2019) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz2688 · Cited by 348
Dynamic nested sampling: an improved algorithm for parameter estimation and evidence calculation
Higson, E., Handley, W., Hobson, M., & Lasenby, A. (2019) · Statistics and Computing · doi:10.1007/s11222-018-9844-0 · Cited by 317
Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy
Sharma, S. (2017) · Annual Review of Astronomy and Astrophysics · doi:10.1146/annurev-astro-082214-122339 · Cited by 298
A Large Catalog of Accurate Distances to Local Molecular Clouds: The Gaia DR2 Edition
Zucker, C., Speagle, J. S., Schlafly, E. F., Green, G. M., Finkbeiner, D. P., Goodman, A. A., & Alves, J. (2019) · The Astrophysical Journal · doi:10.3847/1538-4357/ab2388 · Cited by 292
Self-citationAn Older, More Quiescent Universe from Panchromatic SED Fitting of the 3D-HST Survey
Leja, J., Johnson, B. D., Conroy, C., Dokkum, P. V., Speagle, J. S., Brammer, G., Momcheva, I., Skelton, R., Whitaker, K. E., Franx, M., et al. (2019) · The Astrophysical Journal · doi:10.3847/1538-4357/ab1d5a · Cited by 246
Self-citationMOSFiT: Modular Open Source Fitter for Transients
Guillochon, J., Nicholl, M., Villar, V. A., Mockler, B., Narayan, G., Mandel, K. S., Berger, E., & Williams, P. K. G. (2018) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/aab761 · Cited by 228
Brewer, B. J., Pártay, L. B., & Csányi, G. (2011) · Statistics and Computing · doi:10.1007/s11222-010-9198-8 · Cited by 165
A super-Earth and two sub-Neptunes transiting the nearby and quiet M dwarf TOI-270
Günther, M. N., Pozuelos, F. J., Dittmann, J., Dragomir, D., Kane, S. R., Daylan, T., Feinstein, A. D., Huang, C. X., Morton, T. D., Bonfanti, A., et al. (2019) · Nature Astronomy · doi:10.1038/s41550-019-0845-5 · Cited by 147
Zucker, C., Schlafly, E. F., Speagle, J. S., Green, G. M., Portillo, S. K. N., Finkbeiner, D. P., & Goodman, A. A. (2018) · The Astrophysical Journal · doi:10.3847/1538-4357/aae97c · Cited by 138
Self-citationEfficient Bayesian inference for multimodal problems in cosmology
Shaw, J. R., Bridges, M., & Hobson, M. (2007) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2007.11871.x · Cited by 131
Leja, J., Johnson, B. D., Conroy, C., & van Dokkum, P. (2018) · The Astrophysical Journal · doi:10.3847/1538-4357/aaa8db · Cited by 113
A super-Earth and two sub-Neptunes transiting the nearby and quiet M dwarf TOI-270
Günther, M. N., Pozuelos, F. J., Dittmann, J., Dragomir, D., Kane, S. R., Daylan, T., Feinstein, A. D., Huang, C. X., Morton, T. D., Bonfanti, A., et al. (2019) · Cited by 103
Zucker, C., Schlafly, E. F., Speagle, J. S., Green, G. M., Portillo, S. K., Finkbeiner, D. P., & Goodman, A. A. (2018) · eScholarship (California Digital Library) · Cited by 79
Self-citationGround-based Optical Transmission Spectroscopy of the Small, Rocky Exoplanet GJ 1132b
Diamond-Lowe, H., Berta-Thompson, Z. K., Charbonneau, D., & Kempton, E. M.-R. (2018) · The Astronomical Journal · doi:10.3847/1538-3881/aac6dd · Cited by 77
Leave Pima Indians Alone: Binary Regression as a Benchmark for Bayesian Computation
Chopin, N., & Ridgway, J. (2017) · Statistical Science · doi:10.1214/16-sts581 · Cited by 61
nestcheck : diagnostic tests for nested sampling calculations
Higson, E., Handley, W. J., Hobson, M., & Lasenby, A. N. (2018) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sty3090 · Cited by 53
Marginal Likelihoods from Monte Carlo Markov ChainsPreprint
Heavens, A., Fantaye, Y. T., Mootoovaloo, A., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.03472 · Cited by 29
Bayesian sparse reconstruction: a brute-force approach to astronomical imaging and machine learning
Higson, E., Handley, W. J., Hobson, M., & Lasenby, A. N. (2018) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sty3307 · Cited by 20
The changing landscape of astrostatistics and astroinformatics
Feigelson, E. D. (2016) · Proceedings of the International Astronomical Union · doi:10.1017/s1743921317003453 · Cited by 4
Cited by
Abbott, R., Abbott, T. D., Abraham, S., Acernese, F., Ackley, K., Adams, A., Adams, C., Adhikari, R. X., Adya, V. B., Affeldt, C., et al. (2021) · Physical Review X · doi:10.1103/physrevx.11.021053 · Cited by 2,236
Abbott, R., Abbott, T. D., Abraham, S., Acernese, F., Ackley, K., Adams, C., Adhikari, R. X., Adya, V. B., Affeldt, C., Agathos, M., et al. (2020) · The Astrophysical Journal Letters · doi:10.3847/2041-8213/ab960f · Cited by 1,817
Abbott, R., Abbott, T. D., Acernese, F., Ackley, K., Adams, C., Adhikari, N., Adhikari, R. X., Adya, V. B., Affeldt, C., Agarwal, D., et al. (2023) · Physical Review X · doi:10.1103/physrevx.13.041039 · Cited by 1,754
GW190425: Observation of a Compact Binary Coalescence with Total Mass ∼ 3.4 M⊙
Abbott, B. P., Abbott, R., Abbott, T. D., Abraham, S., Acernese, F., Ackley, K., Adams, C., Adhikari, R. X., Adya, V. B., Affeldt, C., et al. (2020) · The Astrophysical Journal Letters · doi:10.3847/2041-8213/ab75f5 · Cited by 1,603
Importance Nested Sampling and the MultiNest Algorithm
Feroz, F., Hobson, M. P., Cameron, E., & Pettitt, A. N. (2019) · The Open Journal of Astrophysics · doi:10.21105/astro.1306.2144 · Cited by 973
Metadata
- Authors
- Speagle, J. S.
- Venue
- Monthly Notices of the Royal Astronomical Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-02-03
- Volume
- 493
- Issue
- 3
- Pages
- 3132-3158
- ISSN
- 0035-8711 (ISSN-L)
- 1365-2966
- OpenAlex
- W2931388211
- Cited by
- 2,230
- References
- 64
- FWCI
- 166.01
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.