Fast and reliable Markov chain Monte Carlo technique for cosmological parameter estimation
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Markov chain Monte Carlo (MCMC) techniques are now widely used for cosmological parameter estimation. Chains are generated to sample the posterior probability distribution obtained following the Bayesian approach. An important issue is how to optimize the efficiency of such sampling and how to diagnose whether a finite-length chain has adequately sampled the underlying posterior probability distribution. We show how the power spectrum of a single such finite chain may be used as a convergence diagnostic by means of a fitting function, and discuss strategies for optimizing the distribution for the proposed steps. The methods developed are applied to current cosmic microwave background and large-scale structure data interpreted using both a pure adiabatic cosmological model and a mixed adiabatic/isocurvature cosmological model including possible correlations between modes. For the latter application, because of the increased dimensionality and the presence of degeneracies, the need for tuning MCMC methods for maximum efficiency becomes particularly acute.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Cosmological parameters from SDSS and WMAP
Tegmark, M., Strauss, M. A., Blanton, M. R., Abazajian, K., Dodelson, S., Sandvik, H., Wang, X., Weinberg, D. H., Zehavi, I., Bahcall, N. A., et al. (2004) · Physical Review D · doi:10.1103/physrevd.69.103501 · Cited by 3,982
Evaluating the Accuracy of Sampling-Based Approaches to the Calculation of Posterior Moments
Geweke, J. (1992) · Bayesian Statistics 4 · doi:10.1093/oso/9780198522669.003.0010 · Cited by 3,307
The Three‐Dimensional Power Spectrum of Galaxies from the Sloan Digital Sky Survey
Tegmark, M., Blanton, M. R., Strauss, M. A., Hoyle, F., Schlegel, D., Scoccimarro, R., Vogeley, M. S., Weinberg, D. H., Zehavi, I., Berlind, A., et al. (2004) · The Astrophysical Journal · doi:10.1086/382125 · Cited by 1,787
Simulation Run Length Control in the Presence of an Initial Transient
Heidelberger, P., & Welch, P. D. (1983) · Operations Research · doi:10.1287/opre.31.6.1109 · Cited by 1,297
First‐Year Wilkinson Microwave Anisotropy Probe ( WMAP ) Observations: Implications For Inflation
Peiris, H. V., Komatsu, E., Verde, L., Spergel, D. N., Bennett, C. L., Halpern, M., Hinshaw, G., Jarosik, N., Kogut, A., Limon, M., et al. (2003) · The Astrophysical Journal Supplement Series · doi:10.1086/377228 · Cited by 1,159
Smith, J. Q., Bernardo, J. M., Berger, J. O., Dawid, A. P., & Smith, A. F. M. (1993) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982740 · Cited by 1,097
Kogut, A., Spergel, D. N., Barnes, C., Bennett, C. L., Halpern, M., Hinshaw, G., Jarosik, N., Limon, M., Meyer, S. S., Page, L., et al. (2003) · The Astrophysical Journal Supplement Series · doi:10.1086/377219 · Cited by 938
First‐Year Wilkinson Microwave Anisotropy Probe ( WMAP ) Observations: The Angular Power Spectrum
Hinshaw, G., Spergel, D. N., Verde, L., Hill, R. S., Meyer, S. S., Barnes, C., Bennett, C. L., Halpern, M., Jarosik, N., Kogut, A., et al. (2003) · The Astrophysical Journal Supplement Series · doi:10.1086/377225 · Cited by 880
The 2dF Galaxy Redshift Survey: the power spectrum and the matter content of the Universe
Percival, W. J., Baugh, C. M., Bland-Hawthorn, J., Bridges, T., Cannon, R., Cole, S., Colless, M., Collins, C., Couch, W., Dalton, G., et al. (2001) · Monthly Notices of the Royal Astronomical Society · doi:10.1046/j.1365-8711.2001.04827.x · Cited by 835
Efficient Metropolis Jumping Rules
Gelman*, A., Roberts**, G. O., & Gilks***, W. R. (1996) · Bayesian Statistics 5 · doi:10.1093/oso/9780198523567.003.0038 · Cited by 796
First‐Year Wilkinson Microwave Anisotropy Probe(WMAP) Observations: Parameter Estimation Methodology
Verde, L., Peiris, H. V., Spergel, D. N., Nolta, M. R., Bennett, C. L., Halpern, M., Hinshaw, G., Jarosik, N., Kogut, A., Limon, M., et al. (2003) · The Astrophysical Journal Supplement Series · doi:10.1086/377335 · Cited by 579
How many Iterations in the Gibbs Sampler?
Raftery, A. E., & Lewis, S. M. (1992) · Bayesian Statistics 4 · doi:10.1093/oso/9780198522669.003.0053 · Cited by 335
Measurement, Regression, and Calibration
Gleser, L. J., & Brown, P. J. (1996) · Technometrics · doi:10.2307/1268905 · Cited by 308
Leonard, T., Bernado, J. M., Berger, J. O., Dawid, A. P., & Smith, A. F. M. (1998) · Biometrics · doi:10.2307/2533694 · Cited by 174
Christensen, N. L., Meyer, R., Knox, L., & Luey, B. (2000) · Cited by 170
Efficient cosmological parameter estimation from microwave background anisotropies
Kosowsky, A., Milosavljevic, M., & Jimenez, R. (2002) · Physical Review D · doi:10.1103/physrevd.66.063007 · Cited by 166
Bayesian methods for cosmological parameter estimation from cosmic microwave background measurements
Christensen, N., Meyer, R., Knox, L., & Luey, B. (2001) · Classical and Quantum Gravity · doi:10.1088/0264-9381/18/14/306 · Cited by 164
Knox, L., Christensen, N., & Skordis, C. (2001) · The Astrophysical Journal · doi:10.1086/338655 · Cited by 114
Self-citationAnalyse this! A cosmological constraint package for CMBEASY
Doran, M., & Müller, C. M. (2004) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2004/09/003 · Cited by 78
Knox, L., Christensen, N. L., & Skordis, C. (2001) · CERN Document Server (European Organization for Nuclear Research) · Cited by 74
Self-citationInitial Conditions of the Universe: How Much Isocurvature is Allowed?
Bucher, M., Dunkley, J., Ferreira, P. G., Moodley, K., & Skordis, C. (2004) · Physical Review Letters · doi:10.1103/physrevlett.93.081301 · Cited by 66
Self-citationJiménez, R., Verde, L., Peiris, H. V., & Kosowsky, A. B. (2004) · Physical review. D. Particles, fields, gravitation, and cosmology/Physical review. D. Particles and fields · doi:10.1103/physrevd.70.023005 · Cited by 44
Posterior sampling with improved efficiency
Hanson, K. M., & Cunningham, G. S. (1998) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.310914 · Cited by 26
Measurements, Regression, and Calibration.
Walker, E., & Brown, P. J. (1996) · Journal of the American Statistical Association · doi:10.2307/2291429 · Cited by 18
Cited by
<tt>emcee</tt>: The MCMC Hammer
Foreman-Mackey, D., Hogg, D. W., Lang, D., & Goodman, J. (2013) · Publications of the Astronomical Society of the Pacific · doi:10.1086/670067 · Cited by 12,414
Three‐Year Wilkinson Microwave Anisotropy Probe ( WMAP ) Observations: Implications for Cosmology
Spergel, D. N., Bean, R., Dore, O., Nolta, M. R., Bennett, C. L., Dunkley, J., Hinshaw, G., Jarosik, N., Komatsu, E., Page, L., et al. (2007) · The Astrophysical Journal Supplement Series · doi:10.1086/513700 · Cited by 6,778
“In addition, we use the spectral convergence test described in Dunkley et al. (2005) to confirm convergence.”
Self-citationTHE AVERAGE STAR FORMATION HISTORIES OF GALAXIES IN DARK MATTER HALOS FROM z = 0-8
Behroozi, P. S., Wechsler, R. H., & Conroy, C. (2013) · The Astrophysical Journal · doi:10.1088/0004-637x/770/1/57 · Cited by 2,167
“Although the algorithm of Dunkley et al. (2005) indicates that we converge after only 5×105 points, we continue to run for 4×106 total points to minimize the chance of unexplored regions and to ensure that the adaptive updates of the step covariance matrix converge and do not bias our final results.”
BackgroundMarsh, D. J. E. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.06.005 · Cited by 2,001
Conroy, C., Gunn, J. E., & White, M. (2009) · The Astrophysical Journal · doi:10.1088/0004-637x/699/1/486 · Cited by 1,891
Metadata
- Authors
- Dunkley, J., Bucher, M., Ferreira, P. G., Moodley, K., & Skordis, C.
- Venue
- Monthly Notices of the Royal Astronomical Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-01
- Volume
- 356
- Issue
- 3
- Pages
- 925-936
- ISSN
- 0035-8711 (ISSN-L)
- 1365-2966
- OpenAlex
- W1992851587
- Cited by
- 267
- References
- 27
- FWCI
- 8.98
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.