Automatic physical inference with information maximizing neural networks
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Compressing large data sets to a manageable number of summaries that are informative about the underlying parameters vastly simplifies both frequentist and Bayesian inference. When only simulations are available, these summaries are typically chosen heuristically, so they may inadvertently miss important information. We introduce a simulation-based machine learning technique that trains artificial neural networks to find nonlinear functionals of data that maximize Fisher information: information maximizing neural networks (IMNNs). In test cases where the posterior can be derived exactly, likelihood-free inference based on automatically derived IMNN summaries produces nearly exact posteriors, showing that these summaries are good approximations to sufficient statistics. In a series of numerical examples of increasing complexity and astrophysical relevance we show that IMNNs are robustly capable of automatically finding optimal, nonlinear summaries of the data even in cases where linear compression fails: inferring the variance of Gaussian signal in the presence of noise, inferring cosmological parameters from mock simulations of the Lyman-$\ensuremath{\alpha}$ forest in quasar spectra, and inferring frequency-domain parameters from LISA-like detections of gravitational waveforms. In this final case, the IMNN summary outperforms linear data compression by avoiding the introduction of spurious likelihood maxima. We anticipate that the automatic physical inference method described in this paper will be essential to obtain both accurate and precise cosmological parameter estimates from complex and large astronomical data sets, including those from LSST and Euclid.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Astropy: A community Python package for astronomy
The Astropy Collaboration, Robitaille, T. P., Tollerud, E. J., Greenfield, P., Droettboom, M., Bray, E., Aldcroft, T., Davis, M., Ginsburg, A., Price-Whelan, A. M., et al. (2013) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201322068 · Cited by 14,620
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
Planck 2015 results. XIII. Cosmological parameters
Planck Collaboration, Ade, P. A. R., Aghanim, N., Arnaud, M., Ashdown, M., Aumont, J., Baccigalupi, C., Banday, A. J., Barreiro, R. B., Bartlett, J. G., et al. (2015) · arXiv · doi:10.48550/arxiv.1502.01589 · Cited by 10,720
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Cited by
Machine learning and the physical sciences
Carleo, G., Cirac, I., Cranmer, K., Daudet, L., Schuld, M., Tishby, N., Vogt-Maranto, L., & Zdeborová, L. (2019) · Reviews of Modern Physics · doi:10.1103/revmodphys.91.045002 · Cited by 2,417
Villaescusa-Navarro, F., Hahn, C., Massara, E., Banerjee, A., Delgado, A. M., Ramanah, D. K., Charnock, T., Giusarma, E., Li, Y., Allys, E., et al. (2020) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/ab9d82 · Cited by 336
Self-citationCosmological constraints with deep learning from KiDS-450 weak lensing maps
Fluri, J., Kacprzak, T., Lucchi, A., Refregier, A., Amara, A., Hofmann, T., & Schneider, A. (2019) · Physical Review D · doi:10.1103/physrevd.100.063514 · Cited by 151
Likelihood-free inference with neural compression of DES SV weak lensing map statistics
Jeffrey, N., Alsing, J., & Lanusse, F. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa3594 · Cited by 123
Super-resolution emulator of cosmological simulations using deep physical models
Kodi Ramanah, D., Charnock, T., Villaescusa-Navarro, F., & Wandelt, B. D. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa1428 · Cited by 70
Self-citationTranslation and rotation equivariant normalizing flow (TRENF) for optimal cosmological analysis
Dai, B., & Seljak, U. (2022) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stac2010 · Cited by 48
Dynamical mass inference of galaxy clusters with neural flows
Kodi Ramanah, D., Wojtak, R., Ansari, Z., Gall, C., & Hjorth, J. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa2886 · Cited by 37
“…neural autoregressive flows to model the likelihood, P({Rproj, vlos}|M) ∼ P(d̂ |M), where d̂ corresponds to a set of informative and sufficient summary statistics extracted by a separate neural network, such as the Information Maximizing Neural Network (IMNN) developed by Charnock et al. (2018).”
BackgroundSimulation-based inference of dynamical galaxy cluster masses with 3D convolutional neural networks
Kodi Ramanah, D., Wojtak, R., & Arendse, N. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa3922 · Cited by 31
Metadata
- Authors
- Charnock, T., Lavaux, G., & Wandelt, B. D.
- Venue
- Physical Review D
- Publisher
- American Physical Society (APS)
- Published
- 2018-04-13
- Volume
- 97
- Issue
- 8
- ISSN
- 2470-0010 (ISSN-L)
- 2470-0029
- OpenAlex
- W2791995286
- Cited by
- 113
- References
- 8
- FWCI
- 8.87
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.