Interpreting deep learning models for weak lensing
Open accessAbstract
Deep neural networks (DNNs) are powerful algorithms that have been proven capable of extracting non-Gaussian information from weak lensing (WL) datasets. Understanding which features in the data determine the output of these nested, nonlinear algorithms is an important but challenging task. We analyze a DNN that has been found in previous work to accurately recover cosmological parameters in simulated maps of the WL convergence ($\ensuremath{\kappa}$). We derive constraints on the cosmological parameter pair $({\mathrm{\ensuremath{\Omega}}}_{m},{\ensuremath{\sigma}}_{8})$ from a combination of three commonly used WL statistics (power spectrum, lensing peaks, and Minkowski functionals), using ray-traced simulated $\ensuremath{\kappa}$ maps. We show that the network can improve the inferred parameter constraints relative to this combination by 20% even in the presence of realistic levels of shape noise. We apply a series of well-established saliency methods to interpret the DNN and find that the most relevant pixels are those with extreme $\ensuremath{\kappa}$ values. For noiseless maps, regions with negative $\ensuremath{\kappa}$ account for 69%--89%. of the attribution of the DNN output, defined as the square of the saliency in input space. In the presence of shape noise, the attribution concentrates in high-convergence regions, with 36%--68% of the attribution in regions with $\ensuremath{\kappa}>3{\ensuremath{\sigma}}_{\ensuremath{\kappa}}$.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Matilla et al. (2020) found that in all cases, the most relevant pixels in input maps were the ones with extreme values.
“They found that in all cases, the most relevant pixels in the input maps were the ones with extreme values.”
From The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys (2023) · cites this paper as Matilla et al. (2020)
In noiseless maps, regions with negative convergence accounted for the majority of the attribution, while on realistically noisy maps, high value convergence regions (positive peaks) accounted for the majority of the attribution.
“In noiseless maps, regions with negative convergence accounted for the majority of the attribution, while on realistically noisy maps, the high value convergence regions (positive peaks) account for the majority of the attribution.”
From The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys (2023) · cites this paper as Matilla et al. (2020)
Cites
SciPy 1.0: fundamental algorithms for scientific computing in Python
Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., et al. (2020) · Nature Methods · doi:10.1038/s41592-019-0686-2 · Cited by 38,430 · see citing works
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892 · see citing works
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524 · see citing works
Explainable AI: Interpreting, Explaining and Visualizing Deep Learning
(2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6 · Cited by 1,377 · cited 1× · see citing works
“For an in-depth review of the sub-field of explainable DNN models, we refer the reader to [25].”
MethodInterpretation of Neural Networks Is Fragile
Ghorbani, A., Abid, A., & Zou, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013681 · Cited by 765 · see citing works
Bartelmann, M., & Maturi, M. (1999) · Scholarpedia · doi:10.4249/scholarpedia.32440 · Cited by 710
Hartlap, J., Simon, P., & Schneider, P. (2006) · Astronomy and Astrophysics · doi:10.1051/0004-6361:20066170 · Cited by 701 · see citing works
Cosmology with cosmic shear observations: a review
Kilbinger, M. (2015) · Reports on Progress in Physics · doi:10.1088/0034-4885/78/8/086901 · Cited by 604 · see citing works
Gradient Theory of Optimal Flight Paths
Kelley, H. (1960) · ARS journal · doi:10.2514/8.5282 · Cited by 492 · see citing works
Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
Hikage, C., Oguri, M., Hamana, T., More, S., Mandelbaum, R., Takada, M., Köhlinger, F., Miyatake, H., Nishizawa, A., Aihara, H., et al. (2018) · Nippon Tenmon Gakkai obun kenkyu hokoku · doi:10.1093/pasj/psz010 · Cited by 444 · see citing works
Parameter inference with estimated covariance matrices
Sellentin, E., & Heavens, A. (2015) · Monthly Notices of the Royal Astronomical Society Letters · doi:10.1093/mnrasl/slv190 · Cited by 182 · see citing works
The first-year shear catalog of the Subaru Hyper Suprime-Cam Subaru Strategic Program Survey
Mandelbaum, R., Miyatake, H., Hamana, T., Oguri, M., Simet, M., Armstrong, R., Bosch, J., Murata, R., Lanusse, F., Leauthaud, A., et al. (2017) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx130 · Cited by 161 · see citing works
Cosmological constraints with deep learning from KiDS-450 weak lensing maps
Fluri, J., Kacprzak, T., Lucchi, A., Refregier, A., Amara, A., Hofmann, T., & Schneider, A. (2019) · Physical Review D · doi:10.1103/physrevd.100.063514 · Cited by 151 · see citing works
Abbott, T., Abdalla, F., Ávila, S., Banerji, M., Baxter, E., Bechtol, K., Becker, M., Bertin, E., Blazek, J., Bridle, S., et al. (2018) · Physical Review D · doi:10.1103/physrevd.99.123505 · Cited by 149 · see citing works
Cosmology with the shear-peak statistics
Dietrich, J., & Hartlap, J. (2009) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2009.15948.x · Cited by 140 · see citing works
Bahcall, J., Piran, T., & Weinberg, S. (2004) · doi:10.1142/5536 · Cited by 140 · cited 1×
“Three different Minkowski functionals can be defined for two-dimensional fields [32, 33] by performing measurements over excursion sets defined by the points whose value exceeds a given threshold.”
BackgroundNon-Gaussian information from weak lensing data via deep learning
Gupta, A., Matilla, J. M. Z., Hsu, D., & Haiman, Z. (2018) · Physical Review D · doi:10.1103/physrevd.97.103515 · Cited by 128 · see citing works
Self-citationCosmology constraints from shear peak statistics in Dark Energy Survey Science Verification data
Kacprzak, T., Kirk, D., Friedrich, O., Amara, A., Réfrégier, A., Marian, L., Dietrich, J., Suchyta, E., Aleksic, J., Bacon, D., et al. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw2070 · Cited by 110 · see citing works
Probing cosmology with weak lensing peak counts
Kratochvil, J. M., Haiman, Z., & May, M. (2009) · Physical review. D. Particles, fields, gravitation, and cosmology/Physical review. D. Particles and fields · doi:10.1103/physrevd.81.043519 · Cited by 98 · see citing works
Self-citationMassive neutrinos leave fingerprints on cosmic voids
Kreisch, C., Pisani, A., Carbone, C., Liu, J., Hawken, A., Massara, E., Spergel, D., & Wandelt, B. D. (2018) · Monthly notices of the Royal Astronomical Society · doi:10.1093/mnras/stz1944 · Cited by 96
Weak lensing cosmology with convolutional neural networks on noisy data
Ribli, D., Pataki, B., Matilla, J. M. Z., Hsu, D. J., Haiman, Z., & Csabai, I. (2019) · Monthly notices of the Royal Astronomical Society · doi:10.1093/mnras/stz2610 · Cited by 94 · see citing works
Self-citationCosmology constraints from the weak lensing peak counts and the power spectrum in CFHTLenS data
Liu, J., Petri, A., Haiman, Z., Hui, L., Kratochvil, J. M., & May, M. (2014) · Physical review. D. Particles, fields, gravitation, and cosmology/Physical review. D. Particles and fields · doi:10.1103/physrevd.91.063507 · Cited by 90 · see citing works
Self-citationMartinet, N., Schneider, P., Hildebrandt, H., Shan, H., Asgari, M., Dietrich, J., Harnois-Déraps, J., Erben, T., Grado, A., Heymans, C., et al. (2017) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stx2793 · Cited by 84 · see citing works
Cosmological constraints from noisy convergence maps through deep learning
Fluri, J., Kacprzak, T., Refregier, A., Amara, A., Lucchi, A., & Hofmann, T. (2018) · Physical Review D · doi:10.1103/physrevd.98.123518 · Cited by 83 · see citing works
Liu, X.-K., Pan, C.-Z., Li, R., Shan, H., Wang, Q., Fu, L., Fan, Z.-H., Kneib, J., Leauthaud, A., van Waerbeke, L., et al. (2014) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv784 · Cited by 77 · see citing works
Paillas, E., Cautun, M., Li, B., Cai, Y.-C., Padilla, N. D., Armijo, J., & Bose, S. (2019) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz022 · Cited by 70 · see citing works
Petri, A., Liu, J., Haiman, Z., May, M., Hui, L., & Kratochvil, J. M. (2015) · Physical review. D. Particles, fields, gravitation, and cosmology/Physical review. D. Particles and fields · doi:10.1103/physrevd.91.103511 · Cited by 64 · see citing works
Self-citationAn improved cosmological parameter inference scheme motivated by deep learning
Ribli, D., Pataki, B., & Csabai, I. (2018) · Nature Astronomy · doi:10.1038/s41550-018-0596-8 · Cited by 60 · see citing works
From weak lensing to non-Gaussianity via Minkowski functionals
Munshi, D., van Waerbeke, L., Smidt, J., & Coles, P. (2011) · doi:10.1111/j.1365-2966.2011.19718.x · Cited by 46
On the dissection of degenerate cosmologies with machine learning
Merten, J., Giocoli, C., Baldi, M., Meneghetti, M., Peel, A., Lalande, F., Starck, J.-L., & Pettorino, V. (2019) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz972 · Cited by 45 · see citing works
Weak lensing minima and peaks: Cosmological constraints and the impact of baryons
Coulton, W., Liu, J., McCarthy, I., & Osato, K. (2019) · Monthly notices of the Royal Astronomical Society · doi:10.1093/mnras/staa1098 · Cited by 30 · see citing works
Weak lensing by voids in weak lensing maps
Davies, C. T., Cautun, M., & Li, B.-J. (2018) · Monthly Notices of the Royal Astronomical Society Letters · doi:10.1093/mnrasl/sly135 · Cited by 29
Baryon effects on void statistics in the EAGLE simulation
Paillas, E., Lagos, C., Padilla, N., Tissera, P., Helly, J., & Schaller, M. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stx1514 · Cited by 27 · see citing works
Ling, C., Wang, Q., Li, R., Li, B.-J., Wang, J., & Gao, L. (2014) · doi:10.1103/physrevd.92.064024 · Cited by 18
Parameter inference and model comparison using theoretical predictions from noisy simulations
Jeffrey, N., & Abdalla, F. (2018) · Monthly notices of the Royal Astronomical Society · doi:10.1093/mnras/stz2930 · Cited by 8 · see citing works
Lu, T., & Haiman, Z. (2019) · Monthly notices of the Royal Astronomical Society · doi:10.1093/mnras/stz2931 · Cited by 3
Self-citation
Flagged first, then by citations
9 of the 45 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
The CAMELS Project: Cosmology and Astrophysics with Machine-learning Simulations
Villaescusa-Navarro, F., Anglés-Alcázar, D., Genel, S., Spergel, D. N., S. Somerville, R., Dave, R., Pillepich, A., Hernquist, L., Nelson, D., Torrey, P., et al. (2021) · The Astrophysical Journal · doi:10.3847/1538-4357/abf7ba · Cited by 304 · see citing works
The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys
Huertas-Company, M., & Lanusse, F. (2023) · Publications of the Astronomical Society of Australia · doi:10.1017/pasa.2022.55 · Cited by 102 · see citing works
Cosmological forecast for non-Gaussian statistics in large-scale weak lensing surveys
Zürcher, D., Fluri, J., Sgier, R., Kacprzak, T., & Réfrégier, A. (2020) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2021/01/028 · Cited by 54 · see citing works
“Hence, a comparison between physically motivated summary statistics and such novel, data-driven techniques, as it was conducted recently for some summary statistics by [100], could provide further insights.”
BackgroundMethodShirasaki, M., Moriwaki, K., Oogi, T., Yoshida, N., Ikeda, S., & Nishimichi, T. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stab982 · Cited by 38 · see citing works
Lossless, scalable implicit likelihood inference for cosmological fields
Makinen, T., Charnock, T., Alsing, J., & Wandelt, B. D. (2021) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2021/11/049 · Cited by 37 · see citing works
Multifield Cosmology with Artificial IntelligencePreprint
Villaescusa-Navarro, F., Anglés-Alcázar, D., Genel, S., Spergel, D., Li, Y., Wandelt, B. D., Nicola, A., Thiele, L., Hassan, S., Matilla, J. Z., et al. (2021) · arXiv.org · doi:10.48550/arxiv.2109.09747 · Cited by 28 · see citing works
Self-citationExtracting cosmological parameters from N-body simulations using machine learning techniques
Lazanu, A. (2021) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2021/09/039 · Cited by 23 · see citing works
“…been used in a variety of cosmology setups: CMB [8, 9], LSS [10–13], reionization and 21cm [14, 15], gravitational lensing: weak lensing [16, 17], strong lensing [18, 19], redshift prediction [20, 21], parameter estimation [22, 23], and are expected to provide more insights in the future…”
Sharma, D., Dai, B., & Seljak, U. (2024) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2024/08/010 · Cited by 19 · see citing works
“This approach has been widely applied in prior studies [30, 31, 35–37].”
Measuring the Hubble constant with cosmic chronometers: a machine learning approach
Bengaly, C., Dantas, M. A., Casarini, L., & Alcaniz, J. (2022) · The European Physical Journal C · doi:10.1140/epjc/s10052-023-11734-1 · Cited by 19 · see citing works
Kacprzak, T., & Fluri, J. (2022) · Physical Review X · doi:10.48550/arxiv.2203.09616 · Cited by 18
“An approach similar to this has been introduced for lensing maps by [51], and more broadly in the field of machine learning called interpretability [52, 53].”
MethodModeling assembly bias with machine learning and symbolic regressionPreprint
Wadekar, D., Villaescusa-Navarro, F., Ho, S., & Perreault-Levasseur, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.00111 · Cited by 17 · see citing works
“There are however a few methods like saliency maps which can be used for getting insights into deep learning models (63, 64) and we will discuss them below.”
MethodMADLens, a python package for fast and differentiable non-Gaussian lensing simulations
Böhm, V., Feng, Y., Lee, M. E., & Dai, B. (2020) · Astronomy and Computing · doi:10.1016/j.ascom.2021.100490 · Cited by 16 · see citing works
Barthelemy, A., Halder, A., Gong, Z.-J., & Uhlemann, C. (2024) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2024/03/060 · Cited by 10 · see citing works
“This is complementary to the halo-model approach aimed to describe the more nonlinear regime [32].”
Barthelemy, A., Halder, A., Gong, Z.-J., & Uhlemann, C. (2023) · doi:10.48550/arxiv.2307.09468 · Cited by 7
“Therefore, studying the full 1-point Probability Distribution Function (PDF) of the smoothed κ field inside apertures (see [32, 39]) is a promising way to access the non-Gaussian cosmological information of the foreground matter density field beyond the variance (or the widely used 2PCF) and holds the potential to tig…”
BackgroundMethodMinkowski Functionals in $SO(3)$ for the spin-2 CMB polarisation field
Duque, J. C., Carones, A., Marinucci, D., Migliaccio, M., & Vittorio, N. (2023) · doi:10.48550/arxiv.2301.13191 · Cited by 7
Sum-of-Parts Models: Faithful Attributions for Groups of Features
You, W., Qu, H., Gatti, M., Jain, B., & Wong, E. (2023) · arXiv.org · doi:10.48550/arxiv.2310.16316 · Cited by 5
Golshan, M., & Bayer, A. (2024) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2025/05/024 · Cited by 5 · see citing works
“This is similar to the trend observed for Ω m and σ 8 by [58], where underdense regions were found to significantly lose information upon the addition of noise, however, our results are different to [58] as we find over and underdense regions are similarly salient in the absence of noise, while…”
InfluentialThe FIX Benchmark: Extracting Features Interpretable to eXperts
Jin, H., Havaldar, S., Kim, C., Xue, A., You, W., Qu, H., Gatti, M., Hashimoto, D. A., Jain, B., Madani, A., et al. (2024) · J. Data-centric Mach. Learn. Res. · doi:10.48550/arxiv.2409.13684 · Cited by 5
“We gray-out the pixels not selected in each feature.”
MethodMinkowski Functionals in 𝖲𝖮(3) for the spin-2 CMB polarisation field
Duque, J. C., Carones, A., Marinucci, D., Migliaccio, M., & Vittorio, N. (2024) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2024/01/039 · Cited by 5
Thomsen, A., Bucko, J., Kacprzak, T., Ajani, V., Fluri, J., Réfrégier, A., Anbajagane, D., Castander, F., Ferté, A., Gatti, M., et al. (2025) · Physical Review D · doi:10.1103/3sj1-1l9f · Cited by 4
“Following previous works [F22, 8, 27, 37, 38, 41–44, 46”
Interpreting "Interpretability" and Explaining "Explainability" in Machine Learning in Physics
Gambhir, R., Lucie-Smith, L., & Thaler, J. (2026) · arXiv.org · doi:10.48550/arxiv.2606.26228 · Cited by 3
“…extract with traditional methods – for example, on the origin of late-time halo properties [ 61, 112 ] , a previously unknown self-calibration mode for cluster surveys [ 113 ] , and the identification of which features in weak-lensing maps carry non-Gaussian cosmological information [ 114,115 ] .”
Krywonos, J., Kvasiuk, Y., Johnson, M. C., & Münchmeyer, M. (2025) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2026/03/037 · Cited by 3 · see citing works
Searching for Features with Artificial Neural Networks in Science: The Problem of Non-Uniqueness
Yao, S.-Y., & Hagar, A. (2024) · International Studies in the Philosophy of Science · doi:10.1080/02698595.2024.2346871 · Cited by 3
“The emphasis on voids di ff ers even from conclusions of mainstream traditional statistical methods, but Matilla et al. (2020) could rationalise this result by referring to existing studies that favour a di ff erent hypothesis stressing the cosmic voids.”
BackgroundResultT-FIX: Text-Based Explanations with Features Interpretable to eXperts
Havaldar, S., Jin, H., Kim, C., Xue, A., You, W., Gatti, M., Jain, B., Qu, H., Hashimoto, D. A., Madani, A., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2511.04070 · Cited by 2
“[Bad] The utterance is a straight-forward description of information from a biology textbook.”
Chegeni, A., Hesar, F. F., Raouf, M., Foing, B. H., & Verbeek, F. J. (2025) · Universe · doi:10.3390/universe11030092 · Cited by 2 · see citing works
“Recently, IGs have had numerous applications in astronomy, including strong lensing searches [65] and weak lensing analysis [66].”
Gondhalekar, Y., Hassan, S., Saphra, N., & Andrianomena, S. (2023) · arXiv.org · doi:10.48550/arxiv.2311.18007 · Cited by 2
“Matilla et al. [2] used saliency methods to interpret deep learning models trained to recover cosmological parameters from weak lensing maps.”
BackgroundPower Spectrum Emulators from Neural Networks and Tree-Based Methods
Lazanu, A. (2025) · Physics of the Dark Universe · doi:10.1016/j.dark.2025.102186 · Cited by 1 · see citing works
“Machine learning has been used in a large number of fields in cosmology, including CMB [18, 19], LSS [20, 21, 22, 23], reionization and 21cm [24, 25, 26, 27], gravitational lensing: weak lensing [28, 29], strong lensing [30, 31], redshift prediction [32, 33], parameter estimation [34, 35, 36] etc.”
AKRA 2.0: Accurate Kappa Reconstruction Algorithm for masked shear catalog
Shi, Y., Zhang, P.-J., Deng, F.-R., Zhou, S.-R., Cai, H., Yao, J., & Sun, Z. (2024) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2025/07/038 · Cited by 1 · see citing works
Yao, S.-Y. (2026) · Synthese · doi:10.1007/s11229-026-05799-0
“Some cosmologists train a neural network to predict parameters of the cosmological model from weak lensing images (Matilla et al., 2020 ).”
- Authors
- Matilla, J. M. Z., Sharma, M., Hsu, D., & Haiman, Z.
- Affiliations
- Columbia University (US)
- Venue
- Physical Review D
- Publisher
- American Physical Society (APS)
- Published
- 2020-12-01
- Volume
- 102
- Issue
- 12
- ISSN
- 2470-0010 (ISSN-L)
- 2470-0029
- OpenAlex
- W3041488807
- Cited by
- 48
- References
- 45
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 9 · 2023: 5 · 2022: 11 · 2021: 9 · 2020: 1
- FWCI
- 2.90
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Physical review. D/Physical review. D. (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Aeronautics and Space Administration (80NSSC18K1093)
- National Science Foundation
- Topics
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Cosmology and Gravitation Theories
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Galaxies: Formation, Evolution, Phenomena
- Physical Sciences › Physics and Astronomy › Nuclear and High Energy Physics › Dark Matter and Cosmic Phenomena
- Keywords
- weak gravitational lensing, deep neural network, model interpretability, saliency maps, cosmological parameter constraints, matter density parameter, amplitude of matter fluctuations, convergence maps, shape noise, Minkowski functionals, power spectrum
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review