Cited by 31Galaxies: Formation, Evolution, PhenomenaAstrophysical Phenomena and ObservationsAdvanced Neural Network Applications

Detecting gravitational lenses using machine learning: exploring interpretability and sensitivity to rare lensing configurations

Open access
Wilde, Joshua, Serjeant, Stephen, Bromley, Jane M, Dickinson, Hugh, Koopmans, Léon V E, Metcalf, R Benton·2022·Monthly Notices of the Royal Astronomical Society

Abstract

Forthcoming large imaging surveys such as Euclid and the Vera Rubin Observatory Legacy Survey of Space and Time are expected to find more than 105 strong gravitational lens systems, including many rare and exotic populations such as compound lenses, but these 105 systems will be interspersed among much larger catalogues of ∼109 galaxies. This volume of data is too much for visual inspection by volunteers alone to be feasible and gravitational lenses will only appear in a small fraction of these data which could cause a large amount of false positives. Machine learning is the obvious alternative but the algorithms’ internal workings are not obviously interpretable, so their selection functions are opaque and it is not clear whether they would select against important rare populations. We design, build, and train several convolutional neural networks (CNNs) to identify strong gravitational lenses using VIS, Y, J, and H bands of simulated data, with F1 scores between 0.83 and 0.91 on 100 000 test set images. We demonstrate for the first time that such CNNs do not select against compound lenses, obtaining recall scores as high as 76 per cent for compound arcs and 52 per cent for double rings. We verify this performance using Hubble Space Telescope and Hyper Suprime-Cam data of all known compound lens systems. Finally, we explore for the first time the interpretability of these CNNs using Deep Dream, Guided Grad-CAM, and by exploring the kernels of the convolutional layers, to illuminate why CNNs succeed in compound lens selection.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/mnras/stac562

Cites

80 of 80 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Keeping the first layers from pretrained Zoobot ensures the model is encouraged to learn true morphological properties rather than other patterns such as PSF orientation.

    “By keeping the first layers from the pretrained Zoobot , this also ensures that the model is encouraged to learn true morphological properties rather than other patterns that may arise in simulated lenses such as PSF orientation (Wilde et al. 2022).”

    From Euclid Quick Data Release (Q1): XXVIII. The Strong Lensing Discovery Engine C – Finding lenses with machine learning (2026) · cites this paper as Wilde et al. 2022

    Section 6 (Discussion; page not provided) reports that the CNN learned to classify images using the orientation of the simulated Euclid PSF rather than a scientifically relevant feature. Sections 3.1–3.2 describe the paper’s own CNN architectures and training, but do not say that retaining pretrained Zoobot layers encourages learning true morphology or prevents reliance on PSF orientation. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 12

  1. Abell P. A. et al., 2009, preprint ( arXiv:0912.0201 ) · arXiv
  2. Chinchor N., 1992, Proc. 4th Message Underst. Conf., MUC-4 Evaluation Metricserence. Assoc. Comput. Linguist., USA, p.
  3. Geirhos R., Rubisch P., Michaelis C., Bethge M., Wichmann F. A., Brendel W., 2019, International Conference on Learning Representations
  4. He K., Zhang X., Ren S., Sun J., 2015, 2015 IEEE International Conference on Computer Vision (ICCV), p. 1026
  5. Krizhe vsky A., Sutske ver I., Hinton G. E., 2012, Adv. Neural Inf. Process. Syst., 25, 1097
  6. LeCun Y., Bottou L., Bengio Y., Haffner P., 1998, Proc. IEEE, 86, 2278
  7. Pearson J., Pennock C., Robinson T., 2018, Emergent Scientist, 2, 1
  8. Samuel A. L., 1959, IBM Journal of Research and Development, 210
  9. Selvaraju R. R., Cogswell M., Das A., Vedantam R., Parikh D., Batra D., 2017, IEEE International Conference on Computer Vision (ICCV), 618
  10. Simonyan K., Vedaldi A., Zisserman A., 2014, International Conference on Learning Representations
  11. Springenberg J. T., Dosovitskiy A., Brox T., Riedmiller M., 2015, Interna- tional Conference on Learning Representations Sri v astav a N., Hinton G., Krizhevsky A., Sutskever I., Salakhutdinov R., 2014, J. Mach. Learn. Res, 15, 1929
  12. Zeiler M. D., Fergus R., 2014, Proc. Eur. Conf. Comp. Vis., Visualizing and Understanding Convolutional Networks. Springer, Cham, p. 818

Cited by

Sorted by citations

Authors
Wilde, J., Serjeant, S., Bromley, J. M., Dickinson, H., Koopmans, L. V. E., & Metcalf, R. B.
Affiliations
  • The Open University (GB)
  • University of Groningen (NL)
  • Osservatorio di Astrofisica e Scienza dello Spazio (IT)
Corresponding author
Wilde, Joshua
Venue
Monthly Notices of the Royal Astronomical Society
Published
2022-02-08
Volume
512
Issue
3
Pages
3464-3479
ISSN
  • 0035-8711 (ISSN-L)
  • 1365-2966
OpenAlex
W4214939473
Cited by
31
References
79
Citations by year
2026: 6 · 2025: 8 · 2024: 7 · 2023: 7 · 2022: 3
FWCI
2.45
Type
journal article
Language
en
Open access
Locations
  • Monthly Notices of the Royal Astronomical Society (publishedVersion)
  • University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion, other-oa)
  • Open Research Online (The Open University) (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion, other-oa)
  • Open Research Online (The Open University) (submittedVersion)
  • University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, other-oa)
  • arXiv (Cornell University)
Funders
Horizon 2020 (824064, ST/P000584/1)
Topics
  • Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Galaxies: Formation, Evolution, Phenomena
  • Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Astrophysical Phenomena and Observations
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
strong gravitational lensing, compound lenses, double rings, convolutional neural networks, interpretability, Guided Grad-CAM, Euclid, Vera C. Rubin Observatory

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review