The DOI matches its DataCite record; its reference list is not available.
E(2) Equivariant Self-Attention for Radio Astronomy
Open accessAbstract
In this work we introduce group-equivariant self-attention models to address the problem of explainable radio galaxy classification in astronomy. We evaluate various orders of both cyclic and dihedral equivariance, and show that including equivariance as a prior both reduces the number of epochs required to fit the data and results in improved performance. We highlight the benefits of equivariance when using self-attention as an explainable model and illustrate how equivariant models statistically attend the same features in their classifications as human astronomers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Architectures that preserve known symmetries of the physical problem are an interesting way to keep control on what networks are extracting.
“Architectures that preserve known symmetries of the physical problem are for example an interesting way to keep a control on what the networks are extracting (e.g. Scaife & Porter 2021; Villar et al. 2021a; Bowles et al. 2021).”
From The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys (2023) · cites this paper as Bowles et al. 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
References 17 · Cited by 3
Research works printed but not linked: 10
- [3][3] M. Bowles, A. M. M. Scaife, F. Porter, H. Tang, and D. J. Bastien. Attention-gating for improved radio galaxy classification. Monthly Notices of the Royal Astronomical Society , 501(3):4579-4595, Mar. 2021. -
- [4][4] P. Broekema, R. Van Nieuwpoort, and H. Bal. The square kilometre array science data processor. preliminary compute platform design. Journal of Instrumentation , 10:C07004-C07004, 07 2015. -
- [5][5] S. Dieleman, K. W. Willett, and J. Dambre. Rotation-invariant convolutional neural networks for galaxy morphology prediction. Monthly Notices of the Royal Astronomical Society , 450(2):14411459, 04 2015. -
- [7][7] M. J. Jarvis, A. R. Taylor, I. Agudo, J. R. Allison, R. P. Deane, B. Frank, N. Gupta, I. Heywood, N. Maddox, K. McAlpine, M. G. Santos, A. M. Scaife, M. Vaccari, J. T. Zwart, E. Adams, D. J. Bacon, A. J. Baker, B. A. Bassett, P. N. Best, R. Beswick, S. Blyth, M. L. Brown, M. Brüggen, M. Cluver, S. Colafranceso, G. Cotter, C. Cress, R. Davé, C. Ferrari, M. J. Hardcastle, C. Hale, I. Harrison, P. W. Hatfield, H. R. Klöckner, S. Kolwa, E. Malefahlo, T. Marubini, T. Mauch, K. Moodley, R. Morganti, R. Norris, J. A. Peters, I. Prandoni, M. Prescott, S. Oliver, N. Oozeer, H. J. Röttgering, N. Seymour, C. Simpson, O. Smirnov, D. J. Smith, K. Spekkens, J. Stil, C. Tasse, K. van der Heyden, I. H. Whittam, and W. L. WIlliams. The MeerKAT international GHz tiered extragalactic exploration (MIGHTEE) survey. In Proceedings of Science , 2016. -
- [11][11] K. Ntwaetsile and J. E. Geach. Rapid sorting of radio galaxy morphology using Haralick features. Monthly Notices of the Royal Astronomy Scoiety , 502(3):3417-3425, Apr. 2021. -
- [14][14] J. Schlemper, O. Oktay, L. Chen, J. Matthew, C. Knight, B. Kainz, B. Glocker, and D. Rueckert. Attention-gated networks for improving ultrasound scan plane detection. arXiv preprint arXiv:1804.05338 , 2018. - · arXiv
- [15][15] K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 , 2014. - · arXiv
- [16][16] H. Tang, A. M. M. Scaife, and J. P. Leahy. Transfer learning for radio galaxy classification. Monthly Notices of the Royal Astronomical Society , 488(3):3358-3375, Sept. 2019. -
- [18][18] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin. Attention is all you need. In Advances in neural information processing systems , pages 5998-6008, 2017. -
- [19][19] M. Weiler and G. Cesa. General e(2)-equivariant steerable cnns. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett, editors, Advances in Neural Information Processing Systems , volume 32. Curran Associates, Inc., 2019.
Metadata
- Authors
- Bowles, M., Bromley, M., Allen, M., & Scaife, A.
- Affiliations
- University of Manchester (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2111.04742
- OpenAlex
- W3213424209
- Cited by
- 3
- References
- 17
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- Science and Technology Facilities Council
- Topics
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Radio Astronomy Observations and Technology
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Galaxies: Formation, Evolution, Phenomena
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- radio galaxy classification, explainable AI, equivariant neural networks, attention mechanism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
