Deblending and classifying astronomical sources with Mask R-CNN deep learning
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
We apply a new deep learning technique to detect, classify, and deblend sources in multiband astronomical images. We train and evaluate the performance of an artificial neural network built on the Mask Region-based Convolutional Neural Network image processing framework, a general code for efficient object detection, classification, and instance segmentation. After evaluating the performance of our network against simulated ground truth images for star and galaxy classes, we find a precision of 92 per cent at 80 per cent recall for stars and a precision of 98 per cent at 80 per cent recall for galaxies in a typical field with ∼30 galaxies arcmin−2. We investigate the deblending capability of our code, and find that clean deblends are handled robustly during object masking, even for significantly blended sources. This technique, or extensions using similar network architectures, may be applied to current and future deep imaging surveys such as Large Synoptic Survey Telescope and Wide-Field Infrared Survey Telescope. Our code, astro r-cnn, is publicly available at https://github.com/burke86/astro_rcnn.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Astropy: A community Python package for astronomy
The Astropy Collaboration, Robitaille, T. P., Tollerud, E. J., Greenfield, P., Droettboom, M., Bray, E., Aldcroft, T., Davis, M., Ginsburg, A., Price-Whelan, A. M., et al. (2013) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201322068 · Cited by 14,620
Path Aggregation Network for Instance Segmentation
Liu, S., Qi, L., Qin, H., Shi, J., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00913 · Cited by 10,011
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
On the variation of the initial mass function
Kroupa, P. (2001) · Monthly Notices of the Royal Astronomical Society · doi:10.1046/j.1365-8711.2001.04022.x · Cited by 7,499
LSST: From Science Drivers to Reference Design and Anticipated Data Products
Ivezić, Ž., Kahn, S. M., Tyson, J. A., Abel, B., Acosta, E., Allsman, R., Alonso, D., AlSayyad, Y., Anderson, S. F., Andrew, J., et al. (2019) · The Astrophysical Journal · doi:10.3847/1538-4357/ab042c · Cited by 4,357
Self-citationLSST: from Science Drivers to Reference Design and Anticipated Data Products
Ivezić, Ž., Kahn, S. M., Tyson, J. A., Abel, B., Acosta, E., Allsman, R., Alonso, D., AlSayyad, Y., Anderson, S. F., Andrew, J., et al. (2008) · arXiv · doi:10.48550/arxiv.0805.2366 · Cited by 4,357
Self-citationA Survey on Deep Transfer Learning
Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_27 · Cited by 3,165
YOLACT: Real-Time Instance Segmentation
Bolya, D., Zhou, C., Xiao, F., & Lee, Y. J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00925 · Cited by 2,536 · cited 1×
“There are several machine learning -based solutions that perform semantic/instance segmentation, such as YOLO (Red-mon et al. 2015), YOLACT (Bolya et al. 2019), PANet (Liu et al. 2018), and TernausNet (Iglovikov & Shvets 2018).”
MethodDeep Networks with Stochastic Depth
Huang, G., Sun, Y., Liu, Z., Sedra, D., & Weinberger, K. Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_39 · Cited by 2,104
Rotation-invariant convolutional neural networks for galaxy morphology prediction
Dieleman, S., Willett, K. W., & Dambre, J. (2015) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv632 · Cited by 781
Star–galaxy classification using deep convolutional neural networks
Kim, E. J., & Brunner, R. J. (2017) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw2672 · Cited by 221
Photometric redshifts from SDSS images using a convolutional neural network
Pasquet, J., Bertin, E., Treyer, M., Arnouts, S., & Fouchez, D. (2019) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201833617 · Cited by 197
The effective number density of galaxies for weak lensing measurements in the LSST project
Chang, C., Jarvis, M., Jain, B., Kahn, S. M., Kirkby, D., Connolly, A., Krughoff, S., Peng, E. H., & Peterson, J. R. (2013) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stt1156 · Cited by 164
Self-citationMorpheus: A Deep Learning Framework for the Pixel-level Analysis of Astronomical Image Data
Hausen, R., & Robertson, B. E. (2020) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/ab8868 · Cited by 110 · cited 1×
“The recent work of Hausen & Robertson (2019) combined deep learning semantic segmentation with mask separation algorithms to classify and deblend galaxies in the Hubble Space Telescope images.”
BackgroundPhotometry of high-redshift blended galaxies using deep learning
Boucaud, A., Huertas-Company, M., Heneka, C., Ishida, E. E. O., Sedaghat, N., de Souza, R. S., Moews, B., Dole, H., Castellano, M., Merlin, E., et al. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz3056 · Cited by 60
Cited by
The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys
Huertas-Company, M., & Lanusse, F. (2023) · Publications of the Astronomical Society of Australia · doi:10.1017/pasa.2022.55 · Cited by 102
“Burke et al. (2019), Farias et al. (2020) Tanoglidis et al. (2021a) explored an alternative approach based on region based CNN architectures such as Mask R-CNNs to perform similar tasks, i.e. detection, deblending and classification.”
MethodThe challenge of blending in large sky surveys
Melchior, P., Joseph, R., Sanchez, J., MacCrann, N., & Gruen, D. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00353-y · Cited by 30
Tanoglidis, D., Ćiprijanović, A., Drlica-Wagner, A., Nord, B., Wang, M. H. L. S., Amsellem, A. J., Downey, K., Jenkins, S., Kafkes, D., & Zhang, Z. (2021) · arXiv · doi:10.48550/arxiv.2109.08246 · Cited by 25
“Similarly to what was proposed in Burke et al. (2019), the training is performed in different stages with progressively smaller learning rates, α, at each stage.”
BackgroundMethodTanoglidis, D., Ćiprijanović, A., Drlica-Wagner, A., Nord, B., Wang, M. H. L. S., Amsellem, A. J., Downey, K., Jenkins, S., Kafkes, D., & Zhang, Z. (2022) · Astronomy and Computing · doi:10.1016/j.ascom.2022.100580 · Cited by 25
Metadata
- Authors
- Burke, C. J., Aleo, P. D., Chen, Y.-C., Liu, X., Peterson, J. R., Sembroski, G. H., & Lin, J. Y.-Y.
- Venue
- Monthly Notices of the Royal Astronomical Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-10-10
- Volume
- 490
- Issue
- 3
- Pages
- 3952-3965
- ISSN
- 0035-8711 (ISSN-L)
- 1365-2966
- OpenAlex
- W2964382283
- Cited by
- 101
- References
- 19
- FWCI
- 3.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.