Integrating human and machine intelligence in galaxy morphology classification tasks
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Quantifying galaxy morphology is a challenging yet scientifically rewarding task. As the scale of data continues to increase with upcoming surveys, traditional classification methods will struggle to handle the load. We present a solution through an integration of visual and automated classifications, preserving the best features of both human and machine. We demonstrate the effectiveness of such a system through a re-analysis of visual galaxy morphology classifications collected during the Galaxy Zoo 2 (GZ2) project. We reprocess the top-level question of the GZ2 decision tree with a Bayesian classification aggregation algorithm dubbed SWAP, originally developed for the Space Warps gravitational lens project. Through a simple binary classification scheme, we increase the classification rate nearly 5-fold classifying 226 124 galaxies in 92 d of GZ2 project time while reproducing labels derived from GZ2 classification data with 95.7 per cent accuracy. We next combine this with a Random Forest machine learning algorithm that learns on a suite of non-parametric morphology indicators widely used for automated morphologies. We develop a decision engine that delegates tasks between human and machine and demonstrate that the combined system provides at least a factor of 8 increase in the classification rate, classifying 210 803 galaxies in just 32 d of GZ2 project time with 93.1 per cent accuracy. As the Random Forest algorithm requires a minimal amount of computational cost, this result has important implications for galaxy morphology identification tasks in the era of Euclid and other large-scale surveys.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Lintott, C. J., Schawinski, K., Slosar, A., Land, K., Bamford, S., Thomas, D., Raddick, M. J., Nichol, R. C., Szalay, A., Andreescu, D., et al. (2008) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2008.13689.x · Cited by 1,488
Self-citationThe Relationship between Stellar Light Distributions of Galaxies and Their Formation Histories
Conselice, C. J. (2003) · The Astrophysical Journal Supplement Series · doi:10.1086/375001 · Cited by 875 · cited 2×
“…been the automated extraction of morphologies with the development of parametric (Sersic 1968; Odewahn et al. 2002; Peng et al. 2002) and non-parametric (Abraham et al. 1994; Abraham, van den Bergh & Nair 2003; Conselice 2003; Lotz, Primack & Madau 2004; Freeman et al. 2013) structural indicators.”
BackgroundMethodRotation-invariant convolutional neural networks for galaxy morphology prediction
Dieleman, S., Willett, K. W., & Dambre, J. (2015) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv632 · Cited by 781
Self-citationWillett, K. W., Lintott, C. J., Bamford, S. P., Masters, K. L., Simmons, B. D., Casteels, K. R. V., Edmondson, E. M., Fortson, L. F., Kaviraj, S., Keel, W. C., et al. (2013) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stt1458 · Cited by 659
Self-citationA CATALOG OF VISUAL-LIKE MORPHOLOGIES IN THE 5 CANDELS FIELDS USING DEEP LEARNING
Huertas-Company, M., Gravet, R., Cabrera-Vives, G., Pérez-González, P. G., Kartaltepe, J. S., Barro, G., Bernardi, M., Mei, S., Shankar, F., Dimauro, P., et al. (2015) · The Astrophysical Journal Supplement Series · doi:10.1088/0067-0049/221/1/8 · Cited by 285
Space Warps – I. Crowdsourcing the discovery of gravitational lenses
Marshall, P. J., Verma, A., More, A., Davis, C. P., More, S., Kapadia, A., Parrish, M., Snyder, C., Wilcox, J., Baeten, E., et al. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv2009 · Cited by 117 · cited 12×
“4 of Marshall et al. 2016) demonstrates the volunteer assessment we achieve at the end of our simulation, and shows confusion matrices for 1000 randomly selected volunteers.”
BackgroundMethodInfluentialSelf-citationMore, A., Verma, A., Marshall, P. J., More, S., Baeten, E., Wilcox, J., Macmillan, C., Cornen, C., Kapadia, A., Parrish, M., et al. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv1965 · Cited by 116 · cited 1×
“To intelligently manage subject retirement and increase classification efficiency, we adapt an algorithm from the Zooniverse project Space Warps (Marshall et al. 2016), which searched for and discovered several gravitational lens candidates in the CFHT Legacy Survey (More et al. 2016).”
MethodSelf-citation
Cited by
Galaxy Zoo: probabilistic morphology through Bayesian CNNs and active learning
Walmsley, M., Smith, L., Lintott, C., Gal, Y., Bamford, S., Dickinson, H., Fortson, L., Kruk, S., Masters, K., Scarlata, C., et al. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz2816 · Cited by 160
Self-citationSurveying the reach and maturity of machine learning and artificial intelligence in astronomy
Fluke, C. J., & Jacobs, C. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1349 · Cited by 149
“…neural network-based Faranoff-Riley classifications of radio galaxies [Aniyan and Thorat, 2017]; automated morphological annotation and assignment [Beck et al., 2018, Dom´ınguez S´anchez et al., 2018, Kuminski and Shamir, 2018] and labelling [Hocking et al., 2018] of galaxy images, including…”
Morpheus: A Deep Learning Framework for the Pixel-level Analysis of Astronomical Image Data
Hausen, R., & Robertson, B. E. (2020) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/ab8868 · Cited by 110
“The efficiency of users varies, but by leveraging the power of the public interest and enthusiasm, and now machine learning (Beck et al. 2018; Walmsley et al. 2019), the project can use scalability to offset variability in the performance of individual users.”
BackgroundMartin, G., Bazkiaei, A. E., Spavone, M., Iodice, E., Mihos, J. C., Montes, M., Benavides, J. A., Brough, S., Carlin, J. L., Collins, C. A., et al. (2022) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stac1003 · Cited by 76
Predicting the Spectrum of UGC 2885, Rubin’s Galaxy with Machine Learning
Holwerda, B. W., Wu, J. F., Keel, W. C., Young, J., Mullins, R., Hinz, J., Ford, K. E. S., Barmby, P., Chandar, R., Bailin, J., et al. (2021) · The Astrophysical Journal · doi:10.3847/1538-4357/abffcc · Cited by 14
Metadata
- Authors
- Beck, M. R., Scarlata, C., Fortson, L. F., Lintott, C. J., Simmons, B. D., Galloway, M. A., Willett, K. W., Dickinson, H., Masters, K. L., Marshall, P. J., & Wright, D.
- Venue
- Monthly Notices of the Royal Astronomical Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-03-06
- Volume
- 476
- Issue
- 4
- Pages
- 5516-5534
- ISSN
- 0035-8711 (ISSN-L)
- 1365-2966
- OpenAlex
- W2788826274
- Cited by
- 65
- References
- 8
- FWCI
- 5.19
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.