Self-supervised Representation Learning for Astronomical Images
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index; 7 of the 17 sources its claims cite were checked for support.
Abstract
Abstract Sky surveys are the largest data generators in astronomy, making automated tools for extracting meaningful scientific information an absolute necessity. We show that, without the need for labels, self-supervised learning recovers representations of sky survey images that are semantically useful for a variety of scientific tasks. These representations can be directly used as features, or fine-tuned, to outperform supervised methods trained only on labeled data. We apply a contrastive learning framework on multiband galaxy photometry from the Sloan Digital Sky Survey (SDSS), to learn image representations. We then use them for galaxy morphology classification and fine-tune them for photometric redshift estimation, using labels from the Galaxy Zoo 2 data set and SDSS spectroscopy. In both downstream tasks, using the same learned representations, we outperform the supervised state-of-the-art results, and we show that our approach can achieve the accuracy of supervised models while using 2–4 times fewer labels for training. The codes, trained models, and data can be found at https://portal.nersc.gov/project/dasrepo/self-supervised-learning-sdss .
Overview
CoChat Summary
TL;DR
Self-supervised contrastive learning on unlabeled SDSS galaxy images learns representations that are useful for morphology classification and photometric redshift estimation. The learned representations outperform supervised baselines and can match supervised accuracy with 2–4× fewer labels.
Key findings
- Using the same learned representations, the authors outperform supervised state-of-the-art results on galaxy morphology classification and photometric redshift estimation.
- For photometric redshift estimation, pre-training on unlabeled data gives accuracy equivalent to supervised training on 2–4× more spectroscopic redshift labels.
- For the first Galaxy Zoo 2 morphology question, roughly a factor of 16 more labels are required in the supervised setting to achieve the same performance as the fine-tuned self-supervised model.
- In augmentation ablation, Gaussian noise was the strongest augmentation and PSF the weakest; best performance was achieved using all augmentations except PSF.
Methods
- Contrastive self-supervised learning with an InfoNCE loss on ∼1.2 million SDSS ugriz galaxy images of 64×64 pixels, using a ResNet50 encoder and augmentations including galactic extinction, PSF smoothing, rotation, jitter/crop, and Gaussian noise.
- Downstream tasks: Galaxy Zoo 2 morphology classification using 183,929 galaxies with both ugriz images and crowd-sourced classifications, and photometric redshift estimation using 517,190 labeled spectroscopic galaxies, with 400,000 for training and 103,000 for validation.
- Morphology classifiers included a supervised CNN from scratch, a linear classifier on frozen self-supervised representations, and a fine-tuned self-supervised encoder; photometric redshift used 180 redshift bins spanning 0 ≤ z ≤ 0.4 and metrics Δz, σ_MAD, and outlier percentage η.
Limitations
- The paper states that exact quantitative comparison to Domínguez Sánchez et al. (2018) and Walmsley et al. (2020) is not possible due to inconsistent datasets, and that augmentation findings may not generalize to other surveys with different resolutions, signal-to-noise ratios, or target objects.
- The paper states that spectroscopic labels impose selection bias: galaxies with specz labels are biased toward nearby bright objects with low galactic extinction and are not representative of all photometric galaxies.
- The text also makes evident that images span 25.3 arcseconds, which is not large enough for very nearby large galaxies, and that misclassifications arise from imaging artifacts and label uncertainty.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
7 Valid · 1 Not valid · 4 Not checked · 74 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“For example, due to the series of flux and quality cuts applied when selecting spectroscopic targets (Strauss et al. 2002), galaxies with specz labels have a distinct bias towards nearby bright objects with low galactic extinction.”
What the sources say
- Partly supportedcites Strauss et al. 2002 sourceExperimental — accuracy not yet measured
Section 4.1 (page unavailable) describes an r-band magnitude limit of 17.77, and §5.2 reports a median redshift of 0.104; the paper also describes photometric quality cuts. These support selection toward apparently bright, relatively nearby galaxies. But §4.1 says magnitudes are corrected for Galactic extinction before selection, and the cited passages do not establish a distinct bias toward low-extinction sightlines. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and we show that our approach can achieve the accuracy of supervised models while using 2-4 times fewer labels for training.”
- Also stated in: § 3.3. Photometric Redshift Estimation · p. 7 · boosted
“Impressively, the accuracy gained from pre-training on unlabeled data is equivalent to supervised training on 2 -4 × more specz labels, with no modifications in architecture size or complexity.”
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 3.3. Photometric Redshift Estimation · p. 7 · boosted
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Likewise, we found that classification became a straightforward task when using any subset of the labels.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Here we further show that the UMAP performed on the representations surpasses the utility of a UMAP performed directly on the images”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As evidenced by Figure 2, the self-supervised representations have achieved a high degree of separation between numerous types of galaxy morphologies.”
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
40 more claims
Create a free account to see all 86 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 25
- It may state two separate claims as one. 18
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another benefit to self-supervised models, other than training on unlabelled data, is the computational cost, self-supervised models have been shown to need only 1% of the computational power needed by supervised models (Hayat et al. 2021).”
From Detecting galaxy tidal features using self-supervised representation learning (2024) · cites this paper as Hayat et al. 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Here, the authors proposed a two-step approach, first training in complete self-supervision (without needing any spectroscopic redshifts) a 1d encoding of galaxies postage stamps. And in a second step, training in a supervised way a shallow MLP to predict redshifts on a small training set of available spectroscopic redshifts.”
From The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys (2023) · cites this paper as Hayat et al. (2021)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“They find for instance that their selfsupervised approach using 20% of labelled data achieves similar accuracy to a fully supervised training using labels for the entire dataset.”
From The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys (2023) · cites this paper as Hayat et al. (2021)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The first work exploring self-supervised learning is by Hayat et al. (2021).”
From The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys (2023) · cites this paper as Hayat et al. (2021)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Hayat et al. (2021) and Stein et al. (2022) show that once the encoder section of a self-supervised model has been trained one can conduct a simple similarity search to find objects of interest, or apply a linear classifier directly onto the encoder's outputs to separate the data into a variety of classes.”
From Detecting galaxy tidal features using self-supervised representation learning (2024) · cites this paper as Hayat et al. 2021
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ C.3. Performance metrics & additional results · p. 17
“Figure 11. Predicted labels compared to crowd-sourced answers for the first GZ2 question: 'Could this be a disk viewed edge-on?'.”
§ C.3. Performance metrics & additional results · p. 16
“Figures 11 and 12 show the classification results in the same style as Figure 3, but for the second and third GZ questions, respectively.”
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857
MEASURING REDDENING WITH SLOAN DIGITAL SKY SURVEY STELLAR SPECTRA AND RECALIBRATING SFD
Schlafly, E. F., & Finkbeiner, D. P. (2011) · The Astrophysical Journal · doi:10.1088/0004-637x/737/2/103 · Cited by 7,531
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
McInnes, L., Healy, J., & Melville, J. (2018) · arXiv · doi:10.48550/arxiv.1802.03426 · Cited by 7,101
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
LSST: From Science Drivers to Reference Design and Anticipated Data Products
Ivezić, Ž., Kahn, S. M., Tyson, J. A., Abel, B., Acosta, E., Allsman, R., Alonso, D., AlSayyad, Y., Anderson, S. F., Andrew, J., et al. (2019) · The Astrophysical Journal · doi:10.3847/1538-4357/ab042c · Cited by 4,357 · cited 3×
“In the near future, incoming sky surveys such as the Vera Rubin Observatory (Ivezić et al. 2019b), Euclid (Laureijs et al. 2011), the Nancy Grace Roman Space Telescope (Spergel et al. 2013), or the Square Kilometer Array6 will open yet another research epoch, where data sets are of sizes that…”
BackgroundMethodLSST: from Science Drivers to Reference Design and Anticipated Data Products
Ivezić, Ž., Kahn, S. M., Tyson, J. A., Abel, B., Acosta, E., Allsman, R., Alonso, D., AlSayyad, Y., Anderson, S. F., Andrew, J., et al. (2008) · arXiv · doi:10.48550/arxiv.0805.2366 · Cited by 4,357
THE ELEVENTH AND TWELFTH DATA RELEASES OF THE SLOAN DIGITAL SKY SURVEY: FINAL DATA FROM SDSS-III
Alam, S., Albareti, F. D., Prieto, C. A., Anders, F., Anderson, S. F., Anderton, T., Andrews, B. H., Armengaud, E., Aubourg, É., Bailey, S., et al. (2015) · The Astrophysical Journal Supplement Series · doi:10.1088/0067-0049/219/1/12 · Cited by 2,449 · cited 1×
“Our database of galaxies is assembled from Data Release 12 (DR12; Alam et al. 2015) of the SDSS.”
MethodThe 2.5 m Telescope of the Sloan Digital Sky Survey
Gunn, J. E., Siegmund, W. A., Mannery, E. J., Owen, R. E., Hull, C. L., Leger, R. F., Carey, L. N., Knapp, G. R., York, D. G., Boroski, W. N., et al. (2006) · The Astronomical Journal · doi:10.1086/500975 · Cited by 2,373
Improved Baselines with Momentum Contrastive Learning
Chen, X., Fan, H., Girshick, R., & He, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04297 · Cited by 1,956
Spectroscopic Target Selection in the Sloan Digital Sky Survey: The Main Galaxy Sample
Strauss, M. A., Weinberg, D. H., Lupton, R. H., Narayanan, V. K., Annis, J., Bernardi, M., Blanton, M., Burles, S., Connolly, A. J., Dalcanton, J., et al. (2002) · The Astronomical Journal · doi:10.1086/342343 · Cited by 1,909 · cited 1×
“For example, due to the series of flux and quality cuts applied when selecting spectroscopic targets (Strauss et al. 2002), galaxies with spec-z labels have a distinct bias toward nearby bright objects with low galactic extinction.”
BackgroundThe Sloan Digital Sky Survey Photometric Camera
Gunn, J. E., Carr, M., Rockosi, C., Sekiguchi, M., Berry, K., Elms, B., de Haas, E., Ivezić, Ž., Knapp, G., Lupton, R., et al. (1998) · The Astronomical Journal · doi:10.1086/300645 · Cited by 1,692 · cited 1×
“The rapid advance of digital sky surveys in the 1990s, spearheaded by the Sloan Digital Sky Survey (SDSS; Gunn et al. 1998, 2006), has rendered obsolete the approach of manual inspection of images by an expert.”
MethodLintott, C. J., Schawinski, K., Slosar, A., Land, K., Bamford, S., Thomas, D., Raddick, M. J., Nichol, R. C., Szalay, A., Andreescu, D., et al. (2008) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2008.13689.x · Cited by 1,488 · cited 2×
“The GZ project (Lintott et al. 2008) has been fundamental in this endeavor by crowdsourcing morphological classifications for a significant number of galaxies.”
BackgroundWide-Field InfrarRed Survey Telescope-Astrophysics Focused Telescope Assets WFIRST-AFTA 2015 Report
Spergel, D. N., Gehrels, N. A., Baltay, C., Bennett, D. P., Breckinridge, J. B., Donahue, M. E., Dressler, A. M., Gaudi, B. S., Greene, T. P., Guyon, O., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.03757 · Cited by 957
Drizzle: A Method for the Linear Reconstruction of Undersampled Images
Fruchter, A. S., & Hook, R. N. (2002) · Publications of the Astronomical Society of the Pacific · doi:10.1086/338393 · Cited by 829 · cited 1×
“The Montage pipeline uses Variable-Pixel Linear Reconstruction (Fruchter & Hook 2002) during the projection process to appropriately transform source input pixel values into the output pixel space.”
MethodRotation-invariant convolutional neural networks for galaxy morphology prediction
Dieleman, S., Willett, K. W., & Dambre, J. (2015) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv632 · Cited by 781 · cited 1×
“Shown most prominently by the winners of the “Galaxy Challenge” (Dieleman et al. 2015) and numerous subsequent works since (Domínguez Sánchez et al. 2018, 2019; Khan et al. 2019; Spindler et al. 2020; Vega-Ferrero et al. 2020; Walmsley et al. 2020), CNNs excel at this task.”
BackgroundWhat makes for good views for contrastive learning
Tian, Y., Sun, C., Poole, B., Krishnan, D., Schmid, C., & Isola, P. (2020) · arXiv · doi:10.48550/arxiv.2005.10243 · Cited by 773
A Systematic Review on Supervised and Unsupervised Machine Learning Algorithms for Data Science
Alloghani, M., Al-Jumeily, D., Mustafina, J., Hussain, A., & Aljaaf, A. J. (2020) · Unsupervised and Semi-Supervised Learning · doi:10.1007/978-3-030-22475-2_1 · Cited by 702
Willett, K. W., Lintott, C. J., Bamford, S. P., Masters, K. L., Simmons, B. D., Casteels, K. R. V., Edmondson, E. M., Fortson, L. F., Kaviraj, S., Keel, W. C., et al. (2013) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stt1458 · Cited by 659 · cited 3×
“We first visualize how the model has organized the image representation space and explore how morphological characteristics from the Galaxy Zoo 2 project (GZ2; Willett et al. 2013) and spectroscopic redshifts from SDSS map onto this representation space.”
BackgroundMethodInfluentialUsing Self-Supervised Learning Can Improve Model Robustness and Uncertainty
Hendrycks, D., Mazeika, M., Kadavath, S., & Song, D. (2019) · arXiv · doi:10.48550/arxiv.1906.12340 · Cited by 634
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · arXiv · doi:10.48550/arxiv.1807.05520 · Cited by 533
Wide-Field InfraRed Survey Telescope-Astrophysics Focused Telescope Assets WFIRST-AFTA Final ReportPreprint
Spergel, D. N., Gehrels, N., Breckinridge, J., Donahue, M., Dressler, A. M., Gaudi, B. S., Greene, T., Guyon, O., Hirata, C., Kalirai, J., et al. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1305.5422 · Cited by 499
Big Self-Supervised Models are Strong Semi-Supervised Learners
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., & Hinton, G. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10029 · Cited by 421
Preparing Red‐Green‐Blue Images from CCD Data
Lupton, R., Blanton, M. R., Fekete, G., Hogg, D. W., O’Mullane, W., Szalay, A., & Wherry, N. (2004) · Publications of the Astronomical Society of the Pacific · doi:10.1086/382245 · Cited by 420 · cited 1×
“…setting with the same architecture of the encoder, the second is a linear classifier applied directly 7 rgb images are obtained by “luptonizing” (Lupton et al. 2004) the gri photometric bands. on the self-supervised representations, and for the third we fine-tune the self-supervised encoder…”
MethodUsing Pre-Training Can Improve Model Robustness and Uncertainty
Hendrycks, D., Lee, K., & Mazeika, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09960 · Cited by 408
Improving galaxy morphologies for SDSS with Deep Learning
Domínguez Sánchez, H., Huertas-Company, M., Bernardi, M., Tuccillo, D., & Fischer, J. L. (2018) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sty338 · Cited by 382 · cited 1×
“Shown most prominently by the winners of the “Galaxy Challenge” (Dieleman et al. 2015) and numerous subsequent works since (Domínguez Sánchez et al. 2018, 2019; Khan et al. 2019; Spindler et al. 2020; Vega-Ferrero et al. 2020; Walmsley et al. 2020), CNNs excel at this task.”
BackgroundExample selection for bootstrapping statistical parsers
Steedman, M., Hwa, R., Clark, S., Osborne, M., Sarkar, A., Hockenmaier, J., Ruhlen, P., Baker, S., & Crim, J. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073476 · Cited by 364
Slicing Through Multicolor Space: Galaxy Redshifts from Broadband Photometry
Connolly, A. J., Csabai, I., Szalay, A. S., Koo, D. C., Kron, R. G., & Munn, J. A. (1995) · The Astronomical Journal · doi:10.1086/117720 · Cited by 332 · cited 1×
“Photo-z models take multiband galaxy photometry and use template fitting (Loh & Spillar 1986), ML (Connolly et al. 1995), or hybrid methods to produce estimates for the galaxyʼs redshift z and its associated probability density function.”
MethodScaling and Benchmarking Self-Supervised Visual Representation Learning
Goyal, P., Mahajan, D., Gupta, A., & Misra, I. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00649 · Cited by 330
Supervised and Unsupervised Learning for Data Science
(2020) · Unsupervised and Semi-Supervised Learning · doi:10.1007/978-3-030-22475-2 · Cited by 307
Galaxy Zoo: ‘Hanny's Voorwerp’, a quasar light echo?
Lintott, C. J., Schawinski, K., Keel, W., van Arkel, H., Bennert, N., Edmondson, E., Thomas, D., Smith, D. J. B., Herbert, P. D., Jarvis, M. J., et al. (2009) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2009.15299.x · Cited by 292 · cited 1×
“Serendipitous discovery of an ionization echo from a recently faded quasar (Lintott et al. 2009), as well as the cumbersome search for similar systems that followed (Keel et al. 2012), showcases other big data challenges.”
BackgroundThe many flavours of photometric redshifts
Salvato, M., Ilbert, O., & Hoyle, B. (2018) · Nature Astronomy · doi:10.1038/s41550-018-0478-0 · Cited by 234
Photometric redshifts from SDSS images using a convolutional neural network
Pasquet, J., Bertin, E., Treyer, M., Arnouts, S., & Fouchez, D. (2019) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201833617 · Cited by 197
Photometric redshifts for the SDSS Data Release 12
Beck, R., Dobos, L., Budavári, T., Szalay, A. S., & Csabai, I. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw1009 · Cited by 187 · cited 1×
“In the resulting set of galaxies, we remove duplicates that were already included in our spectroscopic sample, and we exclude samples with an estimated photometric redshift (as estimated by Beck et al. 2016) zphot> 0.8.”
MethodInfluentialD’Isanto, A., & Polsterer, K. L. (2018) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201731326 · Cited by 165 · cited 1×
“Traditionally, such models relied on “handcrafted” features extracted from the observations, but recent work has also successfully applied CNNs directly to the images themselves (Hoyle 2016; D’Isanto & Polsterer 2018; Pasquet et al. 2019).”
MethodKeel, W. C., Chojnowski, S. D., Bennert, V. N., Schawinski, K., Lintott, C. J., Lynn, S., Pancoast, A., Harris, C., Nierenberg, A. M., Sonnenfeld, A., et al. (2012) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2011.20101.x · Cited by 161
Galaxy Zoo: probabilistic morphology through Bayesian CNNs and active learning
Walmsley, M., Smith, L., Lintott, C., Gal, Y., Bamford, S., Dickinson, H., Fortson, L., Kruk, S., Masters, K., Scarlata, C., et al. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz2816 · Cited by 160
Measuring photometric redshifts using galaxy images and Deep Neural Networks
Hoyle, B. (2016) · Astronomy and Computing · doi:10.1016/j.ascom.2016.03.006 · Cited by 144 · cited 1×
“Traditionally, such models relied on “handcrafted” features extracted from the observations, but recent work has also successfully applied CNNs directly to the images themselves (Hoyle 2016; D’Isanto & Polsterer 2018; Pasquet et al. 2019).”
MethodHart, R. E., Bamford, S. P., Willett, K. W., Masters, K. L., Cardamone, C., Lintott, C. J., Mackay, R. J., Nichol, R. C., Rosslowe, C. K., Simmons, B. D., et al. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw1588 · Cited by 127 · cited 2×
“See Figure 2 of Hart et al. (2016) for a clear illustration of the decision tree.”
BackgroundMethodInfluentialPhotometric redshifts of galaxies
Loh, E. D., & Spillar, E. J. (1986) · The Astrophysical Journal · doi:10.1086/164062 · Cited by 115 · cited 1×
“Photo-z models take multiband galaxy photometry and use template fitting (Loh & Spillar 1986), ML (Connolly et al. 1995), or hybrid methods to produce estimates for the galaxyʼs redshift z and its associated probability density function.”
MethodTransfer learning for galaxy morphology from one survey to another
Domínguez Sánchez, H., Huertas-Company, M., Bernardi, M., Kaviraj, S., Fischer, J. L., Abbott, T. M. C., Abdalla, F. B., Annis, J., Avila, S., Brooks, D., et al. (2019) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sty3497 · Cited by 91
What Should Not Be Contrastive in Contrastive Learning
Xiao, T., Wang, X., Efros, A. A., & Darrell, T. (2020) · arXiv · doi:10.48550/arxiv.2008.05659 · Cited by 91
An automatic taxonomy of galaxy morphology using unsupervised machine learning
Hocking, A., Geach, J. E., Sun, Y., & Davey, N. (2018) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stx2351 · Cited by 90
Identifying strong lenses with unsupervised machine learning using convolutional autoencoder
Cheng, T.-Y., Li, N., Conselice, C. J., Aragón‐Salamanca, A., Dye, S., & Metcalf, R. B. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa1015 · Cited by 90 · cited 1×
“Many such methods have already been applied to studies of galaxy morphology (Hocking et al. 2018; Cheng et al. 2020a; Martin et al. 2020; Spindler et al. 2020), identification of strong lenses (Cheng et al. 2020b), and anomaly detection (Xiong et al. 2018; Margalef-Bentabol et al. 2020).”
MethodGalaxy morphological classification in deep-wide surveys via unsupervised machine learning
Martin, G., Kaviraj, S., Hocking, A., Read, S. C., & Geach, J. E. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz3006 · Cited by 87
Beyond the hubble sequence – exploring galaxy morphology with unsupervised machine learning
Cheng, T.-Y., Huertas-Company, M., Conselice, C. J., Aragón-Salamanca, A., Robertson, B. E., & Ramachandra, N. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stab734 · Cited by 66
Detecting outliers in astronomical images with deep generative networks
Margalef-Bentabol, B., Huertas-Company, M., Charnock, T., Margalef-Bentabol, C., Bernardi, M., Dubois, Y., Storey-Fisher, K., & Zanisi, L. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa1647 · Cited by 56 · cited 1×
“Many such methods have already been applied to studies of galaxy morphology (Hocking et al. 2018; Cheng et al. 2020a; Martin et al. 2020; Spindler et al. 2020), identification of strong lenses (Cheng et al. 2020b), and anomaly detection (Xiong et al. 2018; Margalef-Bentabol et al. 2020).”
MethodDeep learning at scale for the construction of galaxy catalogs in the Dark Energy Survey
Khan, A., Huerta, E. A., Wang, S., Gruendl, R., Jennings, E., & Zheng, H. (2019) · Physics Letters B · doi:10.1016/j.physletb.2019.06.009 · Cited by 46 · cited 1×
“Shown most prominently by the winners of the “Galaxy Challenge” (Dieleman et al. 2015) and numerous subsequent works since (Domínguez Sánchez et al. 2018, 2019; Khan et al. 2019; Spindler et al. 2020; Vega-Ferrero et al. 2020; Walmsley et al. 2020), CNNs excel at this task.”
BackgroundSpindler, A., Geach, J. E., & Smith, M. J. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa3670 · Cited by 45 · cited 2×
“Shown most prominently by the winners of the “Galaxy Challenge” (Dieleman et al. 2015) and numerous subsequent works since (Domínguez Sánchez et al. 2018, 2019; Khan et al. 2019; Spindler et al. 2020; Vega-Ferrero et al. 2020; Walmsley et al. 2020), CNNs excel at this task.”
BackgroundMethodPushing automated morphological classifications to their limits with the Dark Energy Survey
Vega-Ferrero, J., Domínguez Sánchez, H., Bernardi, M., Huertas-Company, M., Morgan, R., Margalef, B., Aguena, M., Allam, S., Annis, J., Avila, S., et al. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stab594 · Cited by 44
Effectively using unsupervised machine learning in next generation astronomical surveys
Reis, I., Rotman, M., Poznanski, D., Prochaska, J. X., & Wolf, L. (2020) · Astronomy and Computing · doi:10.1016/j.ascom.2020.100437 · Cited by 32 · cited 1×
“When displayed through an interactive data portal (e.g., Reis et al. 2021), such visualizations built on self-supervised representations can be invaluable to the broader astronomical community.”
MethodA Study of the Point-spread Function in SDSS Images
Xin, B., Ivezić, Ž., Lupton, R. H., Peterson, J. R., Yoachim, P., Jones, L., Claver, C. F., & Angeli, G. (2018) · The Astronomical Journal · doi:10.3847/1538-3881/aae316 · Cited by 18 · cited 1×
“13( ) and scaled appropriately to the other channels using λ−0.3 (Xin et al. 2018).”
BackgroundInfluentialAnomaly Detection for Astronomical Data
Xiong, L., Póczos, B., Connolly, A. J., et al. (2018) · Figshare · doi:10.1184/r1/6475475.v1 · Cited by 13
Anomaly Detection for Astronomical Data
Xiong, L., Poczos, B., Connolly, A. J., & Schneider, J. (2018) · Figshare · doi:10.1184/r1/6475475 · Cited by 13
georgestein/ml-in-cosmology: Machine learning in cosmology
Stein, G. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4024768 · Cited by 8
Self-citationgeorgestein/ml-in-cosmology: Machine learning in cosmology
Stein, G. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4024767 · Cited by 7
Self-citationMorphology in the era of large surveys
Lintott, C., Masters, K., Simmons, B., et al. (2013) · Astronomy & Geophysics · doi:10.1093/astrogeo/att162 · Cited by 1 · cited 1×
“…science” like the Galaxy Zoo5 project (GZ; Lintott et al. 2008) plays an important role for tasks that are too complex to describe algorithmically, yet are heuristically quite comprehensible to humans, such as classification of galaxies based on their morphological types (Lintott et al. 2013).”
BackgroundEuclid Definition Study Report
Laureijs, R., Amiaux, J., Arduini, S., Auguères, J. L., Brinchmann, J., Cole, R., Cropper, M., Dabin, C., Duvet, L., Ealet, A., et al. (2011) · arXiv · doi:10.48550/arxiv.1110.3193
Pushing automated morphological classifications to their limits with the Dark Energy Survey
Vega-Ferrero, J., Sánchez, H. D., Bernardi, M., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07858
Beyond the Hubble Sequence -- Exploring Galaxy Morphology with Unsupervised Machine Learning
Cheng, T.-Y., Marc Huertas-Company, Conselice, C. J., et al. (2020) · arXiv · doi:10.48550/arxiv.2009.11932
Cited by
The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys
Huertas-Company, M., & Lanusse, F. (2023) · Publications of the Astronomical Society of Australia · doi:10.1017/pasa.2022.55 · Cited by 102
“The first work exploring self-supervised learning is by Hayat et al. (2021).”
BackgroundMethodInfluentialAstronomia ex machina: a history, primer and outlook on neural networks in astronomy
Smith, M. J., & Geach, J. E. (2023) · Royal Society Open Science · doi:10.1098/rsos.221454 · Cited by 112
“[231] trained SimCLR [185] on multi-band galaxy photometry from the SDSS [74].”
MethodAstroCLIP: a cross-modal foundation model for galaxies
Parker, L., Lanusse, F., Golkar, S., Sarra, L., Cranmer, M., Bietti, A., Eickenberg, M., Krawezik, G. P., McCabe, M., Morel, R., et al. (2024) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stae1450 · Cited by 192
Practical galaxy morphology tools from deep supervised representation learning
Walmsley, M., Scaife, A. M. M., Lintott, C. J., Lochner, M., Etsebeth, V., Géron, T., Dickinson, H. J., Fortson, L., Kruk, S., Masters, K. L., et al. (2022) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stac525 · Cited by 111
Mining for Strong Gravitational Lenses with Self-supervised Learning
Stein, G., Blaum, J., Harrington, P., Medan, T., & Lukić, Z. (2022) · The Astrophysical Journal · doi:10.3847/1538-4357/ac6d63 · Cited by 52
“…orientation of the galaxies, the number of sources, the clustering, and the color, while removing the noise and symmetries described by the data augmentations (for a visualization of how galaxy properties are organized in the representation space of a self-supervised model, see Hayat et al. 2021).”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Hayat, M. A., Stein, G., Harrington, P., Lukić, Z., & Mustafa, M.
- Affiliations
- Lawrence Berkeley National Laboratory (US)
- Venue
- The Astrophysical Journal Letters
- Publisher
- American Astronomical Society
- Published
- 2021-04-01
- Volume
- 911
- Issue
- 2
- Pages
- L33
- ISSN
- 2041-8205 (ISSN-L)
- 2041-8213
- OpenAlex
- W3118065583
- Cited by
- 79
- References
- 50
- Citations by year
- 2026: 8 · 2025: 14 · 2024: 18 · 2023: 20 · 2022: 15 · 2021: 4
- FWCI
- 7.60
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (vor, 25 d)
- iopscience.iop.org/info/page/text-and-data-mining (tdm, 25 d)
- Locations
- The Astrophysical Journal Letters (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion, cc-by)
- eScholarship (California Digital Library) (submittedVersion)
- arXiv (Cornell University)
- Funders
- NERSC (AC02-05CH11231)
- Topics
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Galaxies: Formation, Evolution, Phenomena
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Astronomical Observations and Instrumentation
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- self-supervised representation learning, contrastive learning, celestial imagery, sky survey, galaxy morphology classification, photometric redshift estimation, Galaxy Zoo 2, Sloan Digital Sky Survey, label efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.