Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index; 7 of the 17 sources its claims cite were checked for support.

Self-supervised Representation Learning for Astronomical Images

Open access
Hayat, Md Abul, Stein, George, Harrington, Peter, Lukić, Zarija, Mustafa, Mustafa · 2021 · The Astrophysical Journal Letters

Abstract

Abstract Sky surveys are the largest data generators in astronomy, making automated tools for extracting meaningful scientific information an absolute necessity. We show that, without the need for labels, self-supervised learning recovers representations of sky survey images that are semantically useful for a variety of scientific tasks. These representations can be directly used as features, or fine-tuned, to outperform supervised methods trained only on labeled data. We apply a contrastive learning framework on multiband galaxy photometry from the Sloan Digital Sky Survey (SDSS), to learn image representations. We then use them for galaxy morphology classification and fine-tune them for photometric redshift estimation, using labels from the Galaxy Zoo 2 data set and SDSS spectroscopy. In both downstream tasks, using the same learned representations, we outperform the supervised state-of-the-art results, and we show that our approach can achieve the accuracy of supervised models while using 2–4 times fewer labels for training. The codes, trained models, and data can be found at https://portal.nersc.gov/project/dasrepo/self-supervised-learning-sdss .

Overview

CoChat Summary

TL;DR

Self-supervised contrastive learning on unlabeled SDSS galaxy images learns representations that are useful for morphology classification and photometric redshift estimation. The learned representations outperform supervised baselines and can match supervised accuracy with 2–4× fewer labels.

Key findings

  • Using the same learned representations, the authors outperform supervised state-of-the-art results on galaxy morphology classification and photometric redshift estimation.
  • For photometric redshift estimation, pre-training on unlabeled data gives accuracy equivalent to supervised training on 2–4× more spectroscopic redshift labels.
  • For the first Galaxy Zoo 2 morphology question, roughly a factor of 16 more labels are required in the supervised setting to achieve the same performance as the fine-tuned self-supervised model.
  • In augmentation ablation, Gaussian noise was the strongest augmentation and PSF the weakest; best performance was achieved using all augmentations except PSF.

Methods

  • Contrastive self-supervised learning with an InfoNCE loss on ∼1.2 million SDSS ugriz galaxy images of 64×64 pixels, using a ResNet50 encoder and augmentations including galactic extinction, PSF smoothing, rotation, jitter/crop, and Gaussian noise.
  • Downstream tasks: Galaxy Zoo 2 morphology classification using 183,929 galaxies with both ugriz images and crowd-sourced classifications, and photometric redshift estimation using 517,190 labeled spectroscopic galaxies, with 400,000 for training and 103,000 for validation.
  • Morphology classifiers included a supervised CNN from scratch, a linear classifier on frozen self-supervised representations, and a fine-tuned self-supervised encoder; photometric redshift used 180 redshift bins spanning 0 ≤ z ≤ 0.4 and metrics Δz, σ_MAD, and outlier percentage η.

Limitations

  • The paper states that exact quantitative comparison to Domínguez Sánchez et al. (2018) and Walmsley et al. (2020) is not possible due to inconsistent datasets, and that augmentation findings may not generalize to other surveys with different resolutions, signal-to-noise ratios, or target objects.
  • The paper states that spectroscopic labels impose selection bias: galaxies with specz labels are biased toward nearby bright objects with low galactic extinction and are not representative of all photometric galaxies.
  • The text also makes evident that images span 25.3 arcseconds, which is not large enough for very nearby large galaxies, and that misclassifications arise from imaging artifacts and label uncertainty.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3847/2041-8213/abf2c7

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

7 Valid · 1 Not valid · 4 Not checked · 74 Own results and interpretations

40 more claims

Create a free account to see all 86 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 25
  • It may state two separate claims as one. 18

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

6 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 50 references

Cited by

See all 79

Metadata

Authors
Hayat, M. A., Stein, G., Harrington, P., Lukić, Z., & Mustafa, M.
Affiliations
Lawrence Berkeley National Laboratory (US)
Venue
The Astrophysical Journal Letters
Published
2021-04-01
Volume
911
Issue
2
Pages
L33
ISSN
  • 2041-8205 (ISSN-L)
  • 2041-8213
OpenAlex
W3118065583
Cited by
79
References
50
Citations by year
2026: 8 · 2025: 14 · 2024: 18 · 2023: 20 · 2022: 15 · 2021: 4
FWCI
7.60
Type
journal article
Language
en
Open access
Licence
Locations
  • The Astrophysical Journal Letters (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion, cc-by)
  • eScholarship (California Digital Library) (submittedVersion)
  • arXiv (Cornell University)
Funders
NERSC (AC02-05CH11231)
Topics
  • Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Galaxies: Formation, Evolution, Phenomena
  • Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Astronomical Observations and Instrumentation
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
self-supervised representation learning, contrastive learning, celestial imagery, sky survey, galaxy morphology classification, photometric redshift estimation, Galaxy Zoo 2, Sloan Digital Sky Survey, label efficiency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Self-supervised Representation Learning for Astronomical Images. https://app.cochat.ai/papers/10.3847/2041-8213/abf2c7
The paper
Hayat, M. A., Stein, G., Harrington, P., Lukić, Z., & Mustafa, M. (2021). Self-supervised Representation Learning for Astronomical Images. The Astrophysical Journal Letters. https://doi.org/10.3847/2041-8213/abf2c7

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.