Generative deep fields: arbitrarily sized, random synthetic astronomical images through deep learning
Open accessAbstract
Generative adversarial networks (GANs) are a class of artificial neural network that can produce realistic, but artificial, images that resemble those in a training set. In typical GAN architectures these images are small, but a variant known as Spatial GANs (SGANs) can generate arbitrarily large images, provided training images exhibit some level of periodicity. Deep extragalactic imaging surveys meet this criteria due to the cosmological tenet of isotropy. Here we train an SGAN to generate images resembling the iconic Hubble Space Telescope eXtreme Deep Field (XDF). We show that the properties of ‘galaxies’ in generated images have a high level of fidelity with galaxies in the real XDF in terms of abundance, morphology, magnitude distributions, and colours. As a demonstration we have generated a 7.6-billion pixel ‘generative deep field’ spanning 1.45 deg. The technique can be generalized to any appropriate imaging training set, offering a new purely data-driven approach for producing realistic mock surveys and synthetic data at scale, in astrophysics and beyond.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Smith & Geach (2019) demonstrated the ability to sample an 87 040 × 87 040 pixel image emulating the HST XDF using a Spatial-GAN.
“The authors demonstrated the ability to sample a 87 040 × 87 040 pixels image emulating the HST eXtreme Deep Field (XDF).”
From The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys (2023) · cites this paper as Smith & Geach (2019)
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
Schawinski, K., Zhang, C., Zhang, H., Fowler, L., & Santhanam, G. K. (2017) · Monthly Notices of the Royal Astronomical Society: Letters · doi:10.1093/mnrasl/slx008 · Cited by 246 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Morpheus: A Deep Learning Framework for the Pixel-level Analysis of Astronomical Image Data
Hausen, R., & Robertson, B. E. (2020) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/ab8868 · Cited by 110 · see citing works
“Deep learning models have been further applied to infer the surface brightness profiles of galaxies (Tuccillo et al. 2018) and measure their fluxes (Boucaud et al. 2019), and now to simulate entire surveys (Smith & Geach 2019).”
MethodThe Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys
Huertas-Company, M., & Lanusse, F. (2023) · Publications of the Astronomical Society of Australia · doi:10.1017/pasa.2022.55 · Cited by 102 · see citing works
“Smith & Geach (2019) proposed to use a GAN variant, known as a Spatial-GAN (SGAN) to generate no longer only postage stamps, but entire fields of arbitrary size through a purely convolutional architecture.”
MethodDeep generative models for galaxy image simulations
Lanusse, F., Mandelbaum, R., Ravanbakhsh, S., Li, C.-L., Freeman, P., & Póczos, B. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stab1214 · Cited by 53 · see citing works
- Authors
- Smith, M. J., & Geach, J. E.
- Affiliations
- University of Hertfordshire (GB)
- Corresponding author
- Geach, James E
- Venue
- Monthly Notices of the Royal Astronomical Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-10-21
- Volume
- 490
- Issue
- 4
- Pages
- 4985-4990
- ISSN
- 0035-8711 (ISSN-L)
- 1365-2966
- OpenAlex
- W2940729180
- Cited by
- 27
- References
- 2
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 2 · 2023: 7 · 2022: 3 · 2021: 6 · 2020: 3 · 2019: 3
- FWCI
- 1.68
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Monthly Notices of the Royal Astronomical Society (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- University of Hertfordshire Research Archive (University of Hertfordshire) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Queen’s University
- Royal Society
- NVIDIA
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Galaxies: Formation, Evolution, Phenomena
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Stellar, planetary, and galactic studies
- Keywords
- generative adversarial networks, deep field, mock surveys, synthetic data generation, galaxy morphology, galaxy color, isotropy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review