The PAU Survey: Photometric redshifts using transfer learning from simulations
Open accessAbstract
In this paper, we introduce the deepz deep learning photometric redshift (photo-z) code. As a test case, we apply the code to the PAU survey (PAUS) data in the COSMOS field. deepz reduces the σ68 scatter statistic by 50 per cent at iAB = 22.5 compared to existing algorithms. This improvement is achieved through various methods, including transfer learning from simulations where the training set consists of simulations as well as observations, which reduces the need for training data. The redshift probability distribution is estimated with a mixture density network (MDN), which produces accurate redshift distributions. Our code includes an autoencoder to reduce noise and extract features from the galaxy SEDs. It also benefits from combining multiple networks, which lowers the photo-z scatter by 10 per cent. Furthermore, training with randomly constructed coadded fluxes adds information about individual exposures, reducing the impact of photometric outliers. In addition to opening up the route for higher redshift precision with narrow bands, these machine learning techniques can also be valuable for broad-band surveys.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Using a pretraining on simulations was found to reduce the photo-z scatter by as much as 50% for faint galaxies.
“Using a pretraining on simulations was found to reduce the photo-z scatter by as much as 50% for faint galaxies.”
From The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys (2023) · cites this paper as Eriksen et al. (2020)
Eriksen et al. (2020) explored transfer learning using a MDN trained on a combination of FSPS simulations and data from the PAU Survey.
“This approach was for instance explored in Eriksen et al. (2020) using a MDN trained on a combination of FSPS simulations and data from the PAU Survey.”
From The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys (2023) · cites this paper as Eriksen et al. (2020)
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
A systematic study of the class imbalance problem in convolutional neural networks
Buda, M., Maki, A., & Mazurowski, M. A. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.011 · Cited by 3,088 · see citing works
Calibrating Redshift Distributions beyond Spectroscopic Limits with Cross‐Correlations
Newman, J. A. (2008) · The Astrophysical Journal · doi:10.1086/589982 · Cited by 285 · see citing works
The many flavours of photometric redshifts
Salvato, M., Ilbert, O., & Hoyle, B. (2018) · Nature Astronomy · doi:10.1038/s41550-018-0478-0 · Cited by 234 · see citing works
Using neural networks to estimate redshift distributions. An application to CFHTLenS
Bonnett, C. (2015) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv230 · Cited by 76 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Dawes Review 10: The impact of deep learning for the analysis of galaxy surveys
Huertas-Company, M., & Lanusse, F. (2023) · Publications of the Astronomical Society of Australia · doi:10.1017/pasa.2022.55 · Cited by 102 · see citing works
“This approach was for instance explored in (Eriksen et al., 2020) using a MDN trained on a combination of FSPS simulations and data from the PAU Survey.”
Method
- Authors
- Eriksen, M., Alarcon, A., Cabayol, L., Carretero, J., Casas, R., Castander, F. J., De Vicente, J., Fernandez, E., Garcia-Bellido, J., Gaztanaga, E., Hildebrandt, H., Hoekstra, H., Joachimi, B., Miquel, R., Padilla, C., Sanchez, E., Sevilla-Noarbe, I., & Tallada, P.
- Affiliations
- Institute for High Energy Physics (ES)
- Argonne National Laboratory (US)
- Institute of Space Sciences (ES)
- Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas (CIEMAT), Avenida Complutense 40, E-28040 Madrid (Madrid), Spain
- Instituto de Física Teórica (IFT-UAM/CSIC), Universidad Autónoma de Madrid, E-28049 Madrid, Spain
- Institute of Space Sciences (ICE, CSIC), Campus UAB, Carrer de Can Magrans, s/n, E-08193 Barcelona, Spain
- Ruhr University Bochum (DE)
- Leiden University (NL)
- University College London (GB)
- Institució Catalana de Recerca i Estudis Avançats (ES)
- Institut de Física d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, E-08193 Bellaterra (Barcelona), Spain
- Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas (ES)
- Corresponding author
- Eriksen, M
- ORCID
- Venue
- Monthly Notices of the Royal Astronomical Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-08-06
- Volume
- 497
- Issue
- 4
- Pages
- 4565-4579
- ISSN
- 0035-8711 (ISSN-L)
- 1365-2966
- OpenAlex
- W3017324097
- Cited by
- 39
- References
- 5
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 8 · 2023: 7 · 2022: 4 · 2021: 14 · 2020: 1
- FWCI
- 2.90
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Monthly Notices of the Royal Astronomical Society (publishedVersion)
- arXiv (Cornell University) (acceptedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- DIGITAL.CSIC (Spanish National Research Council (CSIC)) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Ministerio de Economía y Competitividad (CSD2007-00060, AYA2015-71825, ESP2017-89838, PGC2018-094773, SEV-2016-0588, SEV-2016-0597, MDM-2015-0509)
- Generalitat de Catalunya
- Durham University
- European Research Council (StG DEGAS-259586)
- ETH Zurich
- H2020 European Research Council (StG ADULT-279396)
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (639.043.512)
- University College London (776247)
- Topics
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Galaxies: Formation, Evolution, Phenomena
- Physical Sciences › Engineering › Computational Mechanics › Astronomical Observations and Instrumentation
- Physical Sciences › Physics and Astronomy › Instrumentation › Astronomy and Astrophysical Research
- Keywords
- photometric redshifts, transfer learning, Pau, COSMOS field, mixture density networks, autoencoder, galaxy spectral energy distributions, narrow-band survey
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review