The Hyper Suprime-Cam software pipeline
Open accessAbstract
In this paper, we describe the optical imaging data processing pipeline developed for the Subaru Telescope’s Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey Telescope’s Data Management system, adding customizations for HSC, large-scale processing capabilities, and novel algorithms that have since been reincorporated into the LSST codebase. While designed primarily to reduce HSC Subaru Strategic Program (SSP) data, it is also the recommended pipeline for reducing general-observer HSC data. The HSC pipeline includes high-level processing steps that generate coadded images and science-ready catalogs as well as low-level detrending and image characterizations.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
HSC-SSP data are reduced using the LSST pipeline, and because the two surveys produce similar data, it will be more straightforward to adapt the SSL model and train it on LSST data once released.
“HSC-SSP data are reduced using the LSST pipeline (Bosch et al. 2018; Aihara et al. 2019) and since the two surveys produce similar data, it will be more straightforward to adapt our SSL model and train it on LSST data once it is released.”
From Detecting galaxy tidal features using self-supervised representation learning (2024) · cites this paper as Bosch et al. 2018
Cites
SExtractor: Software for source extraction
Bertin, É., & Arnouts, S. (1996) · Astronomy & Astrophysics Supplement Series · doi:10.1051/aas:1996164 · Cited by 8,937 · see citing works
DAOPHOT - A computer program for crowded-field stellar photometry
Stetson, P. B. (1987) · Publications of the Astronomical Society of the Pacific · doi:10.1086/131977 · Cited by 4,725 · see citing works
The Second Data Release of the Sloan Digital Sky Survey
Abazajian, K. N., Adelman-McCarthy, J., Agüeros, M. A., Allam, S., Anderson, K. S. J., Anderson, S. F., Annis, J., Bahcall, N. A., Baldry, I. K., Bastian, S., et al. (2004) · The Astronomical Journal · doi:10.1086/421365 · Cited by 1,126 · see citing works
Self-citationThe Hyper Suprime-Cam SSP Survey: Overview and survey design
Aihara, H., Arimoto, N., Armstrong, R., Arnouts, S., Bahcall, N. A., Bickerton, S., Bosch, J., Bundy, K., Capak, P. L., Chan, J. H. H., et al. (2018) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx066 · Cited by 1,087 · see citing works
Self-citationPhotometry of a complete sample of faint galaxies
Kron, R. G. (1980) · The Astrophysical Journal Supplement Series · doi:10.1086/190669 · Cited by 1,054 · see citing works
Astrometric Calibration of the Sloan Digital Sky Survey
Pier, J. R., Munn, J. A., Hindsley, R. B., Hennessy, G. S., Kent, S. M., Lupton, R. H., & Ivezić, Ž. (2003) · The Astronomical Journal · doi:10.1086/346138 · Cited by 908 · see citing works
Self-citationThe Dark Energy Survey: more than dark energy - an overview
Abbott, D., Abdalla, F., Aleksic, J., Allam, S., Amara, A., Bacon, D., Balbinot, E., Banerji, M., Bechtol, K., Benoit-Lévy, A., et al. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw641 · Cited by 766 · see citing works
First data release of the Hyper Suprime-Cam Subaru Strategic Program
Aihara, H., Armstrong, R., Bickerton, S., Bosch, J., Coupon, J., Furusawa, H., Hayashi, Y., Ikeda, H., Kamata, Y., Karoji, H., et al. (2017) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx081 · Cited by 605 · see citing works
Self-citationHyper Suprime-Cam: System design and verification of image quality
Miyazaki, S., Komiyama, Y., Kawanomoto, S., Doi, Y., Furusawa, H., Hamana, T., Hayashi, Y., Ikeda, H., Kamata, Y., Karoji, H., et al. (2017) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx063 · Cited by 560 · see citing works
Self-citationde Jong, J. T. A., Kleijn, G. A. V., Kuijken, K. H., & Valentijn, E. A. (2012) · Experimental Astronomy · doi:10.1007/s10686-012-9306-1 · Cited by 439 · see citing works
Weak Gravitational Lensing with COSMOS: Galaxy Selection and Shape Measurements
Leauthaud, A., Massey, R. J., Kneib, J., Rhodes, J. D., Johnston, D. E., Capak, P. L., Heymans, C., Ellis, R. S., Koekemoer, A. M., Fèvre, O. C. L., et al. (2007) · The Astrophysical Journal Supplement Series · doi:10.1086/516598 · Cited by 435 · see citing works
Self-citationGalSim: The modular galaxy image simulation toolkit
Rowe, B., Jarvis, M., Mandelbaum, R., Bernstein, G. M., Bosch, J., Simet, M., Meyers, J. M., Kacprzak, T., Nakajima, R., Zuntz, J., et al. (2015) · Astronomy and Computing · doi:10.1016/j.ascom.2015.02.002 · Cited by 432 · see citing works
Self-citationWeak Gravitational Lensing and Its Cosmological Applications
Hoekstra, H., & Jain, B. (2008) · Annual Review of Nuclear and Particle Science · doi:10.1146/annurev.nucl.58.110707.171151 · Cited by 423 · see citing works
Gravitational lensing analysis of the Kilo-Degree Survey
Kuijken, K. H., Heymans, C., Hildebrandt, H., Nakajima, R., Erben, T., de Jong, J. T. A., Viola, M., Choi, A., Hoekstra, H., Miller, L., et al. (2015) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv2140 · Cited by 420 · see citing works
Shear calibration biases in weak-lensing surveys
Hirata, C., & Seljak, U. (2003) · Monthly Notices of the Royal Astronomical Society · doi:10.1046/j.1365-8711.2003.06683.x · Cited by 396 · see citing works
Photometric redshifts for Hyper Suprime-Cam Subaru Strategic Program Data Release 1
Tanaka, M., Coupon, J., Hsieh, B.-C., Mineo, S., Nishizawa, A. J., Speagle, J. S., Furusawa, H., Miyazaki, S., & Murayama, H. (2017) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx077 · Cited by 334 · see citing works
Self-citationMiller, L., Heymans, C., Kitching, T., van Waerbeke, L., Erben, T., Hildebrandt, H., Hoekstra, H., Mellier, Y., Rowe, B., Coupon, J., et al. (2012) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sts454 · Cited by 328 · see citing works
Self-citationHyper Suprime-Cam: Camera dewar design
Komiyama, Y., Obuchi, Y., Nakaya, H., Kamata, Y., Kawanomoto, S., Utsumi, Y., Miyazaki, S., Uraguchi, F., Furusawa, H., Morokuma, T., et al. (2017) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx069 · Cited by 223 · see citing works
Self-citationTHE SLOAN DIGITAL SKY SURVEY COADD: 275 deg 2 OF DEEP SLOAN DIGITAL SKY SURVEY IMAGING ON STRIPE 82
Annis, J. T., Soares-Santos, M., Strauss, M. A., Becker, A. C., Dodelson, S., Fan, X., Gunn, J. E., Hao, J., Ivezić, Ž., Jester, S., et al. (2014) · The Astrophysical Journal · doi:10.1088/0004-637x/794/2/120 · Cited by 221 · see citing works
Self-citationBovy, J., Hennawi, J. F., Hogg, D. W., Myers, A. D., Kirkpatrick, J. A., Schlegel, D. J., Ross, N. P., Sheldon, E. S., McGreer, I. D., Schneider, D. P., et al. (2011) · The Astrophysical Journal · doi:10.1088/0004-637x/729/2/141 · Cited by 217 · see citing works
The on-site quality-assurance system for Hyper Suprime-Cam: OSQAH
Furusawa, H., Koike, M., Takata, T., Okura, Y., Miyatake, H., Lupton, R. H., Bickerton, S. J., Price, P. A., Bosch, J., Yasuda, N., et al. (2017) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx079 · Cited by 208 · see citing works
Self-citationThe DES Science Verification weak lensing shear catalogues
Jarvis, M., Sheldon, E. S., Zuntz, J., Kacprzak, T., Bridle, S., Amara, A., Armstrong, R., Becker, M. R., Bernstein, G. M., Bonnett, C., et al. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw990 · Cited by 187 · see citing works
Self-citationThe first-year shear catalog of the Subaru Hyper Suprime-Cam Subaru Strategic Program Survey
Mandelbaum, R., Miyatake, H., Hamana, T., Oguri, M., Simet, M., Armstrong, R., Bosch, J., Murata, R., Lanusse, F., Leauthaud, A., et al. (2017) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx130 · Cited by 161 · see citing works
Self-citationThe brighter-fatter effect and pixel correlations in CCD sensors
Antilogus, P. E., Astier, P., Doherty, P., Guyonnet, A., & Regnault, N. (2014) · Journal of Instrumentation · doi:10.1088/1748-0221/9/03/c03048 · Cited by 160 · see citing works
The bright-star masks for the HSC-SSP survey
Coupon, J., Czakon, N. G., Bosch, J., Komiyama, Y., Medezinski, E., Miyazaki, S., & Oguri, M. (2017) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx047 · Cited by 144 · see citing works
Self-citationCharacterization and photometric performance of the Hyper Suprime-Cam Software Pipeline
Huang, S., Leauthaud, A., Murata, R., Bosch, J., Price, P., Lupton, R., Mandelbaum, R., Lackner, C., Bickerton, S., Miyazaki, S., et al. (2017) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx126 · Cited by 112 · see citing works
Self-citationCharacterization and correction of charge-induced pixel shifts in DECam
Gruen, D., Bernstein, G. M., Jarvis, M., Rowe, B., Vikram, V., Plazas, A. A., & Seitz, S. (2015) · Journal of Instrumentation · doi:10.1088/1748-0221/10/05/c05032 · Cited by 78 · see citing works
Jee, M. J., & Tyson, J. A. (2011) · Publications of the Astronomical Society of the Pacific · doi:10.1086/660137 · Cited by 74 · see citing works
An implementation of Bayesian lensing shear measurement
Sheldon, E. S. (2014) · Monthly Notices of the Royal Astronomical Society Letters · doi:10.1093/mnrasl/slu104 · Cited by 71 · see citing works
IMPACT OF ATMOSPHERIC CHROMATIC EFFECTS ON WEAK LENSING MEASUREMENTS
Meyers, J. M., & Burchat, P. R. (2015) · The Astrophysical Journal · doi:10.1088/0004-637x/807/2/182 · Cited by 39 · see citing works
Replacing Standard Galaxy Profiles with Mixtures of Gaussians
Hogg, D. W., & Lang, D. (2013) · Publications of the Astronomical Society of the Pacific · doi:10.1086/671228 · Cited by 39 · see citing works
Self-citationZackay, B., & Ofek, E. O. (2017) · The Astrophysical Journal · doi:10.3847/1538-4357/836/2/188 · Cited by 36 · see citing works
Fast Algorithms for Matching CCD Images to a Stellar Catalogue
Tabur, V. (2007) · Publications of the Astronomical Society of Australia · doi:10.1071/as07028 · Cited by 28 · see citing works
An algorithm for precise aperture photometry of critically sampled images
Bickerton, S. J., & Lupton, R. H. (2013) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stt244 · Cited by 11 · see citing works
Self-citationGALAXY MODELING WITH COMPOUND ELLIPTICAL SHAPELETS
Bosch, J. (2010) · The Astronomical Journal · doi:10.1088/0004-6256/140/3/870 · Cited by 10 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
LSST: From Science Drivers to Reference Design and Anticipated Data Products
Ivezić, Ž., Kahn, S. M., Tyson, J. A., Abel, B., Acosta, E., Allsman, R., Alonso, D., AlSayyad, Y., Anderson, S. F., Andrew, J., et al. (2019) · The Astrophysical Journal · doi:10.3847/1538-4357/ab042c · Cited by 4,357 · see citing works
Self-citationThe Hyper Suprime-Cam SSP Survey: Overview and survey design
Aihara, H., Arimoto, N., Armstrong, R., Arnouts, S., Bahcall, N. A., Bickerton, S., Bosch, J., Bundy, K., Capak, P. L., Chan, J. H. H., et al. (2018) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psx066 · Cited by 1,087 · see citing works
Self-citationSecond data release of the Hyper Suprime-Cam Subaru Strategic Program
Aihara, H., AlSayyad, Y., Ando, M., Armstrong, R., Bosch, J., Egami, E., Furusawa, H., Furusawa, J., Goulding, A., Harikane, Y., et al. (2019) · Publications of the Astronomical Society of Japan · doi:10.1093/pasj/psz103 · Cited by 511 · see citing works
Self-citationDark Energy Survey Year 3 results: Cosmology from cosmic shear and robustness to data calibration
Amon, A., Gruen, D., Troxel, M. A., MacCrann, N., Dodelson, S., Choi, A., Doux, C., Secco, L. F., Samuroff, S., Krause, E., et al. (2022) · Physical Review D · doi:10.1103/physrevd.105.023514 · Cited by 437 · see citing works
Weak Lensing for Precision Cosmology
Mandelbaum, R. (2018) · Annual Review of Astronomy and Astrophysics · doi:10.1146/annurev-astro-081817-051928 · Cited by 409 · see citing works
Self-citationIlluminating Low Surface Brightness Galaxies with the Hyper Suprime-Cam Survey
Greco, J. P., Greene, J. E., Strauss, M. A., Macarthur, L. A., Flowers, X., Goulding, A. D., Huang, S., Kim, J. H., Komiyama, Y., Leauthaud, A., et al. (2018) · The Astrophysical Journal · doi:10.3847/1538-4357/aab842 · Cited by 193 · see citing works
Self-citationHuang, S., Leauthaud, A., Greene, J. E., Bundy, K., Lin, Y.-T., Tanaka, M., Miyazaki, S., & Komiyama, Y. (2018) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stx3200 · Cited by 113 · see citing works
Self-citationKado-Fong, E., Greene, J. E., Hendel, D., Price-Whelan, A. M., Greco, J. P., Goulding, A. D., Huang, S., Johnston, K. V., Komiyama, Y., Lee, C.-H., et al. (2018) · The Astrophysical Journal · doi:10.3847/1538-4357/aae0f0 · Cited by 69 · see citing works
Self-citationSonnenfeld, A., Verma, A., More, A., Baeten, E., Macmillan, C., Wong, K. C., Chan, J. H. H., Jaelani, A. T., Lee, C.-H., Oguri, M., et al. (2020) · Astronomy & Astrophysics · doi:10.1051/0004-6361/202038067 · Cited by 67 · see citing works
Deep generative models for galaxy image simulations
Lanusse, F., Mandelbaum, R., Ravanbakhsh, S., Li, C.-L., Freeman, P., & Póczos, B. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stab1214 · Cited by 53 · see citing works
Self-citationAnomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks
Storey-Fisher, K., Huertas-Company, M., Ramachandra, N., Lanusse, F., Leauthaud, A., Luo, Y., Huang, S., & Prochaska, J. X. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stab2589 · Cited by 38 · see citing works
Self-citationPaillassa, M., Bertin, E., & Bouy, H. (2020) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201936345 · Cited by 35 · see citing works
“Most current pipelines rely on a fine prior knowledge of their instruments to detect and mask electronic contaminants (e.g., Bosch et al. 2018; Morganson et al. 2018) and to some extent optical contaminants (e.g., Kawanomoto et al. 2016a,b).”
BackgroundMethodThe challenge of blending in large sky surveys
Melchior, P., Joseph, R., Sanchez, J., MacCrann, N., & Gruen, D. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00353-y · Cited by 30 · see citing works
Martínez-Lombilla, C., Brough, S., Montes, M., Baena-Gallé, R., Akhlaghi, M., Infante-Sainz, R., Driver, S. P., Holwerda, B. W., Pimbblet, K. A., & Robotham, A. S. G. (2022) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stac3119 · Cited by 27 · see citing works
Wavelength-dependent PSFs and their impact on weak lensing measurements
Carlsten, S. G., Strauss, M. A., Lupton, R. H., Meyers, J. E., & Miyazaki, S. (2018) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sty1636 · Cited by 29 · see citing works
Self-citationMassive Early-type Galaxies in the HSC-SSP: Flux Fraction of Tidal Features and Merger Rates
Huang 黄, Q. 齐., & Fan 范, L. 璐. (2022) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/ac85b1 · Cited by 19 · see citing works
Cañameras, R., Schuldt, S., Shu, Y., Suyu, S. H., Taubenberger, S., Andika, I. T., Bag, S., Inoue, K. T., Jaelani, A. T., Leal-Taixé, L., et al. (2024) · Astronomy & Astrophysics · doi:10.1051/0004-6361/202347072 · Cited by 19 · see citing works
Detecting galaxy tidal features using self-supervised representation learning
Desmons, A., Brough, S., & Lanusse, F. (2024) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stae1402 · Cited by 15 · see citing works
- Authors
- Bosch, J., Armstrong, R., Bickerton, S., Furusawa, H., Ikeda, H., Koike, M., Lupton, R., Mineo, S., Price, P., Takata, T., Tanaka, M., Yasuda, N., AlSayyad, Y., Becker, A. C., Coulton, W., Coupon, J., Garmilla, J., Huang, S., Krughoff, K. S., Lang, D., Leauthaud, A., Lim, K.-T., Lust, N. B., MacArthur, L. A., Mandelbaum, R., Miyatake, H., Miyazaki, S., Murata, R., More, S., Okura, Y., Owen, R., Swinbank, J. D., Strauss, M. A., Yamada, Y., & Yamanoi, H.
- Affiliations
- Princeton University (US)
- Kavli Institute for the Physics and Mathematics of the Universe (JP)
- National Astronomical Observatory of Japan (JP)
- The Graduate University for Advanced Studies, SOKENDAI (JP)
- University of Washington (US)
- University of Geneva (CH)
- Astronomy Department, University of Washington, Box 351580, U.W., Seattle, WA 98195-1580, USA
- University of Toronto (CA)
- SLAC National Accelerator Laboratory (US)
- Carnegie Mellon University (US)
- Jet Propulsion Laboratory (US)
- Brookhaven National Laboratory (US)
- Corresponding author
- Bosch, James
- ORCID
- Venue
- Publications of the Astronomical Society of Japan
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-10-12
- Volume
- 70
- Issue
- SP1
- ISSN
- 0004-6264 (ISSN-L)
- 2053-051X
- OpenAlex
- W2620256628
- Cited by
- 551
- References
- 35
- Citations by year
- 2026: 39 · 2025: 56 · 2024: 65 · 2023: 62 · 2022: 65 · 2021: 63 · 2020: 63 · 2019: 55 · 2018: 39 · 2017: 41 · 2016: 3
- FWCI
- 56.33
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Publications of the Astronomical Society of Japan (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Aeronautics and Space Administration (NNX08AR22G)
- National Science Foundation (AST-1238877)
- Japan Society for Promotion of Science (JP15K17600 and JP16H01089)
- Topics
- Physical Sciences › Physics and Astronomy › Instrumentation › Astronomy and Astrophysical Research
- Physical Sciences › Engineering › Computational Mechanics › Astronomical Observations and Instrumentation
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Adaptive optics and wavefront sensing
- Keywords
- Hyper Suprime-Cam, Subaru Telescope, optical imaging, LSST, astronomical catalogues, image characterization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
