Scaling Laws for Galaxy Images
Open accessAbstract
We present the first systematic investigation of supervised scaling laws outside of an ImageNet-like context - on images of galaxies. We use 840k galaxy images and over 100M annotations by Galaxy Zoo volunteers, comparable in scale to Imagenet-1K. We find that adding annotated galaxy images provides a power law improvement in performance across all architectures and all tasks, while adding trainable parameters is effective only for some (typically more subjectively challenging) tasks. We then compare the downstream performance of finetuned models pretrained on either ImageNet-12k alone vs. additionally pretrained on our galaxy images. We achieve an average relative error rate reduction of 31% across 5 downstream tasks of scientific interest. Our finetuned models are more label-efficient and, unlike their ImageNet-12k-pretrained equivalents, often achieve linear transfer performance equal to that of end-to-end finetuning. We find relatively modest additional downstream benefits from scaling model size, implying that scaling alone is not sufficient to address our domain gap, and suggest that practitioners with qualitatively different images might benefit more from in-domain adaption followed by targeted downstream labelling.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In order to ensure model performance remains consistent over the entire range of properties in a galaxy sample, the datasets used to train a model should ideally trace the full range of galaxy properties in the sample to which the model will be applied, even for self-supervised models.
“This tells us that in order to ensure model performance remains consistent over the entire range of properties in a galaxy sample, the datasets used to train a model should ideally trace the full range of galaxy properties in the sample to which the model will be applied even for self-supervised models (e.g. Walmsley et al. 2024).”
From Detecting galaxy tidal features using self-supervised representation learning (2024) · cites this paper as Walmsley et al. 2024
The Introduction and Downstream Performance section report that in-domain galaxy pretraining improves performance when downstream images differ from ImageNet, supporting the general value of training on relevant images. They do not establish that training data must cover the full range of galaxy properties to keep performance consistent across that range. The Limitations section says self-supervised alternatives are left for future work, so the claim's extension to those models is unsupported. (LLM, conf=0.84)
Experimental — accuracy not yet measuredUsing pretrained models such as Zoobot and fine-tuning them (transfer learning) can create a model optimised for a new problem more quickly and easily than creating a model from scratch.
“Using pretrained models such as Zoobot and fine-tuning them is an example of 'transfer learning', whereby taking a tool that is already primed to solve a different but related problem and then adapting only a part of the model, it is possible to create a model that is optimised to solve a new problem in a way that is quicker and easier than creating a model from scratch (Walmsley et al. 2024).”
From Euclid Quick Data Release (Q1): XXVIII. The Strong Lensing Discovery Engine C – Finding lenses with machine learning (2026) · cites this paper as Walmsley et al. 2024
Section 4 (Downstream Performance; page unavailable) compares pretrained, fine-tuned models with models trained from scratch and reports that pretraining improves performance and label efficiency. It also reports that linear transfer learning can perform similarly to full fine-tuning, supporting the possibility of adapting only part of a model. The paper does not establish that this approach is quicker or easier than building a model from scratch. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Part of this paper’s reference list could not be split into single entries.
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1× · see citing works
“We see a power law between labelled images and test loss across all architecture families tested (ResNet [31], EfficientNet [32], EfficientNetV2 [33], MaxViT [34], ConvNeXT [35]) and all variants.”
BackgroundImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 2× · see citing works
“Zoo [5] online volunteers, comparable in scale to Imagenet-1K [6] and including more than half of all human galaxy labels ever collected.”
BackgroundMethodEfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072 · cited 1× · see citing works
“We see a power law between labelled images and test loss across all architecture families tested (ResNet [31], EfficientNet [32], EfficientNetV2 [33], MaxViT [34], ConvNeXT [35]) and all variants.”
BackgroundLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 2× · see citing works
“Notably, self-supervised training on web-scale datasets shows remarkable few-and zero-shot generalization performance (e.g. [7, 38]).”
BackgroundLiu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., & Xie, S. (2022) · arXiv · Cited by 8,924 · see citing works
Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., & Xie, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01167 · Cited by 8,494 · cited 1× · see citing works
“We see a power law between labelled images and test loss across all architecture families tested (ResNet [31], EfficientNet [32], EfficientNetV2 [33], MaxViT [34], ConvNeXT [35]) and all variants.”
BackgroundOn the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676 · see citing works
The UKIRT Infrared Deep Sky Survey (UKIDSS)
Lawrence, A., Warren, S. J., Almaini, O., Edge, A. C., Hambly, N. C., Jameson, R. F., Lucas, P. W., Casali, M. M., Adamson, A. J., Dye, S., et al. (2007) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2007.12040.x · Cited by 2,445 · cited 1× · see citing works
“UKIDSS includes images taken by the UK Infrared Telescope; the survey is described in [47].”
MethodEfficientNetV2: Smaller Models and Faster TrainingPreprint
Tan, M., & Le, Q. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.00298 · Cited by 1,473 · cited 1× · see citing works
“We see a power law between labelled images and test loss across all architecture families tested (ResNet [31], EfficientNet [32], EfficientNetV2 [33], MaxViT [34], ConvNeXT [35]) and all variants.”
BackgroundMaxViT: Multi-Axis Vision Transformer
Tu, Z., Talebi, H., Zhang, H., Yang, F., Milanfar, P., Bovik, A., & Li, Y.-X. (2022) · European Conference on Computer Vision · doi:10.48550/arxiv.2204.01697 · Cited by 1,218 · cited 1×
“We see a power law between labelled images and test loss across all architecture families tested (ResNet [31], EfficientNet [32], EfficientNetV2 [33], MaxViT [34], ConvNeXT [35]) and all variants.”
Background(2022) · doi:10.1007/978-3-031-20053-3_27 · Cited by 1,060 · see citing works
Zhai, X., Kolesnikov, A., Houlsby, N., & Beyer, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01179 · Cited by 891 · cited 1× · see citing works
“The data supporting these laws in supervised computer vision is drawn from experiments with ImageNet or ImageNet-like datasets [1, 2, 3, 4].”
MethodTransfusion: Understanding Transfer Learning for Medical ImagingPreprint
Raghu, M., Zhang, C., Kleinberg, J. M., & Samy Bengio, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07208 · Cited by 845 · cited 1× · see citing works
“The medical imaging community, which shares a need for label-efficient adaption to qualitatively different images, ‘routinely’ [12] applies ImageNet-like pretraining with varying results [13, 14, 15, 16].”
BackgroundRotation-invariant convolutional neural networks for galaxy morphology prediction
Dieleman, S., Willett, K. W., & Dambre, J. (2015) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv632 · Cited by 781 · cited 1× · see citing works
“Galaxy Zoo labels have been extensively used as a deep learning benchmark (first by [22]) or as training data for deployed models (e.g. for the Euclid space telescope [23]).”
BackgroundReproducible Scaling Laws for Contrastive Language-Image Learning
Cherti, M., Beaumont, R., Wightman, R., Wortsman, M., Ilharco, G., Gordon, C., Schuhmann, C., Schmidt, L., & Jitsev, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00276 · Cited by 673 · cited 1× · see citing works
“Notably, self-supervised training on web-scale datasets shows remarkable few-and zero-shot generalization performance (e.g. [7, 38]).”
BackgroundWillett, K. W., Lintott, C. J., Bamford, S. P., Masters, K. L., Simmons, B. D., Casteels, K. R. V., Edmondson, E. M., Fortson, L. F., Kaviraj, S., Keel, W. C., et al. (2013) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stt1458 · Cited by 659 · cited 1× · see citing works
“The campaigns used in this work are Galaxy Zoo DESI (397k galaxies, [27]) primarily from the Blanco Telescope in Chile, Galaxy Zoo 2 (188k galaxies, [44]) from the Sloan Foundation Telescope in New Mexico, Galaxy Zoo Hubble (94k galaxies, [45]) and Galaxy Zoo CANDELS (47k images, [46]) from the…”
MethodSelf-citationDeep Learning Scaling is Predictable, Empirically
Hestness, J., Narang, S., Ardalani, N., Diamos, G., Jun, H., Kianinejad, H., Patwary, M. M. A., Yang, Y., & Zhou, Y. (2017) · arXiv · doi:10.48550/arxiv.1712.00409 · Cited by 427 · see citing works
What is being transferred in transfer learning?Preprint
Neyshabur, B., Sedghi, H., & Zhang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.11687 · Cited by 274 · cited 1× · see citing works
“Theory [17] and a medical imaging experiment [18] suggest additional training on diverse yet in-domain images may be helpful.”
Backgroundemcee v3: A Python ensemble sampling toolkit for affine-invariant MCMC
Foreman-Mackey, D., Farr, W., Sinha, M., et al. (2019) · Journal of Open Source Software · doi:10.21105/joss.01864 · Cited by 222 · cited 1×
“We use a Bayesian treatment via ensemble MCMC [42].”
MethodAre Emergent Abilities of Large Language Models a Mirage?
Schaeffer, R., Miranda, B., & Koyejo, S. (2023) · arXiv · doi:10.48550/arxiv.2304.15004 · Cited by 200 · see citing works
Walmsley, M., Lintott, C. J., Géron, T., Kruk, S., Krawczyk, C., Willett, K., Bamford, S. P., Kelvin, L. S., Fortson, L., Gal, Y., et al. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stab2093 · Cited by 198 · cited 3× · see citing works
“The images to inspect were prioritised by a previous deep learning search (the automated measurements published in [28]).”
BackgroundMethodSelf-citationPawlik, M. M., Wild, V., Walcher, C. J., Johansson, P. H., Villforth, C., Rowlands, K., Méndez‐Abreu, J., & Hewlett, T. (2015) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stv2878 · Cited by 162 · cited 1× · see citing works
“Characterizing the remnants reveals the details of each collision, but remnants are hard to distinguish automatically from typical galaxy structure; finding LSB features has been challenging for both rule-based algorithms and deep learning approaches (e.g. [48, 49, 50]).”
BackgroundFAINT TIDAL FEATURES IN GALAXIES WITHIN THE CANADA-FRANCE-HAWAII TELESCOPE LEGACY SURVEY WIDE FIELDS
Atkinson, A. M., Abraham, R. G., & Ferguson, A. M. N. (2013) · The Astrophysical Journal · doi:10.1088/0004-637x/765/1/28 · Cited by 122 · cited 1× · see citing works
“Subclasses are ‘arm’, ‘stream’, ‘shell’, or ‘diffuse’, based on the taxonomy in [52].”
Self-citationWhat Makes Transfer Learning Work for Medical Images: Feature Reuse & Other Factors
Matsoukas, C., Haslum, J. F., Sorkhei, M., Söderberg, M. P., & Smith, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00901 · Cited by 113 · cited 1× · see citing works
“The medical imaging community, which shares a need for label-efficient adaption to qualitatively different images, ‘routinely’ [12] applies ImageNet-like pretraining with varying results [13, 14, 15, 16].”
BackgroundDeep learning predictions of galaxy merger stage and the importance of observational realism
Bottrell, C., Hani, M. H., Teimoorinia, H., Ellison, S. L., Moreno, J., Torrey, P., Hayward, C. C., Thorp, M., Simard, L., & Hernquist, L. (2019) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz2934 · Cited by 113 · cited 1× · see citing works
“Characterizing the remnants reveals the details of each collision, but remnants are hard to distinguish automatically from typical galaxy structure; finding LSB features has been challenging for both rule-based algorithms and deep learning approaches (e.g. [48, 49, 50]).”
BackgroundRethinking pre-training on medical imaging
Wen, Y., Chen, L., Deng, Y., & Zhou, C. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103145 · Cited by 92 · cited 1× · see citing works
“The medical imaging community, which shares a need for label-efficient adaption to qualitatively different images, ‘routinely’ [12] applies ImageNet-like pretraining with varying results [13, 14, 15, 16].”
BackgroundTransfer learning for galaxy morphology from one survey to another
Domínguez Sánchez, H., Huertas-Company, M., Bernardi, M., Kaviraj, S., Fischer, J. L., Abbott, T. M. C., Abdalla, F. B., Annis, J., Avila, S., Brooks, D., et al. (2019) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sty3497 · Cited by 91 · cited 2× · see citing works
“These projects use labelled images from a single telescope or, less frequently, apply transfer learning from one telescope to another [24, 25, 26].”
BackgroundIdentifying galaxy mergers in observations and simulations with deep learning
Pearson, W. J., Wang, L., Trayford, J. W., Petrillo, C. E., & van der Tak, F. F. S. (2019) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201935355 · Cited by 90 · cited 1× · see citing works
“Characterizing the remnants reveals the details of each collision, but remnants are hard to distinguish automatically from typical galaxy structure; finding LSB features has been challenging for both rule-based algorithms and deep learning approaches (e.g. [48, 49, 50]).”
BackgroundGalaxy Zoo: Quantitative visual morphological classifications for 48 000 galaxies from CANDELS
Simmons, B., Lintott, C., Willett, K., Masters, K., Kartaltepe, J., Häußler, B., Kaviraj, S., Krawczyk, C., Kruk, S., Mcintosh, D. H., et al. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw2587 · Cited by 83 · see citing works
Self-citationA Constructive Prediction of the Generalization Error Across Scales
Rosenfeld, J. S., Rosenfeld, A., Belinkov, Y., & Shavit, N. (2019) · arXiv · doi:10.48550/arxiv.1909.12673 · Cited by 74 · cited 1× · see citing works
“The data supporting these laws in supervised computer vision is drawn from experiments with ImageNet or ImageNet-like datasets [1, 2, 3, 4].”
MethodGalaxy Zoo: morphological classifications for 120 000 galaxies in HST legacy imaging
Willett, K., Galloway, M. A., Bamford, S., Lintott, C., Masters, K., Scarlata, C., Simmons, B., Beck, M., Cardamone, C., Cheung, E., et al. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw2568 · Cited by 73 · cited 1× · see citing works
“…Blanco Telescope in Chile, Galaxy Zoo 2 (188k galaxies, [44]) from the Sloan Foundation Telescope in New Mexico, Galaxy Zoo Hubble (94k galaxies, [45]) and Galaxy Zoo CANDELS (47k images, [46]) from the Hubble Space Telescope, Galaxy Zoo UKIDSS (69k galaxies) from the UK Infrared Telescope in…”
BackgroundSelf-citationSupervised Transfer Learning at Scale for Medical ImagingPreprint
Mustafa, B., Loh, A., Freyberg, J., MacWilliams, P., Wilson, M., McKinney, S. M., Sieniek, M., Winkens, J., Liu, Y., Bui, P., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.05913 · Cited by 71 · cited 1× · see citing works
“The medical imaging community, which shares a need for label-efficient adaption to qualitatively different images, ‘routinely’ [12] applies ImageNet-like pretraining with varying results [13, 14, 15, 16].”
BackgroundA Systematic Benchmarking Analysis of Transfer Learning for Medical Image Analysis
Taher, M. R. H., Haghighi, F., Feng, R., Gotway, M. B., & Liang, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87722-4_1 · Cited by 70 · cited 1× · see citing works
“Theory [17] and a medical imaging experiment [18] suggest additional training on diverse yet in-domain images may be helpful.”
BackgroundGhosh, A., Urry, C. M., Wang, Z., Schawinski, K., Turp, D., & Powell, M. C. (2020) · The Astrophysical Journal · doi:10.3847/1538-4357/ab8a47 · Cited by 58 · cited 1× · see citing works
“Most authors train from scratch, a minority use ImageNet pretraining, and a few use galaxy-galaxy transfer learning (e.g. [29, 24]).”
BackgroundSchaeffer, R., Khona, M., Robertson, Z., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2303.14151 · Cited by 57 · cited 1×
“8) but increasing parameter count still improves train loss far more rapidly than test loss, suggesting that while a degree of overparameterization is helpful (see e.g. [37]), continued parameter-only scaling may be untenable.”
BackgroundScaling Laws of Synthetic Images for Model Training … for Now
Fan, L., Chen, K., Krishnan, D., Katabi, D., Isola, P., & Tian, Y. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00705 · Cited by 46 · cited 1×
“Work on scaling laws often reports substantial improvements to few-shot [7] and finetuning [8] performance, including in the context of domain shift [9] and continual learning [10].”
BackgroundTang, H., Scaife, A. M. M., & Leahy, J. P. (2019) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz1883 · Cited by 46 · cited 1× · see citing works
“These projects use labelled images from a single telescope or, less frequently, apply transfer learning from one telescope to another [24, 25, 26].”
BackgroundSelf-citationButa, R. (2017) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stx1829 · Cited by 46 · see citing works
Masters, K. L., & Galaxy Zoo Team (2019) · Proceedings of the International Astronomical Union · doi:10.1017/s1743921319008615 · Cited by 31 · cited 3× · see citing works
“Zoo [5] online volunteers, comparable in scale to Imagenet-1K [6] and including more than half of all human galaxy labels ever collected.”
BackgroundScaling Laws for Deep LearningPreprint
Rosenfeld, J. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.07686 · Cited by 26 · cited 1× · see citing works
“When scaling model parameters, we see that large models are most effective only when supported by larger datasets (matching e.g. [36]).”
MethodAssaying Out-Of-Distribution Generalization in Transfer LearningPreprint
Wenzel, F., Dittadi, A., Gehler, P., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.09239 · Cited by 24 · cited 1× · see citing works
“Work on scaling laws often reports substantial improvements to few-shot [7] and finetuning [8] performance, including in the context of domain shift [9] and continual learning [10].”
BackgroundAstroCLIP: Cross-Modal Pre-Training for Astronomical Foundation Models
Lanusse, F., Parker, L., Golkar, S., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2310.03024 · Cited by 23 · cited 1×
“We hope this paper will provide a comparison point for future work investigating self-supervised alternatives [39, 26, 40] or hybrid approaches [41].”
BackgroundAstroformer: More Data Might not be all you need for Classification
Dagli, R. (2023) · Tiny Papers @ ICLR · doi:10.48550/arxiv.2304.05350 · Cited by 19 · cited 2×
“We use more labelled galaxy images than any previous work and train larger models than all but one [20].”
MethodTowards Galaxy Foundation Models with Hybrid Contrastive LearningPreprint
Walmsley, M., Slijepcevic, I. V., Bowles, M., & Scaife, A. (2022) · arXiv.org · doi:10.48550/arxiv.2206.11927 · Cited by 19 · cited 1× · see citing works
“We hope this paper will provide a comparison point for future work investigating self-supervised alternatives [39, 26, 40] or hybrid approaches [41].”
BackgroundSelf-citationScaling Vision TransformersPreprint
Zhai, X., Kolesnikov, A. I., Houlsby, N., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04560 · Cited by 18 · see citing works
Learning useful representations for radio astronomy"in the wild"with contrastive learningPreprint
Slijepcevic, I. V., Scaife, A., Walmsley, M., & Bowles, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.08666 · Cited by 14 · cited 2× · see citing works
“These projects use labelled images from a single telescope or, less frequently, apply transfer learning from one telescope to another [24, 25, 26].”
BackgroundSelf-citationSelf-supervised similarity search for large scientific datasets
Stein, G., Harrington, P., Blaum, J., Medan, T., & Lukic, Z. (2021) · arXiv · doi:10.48550/arxiv.2110.13151 · Cited by 13 · cited 1× · see citing works
“We hope this paper will provide a comparison point for future work investigating self-supervised alternatives [39, 26, 40] or hybrid approaches [41].”
BackgroundScaling Laws of Synthetic Images for Model Training ... for NowPreprint
Fan, L., Chen, K., Krishnan, D., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.04567 · Cited by 1 · see citing works
Walmsley, M., Géron, T., Kruk, S., et al. (2023) · Lancaster EPrints (Lancaster University) · doi:10.48550/arxiv.2309.11425
Self-citation
Flagged first, then by citations
Research works printed but not linked: 7
- Utkarsh Sharma and Jared Kaplan. Scaling laws from the data manifold dimension. The Journal of Machine Learning Research, 23(1):9:343-9:376, January 2022. ISSN 1532-4435.
- Vinay Venkatesh Ramasesh, Aitor Lewkowycz, and Ethan Dyer. Effect of scale on catastrophic forgetting in neural networks. October 2021. URL https://openreview.net/forum?id=GhVS8_yPeEa.
- Mehdi Cherti and J. Jitsev. Effect of large-scale pre-training on full and few-shot transfer learn- ing for natural and medical images. ArXiv, 2021. URL https://www.semanticscholar. org/paper/Effect-of-large-scale-pre-training-on-full-and-for-Cherti-Jitsev/ f1362000a1561924a3a07d7b9ab3d8cc3fd4e96d.
- Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper/2020/hash/ 0607f4c705595b911a4f3e7a127b44e0-Abstract.html.
- Euclid Collaboration, B. Aussel, S. Kruk, M. Walmsley, M. Huertas-Company, M. Castellano, C. J. Conselice, M. Delli Veneri, H. Domínguez Sánchez, P.-A. Duc, U. Kuchner, A. La Marca, B. Margalef- Bentabol, F. R. Marleau, G. Stevens, Y. Toba, C. Tortora, L. Wang, N. Aghanim, B. Altieri, A. Amara, S. Andreon, N. Auricchio, M. Baldi, S. Bardelli, R. Bender, C. Bodendorf, D. Bonino, E. Branchini, M. Brescia, J. Brinchmann, S. Camera, V. Capobianco, C. Carbone, J. Carretero, S. Casas, S. Cavuoti, A. Cimatti, G. Congedo, L. Conversi, Y. Copin, F. Courbin, H. M. Courtois, M. Cropper, A. Da Silva, H. Degaudenzi, A. M. Di Giorgio, J. Dinis, F. Dubath, X. Dupac, S. Dusini, M. Farina, S. Farrens, S. Fer- riol, S. Fotopoulou, M. Frailis, E. Franceschi, P. Franzetti, M. Fumana, S. Galeotta, B. Garilli, B. Gillis, C. Giocoli, A. Grazian, F. Grupp, S. V. H. Haugan, W. Holmes, I. Hook, F. Hormuth, A. Hornstrup, P. Hudelot, K. Jahnke, E. Keihänen, S. Kermiche, A. Kiessling, M. Kilbinger, B. Kubik, M. Kümmel, M. Kunz, H. Kurki-Suonio, R. Laureijs, S. Ligori, P. B. Lilje, V. Lindholm, I. Lloro, E. Maiorano, O. Man- sutti, O. Marggraf, K. Markovic, N. Martinet, F. Marulli, R. Massey, S. Maurogordato, E. Medinaceli, S. Mei, Y. Mellier, M. Meneghetti, E. Merlin, G. Meylan, M. Moresco, L. Moscardini, E. Munari, S.-M. Niemi, C. Padilla, S. Paltani, F. Pasian, K. Pedersen, W. J. Percival, V. Pettorino, S. Pires, G. Polenta, M. Poncet, L. A. Popa, L. Pozzetti, F. Raison, R. Rebolo, A. Renzi, J. Rhodes, G. Riccio, E. Romelli, M. Roncarelli, E. Rossetti, R. Saglia, D. Sapone, B. Sartoris, M. Schirmer, P. Schneider, A. Secroun, G. Seidel, S. Serrano, C. Sirignano, G. Sirri, L. Stanco, J.-L. Starck, P. Tallada-Crespí, A. N. Taylor, H. I. Teplitz, I. Tereno, R. Toledo-Moreo, F. Torradeflot, I. Tutusaus, E. A. Valentijn, L. Valenziano, T. Vas- sallo, A. Veropalumbo, Y. Wang, J. Weller, A. Zacchei, G. Zamorani, J. Zoubian, E. Zucca, A. Biviano, M. Bolzonella, A. Boucaud, E. Bozzo, C. Burigana, C. Colodro-Conde, D. Di Ferdinando, R. Farinelli, J. Graciá-Carpio, G. Mainetti, S. Marcin, N. Mauri, C. Neissner, A. A. Nucita, Z. Sakr, V. Scottez, M. Tenti, M. Viel, M. Wiesmann, Y. Akrami, V. Allevato, S. Anselmi, C. Baccigalupi, M. Ballardini, S. Borgani, A. S. Borlaff, H. Bretonnière, S. Bruton, R. Cabanac, A. Calabro, A. Cappi, C. S. Carvalho, G. Castignani, T. Castro, G. Cañas-Herrera, K. C. Chambers, J. Coupon, O. Cucciati, S. Davini, G. De Lucia, G. Desprez, S. Di Domizio, H. Dole, A. Díaz-Sánchez, J. A. Escartin Vigo, S. Escoffier, I. Ferrero, F. Finelli, L. Gabarra, K. Ganga, J. García-Bellido, E. Gaztanaga, K. George, F. Giacomini, G. Gozaliasl, A. Gregorio, D. Guinet, A. Hall, H. Hildebrandt, A. Jimenez Munoz, J. J. E. Kajava, V. Kansal, D. Karagiannis, C. C. Kirkpatrick, L. Legrand, A. Loureiro, J. Macias-Perez, M. Magliocchetti, R. Maoli, M. Martinelli, C. J. A. P. Martins, S. Matthew, M. Maturi, L. Maurin, R. B. Metcalf, M. Migliaccio, P. Monaco, G. Morgante, S. Nadathur, Nicholas A. Walton, A. Peel, A. Pezzotta, V. Popa, C. Porciani, D. Potter, M. Pöntinen, P. Reimberg, P.-F. Rocci, A. G. Sánchez, A. Schneider, E. Sefusatti, M. Sereno, P. Simon, A. Spurio Mancini, S. A. Stanford, J. Steinwagner, G. Testera, M. Tewes, R. Teyssier, S. Toft, S. Tosi, A. Troja, M. Tucci, C. Valieri, J. Valiviita, D. Vergani, and I. A. Zinchenko. Euclid preparation. Measuring detailed galaxy morphologies for Euclid with Machine Learning, February 2024. URL http://arxiv.org/abs/2402.10187. arXiv:2402.10187 [astro-ph]. · arXiv
- Ilya Loshchilov and Frank Hutter. Decoupled Weight Decay Regularization, January 2019. URL http: //arxiv.org/abs/1711.05101. arXiv:1711.05101 [cs, math]. · arXiv
- Arjun Dey, David J. Schlegel, Dustin Lang, Robert Blum, Kaylan Burleigh, Xiaohui Fan, Joseph R. Findlay, Doug Finkbeiner, David Herrera, Stéphanie Juneau, Martin Landriau, Michael Levi, Ian McGreer, Aaron Meisner, Adam D. Myers, John Moustakas, Peter Nugent, Anna Patej, Edward F. Schlafly, Alistair R. Walker, Francisco Valdes, Benjamin A. Weaver, Christophe Yèche, Hu Zou, Xu Zhou, Behzad Abareshi, T. M. C. Abbott, Bela Abolfathi, C. Aguilera, Shadab Alam, Lori Allen, A. Alvarez, James Annis, Behzad Ansarinejad, Marie Aubert, Jacqueline Beechert, Eric F. Bell, Segev Y. BenZvi, Florian Beutler, Richard M. Bielby, Adam S. Bolton, César Briceño, Elizabeth J. Buckley-Geer, Karen Butler, Annalisa Calamida, Raymond G. Carlberg, Paul Carter, Ricard Casas, Francisco J. Castander, Yumi Choi, Johan Comparat, Elena Cukanovaite, Timothée Delubac, Kaitlin DeVries, Sharmila Dey, Govinda Dhungana, Mark Dickinson, Zhejie Ding, John B. Donaldson, Yutong Duan, Christopher J. Duckworth, Sarah Eftekharzadeh, Daniel J. Eisenstein, Thomas Etourneau, Parker A. Fagrelius, Jay Farihi, Mike Fitzpatrick, Andreu Font-Ribera, Leah Fulmer, Boris T. Gänsicke, Enrique Gaztanaga, Koshy George, David W. Gerdes, Satya Gontcho A Gontcho, Claudio Gorgoni, Gregory Green, Julien Guy, Diane Harmer, M. Hernandez, Klaus Honscheid, Lijuan (Wendy) Huang, David J. James, Buell T. Jannuzi, Linhua Jiang, Richard Joyce, Armin Karcher, Sonia Karkar, Robert Kehoe, Jean-Paul Kneib, Andrea Kueter-Young, Ting-Wen Lan, Tod R. Lauer, Laurent Le Guillou, Auguste Le Van Suu, Jae Hyeon Lee, Michael Lesser, Laurence Perreault Levasseur, Ting S. Li, Justin L. Mann, Robert Marshall, C. E. Martínez-Vázquez, Paul Martini, Hélion du Mas des Bourboux, Sean McManus, Tobias Gabriel Meier, Brice Ménard, Nigel Metcalfe, Andrea Muñoz-Gutiérrez, Joan Najita, Kevin Napier, Gautham Narayan, Jeffrey A. Newman, Jundan Nie, Brian Nord, Dara J. Norman, Knut A. G. Olsen, Anthony Paat, Nathalie Palanque-Delabrouille, Xiyan Peng, Claire L. Poppett, Megan R. Poremba, Abhishek Prakash, David Rabinowitz, Anand Raichoor, Mehdi Rezaie, A. N. Robertson, Natalie A. Roe, Ashley J. Ross, Nicholas P. Ross, Gregory Rudnick, Sasha Safonova, Abhijit Saha, F. Javier Sánchez, Elodie Savary, Heidi Schweiker, Adam Scott, Hee-Jong Seo, Huanyuan Shan, David R. Silva, Zachary Slepian, Christian Soto, David Sprayberry, Ryan Staten, Coley M. Stillman, Robert J. Stupak, David L. Summers, Suk Sien Tie, H. Tirado, Mariana Vargas-Magaña, A. Katherina Vivas, Risa H. Wechsler, Doug Williams, Jinyi Yang, Qian Yang, Tolga Yapici, Dennis Zaritsky, A. Zenteno, Kai Zhang, Tianmeng Zhang, Rongpu Zhou, and Zhimin Zhou. Overview of the DESI Legacy Imaging Surveys. The Astronomical Journal, 157(5):168, April 2019. ISSN 00046256. doi: 10.3847/1538-3881/ab089d. URL http://arxiv.org/abs/1804.08657. arXiv: 1804.08657. · DOI
Cited by
Sorted by citations
Detecting galaxy tidal features using self-supervised representation learning
Desmons, A., Brough, S., & Lanusse, F. (2024) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stae1402 · Cited by 15 · see citing works
Euclid Collaboration, Lines, N. E. P., Collett, T. E., Walmsley, M., Rojas, K., Li, T., Leuzzi, L., Manjón-García, A., Vincken, S. H., Wilde, J., et al. (2026) · Astronomy & Astrophysics · doi:10.1051/0004-6361/202554542 · Cited by 14 · see citing works
Self-citationAguilar-Argüello, G., Fuentes-Pineda, G., Hernández-Toledo, H. M., Martínez, L. A., Vázquez-Mata, J. A., Brough, S., Demarco, R., Ghosh, A., Jiménez-Teja, Y., Martin, G., et al. (2025) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staf085 · Cited by 8 · see citing works
- Authors
- Walmsley, M., Bowles, M., Scaife, A. M. M., Makechemu, J. S., Gordon, A. J., Ferguson, A. M. N., Mann, R. G., Pearson, J., Popp, J. J., Bovy, J., Speagle, J., Dickinson, H., Fortson, L., Géron, T., Kruk, S., Lintott, C. J., Mantha, K., Mohan, D., O'Ryan, D., & Slijepevic, I. V.
- Affiliations
- University of Toronto (CA)
- University of Manchester (GB)
- Lancaster University (GB)
- Royal Observatory (GB)
- The Open University (GB)
- University of Minnesota (US)
- European Space Agency (FR)
- University of Oxford (GB)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2404.02973
- OpenAlex
- W4394007058
- Cited by
- 2
- References
- 41
- Citations by year
- 2025: 1 · 2024: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1835530, 2006894)
- Alfred P. Sloan Foundation
- University of Toronto
- Science and Technology Facilities Council (ST/X508640/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Physics and Astronomy › Astronomy and Astrophysics › Galaxies: Formation, Evolution, Phenomena
- Keywords
- scaling laws, galaxy images, supervised learning, transfer learning, label efficiency, model size scaling, domain gap, astronomical image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
