Zhai, Xiaohua

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 47,472

MLP-Mixer: An all-MLP Architecture for Vision

Tolstikhin, I., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Steiner, A., Keysers, D., Uszkoreit, J., et al. (2021) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 2,087

Sigmoid Loss for Language Image Pre-Training

Zhai, X., Mustafa, B., Kolesnikov, A., & Beyer, L. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV)

Multimodal Machine Learning ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 1,127

Big Transfer (BiT): General Visual Representation Learning

Kolesnikov, A., Beyer, L., Zhai, X., Puigcerver, J., Yung, J., Gelly, S., & Houlsby, N. (2019) · arXiv

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 1,039

Big Transfer (BiT): General Visual Representation Learning

Kolesnikov, A., Beyer, L., Zhai, X., Puigcerver, J., Yung, J., Gelly, S., & Houlsby, N. (2020) · Lecture Notes in Computer Science

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 1,039

Scaling Vision Transformers

Zhai, X., Kolesnikov, A., Houlsby, N., & Beyer, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 891

Revisiting Self-Supervised Visual Representation Learning

Kolesnikov, A., Zhai, X., & Beyer, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 675

LiT: Zero-Shot Transfer with Locked-image text Tuning

Zhai, X., Wang, X., Mustafa, B., Steiner, A., Keysers, D., Kolesnikov, A., & Beyer, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Multimodal Machine Learning ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 402

Underspecification Presents Challenges for Credibility in Modern Machine Learning

D'Amour, A., Heller, K., Moldovan, D., Adlam, B., Alipanahi, B., Beutel, A., Chen, C., Deaton, J., Eisenstein, J., Hoffman, M. D., et al. (2020) · arXiv

Domain Adaptation and Few-Shot LearningAdversarial Robustness in Machine Learning

Cited by 398

Self-Supervised GANs via Auxiliary Rotation Loss

Chen, T., Zhai, X., Ritter, M., Lucic, M., & Houlsby, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Generative Adversarial Networks and Image SynthesisDigital Media Forensic Detection

Cited by 328

How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers

Steiner, A., Kolesnikov, A., Zhai, X., Wightman, R., Uszkoreit, J., & Beyer, L. (2021) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 292

Are we done with imagenet?

Beyer, L., Hénaff, O. J., Kolesnikov, A., Zhai, X., & Oord, A. V. D. (2020) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 176

Revisiting the Calibration of Modern Neural Networks

Minderer, M., Djolonga, J., Romijnders, R., Hubis, F., Zhai, X., Houlsby, N., Tran, D., & Lucic, M. (2021) · arXiv

Adversarial Robustness in Machine LearningAdvanced Neural Network Applications

Cited by 160

High-Fidelity Image Generation With Fewer Labels

Lucic, M., Tschannen, M., Ritter, M., Zhai, X., Bachem, O., & Gelly, S. (2019) · arXiv

Generative Adversarial Networks and Image SynthesisDomain Adaptation and Few-Shot Learning

Cited by 134

Scaling vision transformers to 22 billion parameters

Dehghani, M., Djolonga, J., Mustafa, B., Padlewski, P., Heek, J., Gilmer, J., Steiner, A., Caron, M., Geirhos, R., Alabdulmohsin, I., et al. (2023) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 112

On Robustness and Transferability of Convolutional Neural Networks

Djolonga, J., Yung, J., Tschannen, M., Romijnders, R., Beyer, L., Kolesnikov, A., Puigcerver, J., Minderer, M., D'Amour, A., Moldovan, D., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 98

On Robustness and Transferability of Convolutional Neural Networks

Djolonga, J., Yung, J., Tschannen, M., Romijnders, R., Beyer, L., Kolesnikov, A., Puigcerver, J., Minderer, M., D'Amour, A., Moldovan, D., et al. (2020) · arXiv

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 98

Revisiting neural scaling laws in language and vision

Alabdulmohsin, I., Neyshabur, B., & Zhai, X. (2022) · Advances in Neural Information Processing Systems 35

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 41

SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features

Tschannen, M., Gritsenko, A., Wang, X., Naeem, M. F., Alabdulmohsin, I., Parthasarathy, N., Evans, T., Beyer, L., Xia, Y., Mustafa, B., et al. (2025) · arXiv

Multimodal Machine Learning ApplicationsAdvanced Neural Network Applications

Cited by 22

PaliGemma: A versatile 3B VLM for transfer

Beyer, L., Steiner, A., Pinto, A. S., Kolesnikov, A., Wang, X., Salz, D., Neumann, M., Alabdulmohsin, I., Tschannen, M., Bugliarello, E., et al. (2024) · arXiv

Multimodal Machine Learning ApplicationsAdvanced Neural Network Applications

Cited by 17