The DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
MaskGIT: Masked Generative Image Transformer
Open accessAbstract
Generative transformers have experienced rapid popularity growth in the computer vision community in synthesizing high-fidelity and high-resolution images. The best generative transformer models so far, however, still treat an image naively as a sequence of tokens, and decode an image sequentially following the raster scan ordering (i.e. line-by-line). We find this strategy neither optimal nor efficient. This paper proposes a novel image synthesis paradigm using a bidirectional transformer decoder, which we term MaskGIT. During training, MaskGIT learns to predict randomly masked tokens by attending to tokens in all directions. At inference time, the model begins with generating all tokens of an image simultaneously, and then refines the image iteratively conditioned on the previous generation. Our experiments demonstrate that MaskGIT significantly outperforms the state-of-the-art transformer model on the ImageNet dataset, and accelerates autoregressive decoding by up to 48x. Besides, we illustrate that MaskGIT can be easily extended to various image editing tasks, such as inpainting, extrapolation, and image manipulation. Project page: masked-generative-image-transformer.github.io.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus, discrete tokenizers are deployed in various visual understanding (Sun et al., 2024; Team, 2024; Wang et al., 2024; Wu et al., 2024) as well as image (Chang et al., 2022; Esser et al., 2021; Ramesh et al., 2021; Sun et al., 2024; Yu et al., 2022) and video generation tasks (Ge et al., 2022; Hong et al., 2023; Kondratyuk et al., 2024; Luo et al., 2024; Villegas et al., 2023; Wu et al., 2022;”
From Cosmos World Foundation Model Platform for Physical AI (2025) · cites this paper as Chang et al., 2022
In the citing paper
“Recent advances in deep learning have facilitated significant progress for various data modalities [29,161,205], such as images [38,239], audio [110,170], and text [14,20,75,159,162].”
From Diffusion Models: A Comprehensive Survey of Methods and Applications (2024) · cites this paper as [29]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,119
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Flagged first, then by citations
1 of the 52 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- seonghyeon, 2020, Implementation of generating diverse high-fidelity images with vq-vae-2 in py-torch
- suman, 2019, Ravuri and Oriol Vinyals. Classification accuracy score for conditional generative models, NeurIPS, 12247
- diederik, 2014, Kingma and Max Welling. Auto-encoding variational bayes, ICLRE
- ba, 2016, Layer normalization
- ho, 2021, Cas-caded diffusion models for high fidelity image gener-ation
- zhang, 2019, Goodfellow, Dimitris N. Metaxas, and Augustus Odena. Self-attention generative adver-sarial networks, ICML
- 2021, Tfhub model of boundless
- cheng, 2021, In&out Diverse image outpainting via gan inversion
- chen, 2020, Gener-ative pretraining from pixels, International Confer-ence on Machine Learning, 1691
- vaswani, 2017, Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need, NeurIPS
Cited by
Sorted by citations
Scalable Diffusion Models with Transformers
Peebles, W., & Xie, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00387 · Cited by 2,284
Diffusion Models: A Comprehensive Survey of Methods and Applications
Yang, L., Zhang, Z., Song, Y., Hong, S., Xu, R., Zhao, Y., Zhang, W., Cui, B., & Yang, M.-H. (2024) · ACM Computing Surveys · doi:10.1145/3626235 · Cited by 1,704
Imagic: Text-Based Real Image Editing with Diffusion Models
Kawar, B., Zada, S., Lang, O., Tov, O., Chang, H., Dekel, T., Mosseri, I., & Irani, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00582 · Cited by 991
Self-citationSimulating 500 million years of evolution with a language model
Hayes, T., Rao, R., Akin, H., Sofroniew, N. J., Oktay, D., Lin, Z., Verkuil, R., Tran, V. Q., Deaton, J., Wiggert, M., et al. (2025) · Science · doi:10.1126/science.ads0018 · Cited by 937
Bandi, A., Adapa, P. V. S. R., & Kuchi, Y. E. V. P. K. (2023) · Future Internet · doi:10.3390/fi15080260 · Cited by 638
MoMask: Generative Masked Modeling of 3D Human Motions
Guo, C., Mu, Y., Javed, M. G., Wang, S., & Cheng, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00186 · Cited by 280
A Cookbook of Self-Supervised Learning
Balestriero, R., Ibrahim, M., Sobal, V., Morcos, A., Shekhar, S., Goldstein, T., Bordes, F., Bardes, A., Mialon, G., Tian, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.12210 · Cited by 182
“However, masked image models can also achieve strong generative modeling [Chang et al., 2022], including text-conditional generation [Chang et al., 2023].”
BackgroundFastComposer: Tuning-Free Multi-subject Image Generation with Localized Attention
Xiao, G., Yin, T., Freeman, W. T., Durand, F., & Han, S. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02227-z · Cited by 297
Self-citationDreamBooth3D: Subject-Driven Text-to-3D Generation
Raj, A., Kaza, S., Poole, B., Niemeyer, M., Ruiz, N., Mildenhall, B., Zada, S., Aberman, K., Rubinstein, M., Barron, J. T., et al. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00223 · Cited by 167
Collaborative Diffusion for Multi-Modal Face Generation and Editing
Huang, Z., Chan, K. C. K., Jiang, Y., & Liu, Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00589 · Cited by 162
VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder
Gu, Y., Wang, X., Xie, L., Dong, C., Li, G., Shan, Y., & Cheng, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19797-0_8 · Cited by 144
Multimodal Image Synthesis and Editing: The Generative AI Era
Zhan, F., Yu, Y., Wu, R., Zhang, J., Lu, S., Liu, L., Kortylewski, A., Theobalt, C., & Xing, E. P. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3305243 · Cited by 197
Jiang, Y., Yang, S., Qiu, H., Wu, W., Loy, C. C., & Liu, Z. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530104 · Cited by 176
Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
Chen, S., Wang, C., Wu, Y., Zhang, Z., Zhou, L., Liu, S., Chen, Z., Liu, T., Wang, H., Li, J., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3530270 · Cited by 162
MAGVIT: Masked Generative Video Transformer
Yu, L., Cheng, Y., Sohn, K., Lezama, J., Zhang, H., Chang, H., Hauptmann, A. G., Yang, M., Yuan, H., Essa, I. A., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01008 · Cited by 190
Self-citationThree Things Everyone Should Know About Vision Transformers
Touvron, H., Cord, M., El-Nouby, A., Verbeek, J. J., & Jeǵou, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20053-3_29 · Cited by 150
MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesis
Li, T., Chang, H., Mishra, S. K., Zhang, H., Katabi, D., & Krishnan, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00213 · Cited by 156
Self-citationMuse: Text-To-Image Generation via Masked Generative Transformers
Chang, H., Zhang, H., Barber, J., Maschinot, A., Lezama, J., Jiang, L., Yang, M.-H., Murphy, K., Freeman, W. T., Rubinstein, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2301.00704 · Cited by 157
“…et al., 2022; Chang et al., 2022); new families of generative models such as diffusion (Ho et al., 2020; Rombach et al., 2022; Saharia et al., 2022) and masking-based generation (Chang et al., 2022); and finally, the availability of large scale image-text paired datasets (Schuhmann et al., 2021).”
BackgroundMethodInfluentialSelf-citationSelf-Supervised Masked Convolutional Transformer Block for Anomaly Detection
Madan, N., Ristea, N.-C., Ionescu, R. T., Nasrollahi, K., Khan, F. S., Moeslund, T. B., & Shah, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3322604 · Cited by 131
Sequential Modeling Enables Scalable Learning for Large Vision Models
Bai, Y., Geng, X., Mangalam, K., Bar, A., Yuille, A., Darrell, T., Malik, J., & Efros, A. A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02157 · Cited by 192
Masked Diffusion Transformer is a Strong Image Synthesizer
Gao, S., Zhou, P., Cheng, M.-M., & Yan, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02117 · Cited by 91
LayoutDM: Discrete Diffusion Model for Controllable Layout Generation
Inoue, N., Kikuchi, K., Simo‐Serra, E., Otani, M., & Yamaguchi, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00980 · Cited by 147
SiT: Exploring Flow and Diffusion-Based Generative Models with Scalable Interpolant Transformers
Ma, N., Goldstein, M., Albergo, M. S., Boffi, N. M., Vanden-Eijnden, E., & Xie, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72980-5_2 · Cited by 364
Localizing Object-level Shape Variations with Text-to-Image Diffusion Models
Patashnik, O., Garibi, D., Azuri, I., Averbuch‐Elor, H., & Cohen‐Or, D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02107 · Cited by 122
Target Detection in Hyperspectral Remote Sensing Image: Current Status and Challenges
Chen, B., Liu, L., Zou, Z., & Shi, Z. (2023) · Remote Sensing · doi:10.3390/rs15133223 · Cited by 109
Visual Prompt Tuning for Generative Transfer Learning
Sohn, K., Chang, H., Lezama, J., Polanía, L. F., Zhang, H., Hao, Y., Essa, I. A., & Jiang, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01900 · Cited by 103
Self-citationPhenaki: Variable Length Video Generation From Open Domain Textual Description
Villegas, R., Babaeizadeh, M., Kindermans, P.-J., Moraldo, H., Zhang, H., Saffar, M. T., Castro, S., Kunze, J., & Erhan, D. (2022) · arXiv · doi:10.48550/arxiv.2210.02399 · Cited by 92
“As discussed in MaskGIT [8], the masking schedule γ i and sampling schedule β i have a signifi-cant effect on the samples quality therefore we follow the same strategies.”
MethodInfluentialSelf-citationGeneralizable Patch-Based Neural Rendering
Suhail, M., Esteves, C., Sigal, L., & Makadia, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19824-3_10 · Cited by 89
Photorealistic Video Generation with Diffusion Models
Gupta, A., Yu, L., Sohn, K., Gu, X., Hahn, M., Fei-Fei, L., Essa, I. A., Jiang, L., & Lezama, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72986-7_23 · Cited by 253
Self-citationFrido: Feature Pyramid Diffusion for Complex Scene Image Synthesis
Fan, W.-C., Chen, Y., Chen, D., Yu, C., Yuan, L., & Wang, Y.-C. F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25133 · Cited by 80
MMM: Generative Masked Motion Model
Pinyoanuntapong, E., Wang, P., Lee, M., & Chen, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00153 · Cited by 114
StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesis
Kang, M., Shin, J., & Park, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3306436 · Cited by 85
DiffCollage: Parallel Generation of Large Content with Diffusion Models
Zhang, Q., Song, J., Huang, X., Chen, Y., & Liu, M.-Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00982 · Cited by 85
Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models
Dong, W., Xue, S., Duan, X., & Han, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00683 · Cited by 81
Learning Imbalanced Data with Vision Transformers
Xu, Z., Liu, R., Yang, S., Chai, Z., & Yuan, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01516 · Cited by 66
T-former: An Efficient Transformer for Image Inpainting
Deng, Y., Hui, S., Zhou, S., Meng, D., & Wang, J. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548446 · Cited by 64
Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation
Wu, C., Chen, X., Wu, Z., Ma, Y., Liu, X., Pan, Z., Wen, L., Xie, Z., Yu, X., Ruan, C., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01210 · Cited by 334
DiffiT: Diffusion Vision Transformers for Image Generation
Hatamizadeh, A., Song, J., Liu, G., Kautz, J., & Vahdat, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73242-3_3 · Cited by 102
Zero-shot spatial layout conditioning for text-to-image diffusion models
Couairon, G., Careil, M., Cord, M., Lathuilière, S., & Verbeek, J. J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00207 · Cited by 68
HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Models
Bakr, E. M., Sun, P., Shen, X., Khan, F. F., Li, L. E., & Elhoseiny, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01834 · Cited by 74
NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
Yin, S., Wu, C., Yang, H., Wang, J., Wang, X., Ni, M., Yang, Z., Li, L., Liu, S., Yang, F., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.73 · Cited by 166
Learning Compact Representations for LiDAR Completion and Generation
Xiong, Y., Ma, W.-C., Wang, J., & Urtasun, R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00110 · Cited by 63
CityDreamer: Compositional Generative Model of Unbounded 3D Cities
Xie, H., Chen, Z., Hong, F., & Liu, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00923 · Cited by 56
Li, Q., Mashhadi, M. B., Gao, Z., Tafazolli, R., Bennis, M., & Niyato, D. T. (2025) · IEEE Wireless Communications · doi:10.1109/mwc.001.2500084 · Cited by 52
Bond-Taylor, S., Hessey, P., Sasaki, H., Breckon, T. P., & Willcocks, C. G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20050-2_11 · Cited by 59
Explainable time series anomaly detection using masked latent generative modeling
Lee, D.-S., Malacarne, S., & Aune, E. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110826 · Cited by 61
Zheng, C., & Vedaldi, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02084 · Cited by 61
Text2Performer: Text-Driven Human Video Generation
Jiang, Y., Yang, S., Koh, T. L., Wu, W., Loy, C. C., & Liu, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02079 · Cited by 54
Coarse-to-Fine Amodal Segmentation with Shape Prior
Gao, J., Qian, X., Wang, Y., Xiao, T., He, T., Zhang, Z., & Fu, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00122 · Cited by 44
CLIP-Sculptor: Zero-Shot Generation of High-Fidelity and Diverse Shapes from Natural Language
Sanghi, A., Fu, R., Liu, V., Willis, K. D. D., Shayani, H., Khasahmadi, A. H., Sridhar, S., & Ritchie, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01759 · Cited by 49
Masked Image Modeling: A Survey
Hondru, V., Croitoru, F.-A., Minaee, S., Ionescu, R. T., & Sebe, N. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02524-1 · Cited by 63
RealFill: Reference-Driven Generation for Authentic Image Completion
Tang, L., Ruiz, N., Chu, Q., Li, Y., Holynski, A., Jacobs, D. E., Hariharan, B., Pritch, Y., Wadhwa, N., Aberman, K., et al. (2024) · ACM Transactions on Graphics · doi:10.1145/3658237 · Cited by 57
Latent diffusion model for conditional reservoir facies generation
Lee, D.-S., Ovanger, O., Eidsvik, J., Aune, E., Skauvold, J., & Hauge, R. (2024) · Computers & Geosciences · doi:10.1016/j.cageo.2024.105750 · Cited by 48
GenerateCT: Text-Conditional Generation of 3D Chest CT Volumes
Hamamcı, İ. E., Er, S., Sekuboyina, A., Simsar, E., Tezcan, A., Simsek, A. G., Esirgün, S. N., Almas, F., Doğan, I., Dasdelen, M. F., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72986-7_8 · Cited by 36
Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Review
Shi, Y., Jiang, K., Li, J., Qian, Z., Wen, J., Yang, M., Wang, K., & Yang, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3495045 · Cited by 50
MaskCRT: Masked Conditional Residual Transformer for Learned Video Compression
Chen, Y.-H., Xie, H.-S., Chen, C., Gao, Z.-L., Benjak, M., Peng, W.-H., & Östermann, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3427426 · Cited by 34
Diffusion Models Without Attention
Yan, J. N., Gu, J., & Rush, A. M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00787 · Cited by 62
A Review of Recent Advances on Deep Learning Methods for Audio-Visual Speech Recognition
Ivanko, D., Ryumin, D., & Karpov, A. A. (2023) · Mathematics · doi:10.3390/math11122665 · Cited by 37
BAMM: Bidirectional Autoregressive Motion Model
Pinyoanuntapong, E., Saleem, M. U., Wang, P., Lee, M., Das, S., & Chen, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72633-0_10 · Cited by 57
Catch Missing Details: Image Reconstruction with Frequency Augmented Variational Autoencoder
Lin, X., Li, Y., Hsiao, J.-H., Ho, C., & Kong, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00173 · Cited by 33
ME- ViT: A Single-Load Memory-Efficient FPGA Accelerator for Vision Transformers
Marino, K., Zhang, P., & Prasanna, V. K. (2023) · IEEE International Conference on High Performance Computing, Data, and Analytics · doi:10.1109/hipc58850.2023.00039 · Cited by 37
MaskSketch: Unpaired Structure-guided Masked Image Generation
Bashkirova, D., Lezama, J., Sohn, K., Saenko, K., & Essa, I. A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00187 · Cited by 35
Huang, M., Mao, Z., Chen, Z., & Zhang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02164 · Cited by 38
Vlogger: Make Your Dream A Vlog
Zhuang, S., Li, K., Chen, X., Wang, Y., Liu, Z., Qiao, Y., & Wang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00841 · Cited by 62
Improved Masked Image Generation with Token-Critic
Lezama, J., Chang, H., Jiang, L., & Essa, I. A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20050-2_5 · Cited by 34
Self-citationNÜWA-LIP: Language-guided Image Inpainting with Defect-free VQGAN
Ni, M., Li, X., & Zuo, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01363 · Cited by 28
Towards Variable and Coordinated Holistic Co-Speech Motion Generation
Liu, Y., Cao, Q., Wen, Y., Jiang, H., & Ding, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00155 · Cited by 39
Meng, Z., Xie, Y., Peng, X., Han, Z., & Jiang, H. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02594 · Cited by 70
Masked Lip-Sync Prediction by Audio-Visual Contextual Exploitation in Transformers
Sun, Y., Zhou, H., Wang, K., Wu, Q., Hong, Z., Liu, J., Ding, E., Wang, J., Liu, Z., & Koike, H. (2022) · SIGGRAPH Asia Conference Papers · doi:10.1145/3550469.3555393 · Cited by 26
FontTransformer: Few-shot high-resolution Chinese glyph image synthesis via stacked transformers
Liu, Y., & Lian, Z. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109593 · Cited by 30
Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image Generation
Huang, M., Mao, Z., Wang, Q., & Zhang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00199 · Cited by 26
Prospective Role of Foundation Models in Advancing Autonomous Vehicles
Wu, J., Gao, B., Gao, J., Yu, J., Chu, H., Yu, Q., Gong, X., Chang, Y. M., Tseng, H. E., Chen, H., et al. (2024) · Research · doi:10.34133/research.0399 · Cited by 27
MoVideo: Motion-Aware Video Generation with Diffusion Model
Liang, J., Fan, Y., Zhang, K., Timofte, R., Gool, L. V., & Ranjan, R. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72784-9_4 · Cited by 28
Finger Recovery Transformer: Toward Better Incomplete Fingerprint Identification
Jia, Z., Huang, C., Wang, Z., Fei, H., Wu, S. J., & Feng, J. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3419690 · Cited by 23
Edge Enhanced Image Style Transfer via Transformers
Zhang, C., Dai, Z., Cao, P., & Yang, J. (2023) · International Conference on Multimedia Retrieval · doi:10.1145/3591106.3592257 · Cited by 22
Extreme Image Compression Using Fine-tuned VQGANs
Mao, Q., Yang, T., Zhang, Y., Wang, Z., Wang, M., Wang, S., Jin, L., & Ma, S. (2024) · DCC · doi:10.1109/dcc58796.2024.00028 · Cited by 30
Wang, Z., Wang, J., Liu, Z., & Qiu, Q. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02162 · Cited by 22
Architectural Synergies in Bi-Modal and Bi-Contrastive Learning
Gu, Y., Liu, B., Zhang, T., Sha, X., & Chen, S. (2024) · IEEE Access · doi:10.1109/access.2024.3457586 · Cited by 19
Ma, Y., Ye, W., Cui, C., Zhang, H., Xing, S., Ke, F., Wang, J., Miao, C., Chen, J., Rezatofighi, H., et al. (2025) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw65960.2025.00114 · Cited by 23
Self-citationGINA-3D: Learning to Generate Implicit Neural Assets in the Wild
Shen, B., Yan, X., Qi, C. R., Najibi, M., Deng, B., Guibas, L. J., Zhou, Y., & Anguelov, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00476 · Cited by 23
Don't Look into the Dark: Latent Codes for Pluralistic Image Inpainting
Chen, H., & Zhao, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00725 · Cited by 22
Zheng, Q. S., Teng, P., Zhang, K., Ding, G., Lai, X., Li, Z., & Yuan, Z. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112915 · Cited by 20
Li, X., Sun, Y., Lin, J., Li, L., Feng, T., & Yin, S. (2025) · Artificial Intelligence Science and Engineering · doi:10.23919/aise.2005.000007 · Cited by 20
Joint Holistic and Masked Face Recognition
Zhu, Y., Ren, M., Jing, H., Dai, L., Sun, Z., & Li, P. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3280717 · Cited by 21
UniFaRN: Unified Transformer for Facial Reaction Generation
Liang, C., Wang, J., Zhang, H., Tang, B., Huang, J., Wang, S., & Chen, X. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612854 · Cited by 18
Self-citationMasked Generative Video-to-Audio Transformers with Enhanced Synchronicity
Pascual, S., Yeh, C., Tsiamas, I., & Serrà, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73021-4_15 · Cited by 28
Brain-Conditional Multimodal Synthesis: A Survey and Taxonomy
Mai, W., Zhang, J., Fang, P., & Zhang, Z. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3516698 · Cited by 26
Generating 3D brain tumor regions in MRI using vector-quantization Generative Adversarial Networks
Zhou, M., Wagner, M. W., Tabori, U. Y., Hawkins, C. E., Ertl-Wagner, B. B., & Khalvati, F. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109502 · Cited by 27
M2T: Masking Transformers Twice for Faster Decoding
Mentzer, F., Agustson, E., & Tschannen, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00492 · Cited by 20
SD-DiT: Unleashing the Power of Self-Supervised Discrimination in Diffusion Transformer *
Zhu, R., Pan, Y., Li, Y., Yao, T., Sun, Z., Mei, T., & Chen, C. W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00806 · Cited by 27
TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Clouds
Dupont, E., Cherenkova, K., Mallis, D., Gusev, G., Kacem, A., & Aouada, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73030-6_2 · Cited by 29
Recent Advances in Discrete Speech Tokens: A Review
Guo, Y., Li, Z., Wang, H., Li, B., Shao, C., Zhang, H., Du, C., Xie, C., Liu, S., & Yu, K. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3643619 · Cited by 58
Self-citationMOSO: Decomposing MOtion, Scene and Object for Video Prediction
Sun, M., Wang, N., Zhu, X., & Liu, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01796 · Cited by 19
Efficient-VQGAN: Towards High-Resolution Image Generation with Efficient Vision Transformers
Cao, S., Yin, Y., Huang, L., Liu, Y., Zhao, X., Zhao, D., & Huang, K. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00677 · Cited by 22
Deep Generative Modeling Reshapes Compression and Transmission: From Efficiency to Resiliency
Dai, J., Qin, X., Wang, S., Xu, L., Niu, K., & Zhang, P. (2024) · IEEE Wireless Communications · doi:10.1109/mwc.005.2300574 · Cited by 16
Solving Motion Planning Tasks with a Scalable Generative Model
Hu, Y., Chai, S., Yang, Z., Qian, J., Li, K., Shao, W., Zhang, H., Xu, W., & Liu, Q. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72946-1_22 · Cited by 26
Self-citationLaMD: Latent Motion Diffusion for Image-Conditional Video Generation
Hu, Y., Chen, Z., & Luo, C. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02386-7 · Cited by 43
MapPrior: Bird’s-Eye View Map Layout Estimation with Generative Models
Zhu, X., Zyrianov, V., Liu, Z., & Wang, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00756 · Cited by 17
Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generation
Lu, Z., Hu, K., Wang, C., Bai, L., & Wang, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i13.29332 · Cited by 22
MaskPLAN: Masked Generative Layout Planning from Partial Input
Zhang, H., Savov, A., & Dillenburger, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00856 · Cited by 15
Self-citation
Metadata
- Authors
- Chang, H., Zhang, H., Jiang, L., Liu, C., & Freeman, W. T.
- Affiliations
- Google (United States) (US)
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 11305-11315
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4313021454
- Semantic Scholar
- 7c597874535c1537d7ddff3b3723015b4dc79d30
- Cited by
- 446
- References
- 52
- Citations by year
- 2026: 112 · 2025: 132 · 2024: 121 · 2023: 72 · 2022: 9
- FWCI
- 30.28
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- image generation, non-autoregressive decoding, image inpainting, image extrapolation, image editing, token masking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
