The DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
MaskGIT: Masked Generative Image Transformer
Open accessAbstract
Generative transformers have experienced rapid popularity growth in the computer vision community in synthesizing high-fidelity and high-resolution images. The best generative transformer models so far, however, still treat an image naively as a sequence of tokens, and decode an image sequentially following the raster scan ordering (i.e. line-by-line). We find this strategy neither optimal nor efficient. This paper proposes a novel image synthesis paradigm using a bidirectional transformer decoder, which we term MaskGIT. During training, MaskGIT learns to predict randomly masked tokens by attending to tokens in all directions. At inference time, the model begins with generating all tokens of an image simultaneously, and then refines the image iteratively conditioned on the previous generation. Our experiments demonstrate that MaskGIT significantly outperforms the state-of-the-art transformer model on the ImageNet dataset, and accelerates autoregressive decoding by up to 48x. Besides, we illustrate that MaskGIT can be easily extended to various image editing tasks, such as inpainting, extrapolation, and image manipulation. Project page: masked-generative-image-transformer.github.io.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus, discrete tokenizers are deployed in various visual understanding (Sun et al., 2024; Team, 2024; Wang et al., 2024; Wu et al., 2024) as well as image (Chang et al., 2022; Esser et al., 2021; Ramesh et al., 2021; Sun et al., 2024; Yu et al., 2022) and video generation tasks (Ge et al., 2022; Hong et al., 2023; Kondratyuk et al., 2024; Luo et al., 2024; Villegas et al., 2023; Wu et al., 2022;”
From Cosmos World Foundation Model Platform for Physical AI (2025) · cites this paper as Chang et al., 2022
In the citing paper
“Recent advances in deep learning have facilitated significant progress for various data modalities [29,161,205], such as images [38,239], audio [110,170], and text [14,20,75,159,162].”
From Diffusion Models: A Comprehensive Survey of Methods and Applications (2024) · cites this paper as [29]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,119
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Flagged first, then by citations
1 of the 52 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- seonghyeon, 2020, Implementation of generating diverse high-fidelity images with vq-vae-2 in py-torch
- suman, 2019, Ravuri and Oriol Vinyals. Classification accuracy score for conditional generative models, NeurIPS, 12247
- diederik, 2014, Kingma and Max Welling. Auto-encoding variational bayes, ICLRE
- ba, 2016, Layer normalization
- ho, 2021, Cas-caded diffusion models for high fidelity image gener-ation
- zhang, 2019, Goodfellow, Dimitris N. Metaxas, and Augustus Odena. Self-attention generative adver-sarial networks, ICML
- 2021, Tfhub model of boundless
- cheng, 2021, In&out Diverse image outpainting via gan inversion
- chen, 2020, Gener-ative pretraining from pixels, International Confer-ence on Machine Learning, 1691
- vaswani, 2017, Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need, NeurIPS
Cited by
Sorted by citations
Items 401–452 of 452
Diffusion Image Generation with Explicit Modeling of Data Manifold Geometry
Xue, D., Zhu, Z., & Hou, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37038-9_26
Large Neighborhood Search Meets Iterative Neural Constraint Heuristics
Xu, Y., Li, W., Sanner, S., & Khalil, E. B. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-27242-3_37
Teng, Y., Jiang, Z., Shi, H., Liu, X., Ning, X., DaiMember, G., Wang, Y., Li, Z., & Liu, X. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3700227 · Cited by 3
CameraVQ : Vector‐Quantized Representations for Monocular Camera Calibration
Cheong, D., & Han, J. (2026) · Computer Animation and Virtual Worlds · doi:10.1002/cav.70144
VAR-3D: View-aware Auto-Regressive Model for Text-to-3D Generation via a 3D Tokenizer
Han, Z., Hong, Y., Sun, H., & Cao, D. (2026) · International Conference on Multimedia Retrieval · doi:10.1145/3805622.3810588 · Cited by 2
Elucidating the Design Space of Generative Models for Single-Cell Perturbation PredictionPreprint
Bhattacharya, S., Gensbigler, C., Karim, S., & Lees, J. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.15.732063
Video Object Segmentation-Aware Audio Generation
Viertola, I., Iashin, V., & Rahtu, E. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02911-2
Masked irregular layout planning from partial input with fused modalities
Zhang, H., Savov, A., & Dillenburger, B. (2026) · Automation in Construction · doi:10.1016/j.autcon.2026.107120
Self-citationHu, F., Guo, Y., & Tian, H. (2026) · Applied Sciences · doi:10.3390/app16136760
ArchiCell: Spatial Semantics-Aware Autoregressive Modeling for Building FormsPreprint
Qi, H., Zhang, J., han, J., Cheng, J., Yuan, Z., Li, J., & Li, L. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7068525
Text Generation Image Model Based on Large Language Model and Masked Diffusion Transformer
Liu, M., Zhang, Y., Zhou, J., & Zhang, J. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582658
FusionCraft: A New Paradigm for Fine-Grained Multimodal Fashion Design Generation
Chen, J., Gui, H., Hu, X., Zhang, C., Liang, J., Yang, K., Ju, S., Liu, Y., & Li, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-22267-1_27
MADM: Bridging Mamba and autoregressive diffusion for text-to-motion generation
Ge, Y., Li, C., Zhu, L., Gao, J., & Lin, X. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114459
HL-OutPaint: Coarse-to-Fine Video Outpainting for High-Resolution Long-Range Videos
Park, J., Han, J., Kim, G., Lee, H.-S., Choi, K., Han, Y., & Cho, S. (2026) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3799902.3811098
Test-Time Registers as Global Priors for Tokenized Image Generation
Hong, C.-Y., Wang, Y., Lin, Y., & You, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37517-9_30
ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Video
Lyu, X., Li, G., Qian, Z., Zhang, X., Pollefeys, M., & Tang, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37281-9_26
PhyTrace: Tracing Physical Inconsistency in AI-Generated Images via ISP Emulation
Zhao, S., Liu, W., Xu, D., Zhou, J. T., & Wang, Z. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3709453
Adaptive Diffusion Vision-Language Models for Reliable Medical Image Understanding
Qamar, S., & Alshmrani, G. M. (2026) · Technologies · doi:10.3390/technologies14080464
Local Autoregression with Finite-Support Random Variables for Image Generation
Zhao, C., & Basu, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31654-7_12
Network-Efficient World Model Token Streaming
Mishra, S., Moradipari, A., & Ammar, N. (2026) · IEEE Vehicular Networking Conference (VNC) · doi:10.1109/vnc69225.2026.11629104
Diffusion Language Models for Mobile Edge Agentic AI: Foundations, Applications, and ChallengesPreprint
Li, C., Min, M., Niyato, D., & Ni, W. (2026) · Research Square · doi:10.21203/rs.3.rs-10410801/v1
Birk, S., Merchant, A., Vahidi, A., Theis, F. J., & Lotfollahi, M. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.08.07.743490
LLMSFL: LLM-Driven Smart Feedback Loop System for Target Document Generation
Guo, Z., & Zhang, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36042-7_11
LineAR: Autoregressive Image Generation Needs Only a Few Lines of Cached Tokens
Qin, Z., Lv, Y., Lin, M., Zhang, Z., Gan, C., Chen, T., Shen, L., Hou, J., Lim, C. H., Wen, F., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37035-8_33
Multi-scale Representation Alignment for Visual Autoregressive Modeling with Mixture of Experts
Zhou, N., Tu, Z., Yu, L., Cheng, K., Hu, J., Wang, N., & Chen, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37020-4_5
UNet-Twice: A Simple Structured Reference-Based Inpainting Framework
Lu, J., Xu, Z., Wu, H., Cui, W., Huang, B., Chen, M., & Li, B. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37261-1_22
K-Mask: Kinematic-Aware Masked Modeling for Controllable Text-to-Motion Synthesis
Ahmed, F., Zhao, C., & Basu, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37435-6_13
GR-GRPO: Graph-Diffused Credit for Autoregressive Image RL Alignment
Zhang, Z., Jiang, P.-T., Zheng, T., Zhang, J., Chen, J., & Li, B. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37383-0_11
LISA: Locality-Informed Speculative Decoding for Accelerating Autoregressive Image Generation
Li, Y., Jian, S., Wang, Z., Chen, Z., Lv, C., & Wang, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37255-0_20
What is Attention Mechanism? A Comprehensive Survey of Attention Methods and Transformer Models
Shiri, F. M., Memar, F., & Parhizgar, M. (2026) · Machine Learning · doi:10.1007/s10994-026-07131-w
Jin, Z., Huang, J., Zeng, M., Zheng, Z., & Fei, Z. (2026) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc70295.2026.11680116
Decoupling High and Low Frequencies for Faithful Image Generation with Fine Details
Medi, T., Wang, H., Rampini, A., & Keuper, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37032-7_7 · Cited by 6
GarmentX: Autoregressive parametric representations for 3D garment generation
Guo, J., Chen, J., Chen, W., Sun, Z., Li, L., Zhao, B., Zhu, L., Wang, X., & Liu, Q. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114937 · Cited by 6
Zhou, H., Ma, H., Fang, H., Xu, J., & Sun, Z. (2026) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3773078.3831778
MDGR: Masked Diffusion Generative Recommendation
Mu, L., Deng, H., Xing, H., Hu, J., Zhang, Y., Zeng, X., & Zhang, J. (2026) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3773078.3831862 · Cited by 16
Chen, N., Peng, D., Lin, Y., & Jiang, L. (2026) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2026.3737539
Self-citationDuoFlow: JVP-Free Finite-Difference Mean Flows for One-Step Image Generation
Li, Z., Zhang, X., Tan, P., & Shum, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37225-3_12
Efficient Masked Decoding for Sign Motion Generation with Hand-Aware Token Refinement
Cassini, F., Musumeci, E., & Suriani, V. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-40774-0_13
Unified Multi-plane Autoregressive Diffusion for 3D Multi-contrast MRI Synthesis
Shin, Y., Son, G., Wang, J., Jung, M., Lu, Y., & Hwang, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37450-9_16
EVAR: Edge Visual Autoregressive Models via Principled Pruning
Wang, Z., Li, Y., Li, Y., Su, M., Xu, S., 贯中, 田., & Wang, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37086-0_31
Expert Weaving: Marrying Masked Auto-Regressive and Diffusion Models for Unified Image Restoration
Lu, X., Huang, J., Xiao, J., Li, D., & Fu, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37086-0_10
AlignVAR: Towards Globally Consistent Visual Autoregression for Image Super-Resolution
Liu, C., Zhang, D., Yin, W., Wang, J., Li, T., Guo, J., Jiang, W., Wang, G., & Lu, G. (2026) · doi:10.1109/cvprf71909.2026.00486
Self-citationOne Layer is Enough: Adapting Pretrained Visual Encoders for Image Generation
Gao, Y., Chen, C., & Gu, J. (2026) · doi:10.1109/cvprf71909.2026.00451
Decoupled Scale-Wise Autoregressive Modeling for Visual Generation
Ren, S., Yu, Y., Ruiz, N., Wang, F., & Xie, C. (2026) · doi:10.1109/cvprf71909.2026.00434
Improving Autoregressive Image Generation Through Coarse-to-Fine Token Prediction
Guo, Z., Zhang, K., & Shieh, M. (2026) · doi:10.1109/cvprf71909.2026.00123
Is Your Text-to-Image Model Robust to Caption Noise?
Yu, W., Yang, Z., Lin, S., Zhao, Q., Wang, J., Gui, L., Fredrikson, M., & Jiang, L. (2026) · doi:10.1109/cvprf71909.2026.00367
Self-citationRethinking Training Dynamics in Scale-Wise Autoregressive Generation
Zhou, G., Ge, C., Tan, H., Liu, F., & Hong, Y. (2026) · doi:10.1109/cvprf71909.2026.00442
DSA: Dynamic Step Allocation for Fast Autoregressive Video Generation
Le, T.-T., Zhao, Y., Chai, M., Shen, Z., Cao, Z., Tang, D., 谢小辉, & Kong, D. (2026) · doi:10.1109/cvprf71909.2026.00418
Safe Codebook: Token-Level Moderation for Safer Visual Autoregressive Generation
Zhang, J., Xu, Q., Wen, P., Dai, S., Liu, Y., & Huang, Q. (2026) · doi:10.1109/cvprf71909.2026.00761
Fast Autoregressive Video Generation with Diagonal Decoding
Ye, Y., Guo, J., Wu, H., He, T., Pearce, T., Rashid, T., Hofmann, K., & Bian, J. (2026) · doi:10.1109/cvprf71909.2026.00426
TFGNet: Target Face Generation From Low-Quality Images via Textual Guidance
Wen, X., Zha, Z., Wang, S., Zuo, E., Wen, B., Yuan, X., Zhou, J., & Zhu, C. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3742673
Generative Forecasting of Longitudinal 3D-OCT Under Anti-VEGF Therapy for Diabetic Macular Edema
Feng, Y., Liang, C., & Wang, S. (2026) · Diagnostics · doi:10.3390/diagnostics16203382
Metadata
- Authors
- Chang, H., Zhang, H., Jiang, L., Liu, C., & Freeman, W. T.
- Affiliations
- Google (United States) (US)
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 11305-11315
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4313021454
- Semantic Scholar
- 7c597874535c1537d7ddff3b3723015b4dc79d30
- Cited by
- 446
- References
- 52
- Citations by year
- 2026: 112 · 2025: 132 · 2024: 121 · 2023: 72 · 2022: 9
- FWCI
- 30.28
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- image generation, non-autoregressive decoding, image inpainting, image extrapolation, image editing, token masking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
