The DOI matches its DataCite record; 69 of the 69 references it cites were found in a registry or an index.
Hierarchical Text-Conditional Image Generation with CLIP Latents
Open accessAbstract
Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a CLIP image embedding given a text caption, and a decoder that generates an image conditioned on the image embedding. We show that explicitly generating image representations improves image diversity with minimal loss in photorealism and caption similarity. Our decoders conditioned on image representations can also produce variations of an image that preserve both its semantics and style, while varying the non-essential details absent from the image representation. Moreover, the joint embedding space of CLIP enables language-guided image manipulations in a zero-shot fashion. We use diffusion models for the decoder and experiment with both autoregressive and diffusion models for the prior, finding that the latter are computationally more efficient and produce higher-quality samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While more sophisticated methods for partially editing individual frames during training exist (e.g., text-to-image models [13], [14]), they are slow, computationally expensive and error-prone.”
From Language-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredIn the citing paper
“Generative machines, such as text-to-image algorithms, are contributing to the variety of cultural traits.”
From Machine culture (2023) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“To this end, we generated 512 “artistic” captions using GPT-3 [4] by prompting it with captions for existing artwork (both real and AI generated).”
MethodSelf-citationHigh-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302 · cited 2×
“[42] use diffusion models on the latents obtained from a VQGAN [14] like autoencoder.”
BackgroundMethodLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 3×
“Recent progress in computer vision has been driven by scaling models on large datasets of captioned images collected from the internet [10, 44, 60, 39, 31, 16].”
BackgroundMethodSelf-citationLIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 12,864 · cited 4×
“After applying PCA, we order the principal components by decreasing eigenvalue magnitude, quantize each of the 319 dimensions into 1,024 discrete buckets, and predict the resulting sequence using a decoder-only Transformer [53] model with a causal attention mask.”
MethodInfluentialDecoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Research works printed but not linked: 2
- [23][23] Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Advances in Neural Information Processing Systems 30 (NIPS 2017), 2017.
- [32][32] Ryan Murdock. The Big Sleep. https://twitter.com/advadnoun/status/ 1351038053033406468, 2021. 20 https://openreview.net/forum?id=qw674L9PfQE https://openreview.net/forum?id=qw674L9PfQE https://arxiv.org/abs/2203.13131 https://arxiv.org/abs/2108.00946 https://arxiv.org/abs/2102.01645 https://arxiv.org/abs/1406.2661 https://arxiv.org/abs/2111.14822 https://openreview.net/forum?id=qw8AKxfYbI https://openreview.net/forum?id=qw8AKxfYbI https://arxiv.org/abs/2006.11239 https://arxiv.org/abs/2106.15282 https://arxiv.org/abs/1412.6980 https://arxiv.org/abs/1405.0312 https://arxiv.org/abs/1711.05101 https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://arxiv.org/abs/2112.12750 https://twitter.com/advadnoun/status/1351038053033406468 https://twitter.com/advadnoun/status/1351038053033406468 · arXiv
Cited by
Sorted by citations
Items 1,001–1,051 of 1,051
EXPLORING THE IMPACT OF GENERATIVE STIMULI ON THE CREATIVITY OF DESIGNERS IN COMBINATIONAL DESIGN
Wang, D., & Han, J. (2023) · Proceedings of the Design Society · doi:10.1017/pds.2023.181 · Cited by 14
“Whether parametric design, generative design (Agkathidis, 2016) or the latest generative models such as DALL E (Ramesh et al., 2022), Imagen (Saharia et al., 2022) or Midjourney (Oppenlaender, 2022) ultimately produce images or 3D models are based on given set of conditions.”
BackgroundText-Guided Eyeglasses Manipulation With Spatial Constraints
Wang, J., Liu, P., Liu, J., & Xu, W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3322326 · Cited by 17
“With the rapid advancements in diffusion models, large text-to-image models [50], [59], [60] have demonstrated remarkable generation capabilities, producing stunning and highquality images.”
BackgroundText encoders bottleneck compositionality in contrastive vision-language models
Kamath, A., Hessel, J., & Chang, K.-W. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.301 · Cited by 35
“Underlying several popular multimodal models like CLIP (Radford et al., 2021), DALL-E 2 (Ramesh et al., 2022) and ALIGN (Jia et al., 2021) is a pooled text encoder, i.e., a text representation model that outputs a single vector for a given input caption.”
Assessing deep learning: a work program for the humanities in the age of artificial intelligence
Segessenmann, J., Stadelmann, T., Davison, A., & Dürr, O. M. (2023) · AI and Ethics · doi:10.1007/s43681-023-00408-z · Cited by 18
“…attention by producing striking images from text prompts (e.g., ‘DALL-E 2’ and its open-access brother ‘Stable Diffusion’, as well as ’Midjourney’ [7–9]), while generalist models (e.g., ‘GATO’ [10]), and the unprecedented utility of multimodal ‘large language models’ (LLMs), create the impression…”
DiffusionEMIS: Diffusion Model for 3-D Electromagnetic Inverse Scattering
Bi, X., Chen, Y., & Li, L. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3349681 · Cited by 18
“Diffusion models have achieved great success in extensive generation tasks [36], [40], [41], [42], [43], [44], [45], [46], [47], [48] and start to be explored in perception tasks like image segmentation [49], [50], [51], object detection [38], image super-resolution [52], [53], and inverse problems…”
BackgroundChop & Learn: Recognizing and Generating Object-State Compositions
Saini, N., Wang, H., Swaminathan, A., Jayasundara, V., He, B., Gupta, K., & Shrivastava, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01852 · Cited by 15
“Large-scale deep generative models [47, 50, 52] trained on open-world big datasets have made significant break-throughs in image generation in the last couple of years.”
BackgroundLAW-Diffusion: Complex Scene Generation by Diffusion with Layouts
Yang, B., Luo, Y., Chen, Z., Wang, G., Liang, X., & Lin, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02072 · Cited by 17
Xu, Z., Sangineto, E., & Sebe, N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00699 · Cited by 17
“Recently, text-to-image models trained with large or very large scale datasets [29, 28, 32, 42] have attracted tremendous attention because of their excellent performance in generating high-quality images starting from a textual query.”
BackgroundCzerkawski, M., & Tachtatzis, C. (2024) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2024.3370212 · Cited by 17
“Text prompts are a key method for conditioning, giving rise to text-to-image models such as DALLE-2 [16], Imagen [17], or StableDiffusion [6].”
MethodLatent Space Editing in Transformer-Based Flow Matching
Hu, V. T., Zhang, W., Tang, M., Mettes, P., Zhao, D., & Snoek, C. G. M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i3.27998 · Cited by 22
DreamIdentity: Enhanced Editability for Efficient Face-Identity Preserved Image Generation
Chen, Z., Fang, S., Liu, W., He, Q., Huang, M., & Mao, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i2.27891 · Cited by 16
“More recently, diffusion models, such as GLIDE (Nichol et al. 2021), Imagen (Saharia et al. 2022), DALL-E 2 (Ramesh et al. 2022), LDM (Rombach et al. 2022) have demonstrated the ability on generating unprecedent-edly high-quality and diverse images.”
BackgroundMethodDecoupled Textual Embeddings for Customized Image Generation
Cai, Y., Wei, Y., Ji, Z., Bai, J., Han, H., & Zuo, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i2.27850 · Cited by 20
Depth-aware guidance with self-estimated depth representations of diffusion models
Kim, G., Jang, W., Lee, G., Hong, S., Seo, J., & Kim, S. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110474 · Cited by 33
A foundation model enhanced approach for generative design in combinational creativity
Chen, L., Zhang, Y. E., Han, J., Sun, L., Childs, P., & Wang, B. (2024) · Journal of Engineering Design · doi:10.1080/09544828.2024.2356707 · Cited by 20
3DiffTection: 3D Object Detection with Geometry-Aware Diffusion Features
Xu, C., Ling, H., Fidler, S., & Litany, O. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01010 · Cited by 23
“Novel View Synthesis with Diffusion Models Image synthesis has undergone a significant transformation with the advent of 2D diffusion models, as demonstrated by notable works [12, 18, 19, 28, 29, 33, 36, 38, 43, 44].”
Sieve: Multimodal Dataset Pruning Using Image Captioning Models
Mahmoud, A., Elhoushi, M., Abbas, A., Yu, Y., Ardalani, N., Leather, H., & Morcos, A. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02116 · Cited by 31
“The CLIP text encoder was pretrained along with the CLIP vision encoder to map text and images to the same embedding space, and is used in diffusion models to condition image genera-Filtering [38] pretrained on 10M image-text pairs, and BLIP [20] pretrained on 14M pairs tion [33].”
MethodZhang, L., Awal, R., & Agrawal, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01307 · Cited by 25
“This includes zero-shot image classification [15, 44, 47, 77], object detection [45], semantic segmentation [64, 68, 76, 78], text-image retrieval, evaluation of text-image alignment [8, 22], and text-to-image generation [50, 53, 55].”
BackgroundCPR: Retrieval Augmented Generation for Copyright Protection
Golatkar, A., Achille, A., Zancato, L., Wang, Y., Swaminathan, A. D., & Soatto, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01176 · Cited by 24
“However, rather than reusing existing models, current meth-ods require training of retrieval-specific architectures which — unlike the standard text-to-image diffusion models [46, 47, 49, 68] — can be prompted with several retrieved images along with conditional information, such as text, as inputs.”
MethodInfluentialCustomization Assistant for Text-to-image Generation
Zhou, Y., Zhang, R., Gu, J., & Sun, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00877 · Cited by 22
“The idea of using hierarchical design is also adopted by some follow-up works [1, 25] and proven to be effective in both diffusion models and auto-regressive models.”
Lei, B., Yu, K., Feng, M., Cui, M., & Xie, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00998 · Cited by 14
“In recent years, text-guided 2D image synthesis [10, 41–43 , 55] achieve significant progress and provide a foundation for 3D generation.”
BackgroundPostureHMR: Posture Transformation for 3D Human Mesh Recovery
Song, Y.-P., Wu, X. Y., Yuanl, Z., Qiao, J.-J., & Peng, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00929 · Cited by 14
“Diffusion models have gained popularity as generative models, which have proven effective in generating arbitrary high-quality images [34, 35].”
BackgroundDesigen: A Pipeline for Controllable Design Template Generation
Weng, H., Huang, D., Qiao, Y., Hu, Z., Lin, C.-Y., Zhang, T., & Chen, C. L. P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01209 · Cited by 19
“[50].”
Cheng, J., Pan, X., Fang, Y., Yang, K., Xue, Y., Yan, Q., & Yuan, Y. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae525 · Cited by 19
“To solve this, we adopt the approach utilized in DALL · E 2 [22], where we reduce the dimension of z m from d to L using principal component analysis (PCA).”
BackgroundMethodImproved image reconstruction from brain activity through automatic image captioning
Kalantari, F., Karim Faez, A., Amindavar, H. R., & Nazari, S. (2025) · Scientific Reports · doi:10.1038/s41598-025-89242-3 · Cited by 15
Security and Privacy Challenges of AIGC in Metaverse: A Comprehensive Survey
Zhang, S., Li, H., Sun, K., Chen, H., Wang, Y., & Li, S. (2025) · ACM Computing Surveys · doi:10.1145/3729419 · Cited by 17
“• Image Generation : The ield of image creation has progressed from conventional GANs [9, 47] to auto-regressive models [170] and now to the present difusion models [50, 148].”
Towards Creating Exotic Remote Sensing Datasets using Image Generating AI
Abduljawad, M., & Alsalmani, A. (2022) · International Conference on Electrical and Computing Technologies and Applications (ICECTA) · doi:10.1109/icecta57148.2022.9990245 · Cited by 17
“Dall-E 2 is a 3.5 billions parameters model, that uses Contrastive Language-Image Pre-training (CLIP) image embeddings, which trained on millions of pairs of images and their descriptions [24].”
MethodInfluentialProgrammable design of functional proteins from natural languagePreprint
Dai, F.-Y., You, S.-Y., Zhu, Y.-D., Gao, Y., Fu, L.-H., Zhou, X.-B., Su, J., Wang, C.-T., Fan, Y.-L., Tan, Q.-S., et al. (2026) · bioRxiv · doi:10.1101/2024.08.01.606258 · Cited by 30
Skillful Precipitation Nowcasting Using Physical‐Driven Diffusion Networks
Wang, R., Fung, J. C. H., & Lau, A. K. H. (2024) · Geophysical Research Letters · doi:10.1029/2024gl110832 · Cited by 23
A systematic review of privacy-preserving techniques for synthetic tabular health data
Hyrup, T., Lautrup, A. D., Zimek, A., & Schneider–Kamp, P. (2025) · Discover Data · doi:10.1007/s44248-025-00022-w · Cited by 20
Li, J., Chi, X., Wang, Q., Huang, K., Wang, D.-H., Liu, Y., & Liu, C. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111824 · Cited by 30
Generative AI aids personalized product aesthetic generation and evaluation based on style themes
Wang, Y., Zhang, J., Shen, C., Yu, H., & Luo, S. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103756 · Cited by 21
Foundation Models in Healthcare: Opportunities, Biases and Regulatory Prospects in Europe
Wójcik, M. A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-12673-4_3 · Cited by 14
Signatures of the uncanny valley effect in an artificial neural network
Igaue, T., & Hayashi, R. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107811 · Cited by 16
From Association to Generation: Text-only Captioning by Unsupervised Cross-modal Mapping
Wang, J., Yan, M., Zhang, Y., & Sang, J. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/481 · Cited by 23
Learning Interactive Real-World Simulators
Yang, S., Du, Y., Ghasemipour, K., Tompson, J., Kaelbling, L., Schuurmans, D., & Abbeel, P. (2023) · arXiv · doi:10.48550/arxiv.2310.06114 · Cited by 346
“Generative models trained on internet data can now produce highly realistic text [1],image [2], and video [3].”
BackgroundGenie: Generative Interactive Environments
Bruce, J., Dennis, M., Edwards, A., Parker-Holder, J., Shi, Y., Hughes, E., Lai, M., Mavalankar, A., Steigerwald, R., Apps, C., et al. (2024) · arXiv · doi:10.48550/arxiv.2402.15391 · Cited by 23
Yager, K. G. (2024) · Digital Discovery · doi:10.1039/d4dd00178h · Cited by 12
SafeSea: Synthetic Data Generation for Adverse & Low Probability Maritime Conditions
Tran, M., Shipard, J., Mulyono, H., Wiliem, A., & Fookes, C. (2023) · arXiv · doi:10.48550/arxiv.2311.14764 · Cited by 11
“Diffusion models [13] are capable of being trained with guiding input channels, enabling them to perform conditional image generation such as creating synthesizing visual content based on textual descriptions [24].”
BackgroundCosmos World Foundation Model Platform for Physical AI
NVIDIA, :, Agarwal, N., Ali, A., Bala, M., Balaji, Y., Barker, E., Cai, T., Chattopadhyay, P., Chen, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.03575 · Cited by 13
Semi-supervised multimodal representation learning through a global workspace
Devillers, B., Maytié, L., & VanRullen, R. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3416701 · Cited by 5
“(b) Illustration of the primary and secondary desirable properties for multimodal systems.”
Fu, Y., Bin, H., Zhou, T., Wang, M., Chen, Y., Lai, Z. G. D. C., Wobbrock, J. O., & Hiniker, A. (2024) · arXiv · doi:10.48550/arxiv.2411.00168 · Cited by 4
“Participants in GenAI-supported group were asked to use the ChatGPT web app [71], powered by the DALL-E2 text-to-image model [80] on their computer, to generate and modify designs (we provided participants with ChatGPT Plus accounts).”
MethodLanguage-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation
Hoftijzer, D., Burghouts, G., & Spreeuwers, L. (2023) · 2023 Seventh IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc59093.2023.00007 · Cited by 2
“By an elegant modification to the SOTA architecture [1], with only one additional layer, we generalize better to environments with different wall colors in ObjectNav.”
Generative AI in Game Development: A Qualitative Research Synthesis
Ternar, D.-A., Denisova, A., Cunha, J. M., Kultima, A., & Guckelsberger, C. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791206 · Cited by 6
Fu, J., Grierson, M., Jiang, R., Fu, S., He, M., & Xu, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1591289 · Cited by 1
Video Diffusion Models: A Survey
Melnik, A., Ljubljanac, M., Lu, C., Yan, Q., Ren, W., & Ritter, H. (2024) · arXiv · doi:10.48550/arxiv.2405.03150 · Cited by 4
Han, Y.-H., Huang, T.-M., Hua, K.-L., & Chen, J.-C. (2024) · arXiv · doi:10.48550/arxiv.2404.05583 · Cited by 45
SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrix
Dai, P., Tan, F., Xu, Q., Futschik, D., Du, R., Fanello, S., Qi, X., & Zhang, Y. (2024) · arXiv · doi:10.48550/arxiv.2407.00367
Manga Generation via Layout-controllable Diffusion
Chen, S., Li, D., Bao, Z., Zhou, Y., Tan, L., Zhong, Y., & Zhao, Z. (2024) · arXiv · doi:10.48550/arxiv.2412.19303
OmniGen2: Towards Instruction-Aligned Multimodal Generation
Wu, C., Zheng, P., Yan, R., Xiao, S., Luo, X., Wang, Y., Li, W., Jiang, X., Liu, Y., Zhou, J., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.18871
Improving Model Fusion by Training-time Neuron Alignment with Fixed Neuron Anchors
Li, Z., Li, Z., Lin, J., Shen, T., Xiao, J., Guo, Y., Lin, T., & Wu, C. (2024) · arXiv · doi:10.48550/arxiv.2402.01342
Generative AI in Game Development: A Qualitative Research Synthesis
Ternar, A., Denisova, A., Cunha, J. M., Kultima, A., & Guckelsberger, C. (2025) · arXiv
“OpenAI’s DALL·E (2021) [48, 60] combined a Transformer [72] with CLIP [59], while DALL·E 2 [49] replaced the Transformer with Diffusion [22], producing images that were more realistic and faithful to prompts.”
Metadata
- Authors
- Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M.
- ORCID
- Chen, Mark
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2204.06125
- OpenAlex
- W4224035735
- Cited by
- 2,511
- References
- 66
- Citations by year
- 2026: 46 · 2025: 429 · 2024: 1113 · 2023: 859 · 2022: 63
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- text-to-image generation, diffusion models, image priors, image variation, photorealism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
