The DOI matches its DataCite record; 69 of the 69 references it cites were found in a registry or an index.
Hierarchical Text-Conditional Image Generation with CLIP Latents
Open accessAbstract
Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a CLIP image embedding given a text caption, and a decoder that generates an image conditioned on the image embedding. We show that explicitly generating image representations improves image diversity with minimal loss in photorealism and caption similarity. Our decoders conditioned on image representations can also produce variations of an image that preserve both its semantics and style, while varying the non-essential details absent from the image representation. Moreover, the joint embedding space of CLIP enables language-guided image manipulations in a zero-shot fashion. We use diffusion models for the decoder and experiment with both autoregressive and diffusion models for the prior, finding that the latter are computationally more efficient and produce higher-quality samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While more sophisticated methods for partially editing individual frames during training exist (e.g., text-to-image models [13], [14]), they are slow, computationally expensive and error-prone.”
From Language-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredIn the citing paper
“Generative machines, such as text-to-image algorithms, are contributing to the variety of cultural traits.”
From Machine culture (2023) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“To this end, we generated 512 “artistic” captions using GPT-3 [4] by prompting it with captions for existing artwork (both real and AI generated).”
MethodSelf-citationHigh-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302 · cited 2×
“[42] use diffusion models on the latents obtained from a VQGAN [14] like autoencoder.”
BackgroundMethodLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 3×
“Recent progress in computer vision has been driven by scaling models on large datasets of captioned images collected from the internet [10, 44, 60, 39, 31, 16].”
BackgroundMethodSelf-citationLIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 12,864 · cited 4×
“After applying PCA, we order the principal components by decreasing eigenvalue magnitude, quantize each of the 319 dimensions into 1,024 discrete buckets, and predict the resulting sequence using a decoder-only Transformer [53] model with a causal attention mask.”
MethodInfluentialDecoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Research works printed but not linked: 2
- [23][23] Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Advances in Neural Information Processing Systems 30 (NIPS 2017), 2017.
- [32][32] Ryan Murdock. The Big Sleep. https://twitter.com/advadnoun/status/ 1351038053033406468, 2021. 20 https://openreview.net/forum?id=qw674L9PfQE https://openreview.net/forum?id=qw674L9PfQE https://arxiv.org/abs/2203.13131 https://arxiv.org/abs/2108.00946 https://arxiv.org/abs/2102.01645 https://arxiv.org/abs/1406.2661 https://arxiv.org/abs/2111.14822 https://openreview.net/forum?id=qw8AKxfYbI https://openreview.net/forum?id=qw8AKxfYbI https://arxiv.org/abs/2006.11239 https://arxiv.org/abs/2106.15282 https://arxiv.org/abs/1412.6980 https://arxiv.org/abs/1405.0312 https://arxiv.org/abs/1711.05101 https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://arxiv.org/abs/2112.12750 https://twitter.com/advadnoun/status/1351038053033406468 https://twitter.com/advadnoun/status/1351038053033406468 · arXiv
Cited by
Sorted by citations
Items 701–800 of 1,051
Learning Procedure-aware Video Representation from Instructional Videos and Their Narrations
Zhong, Y., Yu, L., Bai, Y., Li, S.-W. D., Yan, X., & Li, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01424 · Cited by 37
“Diffusion models [51, 53] provide a powerful approach to characterize the probability density of high dimensional signals, and have recently demonstrated impressive results on generating high fidelity visual data, such as images [40,44,45,47], videos [21], and human body motion [57].”
BackgroundCgT-GAN: CLIP-guided Text GAN for Image Captioning
Yu, J., Li, H., Hao, Y., Zhu, B., Xu, T., & He, X. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611891 · Cited by 28
“CLIP has been shown to benefit numerous multi-modal tasks, such as VQA [52], text-to-image synthesis [49], and referring image segmentation [63].”
BackgroundAI-generated visuals of car-free US cities help improve support for sustainable policies
Dubey, R., Hardy, M. D., Griffiths, T. L., & Bhui, R. (2024) · Nature Sustainability · doi:10.1038/s41893-024-01299-6 · Cited by 26
Audio Generation with Multiple Conditional Diffusion Model
Guo, Z., Mao, J., Tao, R. M., Yan, L., Ouchi, K., Liu, H., & Wang, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29773 · Cited by 36
AltDiffusion: A Multilingual Text-to-Image Diffusion Model
Ye, F., Liu, G., Wu, X., & Wu, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28487 · Cited by 38
Artifact feature purification for cross-domain detection of AI-generated images
Meng, Z., Peng, B., Dong, J., Tan, T., & Cheng, H. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104078 · Cited by 31
Cambricon-D: Full-Network Differential Acceleration for Diffusion Models
Kong, W., Hao, Y., Guo, Q., Zhao, Y., Song, X., Li, X., Zou, M., Du, Z., Zhang, R., Liu, C., et al. (2024) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca59077.2024.00070 · Cited by 38
“Diffusion models, such as Stable-Diffusion [18], OpenAI Sora [2], DALL-E 2 [17], have made significant progress in * Corresponding Author current image generation tasks (e.g., generation, inpainting, and super-resolution [18]) .”
MethodA survey on knowledge-enhanced multimodal learning
Lymperaiou, M., & Stamou, G. B. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10825-z · Cited by 45
“DALL-E (Ramesh et al., 2021) uses a 12 billion parameter version of GPT-3 to generate fine-grained and highly diverse images based on corresponding textual descriptions.”
BackgroundInfluentialInteractDiffusion: Interaction Control in Text-to-Image Diffusion Models
Hoe, J. T., Jiang, X., Chan, C. S., Tan, Y., & Hu, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00591 · Cited by 37
“…published version of the proceedings is available on IEEE Xplore. since extensively studied how to control the image generation of the diffusion models via e.g . class [10, 37], text [24, 26, 27, 29], image (including edge, line, scribble and skeleton) [2, 16, 36] and layout [2, 7, 19, 34, 38].”
BackgroundMethodAccelerating Diffusion Sampling with Optimized Time Steps
Xue, S., Liu, Z., Chen, F., Zhang, S., Hu, T., Xie, E., & Li, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00792 · Cited by 51
“These tasks include, but are not limited to, image synthesis [11, 16, 40], video generation [3, 17], text-to-image conversion [36, 39, 41], and speech synthesis [24, 45].”
Towards Language-Driven Video Inpainting via Multimodal Large Language Models
Wu, J., Li, X., Si, C., Zhou, S., Yang, J., Zhang, J., Li, Y., Chen, K., Tong, Y., Liu, Z., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01188 · Cited by 40
“Diffusion-based text-to-image generation models (DMs) [35, 40, 42, 43, 45] show excellent abilities in generating images and videos following text guidance.”
BackgroundExploring Embodied Multimodal Large Models: Development, datasets, and future directions
Chen, S., Wu, Z., Zhang, K., Li, C., Zhang, B., Ma, F., Yu, F. R., & Li, Q. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103198 · Cited by 39
Kim, G., Shim, H., Kim, H., Choi, Y., Kim, J., & Yang, E. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00590 · Cited by 37
“Image editing with diffusion models There are various attempts to manipulate images with diffusion models [3, 13, 16, 18, 22, 24] such as text-guided inpainting [3,18,24], stroke-based editing [16], and style-transfer [13].”
BackgroundMethodThe Power of Sound (TPoS): Audio Reactive Video Generation with Stable Diffusion
Jeong, Y., Ryoo, W., Lee, S. H., Seo, D., Byeon, W., Kim, S., & Kim, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00719 · Cited by 32
“[28], we apply a spherical linear interpolation between all consecutive pairs of c n and c n +1 , yielding k interpolated latent vectors.”
MethodScene Text Image Super-resolution based on Text-conditional Diffusion Models
Noguchi, C., Fukuda, S., & Yamanaka, M. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00151 · Cited by 32
“Diffusion models (DMs) [15,45,46] have demonstrated remarkable generative performance in various tasks, especially in text-to-image synthesis [34,37,40].”
BackgroundControl4D: Efficient 4D Portrait Editing With Text
Shao, R., Sun, J., Cheng, P., Zheng, Z., Zhou, B., Zhang, H., & Liu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00436 · Cited by 65
“Enhanced with pre-trained models [53], they solve multi-modal tasks like text-to-image generation [19, 44, 54].”
BackgroundZhang, M., & Crosthwaite, P. (2026) · International Review of Applied Linguistics in Language Teaching · doi:10.1515/iral-2024-0196 · Cited by 26
Generalizing max pooling via ( a , b ) -grouping functions for Convolutional Neural Networks
Rodríguez-Martínez, I., Asmus, T. D. C., Dimuro, G. P., Herrera, F., Takáč, Z., & Bustince, H. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101893 · Cited by 25
Human, Do You Think This Painting is the Work of a Real Artist?
Park, J., Kang, H., & Kim, H. Y. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2232978 · Cited by 32
“…tools can be used to draw, write poems, and compose songs, the boundaries of creative realms that only humans can work on are getting increasingly blurred (Dhariwal et al., 2020; Goel et al., 2022; Ramesh et al., 2022; Rombach et al., 2022; Sun et al., 2023; Uthus et al., 2022; Van de Cruys, 2020).”
Accelerating Markov Chain Monte Carlo sampling with diffusion models
Hunt-Smith, N. T., Melnitchouk, W., Ringer, F., Sato, N., Thomas, A. W., & White, M. J. (2023) · Computer Physics Communications · doi:10.1016/j.cpc.2023.109059 · Cited by 38
BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesis
Castillo, A., Escobar, M., Jeanneret, G., Pumarola, A., Arbeláez, P., Thabet, A., & Sanakoyeu, A. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00456 · Cited by 42
“Currently, DDPMs are showing impressive results in tasks like image generation and manipulation [5, 42, 39, 8, 30] due to their ability to fit the training distribution at large scale and stable training objective.”
BackgroundMethodInfluentialTA2V: Text-Audio Guided Video Generation
Zhao, M., Wang, W., Chen, T., Zhang, R., & Li, R. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3362149 · Cited by 28
“OpenAI proposed DALL-E2 [6] for the text-to-image generation (T2I) task with the combination of CLIP [7] Fig.”
MethodZhang, H., Chen, P., Xie, X., Jiang, Z., Zhou, Z., & Sun, L. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3689433 · Cited by 33
“Especially, large-scale generation models such as Midjourney [16], Stable Diffusion [63] and DALL-E [60, 61] have been renowned for synthesising high-quality images from textual descriptions.”
Ranni: Taming Text-to-Image Diffusion for Accurate Instruction Following
Feng, Y., Gong, B., Chen, D., Shen, Y., Liu, Y., & Zhou, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00454 · Cited by 54
“With recent advancements in diffusion models, T2I synthesis demonstrates promising results in terms of high fidelity and diversity [7, 12, 24, 31, 32, 37, 38].”
VP3D: Unleashing 2D Visual Prompt for Text-to-3D Generation
Chen, Y., Pant, Y., Yang, H., Yao, T., & Meit, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00468 · Cited by 36
“Significant advancements have been witnessed in text-to-image generation with 2D diffusion models in recent years [3, 12, 13, 25, 30–32 However, extending these capabilities to 3D content generation poses a substantial challenge, primarily due to the absence of large-scale paired text-3D datasets.”
BackgroundText-to-Image Diffusion Models are Great Sketch-Photo Matchmakers
Koley, S., Bhunia, A. K., Sain, A., Chowdhury, P. N., Xiang, T., & Song, Y.-Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01592 · Cited by 31
“This unconditional process could be made “conditional” by influencing the F θ with auxiliary guiding signals p ( e.g ., class labels [32], textual prompts [38, 59, 66, 68, 73], dense semantic maps [57, 105], etc.).”
BackgroundDiffusion Handles Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D
Pandey, K., Guerrero, P., Gadelha, M., Hold-Geoffroy, Y., Singh, K., & Mitra, N. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00735 · Cited by 35
“Such approaches relied on autoregressive [8, 12, 56] and diffusion models [15, 36, 45].”
SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation
Nguyen, T. H., & Tran, A. N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00746 · Cited by 53
“Especially, text-to-image diffusion models, which combine the power of language models and high-quality diffusion models [32, 36, 43], have revolutionized the way that people create visual content based on textual descriptions.”
BackgroundIMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation
Song, Y., Zhang, Z., Lin, Z., Cohen, S. D., Price, B. L., Zhang, J., Kim, S. Y., Zhang, H., Xiong, W., & Aliaga, D. G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00769 · Cited by 43
“Image compositing, the art of merging a reference object with a background to create a cohesive and realistic image, has witnessed transformative advancements with the advent of diffusion models (DM) [13, 32, 33, 36].”
Song, Y., Kim, J., Xing, W., Liu, Z., Li, C., & Oh, H. (2025) · Journal of Research on Technology in Education · doi:10.1080/15391523.2025.2455057 · Cited by 51
Layout-Bridging Text-to-Image Synthesis
Liang, J., Pei, W., & Lu, F. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3274228 · Cited by 28
“The latest works of Imagen [42], DALL-E2 [43] and GLIDE [44] also demonstrate the potential of diffusion models for text-to-image synthesis.”
Method3D Highlighter: Localizing Regions on 3D Shapes via Text Descriptions
Decatur, D., Lang, I., & Hanocka, R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02005 · Cited by 29
“Achieving compositionality with language models is a challenging task [33].”
Sharma, N. V., & Jindal, N. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17890-6 · Cited by 34
“Using natu-ral language descriptions, the current groundbreaking deep learning system, DALLE 2, can produce unique, realistic visuals and artwork [63].”
Will Large-scale Generative Models Corrupt Future Datasets?
Hataya, R., Bao, H., & Arai, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01879 · Cited by 39
“Particularly, DALL · E 2 [47], Midjourney [42], and StableDiffu-sion [51] have web and smartphone applications, and many Figure 1: Schematic view of the problem.”
BackgroundInfluentialBrush Your Text: Synthesize Any Scene Text on Images via Diffusion Model
Zhang, L., Chen, X., Wang, Y., Lu, Y., & Qiao, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28550 · Cited by 36
Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Models
Haas, R., Huberman-Spiegelglas, I., Mulayoff, R., Graßhof, S., Brandt, S. S., & Michaeli, T. (2024) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg59268.2024.10581912 · Cited by 45
“Specifically, recent large-scale text-conditional systems like DALL-E [27], [26], Stable Diffusion [28] and Imagen [34] have sparked a surge of research related to text-driven image editing using DDMs [19], [18], [4], [32], [11], [12], [8], [42], [2].”
BackgroundSG-Bot: Object Rearrangement via Coarse-to-Fine Robotic Imagination on Scene Graphs
Zhai, G., Cai, X., Huang, D., Di, Y., Manhardt, F., Tombari, F., Navab, N., & Busam, B. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610792 · Cited by 33
“Alternatively, goals can be explicit in various formats, such as images [14] on prompts, bounding boxes [61] or poses [62] on descriptions, and direct language instructions [15], [63], [64], leveraging recent off-the-shelf large language models [65], [6], [66].”
BackgroundAI in infectious diseases: The role of datasets
de la Fuente‐Núñez, C. (2024) · Drug Resistance Updates · doi:10.1016/j.drup.2024.101067 · Cited by 24
Generating Images of Rare Concepts Using Pre-trained Diffusion Models
Samuel, D., Ben‐Ari, R., Raviv, S., Darshan, N., & Chechik, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28270 · Cited by 51
“Text-guided generation: Diffusion models provide unprecedented quality for text-to-image generation (Ramesh et al. 2022; Saharia et al. 2022; Balaji et al. 2022) but still struggle with rare fine-grained objects and compositions (Chefer et al.”
BackgroundUnfolding Explainable AI for Brain Tumor Segmentation
Hassan, M. A., Fateh, A. A., Lin, J., Zhuang, Y., Lin, G., Xiong, H., You, Z., Qin, P., & Zeng, H. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128058 · Cited by 28
Learning Multi-Dimensional Human Preference for Text-to-Image Generation
Zhang, S., Wang, B., Wu, J., Li, Y., Gao, T., Zhang, D., & Wang, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00766 · Cited by 27
“In contrast, DALL·E 2 [13] and Imagen [15] are predicated on pixel-based diffusion models.”
BackgroundFreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Composition
Ding, G., Zhao, C., Wang, W., Yang, Z., Liu, Z., Chen, H., & Shen, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00868 · Cited by 37
“The remarkable success of large-scale pre-trained text-to-image (T2I) diffusion models [3, 5, 9, 26, 27, 30, 31] inspires the domain of customized image generation [1, 4, 7, 11, 16, 35] sonalization method, a pioneer work DreamBooth [32] fine-tunes the T2I diffusion model to bind a unique…”
BackgroundGenerative AI for urban planning: Synthesizing satellite imagery via diffusion models
Wang, Q., Liang, Y., Zheng, Y., Xu, K., Zhao, J., & Wang, S. (2025) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2025.102339 · Cited by 40
T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation
Wang, J., Liu, X., Di, Z., Liu, Y., & Wang, X. E. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.160 · Cited by 50
A Pathway Towards Responsible AI Generated Content
Lyu, L. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/803 · Cited by 107
Cai, S., Chan, E. R., Peng, S., Shahbazi, M., Obukhov, A., Gool, L. V., & Wetzstein, G. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00204 · Cited by 43
“Their well-defined steady training protocols enhance the diffusion models’ performance for large-scale training [69, 61].”
BackgroundChupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models
Kim, B.-J., Kwon, P., Lee, K. H., Lee, M., Han, S., Kim, D., & Joo, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01463 · Cited by 30
“Recent diffusion models for text-to-image generation [49, 59, 61, 65] have demonstrated the ability to produce high-quality images based on textual input.”
BackgroundControl3Diff: Learning Controllable 3D Diffusion Models from Single-view Images
Gu, J., Gao, Q., Zhai, S., Chen, B., Liu, L., & Susskind, J. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00030 · Cited by 39
“Importantly, classifier-free guidance [30], which enables generation with a balance between sampling controlled quality and diversity, has become a basic building block for large-scale diffusion models [70, 77].”
BackgroundTECA: Text-Guided Generation and Editing of Compositional 3D Avatars
Zhang, H., Yao, F., Kulits, P., Wen, Y., Thies, J., & Black, M. J. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00151 · Cited by 32
“Following the success of recent 2D text-to-image models [45, 49, 52], the generation of 3D content from text is gaining attention [28, 34, 41, 47].”
BackgroundNOPE: Novel Object Pose Estimation from a Single Image
Nguyen, V. N., Groueix, T., Ponimatkin, G., Hu, Y., Marlet, R., Salzmann, M., & Lepetit, V. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01697 · Cited by 36
“For images, the breakthrough in diffusion models [6,45] have unlocked several workflows [39,41,42].”
BackgroundGradPaint: Gradient-guided inpainting with diffusion models
Grechka, A., Couairon, G., & Cord, M. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.103928 · Cited by 29
Diffusion models in text generation: a survey
Yi, Q., Chen, X., Zhang, C., Zhou, Z., Zhu, L., & Kong, X. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.1905 · Cited by 33
Siamese Meets Diffusion Network: SMDNet for Enhanced Change Detection in High-Resolution RS Imagery
Jia, J., Lee, G.-H., Wang, Z., Lyu, Z., & He, Y. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3384545 · Cited by 27
“…feature differential encoder (SU-FDE) and the denoising diffusion implicit model (DDIM) to innovatively fuse discriminative learning and generation processes into the change detection (CD) task to improve edge detection accuracy in CD and robustness under different environmental conditions.”
MethodSarukkai, V., Li, L., Ma, A., Ré, C., & Fatahalian, K. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00416 · Cited by 43
“Diffusion-based image generation [9, 12, 23, 24, 27, 28] has captured widespread interest with its seemingly magical ability to generate plausible images from a text prompt.”
BackgroundArtists and AI: Creative Interactions and Tensions
Bird, C. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651041 · Cited by 26
“Enabled by the steady release of accessible generative models such as DALLE 2 [22] and Stable Diffusion [23], users are now able to immediately generate high-quality images.”
Normality learning reinforcement for anomaly detection in surveillance videos
Cheng, K., Zeng, X., Liu, Y., Pan, Y., & Li, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111942 · Cited by 23
Attention Calibration for Disentangled Text-to-Image Personalization
Zhang, Y., Yang, M., Zhou, Q., & Wang, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00456 · Cited by 28
“Recently developed large-scale text-to-image models [1, 37, 39, 41] have shown unprecedented capabilities in synthesizing high-quality and diverse images based on a target text prompt.”
Ryu, H., Kim, J., An, H., Chang, J., Seo, J., Kim, T.-H., Kim, Y., Hwang, C., Choi, J., & Horowitz, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01705 · Cited by 43
“Diffusion models are rapidly replacing previous generative models in various fields including computer vision [21, 30, 54, 59, 60, 70, 72], bioinformatics [17, 23, 81, 84], and robotics [1, 4, 6, 7, 10, 11, 24, 35, 50, 52, 56, 69, 75].”
CALRec: Contrastive Alignment of Generative LLMs for Sequential Recommendation
Li, Y., Zhai, X., Alzantot, M., Yu, K., Vulić, I., Korhonen, A., & Hammad, M. M. (2024) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3640457.3688121 · Cited by 39
Conditional score-based diffusion models for solving inverse elasticity problems
Dasgupta, A., Ramaswamy, H., Murgoitio-Esandi, J., Foo, K. Y., Li, R., Zhou, Q., Kennedy, B. F., & Oberai, A. A. (2024) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2024.117425 · Cited by 33
RNDiff: Rainfall nowcasting with Condition Diffusion Model
Ling, X., Li, C., Qin, F., Yang, P., & Huang, Y. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.111193 · Cited by 35
“Some recent large-scale diffusion models, such as DALL·E 2[10], Imagen[11] and Stable Diffusion[12], demonstrate amazing generative capabilities.”
Visual knowledge in the big model era: retrospect and prospect
Wang, W., Yang, Y., & Pan, Y. (2025) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2400250 · Cited by 36
“Various deep generative models have been established for this task, such as GANs (Reed et al, 2016), VAEs (Ramesh et al, 2021), and Autoregressive Models (Ramesh et al, 2022).”
Diffusion model-based image generative method for quality monitoring of direct grain harvesting
Zhang, S., Liu, L., Li, G., Wu, X., Wu, X., Song, Z., & Li, X. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110130 · Cited by 25
CLIPVG: Text-Guided Image Manipulation Using Differentiable Vector Graphics
Song, Y., Shao, X., Chen, K., Zhang, W., Jing, Z., & Li, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25326 · Cited by 31
A Collaborative, Interactive and Context-Aware Drawing Agent for Co-Creative Design
Ibarrola, F., Lawton, T., & Grace, K. S. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3293853 · Cited by 31
“…mindset is in accordance with the actual computer capabilities of up to a few years ago, recent advances (particularly generative models in the fields of imaging and language processing [1], [2]) offer a potential reframing, permitting enough for us to start looking at computers as co-creators [3].”
ResultTell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation
Fu, T.-J., Yu, L., Zhang, N., Fu, C.-Y., Su, J.-C., Wang, W. Y., & Bell, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01029 · Cited by 27
“With large-scale datasets [4,65,66,83], recent pre-trained models can generate high-quality natural images from open-domain description through discrete visual tokens [12, 17, 54, 59, 76, 95] or the diffusion process [51, 58, 62, 63].”
BackgroundUPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfer
Cheong, S. Y., Mustafa, A., & Gilbert, A. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00451 · Cited by 27
“Most methods[27, 34, 24] use the classified-free approaches[17] to find the direction between the conditional and unconditional in the latent space, which is to be applied in sampling time to guide the model towards the conditioning direction.”
MethodInfluentialZhang, X., Yang, B., Kampffmeyer, M., Zhang, W., Zhang, S., Lu, G., Lin, L., Xu, H., & Liang, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02116 · Cited by 24
“Qualitative Result We provide a qualitative comparison of DiffCloth’s garment generation ability compared to state-of-the-art approaches [4, 5, 26, 29].”
BackgroundResultZheng, H., Wang, M., Wang, Z., & Huang, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111547 · Cited by 24
Li, C., Yao, Z., Wu, X., Zhang, M., Holmes, C., Li, C., & He, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29810 · Cited by 36
NoiseCollage: A Layout-Aware Text-to-Image Diffusion Model Based on Noise Cropping and Merging
Shirakawa, T., & Uchida, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00852 · Cited by 31
“Text-to-image diffusion models [4, 11, 25, 27, 28, 30] can generate high-quality and diverse images with a text condition.”
Oh, H.-S., Lee, S.-H., & Lee, S. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3395994 · Cited by 25
“The experimental results showed that the diffusion models performed better than the AR models, as reported in [58].”
ResultLatent Denoising Diffusion GAN: Faster Sampling, Higher Image Quality
Trinh, L. T., & Hamagami, T. (2024) · IEEE Access · doi:10.1109/access.2024.3406535 · Cited by 26
“This versatility expands the potential applications of diffusion models into areas like text-to-image generation ( [2, 5, 30]), video generation ( [8,10]), image-to-image translation ( [6,7,9]), text-to-3D generation [11], and beyond.”
BackgroundMultiscale-attention masked autoencoder for missing data imputation of wind turbines
Fan, Y., Feng, C., Wu, R., Liu, C., & Jiang, D. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112114 · Cited by 26
Unnatural Images: On AI-Generated Photographs
Wasielewski, A. (2024) · Critical Inquiry · doi:10.1086/731729 · Cited by 33
M&M VTO: Multi-Garment Virtual Try-On and Editing
Zhu, L., Li, Y., Liu, N., Peng, H., Yang, D., & Kemelmacher-Shlizerman, I. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00134 · Cited by 33
“In contrast, our approach is tailored for VTO and requires only 6 MB of parameters per person during the inference phase.”
MethodJeDi: Joint-Image Diffusion Models for Finetuning-Free Personalized Text-to-Image Generation
Zeng, Y., Patel, V. M., Wang, H., Huang, X., Wang, T.-C., Liu, M.-Y., & Balaji, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00648 · Cited by 30
“The state-of-the-art in text-to-image generation has advanced significantly in the last two years, propelled by the emergence of large-scale diffusion models and paired image-text datasets [2, 3, 6, 22, 25, 26, 28].”
Retrieval-Augmented Open-Vocabulary Object Detection
Kim, J., Cho, E., Kim, S., & Kim, H. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01650 · Cited by 29
“Recently, thanks to the success of CLIP, there have been many studies for introducing VLMs to various downstream tasks such as image segmentation [15,22,37], image generation [20,29], and object detection [8,16,23,28,30].”
BackgroundBalancing Act: Distribution-Guided Debiasing in Diffusion Models
Parihar, R., Bhat, A., Basu, A., Mallick, S., Kundu, J. N., & Babu, R. V. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00637 · Cited by 36
“This is an extremely practical setting for debiasing and is particularly important for large text-to-image DMs [35, 37, 41] where retraining or fine-tuning is computationally intensive.”
Inversion-Free Image Editing with Language-Guided Diffusion Models
Xu, S., Huang, Y., Pan, J., Ma, Z., & Chai, J. Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00903 · Cited by 100
“These models are increasingly adopted for image manipulation tasks, where DMs are augmented with additional conditions like text prompts [29] or images [37, 39] to generate the target image.”
HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion
Zhang, J., Li, X., Zhang, Q., Cao, Y., Shan, Y., & Liao, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00181 · Cited by 29
“Benefited from the scalability of the diffusion models and large-scale aligned image-text datasets, text-to-image has made great progress such as Glide [37], DALL-E 2 [46], Imagen [48] and StableDiffusion [47].”
BackgroundSemCity: Semantic Scene Generation with Triplane Diffusion
Lee, J., Lee, S., Jo, C., Im, W., Seon, J., & Yoon, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02677 · Cited by 33
“Its generated results have shown remarkably realistic appearances with high fidelity and diversity in a variety of 2D image synthesis such as outpainting [35, 57], inpainting [27, 35] and text-to-image generation [32, 36].”
BackgroundA Review of Deepfake and Its Detection: From Generative Adversarial Networks to Diffusion Models
Liu, B., Liu, B., Zhu, T., & Ding, M. (2025) · International Journal of Intelligent Systems · doi:10.1155/int/9987535 · Cited by 34
“DALL-E [108] leverages CLIP image representations for controllable text-to-image generation.”
Summerfield, C. (2022) · doi:10.1093/oso/9780192843883.001.0001 · Cited by 24
Gradient-based Constrained Sampling from Language Models
Kumar, S., Paria, B., & Tsvetkov, Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.144 · Cited by 57
“Also related are diffusion models which have obtained state-of-the-art performance for many generative tasks (Ramesh et al., 2022; Ho et al., 2022).”
BackgroundRobust Unsupervised StyleGAN Image Restoration
Poirier‐Ginter, Y., & Lalonde, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02135 · Cited by 28
“, billions of images for [45,47,49]), have recently been shown to outclass GANs when it comes to image generation quality [17].”
BackgroundHu, V. T., Zhang, D. W., Asano, Y. M., Burghouts, G. J., & Snoek, C. G. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01766 · Cited by 28
“Diffusion models have recently enabled tremendous advancements in many computer vision fields related to image synthesis, but counterintuitively this often comes with the cost of requiring large annotated datasets [49,55].”
Toward Secure and Robust Steganography for Black-Box Generated Images
Zeng, K., Chen, K., Zhang, J., Zhang, W., & Yu, N. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3361220 · Cited by 24
“Notably, the output quality of the most advanced TTI models such as DALL-E 2 [33], Imagen [34], and Stable Diffusion [2] is approaching that of real photos and human-drawn art.”
BackgroundDriftRec: Adapting Diffusion Models to Blind JPEG Restoration
Welker, S., Chapman, H. N., & Gerkmann, T. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3383776 · Cited by 26
“Diffusion models have taken the world of machine learning by storm due to their unprecedented ability to generate highfidelity images [1]–[3] and audio [4]–[6], their relatively easy training, and their great flexibility to effectively condition on a variety of user inputs [2], [3], [7].”
BackgroundFew-shot satellite image classification for bringing deep learning on board OPS-SAT
Shendy, R., & Nalepa, J. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123984 · Cited by 22
Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior
Liu, F., Wu, D., Wei, Y., Rao, Y., & Duan, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01962 · Cited by 43
Language Models as Black-Box Optimizers for Vision-Language Models
Liu, S., Yu, S., Lin, Z., Pathak, D., & Ramanan, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01206 · Cited by 41
“Given that contemporary black-box VLMs [46, 48] like DALL-E [4, 54] still offer a language-based user interface and may be accessed through APIs that facilitate input and output in natural language , this allows users to customize these models through optimizing textual prompts.”
MethodHierarchical Patch Diffusion Models for High-Resolution Video Generation
Skorokhodov, I., Menapace, W., Siarohin, A., & Tulyakov, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00723 · Cited by 27
“Later stages of CDMs can also operate in a patch-wise fashion [43], even though they have not been explicitly trained for this.”
BackgroundTRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Models
Zhang, Z., Long, F., Pan, Y., Qiu, Z., Yao, T., Cao, Y., & Mei, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00828 · Cited by 32
“T2V diffusion models [2, 26] are usually constructed by re-moulding T2I diffusion models [44, 49].”
Wu, X., Hao, Y., Sun, K., Chen, Y., Zhu, F., Zhao, R., & Li, H. (2023) · arXiv · doi:10.48550/arxiv.2306.09341 · Cited by 22
“Recent advances in text-to-image synthesis [22, 21, 23, 17, 2] have made it possible to generate high-fidelity images based on text prompts.”
BackgroundMethodInfluentialWeakly-supervised deepfake localization in diffusion-generated images
Ţânţaru, D.-C., Oneaţă, E., & Oneaţă, D. (2024) · 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv57701.2024.00614 · Cited by 25
“Among the classes of generative models, diffusion models are emerging as the dominant paradigm [14], showcasing impressive results on a wide array of tasks including text-controlled image generation [45, 48, 51, 61] or image-to-image translation [38, 48, 50, 61].”
BackgroundClemmer, C., Ding, J., & Feng, Y. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00840 · Cited by 26
“Text-to-Image models, such as DALL-E [19] and diffusion models [23] have had exponential growth over the last few years [20].”
BackgroundMethodGraphusion: Latent Diffusion for Graph Generation
Yang, L. Q., Huang, Z., Zhang, Z., Liu, Z., Hong, S., Zhang, W., Yang, W., Cui, B., & Zhang, L. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3389783 · Cited by 25
“Motivations: Conditional diffusion-based generation [41], [42], [43], [59] is to introduce informative guidance in the reverse process, which has shown promising results in vision tasks.”
BackgroundContinual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation
Liu, J., Xu, R., Yang, S., Zhang, R., Zhang, Q., Chen, Z., Guo, Y., & Zhang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02707 · Cited by 34
“Specifically, BEiT [3] was the first to explore Masked Image Modeling (MIM) in vision transformers by reconstructing the vision dictionary derived from DALL-E [42, 43].”
BackgroundFresco: Spatial-Temporal Correspondence for Zero-Shot Video Translation
Yang, S., Zhou, Y., Liu, Z., & Loy, C. C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00831 · Cited by 34
“Recent advancements in diffusion models [33, 34, 36] have revolutionized image editing by enabling users to manipulate images conveniently through natural language prompts.”
Background
Metadata
- Authors
- Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M.
- ORCID
- Chen, Mark
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2204.06125
- OpenAlex
- W4224035735
- Cited by
- 2,511
- References
- 66
- Citations by year
- 2026: 46 · 2025: 429 · 2024: 1113 · 2023: 859 · 2022: 63
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- text-to-image generation, diffusion models, image priors, image variation, photorealism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
