The DOI matches its DataCite record; 69 of the 69 references it cites were found in a registry or an index.
Hierarchical Text-Conditional Image Generation with CLIP Latents
Open accessAbstract
Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a CLIP image embedding given a text caption, and a decoder that generates an image conditioned on the image embedding. We show that explicitly generating image representations improves image diversity with minimal loss in photorealism and caption similarity. Our decoders conditioned on image representations can also produce variations of an image that preserve both its semantics and style, while varying the non-essential details absent from the image representation. Moreover, the joint embedding space of CLIP enables language-guided image manipulations in a zero-shot fashion. We use diffusion models for the decoder and experiment with both autoregressive and diffusion models for the prior, finding that the latter are computationally more efficient and produce higher-quality samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While more sophisticated methods for partially editing individual frames during training exist (e.g., text-to-image models [13], [14]), they are slow, computationally expensive and error-prone.”
From Language-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredIn the citing paper
“Generative machines, such as text-to-image algorithms, are contributing to the variety of cultural traits.”
From Machine culture (2023) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“To this end, we generated 512 “artistic” captions using GPT-3 [4] by prompting it with captions for existing artwork (both real and AI generated).”
MethodSelf-citationHigh-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302 · cited 2×
“[42] use diffusion models on the latents obtained from a VQGAN [14] like autoencoder.”
BackgroundMethodLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 3×
“Recent progress in computer vision has been driven by scaling models on large datasets of captioned images collected from the internet [10, 44, 60, 39, 31, 16].”
BackgroundMethodSelf-citationLIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 12,864 · cited 4×
“After applying PCA, we order the principal components by decreasing eigenvalue magnitude, quantize each of the 319 dimensions into 1,024 discrete buckets, and predict the resulting sequence using a decoder-only Transformer [53] model with a causal attention mask.”
MethodInfluentialDecoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Research works printed but not linked: 2
- [23][23] Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Advances in Neural Information Processing Systems 30 (NIPS 2017), 2017.
- [32][32] Ryan Murdock. The Big Sleep. https://twitter.com/advadnoun/status/ 1351038053033406468, 2021. 20 https://openreview.net/forum?id=qw674L9PfQE https://openreview.net/forum?id=qw674L9PfQE https://arxiv.org/abs/2203.13131 https://arxiv.org/abs/2108.00946 https://arxiv.org/abs/2102.01645 https://arxiv.org/abs/1406.2661 https://arxiv.org/abs/2111.14822 https://openreview.net/forum?id=qw8AKxfYbI https://openreview.net/forum?id=qw8AKxfYbI https://arxiv.org/abs/2006.11239 https://arxiv.org/abs/2106.15282 https://arxiv.org/abs/1412.6980 https://arxiv.org/abs/1405.0312 https://arxiv.org/abs/1711.05101 https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://arxiv.org/abs/2112.12750 https://twitter.com/advadnoun/status/1351038053033406468 https://twitter.com/advadnoun/status/1351038053033406468 · arXiv
Cited by
Sorted by citations
Items 301–400 of 1,051
A Latent Space of Stochastic Diffusion Models for Zero-Shot Image Editing and Guidance
Wu, C., & de la Torre, F. N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00678 · Cited by 97
“Diffusion models for image generation Diffusion probabilistic models (DPMs) [30, 9] are a class of generative models that generate images by iterative denoising, which have been the basis of text-to-image synthesis such as DALL E-2 [24] and Stable Diffusion [25].”
BackgroundToward an Integrated Machine Learning Model of a Proteomics Experiment
Neely, B. A., Dorfer, V., Martens, L., Bludau, I., Bouwmeester, R., Degroeve, S., Deutsch, E. W., Gessulat, S., Käll, L., Palczynski, P., et al. (2023) · Journal of Proteome Research · doi:10.1021/acs.jproteome.2c00711 · Cited by 79
A roadmap for the development of human body digital twins
Tang, C., Yi, W., Occhipinti, E., Dai, Y., Gao, S., & Occhipinti, L. G. (2024) · Nature Reviews Electrical Engineering · doi:10.1038/s44287-024-00025-w · Cited by 100
“AI models such as DALL·E 2 (which can complete intricate drawings based solely on descriptive sentences) [14] and ChatGPT (which can answer various complex questions, including coding and finance strategies) [15] pre-train on immense amounts of unlabeled data and fine-tune on small, labeled datasets for diverse tasks.”
Grounded Text-to-Image Synthesis with Attention Refocusing
Phung, Q., Ge, S., & Huang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00758 · Cited by 135
“The development of the scalable model architectures, including GANs [28, 50], autoregressive models [9, 13, 45, 63], and diffusion models [4, 22, 38, 46, 49], together with various training and inference techniques [21– 23 ,”
MethodDiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
He, Z., Sun, T., Tang, Q., Wang, K., Huang, X., & Qiu, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.248 · Cited by 206
Online Detection of AI-Generated Images
Epstein, D. C., Jain, I., Wang, O., & Zhang, R. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00045 · Cited by 91
“These models reflect the rapid pace of advancement in realistic synthetic image generation, including academic papers [22, 49, 32, 38, 34] as well as company re-leases [37, 3, 1, 55, 7].”
BackgroundMethodInfluentialPRIOR: Prototype Representation Joint Learning from Medical Images and Reports
Cheng, P., Lin, L., Lyu, J., Huang, Y., Luo, W., & Tang, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01953 · Cited by 93
“And Ramesh et al . prove that prototype learning works well on cross-modality interaction tasks [40].”
BackgroundDiverse Data Augmentation with Diffusions for Effective Test-time Prompt Tuning
Feng, C.-M., Yu, K., Liu, Y., Khan, S. H., & Zuo, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00255 · Cited by 116
“…e.g ., using the latent space of powerful pretrained autoencoders for high-resolution image synthesis [41], enhancing text-conditional image synthesis [32, 39], learning diffusion-based prior for few-shot conditional image generation [47], and probabilistic model for point cloud generation [20].”
BackgroundResultInfluentialDiffusionRet: Generative Text-Video Retrieval with Diffusion Model
Jin, P., Li, H., Cheng, Z., Li, K., Ji, X., Liu, C., Li, Y., & Chen, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00234 · Cited by 100
“Instead of predicting the noise component k of xk, we follow [58] and predict the data distribution itself, i.”
BackgroundTextMesh: Generation of Realistic 3D Meshes From Text Prompts
Tsalicoglou, C., Manhardt, F., Tonioni, A., Niemeyer, M., & Tombari, F. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00154 · Cited by 134
“The huge boost in quality has been made possible by the availability of extremely large datasets of image-text pairs [30] and scalable generator architectures based on diffusion models [2, 26– 28] and transformers [6, 37].”
MethodSmartEdit: Exploring Complex Instruction-Based Image Editing with Multimodal Large Language Models
Huang, Y., Xie, L., Wang, X., Yuan, Z., Cun, X., Ge, Y., Zhou, J., Dong, C., Huang, R., Zhang, R., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00799 · Cited by 132
“As we mentioned in the main paper (Section 4.3), to effectively stimulate SmartEdit’s editing capabilities for more complex instructions, we synthesize approximately 476 paired data as a supplement to the training data.”
MethodInfluentialA multifaceted vision of the human-AI collaboration: a comprehensive review
Puerta-Beldarrain, M., Gómez-Carmona, O., Sánchez-Corcuera, R., Casado-Mansilla, D., López-de-Ipiña, D., & Chen, L. (2025) · IEEE Access · doi:10.1109/access.2025.3536095 · Cited by 73
Mastering Deepfake Detection: A Cutting-Edge Approach to Distinguish GAN and Diffusion-Model Images
Guarnera, L., Giudice, O., & Battiato, S. (2024) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3652027 · Cited by 74
Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models
Wu, Q., Liu, Y., Zhao, H., Kale, A., Bui, T., Yu, T., Lin, Z., Zhang, Y., & Chang, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00189 · Cited by 87
“One type of conditional generation models is the text-to-image diffusion models [51,56,61,65], which take text descriptions as inputs and generate images that match the text descriptions.”
BackgroundMusicLDM: Enhancing Novelty in text-to-music Generation Using Beat-Synchronous mixup Strategies
Chen, K., Wu, Y., Liu, H., Nezhurina, M., Berg-Kirkpatrick, T., & Dubnov, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447265 · Cited by 108
“Diffusion models have shown superior performance in these types of cross-modal generation tasks, including systems like DALLE-2 [4] and Stable Diffusion [5] for text-to-image; AudioLDM [6] and Make-an-Audio [7] for text-to-audio.”
BackgroundVimpari, V., Kultima, A., Hämäläinen, P., & Guckelsberger, C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3611025 · Cited by 77
Integrated Photonic Tensor Processing Unit for a Matrix Multiply: A Review
Peserico, N., Shastri, B. J., & Sorger, V. J. (2023) · Journal of Lightwave Technology · doi:10.1109/jlt.2023.3269957 · Cited by 74
Scaling Robot Learning with Semantically Imagined Experience
Yu, T., Xiao, T. G., Tompson, J., Stone, A., Wang, S., Brohan, A., Singh, J., Tan, C., Dee, M., Peralta, J., et al. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.027 · Cited by 226
Predictive microstructure image generation using denoising diffusion probabilistic models
Azqadan, E., Jahed, H., & Arami, A. (2023) · Acta Materialia · doi:10.1016/j.actamat.2023.119406 · Cited by 81
Freestyle Layout-to-Image Synthesis
Han, X., Huang, Z., Sun, Q., Song, L., & Zhang, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01370 · Cited by 80
“Recent text-to-image synthesis methods such as GLIDE [29], DALL-E2 [33], Imagen [37], Parti [55], CogView2 [7], and Stable Diffusion [35] are built upon either auto-regressive or diffusion models.”
MethodMotionGPT: Finetuned LLMs Are General-Purpose Motion Generators
Zhang, Y., Huang, D., Liu, B., Tang, S., Lu, Y., Chen, L., Bai, L., Chu, Q., Yu, N., & Ouyang, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28567 · Cited by 128
EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual Grounding
Wu, Y., Cheng, X., Zhang, R., Cheng, Z., & Zhang, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01843 · Cited by 83
“Due to the advance of multimodality [43,45,46,61], many promising works across 3D vision and language have been introduced recently.”
BackgroundConsistent View Synthesis with Pose-Guided Diffusion Models
Tseng, H.-Y., Li, Q., Kim, C., Alsisan, S., Huang, J., & Kopf, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01609 · Cited by 91
“Diffusion models [14,52,54] have achieved impressive performance on many content creation applications, such as image-to-image translation [44] and text-toimage generation [2, 36, 45].”
BackgroundMethodScientific novelty beyond the experiment
Hallsworth, J. E., Udaondo, Z., Pedrós‐Alió, C., Höfer, J., Benison, K. C., Lloyd, K. G., Cordero, R. J. B., de Campos, C. B. L., Yakimov, M. M., & Amils, R. (2023) · Microbial Biotechnology · doi:10.1111/1751-7915.14222 · Cited by 62
“Indeed, there are now many artificial systems that have been designed to produce artworks such as music and painting (Baraniuk, 2017; Hitsuwari et al., 2022; Hutson, 2017; Ramesh et al., 2022), though it is still debatable whether this is akin to human creativity.”
BackgroundEXPLORING THE ROLE OF TEXT-TO-IMAGE AI IN CONCEPT GENERATION
Brisco, R., Hay, L., & Dhami, S. (2023) · Proceedings of the Design Society · doi:10.1017/pds.2023.184 · Cited by 68
“The recent proliferation of text-to-image AI models is attributed to the development of new learning techniques such as generative adversarial networks (GANs) and diffusion models using Contrastive Language–Image Pre-training (CLIP) (Ramesh et al., 2022) making the time to train and therefore cost significantly less.”
BackgroundPartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Models
Liu, M., Zhu, Y., Cai, H., Han, S., Ling, Z., Porikli, F., & Su, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02082 · Cited by 74
“Pretrained image-language models have recently made great strides by pretraining on large-scale image-text pairs [1, 22, 29, 45, 46, 50, 76].”
BackgroundMIGC: Multi-Instance Generation Controller for Text-to-Image Synthesis
Zhou, D., Li, Y., Ma, F., Zhang, X., & Yang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00651 · Cited by 113
“Meanwhile, we propose the COCO-MIG benchmark to evaluate the inherent MIG capabilities of generative models.”
MethodSeD: Semantic-Aware Discriminator for Image Super-Resolution
Li, B., Li, X., Zhu, H., Jin, Y., Feng, R., Zhang, Z., & Chen, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02436 · Cited by 81
Jo, H., Lee, J.-K., Lee, Y.-C., & Choo, S. (2024) · Journal of Computational Design and Engineering · doi:10.1093/jcde/qwae017 · Cited by 83
“They only care to show us the wheelchair”: disability representation in text-to-image AI models
Mack, K. A., Qadri, R., Denton, R., Kane, S. K., & Bennett, C. L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642166 · Cited by 67
Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesis
Fan, W.-C., Chen, Y., Chen, D., Yu, C., Yuan, L., & Wang, Y.-C. F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25133 · Cited by 80
AdvDiffuser: Natural Adversarial Example Synthesis with Diffusion Models
Chen, X., Gao, X., Zhao, J., Ye, K., & Xu, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00421 · Cited by 80
“For example, Dall-E [28] and stable diffusion [30] produce professional artistic paintings with user-specified text prompts.”
BackgroundChen, X., & Wu, D. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3378279 · Cited by 85
“DALL-E2[29]usestheCLIPmultimodalcompar-ison model and introduces a two-stage text-to-image generation approach, explicitly generating image representations and training the prior with autoregressive methods or Diffusion models, which improve the diversity and realism of images.”
MethodHa, J., Jeon, H., Han, D. S., Seo, J., & Oh, C. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642472 · Cited by 96
Deep diffusion models for seismic processing
Durall, R., Ghanim, A., Fernandez, M., Ettrich, N., & Keuper, J. (2023) · Computers & Geosciences · doi:10.1016/j.cageo.2023.105377 · Cited by 77
“In a short period of time, these models have achieved surprisingly high performance [3, 4, 5, 6], and have even surpassed state-of-the-art algorithms like generative adversarial networks [7] (GANs) and variational autoencoders [8] (VAEs).”
BackgroundExpressive Text-to-Image Generation with Rich Text
Ge, S., Park, T., Zhu, J.-Y., & Huang, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00694 · Cited by 87
“Fueled by the large-scale text-image datasets [60, 8], various training and inference techniques [20, 62, 21, 22], and scalibility [51], significant progress has been made in text-to-image generation using diffusion models [4, 51, 45, 56, 17], autoregressive models [52, 76, 11, 15], GANs [59, 28],…”
BackgroundMethodCRS-Diff: Controllable Remote Sensing Image Generation With Diffusion Model
Tang, D., Cao, X., Hou, X., Jiang, Z., Liu, J., & Meng, D. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3453414 · Cited by 103
“research topic since the generated images exhibit high quality, e.g., generating realistic images [3], [4], [5], [6], transforming art styles [11], [12], image superresolution [13], [14], [15], and video generation [16].”
BackgroundMethodInfluentialCLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognition
Hegde, D., Valanarasu, J. M. J., & Patel, V. M. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00217 · Cited by 87
“For many tasks in 2D vision, the most efficient and accurate results are now obtained by adapting foundation models [47, 48, 2, 70] which are pre-trained on large-scale data.”
BackgroundGPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation
Wu, T., Yang, G., Li, Z., Zhang, K., Liu, Z., Guibas, L. J., Lin, D., & Wetzstein, G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02098 · Cited by 111
Paint3D: Paint Anything 3D With Lighting-Less Texture Diffusion Models
Zeng, X., Chen, X., Qi, Z., Liu, W., Zhao, Z., Wang, Z., Fu, B., Liu, Y., & Yu, G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00407 · Cited by 74
“The rise of deep generative models has ushered the era of Artificial Intelligence Generated Content, catalyzing advancements in natural language generation [46, 58, 70], image synthesis [42, 48, 50, 51], and 3D generation [31, 43, 61].”
BackgroundHow can LLMs transform the robotic design process?
Stella, F., Santina, C. D., & Hughes, J. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00669-7 · Cited by 73
Multiview Compressive Coding for 3D Reconstruction
Wu, C.-Y., Johnson, J., Malik, J., Feichtenhofer, C., & Gkioxari, G. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00875 · Cited by 79
“We demonstrate the generality of MCC by experimenting on six diverse data sources: CO3D [50], Hypersim [51], Taskon-omy [81], ImageNet [7], in-the-wild iPhone captures and DALL · E 2 [47] generations.”
BackgroundMethodPaiss, R., Ephrat, A., Tov, O., Zada, S., Mosseri, I., Irani, M., & Dekel, T. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00294 · Cited by 121
“In this work, we focus on contrastive VLMs, such as CLIP [38] and BA-SIC [36], as they are widely used both for downstream tasks and as backbones for generative models [40, 43].”
MethodNetDiffusion: Network Data Augmentation Through Protocol-Constrained Traffic Generation
Jiang, X., Liu, S., Gember-Jacobson, A., Bhagoji, A. N., Schmitt, P., Bronzino, F., & Feamster, N. (2024) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3639037 · Cited by 69
SneakyPrompt: Jailbreaking Text-to-image Generative Models
Yang, Y., Hui, B., Yuan, H., Gong, N. Z., & Cao, Y. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00123 · Cited by 128
“For example, Microsoft has embedded DALL · E [2] into an application named Designer [9] and an image creator tool as part of Microsoft Edge; in addition, Stable Diffusion has been used by more than 10 million people daily up to February 2023.”
BackgroundMethodInfluentialStudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesis
Kang, M., Shin, J., & Park, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3306436 · Cited by 85
“The conditional information could be an image [12], [14], [66], [67], [68], [69], [70], [71], [72], [73], [74], [75], [76], [77], a categorical label [10], [27], [78], [79], [80], [81], [82], [83], [84], [85], [86], [87], or a text [88], [89], [90], [91], [92], [93].”
MethodAlhabeeb, S., & Al-Shargabi, A. A. (2024) · IEEE Access · doi:10.1109/access.2024.3365043 · Cited by 77
“Building upon the success of its predecessor [66], DALL-E 2 [80] was launched as a follow-up version with the intention of producing more realistic images at greater resolutions by combining concepts, features, and styles.”
MethodGAI-IoV: Bridging Generative AI and Vehicular Networks for Ubiquitous Edge Intelligence
Xie, G., Xiong, Z., Zhang, X., Xie, R., Guo, S., Guizani, M., & Poor, H. V. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3396276 · Cited by 68
“Other widely utilized GAI models include BERT [7], Imagen [8], and DALL-E 2 [9].”
MethodDiffCollage: Parallel Generation of Large Content with Diffusion Models
Zhang, Q., Song, J., Huang, X., Chen, Y., & Liu, M.-Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00982 · Cited by 85
“Recently, impressive progress has been made in improving its quality [3,44, 45,49], controllability [15, 18,21,28, 37,46], and efficiency [24, 55, 69, 70].”
InfluentialDiffFashion: Reference-Based Fashion Design With Structure-Aware Transfer by Diffusion Models
Cao, S., Chai, W., Hao, S., Zhang, Y., Chen, H., & Wang, G. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3318297 · Cited by 73
“Recently, diffusion models [13], [14], [15] have been applied in various generative tasks, such as text image generation [16], [17] and image translation [18], due to the realism of their generated results.”
BackgroundMelzi, P., Rathgeb, C., Tolosana, R., Vera-Rodríguez, R., Lawatsch, D., Domin, F., & Schaubert, M. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00333 · Cited by 81
“They rely on their strong semantic prior, learned from a large collection of image-caption pairs, to bind a word with various images in different poses and contexts [32, 35].”
BackgroundUniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Image
Valevski, D., Kalman, M., Molad, E., Segalis, E., Matias, Y., & Leviathan, Y. (2023) · ACM Transactions on Graphics · doi:10.1145/3592451 · Cited by 135
“Revolutionary text-to-image models like Dall-E [Ramesh et al. 2022], Imagen [Saharia et al. 2022, 2021] and Stable Diffusion [Rom-bach et al. 2021] excel at creating images from scratch, or at filling manually-removed parts of existing images in a context-aware fashion.”
MethodA Pilot Study of Query-Free Adversarial Attack against Stable Diffusion
Zhuang, H., Zhang, Y., & Liu, S. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00236 · Cited by 76
“All the images are generated from the same seed. served as instructions of DM) to effectively control the content of the synthesized images [3, 12].”
BackgroundGeneralizing Dataset Distillation via Deep Generative Prior
Cazenavette, G., Wang, T., Torralba, A. B., Efros, A. A., & Zhu, J.-Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00364 · Cited by 84
Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models
Ling, H., Kim, S. W., Torralba, A. B., Fidler, S., & Kreis, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00819 · Cited by 127
“As discussed, AYG builds on text-driven image [5, 14, 21, 61, 67, 70, 72, 98], video [1, 7, 22, 25, 28, 38, 78, 90, 91, 94, 107] and 3D-aware DMs [42, 44, 45, 56, 64, 75, 76, 104], uses score distillation sampling [10, 11, 17, 31, 41, 48, 52, 62, 85, 88, 92, 96, 109] and leverages 3D Gaussian…”
Foundation models and intelligent decision-making: Progress, challenges, and perspectives
Huang, J., Xu, Y., Wang, Q., Wang, Q., Liang, X., Wang, F., Zhang, Z., Wei, W., Zhang, B., Huang, L., et al. (2025) · The Innovation · doi:10.1016/j.xinn.2025.100948 · Cited by 87
“85 The progression continued with multimodality models 86–88 such as CLIP 14 and MiniGPT-4, 87 which align images and text in a shared space, enabling versatile zero-shot classification.”
Transferable deep generative modeling of intrinsically disordered protein conformations
Janson, G., & Feig, M. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1012144 · Cited by 62
UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs
Xu, Y., Zhao, Y., Xiao, Z., & Hou, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00783 · Cited by 112
“Researchers have made numerous efforts to train diffusion models on large datasets containing image-text pairs [55] for the text-to-image generation task [1, 43, 47, 49, 51, 66].”
BackgroundDiscop: Provably Secure Steganography in Practice Based on "Distribution Copies"
Ding, J., Chen, K., Wang, Y., Zhao, N., Zhang, W., & Yu, N. (2023) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46215.2023.10179287 · Cited by 71
“Deep generative models can synthesize photo-realistic highresolution images, luxuriant original art [44], [46], [51], [52], and articles that seem written by humans [45], [47], [48].”
Txt2Img-MHN: Remote Sensing Image Generation From Text Using Modern Hopfield Networks
Xu, Y., Yu, W., Ghamisi, P., Kopp, M., & Hochreiter, S. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3323799 · Cited by 71
“Very recently, the second generation of DALL-E has been published [37].”
BackgroundMethodMoreno, H., Gómez, A., Altares-López, S., Ribeiro, Á., & Andújar, D. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.108324 · Cited by 67
Generative models for protein sequence modeling: recent advances and future directions
Mardikoraem, M., Wang, Z., Pascual, N., & Woldring, D. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad358 · Cited by 61
“For example,Dall-E2 [102],a text-to-image framework generated by OpenAI, incorporates a diffusion model during trainingtogeneraterealisticandhigh-qualityimages.”
MethodDeep learning-based text detection and recognition on architectural floor plans
Schönfelder, P., Stebel, F., Andreou, N., & König, M. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105156 · Cited by 70
Z*: Zero-shot Style Transfer via Attention Reweighting
Deng, Y., He, X., Tang, F., & Dong, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00662 · Cited by 67
“Diffusion models have demonstrated impressive results in text-to-image generation [29, 33, 36, 37] and image editing [3, 5, 6, 10, 16, 22, 28, 30, 40, 45, 52].”
MMA-Diffusion: MultiModal Attack on Diffusion Models
Yang, Y., Gao, R., Wang, X., Ho, T.-Y., Xu, N., & Xu, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00739 · Cited by 69
Sapkota, R., Meng, Z., & Karkee, M. (2024) · Smart Agricultural Technology · doi:10.1016/j.atech.2024.100614 · Cited by 58
Lew, A. J., Jin, K., & Buehler, M. J. (2023) · npj Computational Materials · doi:10.1038/s41524-023-01036-1 · Cited by 65
GLFF: Global and Local Feature Fusion for AI-Synthesized Image Detection
Ju, Y., Jia, S., Cai, J., Guan, H., & Lyu, S. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3313503 · Cited by 62
“…released generation models, including StyleGAN2-distillation [79], StyleGAN3 [28] and the state-of-the-art diffusion models such as DALL · E 2 [40], Guided-diffusion [38], and also including partially manipulated images using background matting method [80] to blend the generated images to a…”
MethodResultFairness in Deep Learning: A Survey on Vision and Language Research
Parraga, O., Móre, M. D., Mattjie, C., Gavenski, N. S., Kupssinskü, L. S., Medronha, A., de Moura, L. V., Simões, G. S., & Barros, R. C. (2023) · ACM Computing Surveys · doi:10.1145/3637549 · Cited by 82
“Since DALL-E’s training dataset was collected from the Internet, it was expected that the model would inherit societal biases.”
InfluentialDisenDreamer: Subject-Driven Text-to-Image Generation With Sample-Aware Disentangled Tuning
Chen, H., Zhang, Y. J., Wang, X. Y., Duan, X., Zhou, Y., & Zhu, W. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3369757 · Cited by 59
“Among these models, diffusion-based models like Stable Diffusion [36], DALLE-2 [34], and Imagen [39] have attracted a lot of attention due to their outstanding controllability in generating photo-realistic images according to the text descriptions.”
BackgroundMethod4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling
Bahmani, S., Skorokhodov, I., Rong, V., Wetzstein, G., Guibas, L. J., Wonka, P., Tulyakov, S., Park, J. J., Tagliasacchi, A., & Lindell, D. B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00764 · Cited by 114
“Typically, these methods exploit a pretrained text encoder, such as CLIP [47], to encode the text prompt into a feature vector used to condition the diffusion model [41, 49].”
BackgroundMethodAEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error
Ricker, J., Lukovnikov, D., & Fischer, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00872 · Cited by 91
“1) [32], which builds upon Stable Diffusion and DALL-E 2 [31].”
BackgroundCopyright Safety for Generative AIPreprint
Sag, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4438593 · Cited by 71
Schetinger, V., Bartolomeo, S. D., El‐Assady, M., McNutt, A. M., Miller, M., Passos, J. P. A., & Adams, J. L. (2023) · Computer Graphics Forum · doi:10.1111/cgf.14841 · Cited by 75
Multi-metrics adaptively identifies backdoors in Federated learning
Huang, S., Li, Y., Chen, C., Shi, L., & Gao, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00429 · Cited by 63
“The parameters of neural networks can be viewed as a typical high-dimensional space, especially when the number of parameters increases as the trend in deep learning applications [9, 44, 42, 15, 34, 54, 43].”
BackgroundInverse design of porous materials: a diffusion model approach
Park, J., Gill, A. P. S., Moosavi, S. M., & Kim, J. (2024) · Journal of Materials Chemistry A · doi:10.1039/d3ta06274k · Cited by 60
Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation
Ma, X., Patidar, S., Haughton, I., & James, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01712 · Cited by 80
“…agent, different from most of the diffusion models that learn to predict a noise prediction model and learn to reconstruct the noise during the denoising steps, we follow Ramesh et al. [31] and observe that empirically directly predicting the original actions a and a is giving better performance.”
BackgroundConditional diffusion-based microstructure reconstruction
Düreth, C., Seibert, P., Rücker, D., Handford, S., Kästner, M., & Gude, Μ. (2023) · Materials Today Communications · doi:10.1016/j.mtcomm.2023.105608 · Cited by 62
“For example, while the well-known artistic generative model DALL-E [36] employs a single-pass transformer-based de-coder, the successor, DALL-E 2 is based on di ff usion models because of their e ffi ciency and high-quality samples [35].”
BackgroundI Hear Your True Colors: Image Guided Audio Generation
Sheffer, R., & Adi, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096023 · Cited by 58
“Large-scale datasets of text-image pairs automatically obtained from the internet [7] were one of the main factors enabling recent breakthroughs in such models [4, 5].”
BackgroundMethodVIDM: Video Implicit Diffusion Models
Mei, K., & Patel, V. M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26094 · Cited by 70
SKED: Sketch-guided Text-based 3D Editing
Mikaeili, A., Perel, O., Safaee, M., Cohen‐Or, D., & Amiri, A. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01343 · Cited by 73
“The field of image synthesis has been significantly pro-pelled by neural generative models, particularly by the lat-est text-to-image models that predominantly rely on large language-image models [3, 54, 55, 56].”
MethodDiffusion Model as Representation Learner
Yang, X., & Wang, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01736 · Cited by 58
“DPMs [24] have emerged as a cutting-edge approach for generating high-quality samples, with applications like conditioned image generation [85, 52, 57], 3D generation [50], video synthesis [25] and domain generalization [82].”
BackgroundZero-shot spatial layout conditioning for text-to-image diffusion models
Couairon, G., Careil, M., Cord, M., Lathuilière, S., & Verbeek, J. J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00207 · Cited by 68
“bilities when trained on vast web-scale datasets [15, 34, 36, 38].”
BackgroundImproving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models
Lee, S., Chung, H., Park, M., Park, J., Ryu, W., & Ye, J. C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00983 · Cited by 69
“The confluence of the diffusion model with conditioning training is a noteworthy synergy, constituting a foundational framework within the domain of text-guided image generation [30, 32, 29].”
BackgroundChatPose: Chatting about 3D Human Pose
Feng, Y., Jing, L., Dwivedi, S. K., Sun, Y. M., Patel, P., & Black, M. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00204 · Cited by 81
“Given a textual description of a person’s attributes, advanced image generation methods like Stable Diffusion [43] and DALL·E 2 [42] generate realistic 2D images of people.”
MethodPrompt-Free Diffusion: Taking “Text” Out of Text-to-Image Diffusion Models
Xu, X., Guo, J., Wang, Z., Huang, G. M., Essa, I. A., & Shi, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00829 · Cited by 84
RenAIssance: A Survey Into AI Text-to-Image Generation in the Era of Large Model
Bie, F., Yang, Y., Zhou, Z., Ghanem, A., Zhang, M., Yao, Z., Wu, X., Holmes, C., Golnari, P. A., Clifton, D. A., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3522305 · Cited by 96
“Besides, CLIP enables multi-modal learning for contrastive text-image representations, which has spurred the development of prior-decoder TTI architecture [4, 158, 161] that generates images without arbitrary need of text embeddings.”
BackgroundMethodInfluentialDiffFace: Diffusion-based face swapping with facial guidance
Kim, K., Kim, Y., Cho, S., Seo, J., Nam, J., Lee, K., Kim, S., & Lee, K.-H. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111451 · Cited by 136
Shipard, J., Wiliem, A., Thanh, K. N., Xiang, W., & Fookes, C. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00084 · Cited by 73
“To address the MA-ZSC problem, we utilise a L atent D iffusion M odel [27] (LDM) which can generate synthetic training images for each unseen class from its textual description.”
MethodInfluentialHRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Models
Bakr, E. M., Sun, P., Shen, X., Khan, F. F., Li, L. E., & Elhoseiny, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01834 · Cited by 74
“As shown in Figure 5 part B, the best model is DALLE-V2 [55], which achieves a 75% error rate.”
BackgroundMethodInfluentialC2Ideas: Supporting Creative Interior Color Design Ideation with a Large Language Model
Hou, Y., Yang, M., Cui, H., Wang, L., Xu, J., & Zeng, W. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642224 · Cited by 64
“Existing solutions primarily involve refining pre-trained models with domain-specific data [9] and integrating human expertise through human-in-the-loop techniques [40].”
BackgroundSiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion
Ho, H.-I., Song, J., & Hilliges, O. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00058 · Cited by 73
“ControlNet [77] introduced additional trainable plugins to enable image conditioning such as body skeletons.”
BackgroundMethodSatSynth: Augmenting Image-Mask Pairs Through Diffusion Models for Aerial Semantic Segmentation
Toker, A., Eisenberger, M., Cremers, D., & Leal-Taixé, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02615 · Cited by 73
“Besides unconditional generation of novel data instances, common applications of image diffusion models include inpainting [39, 45], super-resolution [29], style transfer [70], depth prediction [54], and general x-to-image tasks [47, 49, 52].”
BackgroundMethodThe role of large language models in agriculture: harvesting the future with LLM intelligence
Shaikh, T. A., Rasool, T., Veningston, K., & Yaseen, S. M. (2024) · Progress in Artificial Intelligence · doi:10.1007/s13748-024-00359-4 · Cited by 67
“However, new developments in LLM research indicate that these algorithms may greatly help with software execution, mathematical reasoning, and even form generation [149].”
Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes
Ju, X., Zeng, A., Wang, J., Xu, Q., & Zhang, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00067 · Cited by 60
Scene-Driven Multimodal Knowledge Graph Construction for Embodied AI
Song, Y., Sun, P., Liu, H., Li, Z., Song, W., Xiao, Y., & Zhou, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3399746 · Cited by 61
“This not only improves the efficiency of navigation planning but also reduces the risk of making mistakes in unseen scenes.”
BackgroundAI Art is Theft: Labour, Extraction, and Exploitation: Or, On the Dangers of Stochastic Pollocks
Goetze, T. S. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658898 · Cited by 75
HIVE: Harnessing Human Feedback for Instructional Visual Editing
Zhang, S., Yang, X., Feng, Y., Qin, C., Chen, C.-C., Yu, N., Chen, Z., Wang, H., Savarese, S., Ermon, S., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00862 · Cited by 133
“[12, 29, 34, 43, 44, 46, 47, 60].”
BackgroundGenerative Pretrained Transformer for Heterogeneous Catalysts
Mok, D. H., & Back, S. (2024) · Journal of the American Chemical Society · doi:10.1021/jacs.4c11504 · Cited by 63
Score-Based Diffusion Models as Principled Priors for Inverse Imaging
Feng, B. T., Smith, J., Rubinstein, M., Chang, H., Bouman, K. L., & Freeman, W. T. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00965 · Cited by 99
“This capability has gone under-examined in previous work, which mostly focuses on diffusion models as unconditional samplers [20, 31, 60] and conditional samplers [61, 53, 57, 32, 39].”
Background
Metadata
- Authors
- Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M.
- ORCID
- Chen, Mark
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2204.06125
- OpenAlex
- W4224035735
- Cited by
- 2,511
- References
- 66
- Citations by year
- 2026: 46 · 2025: 429 · 2024: 1113 · 2023: 859 · 2022: 63
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- text-to-image generation, diffusion models, image priors, image variation, photorealism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
