The DOI matches its DataCite record; 69 of the 69 references it cites were found in a registry or an index.
Hierarchical Text-Conditional Image Generation with CLIP Latents
Open accessAbstract
Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a CLIP image embedding given a text caption, and a decoder that generates an image conditioned on the image embedding. We show that explicitly generating image representations improves image diversity with minimal loss in photorealism and caption similarity. Our decoders conditioned on image representations can also produce variations of an image that preserve both its semantics and style, while varying the non-essential details absent from the image representation. Moreover, the joint embedding space of CLIP enables language-guided image manipulations in a zero-shot fashion. We use diffusion models for the decoder and experiment with both autoregressive and diffusion models for the prior, finding that the latter are computationally more efficient and produce higher-quality samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While more sophisticated methods for partially editing individual frames during training exist (e.g., text-to-image models [13], [14]), they are slow, computationally expensive and error-prone.”
From Language-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredIn the citing paper
“Generative machines, such as text-to-image algorithms, are contributing to the variety of cultural traits.”
From Machine culture (2023) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“To this end, we generated 512 “artistic” captions using GPT-3 [4] by prompting it with captions for existing artwork (both real and AI generated).”
MethodSelf-citationHigh-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302 · cited 2×
“[42] use diffusion models on the latents obtained from a VQGAN [14] like autoencoder.”
BackgroundMethodLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 3×
“Recent progress in computer vision has been driven by scaling models on large datasets of captioned images collected from the internet [10, 44, 60, 39, 31, 16].”
BackgroundMethodSelf-citationLIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 12,864 · cited 4×
“After applying PCA, we order the principal components by decreasing eigenvalue magnitude, quantize each of the 319 dimensions into 1,024 discrete buckets, and predict the resulting sequence using a decoder-only Transformer [53] model with a causal attention mask.”
MethodInfluentialDecoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Research works printed but not linked: 2
- [23][23] Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Advances in Neural Information Processing Systems 30 (NIPS 2017), 2017.
- [32][32] Ryan Murdock. The Big Sleep. https://twitter.com/advadnoun/status/ 1351038053033406468, 2021. 20 https://openreview.net/forum?id=qw674L9PfQE https://openreview.net/forum?id=qw674L9PfQE https://arxiv.org/abs/2203.13131 https://arxiv.org/abs/2108.00946 https://arxiv.org/abs/2102.01645 https://arxiv.org/abs/1406.2661 https://arxiv.org/abs/2111.14822 https://openreview.net/forum?id=qw8AKxfYbI https://openreview.net/forum?id=qw8AKxfYbI https://arxiv.org/abs/2006.11239 https://arxiv.org/abs/2106.15282 https://arxiv.org/abs/1412.6980 https://arxiv.org/abs/1405.0312 https://arxiv.org/abs/1711.05101 https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://arxiv.org/abs/2112.12750 https://twitter.com/advadnoun/status/1351038053033406468 https://twitter.com/advadnoun/status/1351038053033406468 · arXiv
Cited by
Sorted by citations
Items 501–600 of 1,051
ClipFace: Text-guided Editing of Textured 3D Morphable Models
Aneja, S., Thies, J., Dai, A., et al. (2023) · doi:10.1145/3588432.3591566 · Cited by 40
“Recent progress in 2D language models has opened up significant opportunities for text-guided image manipulation [Abdal et al. 2022; Avrahami et al. 2022; Bau et al. 2021; Crowson 2021; Dayma et al. 2021; Ramesh et al. 2022, 2021; Ruiz et al. 2022].”
BackgroundMagistri, F., Weyler, J., Gogoll, D., Lottes, P., Behley, J., Petrinić, N., & Stachniss, C. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.108114 · Cited by 48
Text2Performer: Text-Driven Human Video Generation
Jiang, Y., Yang, S., Koh, T. L., Wu, W., Loy, C. C., & Liu, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02079 · Cited by 54
“DALLE [33, 32]) has attracted substantial attention.”
End-to-End Diffusion Latent Optimization Improves Classifier Guidance
Wallace, B., Gokul, A., Ermon, S., & Naik, N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00669 · Cited by 64
“Except for this watermark, it is identical to the accepted version; the final published version of the proceedings is available on IEEE Xplore. ages given an input text prompt [35, 36, 38, 34, 2].”
BackgroundMethodA Comprehensive Survey of Image Generation Models Based on Deep Learning
Li, J., Zhang, C., Zhu, W., & Ren, Y. (2024) · Annals of Data Science · doi:10.1007/s40745-024-00544-1 · Cited by 47
“Based on DALL-E and GLIDE, OpenAI introduced DALL-E2 [77].”
Wang, Y., Yang, D., Brémond, F., & Dantcheva, A. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3449075 · Cited by 159
“Diffusion Models (DMs) [25], [41], [59] have contributed to a remarkable progress in image synthesis [46], [47], [48], as well as video generation.”
BackgroundWen, B., Norel, R., Liu, J. C., Stappenbeck, T. S., Zulkernine, F. H., & Chen, H. (2024) · IEEE International Conference on Digital Health (ICDH) · doi:10.1109/icdh62654.2024.00027 · Cited by 48
“These developments build upon progress in both autoregressive models [17], [18] and diffusion models [19]–[22], which leverage the power of large-scale pre-trained language and vision models to generate high-quality visual content from textual descriptions.”
BackgroundFICE: Text-conditioned fashion-image editing with guided GAN inversion
Pernuš, M., Fookes, C., Štruc, V., & Dobrišek, S. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.111022 · Cited by 44
DiffForensics: Leveraging Diffusion Prior to Image Forgery Detection and Localization
Yu, Z., Ni, J., Lin, Y., Deng, H., & Li, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01213 · Cited by 55
“In addition to being widely used in generative models [11] such as image generation [13, 33, 35, 38], image inpainting [10, 36], and image editing [2, 9], its potential representation learning ability has also found applications in other computer vision tasks, such as image segmentation [4, 6] and…”
BackgroundLanguage-driven Grasp Detection
Vuong, A. D., Vu, M. N., Huang, B., Nguyen, N., Le, H., Vo, T., & Nguyen, A. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01695 · Cited by 39
“Instead of predicting x t as formulated by [33], we follow Ramesh et al. [72] and predict the signal itself, i.e., x t = f ( x t +1 , t + 1 , ˜ x 0 ) with the simple objective [33].”
MethodSound to Visual Scene Generation by Audio-to-Visual Latent Alignment
Kim, S.-B., Senocak, A., Ha, H., Owens, A., & Oh, T.-H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00622 · Cited by 49
“Various tasks have been tack-led in diverse domains, such as text-to-image/video [19,30, 52, 56, 57, 65, 70], speech-to-face/gesture [23, 44], scene graph/layout-to-image [34,75], image/audio-to-caption [4, 36, 40], etc .”
Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks
Rodríguez, F. M., García-Mojón, R., & Fernandez-Barciela, M. (2023) · Sensors · doi:10.3390/s23229037 · Cited by 48
“The most known and documented examples of these last ones are DALL E [4,5] and Stable Diffusion [6].”
BackgroundCon-CDVAE: A method for the conditional generation of crystal structures
Ye, C., Weng, H., & Wu, Q. (2024) · Computational Materials Today · doi:10.1016/j.commt.2024.100003 · Cited by 53
“In order to achieve conditional generation, we build two new blocks based on CDVAE [18], and introduce the 𝑃𝑟𝑖𝑜𝑟 block ,inspired by DALL-E2 [14], to generate the latent variable according given properties.”
BackgroundMethodInfluentialGaussian Shell Maps for Efficient 3D Human Generation
Abdal, R., Wang, Y., Shi, Z., Xu, Y., Po, R., Kuang, Z., Chen, Q., Yeung, D., & Wetzstein, G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00902 · Cited by 57
“GANs and diffusion models are two very powerful generative models emerging as a result of efficient architectures and high-quality datasets [25, 48].”
Self-Correcting LLM-Controlled Diffusion Models
Wu, T.-H., Lian, L., Gonzalez, J. E., Li, B., & Darrell, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00605 · Cited by 46
“Initial studies [19–21] showed diffusion models’ ability to create high-quality images, but they struggle with complex prompts.”
BackgroundAI Regulation Is (not) All You Need
Lucaj, L., van der Smagt, P., & Benbouzid, D. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594079 · Cited by 40
Wolfe, R., Yang, Y., Howe, B., & Caliskan, A. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594072 · Cited by 42
Natural Language Processing in Marketing
Hartmann, J., & Netzer, O. (2023) · Artificial Intelligence in Marketing · doi:10.1108/s1548-643520230000020011 · Cited by 38
Uncurated Image-Text Datasets: Shedding Light on Demographic Bias
García, N., Hirota, Y., Wu, Y., & Nakashima, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00672 · Cited by 50
“Those models have been shown to learn visual and language representations that outperform the previous state-of-the-art on tasks such as zero-shot classification [37] or text-to-image generation [38, 39].”
BackgroundDiverse Hyperspectral Remote Sensing Image Synthesis With Diffusion Models
Liu, L., Chen, B., Chen, H., Zou, Z., & Shi, Z. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3335975 · Cited by 47
“Diffusion models show great potential in diverse HSI synthesis, as they consider both quality and diversity in image generation [25], [26], [27].”
BackgroundMethodMicromechanics-based deep-learning for composites: Challenges and future perspectives
Mirkhalaf, M., & Rocha, I. B. C. M. (2024) · European Journal of Mechanics - A/Solids · doi:10.1016/j.euromechsol.2024.105242 · Cited by 40
Performance Comparison and Visualization of AI-Generated-Image Detection Methods
Park, D., Na, H., & Choi, D. (2024) · IEEE Access · doi:10.1109/access.2024.3394250 · Cited by 53
“The test dataset provided by Corvi et al. [53] was also used as the base of the transformer-generated-image test dataset, which consisted of images generated by DALL · E Mini [34], DALL · E 2 [35], and Taming Transformers [36].”
BackgroundMethodFu, J., Zhou, W., Jiang, Q., Liu, H., & Zhai, G. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3420083 · Cited by 43
“The AIGCIQA-2023 dataset uses Glide [22], Lafite [28], DALLE2 [27], Stable Diffusion [23], Unidiffuser [29], and Controlnet [30] to generate 2400 AGIs.”
MethodVision + X: A Survey on Multimodal Learning in the Light of Data
Zhu, Y., Wu, Y., Sebe, N., & Yan, Y. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3420239 · Cited by 56
“Starting from recent several years since 2020, DPMs have gradually become one of the most active methods for vision generation tasks [89], [101], [102], [194], [220], [320], due to its impressive performance and better tractability compared to GANs.”
BackgroundViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
Höllein, L., Božič, A., Muller, N. E., Novotný, D., Tseng, H.-Y., Richardt, C., Zollhöfer, M., & Nießner, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00482 · Cited by 55
“In recent years, text-to-image (T2I) diffusion models [29, 33] have emerged as cutting-edge technologies, revolutionizing high-quality and imaginative 2D content creation guided by text descriptions.”
InfluentialKhosravi, B., Purkayastha, S., Erickson, B. J., Trivedi, H., & Gichoya, J. W. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100890 · Cited by 47
Hallucination of Multimodal Large Language Models: A Survey
Bai, Z., Wang, P., Xiao, T., He, T., Han, Z., Zhang, Z., & Shou, M. Z. (2024) · arXiv · doi:10.48550/arxiv.2404.18930 · Cited by 38
“The hallucinatory examples are generated using leading MLLMs and image generation models, such as LLaVA [75], MiniGPT-4 [138], DALL-E2 [89], and DALL-E3 [6].”
Carrillo-Perez, F., Pizurica, M., Zheng, Y., Nandi, T. N., Madduri, R., Shen, J., & Gevaert, O. (2024) · Nature Biomedical Engineering · doi:10.1038/s41551-024-01193-8 · Cited by 37
“Dall-E 2 and Imagen presented incredible results in image synthesis based on textual input, surpassing all previous methods in quality metrics and synthesis capabilities 32,33 .”
Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model
Ren, Z., Pan, Z., Zhou, X., & Kang, L. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096441 · Cited by 45
“They blend text into the input and guide the generation of images using techniques such as classifier guidance [11], classifier-free guidance [12], which synthesize impressive samples, such as [13].”
MethodMR2: A Benchmark for Multimodal Retrieval-Augmented Rumor Detection in Social Media
Hu, X., Guo, Z., Chen, J., Wen, L., & Yu, P. S. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591896 · Cited by 46
“Recent efforts in realistic images and art generation from natural language descriptions have exacerbated this issue [21, 48, 49, 52].”
BackgroundChen, H., & Ding, N. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.858 · Cited by 60
SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesis
Farshad, A., Yeganeh, Y., Chi, Y., Shen, C., Ommer, B., & Navab, N. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00016 · Cited by 43
“Such a model is obtained by generating noisy samples x t ∼ q ( x t | x 0 ) and training a model θ (typically a U-Net) to predict the added noise using an MSE loss: This model can then successively generate images by de-noising images step by step starting from pure noise.”
MethodSALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulation
Koo, J., Yoo, S., Nguyen, M. H., & Sung, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01328 · Cited by 49
“The staggering rise of the recent image generative model such as DALL-E 2 [56], StableDiffusion [57], and Midjour-ney [41] has drawn great attention to the diffusion mod-* Equal contribution. els.”
BackgroundTexture Generation on 3D Meshes with Point-UV Diffusion
Yu, X., Dai, P., Li, W., Ma, L., Liu, Z., & Qi, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00388 · Cited by 51
Machine Learning in Petrology: State-of-the-Art and Future Perspectives
Petrelli, M. (2024) · Journal of Petrology · doi:10.1093/petrology/egae036 · Cited by 47
“Examples are BERT (Devlin et al., 2018), DALL-E (Ramesh et al., 2022), and GPT-4 (OpenAI, 2023).”
Applying Generative Machine Learning to Intrusion Detection: A Systematic Mapping Study and Review
Halvorsen, J., Izurieta, C. I., Cai, H., & Gebremedhin, A. H. (2024) · ACM Computing Surveys · doi:10.1145/3659575 · Cited by 41
“These models in particular have gained considerable attention due to their use in creating AI-generated artwork thanks to tools such as Stable Diffusion [84] and DALL-E 2 [80].”
MethodEmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Models
Yang, J., Feng, J., & Huang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00608 · Cited by 54
“Diffusion models are witnessed impressive and rapid progress in recent years, where methods like GLIDE [28], DALLE2 [32], Ima-gen [40] can generate diverse, photo-realistic and high-quality images.”
Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
Xing, Y., He, Y., Tian, Z., Wang, X., & Chen, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00683 · Cited by 84
“Recently, AI-generated content has made significant advances in creating diverse and high-realistic images [4, 9, 22, 32, 34], videos [4, 7, 15, 19, 20, 22, 38], or sound [25, 28–30, 46 ], based on the input One potential solution to this problem is to generate visual and audio content in two…”
BackgroundDiffusion-ES: Gradient-Free Planning with Diffusion for Autonomous and Instruction-Guided Driving
Yang, B., Su, H., Gkanatsios, N., Ke, T.-W., Jain, A., Schneider, J., & Fragkiadaki, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01453 · Cited by 88
“Diffusion models for decision-making and trajectory optimization Diffusion models [21, 39, 55, 56] learn to approximate the data distribution through an iterative denoising process and have shown impressive results on image generation [13, 44, 48, 50].”
BackgroundLatent diffusion model for conditional reservoir facies generation
Lee, D.-S., Ovanger, O., Eidsvik, J., Aune, E., Skauvold, J., & Hauge, R. (2024) · Computers & Geosciences · doi:10.1016/j.cageo.2024.105750 · Cited by 48
“This involves minimizing Prior training , (5) The recent work that proposed DALLE-2 (Ramesh et al., 2022) empirically found that predicting z 0 instead of ϵ results in better training.”
From human-centered to symbiotic artificial intelligence: a focus on medical applications
Desolda, G., Esposito, A., Lanzilotti, R., Piccinno, A., & Costabile, M. F. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-20414-5 · Cited by 62
Toward Fashion Intelligence in the Big Data Era: State-of-the-Art and Future Prospects
Liu, L., Zhang, H., Zhou, D., & Shi, J. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3285880 · Cited by 37
“Generative AI (AIGC, a.k.a. AI-generated content) [226] has gone viral with intriguing tools with ChatGPT [226]or DALL-E [227].”
MethodEliminating Contextual Prior Bias for Semantic Image Editing via Dual-Cycle Diffusion
Yang, Z., Chu, T., Lin, X., Gao, E., Liu, D., Yang, J., & Wang, C. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3286841 · Cited by 37
“In recent years, there has been substantial progress in textconditioned generation techniques, with the advent of models such as DALL-E [19], Make-A-Scene [20], Imagen [21], Parti [25], and DALL-E2 [22].”
DALLE-2 is Seeing Double: Flaws in Word-to-Concept Mapping in Text2Image Models
Rassin, R., Ravfogel, S., & Goldberg, Y. (2022) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2022.blackboxnlp-1.28 · Cited by 39
Quantum utility – definition and assessment of a practical quantum advantage
Herrmann, N., Arya, D., Doherty, M. W., Mingare, A., Pillay, J. C., Preis, F., & Prestel, S. (2023) · IEEE International Conference on Quantum Software (QSW) · doi:10.1109/qsw59989.2023.00028 · Cited by 53
“[90] Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen.”
BackgroundEffective Real Image Editing with Accelerated Iterative Diffusion Inversion
Pan, Z., Gherardi, R., Xie, X., & Huang, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01458 · Cited by 47
“More recently techniques such as GLIDE[33], DALL · E 2 [37] and Imagen[40], have used text embeddings from large language models to train conditional diffusion models, all of them capable of generating diverse and high quality images that match with the arbitrarily complex prompt texts.”
MethodLi, L., Li, H., Zheng, X., Wu, J., Xiao, X., Wang, R., Zheng, M. J., Pan, X., Chao, F., & Ji, R. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00654 · Cited by 43
“Diffusion models are a class of generative models that exhibit remarkable performance across a broad range of tasks, including but not limited to image generation [14, 24, 8, 2, 29, 4, 15, 38], super-resolution [33, 39, 6], inpainting [22, 31], and text-to-image generation [25, 32, 27, 10].”
BackgroundSpeech driven video editing via an audio-conditioned diffusion model
Bigioi, D., Basak, S., Stypułkowski, M., Zięba, M., Jordan, H., McDonnell, R., & Corcoran, P. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.104911 · Cited by 49
AnimeDiffusion: Anime Diffusion Colorization
Cao, Y., Meng, X., Mok, P. Y., Lee, T., Liu, X., & Li, P. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3357568 · Cited by 40
“DALL-E2[37]andImagen[38]wereproposed successivelytoperformtext-guidednaturalimagesynthesis tasks.”
V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
Wang, H., Ma, J., Pascual, S., Cartwright, R., & Cai, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29475 · Cited by 49
Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Models
Pan, X., Qin, P., Li, Y., Xue, H., & Chen, W. (2024) · 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv57701.2024.00290 · Cited by 47
“Recently advanced diffusion models [31] such as DALL·E 2 [24], Imagen [29], and Stable Diffusion [26] have shown unprecedented text-to-image synthetic capacities.”
BackgroundSGDM: An Adaptive Style-Guided Diffusion Model for Personalized Text to Image Generation
Xu, Y., Xu, X., Gao, H., & Xiao, F. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3399075 · Cited by 46
“Models like DALL-E2 [28], Imagen [2] and Stable Diffusion [1] are trained on large-scale text-image pairs, showing the robust capabilities of diffusion models in generating complex scenes and semantics. eDiff-I [29] employs a multi-stage approach to image generation, with each stage us-ing…”
MethodA GAN-Based Semantic Communication for Text Without CSI
Mao, J., Xiong, K., Liu, M., Qin, Z., Chen, W., Fan, P., & Letaief, K. B. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3415363 · Cited by 44
Towards Realistic Scene Generation with LiDAR Diffusion Models
Ran, H., Guizilini, V., & Wang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01396 · Cited by 52
“CLIP enables zero-shot understanding across diverse generation tasks of text-to-image [49], text-to-video [68], etc .”
BackgroundMatSynth: A Modern PBR Materials Dataset
Vecchio, G., & Deschaintre, V. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02087 · Cited by 47
“In generative workflow in particular, data has been a key enabler for higher quality and diversity [3, 35].”
BackgroundTowards Generalizable Tumor Synthesis
Chen, Q., Chen, X., Song, H., Xiong, Z., Yuille, A., Wei, C., & Zhou, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01060 · Cited by 54
“The quality of synthetic data produced by a generative model is typically heavily reliant on the quantity and diversity of the paired training data used during the training phase [11, 39, 64].”
BackgroundZONE: Zero-Shot Instruction-Guided Local Editing
Li, S., Zeng, B., Feng, Y., Gao, S., Liu, X.-J., Liu, J., Li, L., Tang, X., Hu, Y. G., Liu, J., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00598 · Cited by 60
“State-of-the-art (SOTA) image generative techniques [39, 44, 45, 56] predominantly concentrate on stylization, where the desired appearance is determined by a reference image or textual description, often leading to global image alterations [26, 31, 50].”
InfluentialTexture-Preserving Diffusion Models for High-Fidelity Virtual Try-On
Yang, X., Ding, C., Hong, Z., Huang, J., Jin, T., & Xu, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00670 · Cited by 43
“Diffusion models [17, 20, 38, 39] have attracted significant research attention, as they generate high-quality images and enable stable training convergence.”
BackgroundDysen-VDM: Empowering Dynamics-Aware Text-to-Video Diffusion with LLMs
Fei, H., Wu, S., Ji, W., Zhang, H., & Chua, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00730 · Cited by 68
“Recently, AI-Generated Content (AIGC) has witnessed thrilling advancements and remarkable progress, e.g., Chat-GPT [46], DELLE-2 [49] and Stable Diffusion (SD) [51].”
BackgroundPlaying with words: Comparing the vocabulary and lexical diversity of ChatGPT and humans
Reviriego, P., Conde, J., Merino-Gómez, E., Martínez, G., & Hernández, J. A. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100602 · Cited by 37
“The rise of Generative AI with text-to-image generators such as DALL-E (Ramesh, Dhariwal, Nichol, Chu, & Chen, 2022) or Stable Diffusion (Esser et al., 2024b), text-to-video tools such as Sora, and in particular LLMs has transformed how interactive applications are developed with LLMs becoming a new piece in the softw…”
Artificial Intelligence Co-Piloted AuditingPreprint
Gu, H., Schreyer, M., Moffitt, K. C., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4444763 · Cited by 36
Kim, G., & Chun, S. Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01365 · Cited by 41
Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionality
Lorenz, P., Durall, R., & Keuper, J. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00051 · Cited by 47
“As a result, a large number of studies have been exploring novel network architectures [83, 57, 20, 50, 69], alternative noise schedules to accelerate the sampling during inference [83, 57, 50, 53, 96, 76] and state-of-the-art text-to-image approaches [15, 67, 75, 69, 33, 73].”
BackgroundDiffTAD: Temporal Action Detection with Proposal Denoising Diffusion
Nag, S., Zhu, X., Deng, J., Song, Y.-Z., & Xiang, T. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00951 · Cited by 47
“Diffusion models have recently demonstrated remarkable results in fields including computer vision [5, 57, 61, 54, 26, 20, 60, 64, 27, 94, 29, 92], nature language processing [4, 39, 24], audio processing [55, 91, 85, 37, 73, 31, 35], interdisciplinary applications[33, 30, 3, 89, 76, 84, 62], etc .”
BackgroundDiverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptation
Yariv, G., Gat, I., Benaim, S., Wolf, L., Schwartz, I., & Adi, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28486 · Cited by 59
Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models
Wang, R., Chen, Z., Chen, C., Ma, J., Lu, H., & Lin, X. S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28364 · Cited by 43
Choi, H.-Y., Lee, S.-H., & Lee, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29740 · Cited by 42
Towards Realistic Generative 3D Face Models
Rai, A., Gupta, H., Pandey, A., et al. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00370 · Cited by 37
“Introduction The success of language models like GPT-3 [41], and more recently, the release of text-to-image models like GLIDE [35], DALLE-2 [43], or Imagen [45] have all contributed to the enormous popularity of generative AI.”
BackgroundAn Analysis of Recent Advances in Deepfake Image Detection in an Evolving Threat Landscape
Abdullah, S. M., Cheruvu, A., Kanchi, S., Chung, T., Gao, P., Jadliwala, M. S., & Viswanath, B. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00194 · Cited by 58
Diffusion Models for Medical Image Computing: A Survey
Shi, Y., Abulizi, A., Wang, H., Feng, K., Abudukelimu, N., Su, Y., & Abudukelimu, H. (2024) · Tsinghua Science & Technology · doi:10.26599/tst.2024.9010047 · Cited by 44
360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Model
Wang, Q., Li, W., Mou, C., Cheng, X., & Zhang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00660 · Cited by 48
“Noteworthy examples include GLIDE [29], DALLE-2 [33], Imagen [37].”
BackgroundAVID: Any-Length Video Inpainting with Diffusion Model
Zhang, Z., Wu, B., Wang, X., Luo, Y., Zhang, L., Zhao, Y., Vajda, P., Metaxas, D., & Yu, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00684 · Cited by 69
“The success of diffusion models [23, 56, 58] have enabled advanced image generation [16, 43, 46, 47, 51].”
BackgroundFlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesis
Liang, F., Wu, B., Wang, J., Yu, L., Li, K., Zhao, Y., Misra, I., Huang, J., Zhang, P., Vajda, P., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00784 · Cited by 68
“Notable advancements have been seen in text-guided Image-to-Image (I2I) synthesis [4, 14, 31, 43], greatly supported by large pre-trained text-to-image diffusion models [37, 39, 40].”
MethodAn Investigation on Utilizing Large Language Model for Industrial Computer-Aided Design Automation
Deng, H., Khan, S., & Erkoyuncu, J. A. (2024) · Procedia CIRP · doi:10.1016/j.procir.2024.07.049 · Cited by 44
DALLE-URBAN: Capturing the urban design expertise of large text to image transformers
Seneviratne, S., Senanayake, D., Rasnayaka, S., Vidanaarachchi, R., & Thompson, J. (2022) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta56598.2022.10034603 · Cited by 44
“In particular we evaluate DALL-E 2 [25] on its ability to handle challenges in urban design and urban planning.”
Tanasra, H., Shaham, T. R., Michaeli, T., Austern, G., & Barath, S. (2023) · Buildings · doi:10.3390/buildings13071793 · Cited by 34
AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensics
Jia, S., Huang, M., Zhou, Z., Ju, Y., Cai, J., & Lyu, S. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00096 · Cited by 50
“…manipulation techniques such as manual copy-move, slicing, or inpainting as described in [64], the latest language and vision models such as DALL-E [53, 54] allow for fully automatic and realistic local edits to images guided by a text prompt while preserving semantic information and stylistic…”
BackgroundMethodInfluentialCLIP-Sculptor: Zero-Shot Generation of High-Fidelity and Diverse Shapes from Natural Language
Sanghi, A., Fu, R., Liu, V., Willis, K. D. D., Shayani, H., Khasahmadi, A. H., Sridhar, S., & Ritchie, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01759 · Cited by 49
Fast Point Cloud Generation with Straight Flows
Wu, L., Wang, D., Gong, C., Liu, X., Xiong, Y., Ranjan, R., Krishnamoorthi, R., Chandra, V., & Liu, Q. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00911 · Cited by 49
“Among these works, denoising diffusion probabilistic models (DDPM) [11] demonstrate the power and flexibility to generate high-quality samples on large-scale image benchmarks and other domains [7, 12, 30, 32, 33, 44], which makes the diffusion model become a mainstream to learn the transport flow.”
Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priors
Yu, Z., Yin, Z., Zhou, D., Wang, D., Wong, F., & Wang, B. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00703 · Cited by 44
“The diffusion model [44, 15, 45], which is a likelihood-based model consisting of cascading denoising autoencoders, has recently shown great success in numerous generative tasks with different modalities including image [10, 35, 40, 41], audio [25], video [43], and motion [46].”
MethodHossain, M. Z., Zaman, F. U., & Islam, M. R. (2023) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit60459.2023.10440990 · Cited by 36
“Notable models like Dall-E [6] and Imagen [7] have pushed the boundaries of image quality, sparking debates about the impact of such technology.”
BackgroundA Multiscale Grouping Transformer With CLIP Latents for Remote Sensing Image Captioning
Meng, L., Wang, J., Meng, R., Yang, Y., & Xiao, L. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3385500 · Cited by 42
“Furthermore, to overcome the data scarcity issue, we leverage the CLIP image embedding, which is known for its impressive zero-shot capabilities and robustness to variations in image distribution [23].”
BackgroundHiDiffSeg: A hierarchical diffusion model for blood vessel segmentation in retinal fundus images
Huang, W., & Liu, F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124249 · Cited by 39
PortraitBooth: A Versatile Portrait Model for Fast Identity-Preserved Personalization
Xu, P., Zhu, J., Jiang, B., Tai, Y. Y., Luo, D., Zhang, J., Lin, W., Jin, T., Wang, C., & Ji, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02557 · Cited by 54
“Despite the capabilities of large-scale diffusion models such as Imagen [35], DALL·E2 [30], and Stable Diffusion [31] in text-to-image synthesis, they lack precise control over image generation solely through text guidance.”
MethodCollaborating Foundation Models for Domain Generalized Semantic Segmentation
Benigmim, Y., Roy, S., Essid, S., Kalogeiton, V. S., & Lathuilière, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00300 · Cited by 48
“…of contrastively trained image classification models (e.g., CLIP [56], ALIGN [30]), text-conditioned generative models (e.g., Stable Diffusion [59], DALL-E [57]), vision transformer-based segmentation model trained on mammoth dataset (e.g., Segment Anything Model (SAM) [35]), to name a few.”
BackgroundOptimizing Diffusion Noise Can Serve As Universal Motion Priors
Karunratanakul, K., Preechakul, K., Aksan, E., Beeler, T., Suwajanakorn, S., & Tang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00133 · Cited by 69
“The growing interest in the diffusion-based model stems from their superior results and impressive generation controllability, for example, in text-conditioned generation [57, 60, 63] and image-conditioned editing [3, 4, 9, 22, 47].”
BackgroundMethodA Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsampling
Qu, W., Shao, Y., Meng, L., Huang, X., & Xiao, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01964 · Cited by 48
“Thanks to the rich and structured data, the conditional networks for text or images can be replaced by powerful pre-trained models [34–36 , 41 ].”
BackgroundExploration of crystal chemical space using text-guided generative artificial intelligence
Park, H., Onwuli, A., & Walsh, A. (2025) · Nature Communications · doi:10.1038/s41467-025-59636-y · Cited by 59
“Demonstrations by various generative models of text to other modality, such as Imagen 25 and Dall-e 26 , which incorporate text encoders pre-trained through contrastive learning with image embedding vectors, have shown enhanced performance compared to models trained solely on textual data.”
On the design fundamentals of diffusion models: A survey
Chang, Z., Koulieris, G. A., Chang, H. J., & Shum, H. P. H. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111934 · Cited by 158
Wang, J., Watson, J. L., & Lisanza, S. L. (2024) · Cold Spring Harbor Perspectives in Biology · doi:10.1101/cshperspect.a041472 · Cited by 43
Diffusion-Based Visual Art Creation: A Survey and New Perspectives
Wang, B., Chen, Q., & Wang, Z. (2025) · ACM Computing Surveys · doi:10.1145/3728459 · Cited by 40
“From an artistic perspective, the first two categories characterize different art forms/genres with corresponding features.”
Creative Agents: Rethinking Agency and Creativity in Human and Artificial Systems
Moruzzi, C. (2022) · Journal of Aesthetics and Phenomenology · doi:10.1080/20539320.2022.2150470 · Cited by 34
“This reflection is particularly urgent given the rapid developments in AI technology, especially in the field of image generation, as exemplified by state-of-the-art image generation neural networks, such as DALL·E 2 by OpenAI, 58 or Imagen by Google Research 59 which can create original, realistic images and art from…”
BackgroundArtinter: AI-powered Boundary Objects for Commissioning Visual Arts
Chung, J. J. Y., & Adar, E. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3595961 · Cited by 33
“generation algorithms can generate high-quality images following text prompts [75, 78, 80] or even replicating styles and objects in given example images [26, 79].”
BackgroundMethodRGBD2: Generative Scene Synthesis via Incremental View Inpainting Using RGBD Diffusion Models
Lei, J., Tang, J., & Jia, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00814 · Cited by 42
Conditional Video Diffusion Network for Fine-Grained Temporal Sentence Grounding
Liu, D., Zhu, J., Fang, X., Xiong, Z., Wang, H., Li, R., & Zhou, P. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3334019 · Cited by 37
“Diffusion-based models have been successfully applied to multiple generation tasks, such as image generation [43], [50], [53], text-conditional image generation [54], [55], [56], [57], audio generation [58], [59], graph/shape generation [60], [61] and can produce smooth and manifold results.”
BackgroundPeng, Y., Lock, I., & Salah, A. A. (2023) · Communication Methods and Measures · doi:10.1080/19312458.2023.2277956 · Cited by 41
“Starting with the AlexNet model (Krizhevsky et al., 2017), which had 60 million parameters to detect a thousand object categories, the field has quickly arrived at a point where a short prompt of text could be turned into a plausible image of convincing appearance (Ramesh et al., 2022).”
MethodReference-guided Controllable Inpainting of Neural Radiance Fields
Mirzaei, A., Aumentado‐Armstrong, T., Brubaker, M. A., Kelly, J. W., Levinshtein, A., Derpanis, K. G., & Gilitschenski, I. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01633 · Cited by 38
“, [55, 50]), will render controllability increasingly important in future work.”
BackgroundAceto, G., Giampaolo, F., Guida, C., Izzo, S., Pescapè, A., Piccialli, F., & Prezioso, E. (2024) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2024.103926 · Cited by 37
Kim, H., & Yi, J.-S. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105615 · Cited by 40
OpenBias: Open-Set Bias Detection in Text-to-Image Generative Models
Moreno D’Incà, Peruzzo, E., Mancini, M., Xu, D., Goe, V., Xu, X., Wang, Z., Shi, H., & Sebe, N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01162 · Cited by 54
“Text-to-Image (T2I) generation has become increasingly popular, thanks to its intuitive conditioning and the high quality and fidelity of the generated content [39, 41, 43, 44, 46].”
Metadata
- Authors
- Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M.
- ORCID
- Chen, Mark
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2204.06125
- OpenAlex
- W4224035735
- Cited by
- 2,511
- References
- 66
- Citations by year
- 2026: 46 · 2025: 429 · 2024: 1113 · 2023: 859 · 2022: 63
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- text-to-image generation, diffusion models, image priors, image variation, photorealism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
