The DOI matches its DataCite record; 69 of the 69 references it cites were found in a registry or an index.
Hierarchical Text-Conditional Image Generation with CLIP Latents
Open accessAbstract
Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a CLIP image embedding given a text caption, and a decoder that generates an image conditioned on the image embedding. We show that explicitly generating image representations improves image diversity with minimal loss in photorealism and caption similarity. Our decoders conditioned on image representations can also produce variations of an image that preserve both its semantics and style, while varying the non-essential details absent from the image representation. Moreover, the joint embedding space of CLIP enables language-guided image manipulations in a zero-shot fashion. We use diffusion models for the decoder and experiment with both autoregressive and diffusion models for the prior, finding that the latter are computationally more efficient and produce higher-quality samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While more sophisticated methods for partially editing individual frames during training exist (e.g., text-to-image models [13], [14]), they are slow, computationally expensive and error-prone.”
From Language-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredIn the citing paper
“Generative machines, such as text-to-image algorithms, are contributing to the variety of cultural traits.”
From Machine culture (2023) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“To this end, we generated 512 “artistic” captions using GPT-3 [4] by prompting it with captions for existing artwork (both real and AI generated).”
MethodSelf-citationHigh-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302 · cited 2×
“[42] use diffusion models on the latents obtained from a VQGAN [14] like autoencoder.”
BackgroundMethodLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 3×
“Recent progress in computer vision has been driven by scaling models on large datasets of captioned images collected from the internet [10, 44, 60, 39, 31, 16].”
BackgroundMethodSelf-citationLIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 12,864 · cited 4×
“After applying PCA, we order the principal components by decreasing eigenvalue magnitude, quantize each of the 319 dimensions into 1,024 discrete buckets, and predict the resulting sequence using a decoder-only Transformer [53] model with a causal attention mask.”
MethodInfluentialDecoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Research works printed but not linked: 2
- [23][23] Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Advances in Neural Information Processing Systems 30 (NIPS 2017), 2017.
- [32][32] Ryan Murdock. The Big Sleep. https://twitter.com/advadnoun/status/ 1351038053033406468, 2021. 20 https://openreview.net/forum?id=qw674L9PfQE https://openreview.net/forum?id=qw674L9PfQE https://arxiv.org/abs/2203.13131 https://arxiv.org/abs/2108.00946 https://arxiv.org/abs/2102.01645 https://arxiv.org/abs/1406.2661 https://arxiv.org/abs/2111.14822 https://openreview.net/forum?id=qw8AKxfYbI https://openreview.net/forum?id=qw8AKxfYbI https://arxiv.org/abs/2006.11239 https://arxiv.org/abs/2106.15282 https://arxiv.org/abs/1412.6980 https://arxiv.org/abs/1405.0312 https://arxiv.org/abs/1711.05101 https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://arxiv.org/abs/2112.12750 https://twitter.com/advadnoun/status/1351038053033406468 https://twitter.com/advadnoun/status/1351038053033406468 · arXiv
Cited by
Sorted by citations
Items 901–1,000 of 1,051
Partiality and Misconception: Investigating Cultural Representativeness in Text-to-Image Models
Zhang, L., Liao, X., Yang, Z., Gao, B., Wang, C., Yang, Q., & Li, D. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642877 · Cited by 34
DSDRec: Next POI recommendation using deep semantic extraction and diffusion model
Wang, Z., Zeng, J., Zhong, L., Liu, L., Gao, M., & Wen, J. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121004 · Cited by 22
Hintersdorf, D., Struppek, L., Brack, M., Friedrich, F., Schramowski, P., & Kersting, K. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15461 · Cited by 27
“Models like CLIP, for example, are used in many downstream tasks such as Stable Diffusion (Rombach et al., 2022) or DALL-E 2 (Ramesh et al., 2022).”
MethodWu, Z., Zhou, P., Yi, X., Yuan, X., & Zhang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00944 · Cited by 42
“This recent success has seamlessly transcended into the domain of text-to-3D generation by leveraging the pre-trained 2D diffusion models [33, 34] to guide the 3D generation process, regardless of the absence of large-scale 3D generative models [3, 45].”
G-HOP: Generative Hand-Object Prior for Interaction Reconstruction and Grasp Synthesis
Ye, Y., Gupta, A., Kitani, K., & Tulsiani, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00187 · Cited by 34
“Diffusion models [20] are a family of generative models and have driven great progress in multiple domains like image generation [39, 40], 3D object generation [23, 28, 36], novel-view synthesis [29, 34], human motion [25, 46], video generation [43], etc .”
Face2Diffusion for Fast and Editable Face Personalization
Shiohara, K., & Yamasaki, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00654 · Cited by 24
“Text-to-image (T2I) diffusion models [30, 35, 36, 40] are a kind of generative models based on diffusion models [17, 44, 45] that generate images by gradual denoising steps in the image space [30, 35, 40] or latent one [36].”
Cao, C., Cai, Y., Dong, Q., Wang, Y., & Fu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00736 · Cited by 20
“If we regard the large Text-to-Image (T2I) models [6, 37, 41, 44, 46, 48] as skillful painters, could they also follow such simple and intuitive task formulation to handle complex reference-guided synthesis tasks?”
BackgroundNew Automation for Social Bots: From Trivial Behavior to AI-Powered Communication
Grimme, C., Pohl, J., Cresci, S., Lüling, R., & Preuss, M. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-18253-2_6 · Cited by 19
Human in the AI Loop via xAI and Active Learning for Visual Inspection
Rožanec, J. M., Montini, E., Cutrona, V., Papamartzivanos, D., Klemenčič, T., Fortuna, B., Mladenić, D., Veliou, E., Giannetsos, T., & Emmanouilidis, C. (2024) · Artificial Intelligence in Manufacturing · doi:10.1007/978-3-031-46452-2_22 · Cited by 17
Unified modeling of 3D molecular generation via atomic interactions with PocketXMol
Peng, X., Guo, R., Guo, F., Wang, Z., Sun, J., Guan, J., Jia, Y., Xu, Y., Huang, Y., Zhang, M., et al. (2026) · Cell · doi:10.1016/j.cell.2026.01.003 · Cited by 22
Gao, Y., Dong, K., Gao, Y., Jin, X., Yang, J., Yan, G. F., & Liu, Q. (2024) · Cell Genomics · doi:10.1016/j.xgen.2024.100553 · Cited by 19
CosmicMan: A Text-to-Image Foundation Model for Humans
Li, S., Fu, J., Liu, K., Wang, W., Lin, K.-Y., & Wu, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00664 · Cited by 26
“Its successors [1, 41] enhance performance through model design and improved captions.”
Fine-Grained Visual Text Prompting
Yang, L., Li, X., Wang, Y., Wang, X., & Yang, J. J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3504568 · Cited by 17
Mind the modality gap: Towards a remote sensing vision-language model via cross-modal alignment
Zavras, A., Michail, D., Demir, B., & Papoutsis, I. (2025) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2025.06.019 · Cited by 30
Ren, C., Lee, S.-J., & Hu, C. (2023) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2023.100007 · Cited by 19
EKILA: Synthetic Media Provenance and Attribution for Generative Art
Balan, K., Agarwal, S., Jenni, S., Parsons, A., Gilbert, A., & Collomosse, J. P. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00098 · Cited by 22
“GenAI models [36, 37, 42] are typically trained on millions of images.”
BackgroundMethodText2Scene: Text-driven Indoor Scene Stylization with Part-Aware Details
Hwang, I., Kim, H., & Kim, Y. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00188 · Cited by 18
“CLIP [42] learns latent space with a large amount of image text pairs, and the additional text input allows semantic manipulation for various generative tasks, including images [8,38,43–45], videos [3,17], motions [49,50], and 3D assets [18,21,39,46].”
BackgroundDual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning
Jiang, C., Liu, H., Yu, X., Wang, Q., Cheng, Y., Xu, J., Liu, Z., Guo, Q., Chu, W., Yang, M., et al. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612006 · Cited by 17
“With the success in many downstream tasks [37, 38, 41, 46, 56], CLIP [39] has injected new impetus into the improvement of text-video retrieval and quickly becomes one of the mainstream backbones [6, 9, 13, 14, 35, 36, 47].”
BackgroundBoosting GUI Prototyping with Diffusion Models
Wei, J., Courbis, A.-L., Lambolais, T., Xu, B., Bernard, P. L., & Dray, G. (2023) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re57278.2023.00035 · Cited by 27
“Recently, deep learning-based text-to-image models have emerged as a promising approach to generate highly detailed and structured images based on text descriptions [20–23].”
BackgroundA Cheaper and Better Diffusion Language Model with Soft-Masked Noise
Chen, J., Zhang, A., Li, M., Smola, A. J., & Yang, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.289 · Cited by 28
Controllable Inversion of Black-Box Face Recognition Models via Diffusion
Kansy, M., Raël, A., Mignone, G., Naruniec, J., Schroers, C., Groß, M. H., & Weber, R. M. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00341 · Cited by 20
“[51], we adapt classifier-free guidance [24] by setting the ID vector to the 0 -vector with 10% probability during training (unconditional setting).”
MethodResultDiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusion
Rommel, C., Junior, E. A. D. V., Chen, M., Khalfaoui, S., Marlet, R., Cord, M., & Pérez, P. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00346 · Cited by 17
“…models (DDPM) [9] emerged as the new state-of-the-art generative models [40], leading to impressive results in a broad range of applications such as text-to-image generation [23, 28, 31, 27], inpainting [19, 30], audio synthesis [16], time-series imputation [36] and computational chemistry [10].”
BackgroundSelf-citationPerceptual Artifacts Localization for Image Synthesis Tasks
Zhang, L., Xu, Z., Barnes, C., Zhou, Y., Liu, Q., Zhang, H., Amirghodsi, S., Lin, Z., Shechtman, E., & Shi, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00697 · Cited by 27
“However, it’s observed that leading diffusion inpainting models, like DALL-E [40] and Stable Diffusion [42], sometimes falter in generating high-fidelity object details, such as facial features.”
BackgroundMethodInfluentialGuiding image captioning models toward more specific captions
Kornblith, S., Li, L., Wang, Z.-R., & Nguyen, T. N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01400 · Cited by 19
“CFG is widely used in diffusion-based and autoregressive text-to-image models [26, 32, 35, 33, 12, 48].”
MethodToo Large; Data Reduction for Vision-Language Pre-Training
Wang, A. J., Lin, K. Q., Zhang, D. J., Lei, S. W., & Shou, M. Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00292 · Cited by 28
“To this end, we randomly sample 0.3M subset of CC3M and generate image from text with three popular text to image generation models, VQ-GAN [56], DALLE 2 [35] and Stable Diffusion [37].”
MethodInfluentialImproving CLIP Fine-tuning Performance
Wei, Y., Hu, H., Xie, Z., Liu, Z., Zhang, Z., Cao, Y., Bao, J., Chen, D., & Guo, B. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00501 · Cited by 20
“2) The contrastive language-image pre-training (CLIP) task is to connect paired images and texts and separate unpaired ones, which opens up the field of zero-shot recognition [42, 23], and proves to be powerful in multi-modality down-stream tasks [47, 40, 44].”
BackgroundDiffusion Model-Based Multiobjective Optimization for Gasoline Blending Scheduling
Fang, W., Du, W., He, R., Tang, Y. S., Jin, Y., & Yen, G. G. (2024) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2024.3363980 · Cited by 22
“Following the successful utilization of the diffusion model in image synthesis by DALLE-2 [11], it has quickly surpassed generative adversarial networks (GANs) [12] and became the most powerful deep generative model, exhibiting remarkable performance across multiple applications such as image…”
MethodInfluentialConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraints
Richardson, E., Goldberg, K., Alaluf, Y., & Cohen‐Or, D. (2024) · ACM Transactions on Graphics · doi:10.1145/3659578 · Cited by 33
“” “ A photo of <new-pet> on the beach ” Input Images”
BackgroundMethodInfluentialMulti-Condition Latent Diffusion Network for Scene-Aware Neural Human Motion Prediction
Gao, X., Yang, Y., Wu, Y., Du, S., & Qi, G.-J. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3414935 · Cited by 17
“…diffusion-based prediction sys-tem for inferring indoor 3D human motions still remains under-explored and confronts various challenges, such as joint inference based on motion-scene multi-condition contexts, robustness against scene condition redundancy, and body-scene interaction embedding.”
BackgroundGotcha: Real-Time Video Deepfake Detection via Challenge-Response
Mittal, G., Hegde, C., & Memon, N. D. (2024) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp60621.2024.00009 · Cited by 26
“Although, this work explores Auto-Encoder-based generative models, but we acknowledge the innovations in synthetic media generation, especially based on NERFs [18], and Diffusion Models [19] coupled with CLIP [20].”
MethodUDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusion
Zhou, J., Zhang, W., Ma, B., Shi, K., Liu, Y.-S., & Han, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02031 · Cited by 17
“signed distance fields (UDFs) which is capable to generate textured 3D shapes with open surfaces from text conditions or unconditionally.”
BackgroundDiffSal: Joint Audio and Video Learning for Diffusion Saliency Prediction
Xiong, J., Zhang, P., You, T., Li, C., Huang, W., & Zha, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02575 · Cited by 21
“…re-sults and strong generalization capabilities, diffusion models have achieved an impressive performance in generative tasks, such as image generation [3, 6, 7, 12, 16], image-to-image translation [32, 44, 52, 56, 63], video generation [23, 27, 60], text-to-image synthesis [20, 42, 62], and etc .”
Robust Noisy Correspondence Learning with Equivariant Similarity Consistency
Yang, Y., Wang, L., Yang, E., & Deng, C. D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01676 · Cited by 21
“Cross-modal learning aims to extract and understand meaningful correspondences between data from different modalities, which contains various downstream tasks, such as audio-visual recognition [1, 2], multi-modal fusion [23, 27], and cross-modal generation [31, 32, 34, 52].”
CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Models
Meral, T. H. S., Simsar, E., Tombari, F., & Yanardag, P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00860 · Cited by 35
“However, with the advent of diffusion-based image generation models [15, 26, 38], and their evolution into large-scale text-to-image models [4, 33, 37], they became the state-of-the-art for the text-to-image generation.”
BackgroundTailored Visions: Enhancing Text-to-Image Generation with Personalized Prompt Rewriting
Chen, Z., Zhang, L., Weng, F., Pan, L., & Lan, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00738 · Cited by 27
“DALL-E2 [18] introduces latent diffusion models to generate various images by conditioning on CLIP text latents and CLIP image embeddings generated by a prior model.”
BackgroundComputer Vision Models for Image Analysis in Advertising Research
Li, H., & Zhang, N. (2024) · Journal of Advertising · doi:10.1080/00913367.2024.2407644 · Cited by 17
Distributional Semantics: Meaning Through Culture and Interaction
Contreras Kallens, P., & Christiansen, M. H. (2025) · Topics in Cognitive Science · doi:10.1111/tops.12771 · Cited by 17
“Future work could explore how similar the linkages in these models representations of meaning are to the ones assumed to underlie human language use.”
Yu, X., Elazab, A., Ge, R., Zhu, J., Zhang, L., Jia, G., Wu, Q., Wan, X., Li, L., & Wang, C. (2025) · Neural Networks · doi:10.1016/j.neunet.2024.107096 · Cited by 18
Imasato, N., Miyazawa, K., Duncan, C., & Nagai, T. (2023) · IEEE Access · doi:10.1109/access.2023.3280603 · Cited by 21
GECCO: Geometrically-Conditioned Point Diffusion Models
Tyszkiewicz, M. J., Fua, P., & Trulls, E. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00203 · Cited by 24
“They have shown great success synthesizing images from text [51, 53, 54], speech [7, 29, 43, 8], 3D objects [18, 42], and recently point clouds [38, 71, 68].”
BackgroundGender Bias in Natural Language Processing and Computer Vision: A Comparative Survey
Bartl, M., Mandal, A., Leavy, S., & Little, S. (2024) · ACM Computing Surveys · doi:10.1145/3700438 · Cited by 23
“The connection between the domains of language and vision within AI has grown due to automatic labelling of images, multimodal visual-linguistic models such as VL-BERT [123], as well as generative models such as Dall-E [98] that take text as input to generate images.”
Engression: extrapolation through the lens of distributional regression
Shen, X., & Meinshausen, N. (2024) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1093/jrsssb/qkae108 · Cited by 48
Dense Feature Interaction Network for Image Inpainting Localization
Yao, Y., Han, T., Jia, S., & Lyu, S. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3531103 · Cited by 18
“The emergence of diffusion-based image generation models, such as DALL · E 2 [43] and Stable Diffusion [44] further significantly improved the performance of image inpainting [45– 48].”
An explainable AI approach for diagnosis of COVID-19 using MALDI-ToF mass spectrometry
Seethi, V. D. R., LaCasse, Z., Chivte, P., Bland, J., Kadkol, S. S., Gaillard, E. R., Bharti, P., & Alhoori, H. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121226 · Cited by 19
“Images for gargle sample adapted with (Ramesh et al., 2022) and MALDI-ToF image”
MethodArbitrary Style Guidance for Enhanced Diffusion-Based Text-to-Image Generation
Pan, Z., Zhou, X., & Tian, H. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00444 · Cited by 19
“[40] proposed to use pretrained CLIP image embedding as input for the conditional image generation model.”
BackgroundMethodWe are the Data: Challenges and Opportunities for Creating Demographically Diverse Anthropographics
Dhawka, P., He, H. A., & Willett, W. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581086 · Cited by 17
“In particular, AI image-synthesis platforms such as DALL-E 2 [44], AI-augmented illustration tools [19], and text-to-image synthesis tools [20] are likely to lower barriers for creating large numbers of unique human images that can be used to represent individuals.”
BackgroundShajek, A., & Hartmann, E. (2023) · Springer eBooks · doi:10.1007/978-3-031-26490-0 · Cited by 20
Iterative α -(de)Blending: a Minimalist Deterministic Diffusion Model
Heitz, E., Belcour, L., & Chambon, T. (2023) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3588432.3591540 · Cited by 33
“Diffusion models have recently become one of the most popular generative modeling tools [Ramesh et al. 2022].”
MethodCan Artificial Intelligence Reconstruct Ancient Mosaics?
Andrés, F. M., Merino-Gómez, E., Reviriego, P., et al. (2023) · Studies in Conservation · doi:10.1080/00393630.2023.2227798 · Cited by 16
“The most famous generator is DALL-E from OpenAI [13],[14] that has been, for example, used recently to create the font cover of a well-known magazine3.”
MethodInfluentialSVGformer: Representation Learning for Continuous Vector Graphics using Transformers
Cao, D., Wang, Z., Echevarria, J., & Liu, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00973 · Cited by 18
“Inspired by diffusion models [13,24,27,28], one possible insight for future work can be smooth the latent space by introducing the diffusion process.”
MethodBlended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields
Gordon, O., Avrahami, O., & Lischinski, D. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00316 · Cited by 27
“In contrast to local edits in images, e.g ., [3, 2, 6, 42, 51, 23, 8], where the edit is done in pixel space with all the required information appearing in a single view, editing a NeRF-represented scene is more challenging due to the requirement for consistency across multiple views be-tween the…”
BackgroundMethodStatistically Conditioned Polycrystal Generation Using Denoising Diffusion Models
Buzzy, M. O., Robertson, A. E., & Kalidindi, S. R. (2023) · Acta Materialia · doi:10.1016/j.actamat.2024.119746 · Cited by 21
Controllable 3D Face Generation with Conditional Style Code Diffusion
Shen, X., Ma, J., Zhou, C., & Yang, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28283 · Cited by 18
StyleGAN-Fusion: Diffusion Guided Domain Adaptation of Image Generators
Song, K., Han, L., Liu, B., Metaxas, D., & Elgammal, A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00537 · Cited by 54
“Diffusion models have witnessed a remarkable rise in image-generation tasks with their ability to cover a wide range of visual semantics from different image domains [5, 11, 14, 16, 37, 45, 46, 48, 51, 58].”
BackgroundTime to Shine: Fine-Tuning Object Detection Models with Synthetic Adverse Weather Images
Rothmeier, T., Huber, W., & Knoll, A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00439 · Cited by 24
“Among these techniques, text-to-image models have emerged as powerful tools for generating high-quality images based on textual descriptions [31].”
BackgroundMethodPersonalized Face Inpainting with Diffusion Models by Parallel Visual Attention
Xu, J., Motamed, S., Vaddamanu, P., Wu, C., Häne, C., Bazin, J., & la Torre, F. D. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00535 · Cited by 21
“Among these tasks, text-to-image generation [34,41] aims at generating faithful images based on a text prompt.”
BackgroundGenerative vs. Non-Generative AI: Analyzing the Effects of AI on the Architectural Design Process
Salem, A., Mansour, Y., & Eldaly, H. (2024) · Engineering Research Journal · doi:10.21608/erjsh.2024.255372.1256 · Cited by 18
“The model showcases the adaptability of large language models for image generation, demonstrating its proficiency in translating textual descriptions into visually compelling content [24].”
BackgroundOn Exact Inversion of DPM-Solvers
Hong, S., Lee, K., Jeon, S. Y., Bae, H., & Chun, S. Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00675 · Cited by 26
“Now, DPMs are widely applicable across various domains and applications such as image generation [8, 26, 31, 32], conditional image synthesis [7, 24, 26, 26, 27] and solving inverse problems [13, 16, 30].”
SD-DiT: Unleashing the Power of Self-Supervised Discrimination in Diffusion Transformer *
Zhu, R., Pan, Y., Li, Y., Yao, T., Sun, Z., Mei, T., & Chen, C. W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00806 · Cited by 27
“Such practical generative model pushes the limits of a series of CV applications, including text-to-image synthesis [2, 53, 54, 57], MaskDiT.”
BackgroundDeepJEB: 3D Deep Learning-Based Synthetic Jet Engine Bracket Dataset
Hong, S.-J., Kwon, Y., Shin, D., Park, J., & Kang, N. (2024) · Journal of Mechanical Design · doi:10.1115/1.4067089 · Cited by 16
Language-Guided Face Animation by Recurrent StyleGAN-Based Generator
Hang, T., Yang, H., Liu, B., Fu, J., Geng, X., & Guo, B. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3248143 · Cited by 15
“Diffusion models have demonstrated strong power on content creation [5], [24], [25].”
BackgroundA Survey of Reasoning with Foundation ModelsPreprint
Sun, J., Zheng, C., Xie, E., Liu, Z., Chu, R., Liu, J., Xu, J., Ding, M., Li, H., Geng, M., et al. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ac4sp · Cited by 143
Rawte, V., Priya, P., Tonmoy, S. M. T. I., Zaman, S. M. M., Sheth, A., & Das, A. (2023) · arXiv · doi:10.48550/arxiv.2309.11064 · Cited by 16
Robosourcing Educational Resources -- Leveraging Large Language Models for Learnersourcing
Denny, P., Sarsa, S., Hellas, A., & Leinonen, J. (2022) · arXiv · doi:10.48550/arxiv.2211.04715 · Cited by 21
TSGDiff: Traffic state generative diffusion model using multi-source information fusion
Zhang, H., Dong, H., & Yang, Z. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105081 · Cited by 23
FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Models
Li, Y., Liu, X., Wang, X., Lee, B., Wang, S., Rocha, A. D. R., & Lin, W. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3597211 · Cited by 59
“…the generation models included in the FakeBench span ten different types, including two generative adversarial networks (GAN) based models [80], [81], one auto-regressive model [82], four stable di ff usion (SD) based models [84], [85], [86], [87], and three proprietary models [1], [2], [92].”
Imaginary Voice: Face-Styled Diffusion Model for Text-to-Speech
Lee, J.-Y., Chung, J. S., & Chung, S.-W. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094745 · Cited by 20
“Recently, another successful generative approach, diffusion-based methods [11, 12, 13, 9], have been proposed in speech synthesis, as the diffusion methods have proved their effectiveness in various generation tasks [21, 8, 7].”
BackgroundMethodEnvisioning the future of virtual production in filmmaking: A remote co-design study
Bodini, A., Manohar, A. K., Colecchia, F., Harrison, D. J., & Garaj, V. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16308-7 · Cited by 16
“AI Algorithm such as DALL-E [33], its iteration DALL-E 2 [32], and Imagen [35], which have attracted attention in recent years as potentially disruptive in the media industry [30], were a topic of discussion in addition to immersive technologies.”
RePaint-NeRF: NeRF Editting via Semantic Masks and Diffusion Models
Zhou, X., He, Y., Yu, F. R., Li, J., & Li, Y. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/201 · Cited by 23
Unite and Conquer: Plug & Play Multi-Modal Synthesis Using Diffusion Models
Nair, N. G., Bandara, W. G. C., & Patel, V. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00588 · Cited by 19
“E-2 [26], Imagen [29] and multiple other works that can create photorealistic images using text prompts.”
BackgroundThe Five-Dollar Model: Generating Game Maps and Sprites from Sentence Embeddings
Merino, T., Negri, R., Rajesh, D., Charity, M., & Togelius, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v19i1.27506 · Cited by 15
Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
Cross-Zamirski, J., Anand, P., Williams, G. B., Mouchet, E., Wang, Y., & Schönlieb, C. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00411 · Cited by 22
“While many other diffusion models exist which incorporate natural language text encoders such as CLIP [32] (text-to-image) [33, 35], there has been much less attention on advancing models with both paired image and class label information.”
BackgroundOptimizing Prompts Using In-Context Few-Shot Learning for Text-to-Image Generative Models
Lee, S., Lee, J., Bae, C. H., Choi, M.-S., Lee, R., & Ahn, S. (2024) · IEEE Access · doi:10.1109/access.2023.3348778 · Cited by 16
“The quality of synthesized images from text-to-image generative models has significantly improved, and such models can now produce high-quality images comparable to those created by human painters [7], [8].”
BackgroundDiffMat: Latent diffusion models for image-guided material generation
Yuan, L., Yan, D., Saito, S., & Fujishiro, I. (2024) · Visual Informatics · doi:10.1016/j.visinf.2023.12.001 · Cited by 17
Identification of Systematic Errors of Image Classifiers on Rare Subgroups
Metzen, J., Hutmacher, R., Hua, N. G., Boreiko, V., & Zhang, D. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.00467 · Cited by 24
“The most similar line of work to ours is built on top of text-to-image synthesis models [42, 43, 45, 9].”
BackgroundEfficient-VQGAN: Towards High-Resolution Image Generation with Efficient Vision Transformers
Cao, S., Yin, Y., Huang, L., Liu, Y., Zhao, X., Zhao, D., & Huang, K. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00677 · Cited by 22
“As diffusion models continue to evolve, recent studies [31, 34] have begun to explore the utilization of cascaded diffusion models for generating high-resolution images.”
BackgroundDLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer
Levi, E., Brosh, E., Mykhailych, M., & Perez, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00201 · Cited by 19
“For the reverse diffusion process, we follow [29, 35], and train a model F cθ (¯ x t , c, ¯ y t ) to directly predict ¯ x 0 from the noise, where ¯ y t carries the class information in the diffusion process, as described in the next paragraph.”
BackgroundMethodEngaging the many-hands problem of generative-AI outputs: a framework for attributing credit
Khosrowi, D., Finn, F., & Clark, E. (2024) · AI and Ethics · doi:10.1007/s43681-024-00440-7 · Cited by 17
“6 To do so, we first focus on generative visual AI systems for image creation, such as OpenAI’s DALL-E2, Stability.ai’s Stable Diffusion, Mid-journey and related systems [63, 65], which allow users to steer image synthesis through a combination of text and image prompts for conditioning.”
Liu, J., & Liu, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28155 · Cited by 15
“Compositional Image Generation Diffusion models have achieved remarkable performance in this task by modeling the image generation process as a reverse diffusion process (Ruiz et al. 2023) (Saharia et al. 2022) (Nichol and Dhariwal 2021) (Ramesh et al. 2022).”
BackgroundSSMG: Spatial-Semantic Map Guided Diffusion Model for Free-Form Layout-to-Image Generation
Jia, C., Luo, M., Dang, Z., Dai, G., Chang, X., Wang, M., & Wang, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i3.28024 · Cited by 23
Iterative Multi-granular Image Editing using Diffusion Models
Joseph, K. J., Udhayanan, P., Shukla, T., Agarwal, A., Karanam, S., Goswami, K., & Srinivasan, B. V. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00792 · Cited by 25
“These models has been found to be extremely successful in synthesizing realistic images [4, 20, 23] when x i ∈ R W × H × 3 .”
MethodSemantic regularization of electromagnetic inverse problems
Zhang, H., Chen, Y., Wang, Z., Cui, T. J., del Hougne, P., & Li, L. (2024) · Nature Communications · doi:10.1038/s41467-024-48115-5 · Cited by 20
A Two-Stage Personalized Virtual Try-On Framework With Shape Control and Texture Guidance
Zhang, S., Ni, M., Chen, S., Wang, L., Ding, W., & Liu, Y. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3405718 · Cited by 16
“Each step be described as: where ε t − 1 represents the noise, α t = 1 − β t , β t is the hyper-parameter of the diffusion model, x t − 1 represents the last step image, x t represents the current image.”
BackgroundCustomize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training
He, R., Huang, S., Nie, X., Hui, T., Liu, L., Dai, J., Han, J., Li, G., & Liu, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00665 · Cited by 23
“Among these methods, diffusion model based methods, such as Stable Diffusion [35] and DALL·E 2 [32], have shown remarkable image generation ability as a result of training on massive text-image datasets.”
MethodGenerative Unlearning for Any Identity
Seo, J., Lee, S.-H., Lee, T., Moon, S., & Park, G.-M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00874 · Cited by 17
“In image synthesis field, GAN-based generative models have achieved remarkable performance not only in 2D [18–21, 32, 33, 36, 37] but also in 3D [4, 42, 48, 56, 57] domain.”
MethodChen, Y., Chen, D., Liu, R., Zhou, S., Xue, W., & Peng, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01768 · Cited by 16
“The success of VLP models inspires the “fine-tuning” trend on multiple downstream tasks, such as open-vocabulary detection [21], segmentation [18, 67, 70], caption [41], summarization [42], generation [50], etc.”
CoDi: Conditional Diffusion Distillation for Higher-Fidelity and Faster Image Generation
Mei, K., Delbracio, M., Talebi, H., Tu, Z., Patel, V. M., & Milanfar, P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00864 · Cited by 24
“(c) Our 1-step InstructPix2Pix Text-to-image diffusion models [29, 32, 37] trained on large-scale data [15, 41] have significantly dominated generative tasks by delivering impressive high-quality and diverse results.”
BackgroundFaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio
Xu, C., Liu, Y., Xing, J., Wang, W., Sun, M., Dan, J., Huang, T., Li, S., Cheng, Z.-Q., Tai, Y. Y., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00129 · Cited by 20
“Recently, text-to-image generations [13, 19, 26, 44, 45] have gain significant attentions.”
Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Model
He, X., Huang, Q., Zhang, Z., Lin, Z., Wu, Z., Yang, S., Li, M., Chen, Z., Xu, S., & Wu, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00220 · Cited by 26
“Per [28], our diffusion model predicts the clean motion feature sequence ˆ x 0 from noised x t given noising step t and conditions c = { a , x (0)0 } , where a denotes the audio feature, and x (0)0 ∈ R C is the source motion feature extracted from the source image S , i.e . the first video frame.”
MethodText-Guided 3D Face Synthesis - From Generation to Editing
Wu, Y., Meng, Y., Hu, Z., Li, L., Wu, H., Zhou, K., Xu, W., & Yu, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00126 · Cited by 16
“Recent advancements in visual-language models [32] and diffusion models [8, 13, 42] have greatly improved text-to-image generation [3, 33, 34, 37].”
BackgroundHaji-Ali, M., Balakrishnan, G., & Ordóñez, V. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00631 · Cited by 25
“Diffusion Models have been widely adopted for their high-quality outputs in generative tasks [8, 11, 15, 20, 22, 35, 37, 39, 43, 55, 58].”
BackgroundText-Guided Explorable Image Super-Resolution
Gandikota, K. V., & Chandramouli, P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02447 · Cited by 20
“Recent developments in image generation [18, 21, 57], contrastive learning[7] and large-scale training on massive internet-scale datasets of paired text prompts and images [70, 71] accelerated research in vision-language learning [30, 58, 61, 63, 64, 68].”
BackgroundMethodResultInfluentialKolmogorov–Arnold Network Made Learning Physics Laws Simple
Wu, Y., Su, T., Du, B., Hu, S., Xiong, J., & Pan, D. (2024) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.4c02589 · Cited by 15
Brain-Conditional Multimodal Synthesis: A Survey and Taxonomy
Mai, W., Zhang, J., Fang, P., & Zhang, Z. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3516698 · Cited by 26
“EEG Electrodes, which are located in brain regions with the same color in Fig.2, are placed following the international 10-10 channel system.”
More than anything: Advocating for synthetic architectures within large-scale language-image models
Koehler, D. (2023) · International Journal of Architectural Computing · doi:10.1177/14780771231170455 · Cited by 16
“The current labeling algorithm, CLIP, for Contrastive Language-Image Pre-training, 18,19 not only label images with their content but also with contrasting, absent features.”
MethodZeroFake: Zero-Shot Detection of Fake Images Generated and Edited by Text-to-Image Generation Models
Sha, Z., Tan, Y., Li, M., Michael Backes, A., & Zhang, Y. (2024) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3658644.3690297 · Cited by 19
MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN
Chen, R., Ding, Z., Zheng, S., Zhang, C., Leng, J., Liu, X., & Liang, Y. E. (2024) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3620666.3651330 · Cited by 16
“First, there are numerous tensors with long lifetimes , such as model parameters [7, 12, 15, 40, 51], activations during the training’s forward pass [5, 10, 38, 42], and intermediate tensors in complex networks [44, 73, 75].”
BackgroundKaragianni, A., & Doh, M. (2024) · Porn Studies · doi:10.1080/23268743.2024.2408277 · Cited by 21
Artistic User Expressions in AI-powered Creativity Support Tools
Chung, J. J. Y. (2022) · Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3526114.3558531 · Cited by 14
“Recent natural language prompt-based input approaches [1, 6] would allow users to express intentions roughly, but they also have limitations that the user might disagree with the tool on how they use verbal concepts.”
BackgroundStanding on the Shoulders of AI Giants
Lin, H.-Y. (2023) · Computer · doi:10.1109/mc.2022.3218176 · Cited by 16
Metadata
- Authors
- Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M.
- ORCID
- Chen, Mark
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2204.06125
- OpenAlex
- W4224035735
- Cited by
- 2,511
- References
- 66
- Citations by year
- 2026: 46 · 2025: 429 · 2024: 1113 · 2023: 859 · 2022: 63
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- text-to-image generation, diffusion models, image priors, image variation, photorealism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
