The DOI matches its DataCite record; 69 of the 69 references it cites were found in a registry or an index.
Hierarchical Text-Conditional Image Generation with CLIP Latents
Open accessAbstract
Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a CLIP image embedding given a text caption, and a decoder that generates an image conditioned on the image embedding. We show that explicitly generating image representations improves image diversity with minimal loss in photorealism and caption similarity. Our decoders conditioned on image representations can also produce variations of an image that preserve both its semantics and style, while varying the non-essential details absent from the image representation. Moreover, the joint embedding space of CLIP enables language-guided image manipulations in a zero-shot fashion. We use diffusion models for the decoder and experiment with both autoregressive and diffusion models for the prior, finding that the latter are computationally more efficient and produce higher-quality samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While more sophisticated methods for partially editing individual frames during training exist (e.g., text-to-image models [13], [14]), they are slow, computationally expensive and error-prone.”
From Language-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredIn the citing paper
“Generative machines, such as text-to-image algorithms, are contributing to the variety of cultural traits.”
From Machine culture (2023) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“To this end, we generated 512 “artistic” captions using GPT-3 [4] by prompting it with captions for existing artwork (both real and AI generated).”
MethodSelf-citationHigh-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302 · cited 2×
“[42] use diffusion models on the latents obtained from a VQGAN [14] like autoencoder.”
BackgroundMethodLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 3×
“Recent progress in computer vision has been driven by scaling models on large datasets of captioned images collected from the internet [10, 44, 60, 39, 31, 16].”
BackgroundMethodSelf-citationLIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 12,864 · cited 4×
“After applying PCA, we order the principal components by decreasing eigenvalue magnitude, quantize each of the 319 dimensions into 1,024 discrete buckets, and predict the resulting sequence using a decoder-only Transformer [53] model with a causal attention mask.”
MethodInfluentialDecoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Research works printed but not linked: 2
- [23][23] Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Advances in Neural Information Processing Systems 30 (NIPS 2017), 2017.
- [32][32] Ryan Murdock. The Big Sleep. https://twitter.com/advadnoun/status/ 1351038053033406468, 2021. 20 https://openreview.net/forum?id=qw674L9PfQE https://openreview.net/forum?id=qw674L9PfQE https://arxiv.org/abs/2203.13131 https://arxiv.org/abs/2108.00946 https://arxiv.org/abs/2102.01645 https://arxiv.org/abs/1406.2661 https://arxiv.org/abs/2111.14822 https://openreview.net/forum?id=qw8AKxfYbI https://openreview.net/forum?id=qw8AKxfYbI https://arxiv.org/abs/2006.11239 https://arxiv.org/abs/2106.15282 https://arxiv.org/abs/1412.6980 https://arxiv.org/abs/1405.0312 https://arxiv.org/abs/1711.05101 https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://arxiv.org/abs/2112.12750 https://twitter.com/advadnoun/status/1351038053033406468 https://twitter.com/advadnoun/status/1351038053033406468 · arXiv
Cited by
Sorted by citations
Items 801–900 of 1,051
Liu, Y., Fan, C., Dai, Y., Chen, X., Zhou, P., & Sun, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02286 · Cited by 43
“Among the approaches proposed to achieve this goal [38, 46], DreamBooth [44] and Text Inversion [13] are two prominent training-based methods that offer impressive personalize generation ability.”
MethodImage Sculpting: Precise Object Editing with 3D Geometry Control
Yenphraphai, J., Pan, X., Liu, S., Panozzo, D., & Xie, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00406 · Cited by 33
“Recent developments in the field of image generative modeling [63, 66, 68, 89] have unlocked new potentials in creative content creation, offering unprecedented opportunities for the generation of diverse visual content by mate-rializing ideas and concepts articulated through language prompts.”
A Recipe for Scaling up Text-to-Video Generation with Text-free Videos
Wang, X., Zhang, S., Yuan, H., Qing, Z., Gong, B., Zhang, Y., Shen, Y., Gao, C., & Sang, N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00628 · Cited by 40
“…similar inspiration, Make-A-Video [50] and Gen-1 [12] employ a two-step strategy that first leverages a large ( ∼ 1B parameters) diffusion prior model [42] to convert text embedding into image embedding of CLIP [41] and then enters it into an image-conditioned generator to synthesize videos.”
BackgroundMethodInfluentialEvaluating the alignment of AI with human emotions
Lomas, D., van der Maden, W., Bandyopadhyay, S., Lion, G., Patel, N., Jain, G., Litowsky, Y., Xue, H., & Desmet, P. (2024) · Advanced Design Research · doi:10.1016/j.ijadr.2024.10.002 · Cited by 30
Zhu, Z., Ren, Y., & Shen, A. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13551-3 · Cited by 30
“Simultaneously, multiple text-to-image AI systems, such as Disco Diffusion (Li, 2022), Midjourney (Abul Khair et al., 2023), OpenAI’s DALL-E2 (Ramesh et al., 2022), Google’s Imagen (Saharia et al., 2022), and Stable Diffusion (Rombach et al., 2022), are advancing rapidly.”
Explainability and vision foundation models: A survey
Kazmierczak, R., Berthier, É., Frehse, G., & Franchi, G. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103184 · Cited by 45
A versatile multimodal learning framework bridging multiscale knowledge for material design
Wu, Y., Ding, M., He, H., Wu, Q., Jiang, S., Zhang, P., & Ji, J. (2025) · npj Computational Materials · doi:10.1038/s41524-025-01767-3 · Cited by 33
“Recent advances in MML, such as CLIP 29 , ImageBind 30 , and DALLE-2 31 have demonstrated impressive cross-modal understanding capabilities.”
Deep generative modeling of temperature-dependent structural ensembles of proteins
Janson, G., Jussupow, A., & Feig, M. (2025) · Communications Chemistry · doi:10.1038/s42004-025-01737-2 · Cited by 33
“The methodisanevolutionoftheStructuralAutoencoderModel(SAM),alatent diffusionmodel 24 that we originally applied to C α ensembles of intrinsically disordered peptides 25 .”
Image Completion with Heterogeneously Filtered Spectral Hints
Xu, X., Navasardyan, S., Tadevosyan, V., Sargsyan, A., Mu, Y., & Shi, H. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00457 · Cited by 24
“The concurrent works in diffusion models [20, 46] can also be extended to inpainting tasks in which LDM [44] and DALL-E2 [41] shows promising results at a higher computational cost during inference time.”
BackgroundOn the use of Stable Diffusion for creating realistic faces: from generation to detection
Papa, L., Faiella, L., Corvitto, L., Maiano, L., & Amerini, I. (2023) · International Workshop on Biometrics and Forensics (IWBF) · doi:10.1109/iwbf57495.2023.10156981 · Cited by 29
“Based on this methodology, Stable Diffusion [1] and Dall-E [4] are two mainstream applications capable of generating highly realistic images by providing a textual description as input.”
MethodNon-Contrastive Learning Meets Language-Image Pre-Training
Zhou, J., Li, D., Gan, Z., Wang, L., & Wei, F. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01061 · Cited by 30
TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervision
Wei, J., Wang, H., Feng, J., Lin, G., & Yap, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01612 · Cited by 23
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Zheng, N., Jiang, H., Zhang, Q., Han, Z., Ma, L., Yang, Y., Yang, F., Zhang, C., Qiu, L., Yang, M., et al. (2023) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3600006.3613139 · Cited by 30
“In natural language processing [22, 51, 55] and multi-modality models [53, 56], token sequences naturally have varied input and output lengths.”
BackgroundRéby, K., Guilhelm, A., & Luca, L. D. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00184 · Cited by 24
“For example, given a short natural language prompt, foundation models such as DALLE 2[45] or Midjourney[4], may execute tasks like answering questions, producing text, or generating images.”
BackgroundImage Steganography and Style Transformation Based on Generative Adversarial Network
Li, L., Zhang, X., Chen, K., Feng, G., Wu, D., & Zhang, W. (2024) · Mathematics · doi:10.3390/math12040615 · Cited by 21
SODA: Bottleneck Diffusion Models for Representation Learning
Hudson, D. A., Zoran, D., Malinowski, M., Lampinen, A. K., Jaegle, A., McClelland, J. L., Matthey, L., Hill, F., & Lerchner, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02181 · Cited by 52
“As indicated by Table 2, SODA produces excellent reconstructions, surpassing competing approaches like VQGAN [75], StyleGAN2 [85], DALL-E [74] and unCLIP (DALL-E2) [8], especially in terms of structural and semantic similarity (SSIM & LPIPS).”
MethodText-Conditioned Generative Model of 3D Strand-Based Human Hairstyles
Sklyarova, V., Zakharov, E., Hilliges, O., Black, M. J., & Thies, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00450 · Cited by 23
“Specifically, we use CLIP [37] and compute the cosine distance between images and their respective text prompts.”
PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Models
Zhang, Y., Xing, Z., Zeng, Y., Fang, Y., & Chen, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00740 · Cited by 42
Generative AI: Overview, Economic Impact, and Applications in Asset ManagementPreprint
Luk, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4574814 · Cited by 24
Inspecting the Geographical Representativeness of Images from Text-to-Image Models
Basu, A., Babu, R. V., & Pruthi, D. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00474 · Cited by 21
“In the supplementary material, we show images generated separately by both DALL·E 2 [32] and Stable Diffusion [35] for all the 10 nouns, whereas we choose one country from each continent: US, Chile, UK, Japan, South Africa, and Australia.”
BackgroundMethodInfluentialZhao, L., Hu, Y., Yang, X., Dou, Z., & Wu, Q. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125370 · Cited by 23
Cheng, A., Ser, C. T., Skreta, M., Guzmán-Cordero, A., Thiede, L., Burger, A., Aldossary, A., Leong, S. X., Pablo‐García, S., Strieth‐Kalthoff, F., et al. (2024) · Faraday Discussions · doi:10.1039/d4fd00153b · Cited by 22
Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidance
Shen, D., Song, G., Xue, Z., Wang, F.-Y., & Liu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00895 · Cited by 32
“Recently, text-to-image generation has witnessed rapid development and various applications [29, 30, 32, 33, 45], where visually stunning images can be created by simply typing in a text prompt.”
BackgroundMultiDiff: Consistent Novel View Synthesis from a Single Image
Müller, N., Schwarz, K., Roessle, B., Porzi, L., Bulò, S. R., Nießner, M., & Kontschieder, P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00977 · Cited by 40
“Interest-ingly, GeoGPT [51] directly models long-range 3D correspondences between source and target views with an autoregressive transformer, demonstrating that an intermediate 3D representation may not be needed for NVS from a single image.”
BackgroundLiu, R., Pang, W., Chen, J., Balakrishnan, V., & Chin, H. L. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13135-7 · Cited by 31
“The researchers conducted a quantitative evaluation of the Twenty-Four Solar Terms traditional Chinese painting instructional image resources generated by four models: Dall · E 2 (Ramesh et al., 2022), Stable Diffusion (Rombach et al., 2022), Midjour-ney (Borji, 2022), and the proposed method.”
InfluentialUnified residential floor plan generation with multimodal inputs
Zeng, P., Yin, J., Zhang, M., Li, J., Zhang, Y., & Lu, S. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106408 · Cited by 22
Zhao, C., Yuan, S., Jiang, C., Cai, J., Yu, H., Wang, M. Y., & Chen, Q. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3265893 · Cited by 20
Semantic Distance Adversarial Learning for Text-to-Image Synthesis
Yuan, B., Sheng, Y., Bao, B., Chen, Y. P., & Xu, C. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3278992 · Cited by 21
“Compared with the diffusion-based methods: We conduct a comprehensive comparison of SEMA with the state-of-the-art diffusion-based T2I methods: VQ-diffusion [31], GLIDE [33], DALLE-2 [32], Imagen [37], LDM [36], where VQ-diffusion has 3 versions with varying amounts of parameters and training data.”
BackgroundMethodMIDMs: Matching Interleaved Diffusion Models for Exemplar-Based Image Translation
Seo, J., Lee, G., Cho, S., Lee, J., & Kim, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25313 · Cited by 28
Efficient Transformers with Dynamic Token Pooling
Nawrot, P., Chorowski, J., Łańcucki, A., & Ponti, E. M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.353 · Cited by 61
“The Transformer architecture (Vaswani et al., 2017) lies at the heart of cutting-edge generative models, such as GPT-3 (Brown et al., 2020) for text and DALL·E 2 (Ramesh et al., 2022) for images.”
Tan, Z., Yang, X., Ye, Z., Wang, Q., Yan, Y., Nguyen, A., & Huang, K. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109883 · Cited by 21
Attention-Bridged Modal Interaction for Text-to-Image Generation
Tan, H., Yin, B., Xu, K., Wang, H., Liu, X., & Li, X. S. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3347971 · Cited by 20
“DALL-E2 [36], based on the diffusion model, adopted the CLIP [34] to enhance the semantics representation of the synthesized image.”
MethodEquivariant Similarity for Vision-Language Foundation Models
Wang, T., Lin, K., Li, L., Lin, C.-C., Yang, Z., Zhang, H., Liu, Z., & Wang, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01102 · Cited by 32
“On the one hand, recent VLMs [51, 68, 13, 48, 74, 49] have demonstrated impressive results in various downstream VL tasks such as image-text retrieval.”
BackgroundEvaluating Data Attribution for Text-to-Image Models
Wang, S.-Y., Efros, A. A., Zhu, J.-Y., & Zhang, R. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00661 · Cited by 29
“Adapting such models to text-to-image synthesis [56, 44, 45] has produced a rash of models of amazing quality and diversity, including Imagen [60] and DALL E-2 [54].”
BackgroundReconstructing Regularly Missing Seismic Traces With a Classifier-Guided Diffusion Model
Wang, X., Wang, Z., Xiong, Z., Yang, Y., Zhu, C., & Gao, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3367354 · Cited by 25
Image Captioning with Multi-Context Synthetic Data
Ma, F., Zhou, Y., Rao, F., Zhang, Y., & Sun, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28203 · Cited by 32
“Conditional versions enhance control and produce premium outcomes, extending their usefulness, as seen in text-to-image generation with models like DALL-E 2, Imagen, and Stable Diffusion (Ramesh et al. 2022; Saharia et al. 2022; Rombach et al. 2022).”
BackgroundInfluentialDing, K., Feng, X., & Yu, H. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112317 · Cited by 20
Protein Design by Directed Evolution Guided by Large Language Models
Tran, T. P., & Hy, T. S. (2024) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2024.3439690 · Cited by 26
“In the recent years, generative models have emerged as powerful tools for generating creative and diverse content, ranging from text [8], [9], images [10], [11] to speech [12], and more.”
Crossway Diffusion: Improving Diffusion-based Visuomotor Policy via Self-supervised Learning
Li, X., Belagali, V., Shang, J., & Ryoo, M. S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610175 · Cited by 39
“Recent works [18], [19], [20], [21] have demonstrated its great ability in image generation and other data generation tasks.”
BackgroundAir target intent recognition method combining graphing time series and diffusion models
Chenghai, L. I., Wang, K., Song, Y., Wang, P., & Li, L. (2024) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2024.08.008 · Cited by 21
Hierarchical Spatio-temporal Decoupling for Text-to- Video Generation
Qing, Z., Zhang, S., Wang, J., Wang, X., Wei, Y., Zhang, Y., Gao, C., & Sang, N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00634 · Cited by 43
“To generate high-resolution images, a series of methods [3, 18, 34, 40, 43] have employed super-resolution techniques on low-resolution images, while others [13, 37, 41] have utilized decoders to de-6636 Figure 3.”
Material Palette: Extraction of Materials from a Single Image
Lopes, I., Pizzati, F., & de Charette, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00419 · Cited by 22
Watermark-embedded Adversarial Examples for Copyright Protection against Diffusion Models
Zhu, P., Takahashi, T., & Kataoka, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02305 · Cited by 28
“DMs have been applied to various generation tasks such as image synthesis [9, 43], text-to-image generation [1, 41, 58, 59], and text-guided image editing [4, 34, 54, 61].”
MethodMa, W., Chen, S., Lou, Y., Li, X., & Zhou, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02564 · Cited by 35
“Generating tokens via diffusion is much harder than generation in continuous domains such as images [34] and embeddings [28, 30] due to its discrete nature [24, 54].”
BackgroundFreeDrag: Feature Dragging for Reliable Point-Based Image Editing
Ling, P., Chen, L., Zhang, P., Chen, H., Jin, Y., & Zheng, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00655 · Cited by 56
“…researchers have proposed two primary categories of methodologies in this domain: (1) harnessing prior 3D models [8, 12, 46] or manual annotations [2, 17, 26, 34, 42] to enhance control over generative models, and (2) employing textual guidance for conditional generative models [37, 39, 41].”
BackgroundBA-SAM: Scalable Bias-Mode Attention Mask for Segment Anything Model
Song, Y., Zhou, Q., Li, X., Fan, D.-P., Lu, X., & Ma, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00305 · Cited by 26
“These models, Vision-Language Models (VLM) (CLIP [54] and DALL-E [55]) combine computer vision and natural language pro-2 cessing to understand and generate descriptions or analyze visual content using textual and visual information.”
BackgroundBhat, S. M., Palepu, K., Hong, L., Mao, J., Ye, T., Iyer, R., Zhao, L., Chen, T., Vincoff, S., Watson, R., et al. (2024) · bioRxiv · doi:10.1101/2023.06.26.546591 · Cited by 90
“24,25 DALL-E 2, a denoising diffusion model, was then trained using the CLIP latent space to generate photorealistic images conditioned on an associated text prompt.”
BenthicNet: A global compilation of seafloor images for deep learning applications
Lowe, S. C., Misiuk, B., Xu, I., Abdulazizov, S., Baroi, A. R., Bastos, A. C., Best, M. B., Ferrini, V. L., Friedman, A., Hart, D., et al. (2025) · Scientific Data · doi:10.1038/s41597-025-04491-1 · Cited by 31
Deepfakes on Demand: The rise of accessible non-consensual deepfake image generators
Hawkins, W., Mittelstadt, B., & Russell, C. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732107 · Cited by 20
“A year later, OpenAI followed this up with the release of DALL-E 2, where the use of diffusion models led to substantial quality improvements [42].”
CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation
Tang, Z., Yang, Z., Khademi, M., Liu, Y., Zhu, C., & Bansal, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02589 · Cited by 57
“1 [22] (stabilityai/stable-diffusion-2-1-unclip [21]), Audi-oLDM2 [15], and zeroscope v2 2 .”
ZeroShape: Regression-Based Zero-Shot Shape Reconstruction
Huang, Z., Stojanov, S., Thai, A., Jampani, V., & Rehg, J. M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00959 · Cited by 21
“3D from 2D Generative Models There have been efforts to use the real-world 2D image prior from text-to-2D gen-4 erative models [1, 40, 44, 45] to reconstruct 3D shape from a single image.”
MethodInteligencia Artificial en la Educación Avances y Desafíos Multidisciplinarios.
Barahona-Martínez, G. E., Gallardo-Chiluisa, N. N., Caiza, Y. E. Q., Jiménez-Rivas, D. E., Caicedo-Basurto, R. L., Guanotuña-Yaulema, J. A., Flores-Cruz, P. L., & Hernández, D. M. G. (2024) · Editorial Grupo AEA eBooks · doi:10.55813/egaea.l.101 · Cited by 24
Textual prompt guided image restoration
Yan, Q., Jiang, A., Chen, K., Peng, L., Yi, Q., & Zhang, C. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110981 · Cited by 33
Distinguishing and Matching-Aware Unsupervised Point Cloud Completion
Xiao, H., Li, Y., Kang, W., et al. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3250970 · Cited by 19
Foundation Model for Material Science
Takeda, S., Kishimoto, A., Hamada, L., Nakano, D., & Smith, J. R. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i13.26793 · Cited by 25
“This is related to the approach on autoregressive and diffusion models that leverage the latent spaces trained by contrastive learning (Ramesh et al. 2022).”
MethodTransferable learning on analog hardware
Vadlamani, S. K., Englund, D. R., & Hamerly, R. (2023) · Science Advances · doi:10.1126/sciadv.adh3436 · Cited by 22
Few-Shot Learning with Visual Distribution Calibration and Cross-Modal Distribution Alignment
Wang, R., Zheng, H. R., Duan, X., Liu, J., Lu, Y., Wang, T., Xu, S., & Zhang, B. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02245 · Cited by 21
“Another challenge is that the distributions of the image and the text representations of the same class are not truly aligned in CLIP [30] as shown in Fig.”
BackgroundInfluentialWang, Z., Wang, J., Liu, Z., & Qiu, Q. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02162 · Cited by 22
CCLAP: Controllable Chinese Landscape Painting Generation Via Latent Diffusion Model
Wang, Z., Zhang, J., Ji, Z., Bai, J., & Shan, S. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00362 · Cited by 21
“To date, diffusion models have been widely used in generative modeling tasks [10], [19], among which the most closely related task to our method is conditional image synthesis, i.”
BackgroundMethodBerman, D. S., Klinger, M. S., & Stapleton, A. G. (2023) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad0102 · Cited by 34
“This viewpoint allows us to draw a very sharp analogy between renormalization and aspects of data compression [36, 55–58], data generation [59–61], data classification [40, 62–67], dimensional reduction and model selection [33, 34, 68] commonly studied in data science and machine learning.”
BackgroundGenerative Artificial Intelligence: A Double-Edged Sword
Kuck, K. (2023) · 2023 World Engineering Education Forum - Global Engineering Deans Council (WEEF-GEDC) · doi:10.1109/weef-gedc59520.2023.10343638 · Cited by 10
“Instead of using a derived version of GPT-3, DALL-E 2, with aid from CLIP, generates images based on a diffusion model [14, 15].”
MethodVQ3D: Learning a 3D-Aware Generative Model on ImageNet
Sargent, K., Koh, J. Y., Zhang, H., Chang, H., Herrmann, C., Srinivasan, P. P., Wu, J., & Sun, D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00391 · Cited by 25
“…beyond single-class generation, we draw inspiration from recent advances in 2D image generation, where other formulations such as text-to-image generation models [51, 33, 28] and two-stage image models [14, 50] have begun to achieve impressive results on very large and diverse image collections.”
BackgroundDesbordes, T., King, J.-R., & Dehaene, S. (2024) · Cell Reports · doi:10.1016/j.celrep.2024.113847 · Cited by 18
Yang, Z., Zhao, J., Yu, Y., & Huang, C. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3371051 · Cited by 20
“But the training of these models is often based on a large number of open-source optical datasets [35], [36], [37], [38], [39].”
BackgroundMethodTian, J., Lei, J., Zhang, J., Xie, W., & Li, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3371481 · Cited by 27
“Diffusion models have rapidly advanced in recent years, showing exceptional promise in fields like computer vision [36], [37], [38].”
Background4D Facial Expression Diffusion Model
Zou, K., Faisan, S., Yu, B., Valette, S., & Seo, H. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3653455 · Cited by 28
“Here, we propose to use a Denoising Diffusion Probabilistic Model (DDPM) [19, 52, 53], a generative approach that has achieved remarkable success in several domains, such as image generation[44, 48, 50], audio synthesis[26], language modeling[30] and point cloud generation[33].”
LidarCLIP or: How I Learned to Talk to Point Clouds
Hess, G., Tonderski, A., Petersson, C., Åström, K., & Svensson, L. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00727 · Cited by 32
“Such scenes are nearly impossible to retrieve with a single modality (left). as image captioning [28], image retrieval [2, 16], semantic segmentation [45], text-to-image generation [31, 33], and referring image segmentation [21,39].”
BackgroundMethodLing, Y., Wang, Z., Yang, Y., Bao, L., Bao, S., Wang, Q., Cai, Y., & Huang, R. (2024) · Science China Information Sciences · doi:10.1007/s11432-023-3887-0 · Cited by 19
“The artificial intelligence (AI) market has seen remarkable growth in recent years, particularly in voice recognition and machine vision [1–4].”
BackgroundFan, J., Shi, Z., Ren, Z., Zhou, Y., & Ji, M. (2024) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2024.104093 · Cited by 26
Alchemist: Parametric Control of Material Properties with Diffusion Models
Sharma, P., Jampani, V., Li, Y., Jia, X., Lagun, D., Durand, F., Freeman, B., & Matthews, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02278 · Cited by 38
“Denoising Diffusion Probabalistic Models (DDPMs) have been an active focus of the research community [12, 14, 28–30, 33, 34, 79] for their excellent photorealistic image generation capabilities from text prompts [56,65,67,71].”
BackgroundCapHuman: Capture Your Moments in Parallel Universes
Liang, C., Ma, F., Zhu, L., Deng, Y., & Yang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00612 · Cited by 22
“Ima-gen [34], GLIDE [27], and DALL-E 2 [31] directly operate the denoising process in the pixel space.”
BackgroundGenerative Proxemics: A Prior for 3D Social Interaction from Images
Müller, L., Ye, V., Pavlakos, G., Black, M. J., & Kanazawa, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00925 · Cited by 41
“Following Ramesh et al. [36], we train a neural network D that predicts a sample ˆx 0 = D ( x t ; t ) from a noisy sample x t given the noise level t .”
BackgroundPLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesis
Lv, Z., Wei, Y., Zuo, W., & Wong, K.-Y. K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00885 · Cited by 27
“Benefiting from the powerful diffusion model [12, 36] and extensive text-image training data, text-to-image synthesis has achieved unprecedented successes in terms of image quality, diversity, and alignment with the provided text [24, 30, 31, 33].”
BackgroundEgocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement
Wang, J., Cao, Z., Luvizon, D. C., Liu, L., Sarkar, K., Tang, D., Beeler, T., & Theobalt, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00080 · Cited by 32
“We follow Ramesh et al .’s work [38] to make the network predict the original signal itself, i.e .”
BackgroundPosterior Distillation Sampling
Koo, J., Park, C., & Sung, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01268 · Cited by 36
“Among them, in particular, 2D image diffusion models [5, 26, 37, 39, 41] have demonstrated their powerful generative prior aided by Internet-scale image and text datasets [3, 42, 43].”
BackgroundHwang, J.-S., Lee, S.-H., & Lee, S.-W. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106762 · Cited by 26
This Microtubule Does Not Exist: Super‐Resolution Microscopy Image Generation by a Diffusion Model
Saguy, A., Nahimov, T., Lehrman, M., Gómez‐de‐Mariscal, E., Hidalgo-Cenalmor, I., Alalouf, O., Balakrishnan, A., Heilemann, M., Henriques, R., & Shechtman, Y. (2024) · Small Methods · doi:10.1002/smtd.202400672 · Cited by 21
MISC: Ultra-Low Bitrate Image Semantic Compression Driven by Large Multimodal Model
Li, C., Lu, G. S., Feng, D., Wu, H., Zhang, Z., Liu, X., Zhai, G., Lin, W., & Zhang, W. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3515874 · Cited by 32
Tian, K., Cheng, Y., Liu, Y., Hou, X., Chen, Q., & Li, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28327 · Cited by 20
MaskSim: Detection of synthetic images by masked spectrum similarity analysis
Li, Y., Bammey, Q., Gardella, M., Nikoukhah, T., Morel, J., Colom, M., & von Gioi, R. G. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00390 · Cited by 22
“Leveraging this capability, Latent Diffusion models [64], Stable Diffusion models (SD) [65], Glide [54], CogView [18], Make-A-Scene [27], DALL · E [62] and Ima-gen [66] have extended the scope of diffusion models to generate images from text prompts within a latent feature space.”
B3-CDG: A pseudo-sample diffusion generator for bi-temporal building binary change detection
Chen, P., Li, P., Wang, B., Zhao, S., Zhang, Y., Zhang, T., & Ding, X. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.10.021 · Cited by 20
Spurious reconstruction from brain activity
Shirakawa, K., Nagano, Y., Tanaka, M., Aoki, S., Muraki, Y., Majima, K., & Kamitani, Y. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107515 · Cited by 30
Leveraging Off-the-shelf Diffusion Model for Multi-attribute Fashion Image Manipulation
Kong, C., Jeon, D., Kwon, O., & Kwak, N. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00091 · Cited by 20
“Denoising diffusion models [11, 33, 7, 26, 30] have recently gained great attention from the research community for their impressive synthesis quality, training stability and scalability.”
BackgroundMethodInfluentialLocal-Global Decompositions for Conditional Microstructure Generation
Robertson, A. E., Kelly, C., Buzzy, M. O., & Kalidindi, S. R. (2023) · Acta Materialia · doi:10.1016/j.actamat.2023.118966 · Cited by 21
Transformer-based image generation from scene graphs
Sortino, R., Palazzo, S., Rundo, F., & Spampinato, C. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103721 · Cited by 26
Jeon, I., & Kim, T. (2023) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2023.1092185 · Cited by 24
“, 2020) and text-to-image models (Ramesh et al., 2022; Rombach et al., 2022), approaches under purely engineering goals seem to dispense with the need for a bottom-up approach.”
BackgroundCarrillo‐Pérez, F., Pizurica, M., Ozawa, M. G., Vogel, H. S., West, R. B., Kong, C. S., Herrera, L. J., Shen, J., & Gevaert, O. (2023) · Cell Reports Methods · doi:10.1016/j.crmeth.2023.100534 · Cited by 19
Energy-based Models are Zero-Shot Planners for Compositional Scene Rearrangement
Gkanatsios, N., Jain, A., Zhou, X., Zhang, Y., Atkeson, C. G., & Fragkiadaki, K. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.030 · Cited by 35
“The work of [22] leverages web-scale pre-trained models [13, 47, 49] to generate segmentation masks for each object in the generated goal image.”
BackgroundMethodVideo Diffusion Models with Local-Global Context Guidance
Yang, S., Zhang, L., Liu, Y., Jiang, Z., & He, Y. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/182 · Cited by 25
Foundation Model Drives Weakly Incremental Learning for Semantic Segmentation
Yu, C., Zhou, Q., Li, J., Yuan, J., Wang, Z., & Wang, F. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02268 · Cited by 22
Distribution Shift Inversion for Out-of-Distribution Prediction
Yu, R., Liu, S., Yang, X., & Wang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00350 · Cited by 20
“With promising performance and theoretical explanation, the diffusion model has been intensively investigated in the field of time series generalization/imputation/prediction [29, 32, 56, 68], image generalization/editing/inpainting [3, 6– 8, 41, 44, 54, 61], text generalization/modeling [35, 80], text2image generaliz…”
BackgroundCLIPSonic: Text-to-Audio Synthesis with Unlabeled Videos and Pretrained Language-Vision Models
Dong, H., Liu, X., Pons, J., Bhattacharya, G., Pascual, S., Serrà, J., Berg-Kirkpatrick, T., & McAuley, J. (2023) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa58266.2023.10248160 · Cited by 22
Open-world story generation with structured knowledge enhancement: A comprehensive survey
Wang, Y., Lin, J., Yu, Z., Hu, W. P., & Karlsson, B. F. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126792 · Cited by 21
BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesis
Cao, T., Wang, C., Liu, B., Wu, Z., Zhu, J., & Huang, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.1 · Cited by 42
MtArtGPT: A Multi-Task Art Generation System With Pre-Trained Transformer
Jin, C., Zhu, R., Zhu, Z., Yang, L., Min, Y., & Luo, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3349567 · Cited by 21
“DALL-E2 [39] uses a diffusion prior with CLIP text latent variables and cascaded diffusion models to generate high-resolution 1024 × 1024 images, capturing finer image details and textures.”
MethodTem-adapter: Adapting Image-Text Pretraining for Video Question Answer
Chen, G., Liu, X., Wang, G., Zhang, K., Torr, P. H. S., Zhang, X.-P. S., & Tang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01282 · Cited by 28
“Recently, VLP models have shown great potential for other downstream applications, such as zero-shot and few-shot visual recognition [56, 12, 89, 88, 86], segmentation and detection [60, 87], image generation [50, 59, 52], and action understanding [70, 68].”
BackgroundAny-Size-Diffusion: Toward Efficient Text-Driven Synthesis for Any-Size HD Images
Zheng, Q., Guo, Y., Deng, J., Han, J., Li, Y., Xu, S., & Xu, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28589 · Cited by 26
Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Models
Zhang, M., Yu, N., Wen, R., Michael Backes, A., & Zhang, Y. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00477 · Cited by 26
“…from latent representations sampled from estimated normal distributions; implicit functions (IFs) [9, 15, 38, 39] which circumvent the need for an explicit likelihood; and diffusion probabilistic models (DDPMs) [26,29,43,45,46,51] which denoise noise images step by step until being clean images.”
BackgroundSAW-GAN: Multi-granularity Text Fusion Generative Adversarial Networks for text-to-image generation
Jin, D., Yu, Q., Yu, L., & Qi, M. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111795 · Cited by 18
Lee, H., Savva, M., & Chang, A. X. (2024) · Computer Graphics Forum · doi:10.1111/cgf.15061 · Cited by 32
Metadata
- Authors
- Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M.
- ORCID
- Chen, Mark
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2204.06125
- OpenAlex
- W4224035735
- Cited by
- 2,511
- References
- 66
- Citations by year
- 2026: 46 · 2025: 429 · 2024: 1113 · 2023: 859 · 2022: 63
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- text-to-image generation, diffusion models, image priors, image variation, photorealism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
