The DOI matches its DataCite record; 69 of the 69 references it cites were found in a registry or an index.
Hierarchical Text-Conditional Image Generation with CLIP Latents
Open accessAbstract
Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a CLIP image embedding given a text caption, and a decoder that generates an image conditioned on the image embedding. We show that explicitly generating image representations improves image diversity with minimal loss in photorealism and caption similarity. Our decoders conditioned on image representations can also produce variations of an image that preserve both its semantics and style, while varying the non-essential details absent from the image representation. Moreover, the joint embedding space of CLIP enables language-guided image manipulations in a zero-shot fashion. We use diffusion models for the decoder and experiment with both autoregressive and diffusion models for the prior, finding that the latter are computationally more efficient and produce higher-quality samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While more sophisticated methods for partially editing individual frames during training exist (e.g., text-to-image models [13], [14]), they are slow, computationally expensive and error-prone.”
From Language-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredIn the citing paper
“Generative machines, such as text-to-image algorithms, are contributing to the variety of cultural traits.”
From Machine culture (2023) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“To this end, we generated 512 “artistic” captions using GPT-3 [4] by prompting it with captions for existing artwork (both real and AI generated).”
MethodSelf-citationHigh-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302 · cited 2×
“[42] use diffusion models on the latents obtained from a VQGAN [14] like autoencoder.”
BackgroundMethodLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 3×
“Recent progress in computer vision has been driven by scaling models on large datasets of captioned images collected from the internet [10, 44, 60, 39, 31, 16].”
BackgroundMethodSelf-citationLIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 12,864 · cited 4×
“After applying PCA, we order the principal components by decreasing eigenvalue magnitude, quantize each of the 319 dimensions into 1,024 discrete buckets, and predict the resulting sequence using a decoder-only Transformer [53] model with a causal attention mask.”
MethodInfluentialDecoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Research works printed but not linked: 2
- [23][23] Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Advances in Neural Information Processing Systems 30 (NIPS 2017), 2017.
- [32][32] Ryan Murdock. The Big Sleep. https://twitter.com/advadnoun/status/ 1351038053033406468, 2021. 20 https://openreview.net/forum?id=qw674L9PfQE https://openreview.net/forum?id=qw674L9PfQE https://arxiv.org/abs/2203.13131 https://arxiv.org/abs/2108.00946 https://arxiv.org/abs/2102.01645 https://arxiv.org/abs/1406.2661 https://arxiv.org/abs/2111.14822 https://openreview.net/forum?id=qw8AKxfYbI https://openreview.net/forum?id=qw8AKxfYbI https://arxiv.org/abs/2006.11239 https://arxiv.org/abs/2106.15282 https://arxiv.org/abs/1412.6980 https://arxiv.org/abs/1405.0312 https://arxiv.org/abs/1711.05101 https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://arxiv.org/abs/2112.12750 https://twitter.com/advadnoun/status/1351038053033406468 https://twitter.com/advadnoun/status/1351038053033406468 · arXiv
Cited by
Sorted by citations
Items 401–500 of 1,051
Denoising Diffusion Autoencoders are Unified Self-supervised Learners
Xiang, W., Hongyu, Y., Huang, D., & Wang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01448 · Cited by 88
“Recently, we have witnessed the flourish of AI-generated visual content due to the emergence of diffusion models [26, 53], with state-of-the-art results reported in image synthesis [13, 29, 41], image editing [24] and text-to-image synthesis [46, 48, 50].”
BackgroundCompositional 3D Scene Generation using Locally Conditioned Diffusion
Po, R., & Wetzstein, G. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00026 · Cited by 93
“Advances in large-scale 2D diffusion models trained on internet-scale data [7, 30, 36, 37, 39, 41, 43] have allowed generation of high-quality images that stay accurate to complex text prompts.”
BackgroundHarnessing large vision and language models in agriculture: a review
Zhu, H., Qin, S., Su, M., Lin, C., Li, A., & Gao, J. (2025) · Frontiers in Plant Science · doi:10.3389/fpls.2025.1579355 · Cited by 97
Chen, L., Fei, D., Hu, Y., Wang, Z., & Wang, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25105 · Cited by 72
How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?
Bansal, H., Yin, D., Monajatipoor, M., & Chang, K.-W. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.88 · Cited by 106
High-Fidelity Guided Image Synthesis with Latent Diffusion Models
Singh, J., Gould, S. J., & Zheng, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00581 · Cited by 53
NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models
Kim, S. W., Brown, B., Yin, K., Kreis, K., Schwarz, K., Li, D., Rombach, R., Torralba, A. B., & Fidler, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00821 · Cited by 63
“diffusion models, demonstrate better distribution coverage while preserving high sample quality [10, 11, 13, 20, 22, 43, 48, 53, 54, 68].”
Parameter-Efficient Transfer Learning for Medical Visual Question Answering
Liu, J., Hu, T., Zhang, Y., Yang, F., Hao, J., Lv, J., & Liu, Z. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3311333 · Cited by 52
“Employed as powerful feature extractors, it has been successfully deployed in many applications [17], [18], [19], [20].”
MethodXie, E., Yao, L., Shi, H., Liu, Z., Zhou, D., Liu, Z., Li, J., & Li, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00390 · Cited by 97
“Denoising diffusion probabilistic models (DDPMs) [20, 51, 49] have recently emerged as a formidable technique for generative modeling and have demonstrated impressive results in image synthesis [43, 12, 45], video generation [21, 19, 65] and 3D editing [40].”
BackgroundGeneral Image-to-Image Translation with One-Shot Image Guidance
Cheng, B., Liu, Z., Peng, Y., & Lin, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02078 · Cited by 60
“Diffusion-based image synthesis has been developed rapidly in recent years due to the application of large-scale models [35, 37, 33].”
BackgroundMethodPrompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models
Dong, W., Xue, S., Duan, X., & Han, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00683 · Cited by 81
“Works [6, 11, 35] have been proposed to improve the inversion process.”
BackgroundCreate Your World: Lifelong Text-to-Image Diffusion
Sun, G., Liang, W., Dong, J., Li, J., Ding, Z., & Cong, Y. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3382753 · Cited by 53
“Indetails, when learning the current k th generation task, the short-term memory bank B ks is built from CLIP feature space with the guidance of the k − 1 th long-term memory bank B 1: k − 1 l , where In this way, the Authorized licensed use limited to the terms of the applicable license agreement with IEEE.”
MethodInfluentialPhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
Yang, Y., Jia, B., Zhi, P., & Huang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01539 · Cited by 83
“Such an iterative process also offers flexible ways to provide conditions [6, 46] and guidance [3, 23] that could effectively affect the inference of models.”
Coiera, E. W., & Liu, S. (2022) · Cell Reports Medicine · doi:10.1016/j.xcrm.2022.100860 · Cited by 56
“DALL-E, a 12-billion parameter version of GPT-3, is able to automatically generate images from text captions and accurately preserve both the semantics and style.(68) Foundationmodels are created by transfer learning—a process in which neural networks are first trained on a source task usingmany examples and then retr…”
BackgroundIs Writing Prompts Really Making Art?
McCormack, J., Gambardella, C. C., Rajcic, N., et al. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-29956-8_13 · Cited by 49
A Survey of AI Text-to-Image and AI Text-to-Video Generators
Singh, A. (2023) · International Conference on Artificial Intelligence, Robotics and Control (AIRC) · doi:10.1109/airc57904.2023.10303174 · Cited by 53
DiffStyler: Controllable Dual Diffusion for Text-Driven Image Stylization
Huang, N., Zhang, Y., Tang, F., Ma, C., Huang, H., Dong, W., & Xu, C. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3342645 · Cited by 75
“[36] were the first to implement image generation using the diffusion model, and with continued research in subsequent approaches [4, 12, 19, 24, 30,35,38], the diffusion model is generating high-resolution images with unprecedented quality, often surpassing GANs.”
InfluentialOpen-vocabulary Object Segmentation with Diffusion Models
Li, Z., Zhou, Q., Zhang, X., Zhang, Y., Wang, Y., & Xie, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00705 · Cited by 88
“, OpenAI’s DALL-E 2 [26], Google’s Imagen [30] and Stability AI’s Stable Diffusion [27].”
Background3D-aware Image Generation using 2D Diffusion Models
Xiang, J., Yang, J., Huang, B., & Tong, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00226 · Cited by 71
ATT3D: Amortized Text-to-3D Object Synthesis
Lorraine, J., Xie, K., Zeng, X., Lin, C.-H., Takikawa, T., Sharp, N., Lin, T.-Y., Liu, M.-Y., Fidler, S., & Lucas, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01645 · Cited by 65
A comprehensive survey for generative data augmentation
Chen, Y., Yan, Z., & Zhu, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128167 · Cited by 60
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models
Aneja, S., Thies, J., Dai, A., & NieBner, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02009 · Cited by 62
“These models have demonstrated strong performances as a generative model for a variety of domains such as images [17, 29, 49, 52, 53, 78], videos [8, 18, 20, 69], speech [30, 38, 39] and motion [2, 5, 36, 64, 67, 81].”
BackgroundCoDeF: Content Deformation Fields for Temporally Consistent Video Processing
Ouyang, H., Wang, Q., Xiao, Y., Bai, Q., Zhang, J., Zheng, K., Zhou, X., Chen, Q., & Chen, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00773 · Cited by 98
“State-of-the-art diffusion models, such as GLIDE [30], Dall-E 2 [38, 39], Stable Diffusion [42], and Imagen [45], have been trained on millions of images, resulting in exceptional generative capabilities.”
MethodUsing Human Feedback to Fine-tune Diffusion Models without Any Reward Model
Yang, K., Tao, J., Lyu, J., Ge, C., Chen, J., Shen, W., Zhu, X., & Li, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00854 · Cited by 109
“In our work, we utilize Stable Diffusion [45] to generate images based on specific prompts.”
Shifted Diffusion for Text-to-image Generation
Zhou, Y., Liu, B., Zhu, Y., Yang, X. P., Chen, C., & Xu, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00979 · Cited by 61
“[7, 20–23, 26, 32].”
InfluentialKandinsky: An Improved Text-to-Image Synthesis with Image Prior and Latent Diffusion
Razzhigaev, A., Shakhmatov, A., Maltseva, A., Arkhipkin, V., Pavlov, I., Ryabov, I., Kuts, A. L., Panchenko, A., Кузнецов, А. В., & Dimitrov, D. (2023) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2023.emnlp-demo.25 · Cited by 62
ITI-Gen: Inclusive Text-to-Image Generation
Zhang, C., Chen, X., Chai, S., Wu, C., Lagun, D., Beeler, T., & la Torre, F. D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00367 · Cited by 59
“Recently, the over-whelming success of diffusion-based text-to-image models [58, 66, 58, 51] has attracted significant attention.”
BackgroundMethodInfluentialPC-JeDi: Diffusion for particle cloud generation in high energy physics
Leigh, M., Sengupta, D., Quétant, G., Raine, J. A., Zoch, K., & Golling, T. (2024) · SciPost Physics · doi:10.21468/scipostphys.16.1.018 · Cited by 94
Franceschelli, G., & Musolesi, M. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15278 · Cited by 54
“, 2023), DALL-E 2 (Ramesh et al., 2022) and Stable Diffusion (Rombach et al.”
BackgroundDesignFusion: Integrating Generative Models for Conceptual Design Enrichment
Chen, L., Jing, Q., Tsang, Y., Wang, Q., Sun, L., & Luo, J. (2024) · Journal of Mechanical Design · doi:10.1115/1.4065487 · Cited by 58
WEDGE: A multi-weather autonomous driving dataset built from generative vision-language models
Marathe, A., Ramanan, D., Walambe, R. A., & Kotecha, K. V. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00334 · Cited by 51
“DALL-E 2 [36] is a dual-stage model that combines CLIP embeddings with probabilistic diffusion-model based decoder for conditional generation to generate the final realistic images.”
BackgroundWhat’s “up” with vision-language models? Investigating their struggle with spatial reasoning
Kamath, A., Hessel, J., & Chang, K.-W. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.568 · Cited by 187
From Deep Learning to Rational Machines
Buckner, C. J. (2023) · doi:10.1093/oso/9780197653302.001.0001 · Cited by 57
Diffusion Models as Masked Autoencoders
Wei, C., Mangalam, K., Huang, P.-Y., Li, Y., Fan, H., Hu, X., Wang, H., Xie, C., Yuille, A., & Feichtenhofer, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01492 · Cited by 80
“This process has proven extremely powerful for rich text-conditioned generation of both images [59, 50, 64, 62] and videos [71, 36, 34, 66].”
BackgroundResultInfluentialHuang, W., Wang, J., & Cong, G. (2024) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2024.2347322 · Cited by 49
Cold SegDiffusion: A novel diffusion model for medical image segmentation
Yan, P., Li, M., Zhang, J., Li, G., Jiang, Y., & Luo, H. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112350 · Cited by 50
MindBridge: A Cross-Subject Brain Decoding Framework
Wang, S., Liu, S., Tan, Z., & Wang, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01077 · Cited by 66
“With large-scale image-text pair datasets [32], DMs have demonstrated superior performance in the task of text-to-image generation [9, 26, 30, 42, 47] and achieves unprecedented image quality.”
BackgroundAndrulis, T., Emer, J., & Sze, V. (2023) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3579371.3589062 · Cited by 54
“Retraining DNNs can be a challenge due to high computational cost [43], cumbersome hyperparameter tuning [19], and the potential lack of access to training datasets [50, 62].”
BackgroundFace0: Instantaneously Conditioning a Text-to-Image Model on a Face
Valevski, D., Lumen, D., Matias, Y., & Leviathan, Y. (2023) · SIGGRAPH Asia Conference Papers · doi:10.1145/3610548.3618249 · Cited by 63
“2022] and diffusion models [Ramesh et al. 2022; Rombach et al. 2021; Saharia et al. 2022] have gained popularity as they allow easy text-conditioning and can generalize to broader domains.”
BackgroundRickrolling the Artist: Injecting Backdoors into Text Encoders for Text-to-Image Synthesis
Struppek, L., Hintersdorf, D., & Kersting, K. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00423 · Cited by 76
“DALL-E 2 [43], Stable Diffusion [44], and eDiffi [3], for example, use CLIP’s pre-trained text encoder to process the textual description and provide robust guidance.”
Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation
Azadi, S., Shah, A., Hayes, T., Parikh, D., & Gupta, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01381 · Cited by 54
“In addition to this simple loss, we follow [21, 27] and optimize the hybrid loss, which also uses a loss L vlb that adds a constraint on the estimated variational lower bound (VLB).”
MethodChen, J., Shao, Z., Zheng, X., Zhang, K., & Yin, J. (2024) · Scientific Reports · doi:10.1038/s41598-024-53318-3 · Cited by 64
“These are the most widely used and influential diffusion models, with active user counts exceeding one million 24–26 .”
BackgroundMethodInfluentialVidToMe: Video Token Merging for Zero-Shot Video Editing
Li, X., Ma, C., Yang, X., & Yang, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00715 · Cited by 71
“Recent large-scale diffusion models [35, 37, 41] operate in the latent space to improve performance and efficiency.”
BackgroundLearned Representation-Guided Diffusion Models for Large-Image Generation
Graikos, A., Yellapragada, S., Le, M.-Q., Kapse, S., Prasanna, P., Saltz, J. H., & Samaras, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00815 · Cited by 57
“This leap forward has been enabled by the simultaneous curation of large-scale multi-modal datasets [40] and the development of efficient conditioning mechanisms [35, 37].”
A text-guided protein design framework
Liu, S., Li, Y., Li, Z., Gitter, A., Zhu, Y., Lu, J., Xu, Z., Nie, W., Ramanathan, A., Xiao, C., et al. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01011-z · Cited by 97
“Motivated by recent breakthroughs of foundation models [12, 13, 14, 15], approaches in the computational chemistry domain that utilize textual descriptions of drugs in addition to their intrinsic chemical and structural information have proved to be effective in small-molecule drug discovery [16,…”
InfluentialAVscript: Accessible Video Editing with Audio-Visual Scripts
Huh, M., Yang, S., Peng, Y.-H., Chen, X., Kim, Y., & Pavel, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581494 · Cited by 58
“Recent strides in prompt-driven text generation [11], image generation [62, 68], and image editing [52] suggest that prompt-driven video editing (e.”
BackgroundIntelligent layout generation based on deep generative models: A comprehensive survey
Shi, Y., Shang, M., & Qi, Z. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101940 · Cited by 58
DALL·E 2 fails to reliably capture common syntactic processes
Leivada, E., Murphy, E., & Marcus, G. (2023) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2023.100648 · Cited by 55
Luo, X., Sun, J., Zhang, R., Chi, P., & Cui, R. (2024) · Computers & Geosciences · doi:10.1016/j.cageo.2024.105541 · Cited by 48
SimDA: Simple Diffusion Adapter for Efficient Video Generation
Xing, Z., Dai, Q., Hu, H., Wu, Z., & Jiang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00748 · Cited by 92
“Recently, T2V methods are most based on fine tuning the T2I [78, 79] diffusion models.”
DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
Li, M., Cai, T., Cao, J., Zhang, Q., Cai, H., Bai, J., Jia, Y., Li, K., & Han, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00686 · Cited by 74
“The emergence of large text-to-image models, including Stable Diffusion [55], Imgen [57], eDiff-I [2], DALL · E [3, 49, 50] and Emu [6], further expands the horizons of AI creativity.”
MethodMove as you Say, Interact as you can: Language-Guided Human Motion Generation with Scene Affordance
Wang, Z., Chen, Y., Jia, B., Li, P., Zhang, J., Zhang, J., Liu, T., Zhu, Y., Liang, W., & Huang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00049 · Cited by 67
“Contrary to approaches that predict the added noise ϵ t , our model directly estimate the input signal [69, 76], allowing the end-to-end training of ADM, denoted as G θ , with a simple objective:”
MethodA brief introductory review to deep generative models for civil structural health monitoring
Luleci, F., & Çatbaş, F. N. (2023) · AI in Civil Engineering · doi:10.1007/s43503-023-00017-z · Cited by 50
“More recently, DMs have also shown remarkable success in the image and video generation, such as Imagen (Saharia et al., 2022) and Imagen Video (Ho et al., 2022) from Google, Dall-E 2 (Ramesh et al., 2022) from OpenAI and Make-A-Video (Singer et al., 2022) from Meta.”
BackgroundBrain-Inspired Remote Sensing Foundation Models and Open Problems: A Comprehensive Survey
Jiao, L., Huang, Z., Lu, X., Liu, X., Yang, Y., Zhao, J., Zhang, J., Hou, B., Yang, S., Liu, F., et al. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3316302 · Cited by 49
“In addition, DALL-E [127] combines the diffusion model with multimodal FMs to generate images from text.”
MethodLet the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Model
Xiao, S., Huang, S., Lin, Y., Ye, Y., & Zeng, W. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326913 · Cited by 44
“In this work, we develop our framework based on the Frozen Latent Diffusion Model (LDM) [40].”
BackgroundAdaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessment
Zhou, T., Tan, S., Zhou, W., Luo, Y., Wang, Y., & Yue, G. (2024) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2024.3391060 · Cited by 48
“2 [58], AttnGAN [59], Midjourney [60], and DALLE2 [61].”
MethodAuditing and instructing text-to-image generation models on fairness
Friedrich, F., Brack, M., Struppek, L., Hintersdorf, D., Schramowski, P., Luccioni, A. S., & Kersting, K. (2024) · AI and Ethics · doi:10.1007/s43681-024-00531-5 · Cited by 58
SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generation
Zhang, Y., Song, Y., Liu, J., Wang, R., Yu, J., Tang, H., Li, H., Tang, X., Hu, Y., Pan, H. C., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00771 · Cited by 54
“Subsequently, DALLE2 [29] employed a diffusion model as the generative model, further enhancing text-to-image synthesis ability.”
Panacea: Panoramic and Controllable Video Generation for Autonomous Driving
Wen, Y., Zhao, Y., Liu, Y., Jia, F., Wang, Y., Luo, C., Zhang, C., Wang, T., Sun, X., & Zhang, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00659 · Cited by 100
“Recent advancements in diffusion models (DMs) have achieved remarkable milestones in image generation [8,28, 31, 33, 35].”
BackgroundDiffEditor: Boosting Accuracy and Flexibility on Diffusion-Based Image Editing
Mou, C., Wang, X., Song, J., Shan, Y., & Zhang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00811 · Cited by 64
MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation
Yu, Z., Liu, C., Liu, L., Shi, Z., & Zou, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3507010 · Cited by 66
“Di ff erent from previous single-stage generation methods [4], [19], the proposed framework generates multi-resolution images from a given geographical location in a recursive manner.”
MethodArtificial intelligence for quantum computing
Alexeev, Y., Farag, M. H., Patti, T. L., Wolf, M. E., Ares, N., Aspuru‐Guzik, A., Benjamin, S. C., Cai, Z., Cao, S., Chamberland, C., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-65836-3 · Cited by 99
“Managing this high dimensionality alongside hardware constraints (such as variable gate fi delities and qubit connectivity) necessitates the use of approximation techniques or heuristic methods.”
Membership Inference Attacks against Diffusion Models
Matsumoto, T., Miura, T., & Yanai, N. (2023) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw59333.2023.00013 · Cited by 76
“Remarkably, diffusion models have outperformed GANs on academic benchmarks in the past years [3] and are expected to replace GANs in a variety of applications [4]–[7].”
Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing
Chakrabarty, T., Padmakumar, V., & He, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.460 · Cited by 86
Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluation
Sarto, S., Barraco, M., Cornia, M., Baraldi, L., & Cucchiara, R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00668 · Cited by 54
“While cleaned data sources, on the contrary, are limited in size, recent advances in both image [14,39,43,44] and text generation [28,59,66] have made it possible to synthetically generate data in both modalities, with controlled style and quality.”
BackgroundArtificial intelligence generated content (AIGC) in medicine: A narrative review
Shao, L., Chen, B., Zhang, Z., Zhang, Z., & Chen, X. (2024) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2024073 · Cited by 51
“With the rise of AI generation models, such as generative pre-training transformer (GPT) [4] and DALL-E [5], artificial intelligence generated content (AIGC) has started to gain widespread attention.”
BackgroundAll in Tokens: Unifying Output Space of Visual Tasks via Soft Token
Ning, J., Li, C., Zhang, Z., Wang, C., Geng, Z., Dai, Q., He, K., & Hu, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01822 · Cited by 65
“Vector-Quantization Discretized token output space is widely used in generative models, such as DALL-E[33], VQGAN[12], and VQ-Diffusion[14], to represent high-dimensional complex data.”
MethodDiFaReli: Diffusion Face Relighting
Ponglertnapakorn, P., Tritrong, N., & Suwajanakorn, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02070 · Cited by 56
Gradient-annihilated PINNs for solving Riemann problems: Application to relativistic hydrodynamics
Ferrer-Sánchez, A., Martín‐Guerrero, J. D., de Austri, R. R., Torres-Forné, A., & Font, J. A. (2024) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2024.116906 · Cited by 50
Grasp-Anything: Large-scale Grasp Dataset from Foundation Models
Vuong, A. D., Vu, M. N., Le, H., Huang, B., Bình, H. T. T., Vo, T., Kugi, A., & Nguyen, A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611277 · Cited by 47
“[35] introduce a framework based on DALLE [50] to solve practical rearrangement tasks.”
MethodFreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition
Mo, S., Mu, F., Lin, K. H., Liu, Y., Guan, B., Li, Y., & Zhou, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00713 · Cited by 74
“At a sampling step t , a cleaner image x t − 1 is obtained by subtracting from x t a noise component ϵ t = ϵ θ ( x t ; t, c ) .”
BackgroundMethodVideoBooth: Diffusion-based Video Generation with Image Prompts
Jiang, Y., Wu, T., Yang, S., Si, C., Lin, D., Qiao, Y., Loy, C. C., & Liu, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00639 · Cited by 73
“Make-A-Video [76] proposes to add temporal attention to the architecture of DALLE2 model [68].”
MethodNam, W. K., & Jang, B. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121168 · Cited by 49
Bucher, M. J. J., Kraus, M. A., Rust, R., & Tang, S. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105128 · Cited by 49
Calculon: a methodology and tool for high-level co-design of systems and large language models
Isaev, M., McDonald, N., Dennison, L. R., & Vuduc, R. W. (2023) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3581784.3607102 · Cited by 58
“Weconsider thetaskofconductinghigh-levelanalysesforalgorithm-architecture codesign of distributed clusters and transformer-based Large Language Models (LLMs) [3, 4, 36, 39, 40].”
BackgroundCustomizing 360-Degree Panoramas through Text-to-Image Diffusion Models
Wang, H., Xiang, X., Fan, Y., & Xue, J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00486 · Cited by 51
“Notably, diffusion models applied to text-to-image (T2I) synthesis [29,35,37,40] can produce high-quality images corresponding to descriptive text prompts, making them highly popular on social media.”
BackgroundPolak, M. P., Modi, S., Latosinska, A., Zhang, J., Wang, C.-W., Wang, S., Hazra, A. D., & Morgan, D. D. (2024) · Digital Discovery · doi:10.1039/d4dd00016a · Cited by 60
“The impact of prompts has already been widely observed in NLP-based text to image generation tools (e.g., DALL-E2 [43], MidJourney [44], Stable Diffusion [45]) and a similar situation occurs in the present application.”
BackgroundSpectral-Cascaded Diffusion Model for Remote Sensing Image Spectral Super-Resolution
Chen, B., Liu, L., Liu, C., Zou, Z., & Shi, Z. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3450874 · Cited by 51
“With the burgeoning of deep learning techniques in the domain of natural image generation [12], [13], deep learning-based methods are progressively gaining popularity in the field of spectral super-resolution.”
BackgroundMethodVideo Interpolation with Diffusion Models
Jain, S., Watson, D., Tabellion, E., Hołyński, A., Poole, B., & Kontkanen, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00701 · Cited by 69
“This ease of training has led to significant advances in generative modeling, such as compelling results in text-to-image [38, 40, 44] and text-to-video [17, 55] generation, image-conditioned generation tasks [43], and even 3D novel view synthesis [27, 36, 58].”
BackgroundDiffusionTrack: Point Set Diffusion Model for Visual Object Tracking
Xie, F., Wang, Z., & Ma, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01808 · Cited by 58
“Diffusion models have recently demonstrated remarkable results in fields including computer vision [3, 24, 30, 32, 38, 69, 73, 77, 78, 81, 110, 116], nature language processing [2, 28, 55], audio processing [40, 45, 50, 72, 89, 102, 109] and graph-related topics [41].”
BackgroundMethodShi, H. H., Fang, L., Chen, X., Gu, C., Ma, K., Zhang, X., Zhang, Z., Gu, J., & Lim, E. G. (2024) · IET Smart Grid · doi:10.1049/stg2.12191 · Cited by 52
Multimodal foundation models for material property prediction and discovery
Moro, V., Loh, C., Dangovski, R., Ghorashi, A., Ma, A., Chen, Z., Kim, S., Lu, P. Y., Christensen, T., & Marin Soljacic, A. (2025) · Newton · doi:10.1016/j.newton.2025.100016 · Cited by 69
Artificial Intelligence Can Persuade Humans on Political IssuesPreprint
Bai, H., Voelkel, J. G., Eichstaedt, J. C., & Willer, R. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/stakv · Cited by 58
AI models for protein design are driving antibody engineering
Chungyoun, M., & Gray, J. J. (2023) · Current Opinion in Biomedical Engineering · doi:10.1016/j.cobme.2023.100473 · Cited by 40
The Ethical Implications of Generative Audio Models: A Systematic Literature Review
Barnett, J. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604686 · Cited by 61
“3604686 DALLE-2 [50] for vision, and Jukebox [16]† for music.”
BackgroundInfluentialLDFA: Latent Diffusion Face Anonymization for Self-driving Applications
Klemp, M., Rösch, K., Wagner, R., Quehl, J., & Lauer, M. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00322 · Cited by 42
“Diffusion models (DMs) are generative models that recently showed particularly great success in the domain of image generation [26,27,29].”
BackgroundOne-shot Unsupervised Domain Adaptation with Personalized Diffusion Models
Benigmim, Y., Roy, S., Essid, S., Kalogeiton, V. S., & Lathuilière, S. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00077 · Cited by 50
“Very recently, diffusion models (DM) [19, 44] have brought a paradigm shift in the generative modeling landscape, showing excellent capabilities at generating photo-realistic text-conditioned images [33, 36, 41].”
Explore the Power of Synthetic Data on Few-shot Object Detection
Lin, S., Wang, K., Zeng, X., & Zhao, R. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00071 · Cited by 55
SceneComposer: Any-Level Semantic Image Synthesis
Zeng, Y., Lin, Z., Zhang, J., Liu, Q., Collomosse, J. P., Kuen, J., & Patel, V. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02152 · Cited by 50
“They mostly consider fixed-level semantics as the input, e.g . image-level text descriptions in text-to-image generation (T2I) [37, 41, 43, 45, 46], or pixel-level segmentation maps in segmentation-to-image generation (S2I) [23,38,67].”
BackgroundExploiting Cultural Biases via Homoglyphs in Text-to-Image Synthesis
Struppek, L., Hintersdorf, D., Friedrich, F., Br, M., Schramowski, P., & Kersting, K. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15388 · Cited by 77
“One such example is the recently introduced text-conditioned image generation model DALL-E 2 [43].”
BackgroundZheng, C., & Vedaldi, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02084 · Cited by 61
“…downstream tasks, including image generation [31, 44, 6, 22, 17], image-to-image translation [11, 30, 10, 32], text-to-image synthesis [30, 9, 29, 18], conditional video generation [28, 40, 42], image completion [11, 10, 46], recognition [26, 3, 44, 24, 23] and 3D reconstruction [27, 34, 33].”
BackgroundDirected Diffusion: Direct Control of Object Placement through Attention Guidance
Ma, W.-D. K., Lahiri, A., Lewis, J., Leung, T., & Kleijn, W. B. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28204 · Cited by 69
ProxEdit: Improving Tuning-Free Real Image Editing with Proximal Guidance
Han, L., Song, W., Chen, Q., Zhang, Z., Song, K., Ren, M., Gao, R., Stathopoulos, A., He, X., Chen, Y., et al. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00424 · Cited by 93
Zhuang, Y., Kang, Y., Fei, T., Bian, M., & Du, Y. (2024) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2024.102122 · Cited by 45
“Several notable large language models (LLMs) such as Imagen (Saharia et al., 2022a, b), Midjourney (Oppen-laender, 2022), and DALL-E2 (Ramesh et al., 2022) incorporate Stable Diffusion as a crucial component in their architecture for image generation from texts (Saharia et al., 2022a, b).”
Xing, Y., Qu, L., Zhang, S., Zhang, K., Zhang, Y., & Bruzzone, L. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3461476 · Cited by 42
“DDPM has achieved excellent results in image super-resolution [50], text-to-image generation [51], [66], [67], semantic segmentation [32], image colorization [52] and change detection [58].”
BackgroundCazenavette, G., Sud, A., Leung, T., & Usman, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01023 · Cited by 59
SVGDreamer: Text Guided SVG Generation with Diffusion Model
Xing, X., Zhou, H., Wang, C., Zhang, J., Dong, X., & Yu, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00435 · Cited by 73
“More recently, the remarkable progress of text-to-image (T2I) diffusion models [19, 22, 24, 25, 35] has inspired text-to-vector generation.”
SpotLessSplats: Ignoring Distractors in 3D Gaussian Splatting
Sabour, S., Goli, L., Kopanas, G., Matthews, M., Lagun, D., Guibas, L. J., Jacobson, A., Fleet, D. J., & Tagliasacchi, A. (2025) · ACM Transactions on Graphics · doi:10.1145/3727143 · Cited by 85
“Note that, unlike NeRF, which renders one pixel at a time , 3DSG renders the entire image in a single forward pass.”
The application of artificial intelligence to biology and neuroscience
Richards, B., Tsao, D., & Zador, A. (2022) · Cell · doi:10.1016/j.cell.2022.06.047 · Cited by 38
Intention-Conditioned Long-Term Human Egocentric Action Anticipation
Mascaro, E. V., Ahn, H., & Lee, D. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00599 · Cited by 45
“Finally, Diffusion Models (DMs) [14] have become popular recently due to their great performance in image synthesis tasks [25, 27].”
Background
Metadata
- Authors
- Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M.
- ORCID
- Chen, Mark
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2204.06125
- OpenAlex
- W4224035735
- Cited by
- 2,511
- References
- 66
- Citations by year
- 2026: 46 · 2025: 429 · 2024: 1113 · 2023: 859 · 2022: 63
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- text-to-image generation, diffusion models, image priors, image variation, photorealism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
