The DOI matches its Crossref record; 88 of the 91 references it cites were found in a registry or an index.
Adding Conditional Control to Text-to-Image Diffusion Models
Abstract
We present ControlNet, a neural network architecture to add spatial conditioning controls to large, pretrained text-to-image diffusion models. ControlNet locks the production-ready large diffusion models, and reuses their deep and robust encoding layers pretrained with billions of images as a strong backbone to learn a diverse set of conditional controls. The neural architecture is connected with "zero convolutions" (zero-initialized convolution layers) that progressively grow the parameters from zero and ensure that no harmful noise could affect the finetuning. We test various conditioning controls, e.g., edges, depth, segmentation, human pose, etc., with Stable Diffusion, using single or multiple conditions, with or without prompts. We show that the training of ControlNets is robust with small (1m) datasets. Extensive results show that ControlNet may facilitate wider applications to control image diffusion models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Image annotations, including prompts and spatial cues [92, 121], are essential for training and evaluating image generation models as they provide localized and semantically rich supervision that help models learn meaningful visual representations.”
From Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation (2026) · cites this paper as [121]
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881
Research works printed but not linked: 13
- 2022, Disco diffusion
- 2022, Protogen x3.4 (photorealism) official release
- Ha, Hypernetworks
- 2022, Hypernetwork style training, a tiny guide, stable-diffusion-webui
- 10.1109/TPAMI.2020.2970919 · DOI · Paper page
- 2022, Novelai improvements on stable diffusion
- Lehtinen, Noise2noise: Learning image restoration without clean data
- 2023, Midjourney
- 2022, Comic-diffusion v2, trained on 6 styles at once
- 2023, Dall-e-2
- Schuhmann, LAION-5b: An open large-scale dataset for training next generation image-text models
- 2022, Stable diffusion v1.5 model card
- 2022, Stable diffusion v2 model card, stable-diffusion-2-depth
Cited by
Sorted by citations
Items 501–600 of 1,012
DeferredGS: Decoupled and Relightable Gaussian Splatting With Deferred Shading
Wu, T., Sun, J.-M., Lai, Y., Ma, Y., Kobbelt, L. P., & Gao, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3560933 · Cited by 26
Semantics-Guided Diffusion for Deep Joint Source-Channel Coding in Wireless Image Transmission
Zhang, M., Wu, H., Zhu, G., Jin, R., Chen, X., & Gündüz, D. (2025) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2025.3591456 · Cited by 36
Li, X., Wang, X., Li, B., Yuan, K., Shao, Y., Yao, S., Sun, M., Zhou, C., Timofte, R., & Chen, Z. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00108 · Cited by 26
Chen, P., Shen, M., Ye, P. D., Cao, J., Tu, C., Bouganis, C.-S., Zhao, Y., & Chen, T. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02871-7 · Cited by 178
DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagation
Yang, B., Dong, W., Ma, L., Hu, W., Liu, X., Cui, Z., & Ma, Y. (2024) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr58804.2024.00085 · Cited by 32
Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior
Liu, F., Wu, D., Wei, Y., Rao, Y., & Duan, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01962 · Cited by 43
CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation
Tang, Z., Yang, Z., Khademi, M., Liu, Y., Zhu, C., & Bansal, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02589 · Cited by 57
FreeDrag: Feature Dragging for Reliable Point-Based Image Editing
Ling, P., Chen, L., Zhang, P., Chen, H., Jin, Y., & Zheng, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00655 · Cited by 56
Liu, X., Chen, J., Kao, S.-H., Tai, Y., & Tang, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72640-8_19 · Cited by 26
MagicStick: Controllable Video Editing via Control Handle Transformations
Ma, Y., Cun, X., Liang, S., Xing, J., He, Y., Qi, C., Chen, S., & Chen, Q. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00909 · Cited by 63
Weakly-supervised deepfake localization in diffusion-generated images
Ţânţaru, D.-C., Oneaţă, E., & Oneaţă, D. (2024) · 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv57701.2024.00614 · Cited by 25
Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models
Lin, D. C.-E., & Martelaro, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641920 · Cited by 29
SPAD: Spatially Aware Multi-View Diffusers
Kant, Y., Siarohin, A., Wu, Z., Vasilkovsky, M., Qian, G., Ren, J. F., Güler, R. A., Ghanem, B., Tulyakov, S., & Gilitschenski, I. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00956 · Cited by 44
Still-Moving: Customized Video Generation without Customized Video Data
Chefer, H., Zada, S., Paiss, R., Ephrat, A., Tov, O., Rubinstein, M., Wolf, L., Dekel, T., Michaeli, T., & Mosseri, I. (2024) · ACM Transactions on Graphics · doi:10.1145/3687945 · Cited by 25
A review of deep learning-based approaches to sign language processing
Tan, S., Khan, N., An, Z., Ando, Y., Kawakami, R., & Nakadai, K. (2024) · Advanced Robotics · doi:10.1080/01691864.2024.2442721 · Cited by 28
Chen, Y., Xiao, S., Song, Y., Li, Z., Sun, L., & Chen, L. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2475991 · Cited by 28
Opportunities and Challenges of Foundation Models in Industrial Manufacturing
Ayyat, M., Osman, M., & Nadeem, T. (2025) · IEEE Access · doi:10.1109/access.2025.3589777 · Cited by 25
From Poses to Identity: Training-Free Person Re-Identification via Feature Centralization
Yuan, C., Zhang, G., Ma, C., Zhang, T., & Niu, G. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02273 · Cited by 25
UltraFusion: Ultra High Dynamic Imaging using Exposure Fusion
Chen, Z., Wang, Y., Cai, X., You, Z., Lu, Z.-M., Zhang, F., Guo, S., & Xue, T. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01502 · Cited by 25
Deep learning in plant phenotyping: the first ten years
Ubbens, J. R., Stavness, I., Pound, M. P., & Guo, W. (2025) · Plant Phenomics · doi:10.1016/j.plaphe.2025.100062 · Cited by 29
He, Y., Li, S., Li, K., Wang, J., Li, B., Shi, T., Xin, Y., Li, K., Yin, J., Zhang, M., et al. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129649 · Cited by 53
Using New AI-Driven Techniques to Ease Serious Games Authoring
Pérez-Colado, I. J., Pérez-Colado, V. M., Calvo-Morata, A., Píriz, R. S. C., & Fernández‐Manjón, B. (2023) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie58773.2023.10343021 · Cited by 30
Towards a Simultaneous and Granular Identity-Expression Control in Personalized Face Generation
Liu, R., Ma, B., Zhang, W., Hu, Z., Fan, C., Lv, T., Ding, Y., & Cheng, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00206 · Cited by 35
PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Models
Zhang, Y., Xing, Z., Zeng, Y., Fang, Y., & Chen, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00740 · Cited by 42
TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Models
Zhang, Z., Long, F., Pan, Y., Qiu, Z., Yao, T., Cao, Y., & Mei, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00828 · Cited by 32
PAIR Diffusion: A Comprehensive Multimodal Object-Level Image Editor
Goel, V., Peruzzo, E., Jiang, Y., Xu, D., Xu, X., Sebe, N., Darrell, T., Wang, Z., & Shi, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00822 · Cited by 64
LEO: Generative Latent Image Animator for Human Video Synthesis
Wang, Y., Ma, X., Chen, X., Chen, C., Dantcheva, A., Dai, B., & Qiao, Y. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02231-3 · Cited by 42
FreeMotion: A Unified Framework for Number-Free Text-to-Motion Synthesis
Fan, K., Tang, J., Cao, W., Yi, R., Li, M., Gong, J., Zhang, J., Wang, Y., Wang, C., & Ma, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73242-3_6 · Cited by 25
Zhu, Y., Wang, Y., Shi, H., Zhang, Z., Jiao, D., & Tang, S. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645439 · Cited by 24
Zhang, X., Jiang, S., Zheng, N., Xia, X., Li, Z., Zhang, R., Zhang, J., & Wang, X. (2024) · Water Resources Research · doi:10.1029/2023wr036893 · Cited by 26
You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image Retrieval
Koley, S., Bhunia, A. K., Sain, A., Chowdhury, P. N., Xiang, T., & Song, Y.-Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01562 · Cited by 26
Image Sculpting: Precise Object Editing with 3D Geometry Control
Yenphraphai, J., Pan, X., Liu, S., Panozzo, D., & Xie, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00406 · Cited by 33
Attention Calibration for Disentangled Text-to-Image Personalization
Zhang, Y., Yang, M., Zhou, Q., & Wang, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00456 · Cited by 28
A Product’s Kansei Appearance Design Method Based on Conditional-Controlled AI Image Generation
Du, Y., Liu, X., Cai, M., & Park, K. (2024) · Sustainability · doi:10.3390/su16208837 · Cited by 24
DiffFAS: Face Anti-spoofing via Generative Diffusion Models
Ge, X., Liu, X., Yu, Z., Shi, J., Qi, C., Li, J., & Kalviainen, H. A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72949-2_9 · Cited by 24
Ding, J., Du, Y., Li, W., Pei, L., & Cui, N. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102870 · Cited by 25
MoonShot: Towards Controllable Video Generation and Editing with Motion-Aware Multimodal Conditions
Zhang, D. J., Li, D., Le, H., Shou, M. Z., Xiong, C., & Sahoo, D. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02346-1 · Cited by 66
D 3 : Scaling Up Deepfake Detection by Learning from Discrepancy
Yang, Y., Qian, Z., Zhu, Y., Russakovsky, O., & Wu, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02221 · Cited by 39
ImaginateAR: AI-Assisted In-Situ Authoring in Augmented Reality
Lee, J., Aleotti, F., Mazala, D., Garcia-Hernando, G., Vicente, S., Johnston, O., Kraus-Liang, I., Powierza, J., Shin, D.-H., Froehlich, J. E., et al. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747635 · Cited by 39
EasyControl: Adding Efficient and Flexible Control for Diffusion Transformer
Zhang, Y. S., Yuan, Y., Song, Y., Wang, H., & Liu, J. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01814 · Cited by 101
Understanding image-text relations and news values for multimodal news analysis
Cheema, G. S., Hakimov, S., Müller-Budack, E., Otto, C., Bateman, J. A., & Ewerth, R. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1125533 · Cited by 32
EditAnything: Empowering Unparalleled Flexibility in Image Editing and Generation
Gao, S., Lin, Z., Xie, X., Zhou, P., Cheng, M., & Yan, S. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612680 · Cited by 24
BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesis
Cao, T., Wang, C., Liu, B., Wu, Z., Zhu, J., & Huang, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.1 · Cited by 42
UPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfer
Cheong, S. Y., Mustafa, A., & Gilbert, A. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00451 · Cited by 27
HanDiffuser: Text-to-Image Generation with Realistic Hand Appearances
Narasimhaswamy, S., Bhattacharya, U., Chen, X., Dasgupta, I., Mitra, S., & Hoai, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00239 · Cited by 38
SODA: Bottleneck Diffusion Models for Representation Learning
Hudson, D. A., Zoran, D., Malinowski, M., Lampinen, A. K., Jaegle, A., McClelland, J. L., Matthey, L., Hill, F., & Lerchner, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02181 · Cited by 52
SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors
Chen, D. Z., Li, H., Lee, H.-Y., Tulyakov, S., & Nießner, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01992 · Cited by 43
NoiseCollage: A Layout-Aware Text-to-Image Diffusion Model Based on Noise Cropping and Merging
Shirakawa, T., & Uchida, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00852 · Cited by 31
Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal
Yang, Y., Wu, H., Avilés-Rivero, A. I., Zhang, Y., Qin, J., & Zhu, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02419 · Cited by 29
HandRefiner: Refining Malformed Hands in Generated Images by Diffusion-based Conditional Inpainting
Lu, W., Xu, Y., Zhang, J., Wang, C., & Tao, D. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680693 · Cited by 35
Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions
Tosi, F., Ramirez, P. Z., & Poggi, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73337-6_14 · Cited by 34
Distilling Diffusion Models Into Conditional GANs
Kang, M., Zhang, R., Barnes, C., Paris, S., Kwak, S., Park, J., Shechtman, E., Zhu, J.-Y., & Park, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73390-1_25 · Cited by 24
FlashTex: Fast Relightable Mesh Texturing with LightControlNet
Deng, K., Omernick, T., Weiss, A., Ramanan, D., Zhu, J.-Y., Zhou, T., & Agrawala, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73383-3_6 · Cited by 24
Self-citationWeatherDG: LLM-Assisted Procedural Weather Generation for Domain-Generalized Semantic Segmentation
Qian, C., Guo, Y., Mo, Y., & Li, W. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3559821 · Cited by 36
UniReal: Universal Image Generation and Editing via Learning Real-world Dynamics
Chen, X., Zhang, Z., Zhang, H., Zhou, Y., Kim, S. Y., Liu, Q., Li, Y., Zhang, J., Zhao, N., Wang, Y., et al. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.01166 · Cited by 23
Fresco: Spatial-Temporal Correspondence for Zero-Shot Video Translation
Yang, S., Zhou, Y., Liu, Z., & Loy, C. C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00831 · Cited by 34
SemCity: Semantic Scene Generation with Triplane Diffusion
Lee, J., Lee, S., Jo, C., Im, W., Seon, J., & Yoon, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02677 · Cited by 33
MultiDiff: Consistent Novel View Synthesis from a Single Image
Müller, N., Schwarz, K., Roessle, B., Porzi, L., Bulò, S. R., Nießner, M., & Kontschieder, P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00977 · Cited by 40
SGE: Semantic-guided Generalization Enhancement for Few-Shot Learning
Zheng, Z., Zhu, Y., Wu, H., Lv, L., Niu, S., & Yu, G. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113761 · Cited by 24
Human Motion Video Generation: A Survey
Xue, H., Luo, X., Hu, Z., Zhang, X., Xiang, X., Dai, Y., Liu, J., Zhang, Z., Li, M., Yang, J. J., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3594034 · Cited by 29
MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modeling
Men, Y., Yao, Y., Cui, M., & Bo, L. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01973 · Cited by 23
Large Language Models for Computer-Aided Design: A Survey
Zhang, L., Le, B., Akhtar, N., Lam, S.-K., & Ngo, D. (2026) · ACM Computing Surveys · doi:10.1145/3787499 · Cited by 43
Self-citationDiffusion Models and Representation Learning: A Survey
Fuest, M., Ma, P., Gui, M., Schusterbauer, J., Hu, V. T., & Ommer, B. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3658965 · Cited by 60
IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Design
Shen, F., Yu, J. F., Wang, C., Jiang, X., Du, X., & Tang, J. (2026) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2026.3671365 · Cited by 23
3DStyle-Diffusion: Pursuing Fine-grained Text-driven 3D Stylization with 2D Diffusion Models
Yang, H., Chen, Y., Pan, Y., Yao, T., Chen, Z., & Mei, T. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612363 · Cited by 23
Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views
Zou, Z., Cheng, W., Cao, Y., Huang, S.-S., Shan, Y., & Zhang, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28626 · Cited by 23
Depth-aware guidance with self-estimated depth representations of diffusion models
Kim, G., Jang, W., Lee, G., Hong, S., Seo, J., & Kim, S. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110474 · Cited by 33
A Comparative Analysis Between GAN and Diffusion Models in Image Generation
Peng, Y. (2024) · Transactions on Computer Science and Intelligent Systems Research · doi:10.62051/0f1va465 · Cited by 26
Watermark-embedded Adversarial Examples for Copyright Protection against Diffusion Models
Zhu, P., Takahashi, T., & Kataoka, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02305 · Cited by 28
PLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesis
Lv, Z., Wei, Y., Zuo, W., & Wong, K.-Y. K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00885 · Cited by 27
PFB-Diff: Progressive Feature Blending diffusion for text-driven image editing
Huang, W., Tu, S., & Xu, L. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106777 · Cited by 30
Discriminative Correspondence Estimation for Unsupervised RGB-D Point Cloud Registration
Yan, C., Feng, M., Wu, Z., Guo, Y., Dong, W., Wang, Y., & Mian, A. S. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3480268 · Cited by 24
XPSR: Cross-Modal Priors for Diffusion-Based Image Super-Resolution
Qu, Y., Yuan, K., Zhao, K., Xie, Q., Hao, J., Sun, M. W., & Zhou, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73247-8_17 · Cited by 28
Disentangled Clothed Avatar Generation from Text Descriptions
Wang, J., Liu, Y., Dou, Z., Yu, Z., Liang, Y., Lin, C. C., Xie, R., Song, L., Li, X. S., & Wang, W. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72943-0_22 · Cited by 38
DreamReward: Text-to-3D Generation with Human Preference
Ye, J., Liu, F., Li, Q., Wang, Z., Wang, Y., Wang, X., Duan, Y., & Zhu, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72897-6_15 · Cited by 44
Zhang, M., Yin, J., Zeng, P., Shen, Y., Lü, S., & Wang, X. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129509 · Cited by 24
Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images
Cui, A., Mahajan, J., Shah, V., Gomathinayagam, P., Liu, C., & Lazebnik, S. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00145 · Cited by 23
Wen, Y., & Wang, L. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02175-7 · Cited by 25
Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidance
Shen, D., Song, G., Xue, Z., Wang, F.-Y., & Liu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00895 · Cited by 32
Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruning
Zhang, X., Du, J., Li, Y., Xie, W., & Zhou, J. T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02477 · Cited by 26
RoHM: Robust Human Motion Reconstruction via Diffusion
Zhang, S., Bhatnagar, B. L., Xu, Y., Winkler, A., Kadleček, P., Tang, S., & Bogo, F. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01384 · Cited by 30
Tailored Visions: Enhancing Text-to-Image Generation with Personalized Prompt Rewriting
Chen, Z., Zhang, L., Weng, F., Pan, L., & Lan, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00738 · Cited by 27
Self-citationEgusquiza, I., Benito-Del-Valle, L., Picón, A., Bereciartua, A., Gómez-Zamanillo, L., Elola, A., Aramendi, E., Espejo, R., Eggers, T., Klukas, C., et al. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109690 · Cited by 23
ChatTraffic: Text-to-Traffic Generation via Diffusion Model
Zhang, C., Zhang, Y., Shao, Q., Li, B., Lv, Y., Piao, X., & Yin, B. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3510402 · Cited by 27
Generating conceptual landscape design via text-to-image generative AI model
Ye, X., Huang, T., Song, Y. H., Li, X. S., Newman, G., Wu, D. J., & Zeng, Y. (2025) · Environment and Planning B Urban Analytics and City Science · doi:10.1177/23998083251316064 · Cited by 24
Generative AI in Fashion: Overview
Shi, W.-P., Wong, W. K., & Zou, X. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3718098 · Cited by 22
SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior
Yu, Z., Wang, H., Yang, J., Wang, H., Cao, J., Ji, Z., & Sun, M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00375 · Cited by 41
Taming a Diffusion Model to Revitalize Remote Sensing Image Super-Resolution
Zhu, C. N., Liu, Y., Huang, S., & Wang, F. (2025) · Remote Sensing · doi:10.3390/rs17081348 · Cited by 27
GPTDrawer: Enhancing Visual Synthesis Through ChatGPT
Li, K., Chen, X., Song, T., Zhang, H., Zhang, W., & Shan, Q. (2025) · International Conference on Neural Networks, Information and Communication Engineering (NNICE) · doi:10.1109/nnice64954.2025.11064518 · Cited by 24
Unified residential floor plan generation with multimodal inputs
Zeng, P., Yin, J., Zhang, M., Li, J., Zhang, Y., & Lu, S. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106408 · Cited by 22
Unconditional latent diffusion models memorize patient imaging data
Dar, S. U. H., Seyfarth, M., Ayx, I., Papavassiliu, T., Schoenberg, S. O., Siepmann, R. M., Laqua, F. C., Kahmann, J., Frey, N., Baeßler, B., et al. (2025) · Nature Biomedical Engineering · doi:10.1038/s41551-025-01468-8 · Cited by 22
AI-generated content in landscape architecture: A survey
Xing, Y., Gan, W., Chen, Q., & Yu, P. S. (2025) · AI Open · doi:10.1016/j.aiopen.2025.10.002 · Cited by 24
Lumina-mGPT: Flexible Photorealistic Autoregressive Text-to-Image Generation
Liu, D., Xin, Y., Zhao, S., Zhuo, L., Lin, W., Li, X., Qin, Q., Zhai, G., Liu, X., Li, H., et al. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02795-2 · Cited by 145
GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fields
Roessle, B., Muller, N. E., Porzi, L., Bulò, S. R., Kontschieder, P., & Nießner, M. (2023) · ACM Transactions on Graphics · doi:10.1145/3618402 · Cited by 22
Attention to the Electroretinogram: Gated Multilayer Perceptron for ASD Classification
Kulyabin, M., Constable, P. A., Zhdanov, A. E., Lee, I., Thompson, D., & Maier, A. (2024) · IEEE Access · doi:10.1109/access.2024.3386638 · Cited by 23
Examining Human Perception of Generative Content Replacement in Image Privacy Protection
Xu, A., Fang, S., Yang, H., Hosio, S. J., & Yatani, K. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642103 · Cited by 22
Creating High-Quality 3D Content by Bridging the Gap between Text-to-2D and Text-to-3D Generation
Ma, Y., Fan, Y., Ji, J., Wang, H., Yin, H., Sun, X., & Ji, R. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3687475 · Cited by 24
Diffusion-based inpainting approach for multifunctional short-term load forecasting
Zhang, L., Jiang, Z., Ji, T., & Chen, Z. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.124442 · Cited by 27
Self-citationPrompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Models
Mahajan, S., Rahman, T., Yi, K. M., & Sigal, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00650 · Cited by 34
Diffusion-Driven GAN Inversion for Multi-Modal Face Image Generation
Kim, J., Oh, C., Do, H., Kim, S.-H., & Sohn, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00990 · Cited by 24
Metadata
- Authors
- Zhang, L., Rao, A., & Agrawala, M.
- Affiliations
- Stanford University (US)
- Venue
- 2023 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2023-10-01
- Pages
- 3813-3824
- OpenAlex
- W4390873054
- Cited by
- 4,547
- References
- 91
- Citations by year
- 2026: 1290 · 2025: 1847 · 2024: 1255 · 2023: 155
- FWCI
- 486.28
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Brown Institute for Media Innovation
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- ControlNet, text-to-image diffusion models, spatial conditioning, conditional image generation, Stable Diffusion, parameter-efficient fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
