The DOI matches its Crossref record; 88 of the 91 references it cites were found in a registry or an index.
Adding Conditional Control to Text-to-Image Diffusion Models
Abstract
We present ControlNet, a neural network architecture to add spatial conditioning controls to large, pretrained text-to-image diffusion models. ControlNet locks the production-ready large diffusion models, and reuses their deep and robust encoding layers pretrained with billions of images as a strong backbone to learn a diverse set of conditional controls. The neural architecture is connected with "zero convolutions" (zero-initialized convolution layers) that progressively grow the parameters from zero and ensure that no harmful noise could affect the finetuning. We test various conditioning controls, e.g., edges, depth, segmentation, human pose, etc., with Stable Diffusion, using single or multiple conditions, with or without prompts. We show that the training of ControlNets is robust with small (1m) datasets. Extensive results show that ControlNet may facilitate wider applications to control image diffusion models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Image annotations, including prompts and spatial cues [92, 121], are essential for training and evaluating image generation models as they provide localized and semantically rich supervision that help models learn meaningful visual representations.”
From Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation (2026) · cites this paper as [121]
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881
Research works printed but not linked: 13
- 2022, Disco diffusion
- 2022, Protogen x3.4 (photorealism) official release
- Ha, Hypernetworks
- 2022, Hypernetwork style training, a tiny guide, stable-diffusion-webui
- 10.1109/TPAMI.2020.2970919 · DOI · Paper page
- 2022, Novelai improvements on stable diffusion
- Lehtinen, Noise2noise: Learning image restoration without clean data
- 2023, Midjourney
- 2022, Comic-diffusion v2, trained on 6 styles at once
- 2023, Dall-e-2
- Schuhmann, LAION-5b: An open large-scale dataset for training next generation image-text models
- 2022, Stable diffusion v1.5 model card
- 2022, Stable diffusion v2 model card, stable-diffusion-2-depth
Cited by
Sorted by citations
Items 201–300 of 1,012
Panacea: Panoramic and Controllable Video Generation for Autonomous Driving
Wen, Y., Zhao, Y., Liu, Y., Jia, F., Wang, Y., Luo, C., Zhang, C., Wang, T., Sun, X., & Zhang, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00659 · Cited by 100
MAISI: Medical AI for Synthetic Imaging
Guo, P., Zhao, C., Yang, D., Xu, Z., Nath, V., Tang, Y., Simon, B., Belue, M. J., Harmon, S. A., Türkbey, B., et al. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00435 · Cited by 94
StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text
Henschel, R. D., Khachatryan, L., Poghosyan, H., Hayrapetyan, D., Tadevosyan, V., Wang, Z., Navasardyan, S., & Shi, H. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00245 · Cited by 56
Control3D: Towards Controllable Text-to-3D Generation
Chen, Y., Pan, Y., Li, Y., Yao, T., & Mei, T. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612489 · Cited by 55
Zero-shot spatial layout conditioning for text-to-image diffusion models
Couairon, G., Careil, M., Cord, M., Lathuilière, S., & Verbeek, J. J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00207 · Cited by 68
IT3D: Improved Text-to-3D Generation with Explicit View Synthesis
Chen, Y., Zhang, C., Yang, X., Cai, Z., Yu, G., Yang, L., & Lin, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i2.27886 · Cited by 71
Chen, X., & Zhang, X. (2023) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3625687.3625798 · Cited by 56
Transparent Image Layer Diffusion using Latent Transparency
Zhang, L., & Agrawala, M. (2024) · ACM Transactions on Graphics · doi:10.1145/3658150 · Cited by 115
Self-citationSiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion
Ho, H.-I., Song, J., & Hilliges, O. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00058 · Cited by 73
PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
Yang, Y., Jia, B., Zhi, P., & Huang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01539 · Cited by 83
DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model
Zhang, Z., Yao, L., Wang, B., Jha, D., Durak, G., Keleş, E., Medetalibeyoğlu, A., & Bağcı, U. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3519307 · Cited by 55
DiffusionShield: A Watermark for Data Copyright Protection against Generative Diffusion Models
Cui, Y., Ren, J., Xu, H., He, P., Liu, H., Sun, L., Xing, Y., & Tang, J. (2025) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3715073.3715079 · Cited by 106
Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes
Ju, X., Zeng, A., Wang, J., Xu, Q., & Zhang, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00067 · Cited by 60
Self-citationDirect-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion
Yang, S., Hou, L., Huang, H., Ma, C., Wan, P., Zhang, D., Chen, X., & Liao, J. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657481 · Cited by 115
Directed Diffusion: Direct Control of Object Placement through Attention Guidance
Ma, W.-D. K., Lahiri, A., Lewis, J., Leung, T., & Kleijn, W. B. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28204 · Cited by 69
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models
Aneja, S., Thies, J., Dai, A., & NieBner, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02009 · Cited by 62
Generalized Predictive Model for Autonomous Driving
Yang, J., Gao, S., Qiu, Y., Chen, L., Li, T., Dai, B., Chitta, K., Wu, P., Zeng, J., Luo, P., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01389 · Cited by 85
DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting
Zhou, S., Fan, Z., Xu, D., Chang, H., Chari, P., Bharadwaj, T., You, S. O., Wang, Z., & Kadambi, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72658-3_19 · Cited by 54
Prompting for Discovery: Flexible Sense-Making for AI Art-Making with Dreamsheets
Almeda, S. G., Zamfirescu-Pereira, J. D., Kim, K. W., Rathnam, P. M., & Hartmann, B. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642858 · Cited by 69
The Impact of Sketch-guided vs. Prompt-guided 3D Generative AIs on the Design Exploration Process
Lee, S. W., Jo, T. H., Jin, S., Choi, J., Yun, K., Bromberg, S., Ban, S., & Hyun, K. H. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642218 · Cited by 53
GenQuery: Supporting Expressive Visual Search with Generative Models
Son, K., Choi, D., Kim, T. S., Kim, Y., & Kim, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642847 · Cited by 71
MedSyn: Text-Guided Anatomy-Aware Synthesis of High-Fidelity 3-D CT Images
Xu, Y., Sun, L., Peng, W., Jia, S., Morrison, K., Perer, A., Zandifar, A., Visweswaran, S., Eslami, M., & Batmanghelich, K. N. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3415032 · Cited by 68
SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generation
Zhang, Y., Song, Y., Liu, J., Wang, R., Yu, J., Tang, H., Li, H., Tang, X., Hu, Y., Pan, H. C., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00771 · Cited by 54
The Potential of Visual ChatGPT for Remote Sensing
Osco, L. P., de Lemos, E. L., Gonçalves, W. N., Ramos, A. P. M., & Marcato, J. (2023) · Remote Sensing · doi:10.3390/rs15133232 · Cited by 52
AvatarVerse: High-Quality & Stable 3D Avatar Creation from Text and Pose
Zhang, H., Chen, B., Yang, H., Qu, L., Wang, X., Chen, L. Y., Long, C., Zhu, F., Du, D. K., & Zheng, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28540 · Cited by 52
DressCode: Autoregressively Sewing and Generating Garments from Text Guidance
He, K., Yao, K., Zhang, Q., Jingyi Yu, A., Liu, L., & Xu, L. (2024) · ACM Transactions on Graphics · doi:10.1145/3658147 · Cited by 52
Generative AI in the context of assistive technologies: Trends, limitations and future directions
Fu, B., Hadid, A., & Damer, N. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105347 · Cited by 57
Wang, C., & Sun, W. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.12.001 · Cited by 62
ContextCam: Bridging Context Awareness with Creative Human-AI Image Co-Creation
Fan, X., Wu, Z., Yu, C., Rao, F., Shi, W., & Tu, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642129 · Cited by 51
ITI-Gen: Inclusive Text-to-Image Generation
Zhang, C., Chen, X., Chai, S., Wu, C., Lagun, D., Beeler, T., & la Torre, F. D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00367 · Cited by 59
Huang, R., Lin, H., Chen, C., Kang Zhang, A., & Zeng, W. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642824 · Cited by 59
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering
Chen, J., Huang, Y., Lv, T., Cui, L., Chen, Q., & Wei, F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72652-1_23 · Cited by 97
MobileDiffusion: Instant Text-to-Image Generation on Mobile Devices
Zhao, Y., Xu, Y., Xiao, Z., Jia, H., & Hou, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73033-7_13 · Cited by 94
Generative Artificial Intelligence Meets Synthetic Aperture Radar: A survey
Huang, Z., Zhang, X., Tang, Z., Xu, F., Datcu, M. P., & Han, J. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3483459 · Cited by 65
MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation
Yu, Z., Liu, C., Liu, L., Shi, Z., & Zou, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3507010 · Cited by 66
GaussCtrl: Multi-view Consistent Text-Driven 3D Gaussian Splatting Editing
Wu, J., Bian, J.-W., Li, X., Wang, G., Reid, I. D., Torr, P. H. S., & Prisacariu, V. A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72630-9_4 · Cited by 81
AIdeation: Designing a Human-AI Collaborative Ideation System for Concept Designers
Wang, W.-F., Lu, C.-T., Ponsa i Campanyà, N., Chen, B.-Y., & Chen, M. Y. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714148 · Cited by 50
SceneDreamer: Unbounded 3D Scene Generation From 2D Image Collections
Chen, Z., Wang, G., & Liu, Z. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3321857 · Cited by 50
General Image-to-Image Translation with One-Shot Image Guidance
Cheng, B., Liu, Z., Peng, Y., & Lin, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02078 · Cited by 60
Matte anything: Interactive natural image matting with segment anything model
Yao, J., Wang, X., Ye, L., & Liu, W. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105067 · Cited by 61
VidToMe: Video Token Merging for Zero-Shot Video Editing
Li, X., Ma, C., Yang, X., & Yang, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00715 · Cited by 71
StyleAdapter: A Unified Stylized Image Generation Model
Wang, Z., Wang, X., Xie, L., Qi, Z., Shan, Y., Wang, W., & Luo, P. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02253-x · Cited by 91
Multi-Source Domain Adaptation by Causal-Guided Adaptive Multimodal Diffusion Networks
Cai, Z., Huang, Y., Zhang, T., Zheng, Y., & Yue, D. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02401-x · Cited by 55
SUR-adapter: Enhancing Text-to-Image Pre-trained Diffusion Models with Large Language Models
Zhong, S., Huang, Z., Wen, W., Qin, J., & Lin, L. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611863 · Cited by 52
An Analysis of Recent Advances in Deepfake Image Detection in an Evolving Threat Landscape
Abdullah, S. M., Cheruvu, A., Kanchi, S., Chung, T., Gao, P., Jadliwala, M. S., & Viswanath, B. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00194 · Cited by 58
Generative AI-powered architectural exterior conceptual design based on the design intent
Shi, M., Seo, J., Cha, S. H., Xiao, B., & Chi, H.-L. (2024) · Journal of Computational Design and Engineering · doi:10.1093/jcde/qwae077 · Cited by 50
Text-Guided Texturing by Synchronized Multi-View Diffusion
Liu, Y., Xie, M., Liu, H., & Wong, T. (2024) · SIGGRAPH Asia Conference Papers · doi:10.1145/3680528.3687621 · Cited by 49
Artificial-Intelligence-Generated Content with Diffusion Models: A Literature Review
Wang, X., He, Z., & Peng, X. (2024) · Mathematics · doi:10.3390/math12070977 · Cited by 55
Toward Real-World Blind Face Restoration With Generative Diffusion Prior
Chen, X., Tan, J., Wang, T., Zhang, K., Luo, W., & Cao, X. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3383659 · Cited by 59
Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessment
Zhou, T., Tan, S., Zhou, W., Luo, Y., Wang, Y., & Yue, G. (2024) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2024.3391060 · Cited by 48
Davis, R. L., Wambsganß, T., Jiang, W., Kim, K. G., Käser, T., & Dillenbourg, P. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642908 · Cited by 48
Li, Z., Bhat, S. F., & Wonka, P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00955 · Cited by 55
Li, X., Zhang, Y., & Ye, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73229-4_27 · Cited by 59
Intelligent Cinematography: a review of AI research for cinematographic production
Azzarelli, A., Anantrasirichai, N., & Bull, D. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11089-3 · Cited by 48
Urban planning in the era of large language models
Zheng, Y., Xu, F., Lin, Y., Santi, P., Ratti, C., Wang, Q., & Li, Y. (2025) · Nature Computational Science · doi:10.1038/s43588-025-00846-1 · Cited by 54
ControlStyle: Text-Driven Stylized Image Generation Using Diffusion Priors
Chen, J., Pan, Y., Yao, T., & Mei, T. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612524 · Cited by 47
DiFaReli: Diffusion Face Relighting
Ponglertnapakorn, P., Tritrong, N., & Suwajanakorn, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02070 · Cited by 56
IDF-CR: Iterative Diffusion Process for Divide-and-Conquer Cloud Removal in Remote-Sensing Images
Wang, M., Song, Y., Wei, P., Xian, X., Shi, Y., & Lin, L. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3378720 · Cited by 51
SDDGR: Stable Diffusion-Based Deep Generative Replay for Class Incremental Object Detection
Kim, J., Cho, H., Kim, J., Tiruneh, Y. Y., & Baek, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02718 · Cited by 55
GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning
Yuan, Y., Li, X., Huang, Y., Mello, S. D., Nagano, K., Kautz, J., & Iqbal, U. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00091 · Cited by 68
CEDNet: A cascade encoder–decoder network for dense prediction
Zhang, G., Li, Z., Tang, C., Li, J., & Hu, X. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.111072 · Cited by 48
Cross-Modal Conditioned Reconstruction for Language-Guided Medical Image Segmentation
Huang, X., Li, H., Cao, M., Chen, L., You, C., & An, D. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3523333 · Cited by 47
Duan, H., Shao, S., Zhai, B., Shah, T., Han, J., & Ranjan, R. K. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02398-3 · Cited by 49
Luo, X., Sun, J., Zhang, R., Chi, P., & Cui, R. (2024) · Computers & Geosciences · doi:10.1016/j.cageo.2024.105541 · Cited by 48
DREAM: Visual Decoding from REversing HumAn Visual SysteM
Xia, W., de Charette, R., Öztireli, C., & Xue, J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00804 · Cited by 54
Neural Canvas: Supporting Scenic Design Prototyping by Integrating 3D Sketching and Generative AI
Shen, Y., Shen, Y., Cheng, J., Jiang, C., Fan, M., & Wang, Z. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642096 · Cited by 46
Shao, Z., Chen, J., Zeng, H., Hu, W., Xu, Q., & Zhang, Y. (2024) · Buildings · doi:10.3390/buildings14061528 · Cited by 50
Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance
Zhao, Q., Long, P., Zhang, Q., Qin, D., Liang, H., Zhang, L., Zhang, Y., Jingyi Yu, A., & Xu, L. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657413 · Cited by 47
Self-citationSelf-Correcting LLM-Controlled Diffusion Models
Wu, T.-H., Lian, L., Gonzalez, J. E., Li, B., & Darrell, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00605 · Cited by 46
Efficient Diffusion Models: A Comprehensive Survey From Principles to Practices
Ma, Z., Zhang, Y., Jia, G., Zhao, L., Ma, Y., Ma, M., Liu, G., Zhang, K., Ding, N., Li, J., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3569700 · Cited by 72
Survey on Monocular Metric Depth Estimation
Zhang, J., Wu, Y., & Jiang, H. (2025) · Computers · doi:10.3390/computers14110502 · Cited by 46
X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attention
Xie, Y., Xu, H., Song, G., Wang, C., Shi, Y., & Luo, L. (2024) · Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers 24 · doi:10.1145/3641519.3657459 · Cited by 45
DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generation
Zeng, C., Dong, Y., Peers, P., Kong, Y., Wu, H., & Tong, X. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657396 · Cited by 45
Niemeijer, J., Schwonberg, M., Termöhlen, J.-A., Schmidt, N. M., & Fingscheidt, T. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00281 · Cited by 51
NetDiff: A Service-Guided Hierarchical Diffusion Model for Network Flow Trace Generation
Zhang, S., Li, T., Jin, D., & Li, Y. (2024) · Proceedings of the ACM on Networking · doi:10.1145/3676870 · Cited by 45
CCEdit: Creative and Controllable Video Editing via Diffusion Models
Feng, R., Weng, W., Wang, Y., Yuan, Y., Bao, J., Luo, C., Chen, Z., & Guo, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00641 · Cited by 67
Let the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Model
Xiao, S., Huang, S., Lin, Y., Ye, Y., & Zeng, W. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326913 · Cited by 44
Guided Image Synthesis via Initial Image Editing in Diffusion Model
Mao, J., Wang, X., & Aizawa, K. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612191 · Cited by 56
End-to-End Diffusion Latent Optimization Improves Classifier Guidance
Wallace, B., Gokul, A., Ermon, S., & Naik, N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00669 · Cited by 64
MMGInpainting: Multi-Modality Guided Image Inpainting Based on Diffusion Models
Zhang, C., Yang, W., Li, X., & Han, H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3382484 · Cited by 53
DemoFusion: Democratising High-Resolution Image Generation With No $$$
Du, R., Chang, D., Hospedales, T. M., Song, Y.-Z., & Ma, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00589 · Cited by 58
GPT4Point: A Unified Framework for Point-Language Understanding and Generation
Qi, Z., Fang, Y., Sun, Z., Wu, X., Wu, T., Wang, J., Lin, D., & Zhao, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02495 · Cited by 59
Multi-Track Timeline Control for Text-Driven 3D Human Motion Generation
Petrovich, M., Litany, O., Iqbal, U., Black, M. J., Varol, G., Peng, X. B., & Rempe, D. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00197 · Cited by 64
Generative Prompt Controlled Diffusion for weakly supervised semantic segmentation
Wu, W., Dai, T., Chen, Z., Huang, X., Ma, F., & Xiao, J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130103 · Cited by 49
Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach
Sun, L., Wu, R., Ma, Z., Liu, S., Yi, Q., & Zhang, L. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00223 · Cited by 64
One-shot Unsupervised Domain Adaptation with Personalized Diffusion Models
Benigmim, Y., Roy, S., Essid, S., Kalogeiton, V. S., & Lathuilière, S. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00077 · Cited by 50
FocalDreamer: Text-Driven 3D Editing via Focal-Fusion Assembly
Li, Y., Dou, Y., Shi, Y., Lei, Y., Chen, X., Zhang, Y., Zhou, P., & Ni, B. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28113 · Cited by 70
Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models
Wang, R., Chen, Z., Chen, C., Ma, J., Lu, H., & Lin, X. S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28364 · Cited by 43
SGDM: An Adaptive Style-Guided Diffusion Model for Personalized Text to Image Generation
Xu, Y., Xu, X., Gao, H., & Xiao, F. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3399075 · Cited by 46
Fu, J., Zhou, W., Jiang, Q., Liu, H., & Zhai, G. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3420083 · Cited by 43
Toward Extreme Image Compression With Latent Feature Guidance and Diffusion Prior
Li, Z., Zhou, Y., Hao, W., Ge, C., & Jiang, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3455576 · Cited by 57
AVID: Any-Length Video Inpainting with Diffusion Model
Zhang, Z., Wu, B., Wang, X., Luo, Y., Zhang, L., Zhao, Y., Vajda, P., Metaxas, D., & Yu, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00684 · Cited by 69
Self-citationZhang, H., Chen, P., Xie, X., Lin, C., Liu, L., Li, Z., You, W., & Sun, L. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676399 · Cited by 49
Generative AI for Film Creation: A Survey of Recent Advances
Zhang, R., Yu, B., Min, J., Xin, Y., Wei, Z., Shi, J. N., Huang, M., Kong, X., Xin, N. L., Jiang, S., et al. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00623 · Cited by 43
Self-citationMatFusion: A Generative Diffusion Model for SVBRDF Capture
Sartor, S., & Peers, P. (2023) · SIGGRAPH Asia Conference Papers · doi:10.1145/3610548.3618194 · Cited by 49
A Comprehensive Survey of Image Generation Models Based on Deep Learning
Li, J., Zhang, C., Zhu, W., & Ren, Y. (2024) · Annals of Data Science · doi:10.1007/s40745-024-00544-1 · Cited by 47
RealFill: Reference-Driven Generation for Authentic Image Completion
Tang, L., Ruiz, N., Chu, Q., Li, Y., Holynski, A., Jacobs, D. E., Hariharan, B., Pritch, Y., Wadhwa, N., Aberman, K., et al. (2024) · ACM Transactions on Graphics · doi:10.1145/3658237 · Cited by 57
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
Höllein, L., Božič, A., Muller, N. E., Novotný, D., Tseng, H.-Y., Richardt, C., Zollhöfer, M., & Nießner, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00482 · Cited by 55
Optimizing Diffusion Noise Can Serve As Universal Motion Priors
Karunratanakul, K., Preechakul, K., Aksan, E., Beeler, T., Suwajanakorn, S., & Tang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00133 · Cited by 69
Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis
Lu, Y., Zhang, M., Ma, A. J., Xie, X., & Lai, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00614 · Cited by 51
Metadata
- Authors
- Zhang, L., Rao, A., & Agrawala, M.
- Affiliations
- Stanford University (US)
- Venue
- 2023 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2023-10-01
- Pages
- 3813-3824
- OpenAlex
- W4390873054
- Cited by
- 4,547
- References
- 91
- Citations by year
- 2026: 1290 · 2025: 1847 · 2024: 1255 · 2023: 155
- FWCI
- 486.28
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Brown Institute for Media Innovation
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- ControlNet, text-to-image diffusion models, spatial conditioning, conditional image generation, Stable Diffusion, parameter-efficient fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
