The DOI matches its Crossref record; 88 of the 91 references it cites were found in a registry or an index.
Adding Conditional Control to Text-to-Image Diffusion Models
Abstract
We present ControlNet, a neural network architecture to add spatial conditioning controls to large, pretrained text-to-image diffusion models. ControlNet locks the production-ready large diffusion models, and reuses their deep and robust encoding layers pretrained with billions of images as a strong backbone to learn a diverse set of conditional controls. The neural architecture is connected with "zero convolutions" (zero-initialized convolution layers) that progressively grow the parameters from zero and ensure that no harmful noise could affect the finetuning. We test various conditioning controls, e.g., edges, depth, segmentation, human pose, etc., with Stable Diffusion, using single or multiple conditions, with or without prompts. We show that the training of ControlNets is robust with small (1m) datasets. Extensive results show that ControlNet may facilitate wider applications to control image diffusion models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Image annotations, including prompts and spatial cues [92, 121], are essential for training and evaluating image generation models as they provide localized and semantically rich supervision that help models learn meaningful visual representations.”
From Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation (2026) · cites this paper as [121]
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881
Research works printed but not linked: 13
- 2022, Disco diffusion
- 2022, Protogen x3.4 (photorealism) official release
- Ha, Hypernetworks
- 2022, Hypernetwork style training, a tiny guide, stable-diffusion-webui
- 10.1109/TPAMI.2020.2970919 · DOI · Paper page
- 2022, Novelai improvements on stable diffusion
- Lehtinen, Noise2noise: Learning image restoration without clean data
- 2023, Midjourney
- 2022, Comic-diffusion v2, trained on 6 styles at once
- 2023, Dall-e-2
- Schuhmann, LAION-5b: An open large-scale dataset for training next generation image-text models
- 2022, Stable diffusion v1.5 model card
- 2022, Stable diffusion v2 model card, stable-diffusion-2-depth
Cited by
Sorted by citations
Items 801–900 of 1,012
DOGAN: DINO-Based Optical-Prior-Driven GAN for SAR-to-Optical Image Translation
He, J., Chen, L., Shi, H., Chen, Y., Yang, J., & Li, W. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3606979 · Cited by 15
Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrieval
Yu, J., Bai, J., Qin, Y., Liu, Q., Wang, X., Wan, P., Zhang, D., & Liu, X. (2025) · SIGGRAPH Asia Conference Papers · doi:10.1145/3757377.3763833 · Cited by 107
Self-Driven Dual-Path Learning for Reference-Based Line Art Colorization Under Limited Data
Wu, S., Yan, X. X., Liu, W., Xu, S., & Zhang, S. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3295115 · Cited by 15
Optimizing Prompts Using In-Context Few-Shot Learning for Text-to-Image Generative Models
Lee, S., Lee, J., Bae, C. H., Choi, M.-S., Lee, R., & Ahn, S. (2024) · IEEE Access · doi:10.1109/access.2023.3348778 · Cited by 16
Identification of Systematic Errors of Image Classifiers on Rare Subgroups
Metzen, J., Hutmacher, R., Hua, N. G., Boreiko, V., & Zhang, D. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.00467 · Cited by 24
Yang, M., Gao, D., Xie, F., Li, J., Song, X., & Shi, G. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446594 · Cited by 16
Chu, E., Huang, T., Lin, S.-Y., & Chen, J.-C. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i2.27899 · Cited by 17
Compositional Inversion for Stable Diffusion Models
Zhang, X., Wei, X.-Y., Wu, J., Zhang, T., Zhang, Z., Lei, Z., & Li, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28565 · Cited by 18
Architectural Facade Design with Style and Structural Features using Stable Diffusion Model
Wen, M., Liang, D., Ye, H., & Tu, H. (2024) · Journal of Intelligent Construction · doi:10.26599/jic.2024.9180034 · Cited by 15
Group-aware Parameter-efficient Updating for Content-Adaptive Neural Video Compression
Chen, Z., Zhou, L., Hu, Z., & Xu, D. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680943 · Cited by 15
GenFrame – Embedding Generative AI Into Interactive Artifacts
Kun, P., Freiberger, M., Løvlie, A. S., & Risi, S. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660750 · Cited by 17
Text-to-Vector Generation with Neural Path Representation
Zhang, P., Zhao, N., & Liao, J. (2024) · ACM Transactions on Graphics · doi:10.1145/3658204 · Cited by 15
Yang, Y., Liu, D., Zhang, S., Deng, Z., Huang, Z., & Tan, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01015 · Cited by 20
Unmixing Before Fusion: A Generalized Paradigm for Multi-Source-Based Hyperspectral Image Synthesis
Yu, Y., Pan, E., Wang, X., Wu, Y., Mei, X., & Ma, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00888 · Cited by 17
Text-Guided 3D Face Synthesis - From Generation to Editing
Wu, Y., Meng, Y., Hu, Z., Li, L., Wu, H., Zhou, K., Xu, W., & Yu, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00126 · Cited by 16
Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation
Chen, X., Mihajlović, M., Wang, S., Prokudin, S., & Tang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00986 · Cited by 21
PRDP: Proximal Reward Difference Prediction for Large-Scale Reward Finetuning of Diffusion Models
Deng, F., Wang, Q., Wei, W., Hou, T., & Grundmann, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00709 · Cited by 25
Liu, J., Cao, Y., Wu, J. Z., Mao, W., Gu, Y., Zhao, R., Keppo, J., Shan, Y., & Shou, M. Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00732 · Cited by 15
Li, Y. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109369 · Cited by 15
Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Models
Luo, Z., Gustafsson, F., Zhao, Z., Sjölund, J., & Schön, T. B. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00658 · Cited by 23
Chen, F., Mai, M., Huang, X., & Li, Y. (2024) · Sustainability · doi:10.3390/su16198414 · Cited by 21
Zeng, H., Zou, K., Chen, Z., Zheng, R., & Fu, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72117-5_58 · Cited by 15
Dubey, S., Chong, Y., Knudsen, B. S., & Elhabian, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73284-3_15 · Cited by 15
SWDiff: Stage-Wise Hyperspectral Diffusion Model for Hyperspectral Image Classification
Chen, L., He, J., Shi, H., Yang, H. J., & Li, W. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3485483 · Cited by 18
Enhancing Tampered Text Detection Through Frequency Feature Fusion and Decomposition
Chen, Z., Shen, C., Yao, T., Sun, K., Ding, S., Lin, X., Cao, L., & Ji, R. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73414-4_12 · Cited by 16
Tuning-Free Image Customization with Image and Text Guidance
Li, P., Nie, Q., Chen, Y., Jiang, X., Wu, K., Lin, Y., Liu, Y., Peng, J., Wang, C., & Zheng, F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73116-7_14 · Cited by 15
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
Zuo, R., Wei, F., Chen, Z., Mak, B. K.-W., Yang, J., & Tong, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72967-6_3 · Cited by 19
UniProcessor: A Text-Induced Unified Low-Level Image Processor
Duan, H., Min, X., Wu, S., Shen, W., & Zhai, G. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72855-6_11 · Cited by 15
Audio-Synchronized Visual Animation
Zhang, L., Mo, S., Zhang, Y., & Morgado, P. M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72940-9_1 · Cited by 27
Self-citationFMBoost: Boosting Latent Diffusion with Flow Matching
Schusterbauer, J., Gui, M., Ma, P., Stracke, N., Baumann, S. A., Hu, V. T., & Ommer, B. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73030-6_19 · Cited by 31
Exploring the use of generative AI for material texturing in 3D interior design spaces
Gallega, R. W., & Sumi, Y. (2024) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1493937 · Cited by 18
Girella, F., Liu, Z., Fummi, F., Setti, F., Cristani, M., & Capogrosso, L. (2024) · International Workshop on Content-Based Multimedia Indexing (CBMI) · doi:10.1109/cbmi62980.2024.10858875 · Cited by 17
Cross-View Meets Diffusion: Aerial Image Synthesis with Geometry and Text Guidance
Arrabi, A., Zhang, X., Sultani, W., Chen, C., & Wshah, S. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00523 · Cited by 15
Distinguished Quantized Guidance for Diffusion-based Sequence Recommendation
Mao, W., Liu, S., Liu, H., Liu, H., Li, X., & Hu, L. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714955 · Cited by 19
Taming diffusion models for image restoration: a review
Luo, Z., Gustafsson, F. K., Zhao, Z. M., Sjölund, J., & Schön, T. B. (2025) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2024.0358 · Cited by 20
Instant Adversarial Purification with Adversarial Consistency Distillation
Lei, C. T., Yam, H. M., Guo, Z., Qian, Y., & Lau, C. P. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02266 · Cited by 17
POSTA: A Go-to Framework for Customized Artistic Poster Generation
Chen, H., Xu, X., Li, W., Ren, J., Tian, Y., Liu, S., Chen, Y.-C., Zhu, L., & Wang, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02672 · Cited by 15
Diff-Restorer: Unleashing Visual Prompts for Diffusion-Based Universal Image Restoration
Zhang, Y., Zhang, H., Chai, X., Cheng, Z., Xie, R., Song, L., & Zhang, W. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3629686 · Cited by 15
Photorealistic Text-to-3D Avatar Generation with Constraints for Decoupled Geometry and Appearance
Xu, Y., Yang, Z., & Yang, Y. (2025) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3774422 · Cited by 32
Virtual staining of label-free tissue in imaging mass spectrometry
Zhang, Y., Huang, L., Pillar, N., Li, Y., Li, Y., Migas, L. G., de Plas, R. V., Spraggins, J. M., & Özcan, A. (2025) · Science Advances · doi:10.1126/sciadv.adv0741 · Cited by 16
Ditto: Accelerating Diffusion Model via Temporal Value Similarity
Kim, S., Lee, H., Cho, W., Park, M., & Ro, W. W. (2025) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca61900.2025.00035 · Cited by 22
A hybrid deep learning approach for the design of 2D Auxetic Metamaterials
Zhang, C., & Zhao, Y. F. (2025) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2025.117972 · Cited by 15
SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptation
Yu, X., Gong, Z., Zhou, C., Fang, Y., & Zhang, H. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714828 · Cited by 24
AIFiligree: A Generative AI Framework for Designing Exquisite Filigree Artworks
Tao, Y., Fu, X., Wu, J., Bian, Z., Zhu, A., Bao, Q., Zheng, W., Wang, Y., Zhu, B., Yang, C., et al. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713281 · Cited by 14
Integrating large models with topology optimization for conceptual design realization
Liang, Z., Zhang, Y., Wang, Y., & Li, W. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103524 · Cited by 19
BEVDiffuser: Plug-and-Play Diffusion Model for BEV Denoising with Ground-Truth Guidance
Ye, X., Yaman, B., Sheng, C., Tao, F., Mallik, A., & Ren, L. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00147 · Cited by 22
Zhong, Y., Li, Z., Chen, D. Z., Hong, L., & Xu, D. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00575 · Cited by 14
Diffusedesigner: sketch-based controllable clothing image generation
Lee, J. W., Kim, J., & Lee, H. (2025) · Fashion and Textiles · doi:10.1186/s40691-025-00426-x · Cited by 14
Marquardt, N., Roseway, A., Romat, H., Panda, P., Pahud, M., Ramos, G., Drucker, S. M., Wilson, A. D., Hinckley, K., & Riche, N. H. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747631 · Cited by 14
Artificial Intelligence for Remote Sensing: Progress, Challenges, and Perspectives
Shang, Y., Cheng, B., Zhang, Z., Wang, Q., Jin, P., Huang, L., Liu, C., Huang, L., Ding, X., Shen, T., et al. (2026) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2026.3656185 · Cited by 17
Vision + Language Applications: A Survey
Zhou, Y., & Shimada, N. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00090 · Cited by 14
Appearance and Pose-guided Human Generation: A Survey
Liao, F., Zou, X., & Wong, W. K. (2023) · ACM Computing Surveys · doi:10.1145/3637060 · Cited by 16
WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models
He, J.-Y., Cheng, Z.-Q., Li, C., Sun, J., Xiang, W., Lin, X., Kang, X., Jin, Z., Hu, Y., Luo, B., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.23 · Cited by 19
KV Inversion: KV Embeddings Learning for Text-Conditioned Real Image Action Editing
Huang, J., Liu, Y., Qin, J., & Chen, S. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-8429-9_14 · Cited by 14
Czerkawski, M., & Tachtatzis, C. (2024) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2024.3370212 · Cited by 17
Li, L., Yang, R., Lv, M., Wu, A., & Zhao, Z. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3376510 · Cited by 16
Market-GAN: Adding Control to Financial Market Data Generation with Semantic Context
Xia, H., Sun, S., Wang, X., & An, B. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29531 · Cited by 14
Frequency-Controlled Diffusion Model for Versatile Text-Guided Image-to-Image Translation
Gao, X., Xu, Z., Zhao, J., & Liu, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i3.27951 · Cited by 17
An Evidence-based Workflow for Studying and Designing Learning Supports for Human-AI Co-creation
Gmeiner, F., Conlin, J. L., Tang, E. H., Martelaro, N., & Holstein, K. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650763 · Cited by 14
EASI-Tex: Edge-Aware Mesh Texturing from Single Image
Perla, S. R. K., Wang, Y., Amiri, A. M., & Zhang, H. (2024) · ACM Transactions on Graphics · doi:10.1145/3658222 · Cited by 22
TexControl: Sketch-Based Two-Stage Fashion Image Generation Using Diffusion Model
Zhang, Y., Zhang, T., & Xie, H. (2024) · Nicograph International (NicoInt) · doi:10.1109/nicoint62634.2024.00021 · Cited by 14
MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback
Chen, C., Nguyen, C., Groueix, T., Kim, V. G., & Weibel, N. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3694681 · Cited by 25
GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videos
Souček, T., Damen, D., Wray, M., Laptev, I., & Šivic, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00627 · Cited by 23
Shi, F., Gu, J., Xu, H., Xu, S., Zhang, W., & Wang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00706 · Cited by 18
UV-IDM: Identity-Conditioned Latent Diffusion Model for Face UV-Texture Generation
Li, H., Feng, Y., Xue, S., Liu, X., Zeng, B., Li, S., Liu, B., Liu, J., Han, S., & Zhang, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01007 · Cited by 17
Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation
Shabani, M. A., Wang, Z., Liu, D., Zhao, N., Yang, J., & Furukawa, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00881 · Cited by 21
Xu, H., Li, H., Wang, Y., Liu, S., & Fu, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00968 · Cited by 18
Automatic Controllable Colorization via Imagination
Cong, X., Wu, Y., Chen, Q., & Lei, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00252 · Cited by 16
Lei, B., Yu, K., Feng, M., Cui, M., & Xie, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00998 · Cited by 14
GraCo: Granularity-Controllable Interactive Segmentation
Zhao, Y., Li, K., Cheng, Z., Qiao, P., Zheng, X., Ji, R., Liu, C., Li, Y., & Chen, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00336 · Cited by 14
SketchINR: A First Look into Sketches as Implicit Neural Representations
Bandyopadhyay, H., Bhunia, A. K., Chowdhury, P. N., Sain, A., Xiang, T., Hospedales, T. M., & Song, Y.-Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01194 · Cited by 14
Deep SVBRDF Acquisition and Modelling: A Survey
Kavoosighafi, B., Hajisharif, S., Miandji, E., Baravdish, G., Cao, W., & Unger, J. (2024) · Computer Graphics Forum · doi:10.1111/cgf.15199 · Cited by 14
Wang, Y., Liu, C., & Zhao, J. (2024) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2024-spring62846.2024.10683477 · Cited by 14
Towards Learning Contrast Kinetics with Multi-condition Latent Diffusion Models
Osuala, R. O., Lang, D. M., Verma, P., Joshi, S., Tsirikoglou, A., Skorupko, G., Kushibar, K., Garrucho, L., Pinaya, W. H. L., Díaz, O., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72086-4_67 · Cited by 14
BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AI
Rajaram, S., Numan, N., Kumaravel, B. T., Marquardt, N., & Wilson, A. D. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676326 · Cited by 14
Huo, J., Wang, Y., Wang, Y., Qian, X., Li, C., Fu, Y., & Feng, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72983-6_4 · Cited by 14
Few-Shot Defect Image Generation Based on Consistency Modeling
Shi, Q., Wei, J., Shen, F., & Zhang, Z. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73116-7_21 · Cited by 17
AnyControl: Create Your Artwork with Versatile Control on Text-to-Image Generation
Sun, Y., Liu, Y., Tang, Y., Pei, W., & Chen, K. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73247-8_6 · Cited by 14
Rota, C., Buzzelli, M., & van de Weijer, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73254-6_3 · Cited by 14
Casper DPM: Cascaded Perceptual Dynamic Projection Mapping onto Hands
Erel, Y., Kozlovsky-Mordenfeld, O., Iwai, D., Sato, K., & Bermano, A. H. (2024) · SIGGRAPH Asia Conference Papers · doi:10.1145/3680528.3687624 · Cited by 14
Self-rectifying Diffusion Sampling with Perturbed-Attention Guidance
Ahn, D., Cho, H., Min, J., Jang, W., Kim, J., Kim, S., Park, H. H., Jin, K. H., & Kim, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73464-9_1 · Cited by 52
Spatio-Temporal Energy-Guided Diffusion Model for Zero-Shot Video Synthesis and Editing
Yang, L. Q., Zhao, Y., Yu, Z., Zeng, B., Xu, M., Hong, S., & Cui, B. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3531390 · Cited by 17
Deep Learning-Based Assessment of Lip Symmetry for Patients With Repaired Cleft Lip
Rosero, K., Salman, A. N., Harrison, L. M., Kane, A. A., Busso, C., & Hallac, R. R. (2025) · The Cleft Palate-Craniofacial Journal · doi:10.1177/10556656241312730 · Cited by 15
Yu, X., Fan, C., Zhang, Z., Wang, Y., Chen, C., Yu, T., & Peng, Y. K. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111561 · Cited by 15
InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation
Wang, Y., Guo, J., Bai, J., Yu, R., He, T., Tan, X., Sun, X., & Bian, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i8.32877 · Cited by 25
Image Conductor: Precision Control for Interactive Video Synthesis
Li, Y., Wang, X., Zhang, Z., Wang, Z., Yuan, Z., Xie, L., Shan, Y., & Zou, Y. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i5.32533 · Cited by 42
TrAME: Trajectory-Anchored Multi-View Editing for Text-Guided 3D Gaussian Manipulation
Luo, C., Di, D., Yang, X., Ma, Y., Xue, Z., Chen, W., Gou, X., & Liu, Y. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3557618 · Cited by 14
Zhang, H., Chen, P., Xie, X., Jiang, Z., Wu, Y., Li, Z., Chen, X., & Sun, L. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713686 · Cited by 14
Efficient Domain Augmentation for Autonomous Driving Testing Using Diffusion Models
Baresi, L., Hu, D. Y. X., Stocco, A., & Tonella, P. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00206 · Cited by 25
DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation Using Limited Data
Zhu, J., Ma, H., Chen, J., & Yuan, J. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02498-0 · Cited by 17
DiffusionAct: Controllable Diffusion Autoencoder for One-shot Face Reenactment
Bounareli, S., Tzelepis, C., Argyriou, V., Patras, I., & Tzimiropoulos, G. (2025) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg61629.2025.11099159 · Cited by 17
Hierarchical painter: Chinese landscape painting restoration with fine-grained styles
Xu, Z., Shang, H., Yang, S., Xu, R., Yan, Y., Li, Y., Huang, J., Yang, H. C., & Zhou, J. (2023) · Visual Intelligence · doi:10.1007/s44267-023-00021-y · Cited by 14
Chop & Learn: Recognizing and Generating Object-State Compositions
Saini, N., Wang, H., Swaminathan, A., Jayasundara, V., He, B., Gupta, K., & Shrivastava, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01852 · Cited by 15
Identity-Preserving Text-to-Video Generation by Frequency DecompositionPreprint
Yuan, S., Huang, J., He, X., Ge, Y., Shi, Y., Chen, L., Luo, J., & Li, Y. (2024) · Qeios · doi:10.32388/tziid6 · Cited by 66
Zhao, S., Huang, Y., He, X., Tong, X., Li, X., & Wu, D. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714157 · Cited by 13
Li, X., Yu, C., Du, W., Jiang, Y., Xie, T., Chen, Y., Yang, Y., & Jiang, C. (2025) · ACM Transactions on Graphics · doi:10.1145/3731177 · Cited by 23
FluxSpace: Disentangled Semantic Editing in Rectified Flow Models
Dalva, Y., Venkatesh, K., & Yanardag, P. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01221 · Cited by 37
50 Years of Automated Face Recognition
Kim, M., Jain, A. K., & Liu, X. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3664269 · Cited by 17
Rong, D., Zhao, Z., Wu, Y., Ke, B., & Ni, B. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3331488 · Cited by 13
Generative Text-to-Image Diffusion for Automated Map Production Based on Geosocial Media Data
Dunkel, A., Burghardt, D., & Gugulica, M. (2024) · KN - Journal of Cartography and Geographic Information · doi:10.1007/s42489-024-00159-9 · Cited by 13
Metadata
- Authors
- Zhang, L., Rao, A., & Agrawala, M.
- Affiliations
- Stanford University (US)
- Venue
- 2023 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2023-10-01
- Pages
- 3813-3824
- OpenAlex
- W4390873054
- Cited by
- 4,547
- References
- 91
- Citations by year
- 2026: 1290 · 2025: 1847 · 2024: 1255 · 2023: 155
- FWCI
- 486.28
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Brown Institute for Media Innovation
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- ControlNet, text-to-image diffusion models, spatial conditioning, conditional image generation, Stable Diffusion, parameter-efficient fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
