The DOI matches its DataCite record; 74 of the 78 references it cites were found in a registry or an index.
Video-to-Video Synthesis
Open accessAbstract
We study the problem of video-to-video synthesis, whose goal is to learn a mapping function from an input source video (e.g., a sequence of semantic segmentation masks) to an output photorealistic video that precisely depicts the content of the source video. While its image counterpart, the image-to-image synthesis problem, is a popular topic, the video-to-video synthesis problem is less explored in the literature. Without understanding temporal dynamics, directly applying existing image synthesis approaches to an input video often results in temporally incoherent videos of low visual quality. In this paper, we propose a novel video-to-video synthesis approach under the generative adversarial learning framework. Through carefully-designed generator and discriminator architectures, coupled with a spatio-temporal adversarial objective, we achieve high-resolution, photorealistic, temporally coherent video results on a diverse set of input formats including segmentation masks, sketches, and poses. Experiments on multiple benchmarks show the advantage of our method compared to strong baselines. In particular, our model is capable of synthesizing 2K resolution videos of street scenes up to 30 seconds long, which significantly advances the state-of-the-art of video synthesis. Finally, we apply our approach to future video prediction, outperforming several state-of-the-art competing systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Results again showed that the proposed algorithm overperformed the other algorithms, both in the PSNR and SSIM metrics.”
From A Review of Detection and Removal of Raindrops in Automotive Vision Systems (2021) · cites this paper as [67]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Self-citationImage-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Self-citationAggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
(1981) · Cited by 11,963
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Research works printed but not linked: 10
- [7][7] Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh. Realtime multi-person 2D pose estimation using part affinity fields. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [16][16] A. Dosovitskiy and T. Brox. Generating images with perceptual similarity metrics based on deep networks. In Advances in Neural Information Processing Systems (NIPS) , 2016. -
- [25][25] K. He, G. Gkioxari, P. Dollár, and R. Girshick. Mask R-CNN. In IEEE International Conference on Computer Vision (ICCV) , 2017. -
- [32][32] E. Ilg, N. Mayer, T. Saikia, M. Keuper, A. Dosovitskiy, and T. Brox. Flownet 2.0: Evolution of optical flow estimation with deep networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [36][36] N. Kalchbrenner, A. v. d. Oord, K. Simonyan, I. Danihelka, O. Vinyals, A. Graves, and K. Kavukcuoglu. Video pixel networks. arXiv preprint arXiv:1610.00527 , 2016. - · arXiv
- [37][37] T. Karras, T. Aila, S. Laine, and J. Lehtinen. Progressive growing of GANs for improved quality, stability, and variation. In International Conference on Learning Representations (ICLR) , 2018. -
- [42][42] X. Liang, L. Lee, W. Dai, and E. P. Xing. Dual motion GAN for future-flow embedded video prediction. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [47][47] L. Ma, X. Jia, Q. Sun, B. Schiele, T. Tuytelaars, and L. Van Gool. Pose guided person image generation. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [50][50] M. Mathieu, C. Couprie, and Y. LeCun. Deep multi-scale video prediction beyond mean square error. In International Conference on Learning Representations (ICLR) , 2016. -
- [65][65] N. Srivastava, E. Mansimov, and R. Salakhudinov. Unsupervised learning of video representations using lstms. In International Conference on Machine Learning (ICML) , 2015. -
Cited by
Sorted by citations
Items 201–300 of 678
ClothFormer: Taming Video Virtual Try-on in All Module
Jiang, J., Wang, T., Yan, H., & Liu, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01053 · Cited by 35
Self-citationExploring the Temporal Consistency of Arbitrary Style Transfer: A Channelwise Perspective
Kong, X., Deng, Y., Tang, F., Dong, W., Ma, C., Chen, Y., He, Z., & Xu, C. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3230084 · Cited by 35
SignDiff: Diffusion Model for American Sign Language Production
Fang, S., Sui, C., Zhou, Y., Zhang, X., Zhong, H., Tian, Y., & Chen, C. (2025) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg61629.2025.11099440 · Cited by 34
Generative Adversarial Networks for Video-to-Video Domain Adaptation
Chen, J., Li, Y., Ma, K., & Zheng, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5750 · Cited by 34
MPL-GAN: Toward Realistic Meteorological Predictive Learning Using Conditional GAN
Liu, H., & Lee, I. (2020) · IEEE Access · doi:10.1109/access.2020.2995187 · Cited by 34
DTVNet: Dynamic Time-Lapse Video Generation via Single Still Image
Zhang, J., Xu, C., Liu, L., Wang, M., Wu, X., Liu, Y., & Jiang, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58558-7_18 · Cited by 35
Quantum semi-supervised generative adversarial network for enhanced data classification
Nakaji, K., & Yamamoto, N. (2021) · Scientific Reports · doi:10.1038/s41598-021-98933-6 · Cited by 39
Multimodal Learning for Temporally Coherent Talking Face Generation With Articulator Synergy
Yu, L., Xie, H., & Zhang, Y. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3091863 · Cited by 34
Text2video: Text-Driven Talking-Head Video Synthesis with Personalized Phoneme - Pose Dictionary
Zhang, S., Yuan, J., Liao, M., & Zhang, L. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747380 · Cited by 34
Nakano, K., Horita, D., Sakata, N., Kiyokawa, K., Yanai, ., & Narumi, T. (2019) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2019.000-1 · Cited by 33
Dynamic Object Removal and Spatio-Temporal RGB-D Inpainting via Geometry-Aware Adversarial Learning
Bešić, B., & Valada, A. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3140654 · Cited by 36
Learning Semantic-Aware Dynamics for Video Prediction
Bei, X., Yang, Y., & Soatto, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00096 · Cited by 33
FashionMirror: Co-attention Feature-remapping Virtual Try-on with Sequential Template Poses
Chen, C.-Y., Lo, L., Huang, P.-J., Shuai, H.-H., & Cheng, W.-H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01355 · Cited by 33
Deepfakes: A Grounded Threat Assessment
Center for Security and Emerging Technology, & Hwang, T. (2020) · doi:10.51593/20190030 · Cited by 33
Law, S., & Neira, M. (2019) · ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery (GeoAI) · doi:10.1145/3356471.3365238 · Cited by 32
Deep CG2Real: Synthetic-to-Real Translation via Image Disentanglement
Bi, S., Sunkavalli, K., Perazzi, F., Shechtman, E., Kim, V. G., & Ramamoorthi, R. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00282 · Cited by 32
High-Fidelity Neural Human Motion Transfer from Monocular Video
Kappel, M., Golyanik, V., Elgharib, M. A., Henningson, J.-O., Seidel, H., Castillo, S., Theobalt, C., & Magnor, M. A. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00159 · Cited by 32
Txt2Vid: Ultra-Low Bitrate Compression of Talking-Head Videos via Text
Tandon, P., Chandak, S., Pataranutaporn, P., Liu, Y., Mapuranga, A. M., Maes, P., Weissman, T., & Sra, M. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3221953 · Cited by 36
GM-NeRF: Learning Generalizable Model-Based Neural Radiance Fields from Multi-View Images
Chen, J., Yi, W., Ma, L., Jia, X., & Lu, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01978 · Cited by 35
Improving Human Pose Estimation With Self-Attention Generative Adversarial Networks
Wang, X., Cao, Z., Wang, R., Liu, Z., & Zhu, X. (2019) · IEEE Access · doi:10.1109/access.2019.2936709 · Cited by 32
Putting People in Their Place: Affordance-Aware Human Insertion into Scenes
Kulal, S., Brooks, T., Aiken, A., Wu, J., Yang, J., Lu, J., Efros, A. A., & Singh, K. K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01639 · Cited by 43
Enforcing Temporal Consistency in Video Depth Estimation
Li, S., Luo, Y., Zhu, Y. H., Zhao, X., Li, Y., & Shan, Y. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00134 · Cited by 34
Towards Language-Driven Video Inpainting via Multimodal Large Language Models
Wu, J., Li, X., Si, C., Zhou, S., Yang, J., Zhang, J., Li, Y., Chen, K., Tong, Y., Liu, Z., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01188 · Cited by 40
Magic-Me: Identity-Specific Video Customized Diffusion
Ma, Z., Zhou, D., Wang, X.-S., Yeh, C.-H., Li, X., Yang, H., Dong, Z., Keutzer, K., & Feng, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92808-6_2 · Cited by 67
Cascade Attention Guided Residue Learning GAN for Cross-Modal Translation
Duan, B., Wang, W., Tang, H., Latapie, H. M., & Yan, Y. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412890 · Cited by 32
Flow Guided Transformable Bottleneck Networks for Motion Retargeting
Ren, J., Chai, M., Woodford, O. J., Olszewski, K., & Tulyakov, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01065 · Cited by 30
Error Compensation Framework for Flow-Guided Video Inpainting
Kang, J., Oh, S. W., & Kim, S. J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19784-0_22 · Cited by 30
Deep Gesture Video Generation With Learning on Regions of Interest
Cui, R., Cao, Z. L., Pan, W., Zhang, C., & Wang, J. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2960700 · Cited by 30
HumanGen: Generating Human Radiance Fields with Explicit Priors
Jiang, S., Jiang, H., Wang, Z., Luo, H., Chen, W., & Xu, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01207 · Cited by 29
Motion-Aware Feature Enhancement Network for Video Prediction
Lin, X., Zou, Q., Xu, X., Huang, Y., & Tian, Y. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2987141 · Cited by 30
Zheng, Z., Yu, Z., Wu, Y., Zheng, H., Zheng, B., & Lee, M. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.04.013 · Cited by 29
Learning metal artifact reduction in cardiac CT images with moving pacemakers
Lossau, T., Nickisch, H., Wissel, T., Morlock, M. M., & Graß, M. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101655 · Cited by 29
Spatial Consistency Constrained GAN for Human Motion Transfer
Ma, F., Xia, G., & Liu, Q. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3064035 · Cited by 29
Physics-informed generative neural network: an application to troposphere temperature prediction
Chen, Z., Gao, J., Wang, W., & Yan, Z. (2021) · Environmental Research Letters · doi:10.1088/1748-9326/abfde9 · Cited by 28
PoT-GAN: Pose Transform GAN for Person Image Synthesis
Li, T., Zhang, W., Song, R., Li, Z., Liu, J., Li, X., & Lu, S. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3104183 · Cited by 28
MedGen3D: A Deep Generative Framework for Paired 3D Image and Mask Generation
Han, K., Xiong, Y., You, C., Khosravi, P., Sun, S., Yan, X., Duncan, J. S., & Xie, X. S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43907-0_72 · Cited by 28
DeepLandscape: Adversarial Modeling of Landscape Videos
Logacheva, E., Suvorov, R. E., Khomenko, O., Mashikhin, A., & Lempitsky, V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58592-1_16 · Cited by 28
iPOKE: Poking a Still Image for Controlled Stochastic Video Synthesis
Blattmann, A., Milbich, T., Dorkenwald, M., & Ommer, B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01444 · Cited by 29
Generative adversarial network
Huang, S.-C., & Le, T.-H. (2021) · Elsevier eBooks · doi:10.1016/b978-0-323-90198-7.00011-2 · Cited by 27
Sparse to Dense Motion Transfer for Face Image Animation
Zhao, R., Wu, T., & Guo, G. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00226 · Cited by 27
Xiao, S., Lan, G., Yang, J., Li, Y., & Wen, J. (2022) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3213832 · Cited by 27
HVTR: Hybrid Volumetric-Textural Rendering for Human Avatars
Hu, T., Yu, T., Zheng, Z., Zhang, H., Liu, Y., & Zwicker, M. (2022) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv57658.2022.00032 · Cited by 32
Expression Conditional Gan for Facial Expression-to-Expression Translation
Tang, H., Wang, W., Wu, S., Chen, X., Xu, D., Sebe, N., & Yan, Y. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803654 · Cited by 27
Sound2Sight: Generating Visual Dynamics from Sound and Context
Chatterjee, M., & Cherian, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58583-9_42 · Cited by 29
Human Motion Transfer from Poses in the Wild
Ren, J., Chai, M., Tulyakov, S., Chen, F., Shen, X., & Yang, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-67070-2_16 · Cited by 26
Video demoiréing with relation-based temporal consistency
Dai, P., Yu, X., Ma, L., Zhang, B., Li, J., Li, W., Shen, J., & Qi, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01710 · Cited by 26
HR-Net: A Landmark Based High Realistic Face Reenactment Network
Ren, Q., Lu, Z., Wu, H., Zhang, J., & Dong, Z. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3268062 · Cited by 26
Sim-Real Joint Reinforcement Transfer for 3D Indoor Navigation
Zhu, F., Zhu, L., & Yang, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01165 · Cited by 26
Deep Blind Video Decaptioning by Temporal Aggregation and Recurrence
Kim, D., Woo, S., Lee, J., & Kweon, I. S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00439 · Cited by 26
Compositional Video Synthesis with Action GraphsPreprint
Bar, A., Herzig, R., Wang, X., Rohrbach, A., Chechik, G., Darrell, T., & Globerson, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15327 · Cited by 26
Copy Motion From One to Another: Fake Motion Video Generation
Liu, Z., Wu, S., Xu, C., Wang, X., Zhu, L., Wu, S., & Feng, F. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/171 · Cited by 25
He, Y., Li, S., Li, K., Wang, J., Li, B., Shi, T., Xin, Y., Li, K., Yin, J., Zhang, M., et al. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129649 · Cited by 53
Attribute-Guided Sketch Generation
Tang, H., Chen, X., Wang, W., Xu, D., Corso, J. J., Sebe, N., & Yan, Y. (2019) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2019.8756586 · Cited by 25
Audio-driven Neural Gesture Reenactment with Video Motion Graphs
Zhou, Y., Yang, J., Li, D., Saito, J., Aneja, D., & Kalogerakis, E. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00341 · Cited by 25
LEMaRT: Label-Efficient Masked Region Transform for Image Harmonization
Liu, S., Huynh, C. P., Chen, C., Arap, M., & Hamid, R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01754 · Cited by 25
LEO: Generative Latent Image Animator for Human Video Synthesis
Wang, Y., Ma, X., Chen, X., Chen, C., Dantcheva, A., Dai, B., & Qiao, Y. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02231-3 · Cited by 42
Wish You Were Here: Context-Aware Human Generation
Gafni, O., & Wolf, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00786 · Cited by 25
CoL-GAN: Plausible and Collision-Less Trajectory Prediction by Attention-Based GAN
Liu, S., Liu, H., Bi, H., & Mao, T. (2020) · IEEE Access · doi:10.1109/access.2020.2987072 · Cited by 24
Reliability of GAN Generated Data to Train and Validate Perception Systems for Autonomous Vehicles
Xu, W., Souly, N., & Brahma, P. P. (2021) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw52041.2021.00023 · Cited by 25
Audio-Visual Autoencoding for Privacy-Preserving Video Streaming
Xu, H., Cai, Z., Takabi, D., & Li, W. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3089080 · Cited by 24
Understanding Object Dynamics for Interactive Image-to-Video Synthesis
Blattmann, A., Milbich, T., Dorkenwald, M., & Ommer, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00513 · Cited by 26
Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation
Fu, T.-J., Yu, L., Zhang, N., Fu, C.-Y., Su, J.-C., Wang, W. Y., & Bell, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01029 · Cited by 27
Vid2Actor: Free-viewpoint Animatable Person Synthesis from Video in the WildPreprint
Weng, C.-Y., Curless, B., & Kemelmacher-Shlizerman, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.12884 · Cited by 24
One-to-one Mapping for Unpaired Image-to-image Translation
Shen, Z., Chen, Y., Huang, T. S., Zhou, S., Georgescu, B., & Liu, X. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093622 · Cited by 23
Progressive and Aligned Pose Attention Transfer for Person Image Generation
Zhu, Z., Huang, T., Xu, M., Shi, B., Cheng, W., & Bai, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3068236 · Cited by 23
Modality Disentangled Discriminator for Text-to-Image Synthesis
Feng, F., Niu, T., Li, R., & Wang, X. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3075997 · Cited by 23
Cross-View Exocentric to Egocentric Video Synthesis
Liu, G., Tang, H., Latapie, H. M., Corso, J. J., & Yan, Y. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475596 · Cited by 23
Self-citationLightweight Texture Correlation Network for Pose Guided Person Image Generation
Zhang, P., Yang, L., Xie, X., & Lai, J. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3131738 · Cited by 24
Xu, K., Singh, R., Fiore, M., Marina, M. K., Bilen, H., Usama, M., Benn, H., & Ziemlicki, C. (2021) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/3485983.3494844 · Cited by 29
Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis
Zhuo, L., Wang, G., Li, S., Wu, W., & Liu, Z. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19784-0_17 · Cited by 24
Free-HeadGAN: Neural Talking Head Synthesis With Explicit Gaze Control
Doukas, M. C., Ververas, E., Sharmanska, V., & Zafeiriou, S. P. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3253243 · Cited by 24
Wang, J., Sha, T., Zhang, W., Li, Z., & Mei, T. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413514 · Cited by 23
Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion
Li, Z., Li, Z., Cui, Z., Pollefeys, M., & Oswald, M. R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00682 · Cited by 33
Mimicry: Towards the Reproducibility of GAN ResearchPreprint
Lee, K. S., & Town, C. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02494 · Cited by 25
A Review of Detection and Removal of Raindrops in Automotive Vision Systems
Hamzeh, Y., & Rawashdeh, S. A. (2021) · Journal of Imaging · doi:10.3390/jimaging7030052 · Cited by 22
“For the DR(eye)VE testing, Vid2Vid [67] and a rain-streak removal [68] algorithms were used instead of the Pix2Pix and Eigen et al. algorithms.”
MethodEvery Moment Matters: Detail-Aware Networks to Bring a Blurry Image Alive
Zhang, K., Luo, W., Stenger, B., Ren, W., Ma, L., & Li, H. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413929 · Cited by 21
Deep Face Video Inpainting via UV Mapping
Wen-qi, Y., Chen, Z., Chen, C., Chen, G., & Wong, K. K. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3240835 · Cited by 21
Hsieh, C.-J., Chung, W.-H., & Hsu, C.-T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19787-1_21 · Cited by 21
Detecting Deepfakes: A Novel Framework Employing XceptionNet-Based Convolutional Neural Networks
Saxena, A., Yadav, D., Gupta, M., Phulre, S., Arjariya, T., Jaiswal, V., & Bhujade, R. K. (2023) · Traitement du signal · doi:10.18280/ts.400301 · Cited by 23
Advancing Naturalistic Affective Science with Deep Learning
Lin, C., Bulls, L. S., Tepfer, L. J., Vyas, A. D., & Thornton, M. A. (2023) · Affective Science · doi:10.1007/s42761-023-00215-z · Cited by 22
Do as I Do: Pose Guided Human Motion Copy
Wu, S., Liu, Z., Zhang, B., Zimmermann, R., Ba, Z., Zhang, X., & Ren, K. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3371530 · Cited by 21
Human Motion Transfer With 3D Constraints and Detail Enhancement
Sun, Y.-T., Fu, Q., Jiang, Y.-R., Liu, Z., Lai, Y., Fu, H., & Gao, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3201904 · Cited by 24
Speech2Video Synthesis with 3D Skeleton Regularization and Expressive Body Poses
Liao, M., Zhang, S., Wang, P., Zhu, H., Zuo, X., & Yang, R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69541-5_19 · Cited by 21
Action2video: Generating Videos of Human 3D Actions
Guo, C., Zuo, X., Wang, S., Liu, X., Zou, S., Gong, M., & Cheng, L. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-021-01550-z · Cited by 22
TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Models
Ni, H., Egger, B., Lohit, S., Cherian, A., Wang, Y., Koike–Akino, T., Huang, X., & Marks, T. K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00861 · Cited by 25
Emotional Listener Portrait: Realistic Listener Motion Simulation in Conversation
Song, L., Yin, G., Jin, Z., Dong, X., & Xu, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01905 · Cited by 20
Adversarial Framework for Unsupervised Learning of Motion Dynamics in Videos
Spampinato, C., Palazzo, S., D’Oro, P., Giordano, D., & Shah, M. A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01246-5 · Cited by 20
Colorblind-shareable videos by synthesizing temporal-coherent polynomial coefficients
Hu, X., Liu, X., Zhang, Z., Xia, M., Li, C., & Wong, T. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356534 · Cited by 20
Cooperative Training of Fast Thinking Initializer and Slow Thinking Solver for Conditional Learning
Xie, J., Zheng, Z., Fang, X., Zhu, S. C., & Wu, Y. N. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3069023 · Cited by 22
Style Generator Inversion for Image Enhancement and AnimationPreprint
Gabbay, A., & Hoshen, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.11880 · Cited by 20
Lee, D., Pfister, T., & Yang, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01030 · Cited by 19
Mining Audio, Text and Visual Information for Talking Face Generation
Yu, L., Yu, J., & Ling, Q. (2019) · Proceedings · doi:10.1109/icdm.2019.00089 · Cited by 19
Harmonizing Maximum Likelihood with GANs for Multimodal Conditional GenerationPreprint
Lee, S., Ha, J., & Kim, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09225 · Cited by 19
Example-Guided Image Synthesis Using Masked Spatial-Channel Attention and Self-supervision
Zheng, H., Liao, H., Chen, L., Xiong, W., Chen, T., & Luo, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58568-6_25 · Cited by 18
Zhang, Z., & Ding, Y. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548330 · Cited by 18
Generation of virtual digital human for customer service industry
Sun, Y., Sun, Z., Wen, Y., Ye, S., Lv, T., Yu, M., Yi, R., Gao, L., & Liu, Y. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.07.018 · Cited by 18
C2F-FWN: Coarse-to-Fine Flow Warping Network for Spatial-Temporal Consistent Motion Transfer
Wei, D., Xu, X., Shen, H., & Huang, K. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16391 · Cited by 18
Diverse Generation from a Single Video Made Possible
Haim, N., Feinstein, B., Granot, N., Shocher, A., Bagon, S., Dekel, T., & Irani, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19790-1_30 · Cited by 18
MoCaNet: Motion Retargeting In-the-Wild via Canonicalization Networks
Zhu, W., Yang, Z., Di, Z., Wu, W., Wang, Y., & Loy, C. C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20274 · Cited by 18
ModeRNN: Harnessing Spatiotemporal Mode Collapse in Unsupervised Predictive Learning
Yao, Z., Wang, Y., Wu, H., Wang, J., & Long, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3293145 · Cited by 18
Metadata
- Authors
- Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Liu, G., Tao, A., Kautz, J., & Catanzaro, B.
- Affiliations
- Nvidia (United Kingdom) (GB)
- University of California, Berkeley (US)
- Adobe Systems (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 1144-1156
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1808.06601
- OpenAlex
- W2886748926
- Cited by
- 594
- References
- 78
- Citations by year
- 2026: 1 · 2025: 28 · 2024: 61 · 2023: 87 · 2022: 88 · 2021: 123 · 2020: 117 · 2019: 87 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- semantic segmentation masks, generative adversarial networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
