The DOI matches its DataCite record; 74 of the 78 references it cites were found in a registry or an index.
Video-to-Video Synthesis
Open accessAbstract
We study the problem of video-to-video synthesis, whose goal is to learn a mapping function from an input source video (e.g., a sequence of semantic segmentation masks) to an output photorealistic video that precisely depicts the content of the source video. While its image counterpart, the image-to-image synthesis problem, is a popular topic, the video-to-video synthesis problem is less explored in the literature. Without understanding temporal dynamics, directly applying existing image synthesis approaches to an input video often results in temporally incoherent videos of low visual quality. In this paper, we propose a novel video-to-video synthesis approach under the generative adversarial learning framework. Through carefully-designed generator and discriminator architectures, coupled with a spatio-temporal adversarial objective, we achieve high-resolution, photorealistic, temporally coherent video results on a diverse set of input formats including segmentation masks, sketches, and poses. Experiments on multiple benchmarks show the advantage of our method compared to strong baselines. In particular, our model is capable of synthesizing 2K resolution videos of street scenes up to 30 seconds long, which significantly advances the state-of-the-art of video synthesis. Finally, we apply our approach to future video prediction, outperforming several state-of-the-art competing systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Results again showed that the proposed algorithm overperformed the other algorithms, both in the PSNR and SSIM metrics.”
From A Review of Detection and Removal of Raindrops in Automotive Vision Systems (2021) · cites this paper as [67]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Self-citationImage-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Self-citationAggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
(1981) · Cited by 11,963
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Research works printed but not linked: 10
- [7][7] Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh. Realtime multi-person 2D pose estimation using part affinity fields. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [16][16] A. Dosovitskiy and T. Brox. Generating images with perceptual similarity metrics based on deep networks. In Advances in Neural Information Processing Systems (NIPS) , 2016. -
- [25][25] K. He, G. Gkioxari, P. Dollár, and R. Girshick. Mask R-CNN. In IEEE International Conference on Computer Vision (ICCV) , 2017. -
- [32][32] E. Ilg, N. Mayer, T. Saikia, M. Keuper, A. Dosovitskiy, and T. Brox. Flownet 2.0: Evolution of optical flow estimation with deep networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [36][36] N. Kalchbrenner, A. v. d. Oord, K. Simonyan, I. Danihelka, O. Vinyals, A. Graves, and K. Kavukcuoglu. Video pixel networks. arXiv preprint arXiv:1610.00527 , 2016. - · arXiv
- [37][37] T. Karras, T. Aila, S. Laine, and J. Lehtinen. Progressive growing of GANs for improved quality, stability, and variation. In International Conference on Learning Representations (ICLR) , 2018. -
- [42][42] X. Liang, L. Lee, W. Dai, and E. P. Xing. Dual motion GAN for future-flow embedded video prediction. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [47][47] L. Ma, X. Jia, Q. Sun, B. Schiele, T. Tuytelaars, and L. Van Gool. Pose guided person image generation. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [50][50] M. Mathieu, C. Couprie, and Y. LeCun. Deep multi-scale video prediction beyond mean square error. In International Conference on Learning Representations (ICLR) , 2016. -
- [65][65] N. Srivastava, E. Mansimov, and R. Salakhudinov. Unsupervised learning of video representations using lstms. In International Conference on Machine Learning (ICML) , 2015. -
Cited by
Sorted by citations
Items 401–500 of 678
A Self-Spatial Adaptive Weighting Based U-Net for Image Segmentation
Cho, C., Lee, Y. H., Park, J., & Lee, S. (2021) · Electronics · doi:10.3390/electronics10030348 · Cited by 9
Image Comes Dancing With Collaborative Parsing-Flow Video Synthesis
Wu, B., Xie, Z., Liang, X., Xiao, Y., Dong, H., & Lin, L. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3123549 · Cited by 9
Layered Controllable Video Generation
Huang, J., Jin, Y., Yi, K. M., & Sigal, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19787-1_31 · Cited by 9
RPGAN: GANs Interpretability via Random RoutingPreprint
Voynov, A. S., & Babenko, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10920 · Cited by 9
UnDIVE: Generalized Underwater Video Enhancement Using Generative Priors
Srinath, S., Chandrasekar, A., Jamadagni, H., Soundararajan, R., & Prathosh, A. P. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00872 · Cited by 10
Dance any Beat: Blending Beats with Visuals in Dance Video Generation
Wang, X., Wang, H., Liu, D., & Cai, W. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00502 · Cited by 8
VR+HD: Video Semantic Reconstruction From Spatio-Temporal Scene Graphs
Li, C., Duan, Y., Du, Q., Sun, S., Deng, X., & Tao, X. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3323654 · Cited by 8
Depth-Guided Deep Video Inpainting
Li, S., Zhu, S., Ge, Y., Zeng, B., Imran, M. A., Abbasi, Q. H., & Cooper, J. M. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3340089 · Cited by 8
DeepDR: Deep Structure-Aware RGB-D Inpainting for Diminished Reality
Gsaxner, C., Mori, S., Schmalstieg, D., Egger, J., Paar, G., Werner Bailer, A., & Kalkofen, D. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00037 · Cited by 8
Latency-Free Driving Scene Prediction for On-Road Teledriving With Future-Image-Generation
Lee, K.-W., Ko, D.-K., Kim, Y.-J., Ryu, J.-H., & Lim, S. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3435481 · Cited by 8
DIM: Dyadic Interaction Modeling for Social Behavior Generation
Tran, M., Chang, D., Siniukov, M., & Soleymani, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72913-3_27 · Cited by 8
Align-and-Attend Network for Globally and Locally Coherent Video Inpainting
Woo, S., Kim, D., Park, K., Lee, J., & Kweon, I. S. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.113 · Cited by 8
Design-Gan: Cross-Category Fashion Translation Driven By Landmark Attention
Lang, Y., He, Y., Dong, J., Yang, F., & Xue, H. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053880 · Cited by 8
Structure-aware Roadview Synthesis for Testing Autonomous Perception
Lin, Z., Zhang, C., Liu, Y., Li, L., & Wang, L. (2020) · IEEE International Conference on Unmanned Systems (ICUS) · doi:10.1109/icus50048.2020.9274834 · Cited by 8
Detection of GAN-Synthesized street videos
Alamayreh, O., & Barni, M. (2021) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco54536.2021.9616262 · Cited by 8
Image generation step by step: animation generation-image translation
Jing, B., Ding, H., Yang, Z., Li, B. H., & Liu, Q. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02835-z · Cited by 8
Single Person Dense Pose Estimation via Geometric Equivariance Consistency
Zhang, Q., Jiang, Y., Zhou, Q., Zhao, Y., Liu, Y., Lu, H., & Hua, X. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3129056 · Cited by 8
Spatially Constrained GAN for Face and Fashion Synthesis
Jiang, S., Liu, H., Wu, Y., & Fu, Y. (2021) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg52635.2021.9666991 · Cited by 8
VAG: A Uniform Model for Cross-Modal Visual-Audio Mutual Generation
Hao, W., Guan, H., & Zhang, Z. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3161314 · Cited by 8
Deep Transformer Based Video Inpainting Using Fast Fourier Tokenization
Kim, T., Kim, J.-W., Oh, H., & Kang, J. (2024) · IEEE Access · doi:10.1109/access.2024.3361283 · Cited by 8
Gomes, T. L., Martins, R., Ferreira, J., & Nascimento, E. R. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093395 · Cited by 8
A Review on Face Reenactment Techniques
Dhere, S., Rathod, S. B., Aarankalle, S., Lad, Y., & Gandhi, M. (2020) · International Conference on Industry 4.0 Technology (I4Tech) · doi:10.1109/i4tech48345.2020.9102668 · Cited by 8
Generating Videos of Zero-Shot Compositions of Actions and Objects
Nawhal, M., Zhai, M., Lehrmann, A., Sigal, L., & Mori, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58610-2_23 · Cited by 8
Altering the Conveyed Facial Emotion Through Automatic Reenactment of Video Portraits
Groth, C., Tauscher, J., Castillo, S., & Magnor, M. A. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-63426-1_14 · Cited by 8
Cross-Identity Motion Transfer for Arbitrary Objects Through Pose-Attentive Video Reassembling
Jeon, S., Nam, S., Oh, S. W., & Kim, S. J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58586-0_18 · Cited by 8
Video Generation from Text Employing Latent Path Construction for Temporal Modeling
Mazaheri, A., & Shah, M. A. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956706 · Cited by 8
CycleGAN Through the Lens of (Dynamical) Optimal Transport
de Bézenac, E., Ayed, I., & Gallinari, P. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86520-7_9 · Cited by 8
First Order Motion Model for Image Animation and Deep Fake Detection: Using Deep Learning
Banu Priya, M., & Daniel, J. F. (2022) · International Conference on Computer Communication and Informatics (ICCCI) · doi:10.1109/iccci54379.2022.9740969 · Cited by 8
Weakly-Supervised High-Fidelity Ultrasound Video Synthesis with Feature Decoupling
Liang, J., Yang, X., Huang, Y., Liu, K., Zhou, X., Hu, X. C., Lin, Z., Luo, H., Zhang, Y., Xiong, Y., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16440-8_30 · Cited by 9
Unsupervised video-to-video translation with preservation of frame modification tendency
Liu, H., Li, C., Lei, D., & Zhu, Q. (2020) · The Visual Computer · doi:10.1007/s00371-020-01913-6 · Cited by 7
Image Animation with Perturbed Masks
Shalev, Y., & Wolf, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00363 · Cited by 7
Coherent Image Animation Using Spatial-Temporal Correspondence
Wang, W., Zhou, W., Bao, J., & Li, H. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3160297 · Cited by 7
Solving Low-Dose CT Reconstruction via GAN with Local Coherence
Liu, W., & Ding, H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43999-5_50 · Cited by 7
Chen, Y., Zeng, R., & Xiong, S. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3323684 · Cited by 7
Anti-Compression Contrastive Facial Forgery Detection
Huang, J., Du, C., Zhu, X., Ma, S., Nepal, ., & Xu, C. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3347103 · Cited by 7
Fast-Vid2Vid++: Spatial-Temporal Distillation for Real-Time Video-to-Video Synthesis
Zhuo, L., Wang, G., Li, S., Wu, W., & Liu, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3450630 · Cited by 8
DGPose: Deep Generative Models for Human Body Analysis
de, R., Ghosh, A., Ajanthan, T., Mikšík, O., Boukhayma, A., Siddharth, N., & Torr, P. H. S. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01306-1 · Cited by 7
HVTR++: Image and Pose Driven Human Avatars Using Hybrid Volumetric-Textural Rendering
Hu, T., Xu, H., Luo, L., Yu, T., Zheng, Z., Zhang, H., Liu, Y., & Zwicker, M. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3297721 · Cited by 9
3D-Aware Multi-Class Image-to-Image Translation with NeRFs
Li, S., van de Weijer, J., Wang, Y., Khan, F. S., Liu, M., & Yang, J. J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01217 · Cited by 7
Self-citationGeometry-Aware GAN for Face Attribute Transfer
Huang, D., Tao, X., Lü, J., & Do, M. N. (2019) · IEEE Access · doi:10.1109/access.2019.2942182 · Cited by 7
Memorize, Then Recall: A Generative Framework for Low Bit-Rate Surveillance Video Compression
Wu, Y., He, T., & Chen, Z. (2020) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas45731.2020.9180753 · Cited by 7
Supervised Video-to-Video Synthesis for Single Human Pose Transfer
Wang, H.-Y., Huang, M., Wu, D., Li, Y., & Zhang, W. (2021) · IEEE Access · doi:10.1109/access.2021.3053617 · Cited by 7
FoV-Net: Field-of-View Extrapolation Using Self-Attention and Uncertainty
Ma, L., Georgoulis, S., Jia, X., & Gool, L. V. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3067848 · Cited by 7
BPA-GAN: Human motion transfer using body-part-aware generative adversarial networks
Jiang, J., Li, G., Wu, S., Zhang, H., & Nie, Y. (2021) · Graphical Models · doi:10.1016/j.gmod.2021.101107 · Cited by 7
A Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors
Zheng, R., Zhou, Z., Song, B., & Ji, C. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412187 · Cited by 7
Disentangling random and cyclic effects in time-lapse sequences
Härkönen, E., Aittala, M., Kynkäänniemi, T., Laine, S., Aila, T., & Lehtinen, J. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530170 · Cited by 7
AlignFlow: Cycle Consistent Learning from Multiple Domains via Normalizing Flows
Grover, A., Chute, C., Shu, R., Cao, Z., & Ermon, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5820 · Cited by 12
Let's Play Music: Audio-Driven Performance Video Generation
Zhu, H., Li, Y., Zhu, F., Zheng, A., & He, R. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412698 · Cited by 7
A Shared Representation for Photorealistic Driving Simulators
Saadatnejad, S., Li, S., Mordan, T., & Alahi, A. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3131303 · Cited by 7
Deep Learning Highway Traffic Scenario Construction with Trajectory Generators
van der Heide, A., Tampère, C. M. J., & Nicolai, M. (2023) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55152.2023.10186614 · Cited by 6
Efficiency-optimized Video Diffusion Models
Deng, Z., He, X., & Peng, Y. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612406 · Cited by 6
3D-Aware Talking-Head Video Motion Transfer
Ni, H., Liu, J., Xue, Y., & Huang, X. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00488 · Cited by 6
Dynamic Graph Memory Bank for Video Inpainting
Zhou, X., Fu, C., Huang, H., & He, R. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3411061 · Cited by 7
TexVocab: Texture Vocabulary-Conditioned Human Avatars
Liu, Y., Li, Z., Liu, Y., & Wang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00169 · Cited by 7
Conditional Temporal Variational AutoEncoder for Action Video Prediction
Xu, X., Wang, Y., Wang, L., Yu, B., & Jia, J. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01832-8 · Cited by 8
Parallel Generative Adversarial Network for Third-person to First-person Image Generation
Liu, G., Latapie, H. M., Kılıç, Ö., & Lawrence, A. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00208 · Cited by 6
Self-citationNHK Meta Studio: A Compact Volumetric TV Studio for 3-D Reconstruction
Morioka, H., Misu, T., Suginoshita, T., & Mitsumine, H. (2022) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2022.3210367 · Cited by 6
SURFGenerator: Generative Adversarial Network Modeling for Synthetic Flooding Video Generation
Lamczyk, S., Ampofo, K., Salashour, B., Cetin, M., & Iftekharuddin, K. M. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891969 · Cited by 6
Versatile Face Animator: Driving Arbitrary 3D Facial Avatar in RGBD Space
Wang, H., Wu, H., Xing, J., & Jia, J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612065 · Cited by 6
Cortinhal, T., & Aksoy, E. E. (2023) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2023.104583 · Cited by 6
NAFT and SynthStab: A RAFT-Based Network and a Synthetic Dataset for Digital Video Stabilization
Souza, M. R. E., Maia, H. D. A., & Pedrini, H. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02264-8 · Cited by 6
Semi Few-Shot Attribute Translation
Durall, R., Pfreundt, F., & Keuper, J. (2019) · International Conference on Image and Vision Computing New Zealand (IVCNZ) · doi:10.1109/ivcnz48456.2019.8961034 · Cited by 6
Pose-Forecasting Aided Human Video Prediction With Graph Convolutional Networks
Zhao, Y., & Dou, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2995383 · Cited by 6
Defect detection of photovoltaic glass based on level set map
Dong, S., Chen, C., Liang, Y., Zou, K., & Liu, G. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07005-x · Cited by 6
Self-citationTemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinates
Xie, Y. X., Mao, H., Yao, A., & Thuerey, N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00344 · Cited by 6
High-Quality Video Generation from Static Structural Annotations
Sheng, L., Pan, J., Guo, J., Shao, J., & Loy, C. C. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01334-x · Cited by 6
Stable Video Style Transfer Based on Partial Convolution with Depth-Aware Supervision
Liu, S., Wu, H., Luo, S., & Sun, Z. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413526 · Cited by 7
Robust Pose Transfer With Dynamic Details Using Neural Video Rendering
Sun, Y.-T., Huang, H., Wang, X., Lai, Y., Liu, W., & Gao, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3166989 · Cited by 6
Cascaded Siamese Self-supervised Audio to Video GAN
Aldausari, N., Sowmya, A., Marcus, N., & Mohammadi, G. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00515 · Cited by 6
Decoupling Identity and Visual Quality for Image and Video Anonymization
Maximov, M., Elezi, I., & Leal-Taixé, L. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26351-4_31 · Cited by 6
Semantic Road Layout Understanding by Generative Adversarial InpaintingPreprint
Berlincioni, L., Becattini, F., Galteri, L., Seidenari, L., & Bimbo, A. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11746 · Cited by 6
AI‐generated video steganography based on semantic segmentation
Lin, Y., Luo, P., Zhang, Z., Liu, J., & Yang, X. (2024) · IET Image Processing · doi:10.1049/ipr2.13154 · Cited by 5
Bidirectional Error-Aware Fusion Network for Video Inpainting
Hou, J., Ji, Z., Yang, J., & Zheng, F. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3454641 · Cited by 5
Semantic-Aware Dynamic Parameter for Video Inpainting Transformer
Lee, E.-H., Yoo, J., Yang, Y., Baik, S., & Kim, T. H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01190 · Cited by 5
Just Dance: detection of human body reenactment fake videos
Alamayreh, O., Fascella, C., Mandelli, S., Tondi, B., Bestagini, P., & Barni, M. (2024) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-024-00635-2 · Cited by 5
Relightable Neural Actor with Intrinsic Decomposition and Pose Control
Luvizon, D. C., Golyanik, V., Kortylewski, A., Habermann, M., & Theobalt, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73202-7_27 · Cited by 8
Mahara, A., Rishe, N. D., & Deng, L. (2025) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai64502.2025.00134 · Cited by 9
Sequential Affinity Learning for Video Restoration
Tian, Y., Chen, S., Liu, Y., Chai, W., Bai, J., Zou, W., Zhang, Y., Jiang, M., Chen, E., & Xue, C. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611742 · Cited by 5
Raformer: Redundancy-Aware Transformer for Video Wire Inpainting
Ji, Z., Su, Y., Zhang, Y., Hou, J., Pang, Y., & Han, J. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3550038 · Cited by 5
WAIT: Feature warping for animation to illustration video translation using GANs
Hiçsönmez, S., Samet, N., Samet, F., Bakir, O., Akbaş, E., & Duygulu, P. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130108 · Cited by 5
Learning to Synthesize and Manipulate Natural Images
Zhu, J.-Y. (2019) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2019.2891309 · Cited by 5
Self-citationSignature and Log-Signature for the Study of Empirical Distributions Generated with GANs
de Curtò, J., de Zarzà, I., Roig, G., & Calafate, C. T. (2023) · Electronics · doi:10.3390/electronics12102192 · Cited by 6
Recognizing Microexpression as Macroexpression by the Teacher-student Framework Network
Song, Y., Zhao, W., Chen, T., Li, S., & Li, J. (2022) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct57072.2022.00115 · Cited by 5
Synthesizing Photorealistic Virtual Humans Through Cross-Modal Disentanglement
Ravichandran, S., Texler, O., Dinev, D., & Kang, H. J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00445 · Cited by 5
Mixpred: Video Prediction Beyond Optical Flow
Yan, J., Qin, G., Zhao, R., Liang, Y., & Xu, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2961383 · Cited by 5
Spatial-Intensity Transform GANs for High Fidelity Medical Image-to-Image Translation
Wang, C. J., Rost, N. S., & Golland, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59713-9_72 · Cited by 5
Çalışkan, A., Mustafa, A., & Hilton, A. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00197 · Cited by 5
Creating and Reenacting Controllable 3D Humans with Differentiable Rendering
Gomes, T. L., Coutinho, T., Azevedo, R., Martins, R., & Nascimento, E. R. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00079 · Cited by 5
Pose Guided Image Generation from Misaligned Sources via Residual Flow Based Correction
Lu, J., Wang, H., Shao, T., Yang, Y., & Zhou, K. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20080 · Cited by 5
QS-Craft: Learning to Quantize, Scrabble and Craft for Conditional Human Motion Animation
Hong, Y., Qian, X., Luo, S., Guo, G., Xue, X., & Fu, Y. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26351-4_27 · Cited by 5
GAN-Based LiDAR Intensity Simulation
Marcus, R., Gabel, F., Knoop, N., & Stamminger, M. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-39059-3_28 · Cited by 4
Saini, A., & Bhui, P. (2024) · IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT) · doi:10.1109/isgt59692.2024.10454173 · Cited by 4
A Survey on Detecting Deep Fakes Using Advanced AI-Based Approaches
Abdulhamed, M. A., & Hashim, A. N. (2024) · Iraqi Journal of Science · doi:10.24996/ijs.2024.65.9.37 · Cited by 4
Elevating Flow-Guided Video Inpainting with Reference Generation
Cho, S., Oh, S. W., Lee, S., & Lee, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i3.32255 · Cited by 4
Generating Bird’s Eye View from Egocentric RGB Videos
Jain, V., Wu, Q., Grover, S., Sidana, K., Chaudhary, G., Myint, S. H., & Hua, Q. (2021) · Wireless Communications and Mobile Computing · doi:10.1155/2021/7479473 · Cited by 4
Photo-realistic image synthesis from lines and appearance with modular modulation
Luo, W., Yang, S., & Zhang, W. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.06.007 · Cited by 4
Conditional generative adversarial networks in computer vision: an introduction and outlook
Gao, M. (2022) · International Conference on Artificial Intelligence, Automation and High Performance Computing (AIAHPC) · doi:10.1117/12.2641644 · Cited by 4
FSTT: Flow-Guided Spatial Temporal Transformer for Deep Video Inpainting
Liu, R., & Zhu, Y. (2023) · Electronics · doi:10.3390/electronics12214452 · Cited by 4
Realistic real-time processing of anime portraits based on generative adversarial networks
Zhu, G., Qu, Z., Sun, L., Liu, Y., & Yang, J. (2024) · Journal of Real-Time Image Processing · doi:10.1007/s11554-024-01481-1 · Cited by 4
Scalable video transformer for full-frame video prediction
Li, Z., & Liu, F. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104166 · Cited by 4
Metadata
- Authors
- Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Liu, G., Tao, A., Kautz, J., & Catanzaro, B.
- Affiliations
- Nvidia (United Kingdom) (GB)
- University of California, Berkeley (US)
- Adobe Systems (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 1144-1156
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1808.06601
- OpenAlex
- W2886748926
- Cited by
- 594
- References
- 78
- Citations by year
- 2026: 1 · 2025: 28 · 2024: 61 · 2023: 87 · 2022: 88 · 2021: 123 · 2020: 117 · 2019: 87 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- semantic segmentation masks, generative adversarial networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
