The DOI matches its DataCite record; 74 of the 78 references it cites were found in a registry or an index.
Video-to-Video Synthesis
Open accessAbstract
We study the problem of video-to-video synthesis, whose goal is to learn a mapping function from an input source video (e.g., a sequence of semantic segmentation masks) to an output photorealistic video that precisely depicts the content of the source video. While its image counterpart, the image-to-image synthesis problem, is a popular topic, the video-to-video synthesis problem is less explored in the literature. Without understanding temporal dynamics, directly applying existing image synthesis approaches to an input video often results in temporally incoherent videos of low visual quality. In this paper, we propose a novel video-to-video synthesis approach under the generative adversarial learning framework. Through carefully-designed generator and discriminator architectures, coupled with a spatio-temporal adversarial objective, we achieve high-resolution, photorealistic, temporally coherent video results on a diverse set of input formats including segmentation masks, sketches, and poses. Experiments on multiple benchmarks show the advantage of our method compared to strong baselines. In particular, our model is capable of synthesizing 2K resolution videos of street scenes up to 30 seconds long, which significantly advances the state-of-the-art of video synthesis. Finally, we apply our approach to future video prediction, outperforming several state-of-the-art competing systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Results again showed that the proposed algorithm overperformed the other algorithms, both in the PSNR and SSIM metrics.”
From A Review of Detection and Removal of Raindrops in Automotive Vision Systems (2021) · cites this paper as [67]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Self-citationImage-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Self-citationAggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
(1981) · Cited by 11,963
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Flagged first, then by citations
4 of the 78 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- [7][7] Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh. Realtime multi-person 2D pose estimation using part affinity fields. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [16][16] A. Dosovitskiy and T. Brox. Generating images with perceptual similarity metrics based on deep networks. In Advances in Neural Information Processing Systems (NIPS) , 2016. -
- [25][25] K. He, G. Gkioxari, P. Dollár, and R. Girshick. Mask R-CNN. In IEEE International Conference on Computer Vision (ICCV) , 2017. -
- [32][32] E. Ilg, N. Mayer, T. Saikia, M. Keuper, A. Dosovitskiy, and T. Brox. Flownet 2.0: Evolution of optical flow estimation with deep networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [36][36] N. Kalchbrenner, A. v. d. Oord, K. Simonyan, I. Danihelka, O. Vinyals, A. Graves, and K. Kavukcuoglu. Video pixel networks. arXiv preprint arXiv:1610.00527 , 2016. - · arXiv
- [37][37] T. Karras, T. Aila, S. Laine, and J. Lehtinen. Progressive growing of GANs for improved quality, stability, and variation. In International Conference on Learning Representations (ICLR) , 2018. -
- [42][42] X. Liang, L. Lee, W. Dai, and E. P. Xing. Dual motion GAN for future-flow embedded video prediction. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [47][47] L. Ma, X. Jia, Q. Sun, B. Schiele, T. Tuytelaars, and L. Van Gool. Pose guided person image generation. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [50][50] M. Mathieu, C. Couprie, and Y. LeCun. Deep multi-scale video prediction beyond mean square error. In International Conference on Learning Representations (ICLR) , 2016. -
- [65][65] N. Srivastava, E. Mansimov, and R. Salakhudinov. Unsupervised learning of video representations using lstms. In International Conference on Machine Learning (ICML) , 2015. -
Cited by
Sorted by citations
Items 101–200 of 678
Exposing deepfakes using a deep multilayer perceptron – convolutional neural network model
Kolagati, S., Priyadharshini, T. C., & Rajam, V. M. A. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2021.100054 · Cited by 92
Example-Guided Style-Consistent Image Synthesis From Semantic Labeling
Wang, M., Yang, G.-Y., Li, R., Liang, R.-Z., Zhang, S., Hall, P. M., & Hu, S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00159 · Cited by 89
Yang, C., Pan, Y., Yao, T., Tian, X., & Mei, T. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350937 · Cited by 89
Deep Learning-Based Image and Video Inpainting: A Survey
Quan, W., Chen, J., Liu, Y., Dong-ming Yan, A., & Wonka, P. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-023-01977-6 · Cited by 106
Machine learning for multi-dimensional optimisation and predictive visualisation of laser machining
McDonnell, M., Arnaldo, D., Pelletier, E., Grant‐Jacob, J. A., Praeger, M. F., Karnakis, D., Eason, R. W., & Mills, B. (2021) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-020-01717-4 · Cited by 88
World-Consistent Video-to-Video Synthesis
Mallya, A., Wang, T.-C., Sapra, K., & Liu, M.-Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58598-3_22 · Cited by 87
Self-citationDetecting fake images by identifying potential texture difference
Yang, J., Xiao, S., Li, A., Lan, G., & Wang, H. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.06.043 · Cited by 86
Rakhimov, R., Volkhonskiy, D., Artemov, A., Zorin, D., & Burnaev, E. V. (2021) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0010241801010112 · Cited by 85
Socially and Contextually Aware Human Motion and Pose Forecasting
Adeli, V., Adeli, E., Reid, I. D., Niebles, J. C., & Rezatofighi, H. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3010742 · Cited by 85
COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encoder
Saito, K., Saenko, K., & Liu, M.-Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58580-8_23 · Cited by 88
Self-citationSaunders, B., Camgöz, N. C., & Bowden, R. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00508 · Cited by 83
An Internal Learning Approach to Video Inpainting
Zhang, H., Mai, L., Jin, H., Wang, Z., Xu, N., & Collomosse, J. P. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00281 · Cited by 81
G3AN: Disentangling Appearance and Motion for Video Generation
Wang, Y., Biliński, P., Brémond, F., & Dantcheva, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00531 · Cited by 81
Photorealistic Audio-driven Video Portraits
Wen, X. L., Wang, M., Richardt, C., Chen, Z.-Y., & Hu, S. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3023573 · Cited by 81
On Leveraging Pretrained GANs for Generation with Limited DataPreprint
Zhao, M., Cong, Y., & Carin, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11810 · Cited by 87
THE AUGMENTED DESIGNER: A RESEARCH AGENDA FOR GENERATIVE AI-ENABLED DESIGN
Thoring, K., Huettemann, S., & Mueller, R. M. (2023) · Proceedings of the Design Society · doi:10.1017/pds.2023.335 · Cited by 79
Learning to Simulate Dynamic Environments With GameGAN
Kim, S. W., Zhou, Y., Philion, J., Torralba, A. B., & Fidler, S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00131 · Cited by 83
GAN Memory with No ForgettingPreprint
Cong, Y., Zhao, M., Li, J., Wang, S., & Carin, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07543 · Cited by 77
Deep Video‐Based Performance Cloning
Aberman, K., Shi, M., Liao, J., Lischinski, D., Chen, B., & Cohen‐Or, D. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13632 · Cited by 76
Deep Spatial Transformation for Pose-Guided Person Image Generation and Animation
Ren, Y., Li, G., Liu, S., & Li, T. H. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3018224 · Cited by 74
StylePeople: A Generative Model of Fullbody Human Avatars
Grigorev, A., Iskakov, K., Ianina, A., Bashirov, R., Zakharkin, I., Vakhitov, A., & Lempitsky, V. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00511 · Cited by 74
DriveGAN: Towards a Controllable High-Quality Neural Simulation
Kim, S. W., Philion, J., Torralba, A., & Fidler, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00576 · Cited by 72
Recurrent Temporal Aggregation Framework for Deep Video Inpainting
Kim, D., Woo, S., Lee, J., & Kweon, I. S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2958083 · Cited by 71
Learning Dynamic Textures for Neural Rendering of Human Actors
Liu, L., Xu, W., Habermann, M., Zollhöfer, M., Bernard, F., Kim, H., Wang, W., & Theobalt, C. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.2996594 · Cited by 71
Pose-Guided Human Animation from a Single Image in the Wild
Yoon, J. S., Liu, L., Golyanik, V., Sarkar, K., Park, H. S., & Theobalt, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01479 · Cited by 71
Speech Drives Templates: Co-Speech Gesture Synthesis with Learned Templates
Qian, S., Tu, Z., Zhi, Y., Liu, W., & Gao, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01089 · Cited by 78
Diverse Semantic Image Synthesis via Probability Distribution Modeling
Tan, Z., Chai, M., Chen, D., Liao, J., Chu, Q., Liu, B., Hua, G., & Yu, N. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00787 · Cited by 70
Fast Video Multi-Style Transfer
Gao, W., Li, Y., Yin, Y., & Yang, M. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093420 · Cited by 67
Label-Noise Robust Generative Adversarial Networks
Kaneko, T., Ushiku, Y., & Harada, T. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00257 · Cited by 66
Otberdout, N., Daoudi, M., Kacem, A., Ballihi, L., & Berretti, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3002500 · Cited by 68
High-Fidelity Face Manipulation With Extreme Poses and Expressions
Fu, C., Hu, Y., Wu, X., Wang, G., Zhang, Q., & He, R. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3050065 · Cited by 66
Tewari, A., Fried, O., Thies, J., Sitzmann, V., Lombardi, S., Xu, Z., Simon, T., Nießner, M., Tretschk, E., Liu, L., et al. (2021) · ACM SIGGRAPH Courses · doi:10.1145/3450508.3464573 · Cited by 65
Self-citationDance Dance Generation: Motion Transfer for Internet Videos
Zhou, Y., Wang, Z., Chen, F., Bui, T., & Berg, T. L. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00153 · Cited by 67
Pathdreamer: A World Model for Indoor Navigation
Koh, J. Y., Lee, H., Yang, Y., Baldridge, J., & Anderson, P. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01447 · Cited by 82
Multimodal Inputs Driven Talking Face Generation With Spatial–Temporal Dependency
Yu, L., Yu, J., Li, M., & Ling, Q. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2973374 · Cited by 63
Requena‐Mesa, C., Benson, V., Reichstein, M., Runge, J., & Denzler, J. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00124 · Cited by 69
Make It Move: Controllable Image-to-Video Generation with Text Descriptions
Hu, Y., Luo, C., & Chen, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01768 · Cited by 62
Conditional GANs for Multi-Illuminant Color Constancy: Revolution or yet Another Approach?
Sidorov, O. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00225 · Cited by 62
Head2Head: Video-based Neural Head Synthesis
Koujan, M. R., Doukas, M. C., Roussos, A., & Zafeiriou, S. P. (2020) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg47880.2020.00048 · Cited by 61
Generative Models for Fast Calorimeter Simulation: the LHCb case>
Chekalina, V., Orlova, E., Ratnikov, F., Ulyanov, D., Ustyuzhanin, A., & Zakharov, E. (2019) · EPJ Web of Conferences · doi:10.1051/epjconf/201921402034 · Cited by 61
Only Train Once: A One-Shot Neural Network Training And Pruning FrameworkPreprint
Chen, T., Ji, B., Ding, T., Fang, B., Wang, G., Zhu, Z., Liang, L., Shi, Y., Yi, S., & Tu, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07467 · Cited by 63
Seeing What a GAN Cannot Generate
Bau, D., Zhu, J.-Y., Wulff, J., Peebles, W., Zhou, B., Strobelt, H., & Torralba, A. B. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00460 · Cited by 65
Self-citationLearning to Groove with Inverse Sequence TransformationsPreprint
Gillick, J., Roberts, A., Engel, J., Eck, D., & Bamman, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.06118 · Cited by 64
Teachers Do More Than Teach: Compressing Image-to-Image Models
Jin, Q., Ren, J., Woodford, O. J., Wang, J., Yuan, G., Wang, Y., & Tulyakov, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01339 · Cited by 58
HumanGAN: A Generative Model of Human Images
Sarkar, K., Liu, L., Golyanik, V., & Theobalt, C. (2021) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv53792.2021.00036 · Cited by 58
OTAvatar: One-Shot Talking Face Avatar with Controllable Tri-Plane Rendering
Ma, Z., Zhu, X., Qi, G.-J., Lei, Z., & Zhang, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01621 · Cited by 58
Progressive Temporal Feature Alignment Network for Video Inpainting
Zou, X., Yang, L., Liu, D., & Lee, Y. J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01618 · Cited by 57
Robinson, J. P., Li, Y., Zhang, N., Fu, Y., & Tulyakov, S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01020 · Cited by 57
TransMoMo: Invariance-Driven Unsupervised Video Motion Retargeting
Yang, Z., Zhu, W., Wu, W., Qian, C., Zhou, Q., Zhou, B., & Loy, C. C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00535 · Cited by 57
DPE: Disentanglement of Pose and Expression for General Video Portrait Editing
Pang, Y., Zhang, Y., Quan, W., Fan, Y., Cun, X., Shan, Y., & Dong-ming Yan, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00049 · Cited by 56
RainMamba: Enhanced Locality Learning with State Space Models for Video Deraining
Wu, H., Yang, Y., Xu, H., Wang, W., Zhou, J., & Zhu, L. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680916 · Cited by 56
Learning to detect anomaly events in crowd scenes from synthetic data
Lin, W., Gao, J., Wang, Y., & Li, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.031 · Cited by 56
Machine learning in NextG networks via generative adversarial networks
Ayanoglu, E., Davaslioglu, K., & Sagduyu, Y. E. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3153004 · Cited by 55
ADD: Attention-Based DeepFake Detection Approach
Khormali, A., & Yuan, J.-S. (2021) · Big Data and Cognitive Computing · doi:10.3390/bdcc5040049 · Cited by 55
FLNet: Landmark Driven Fetching and Learning Network for Faithful Talking Facial Animation Synthesis
Gu, K., Zhou, Y., & Huang, T. S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6717 · Cited by 55
ANR: Articulated Neural Rendering for Virtual Avatars
Raj, A., Tanke, J., Hays, J. H., Vo, M., Stoll, C., & Lassner, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00372 · Cited by 55
Yes, we GAN: Applying adversarial techniques for autonomous driving
Uřičář, M., Křížek, P., Hurych, D., Sobh, I., Yogamani, S. K., & Denny, P. E. (2019) · Electronic Imaging · doi:10.2352/issn.2470-1173.2019.15.avm-048 · Cited by 58
Multi-attention-based approach for deepfake face and expression swap detection and localization
Waseem, S., Abu–Bakar, S. A. R., Omar, Z., Ahmed, B. A., Baloch, S., & Hafeezallah, A. (2023) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-023-00614-z · Cited by 54
Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitions
Wang, Z., Yu, P., Zhao, Y., Zhang, R., Zhou, Y., Yuan, J., & Chen, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6911 · Cited by 52
A review of digital video tampering: From simple editing to full synthesis
Johnston, P., & Elyan, E. (2019) · Digital Investigation · doi:10.1016/j.diin.2019.03.006 · Cited by 51
Chiu, H.-K., Adeli, E., & Niebles, J. C. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2992184 · Cited by 52
Head2Head++: Deep Facial Attributes Re-Targeting
Doukas, M. C., Koujan, M. R., Sharmanska, V., Roussos, A., & Zafeiriou, S. P. (2021) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2021.3049576 · Cited by 52
LOHO: Latent Optimization of Hairstyles via Orthogonalization
Saha, R., Duke, B., Shkurti, F., Taylor, G. W., & Aarabi, P. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00202 · Cited by 49
PuppeteerGAN: Arbitrary Portrait Animation With Semantic-Aware Appearance Transformation
Chen, Z. Q., Wang, C., Yuan, B., & Tao, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01353 · Cited by 48
A survey on recent advances in Sign Language Production
Rastgoo, R., Kiani, K., Escalera, S., Athitsos, V., & Sabokrou, M. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122846 · Cited by 53
Liquid Warping GAN With Attention: A Unified Framework for Human Image Synthesis
Liu, W., Piao, Z., Tu, Z., Luo, W., Ma, L., & Gao, S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3078270 · Cited by 47
Self-Supervised Pose Adaptation for Cross-Domain Image Animation
Wang, C., Xu, C., & Tao, D. (2020) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2020.3031581 · Cited by 46
Structure-Aware Human-Action Generation
Yu, P., Zhao, Y., Li, C., Yuan, J., & Chen, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58577-8_2 · Cited by 46
Short-Term and Long-Term Context Aggregation Network for Video Inpainting
Li, A., Zhao, S., Ma, X., Gong, M., Qi, J., Zhang, R., Tao, D., & Ramamohanarao, K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58548-8_42 · Cited by 46
DeepFake Disrupter: The Detector of DeepFake Is My Friend
Wang, X., Huang, J., Ma, S., Nepal, S., & Xu, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01450 · Cited by 45
Compact Temporal Trajectory Representation for Talking Face Video Compression
Chen, B., Wang, Z., Li, B., Wang, S., & Ye, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3271130 · Cited by 45
Stochastic Image-to-Video Synthesis using cINNs
Dorkenwald, M., Milbich, T., Blattmann, A., Rombach, R., Derpanis, K. G., & Ommer, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00374 · Cited by 45
Smile Like You Mean It: Driving Animatronic Robotic Face with Learned Models
Chen, B., Hu, Y., Li, L., Cummings, S., & Lipson, H. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560797 · Cited by 45
Low Bandwidth Video-Chat Compression using Deep Generative Models
Oquab, M., Stock, P., Gafni, O., Haziza, D., Xu, T., Zhang, P., Çelebi, O., Hasson, Y., Labatut, P., Bose-Kolanu, B., et al. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00271 · Cited by 44
Neural Video Compression Using GANs for Detail Synthesis and Propagation
Mentzer, F., Agustsson, E., Ballé, J., Minnen, D. C., Johnston, N., & Toderici, G. D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19809-0_32 · Cited by 43
Look Outside the Room: Synthesizing A Consistent Long-Term 3D Scene Video from A Single Image
Ren, X., & Wang, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00355 · Cited by 48
Nondestructive 3D pathology with analysis of nuclear features for prostate cancer risk assessment
Serafin, R., Koyuncu, C., Xie, W., Huang, H., Glaser, A. K., Reder, N. P., Janowczyk, A. R., True, L. D., Madabhushi, A., & Liu, J. (2023) · The Journal of Pathology · doi:10.1002/path.6090 · Cited by 43
Salazar-Colores, S., Alberto-Moreno, H., Echeverri, C. J. O., & Flores, G. (2020) · IEEE Access · doi:10.1109/access.2020.3038437 · Cited by 43
Deep Person Generation: A Survey from the Perspective of Face, Pose, and Cloth Synthesis
Sha, T., Zhang, W., Shen, T., Li, Z., & Mei, T. (2022) · ACM Computing Surveys · doi:10.1145/3575656 · Cited by 46
BachGAN: High-Resolution Image Synthesis From Salient Object Layout
Li, Y., Cheng, Y., Gan, Z., Yu, L., Wang, L., & Liu, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00839 · Cited by 42
One-shot Implicit Animatable Avatars with Model-based Priors
Huang, Y., Yi, H., Liu, W., Wang, H., Wu, B., Wang, W., Lin, B., Zhang, D., & Cai, D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00824 · Cited by 42
Neural Scene Decomposition for Multi-Person Motion Capture
Rhodin, H., Constantin, V., Katircioglu, I., Salzmann, M., & Fua, P. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00789 · Cited by 41
Towards Fine-Grained Human Pose Transfer With Detail Replenishing Network
Yang, L., Wang, P., Liu, C., Gao, Z., Ren, P., Zhang, X., Wang, S., Ma, S., Hua, X., & Gao, W. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3052364 · Cited by 40
Adversarial-learning-based image-to-image transformation: A survey
Chen, Y., Zhao, Y., Jia, W., Li, C., & Liu, X. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.06.067 · Cited by 42
Wang, C., Wang, P., Wang, P., Xue, B., & Wang, D. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3083647 · Cited by 40
Fine-Grained Instance-Level Sketch-Based Video Retrieval
Xu, P., Liu, K., Xiang, T., Hospedales, T. M., Ma, Z., Guo, J. H., & Song, Y.-Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3014491 · Cited by 39
Just Noticeable Difference for Deep Machine Vision
Jin, J., Zhang, X., Fu, X., Zhang, H., Lin, W., Lou, J., & Zhao, Y. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3113572 · Cited by 39
A survey on deep learning fundamentals
Tian, C., Cheng, T., Peng, Z., Zuo, W., Tian, Y., Zhang, Q., Wang, F., & Zhang, D. D. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11368-7 · Cited by 46
Scripted Video Generation With a Bottom-Up Generative Adversarial Network
Chen, Q., Wu, Q., Chen, J., Wu, Q., van den Hengel, A., & Tan, M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3003227 · Cited by 38
Menapace, W., Lathuilière, S., Tulyakov, S., Siarohin, A., & Ricci, E. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00993 · Cited by 48
Structure-Aware Motion Transfer with Deformable Anchor Model
Tao, J., Wang, B., Xu, B., Ge, T., Jiang, Y., Li, W., & Duan, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00362 · Cited by 38
Preserving Semantic and Temporal Consistency for Unpaired Video-to-Video Translation
Park, K., Woo, S., Kim, D., Cho, D., & Kweon, I. S. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350864 · Cited by 37
Generating Person Images with Appearance-aware Pose Stylizer
Huang, S., Xiong, H., Cheng, Z.-Q., Wang, Q., Zhou, X., Wen, B., Huan, J., & Dou, D. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/87 · Cited by 37
DeepFake MNIST+: A DeepFake Facial Animation Dataset
Huang, J., Wang, X., Du, B., Du, P., & Xu, C. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00224 · Cited by 37
End-To-End Time-Lapse Video Synthesis From a Single Outdoor Image
Nam, S., Ma, C., Chai, M., Brendel, W., Xu, N., & Kim, S. J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00150 · Cited by 37
Yu, J., Zhang, C., Song, Y., & Cai, W. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533988 · Cited by 41
Controllable Animation of Fluid Elements in Still Images
Mahapatra, A., & Kulkarni, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00365 · Cited by 39
SoK: Privacy-Preserving Data Synthesis
Hu, Y., Wu, F., Li, Q., Long, Y., Garrido, G. M., Ge, C., Ding, B., Forsyth, D. A., Li, B., & Song, D. X. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00002 · Cited by 55
GAC-GAN: A General Method for Appearance-Controllable Human Video Motion Transfer
Wei, D., Xu, X., Shen, H., & Huang, K. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3011290 · Cited by 36
Zhang, M., Wang, T. Y., Ceylan, D., & Mitra, N. J. (2021) · ACM Transactions on Graphics · doi:10.1145/3478513.3480497 · Cited by 35
Self-citation
Metadata
- Authors
- Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Liu, G., Tao, A., Kautz, J., & Catanzaro, B.
- Affiliations
- Nvidia (United Kingdom) (GB)
- University of California, Berkeley (US)
- Adobe Systems (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 1144-1156
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1808.06601
- OpenAlex
- W2886748926
- Cited by
- 594
- References
- 78
- Citations by year
- 2026: 1 · 2025: 28 · 2024: 61 · 2023: 87 · 2022: 88 · 2021: 123 · 2020: 117 · 2019: 87 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- semantic segmentation masks, generative adversarial networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
