The DOI matches its DataCite record; 74 of the 78 references it cites were found in a registry or an index.
Video-to-Video Synthesis
Open accessAbstract
We study the problem of video-to-video synthesis, whose goal is to learn a mapping function from an input source video (e.g., a sequence of semantic segmentation masks) to an output photorealistic video that precisely depicts the content of the source video. While its image counterpart, the image-to-image synthesis problem, is a popular topic, the video-to-video synthesis problem is less explored in the literature. Without understanding temporal dynamics, directly applying existing image synthesis approaches to an input video often results in temporally incoherent videos of low visual quality. In this paper, we propose a novel video-to-video synthesis approach under the generative adversarial learning framework. Through carefully-designed generator and discriminator architectures, coupled with a spatio-temporal adversarial objective, we achieve high-resolution, photorealistic, temporally coherent video results on a diverse set of input formats including segmentation masks, sketches, and poses. Experiments on multiple benchmarks show the advantage of our method compared to strong baselines. In particular, our model is capable of synthesizing 2K resolution videos of street scenes up to 30 seconds long, which significantly advances the state-of-the-art of video synthesis. Finally, we apply our approach to future video prediction, outperforming several state-of-the-art competing systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Results again showed that the proposed algorithm overperformed the other algorithms, both in the PSNR and SSIM metrics.”
From A Review of Detection and Removal of Raindrops in Automotive Vision Systems (2021) · cites this paper as [67]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Self-citationImage-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Self-citationAggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
(1981) · Cited by 11,963
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Research works printed but not linked: 10
- [7][7] Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh. Realtime multi-person 2D pose estimation using part affinity fields. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [16][16] A. Dosovitskiy and T. Brox. Generating images with perceptual similarity metrics based on deep networks. In Advances in Neural Information Processing Systems (NIPS) , 2016. -
- [25][25] K. He, G. Gkioxari, P. Dollár, and R. Girshick. Mask R-CNN. In IEEE International Conference on Computer Vision (ICCV) , 2017. -
- [32][32] E. Ilg, N. Mayer, T. Saikia, M. Keuper, A. Dosovitskiy, and T. Brox. Flownet 2.0: Evolution of optical flow estimation with deep networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [36][36] N. Kalchbrenner, A. v. d. Oord, K. Simonyan, I. Danihelka, O. Vinyals, A. Graves, and K. Kavukcuoglu. Video pixel networks. arXiv preprint arXiv:1610.00527 , 2016. - · arXiv
- [37][37] T. Karras, T. Aila, S. Laine, and J. Lehtinen. Progressive growing of GANs for improved quality, stability, and variation. In International Conference on Learning Representations (ICLR) , 2018. -
- [42][42] X. Liang, L. Lee, W. Dai, and E. P. Xing. Dual motion GAN for future-flow embedded video prediction. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [47][47] L. Ma, X. Jia, Q. Sun, B. Schiele, T. Tuytelaars, and L. Van Gool. Pose guided person image generation. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [50][50] M. Mathieu, C. Couprie, and Y. LeCun. Deep multi-scale video prediction beyond mean square error. In International Conference on Learning Representations (ICLR) , 2016. -
- [65][65] N. Srivastava, E. Mansimov, and R. Salakhudinov. Unsupervised learning of video representations using lstms. In International Conference on Machine Learning (ICML) , 2015. -
Cited by
Sorted by citations
Semantic Image Synthesis With Spatially-Adaptive Normalization
Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974
Self-citationThies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,443
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130191 · Cited by 1,231
Zhu, Y., Zabaras, N. J., Koutsourelakis, P., & Perdikaris, P. G. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.024 · Cited by 1,083
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863
Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824
Chan, C., Ginosar, S., Zhou, T., & Efros, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00603 · Cited by 737
MelGAN: generative adversarial networks for conditional waveform synthesis
Kumar, K., Kumar, R., de Boissiere, T., Gestin, L., Teoh, W. Z., Sotelo, J., de Brebisson, A., Bengio, Y., & Courville, A. (2019) · arXiv · doi:10.48550/arxiv.1910.06711 · Cited by 722
Few-Shot Adversarial Learning of Realistic Neural Talking Head Models
Zakharov, E., Shysheya, A., Burkov, E., & Lempitsky, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00955 · Cited by 687
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599
InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs
Shen, Y., Yang, C., Tang, X., & Zhou, B. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3034267 · Cited by 570
Image2StyleGAN++: How to Edit the Embedded Images?
Abdal, R., Qin, Y., & Wonka, P. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00832 · Cited by 509
HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video
Weng, C.-Y., Curless, B., Srinivasan, P. P., Barron, J. T., & Kemelmacher-Shlizerman, I. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01573 · Cited by 510
One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing
Wang, T.-C., Mallya, A., & Liu, M.-Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00991 · Cited by 496
Self-citationStructure and Content-Guided Video Synthesis with Diffusion Models
Esser, P., Chiu, J., Atighehchian, P., Granskog, J., & Germanidis, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00675 · Cited by 526
Deep-Learning Inversion of Seismic Data
Li, S., Liu, B., Ren, Y., Chen, Y., Yang, S., Wang, Y., & Jiang, P. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2953473 · Cited by 423
Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset
Zhang, Z., Li, L., Ding, Y., & Fan, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00366 · Cited by 368
A Review of Single-Source Deep Unsupervised Visual Domain Adaptation
Zhao, S., Yue, X., Zhang, S., Li, B., Zhao, H., Wu, B., Krishna, R., Gonzalez, J. E., Sangiovanni-Vincentelli, A. L., Seshia, S. A., et al. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3028503 · Cited by 361
Animating Arbitrary Objects via Deep Motion Transfer
Siarohin, A., Lathuilière, S., Tulyakov, S., Ricci, E., & Sebe, N. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00248 · Cited by 358
Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors
Gafni, O., Polyak, A., Ashual, O., Sheynin, S., Parikh, D., & Taigman, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19784-0_6 · Cited by 430
MEAD: A Large-Scale Audio-Visual Dataset for Emotional Talking-Face Generation
Wang, K., Wu, Q., Song, L., Yang, Z., Wu, W., Qian, C., He, R., Qiao, Y., & Loy, C. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58589-1_42 · Cited by 367
Learning Joint Spatial-Temporal Transformations for Video Inpainting
Zeng, Y., Fu, J., & Chao, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_31 · Cited by 308
Towards Visually Explaining Variational Autoencoders
Liu, W., Li, R., Zheng, M., Karanam, S., Wu, Z., Bhanu, B., Radke, R. J., & Camps, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00867 · Cited by 294
Chou, H.-P., Chang, S.-C., Pan, J.-Y., 韦薇, & Juan, D.-C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-65414-6_9 · Cited by 283
CIAGAN: Conditional Identity Anonymization Generative Adversarial Networks
Maximov, M., Elezi, I., & Leal-Taixé, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00549 · Cited by 283
Text-based Editing of Talking-head Video
Fried, O., Tewari, A., Zollhöfer, M., Finkelstein, A., Shechtman, E., Goldman, D. B., Genova, K., Jin, Z., Theobalt, C., & Agrawala, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323028 · Cited by 270
Controllable Person Image Synthesis With Attribute-Decomposed GAN
Men, Y., Mao, Y., Jiang, Y., Ma, W., & Lian, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00513 · Cited by 276
Visual Perception Enabled Industry Intelligence: State of the Art, Challenges and Prospects
Yang, J., Wang, C., Jiang, B., Song, H., & Meng, Q. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2998818 · Cited by 272
Motion Representations for Articulated Animation
Siarohin, A., Woodford, O. J., Ren, J., Chai, M., & Tulyakov, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01344 · Cited by 260
Liu, W., Piao, Z., Min, J., Luo, W., Ma, L., & Gao, S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00600 · Cited by 266
Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translation
Chen, R., Huang, W., Huang, B., Sun, F., & Fang, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00819 · Cited by 273
Unsupervised Discovery of Interpretable Directions in the GAN Latent SpacePreprint
Voynov, A. S., & Babenko, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.03754 · Cited by 272
Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications
Liu, M.-Y., Huang, X., Yu, J., Wang, T.-C., & Mallya, A. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3049196 · Cited by 236
Self-citationFew-shot Video-to-Video SynthesisPreprint
Wang, T.-C., Liu, M.-Y., Tao, A., Liu, G., Kautz, J., & Catanzaro, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12713 · Cited by 269
Self-citationKim, D., Woo, S., Lee, J., & Kweon, I. S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00594 · Cited by 229
Audio-Driven Emotional Video Portraits
Ji, X., Zhou, H., Wang, K., Wu, W., Loy, C. C., Cao, X., & Xu, F. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01386 · Cited by 235
GAN Compression: Efficient Architectures for Interactive Conditional GANs
Li, M., Lin, J., Ding, Y., Liu, Z., Zhu, J.-Y., & Han, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00533 · Cited by 216
Self-citationDeep Image Spatial Transformation for Person Image Generation
Ren, Y., Yu, X., Chen, J., Li, T. H., & Li, G. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00771 · Cited by 214
PIRenderer: Controllable Portrait Image Generation via Semantic Neural Rendering
Ren, Y., Li, G., Chen, Y., Li, T. H., & Liu, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01350 · Cited by 224
A State-of-the-Art Review on Image Synthesis With Generative Adversarial Networks
Wang, L., Chen, W., Yang, W., Bi, F., & Yu, F. R. (2020) · IEEE Access · doi:10.1109/access.2020.2982224 · Cited by 210
Free-Form Video Inpainting With 3D Gated Convolution and Temporal PatchGAN
Chang, Y.-L., Liu, Z. Y., Lee, K.-Y., & Hsu, W. H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00916 · Cited by 207
Multi-Band Melgan: Faster Waveform Generation For High-Quality Text-To-Speech
Yang, G., Yang, S., Liu, K., Fang, P., Chen, W., & Xie, L. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383551 · Cited by 196
Talking Face Generation by Conditional Recurrent Adversarial Network
Song, Y., Zhu, J., Li, D., Wang, A. Y.-D., & Qi, H. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/129 · Cited by 214
Self-citationCOVID-19 CT Image Synthesis With a Conditional Generative Adversarial Network
Jiang, Y., Chen, H., Loew, M. H., & Ko, H. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3042523 · Cited by 191
Neural Rerendering in the Wild
Meshry, M., Goldman, D. B., Khamis, S., Hoppe, H., Pandey, R., Snavely, N., & Martin-Brualla, R. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00704 · Cited by 185
Talking-Head Generation with Rhythmic Head Motion
Chen, L., Cui, G., Liu, C., Li, Z., Kou, Z., Xu, Y., & Xu, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58545-7_3 · Cited by 179
Video Generative Adversarial Networks: A Review
Aldausari, N., Sowmya, A., Marcus, N., & Mohammadi, G. (2022) · ACM Computing Surveys · doi:10.1145/3487891 · Cited by 192
Pix2Video: Video Editing using Image Diffusion
Ceylan, D., Huang, C.-H. P., & Mitra, N. J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02121 · Cited by 234
A Survey on Long-Tailed Visual Recognition
Yang, L., Jiang, H., Song, Q., & Guo, J. H. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01622-8 · Cited by 179
Tang, H., Xu, D., Yan, Y., Torr, P. H. S., & Sebe, N. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00789 · Cited by 168
FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting
Liu, R. Z. Z., Deng, H., Huang, Y., Shi, X., Lu, L., Sun, W., Wang, X., Dai, J., & Li, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01378 · Cited by 171
Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation
Tang, H., Xu, D., Sebe, N., & Yan, Y. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851881 · Cited by 168
An End-to-End Deep Neural Network for Autonomous Driving Designed for Embedded Automotive Platforms
Kocić, J., Jovicic, N. S., & Drndarević, V. (2019) · Sensors · doi:10.3390/s19092064 · Cited by 172
Adversarial Video Generation on Complex Datasets
Clark, A., Donahue, J., & Simonyan, K. (2019) · arXiv · doi:10.48550/arxiv.1907.06571 · Cited by 157
VideoGPT: Video Generation using VQ-VAE and Transformers
Yan, W., Zhang, Y., Abbeel, P., & Srinivas, A. (2021) · arXiv · doi:10.48550/arxiv.2104.10157 · Cited by 156
Towards An End-to-End Framework for Flow-Guided Video Inpainting
Li, Z., Lu, C.-Z., Qin, J., Guo, C., & Cheng, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01704 · Cited by 167
Follow Your Pose: Pose-Guided Text-to-Video Generation Using Pose-Free Videos
Ma, Y., He, Y., Cun, X., Wang, X., Chen, S., Li, X., & Chen, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28206 · Cited by 222
StyleGAN2 Distillation for Feed-Forward Image Manipulation
Viazovetskyi, Y., Ivashkin, V., & Kashin, E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_11 · Cited by 157
Fast Bi-Layer Neural Synthesis of One-Shot Realistic Head Avatars
Zakharov, E., Ivakhnenko, A., Shysheya, A., & Lempitsky, V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58610-2_31 · Cited by 143
Detecting Photoshopped Faces by Scripting Photoshop
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01017 · Cited by 140
Kaplanyan, A., Sochenov, A., Leimkühler, T., Okunev, M., Goodall, T., & Rufo, G. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356557 · Cited by 143
HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment
Yang, L., Wang, S., Ma, S., Gao, W., Liu, C., Wang, P., & Ren, P. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413965 · Cited by 137
Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer
Ge, S., Hayes, T., Yang, H. C., Yin, X. P., Pang, G., Jacobs, D. W., Huang, J., & Parikh, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19790-1_7 · Cited by 177
STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits
Bhattacharya, U., Mittal, T., Chandra, R., Randhavane, T., Bera, A., & Manocha, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i02.5490 · Cited by 132
Conditional Image-to-Video Generation with Latent Flow Diffusion Models
Ni, H., Shi, C., Li, K., Huang, X., & Min, M. R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01769 · Cited by 148
Coordinate-Based Texture Inpainting for Pose-Guided Human Image Generation
Grigorev, A., Sevastopolsky, A., Vakhitov, A., & Lempitsky, V. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01241 · Cited by 123
Neural Head Reenactment with Latent Pose Descriptors
Burkov, E., Pasechnik, I., Grigorev, A., & Lempitsky, V. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01380 · Cited by 128
ImaGINator: Conditional Spatio-Temporal GAN for Video Generation
Wang, Y., Biliński, P., Brémond, F., & Dantcheva, A. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093492 · Cited by 132
HeadGAN: One-shot Neural Head Synthesis and Editing
Doukas, M. C., Zafeiriou, S., & Sharmanska, V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01413 · Cited by 117
Sliced Wasserstein Generative Models
Wu, J., Huang, Z., Acharya, D., Li, W., Thoma, J., Paudel, D. P., & Gool, L. V. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00383 · Cited by 116
Saito, M., Saito, S., Koyama, M., & Kobayashi, S. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01333-y · Cited by 116
VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
Cheng, K., Cun, X., Zhang, Y., Xia, M., Yin, F., Zhu, M., Wang, X., Wang, J., & Wang, N. (2022) · SIGGRAPH Asia Conference Papers · doi:10.1145/3550469.3555399 · Cited by 112
SurfelGAN: Synthesizing Realistic Sensor Data for Autonomous Driving
Yang, Z., Chai, Y., Anguelov, D., Zhou, Y., Sun, P., Erhan, D., Rafferty, S., & Kretzschmar, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01113 · Cited by 110
FW-GAN: Flow-Navigated Warping GAN for Video Virtual Try-On
Dong, H., Liang, X., Shen, X., Wu, B., Chen, B.-C., & Yin, J. P. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00125 · Cited by 112
ProPainter: Improving Propagation and Transformer for Video Inpainting
Zhou, S., Li, C., Chan, K. C. K., & Change, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00961 · Cited by 139
Xie, W., Reder, N. P., Koyuncu, C., Leo, P., Hawley, S. J., Huang, H., Mao, C., Postupna, N. O., Kang, S., Serafin, R., et al. (2021) · Cancer Research · doi:10.1158/0008-5472.can-21-2843 · Cited by 108
Disco: Disentangled Control for Realistic Human Dance Generation
Wang, T., Li, L., Lin, K., Zhai, Y., Lin, C.-C., Yang, Z., Zhang, H., Liu, Z., & Wang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00891 · Cited by 174
Self-citationFace Generation and Editing With StyleGAN: A Survey
Melnik, A., Miasayedzenkau, M., Makaravets, D., Pirshtuk, D., Akbulut, E., Holzmann, D., Renusch, T., Reichert, G., & Ritter, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3350004 · Cited by 105
Shysheya, A., Zakharov, E., Aliev, K.-A., Bashirov, R., Burkov, E., Iskakov, K., Ivakhnenko, A., Malkov, Y. A., Pasechnik, I., Ulyanov, D., et al. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00249 · Cited by 105
Wang, Y., Yang, D., Brémond, F., & Dantcheva, A. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3449075 · Cited by 159
Learning to Drive from Simulation without Real World Labels
Bewley, A., Rigley, J., Liu, Y., Hawke, J., Shen, R., Lam, V.-D., & Kendall, A. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793668 · Cited by 114
Sequence Generative Adversarial Networks for Wind Power Scenario Generation
Liang, J., & Tang, W. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2952182 · Cited by 103
Enhancing Photorealism Enhancement
Richter, S. R., Alhaija, H. A., & Koltun, V. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3166687 · Cited by 124
InstanceDiffusion: Instance-Level Control for Image Generation
Wang, X., Darrell, T., Rambhatla, S. S., Girdhar, R., & Misra, I. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00596 · Cited by 139
Video Generation From Single Semantic Label Map
Pan, J., Wang, C., Jia, X., Shao, J., Sheng, L., Yan, J., & Wang, X. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00385 · Cited by 99
Lin, H., Liu, Y., Li, S., & Qu, X. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123744 · Cited by 99
TransGaGa: Geometry-Aware Unsupervised Image-To-Image Translation
Wu, W., Cao, K., Li, C., Qian, C., & Loy, C. C. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00820 · Cited by 98
Ferreira, J., Coutinho, T., Gomes, T. L., NETO, J. F. L., Azevedo, R., Martins, R., & Nascimento, E. R. (2020) · Computers & Graphics · doi:10.1016/j.cag.2020.09.009 · Cited by 101
A Dynamic Multi-Scale Voxel Flow Network for Video Prediction
Hu, X., Huang, Z., Huang, A., Xu, J., & Zhou, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00593 · Cited by 101
Blurry Video Frame Interpolation
Wang, S., Bao, W., Zhai, G., Chen, L., Min, X., & Gao, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00516 · Cited by 96
Future Video Synthesis With Object Motion Prediction
Wu, Y., Gao, R., Park, J., & Chen, Q. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00558 · Cited by 95
Stochastic Latent Residual Video PredictionPreprint
Franceschi, J.-Y., Delasalles, E., Chen, M., Lamprier, S., & Gallinari, P. (2020) · International Conference on Machine Learning · doi:10.48550/arxiv.2002.09219 · Cited by 96
Adversarial Inference for Multi-Sentence Video Description
Park, J. S., Rohrbach, M., Darrell, T., & Rohrbach, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00676 · Cited by 94
GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Driving
Chen, Y., Rong, F., Duggal, S., Wang, S., Yan, X., Manivasagam, S., Xue, S., Yumer, E., & Urtasun, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00715 · Cited by 93
Hybrid geological modeling: Combining machine learning and multiple-point statistics
Bai, T., & Tahmasebi, P. (2020) · Computers & Geosciences · doi:10.1016/j.cageo.2020.104519 · Cited by 92
Dance Revolution: Long-Term Dance Generation with Music via Curriculum LearningPreprint
Huang, R., Huang, H., Wu, W., Sawada, K. B., Zhang, M., & Jiang, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06119 · Cited by 92
Human ownership of artificial creativity
Eshraghian, J. K. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0161-x · Cited by 95
Deepfakes and scientific knowledge dissemination
Doss, C., Mondschein, J., Shu, D., Wolfson, T., Kopecky, D., Fitton-Kane, V. A., Bush, L., & Tucker, C. (2023) · Scientific Reports · doi:10.1038/s41598-023-39944-3 · Cited by 90
Jamriška, O., Sochorová, Š., Texler, O., Lukáč, M., Fišer, J., Lu, J., Shechtman, E., & Sýkora, D. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323006 · Cited by 90
Metadata
- Authors
- Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Liu, G., Tao, A., Kautz, J., & Catanzaro, B.
- Affiliations
- Nvidia (United Kingdom) (GB)
- University of California, Berkeley (US)
- Adobe Systems (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 1144-1156
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1808.06601
- OpenAlex
- W2886748926
- Cited by
- 594
- References
- 78
- Citations by year
- 2026: 1 · 2025: 28 · 2024: 61 · 2023: 87 · 2022: 88 · 2021: 123 · 2020: 117 · 2019: 87 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- semantic segmentation masks, generative adversarial networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
