Video-to-Video Synthesis
Open accessAbstract
We study the problem of video-to-video synthesis, whose goal is to learn a mapping function from an input source video (e.g., a sequence of semantic segmentation masks) to an output photorealistic video that precisely depicts the content of the source video. While its image counterpart, the image-to-image synthesis problem, is a popular topic, the video-to-video synthesis problem is less explored in the literature. Without understanding temporal dynamics, directly applying existing image synthesis approaches to an input video often results in temporally incoherent videos of low visual quality. In this paper, we propose a novel video-to-video synthesis approach under the generative adversarial learning framework. Through carefully-designed generator and discriminator architectures, coupled with a spatio-temporal adversarial objective, we achieve high-resolution, photorealistic, temporally coherent video results on a diverse set of input formats including segmentation masks, sketches, and poses. Experiments on multiple benchmarks show the advantage of our method compared to strong baselines. In particular, our model is capable of synthesizing 2K resolution videos of street scenes up to 30 seconds long, which significantly advances the state-of-the-art of video synthesis. Finally, we apply our approach to future video prediction, outperforming several state-of-the-art competing systems.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
For DR(eye)VE testing, Alletto et al.'s proposed algorithm outperformed Vid2Vid and a rain-streak removal algorithm in both PSNR and SSIM metrics.
“Results again showed that the proposed algorithm overperformed the other algorithms, both in the PSNR and SSIM metrics.”
From A Review of Detection and Removal of Raindrops in Automotive Vision Systems (2021) · cites this paper as [67]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602 · see citing works
Self-citationImage-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930 · see citing works
Self-citationAggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465 · see citing works
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235 · see citing works
(1981) · Cited by 11,963 · see citing works
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283 · see citing works
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570 · see citing works
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365 · see citing works
Shi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., & Wang, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.207 · Cited by 7,570 · see citing works
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517 · see citing works
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · see citing works
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437 · see citing works
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733 · see citing works
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., & Catanzaro, B. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00917 · Cited by 4,514 · see citing works
Self-citationSpectral Normalization for Generative Adversarial Networks
Miyato, T., Kataoka, T., Koyama, M., & Yoshida, Y. (2018) · arXiv · doi:10.48550/arxiv.1802.05957 · Cited by 3,438 · see citing works
StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks
Zhang, H., Xu, T., Li, H., Zhang, S., Wang, X., Huang, X., & Metaxas, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.629 · Cited by 3,021 · see citing works
Conditional Image Synthesis With Auxiliary Classifier GANsPreprint
Odena, A., Olah, C., & Shlens, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09585 · Cited by 2,968 · see citing works
Dlib-ml: A Machine Learning Toolkit
King, D. E. (2009) · Journal of machine learning research · doi:10.5555/1577069.1755843 · Cited by 2,945 · see citing works
Generative Adversarial Text to Image Synthesis
Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B., & Lee, H. (2016) · arXiv · doi:10.48550/arxiv.1605.05396 · Cited by 2,494 · see citing works
Generative Adversarial Networks
Drori, I. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108891530.013 · Cited by 2,401 · see citing works
Deep Generative Image Models using a Laplacian Pyramid of Adversarial NetworksPreprint
Denton, E., Chintala, S., Szlam, A., & Fergus, R. (2015) · Neural Information Processing Systems · doi:10.48550/arxiv.1506.05751 · Cited by 2,360 · see citing works
Kajiya, J. T. (1986) · ACM SIGGRAPH Computer Graphics · doi:10.1145/15886.15902 · Cited by 2,258 · see citing works
Unsupervised Image-to-Image Translation NetworksPreprint
Liu, M.-Y., Breuel, T. M., & Kautz, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00848 · Cited by 2,121 · see citing works
Self-citationLearning from Simulated and Unsupervised Images through Adversarial Training
Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., & Webb, R. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.241 · Cited by 1,831 · see citing works
Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks
Bousmalis, K., Silberman, N., Dohan, D., Erhan, D., & Krishnan, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.18 · Cited by 1,603 · see citing works
DensePose: Dense Human Pose Estimation in the Wild
Güler, R. A., Neverova, N., & Kokkinos, I. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00762 · Cited by 1,496 · see citing works
Coupled Generative Adversarial NetworksPreprint
Liu, M.-Y., & Tuzel, O. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.07536 · Cited by 1,433 · see citing works
Self-citationAutoencoding beyond pixels using a learned similarity metric
Larsen, A., Sønderby, S. K., Larochelle, H., & Winther, O. (2016) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 1,317 · see citing works
Mask R-CNNPreprint
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv (Cornell University) · Cited by 1,252 · see citing works
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · arXiv · doi:10.48550/arxiv.1604.01685 · Cited by 1,174 · see citing works
Toward Multimodal Image-to-Image TranslationPreprint
Zhu, J.-Y., Zhang, R., Pathak, D., Darrell, T., Efros, A. A., Wang, O., & Shechtman, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11586 · Cited by 1,159 · see citing works
Self-citationMoCoGAN: Decomposing Motion and Content for Video Generation
Tulyakov, S., Liu, M.-Y., Yang, X., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00165 · Cited by 1,076 · see citing works
Self-citationGenerating Videos with Scene DynamicsPreprint
Vondrick, C., Pirsiavash, H., & Torralba, A. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.02612 · Cited by 976 · see citing works
Unsupervised Cross-Domain Image GenerationPreprint
Taigman, Y., Polyak, A., & Wolf, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.02200 · Cited by 901 · see citing works
Deep Predictive Coding Networks for Video Prediction and Unsupervised LearningPreprint
Lotter, W. E., Kreiman, G., & Cox, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08104 · Cited by 805 · see citing works
Unsupervised Learning for Physical Interaction through Video Prediction
Finn, C., Goodfellow, I., & Levine, S. (2016) · arXiv · doi:10.48550/arxiv.1605.07157 · Cited by 759 · see citing works
Space-Time Completion of Video
Wexler, Y., Shechtman, E., & Irani, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.60 · Cited by 681 · see citing works
The ApolloScape Dataset for Autonomous Driving
Huang, X., Cheng, X., Geng, Q., Cao, B., Zhou, D., Wang, P., Lin, Y., & Yang, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00141 · Cited by 679 · see citing works
Unsupervised Learning of Disentangled Representations from VideoPreprint
Denton, E., & Birodkar, V. (2017) · Neural Information Processing Systems · doi:10.48550/arxiv.1705.10915 · Cited by 586 · see citing works
Schödl, A., Szeliski, R., Salesin, D., & Essa, I. A. (2000) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/344779.345012 · Cited by 574 · see citing works
Disentangled Person Image Generation
Ma, L., Sun, Q., Georgoulis, S., Gool, L. V., Schiele, B., & Fritz, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00018 · Cited by 530 · see citing works
Decomposing Motion and Content for Natural Video Sequence Prediction
Villegas, R., Yang, J., Hong, S., Lin, X., & Lee, H. (2017) · arXiv · doi:10.48550/arxiv.1706.08033 · Cited by 488 · see citing works
An Uncertain Future: Forecasting from Static Images Using Variational Autoencoders
Walker, J., Doersch, C., Gupta, A., & Hebert, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46478-7_51 · Cited by 467 · see citing works
A Variational U-Net for Conditional Appearance and Shape Generation
Esser, P., & Sutter, E. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00923 · Cited by 465 · see citing works
cGANs with Projection DiscriminatorPreprint
Miyato, T., & Koyama, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05637 · Cited by 464 · see citing works
Stacked Generative Adversarial Networks
Huang, X., Li, Y., Poursaeed, O., Hopcroft, J. E., & Belongie, S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.202 · Cited by 462 · see citing works
Temporal Generative Adversarial Nets with Singular Value Clipping
Saito, M., Matsumoto, E., & Saito, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.308 · Cited by 412 · see citing works
Bai, X., Wang, J., Simons, D., & Sapiro, G. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531376 · Cited by 365 · see citing works
Stochastic Adversarial Video PredictionPreprint
Lee, A. X., Zhang, R., Ebert, F., Abbeel, P., Finn, C., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.01523 · Cited by 357 · see citing works
Wexler, Y., Shechtman, E., & Irani, M. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315022 · Cited by 353 · see citing works
FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339 · see citing works
Face swapping: automatically replacing faces in photographs
Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P., & Nayar, S. K. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360638 · Cited by 333 · see citing works
The Pose Knows: Video Forecasting by Generating Pose Futures
Walker, J., Marino, K., Gupta, A., & Hebert, M. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.361 · Cited by 333 · see citing works
Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional NetworksPreprint
Xue, T., Wu, J., Bouman, K. L., & Freeman, W. T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02586 · Cited by 330 · see citing works
Synthesizing Images of Humans in Unseen Poses
Balakrishnan, G., Zhao, A. T., Dalca, A. V., Durand, F., & Guttag, J. V. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00870 · Cited by 321 · see citing works
Multi-agent Diverse Generative Adversarial Networks
Ghosh, A., Kulharia, V., Namboodiri, V. P., Torr, P. H. S., & Dokania, P. K. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00888 · Cited by 306 · see citing works
Artistic Style Transfer for Videos
Ruder, M., Dosovitskiy, A., & Brox, T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45886-1_3 · Cited by 295 · see citing works
Coherent Online Video Style Transfer
Chen, D., Liao, J., Yuan, L., Yu, N., & Hua, G. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.126 · Cited by 288 · see citing works
Multimodal Unsupervised Image-to-Image TranslationPreprint
Huang, X., Liu, M.-Y., Belongie, S., & Kautz, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.04732 · Cited by 259 · see citing works
Self-citationShechtman, E., Caspi, Y., & Irani, M. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.85 · Cited by 245 · see citing works
Real-Time Neural Style Transfer for Videos
Huang, H., Wang, H., Luo, W., Ma, L., Jiang, W., Zhu, X., Li, Z., & Liu, W. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.745 · Cited by 223 · see citing works
Ha, D., & Schmidhuber, J. (2018) · Zenodo · doi:10.5281/zenodo.1207631 · Cited by 187 · see citing works
Generating the Future with Adversarial Transformers
Vondrick, C., & Torralba, A. B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.319 · Cited by 164 · see citing works
Pose Guided Human Video Generation
Yang, C., Wang, Z., Zhu, X., Huang, C., Shi, J., & Lin, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_13 · Cited by 139 · see citing works
Characterizing and Improving Stability in Neural Style Transfer
Gupta, A., Johnson, J., Alahi, A., & Fei-Fei, L. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.438 · Cited by 122 · see citing works
Deep Video‐Based Performance Cloning
Aberman, K., Shi, M., Liao, J., Lischinski, D., Chen, B., & Cohen‐Or, D. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13632 · Cited by 76 · see citing works
(2007) · ITNOW · doi:10.1093/combul/bwl126 · Cited by 69 · see citing works
Hierarchical Video Generation From Orthogonal Information: Optical Flow and Texture
Ohnishi, K., Yamamoto, S., Ushiku, Y., & Harada, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11881 · Cited by 48 · see citing works
Detailed Garment Recovery from a Single-View ImagePreprint
Yang, S., Ambert, T., Pan, Z., Wang, K., Yu, L., Berg, T. L., & Lin, M. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.01250 · Cited by 34 · see citing works
Motion-Aware Gradient Domain Video Composition
Chen, T., Zhu, J.-Y., Shamir, A., & Hu, S.-M. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2251642 · Cited by 29 · see citing works
Self-citationImage-based clothes changing system
Zheng, Z., Zhang, H., Zhang, F., & Mu, T. (2017) · Computational Visual Media · doi:10.1007/s41095-017-0084-6 · Cited by 15 · see citing works
Flagged first, then by citations
4 of the 78 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- [7][7] Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh. Realtime multi-person 2D pose estimation using part affinity fields. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [16][16] A. Dosovitskiy and T. Brox. Generating images with perceptual similarity metrics based on deep networks. In Advances in Neural Information Processing Systems (NIPS) , 2016. -
- [25][25] K. He, G. Gkioxari, P. Dollár, and R. Girshick. Mask R-CNN. In IEEE International Conference on Computer Vision (ICCV) , 2017. -
- [32][32] E. Ilg, N. Mayer, T. Saikia, M. Keuper, A. Dosovitskiy, and T. Brox. Flownet 2.0: Evolution of optical flow estimation with deep networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017. -
- [36][36] N. Kalchbrenner, A. v. d. Oord, K. Simonyan, I. Danihelka, O. Vinyals, A. Graves, and K. Kavukcuoglu. Video pixel networks. arXiv preprint arXiv:1610.00527 , 2016. - · arXiv
- [37][37] T. Karras, T. Aila, S. Laine, and J. Lehtinen. Progressive growing of GANs for improved quality, stability, and variation. In International Conference on Learning Representations (ICLR) , 2018. -
- [42][42] X. Liang, L. Lee, W. Dai, and E. P. Xing. Dual motion GAN for future-flow embedded video prediction. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [47][47] L. Ma, X. Jia, Q. Sun, B. Schiele, T. Tuytelaars, and L. Van Gool. Pose guided person image generation. In Advances in Neural Information Processing Systems (NIPS) , 2017. -
- [50][50] M. Mathieu, C. Couprie, and Y. LeCun. Deep multi-scale video prediction beyond mean square error. In International Conference on Learning Representations (ICLR) , 2016. -
- [65][65] N. Srivastava, E. Mansimov, and R. Salakhudinov. Unsupervised learning of video representations using lstms. In International Conference on Machine Learning (ICML) , 2015. -
Cited by
Sorted by citations
Semantic Image Synthesis With Spatially-Adaptive Normalization
Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974 · see citing works
Self-citationThies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,410 · see citing works
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130191 · Cited by 1,231 · see citing works
Zhu, Y., Zabaras, N. J., Koutsourelakis, P., & Perdikaris, P. G. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.024 · Cited by 1,029 · see citing works
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979 · see citing works
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863 · see citing works
Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824 · see citing works
Chan, C., Ginosar, S., Zhou, T., & Efros, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00603 · Cited by 737 · see citing works
MelGAN: generative adversarial networks for conditional waveform synthesis
Kumar, K., Kumar, R., de Boissiere, T., Gestin, L., Teoh, W. Z., Sotelo, J., de Brebisson, A., Bengio, Y., & Courville, A. (2019) · arXiv · doi:10.48550/arxiv.1910.06711 · Cited by 722 · see citing works
Few-Shot Adversarial Learning of Realistic Neural Talking Head Models
Zakharov, E., Shysheya, A., Burkov, E., & Lempitsky, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00955 · Cited by 687 · see citing works
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599 · see citing works
InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs
Shen, Y., Yang, C., Tang, X., & Zhou, B. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3034267 · Cited by 551 · see citing works
Image2StyleGAN++: How to Edit the Embedded Images?
Abdal, R., Qin, Y., & Wonka, P. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00832 · Cited by 499 · see citing works
HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video
Weng, C.-Y., Curless, B., Srinivasan, P. P., Barron, J. T., & Kemelmacher-Shlizerman, I. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01573 · Cited by 478 · see citing works
One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing
Wang, T.-C., Mallya, A., & Liu, M.-Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00991 · Cited by 468 · see citing works
Self-citationStructure and Content-Guided Video Synthesis with Diffusion Models
Esser, P., Chiu, J., Atighehchian, P., Granskog, J., & Germanidis, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00675 · Cited by 413 · see citing works
Deep-Learning Inversion of Seismic Data
Li, S., Liu, B., Ren, Y., Chen, Y., Yang, S., Wang, Y., & Jiang, P. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2953473 · Cited by 405 · see citing works
Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset
Zhang, Z., Li, L., Ding, Y., & Fan, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00366 · Cited by 368 · see citing works
A Review of Single-Source Deep Unsupervised Visual Domain Adaptation
Zhao, S., Yue, X., Zhang, S., Li, B., Zhao, H., Wu, B., Krishna, R., Gonzalez, J. E., Sangiovanni-Vincentelli, A. L., Seshia, S. A., et al. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3028503 · Cited by 355 · see citing works
Animating Arbitrary Objects via Deep Motion Transfer
Siarohin, A., Lathuilière, S., Tulyakov, S., Ricci, E., & Sebe, N. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00248 · Cited by 350 · see citing works
Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors
Gafni, O., Polyak, A., Ashual, O., Sheynin, S., Parikh, D., & Taigman, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19784-0_6 · Cited by 345 · see citing works
MEAD: A Large-Scale Audio-Visual Dataset for Emotional Talking-Face Generation
Wang, K., Wu, Q., Song, L., Yang, Z., Wu, W., Qian, C., He, R., Qiao, Y., & Loy, C. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58589-1_42 · Cited by 344 · see citing works
Learning Joint Spatial-Temporal Transformations for Video Inpainting
Zeng, Y., Fu, J., & Chao, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_31 · Cited by 308 · see citing works
Towards Visually Explaining Variational Autoencoders
Liu, W., Li, R., Zheng, M., Karanam, S., Wu, Z., Bhanu, B., Radke, R. J., & Camps, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00867 · Cited by 294 · see citing works
Chou, H.-P., Chang, S.-C., Pan, J.-Y., 韦薇, & Juan, D.-C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-65414-6_9 · Cited by 276 · see citing works
CIAGAN: Conditional Identity Anonymization Generative Adversarial Networks
Maximov, M., Elezi, I., & Leal-Taixé, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00549 · Cited by 271 · see citing works
Text-based Editing of Talking-head Video
Fried, O., Tewari, A., Zollhöfer, M., Finkelstein, A., Shechtman, E., Goldman, D. B., Genova, K., Jin, Z., Theobalt, C., & Agrawala, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323028 · Cited by 270 · see citing works
Controllable Person Image Synthesis With Attribute-Decomposed GAN
Men, Y., Mao, Y., Jiang, Y., Ma, W., & Lian, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00513 · Cited by 270 · see citing works
Visual Perception Enabled Industry Intelligence: State of the Art, Challenges and Prospects
Yang, J., Wang, C., Jiang, B., Song, H., & Meng, Q. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2998818 · Cited by 268 · see citing works
Motion Representations for Articulated Animation
Siarohin, A., Woodford, O. J., Ren, J., Chai, M., & Tulyakov, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01344 · Cited by 260 · see citing works
Liu, W., Piao, Z., Min, J., Luo, W., Ma, L., & Gao, S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00600 · Cited by 259 · see citing works
Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translation
Chen, R., Huang, W., Huang, B., Sun, F., & Fang, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00819 · Cited by 259 · see citing works
Unsupervised Discovery of Interpretable Directions in the GAN Latent SpacePreprint
Voynov, A. S., & Babenko, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.03754 · Cited by 258 · see citing works
Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications
Liu, M.-Y., Huang, X., Yu, J., Wang, T.-C., & Mallya, A. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3049196 · Cited by 236 · see citing works
Self-citationFew-shot Video-to-Video SynthesisPreprint
Wang, T.-C., Liu, M.-Y., Tao, A., Liu, G., Kautz, J., & Catanzaro, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12713 · Cited by 235 · see citing works
Self-citationKim, D., Woo, S., Lee, J., & Kweon, I. S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00594 · Cited by 229 · see citing works
Audio-Driven Emotional Video Portraits
Ji, X., Zhou, H., Wang, K., Wu, W., Loy, C. C., Cao, X., & Xu, F. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01386 · Cited by 223 · see citing works
GAN Compression: Efficient Architectures for Interactive Conditional GANs
Li, M., Lin, J., Ding, Y., Liu, Z., Zhu, J.-Y., & Han, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00533 · Cited by 216 · see citing works
Self-citationDeep Image Spatial Transformation for Person Image Generation
Ren, Y., Yu, X., Chen, J., Li, T. H., & Li, G. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00771 · Cited by 212 · see citing works
PIRenderer: Controllable Portrait Image Generation via Semantic Neural Rendering
Ren, Y., Li, G., Chen, Y., Li, T. H., & Liu, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01350 · Cited by 211 · see citing works
A State-of-the-Art Review on Image Synthesis With Generative Adversarial Networks
Wang, L., Chen, W., Yang, W., Bi, F., & Yu, F. R. (2020) · IEEE Access · doi:10.1109/access.2020.2982224 · Cited by 210 · see citing works
Free-Form Video Inpainting With 3D Gated Convolution and Temporal PatchGAN
Chang, Y.-L., Liu, Z. Y., Lee, K.-Y., & Hsu, W. H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00916 · Cited by 207 · see citing works
Multi-Band Melgan: Faster Waveform Generation For High-Quality Text-To-Speech
Yang, G., Yang, S., Liu, K., Fang, P., Chen, W., & Xie, L. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383551 · Cited by 193 · see citing works
Talking Face Generation by Conditional Recurrent Adversarial Network
Song, Y., Zhu, J., Li, D., Wang, A. Y.-D., & Qi, H. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/129 · Cited by 192 · see citing works
Self-citationCOVID-19 CT Image Synthesis With a Conditional Generative Adversarial Network
Jiang, Y., Chen, H., Loew, M. H., & Ko, H. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3042523 · Cited by 190 · see citing works
Neural Rerendering in the Wild
Meshry, M., Goldman, D. B., Khamis, S., Hoppe, H., Pandey, R., Snavely, N., & Martin-Brualla, R. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00704 · Cited by 182 · see citing works
Talking-Head Generation with Rhythmic Head Motion
Chen, L., Cui, G., Liu, C., Li, Z., Kou, Z., Xu, Y., & Xu, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58545-7_3 · Cited by 179 · see citing works
Video Generative Adversarial Networks: A Review
Aldausari, N., Sowmya, A., Marcus, N., & Mohammadi, G. (2022) · ACM Computing Surveys · doi:10.1145/3487891 · Cited by 176 · see citing works
Pix2Video: Video Editing using Image Diffusion
Ceylan, D., Huang, C.-H. P., & Mitra, N. J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02121 · Cited by 174 · see citing works
A Survey on Long-Tailed Visual Recognition
Yang, L., Jiang, H., Song, Q., & Guo, J. H. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01622-8 · Cited by 171 · see citing works
Tang, H., Xu, D., Yan, Y., Torr, P. H. S., & Sebe, N. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00789 · Cited by 166 · see citing works
FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting
Liu, R. Z. Z., Deng, H., Huang, Y., Shi, X., Lu, L., Sun, W., Wang, X., Dai, J., & Li, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01378 · Cited by 165 · see citing works
Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation
Tang, H., Xu, D., Sebe, N., & Yan, Y. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851881 · Cited by 163 · see citing works
An End-to-End Deep Neural Network for Autonomous Driving Designed for Embedded Automotive Platforms
Kocić, J., Jovicic, N. S., & Drndarević, V. (2019) · Sensors · doi:10.3390/s19092064 · Cited by 161 · see citing works
Adversarial Video Generation on Complex Datasets
Clark, A., Donahue, J., & Simonyan, K. (2019) · arXiv · doi:10.48550/arxiv.1907.06571 · Cited by 157 · see citing works
VideoGPT: Video Generation using VQ-VAE and Transformers
Yan, W., Zhang, Y., Abbeel, P., & Srinivas, A. (2021) · arXiv · doi:10.48550/arxiv.2104.10157 · Cited by 156 · see citing works
Towards An End-to-End Framework for Flow-Guided Video Inpainting
Li, Z., Lu, C.-Z., Qin, J., Guo, C., & Cheng, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01704 · Cited by 154 · see citing works
Follow Your Pose: Pose-Guided Text-to-Video Generation Using Pose-Free Videos
Ma, Y., He, Y., Cun, X., Wang, X., Chen, S., Li, X., & Chen, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28206 · Cited by 153 · see citing works
StyleGAN2 Distillation for Feed-Forward Image Manipulation
Viazovetskyi, Y., Ivashkin, V., & Kashin, E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_11 · Cited by 150 · see citing works
Fast Bi-Layer Neural Synthesis of One-Shot Realistic Head Avatars
Zakharov, E., Ivakhnenko, A., Shysheya, A., & Lempitsky, V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58610-2_31 · Cited by 142 · see citing works
Detecting Photoshopped Faces by Scripting Photoshop
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01017 · Cited by 140 · see citing works
Kaplanyan, A., Sochenov, A., Leimkühler, T., Okunev, M., Goodall, T., & Rufo, G. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356557 · Cited by 137 · see citing works
HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment
Yang, L., Wang, S., Ma, S., Gao, W., Liu, C., Wang, P., & Ren, P. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413965 · Cited by 137 · see citing works
Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer
Ge, S., Hayes, T., Yang, H. C., Yin, X. P., Pang, G., Jacobs, D. W., Huang, J., & Parikh, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19790-1_7 · Cited by 135 · see citing works
STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits
Bhattacharya, U., Mittal, T., Chandra, R., Randhavane, T., Bera, A., & Manocha, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i02.5490 · Cited by 132 · see citing works
Conditional Image-to-Video Generation with Latent Flow Diffusion Models
Ni, H., Shi, C., Li, K., Huang, X., & Min, M. R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01769 · Cited by 127 · see citing works
Coordinate-Based Texture Inpainting for Pose-Guided Human Image Generation
Grigorev, A., Sevastopolsky, A., Vakhitov, A., & Lempitsky, V. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01241 · Cited by 123 · see citing works
Neural Head Reenactment with Latent Pose Descriptors
Burkov, E., Pasechnik, I., Grigorev, A., & Lempitsky, V. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01380 · Cited by 123 · see citing works
ImaGINator: Conditional Spatio-Temporal GAN for Video Generation
Wang, Y., Biliński, P., Brémond, F., & Dantcheva, A. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093492 · Cited by 122 · see citing works
HeadGAN: One-shot Neural Head Synthesis and Editing
Doukas, M. C., Zafeiriou, S., & Sharmanska, V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01413 · Cited by 117 · see citing works
Sliced Wasserstein Generative Models
Wu, J., Huang, Z., Acharya, D., Li, W., Thoma, J., Paudel, D. P., & Gool, L. V. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00383 · Cited by 116 · see citing works
Saito, M., Saito, S., Koyama, M., & Kobayashi, S. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01333-y · Cited by 116 · see citing works
VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
Cheng, K., Cun, X., Zhang, Y., Xia, M., Yin, F., Zhu, M., Wang, X., Wang, J., & Wang, N. (2022) · SIGGRAPH Asia Conference Papers · doi:10.1145/3550469.3555399 · Cited by 112 · see citing works
SurfelGAN: Synthesizing Realistic Sensor Data for Autonomous Driving
Yang, Z., Chai, Y., Anguelov, D., Zhou, Y., Sun, P., Erhan, D., Rafferty, S., & Kretzschmar, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01113 · Cited by 110 · see citing works
FW-GAN: Flow-Navigated Warping GAN for Video Virtual Try-On
Dong, H., Liang, X., Shen, X., Wu, B., Chen, B.-C., & Yin, J. P. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00125 · Cited by 109 · see citing works
ProPainter: Improving Propagation and Transformer for Video Inpainting
Zhou, S., Li, C., Chan, K. C. K., & Change, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00961 · Cited by 109 · see citing works
Xie, W., Reder, N. P., Koyuncu, C., Leo, P., Hawley, S. J., Huang, H., Mao, C., Postupna, N. O., Kang, S., Serafin, R., et al. (2021) · Cancer Research · doi:10.1158/0008-5472.can-21-2843 · Cited by 108 · see citing works
Disco: Disentangled Control for Realistic Human Dance Generation
Wang, T., Li, L., Lin, K., Zhai, Y., Lin, C.-C., Yang, Z., Zhang, H., Liu, Z., & Wang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00891 · Cited by 107 · see citing works
Self-citationFace Generation and Editing With StyleGAN: A Survey
Melnik, A., Miasayedzenkau, M., Makaravets, D., Pirshtuk, D., Akbulut, E., Holzmann, D., Renusch, T., Reichert, G., & Ritter, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3350004 · Cited by 105 · see citing works
Shysheya, A., Zakharov, E., Aliev, K.-A., Bashirov, R., Burkov, E., Iskakov, K., Ivakhnenko, A., Malkov, Y. A., Pasechnik, I., Ulyanov, D., et al. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00249 · Cited by 105 · see citing works
Wang, Y., Yang, D., Brémond, F., & Dantcheva, A. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3449075 · Cited by 105 · see citing works
Learning to Drive from Simulation without Real World Labels
Bewley, A., Rigley, J., Liu, Y., Hawke, J., Shen, R., Lam, V.-D., & Kendall, A. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793668 · Cited by 103 · see citing works
Sequence Generative Adversarial Networks for Wind Power Scenario Generation
Liang, J., & Tang, W. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2952182 · Cited by 103 · see citing works
Enhancing Photorealism Enhancement
Richter, S. R., Alhaija, H. A., & Koltun, V. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3166687 · Cited by 102 · see citing works
InstanceDiffusion: Instance-Level Control for Image Generation
Wang, X., Darrell, T., Rambhatla, S. S., Girdhar, R., & Misra, I. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00596 · Cited by 100 · see citing works
Video Generation From Single Semantic Label Map
Pan, J., Wang, C., Jia, X., Shao, J., Sheng, L., Yan, J., & Wang, X. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00385 · Cited by 99 · see citing works
Lin, H., Liu, Y., Li, S., & Qu, X. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123744 · Cited by 99 · see citing works
TransGaGa: Geometry-Aware Unsupervised Image-To-Image Translation
Wu, W., Cao, K., Li, C., Qian, C., & Loy, C. C. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00820 · Cited by 98 · see citing works
Ferreira, J., Coutinho, T., Gomes, T. L., NETO, J. F. L., Azevedo, R., Martins, R., & Nascimento, E. R. (2020) · Computers & Graphics · doi:10.1016/j.cag.2020.09.009 · Cited by 98 · see citing works
A Dynamic Multi-Scale Voxel Flow Network for Video Prediction
Hu, X., Huang, Z., Huang, A., Xu, J., & Zhou, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00593 · Cited by 97 · see citing works
Blurry Video Frame Interpolation
Wang, S., Bao, W., Zhai, G., Chen, L., Min, X., & Gao, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00516 · Cited by 96 · see citing works
Future Video Synthesis With Object Motion Prediction
Wu, Y., Gao, R., Park, J., & Chen, Q. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00558 · Cited by 95 · see citing works
Stochastic Latent Residual Video PredictionPreprint
Franceschi, J.-Y., Delasalles, E., Chen, M., Lamprier, S., & Gallinari, P. (2020) · International Conference on Machine Learning · doi:10.48550/arxiv.2002.09219 · Cited by 95 · see citing works
Adversarial Inference for Multi-Sentence Video Description
Park, J. S., Rohrbach, M., Darrell, T., & Rohrbach, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00676 · Cited by 94 · see citing works
GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Driving
Chen, Y., Rong, F., Duggal, S., Wang, S., Yan, X., Manivasagam, S., Xue, S., Yumer, E., & Urtasun, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00715 · Cited by 93 · see citing works
Hybrid geological modeling: Combining machine learning and multiple-point statistics
Bai, T., & Tahmasebi, P. (2020) · Computers & Geosciences · doi:10.1016/j.cageo.2020.104519 · Cited by 92 · see citing works
Dance Revolution: Long-Term Dance Generation with Music via Curriculum LearningPreprint
Huang, R., Huang, H., Wu, W., Sawada, K. B., Zhang, M., & Jiang, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06119 · Cited by 92 · see citing works
Human ownership of artificial creativity
Eshraghian, J. K. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0161-x · Cited by 91 · see citing works
Deepfakes and scientific knowledge dissemination
Doss, C., Mondschein, J., Shu, D., Wolfson, T., Kopecky, D., Fitton-Kane, V. A., Bush, L., & Tucker, C. (2023) · Scientific Reports · doi:10.1038/s41598-023-39944-3 · Cited by 90 · see citing works
Jamriška, O., Sochorová, Š., Texler, O., Lukáč, M., Fišer, J., Lu, J., Shechtman, E., & Sýkora, D. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323006 · Cited by 90 · see citing works
- Authors
- Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Liu, G., Tao, A., Kautz, J., & Catanzaro, B.
- Affiliations
- Nvidia (United Kingdom) (GB)
- University of California, Berkeley (US)
- Adobe Systems (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 1144-1156
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1808.06601
- OpenAlex
- W2886748926
- Cited by
- 594
- References
- 78
- Citations by year
- 2026: 1 · 2025: 28 · 2024: 61 · 2023: 87 · 2022: 88 · 2021: 123 · 2020: 117 · 2019: 87 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- semantic segmentation masks, generative adversarial networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
