Out of Time: Automated Lip Sync in the Wild

Very Deep Convolutional Networks for Large-Scale Image Recognition

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint

Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273

Untitled work

(1981) · Cited by 11,963

Caffe: Convolutional Architecture for Fast Feature Embedding

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077

Two-Stream Convolutional Networks for Action Recognition in Videos

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756

Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences

Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465

Learning a Similarity Metric Discriminatively, with Application to Face Verification

Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335

VoxCeleb2: Deep Speaker Recognition

Chung, J. S., Nagrani, A., & Zisserman, A. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1929 · Cited by 2,256

IEEE Symposium on Security and Privacy

(2023) · IT Professional · doi:10.1109/mitp.2023.3246667 · Cited by 1,180

A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild

Prajwal, K. R., Mukhopadhyay, R., Namboodiri, V. P., & Jawahar, C. V. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413532 · Cited by 897

Look, Listen and Learn

Arandjelović, R., & Zisserman, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.73 · Cited by 836

Deep Audio-Visual Speech Recognition

Afouras, T., Chung, J. S., Senior, A., Vinyals, O., & Zisserman, A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889052 · Cited by 801

Audio-Visual Scene Analysis with Self-Supervised Multisensory Features

Owens, A., & Efros, A. A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_39 · Cited by 704

Voxceleb: Large-scale speaker verification in the wild

Nagrani, A., Chung, J. S., Xie, W., & Zisserman, A. (2019) · Computer Speech & Language · doi:10.1016/j.csl.2019.101027 · Cited by 650

Hierarchical Cross-Modal Talking Face Generation With Dynamic Pixel-Wise Loss

Chen, L., Maddox, R. K., Duan, Z., & Xu, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00802 · Cited by 437

X2Face: A Network for Controlling Face Generation Using Images, Audio, and Pose Codes

Wiles, O., Koepke, A. S., & Zisserman, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_41 · Cited by 431

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation

Zhou, H., Liu, Y., Liu, Z., Luo, P., & Wang, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019299 · Cited by 416

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis

Guo, Y., Chen, K., Liang, S., Liu, Y.-J., Bao, H., & Zhang, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00573 · Cited by 384

Neural Voice Puppetry: Audio-Driven Facial Reenactment

Thies, J., Elgharib, M. A., Tewari, A., Theobalt, C., & Nießner, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_42 · Cited by 411

Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation

Zhou, H., Sun, Y., Wu, W., Loy, C. C., Wang, X., & Liu, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00416 · Cited by 391

Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset

Zhang, Z., Li, L., Ding, Y., & Fan, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00366 · Cited by 368

An Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation

Michelsanti, D., Tan, Z., Zhang, S.-X., Xu, Y., Yu, M., Yu, D., & Jensen, J. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3066303 · Cited by 344

Realistic Speech-Driven Facial Animation with GANs

Vougioukas, K., Petridis, S., & Pantić, M. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01251-8 · Cited by 317

Emotion Recognition in Speech using Cross-Modal Transfer in the Wild

Albanie, S., Nagrani, A., Vedaldi, A., & Zisserman, A. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240578 · Cited by 295

FaceFormer: Speech-Driven 3D Facial Animation with Transformers

Fan, Y., Lin, Z., Saito, J., Wang, W., & Komura, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01821 · Cited by 295

SCSampler: Sampling Salient Clips From Video for Efficient Action Recognition

Korbar, B., Tran, D., & Torresani, L. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00633 · Cited by 227

Seeing Voices and Hearing Faces: Cross-Modal Biometric Matching

Nagrani, A., Albanie, S., & Zisserman, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00879 · Cited by 224

Self-supervised Learning of Audio-Visual Objects from Video

Afouras, T., Owens, A., Chung, J. S., & Zisserman, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58523-5_13 · Cited by 221

Audio-Visual Instance Discrimination with Cross-Modal Agreement

Morgado, P. M., Vasconcelos, N. M., & Misra, I. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01229 · Cited by 227

Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization

Chugh, K., Gupta, P., Dhall, A., & Subramanian, R. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413700 · Cited by 225

CN-Celeb: A Challenging Chinese Speaker Recognition Dataset

Fan, Y. B., Kang, J., Li, L. T., Li, K., Chen, H., Cheng, S., Zhang, P. Y., Zhou, Z., Cai, Y., & Wang, D. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054017 · Cited by 207

You Said That?: Synthesising Talking Faces from Audio

Jamaludin, A., Chung, J. S., & Zisserman, A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01150-y · Cited by 189

CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior

Xing, J., Xia, M., Zhang, Y., Cun, X., Wang, J., & Wong, T. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01229 · Cited by 238

Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection

Haliassos, A., Mira, R., Petridis, S., & Pantic, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01453 · Cited by 180

LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild

Yang, S., Zhang, Y., Feng, D., Yang, M., Wang, C., Xiao, J., Long, K., Shan, S., & Chen, X. (2019) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2019.8756582 · Cited by 175

Large-Scale Visual Speech Recognition

Shillingford, B., Assael, Y., Hoffman, M. W., Paine, T., Hughes, C., Prabhu, U., Liao, H., Sak, H., Rao, K., Bennett, L., et al. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1669 · Cited by 192

Audiovisual SlowFast Networks for Video RecognitionPreprint

Xiao, F., Lee, Y. J., Grauman, K. L., Malik, J., & Feichtenhofer, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08740 · Cited by 251

Is Someone Speaking?

Tao, R., Pan, Z., Das, R. K., Qian, X., Shou, M. Z., & Li, H. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475587 · Cited by 176

Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection

Tao, R., Pan, Z., Das, R. K., Qian, X., Shou, M. Z., & Li, H. (2021) · arXiv · doi:10.48550/arxiv.2107.06592 · Cited by 156

Ava Active Speaker: An Audio-Visual Dataset for Active Speaker Detection

Roth, J., Chaudhuri, S., Klejch, O., Marvin, R., Gallagher, A., Kaver, L., Ramaswamy, S., Stopczynski, A., Schmid, C., Xi, Z., et al. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053900 · Cited by 156

Spot the Conversation: Speaker Diarisation in the Wild

Chung, J. S., Huh, J., Nagrani, A., Afouras, T., & Zisserman, A. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2337 · Cited by 186

Learnable PINs: cross-modal embeddings for person identity

Nagrani, A., Albanie, S., & Zisserman, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_5 · Cited by 151

Multimodal Image Synthesis and Editing: The Generative AI Era

Zhan, F., Yu, Y., Wu, R., Zhang, J., Lu, S., Liu, L., Kortylewski, A., Theobalt, C., & Xing, E. P. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3305243 · Cited by 197

FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning

Zhang, C., Zhao, Y., Huang, Y., Zeng, M., Ni, S., Budagavi, M., & Guo, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00384 · Cited by 140

Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation

Stypułkowski, M., Vougioukas, K., He, S., Zięba, M., Petridis, S., & Pantić, M. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00502 · Cited by 184

Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation

Stypułkowski, M., Vougioukas, K., He, S., Zięba, M., Petridis, S., & Pantic, M. (2023) · arXiv · doi:10.48550/arxiv.2301.03396 · Cited by 140

Evolving Losses for Unsupervised Video Representation Learning

Piergiovanni, A., Angelova, A., & Ryoo, M. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00021 · Cited by 140

KoDF: A Large-scale Korean DeepFake Detection Dataset

Kwon, P., You, J., Nam, G., Park, S., & Chae, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01057 · Cited by 145

DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation

Shen, S., Zhao, W., Meng, Z., Li, W., Zhu, Z., Zhou, J., & Lu, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00197 · Cited by 133

Survey on automatic lip-reading in the era of deep learning

Fernandez-Lopez, A., & Sukno, F. M. (2018) · Image and Vision Computing · doi:10.1016/j.imavis.2018.07.002 · Cited by 135

Multimodal Sparse Transformer Network for Audio-Visual Speech Recognition

Song, Q., Sun, B., & Shutao Li, A. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3163771 · Cited by 128

Everybody’s Talkin’: Let Me Talk as You Want

Song, L., Wu, W., Qian, C., He, R., & Loy, C. C. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3146783 · Cited by 142

Expressive Talking Head Generation with Granular Audio-Visual Control

Liang, B., Pan, Y. M., Guo, Z., Zhou, H., Hong, Z., Han, X., Han, J., Liu, J., Ding, E., & Wang, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00338 · Cited by 124

CN-Celeb: Multi-genre speaker recognition

Li, L., Liu, R., Kang, J., Fan, Y. B., Cui, H., Cai, Y., Vipperla, R., Zheng, T. F., & Wang, D. (2022) · Speech Communication · doi:10.1016/j.specom.2022.01.002 · Cited by 121

Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation

Liu, X., Xu, Y., Wu, Q., Zhou, H., Wu, W., & Zhou, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19836-6_7 · Cited by 121

3D Convolutional Neural Networks for Cross Audio-Visual Matching Recognition

Torfi, A., Iranmanesh, S. M., Nasrabadi, N. M., & Dawson, J. M. (2017) · IEEE Access · doi:10.1109/access.2017.2761539 · Cited by 118

Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis

Li, J., Zhang, J., Bai, X. P., Zhou, J. W., & Gu, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00696 · Cited by 131

One-Shot Talking Face Generation from Single-Speaker Audio-Visual Correlation Learning

Wang, S., Li, L., Ding, Y., & Yu, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20154 · Cited by 115

Discriminative Multi-Modality Speech Recognition

Xu, B., Lu, C., Guo, Y., & Wang, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01444 · Cited by 113

VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

Cheng, K., Cun, X., Zhang, Y., Xia, M., Yin, F., Zhu, M., Wang, X., Wang, J., & Wang, N. (2022) · SIGGRAPH Asia Conference Papers · doi:10.1145/3550469.3555399 · Cited by 112

LipNet: End-to-End Sentence-level LipreadingPreprint

Assael, Y., Shillingford, B., Whiteson, S., & de Freitas, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01599 · Cited by 640

Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert

Wang, J., Qian, X., Zhang, M., Tan, R. T., & Li, H. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01408 · Cited by 116

Robust Audio-Visual Instance Discrimination

Morgado, P. M., Misra, I., & Vasconcelos, N. M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01274 · Cited by 108

Perfect Match: Improved Cross-modal Embeddings for Audio-visual Synchronisation

Chung, S.-W., Chung, J. S., & Kang, H.-G. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682524 · Cited by 108

Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis

Shen, S., Li, W., Zhu, Z. D., Duan, Y., Zhou, J., & Lu, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19775-8_39 · Cited by 107

Non-Parallel Sequence-to-Sequence Voice Conversion With Disentangled Linguistic and Speaker Representations

Zhang, J.-X., Ling, Z.-H., & Dai, L.-R. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2960721 · Cited by 105

Spatio-Temporal Fusion Based Convolutional Sequence Learning for Lip Reading

Zhang, X., Cheng, F., & Shilin, W. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00080 · Cited by 101

Identity-Preserving Talking Face Generation with Landmark and Appearance Priors

Zhong, W., Fang, C., Cai, Y., Wei, P., Zhao, G., Lin, L., & Li, G. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00938 · Cited by 102

Self-Supervised Video Forensics by Audio-Visual Anomaly Detection

Feng, C., Chen, Z., & Owens, A. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01011 · Cited by 101

LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization

Lahiri, A., Kwatra, V., Frueh, C., Lewis, J., & Bregler, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00278 · Cited by 101

Speech-Driven Facial Animation Using Cascaded GANs for Learning of Motion and Texture

Das, D., Biswas, S., Sinha, S., & Bhowmick, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58577-8_25 · Cited by 104

Speaker Inconsistency Detection in Tampered Video

Korshunov, P., & Marcel, S. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553270 · Cited by 97

Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization

Cai, Z., Stefanov, K., Dhall, A., & Hayat, M. (2022) · 2022 International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta56598.2022.10034605 · Cited by 99

EMO: Emote Portrait Alive Generating Expressive Portrait Videos with Audio2Video Diffusion Model Under Weak Conditions

Tian, L., Wang, Q. J., Zhang, B., & Bo, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73010-8_15 · Cited by 211

EMO: Emote Portrait Alive - Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions

Tian, L., Wang, Q., Zhang, B., & Bo, L. (2024) · arXiv · doi:10.48550/arxiv.2402.17485 · Cited by 92

TalkingStyle: Personalized Speech-Driven 3D Facial Animation With Style Preservation

Song, W., Wang, X., Zheng, S., Li, S., Hao, A., & Hou, X. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3409568 · Cited by 91

SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory

Park, S. J., Kim, M., Hong, J., Choi, J., & Ro, Y. M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20102 · Cited by 88

Contrastive Positive Sample Propagation Along the Audio-Visual Event Line

Zhou, J., Guo, D., & Wang, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3223688 · Cited by 90

Deep Learning-Based Automated Lip-Reading: A Survey

Fenghour, S., Chen, D., Guo, K., Li, B., & Xiao, P. (2021) · IEEE Access · doi:10.1109/access.2021.3107946 · Cited by 96

SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis

Peng, Z., Hu, W., Shi, Y., Zhu, X., Zhang, X., Zhao, H., He, J., Liu, H., & Fan, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00070 · Cited by 83

Vision-Infused Deep Audio Inpainting

Zhou, H., Liu, Z., Xu, X., Luo, P., & Wang, X. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00037 · Cited by 80

StyleTalk: One-Shot Talking Head Generation with Controllable Speaking Styles

Ma, Y., Wang, S., Hu, Z., Fan, C., Lv, T., Ding, Y., Deng, Z., & Yu, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25280 · Cited by 79

See the Sound, Hear the Pixels

Ramaswamy, J., & Das, S. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093616 · Cited by 75

Contrastive Multimodal Fusion with TupleInfoNCE

Liu, Y., Fan, Q., Zhang, S., Dong, H., Funkhouser, T. A., & Yi, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00079 · Cited by 77

Learning Representations from Audio-Visual Spatial AlignmentPreprint

Morgado, P. M., Li, Y., & Vasconcelos, N. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.01819 · Cited by 78

Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation

Gan, Y., Yang, Z., Yue, X., Sun, L., & Yang, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02069 · Cited by 72

Human-Computer Interaction System: A Survey of Talking-Head Generation

Zhen, R., Song, W., He, Q., Cao, J., Shi, L., & Luo, J. (2023) · Electronics · doi:10.3390/electronics12010218 · Cited by 76

Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation

Li, L., Wang, S., Zhang, Z., Ding, Y., Zheng, Y., Yu, X., & Fan, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16286 · Cited by 72

StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-Based Generator

Guan, J., Zhang, Z., Zhou, H., Hu, T., Wang, K., He, D., Feng, H., Liu, J., Ding, E., Liu, Z., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00151 · Cited by 71

A Motion Matching-based Framework for Controllable Gesture Synthesis from Speech

Habibie, I., Elgharib, M. A., Sarkar, K., Abdullah, A., Nyatsanga, S., Neff, M., & Theobalt, C. (2022) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3528233.3530750 · Cited by 67

Active Speakers in Context

Alcázar, J. L., Caba, F., Mai, L., Perazzi, F., Lee, J., Arbeláez, P., & Ghanem, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01248 · Cited by 69

What Makes the Sound?: A Dual-Modality Interacting Network for Audio-Visual Event Localization

Ramaswamy, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053895 · Cited by 65

DeepFake on Face and Expression Swap: A Review

Waseem, S., Abu Bakar, S. A. R. S., Ahmed, B. A., Omar, Z., Eisa, T. A. E., & Dalam, M. E. E. (2023) · IEEE Access · doi:10.1109/access.2023.3324403 · Cited by 65

EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditions

Chen, Z., Cao, J., Chen, Z., Li, Y., & Ma, C. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i3.32241 · Cited by 173

Deep learning for visual speech analysis: A survey

Sheng, C., Kuang, G., Bai, L., Hou, C., Guo, Y., Xu, X., Pietikäinen, M., & Liu, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3376710 · Cited by 64

Gating Neural Network for Large Vocabulary Audiovisual Speech Recognition

Tao, F., & Busso, C. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2815268 · Cited by 65

Glitch in the matrix: A large scale benchmark for content driven audio–visual forgery detection and localization

Cai, Z., Ghosh, S., Dhall, A., Gedeon, T., Stefanov, K., & Hayat, M. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103818 · Cited by 63

VoxSRC 2020: The Second VoxCeleb Speaker Recognition ChallengePreprint

Nagrani, A., Chung, J. S., Huh, J., Brown, A., Coto, E., Xie, W., McLaren, M., Reynolds, D. A., & Zisserman, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06867 · Cited by 69

Audiovisual Generalised Zero-shot Learning with Cross-modal Attention and Language

Mercea, O.-B., Riesch, L., Koepke, A. S., & Akata, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01030 · Cited by 60

Real-Time Neural Radiance Talking Portrait Synthesis via Audio-Spatial Decomposition

Tang, J., Wang, K., Zhou, H., Chen, X., He, D., Hu, T., Liu, J., Liu, Z., Zeng, G., & Wang, J. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02481-9 · Cited by 59

3D Talking Face With Personalized Pose Dynamics

Zhang, C., Ni, S., Fan, Z., Li, H., Zeng, M., Budagavi, M., & Guo, X. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3117484 · Cited by 58

FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN

Agarwal, M., Agrawal, S., Anastasopoulos, A., Bentivogli, L., Bojar, O., Borg, C., Carpuat, M. J., Cattoni, R., Cettolo, M., Chen, M., et al. (2023) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2023.iwslt-1.1 · Cited by 57

Lip reading with Hahn Convolutional Neural Networks

Mesbah, A., Berrahou, A., Hammouchi, H., Berbia, H., Qjidaa, H., & Daoudi, M. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.04.010 · Cited by 56

Self-supervised object detection from audio-visual correspondence

Afouras, T., Asano, Y. M., Fagan, F., Vedaldi, A., & Metze, F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01032 · Cited by 56

A Survey of Research on Lipreading Technology

Hao, M., Mamut, M., Yadikar, N., Aysa, A., & Ubul, K. (2020) · IEEE Access · doi:10.1109/access.2020.3036865 · Cited by 60

Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video

Kim, M., Hong, J. H., Park, S. J., & Ro, Y. M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00036 · Cited by 55

The Conversation: Deep Audio-Visual Speech Enhancement

Afouras, T., Chung, J. S., & Zisserman, A. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1400 · Cited by 54

End to End Lip Synchronization with a Temporal AutoEncoderPreprint

Shalev, Y., & Wolf, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.16224

Learning to lip read words by watching videos

Chung, J. S., & Zisserman, A. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.02.001 · Cited by 97

A Deep Learning Approach to Learn Lip Sync from Audio

Bhuiyan, M. I., Mahato, M., Hassan, M. N., & Rahman, M. H. (2021)

End-to-End Lip Synchronisation.Preprint

Kim, Y. J., Heo, H. S., Chung, S.-W., & Lee, B. (2020) · arXiv (Cornell University)

End-To-End Lip Synchronisation Based on Pattern Classification

Kim, Y. J., Heo, H. S., Chung, S.-W., & Lee, B. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383616 · Cited by 9