Out of Time: Automated Lip Sync in the Wild

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works

Very Deep Convolutional Networks for Large-Scale Image Recognition

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · see citing works

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint

Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273 · see citing works

Untitled work

(1981) · Cited by 11,963 · see citing works

Caffe: Convolutional Architecture for Fast Feature Embedding

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077 · see citing works

Two-Stream Convolutional Networks for Action Recognition in Videos

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756 · see citing works

Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences

Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465 · see citing works

Learning a Similarity Metric Discriminatively, with Application to Face Verification

Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036 · see citing works

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335 · see citing works

Dlib-ml: A Machine Learning Toolkit

King, D. E. (2009) · Journal of machine learning research · doi:10.5555/1577069.1755843 · Cited by 2,945 · see citing works

MatConvNet: Convolutional Neural Networks for MATLAB

Vedaldi, A., & Lenc, K. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2807412 · Cited by 2,444 · see citing works

Lip Reading in the Wild

Chung, J. S., & Zisserman, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54184-6_6 · Cited by 537 · see citing works

RELIABLE TRANSITION DETECTION IN VIDEOS: A SURVEY AND PRACTITIONER'S GUIDE

Lienhart, R. W. (2001) · International Journal of Image and Graphics · doi:10.1142/s021946780100027x · Cited by 275 · see citing works

Audiovisual Synchronization and Fusion Using Canonical Correlation Analysis

Sargin, M. E., Yemez, Y., Erzin, E., & Tekalp, A. M. (2007) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2007.906583 · Cited by 182 · see citing works

OuluVS2: A multi-view audiovisual database for non-rigid mouth motion analysis

Anina, I., Zhou, Z., Zhao, G., & Pietikäinen, M. (2015) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2015.7163155 · Cited by 147 · see citing works

Automated lip‐sync: Background and techniques

Lewis, J. P. (1991) · The Journal of Visualization and Computer Animation · doi:10.1002/vis.4340020404 · Cited by 90 · see citing works

Cross-Modal Supervision for Learning Active Speaker Detection in Video

Chakravarty, P., & Tuytelaars, T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_18 · Cited by 59 · see citing works

A Compact Representation of Visual Speech Data Using Latent Variables

Zhou, Z., Hong, X., Zhao, G., & Pietikäinen, M. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.173 · Cited by 53 · see citing works

Audiovisual Speech Synchrony Measure: Application to Biometrics

Bredin, H., & Chollet, G. (2007) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2007/70186 · Cited by 50 · see citing works

Editorial: State of the Journal

Forsyth, D. A. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.7 · Cited by 36 · see citing works

Audio-visual speech asynchrony detection using co-inertia analysis and coupled hidden markov models

Rúa, E. A., Bredin, H., Mateo, C. G., Chollet, G., & Jiménez, D. G. (2008) · Pattern Analysis and Applications · doi:10.1007/s10044-008-0121-2 · Cited by 34 · see citing works

Detecting audio-visual synchrony using deep neural networks

Marcheret, E., Potamianos, G., Vopicka, J., & Goel, V. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-201 · Cited by 25 · see citing works

Lip synchronization for animation

McAllister, D. F., Rodman, R. D., Bitzer, D. L., & Freeman, A. S. (1997) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/259081.259312 · Cited by 22 · see citing works

Faces in Places: compound query retrieval

Zhong, Y., Arandjelović, R., & Zisserman, A. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.56 · Cited by 20 · see citing works

A Real-Time Lip SYNC System Using a Genetic Algorithm for Automatic Neural Network Configuration

Zorić, G., & Pandzic, I. S. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2005.1521684 · Cited by 20 · see citing works

Audio-visual speech translation with automatic lip syncqronization and face tracking based on 3-D head model

Morishima, S., Ogata, S., Murai, K., & Nakamura, S. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745053 · Cited by 19 · see citing works

Lip synchronization of speech.

McAllister, D. F., Rodman, R. D., Bitzer, D. L., & Freeman, A. S. (1997) · AVSP · Cited by 18 · see citing works

Automated lip-sync: direct translation of speech-sound to mouth-shape

Koster, B., Rodman, R. D., & Bitzer, D. L. (2002) · 2018 52nd Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.1994.471519 · Cited by 15 · see citing works

VoxCeleb2: Deep Speaker Recognition

Chung, J. S., Nagrani, A., & Zisserman, A. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1929 · Cited by 2,256 · see citing works

IEEE Symposium on Security and Privacy

(2023) · IT Professional · doi:10.1109/mitp.2023.3246667 · Cited by 1,180 · see citing works

A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild

Prajwal, K. R., Mukhopadhyay, R., Namboodiri, V. P., & Jawahar, C. V. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413532 · Cited by 897 · see citing works

Look, Listen and Learn

Arandjelović, R., & Zisserman, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.73 · Cited by 836 · see citing works

Deep Audio-Visual Speech Recognition

Afouras, T., Chung, J. S., Senior, A., Vinyals, O., & Zisserman, A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889052 · Cited by 801 · see citing works

Audio-Visual Scene Analysis with Self-Supervised Multisensory Features

Owens, A., & Efros, A. A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_39 · Cited by 704 · see citing works

Voxceleb: Large-scale speaker verification in the wild

Nagrani, A., Chung, J. S., Xie, W., & Zisserman, A. (2019) · Computer Speech & Language · doi:10.1016/j.csl.2019.101027 · Cited by 650 · see citing works

Hierarchical Cross-Modal Talking Face Generation With Dynamic Pixel-Wise Loss

Chen, L., Maddox, R. K., Duan, Z., & Xu, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00802 · Cited by 437 · see citing works

X2Face: A Network for Controlling Face Generation Using Images, Audio, and Pose Codes

Wiles, O., Koepke, A. S., & Zisserman, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_41 · Cited by 427 · see citing works

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation

Zhou, H., Liu, Y., Liu, Z., Luo, P., & Wang, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019299 · Cited by 416 · see citing works

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis

Guo, Y., Chen, K., Liang, S., Liu, Y.-J., Bao, H., & Zhang, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00573 · Cited by 384 · see citing works

Neural Voice Puppetry: Audio-Driven Facial Reenactment

Thies, J., Elgharib, M. A., Tewari, A., Theobalt, C., & Nießner, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_42 · Cited by 397 · see citing works

Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation

Zhou, H., Sun, Y., Wu, W., Loy, C. C., Wang, X., & Liu, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00416 · Cited by 377 · see citing works

Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset

Zhang, Z., Li, L., Ding, Y., & Fan, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00366 · Cited by 368 · see citing works

An Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation

Michelsanti, D., Tan, Z., Zhang, S.-X., Xu, Y., Yu, M., Yu, D., & Jensen, J. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3066303 · Cited by 326 · see citing works

Realistic Speech-Driven Facial Animation with GANs

Vougioukas, K., Petridis, S., & Pantić, M. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01251-8 · Cited by 299 · see citing works

Emotion Recognition in Speech using Cross-Modal Transfer in the Wild

Albanie, S., Nagrani, A., Vedaldi, A., & Zisserman, A. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240578 · Cited by 293 · see citing works

FaceFormer: Speech-Driven 3D Facial Animation with Transformers

Fan, Y., Lin, Z., Saito, J., Wang, W., & Komura, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01821 · Cited by 266 · see citing works

SCSampler: Sampling Salient Clips From Video for Efficient Action Recognition

Korbar, B., Tran, D., & Torresani, L. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00633 · Cited by 227 · see citing works

Seeing Voices and Hearing Faces: Cross-Modal Biometric Matching

Nagrani, A., Albanie, S., & Zisserman, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00879 · Cited by 224 · see citing works

Self-supervised Learning of Audio-Visual Objects from Video

Afouras, T., Owens, A., Chung, J. S., & Zisserman, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58523-5_13 · Cited by 221 · see citing works

Audio-Visual Instance Discrimination with Cross-Modal Agreement

Morgado, P. M., Vasconcelos, N. M., & Misra, I. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01229 · Cited by 218 · see citing works

Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization

Chugh, K., Gupta, P., Dhall, A., & Subramanian, R. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413700 · Cited by 225 · see citing works

CN-Celeb: A Challenging Chinese Speaker Recognition Dataset

Fan, Y. B., Kang, J., Li, L. T., Li, K., Chen, H., Cheng, S., Zhang, P. Y., Zhou, Z., Cai, Y., & Wang, D. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054017 · Cited by 207 · see citing works

You Said That?: Synthesising Talking Faces from Audio

Jamaludin, A., Chung, J. S., & Zisserman, A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01150-y · Cited by 189 · see citing works

CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior

Xing, J., Xia, M., Zhang, Y., Cun, X., Wang, J., & Wong, T. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01229 · Cited by 197 · see citing works

Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection

Haliassos, A., Mira, R., Petridis, S., & Pantic, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01453 · Cited by 180 · see citing works

LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild

Yang, S., Zhang, Y., Feng, D., Yang, M., Wang, C., Xiao, J., Long, K., Shan, S., & Chen, X. (2019) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2019.8756582 · Cited by 175 · see citing works

Large-Scale Visual Speech Recognition

Shillingford, B., Assael, Y., Hoffman, M. W., Paine, T., Hughes, C., Prabhu, U., Liao, H., Sak, H., Rao, K., Bennett, L., et al. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1669 · Cited by 164 · see citing works

Audiovisual SlowFast Networks for Video RecognitionPreprint

Xiao, F., Lee, Y. J., Grauman, K. L., Malik, J., & Feichtenhofer, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08740 · Cited by 195 · see citing works

Is Someone Speaking?

Tao, R., Pan, Z., Das, R. K., Qian, X., Shou, M. Z., & Li, H. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475587 · Cited by 157 · see citing works

Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection

Tao, R., Pan, Z., Das, R. K., Qian, X., Shou, M. Z., & Li, H. (2021) · arXiv · doi:10.48550/arxiv.2107.06592 · Cited by 156 · see citing works

Ava Active Speaker: An Audio-Visual Dataset for Active Speaker Detection

Roth, J., Chaudhuri, S., Klejch, O., Marvin, R., Gallagher, A., Kaver, L., Ramaswamy, S., Stopczynski, A., Schmid, C., Xi, Z., et al. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053900 · Cited by 156 · see citing works

Spot the Conversation: Speaker Diarisation in the Wild

Chung, J. S., Huh, J., Nagrani, A., Afouras, T., & Zisserman, A. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2337 · Cited by 155 · see citing works

Learnable PINs: cross-modal embeddings for person identity

Nagrani, A., Albanie, S., & Zisserman, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_5 · Cited by 151 · see citing works

Multimodal Image Synthesis and Editing: The Generative AI Era

Zhan, F., Yu, Y., Wu, R., Zhang, J., Lu, S., Liu, L., Kortylewski, A., Theobalt, C., & Xing, E. P. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3305243 · Cited by 162 · see citing works

FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning

Zhang, C., Zhao, Y., Huang, Y., Zeng, M., Ni, S., Budagavi, M., & Guo, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00384 · Cited by 140 · see citing works

Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation

Stypułkowski, M., Vougioukas, K., He, S., Zięba, M., Petridis, S., & Pantić, M. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00502 · Cited by 149 · see citing works

Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation

Stypułkowski, M., Vougioukas, K., He, S., Zięba, M., Petridis, S., & Pantic, M. (2023) · arXiv · doi:10.48550/arxiv.2301.03396 · Cited by 140

Evolving Losses for Unsupervised Video Representation Learning

Piergiovanni, A., Angelova, A., & Ryoo, M. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00021 · Cited by 134 · see citing works

KoDF: A Large-scale Korean DeepFake Detection Dataset

Kwon, P., You, J., Nam, G., Park, S., & Chae, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01057 · Cited by 145 · see citing works

DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation

Shen, S., Zhao, W., Meng, Z., Li, W., Zhu, Z., Zhou, J., & Lu, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00197 · Cited by 133 · see citing works

Survey on automatic lip-reading in the era of deep learning

Fernandez-Lopez, A., & Sukno, F. M. (2018) · Image and Vision Computing · doi:10.1016/j.imavis.2018.07.002 · Cited by 131 · see citing works

Multimodal Sparse Transformer Network for Audio-Visual Speech Recognition

Song, Q., Sun, B., & Shutao Li, A. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3163771 · Cited by 127 · see citing works

Everybody’s Talkin’: Let Me Talk as You Want

Song, L., Wu, W., Qian, C., He, R., & Loy, C. C. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3146783 · Cited by 142 · see citing works

Expressive Talking Head Generation with Granular Audio-Visual Control

Liang, B., Pan, Y. M., Guo, Z., Zhou, H., Hong, Z., Han, X., Han, J., Liu, J., Ding, E., & Wang, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00338 · Cited by 124 · see citing works

CN-Celeb: Multi-genre speaker recognition

Li, L., Liu, R., Kang, J., Fan, Y. B., Cui, H., Cai, Y., Vipperla, R., Zheng, T. F., & Wang, D. (2022) · Speech Communication · doi:10.1016/j.specom.2022.01.002 · Cited by 121 · see citing works

Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation

Liu, X., Xu, Y., Wu, Q., Zhou, H., Wu, W., & Zhou, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19836-6_7 · Cited by 121 · see citing works

3D Convolutional Neural Networks for Cross Audio-Visual Matching Recognition

Torfi, A., Iranmanesh, S. M., Nasrabadi, N. M., & Dawson, J. M. (2017) · IEEE Access · doi:10.1109/access.2017.2761539 · Cited by 118 · see citing works

Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis

Li, J., Zhang, J., Bai, X. P., Zhou, J. W., & Gu, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00696 · Cited by 116 · see citing works

One-Shot Talking Face Generation from Single-Speaker Audio-Visual Correlation Learning

Wang, S., Li, L., Ding, Y., & Yu, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20154 · Cited by 115 · see citing works

Discriminative Multi-Modality Speech Recognition

Xu, B., Lu, C., Guo, Y., & Wang, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01444 · Cited by 112 · see citing works

VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

Cheng, K., Cun, X., Zhang, Y., Xia, M., Yin, F., Zhu, M., Wang, X., Wang, J., & Wang, N. (2022) · SIGGRAPH Asia Conference Papers · doi:10.1145/3550469.3555399 · Cited by 112 · see citing works

LipNet: End-to-End Sentence-level LipreadingPreprint

Assael, Y., Shillingford, B., Whiteson, S., & de Freitas, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01599 · Cited by 573 · see citing works

Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert

Wang, J., Qian, X., Zhang, M., Tan, R. T., & Li, H. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01408 · Cited by 116 · see citing works

Robust Audio-Visual Instance Discrimination

Morgado, P. M., Misra, I., & Vasconcelos, N. M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01274 · Cited by 108 · see citing works

Perfect Match: Improved Cross-modal Embeddings for Audio-visual Synchronisation

Chung, S.-W., Chung, J. S., & Kang, H.-G. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682524 · Cited by 108 · see citing works

Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis

Shen, S., Li, W., Zhu, Z. D., Duan, Y., Zhou, J., & Lu, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19775-8_39 · Cited by 107 · see citing works

Non-Parallel Sequence-to-Sequence Voice Conversion With Disentangled Linguistic and Speaker Representations

Zhang, J.-X., Ling, Z.-H., & Dai, L.-R. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2960721 · Cited by 105 · see citing works

Spatio-Temporal Fusion Based Convolutional Sequence Learning for Lip Reading

Zhang, X., Cheng, F., & Wang, S. (2019) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2019.00080 · Cited by 88 · see citing works

Identity-Preserving Talking Face Generation with Landmark and Appearance Priors

Zhong, W., Fang, C., Cai, Y., Wei, P., Zhao, G., Lin, L., & Li, G. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00938 · Cited by 102 · see citing works

Self-Supervised Video Forensics by Audio-Visual Anomaly Detection

Feng, C., Chen, Z., & Owens, A. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01011 · Cited by 101 · see citing works

LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization

Lahiri, A., Kwatra, V., Frueh, C., Lewis, J., & Bregler, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00278 · Cited by 101 · see citing works

Speech-Driven Facial Animation Using Cascaded GANs for Learning of Motion and Texture

Das, D., Biswas, S., Sinha, S., & Bhowmick, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58577-8_25 · Cited by 101 · see citing works

Speaker Inconsistency Detection in Tampered Video

Korshunov, P., & Marcel, S. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553270 · Cited by 97 · see citing works

Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization

Cai, Z., Stefanov, K., Dhall, A., & Hayat, M. (2022) · 2022 International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta56598.2022.10034605 · Cited by 99 · see citing works

EMO: Emote Portrait Alive Generating Expressive Portrait Videos with Audio2Video Diffusion Model Under Weak Conditions

Tian, L., Wang, Q. J., Zhang, B., & Bo, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73010-8_15 · Cited by 112 · see citing works

TalkingStyle: Personalized Speech-Driven 3D Facial Animation With Style Preservation

Song, W., Wang, X., Zheng, S., Li, S., Hao, A., & Hou, X. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3409568 · Cited by 91 · see citing works

SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory

Park, S. J., Kim, M., Hong, J., Choi, J., & Ro, Y. M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20102 · Cited by 88 · see citing works

Contrastive Positive Sample Propagation Along the Audio-Visual Event Line

Zhou, J., Guo, D., & Wang, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3223688 · Cited by 82 · see citing works

Deep Learning-Based Automated Lip-Reading: A Survey

Fenghour, S., Chen, D., Guo, K., Li, B., & Xiao, P. (2021) · IEEE Access · doi:10.1109/access.2021.3107946 · Cited by 81 · see citing works

SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis

Peng, Z., Hu, W., Shi, Y., Zhu, X., Zhang, X., Zhao, H., He, J., Liu, H., & Fan, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00070 · Cited by 83 · see citing works

Vision-Infused Deep Audio Inpainting

Zhou, H., Liu, Z., Xu, X., Luo, P., & Wang, X. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00037 · Cited by 80 · see citing works

StyleTalk: One-Shot Talking Head Generation with Controllable Speaking Styles

Ma, Y., Wang, S., Hu, Z., Fan, C., Lv, T., Ding, Y., Deng, Z., & Yu, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25280 · Cited by 79 · see citing works

See the Sound, Hear the Pixels

Ramaswamy, J., & Das, S. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093616 · Cited by 78 · see citing works

Contrastive Multimodal Fusion with TupleInfoNCE

Liu, Y., Fan, Q., Zhang, S., Dong, H., Funkhouser, T. A., & Yi, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00079 · Cited by 77 · see citing works

Learning Representations from Audio-Visual Spatial AlignmentPreprint

Morgado, P. M., Li, Y., & Vasconcelos, N. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.01819 · Cited by 74 · see citing works

Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation

Gan, Y., Yang, Z., Yue, X., Sun, L., & Yang, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02069 · Cited by 72 · see citing works

Human-Computer Interaction System: A Survey of Talking-Head Generation

Zhen, R., Song, W., He, Q., Cao, J., Shi, L., & Luo, J. (2023) · Electronics · doi:10.3390/electronics12010218 · Cited by 76 · see citing works

Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation

Li, L., Wang, S., Zhang, Z., Ding, Y., Zheng, Y., Yu, X., & Fan, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16286 · Cited by 68 · see citing works

StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-Based Generator

Guan, J., Zhang, Z., Zhou, H., Hu, T., Wang, K., He, D., Feng, H., Liu, J., Ding, E., Liu, Z., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00151 · Cited by 71 · see citing works

A Motion Matching-based Framework for Controllable Gesture Synthesis from Speech

Habibie, I., Elgharib, M. A., Sarkar, K., Abdullah, A., Nyatsanga, S., Neff, M., & Theobalt, C. (2022) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3528233.3530750 · Cited by 67 · see citing works

Active Speakers in Context

Alcázar, J. L., Caba, F., Mai, L., Perazzi, F., Lee, J., Arbeláez, P., & Ghanem, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01248 · Cited by 66 · see citing works

What Makes the Sound?: A Dual-Modality Interacting Network for Audio-Visual Event Localization

Ramaswamy, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053895 · Cited by 65 · see citing works

DeepFake on Face and Expression Swap: A Review

Waseem, S., Abu Bakar, S. A. R. S., Ahmed, B. A., Omar, Z., Eisa, T. A. E., & Dalam, M. E. E. (2023) · IEEE Access · doi:10.1109/access.2023.3324403 · Cited by 65 · see citing works

EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditions

Chen, Z., Cao, J., Chen, Z., Li, Y., & Ma, C. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i3.32241 · Cited by 78 · see citing works

Deep learning for visual speech analysis: A survey

Sheng, C., Kuang, G., Bai, L., Hou, C., Guo, Y., Xu, X., Pietikäinen, M., & Liu, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3376710 · Cited by 64 · see citing works

Gating Neural Network for Large Vocabulary Audiovisual Speech Recognition

Tao, F., & Busso, C. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2815268 · Cited by 64 · see citing works

Glitch in the matrix: A large scale benchmark for content driven audio–visual forgery detection and localization

Cai, Z., Ghosh, S., Dhall, A., Gedeon, T., Stefanov, K., & Hayat, M. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103818 · Cited by 63 · see citing works

VoxSRC 2020: The Second VoxCeleb Speaker Recognition ChallengePreprint

Nagrani, A., Chung, J. S., Huh, J., Brown, A., Coto, E., Xie, W., McLaren, M., Reynolds, D. A., & Zisserman, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06867 · Cited by 69 · see citing works

Audiovisual Generalised Zero-shot Learning with Cross-modal Attention and Language

Mercea, O.-B., Riesch, L., Koepke, A. S., & Akata, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01030 · Cited by 60 · see citing works

Real-Time Neural Radiance Talking Portrait Synthesis via Audio-Spatial Decomposition

Tang, J., Wang, K., Zhou, H., Chen, X., He, D., Hu, T., Liu, J., Liu, Z., Zeng, G., & Wang, J. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02481-9 · Cited by 59 · see citing works

3D Talking Face With Personalized Pose Dynamics

Zhang, C., Ni, S., Fan, Z., Li, H., Zeng, M., Budagavi, M., & Guo, X. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3117484 · Cited by 58 · see citing works

FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN

Agarwal, M., Agrawal, S., Anastasopoulos, A., Bentivogli, L., Bojar, O., Borg, C., Carpuat, M., Cattoni, R., Cettolo, M., Chen, M., et al. (2023) · International Workshop on Spoken Language Translation · doi:10.18653/v1/2023.iwslt-1.1 · Cited by 78 · see citing works

Lip reading with Hahn Convolutional Neural Networks

Mesbah, A., Berrahou, A., Hammouchi, H., Berbia, H., Qjidaa, H., & Daoudi, M. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.04.010 · Cited by 56 · see citing works

Self-supervised object detection from audio-visual correspondence

Afouras, T., Asano, Y. M., Fagan, F., Vedaldi, A., & Metze, F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01032 · Cited by 56 · see citing works

A Survey of Research on Lipreading Technology

Hao, M., Mamut, M., Yadikar, N., Aysa, A., & Ubul, K. (2020) · IEEE Access · doi:10.1109/access.2020.3036865 · Cited by 55 · see citing works

Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video

Kim, M., Hong, J. H., Park, S. J., & Ro, Y. M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00036 · Cited by 55 · see citing works

The Conversation: Deep Audio-Visual Speech Enhancement

Afouras, T., Chung, J. S., & Zisserman, A. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1400 · Cited by 54 · see citing works

On Compositions of Transformations in Contrastive Self-Supervised Learning

Patrick, M., Asano, Y. M., Kuznetsova, P., Fong, R., Henriques, J. F., Zweig, G., & Vedaldi, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00944 · Cited by 65 · see citing works

End to End Lip Synchronization with a Temporal AutoEncoderPreprint

Shalev, Y., & Wolf, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.16224

Learning to lip read words by watching videos

Chung, J. S., & Zisserman, A. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.02.001 · Cited by 94 · see citing works

A Deep Learning Approach to Learn Lip Sync from Audio

Bhuiyan, M. I., Mahato, M., Hassan, M. N., & Rahman, M. H. (2021)

End-to-End Lip Synchronisation.Preprint

Kim, Y. J., Heo, H. S., Chung, S.-W., & Lee, B. (2020) · arXiv (Cornell University)

End-To-End Lip Synchronisation Based on Pattern Classification

Kim, Y. J., Heo, H. S., Chung, S.-W., & Lee, B. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383616 · Cited by 9 · see citing works