Out of Time: Automated Lip Sync in the Wild

Very Deep Convolutional Networks for Large-Scale Image Recognition

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint

Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273

Untitled work

(1981) · Cited by 11,963

Caffe: Convolutional Architecture for Fast Feature Embedding

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077

Two-Stream Convolutional Networks for Action Recognition in Videos

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756

Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences

Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465

Learning a Similarity Metric Discriminatively, with Application to Face Verification

Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335

Lip-Reading with Limited-Data Network

Fernandez-Lopez, A., & Sukno, F. M. (2019) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2019.8902572 · Cited by 10

End to End Lip Synchronization with a Temporal AutoEncoder

Shalev, Y., & Wolf, L. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093490 · Cited by 10

Automatic audiovisual synchronisation for ultrasound tongue imaging

Eshky, A., Cleland, J., Ribeiro, M. S., Sugden, E., Richmond, K., & Renals, S. J. (2021) · Speech Communication · doi:10.1016/j.specom.2021.05.008 · Cited by 10

Active Speaker Detection as a Multi-Objective Optimization with Uncertainty-Based Multimodal Fusion

Pouthier, B., Pilati, L., Gudupudi, L. K., Bouveyron, C., & Precioso, F. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-80 · Cited by 10

Group-Level Focus of Visual Attention for Improved Next Speaker Prediction

Birmingham, C., Stefanov, K., & Matarić, M. J. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3479213 · Cited by 10

A Comparative Study of Perceptual Quality Metrics For Audio-Driven Talking Head Videos

Zhang, W., Zhu, C., Gao, J., Yan, Y., Zhai, G., & Yang, X. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10647543 · Cited by 9

PersonaTalk: Bring Attention to Your Persona in Visual Dubbing

Zhang, L., Liang, S., Ge, Z., & Hu, T. (2024) · SIGGRAPH Asia Conference Papers · doi:10.1145/3680528.3687618 · Cited by 9

VPT: Video portraits transformer for realistic talking face generation

Zhang, Z., Zhang, J., & Mai, W. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107122 · Cited by 9

InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation

Wang, Y., Guo, J., Bai, J., Yu, R., He, T., Tan, X., Sun, X., & Bian, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i8.32877 · Cited by 25

InsTaG: Learning Personalized 3D Talking Head from Few-Second Video

Li, J., Zhang, J., Xiao, B., Zheng, J., Zhou, J. W., & Gu, L. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00999 · Cited by 9

SingingHead: A Large-Scale 4D Dataset for Singing Head Animation

Wu, S., Li, Y., Zhang, W., Jia, J., Zhu, Y., Yan, Y., Zhai, G., & Yang, X. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3623560 · Cited by 10

Comparison of Deepfakes Detection Techniques

Salman, S., & Shamsi, J. A. (2023) · doi:10.1109/icai58407.2023.10136659 · Cited by 9

FunnyNet-W: Multimodal Learning of Funny Moments in Videos in the Wild

Liu, Z.-S., Courant, R., & Kalogeiton, V. S. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02000-2 · Cited by 13

Exploring Phonetic Context-Aware Lip-Sync for Talking Face Generation

Park, S. J., Kim, M., Choi, J., & Ro, Y. M. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447284 · Cited by 9

Detecting Adversarial Attacks on Audiovisual Speech Recognition

Ma, P., Petridis, S., & Pantić, M. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413661 · Cited by 17

A Closer Look at Audio-Visual Multi-Person Speech Recognition and Active Speaker Selection

Braga, O., & Siohan, O. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414160 · Cited by 9

Design and Evaluation of a Silent Speech-Based Selection Method for Eye-Gaze Pointing

Pandey, L., & Arif, A. S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3567723 · Cited by 9

Automated Video Face Labelling for Films and TV Material

Parkhi, O., Rahtu, E., Cao, Q., & Zisserman, A. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889831 · Cited by 9

Visual Speech Enhancement using Noise-Invariant TrainingPreprint

Gabbay, A., Shamir, A., & Peleg, B. (2017) · arXiv (Cornell University) · Cited by 9

Ecarnet: enhanced clue-ambiguity reasoning network for multimodal fake news detection

Zhong, S., Peng, S., Liu, X., Zhu, L., Xu, X., & Li, T. (2024) · Multimedia Systems · doi:10.1007/s00530-023-01256-x · Cited by 8

DiffDub: Person-Generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-Encoder

Liu, T., Du, C., Fan, S., Chen, F., & Yu, K. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446049 · Cited by 9

Generating dynamic lip-syncing using target audio in a multimedia environment

Pawar, D., Borde, P. L., & Yannawar, P. L. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100084 · Cited by 8

Multimodal attention for lip synthesis using conditional generative adversarial networks

Vidal, A., & Busso, C. (2023) · Speech Communication · doi:10.1016/j.specom.2023.102959 · Cited by 8

OSM-Net: One-to-Many One-Shot Talking Head Generation With Spontaneous Head Motions

Liu, J., Wang, X., Fu, X., Chai, Y., Cai, Y., Dai, J., & Han, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3394850 · Cited by 8

Expression-aware neural radiance fields for high-fidelity talking portrait synthesis

Wang, X., Ruan, T., Xu, J., Guo, X., Li, J., Yan, F., Zhao, G., & Wang, C. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105075 · Cited by 8

WASD: A Wilder Active Speaker Detection Dataset

Roxo, T., Costa, J. C., Inácio, P. R. M., & Proença, H. P. M. C. (2024) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2024.3412821 · Cited by 8

DIM: Dyadic Interaction Modeling for Social Behavior Generation

Tran, M., Chang, D., Siniukov, M., & Soleymani, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72913-3_27 · Cited by 8

Enhancing the Accessibility of Hearing Impaired to Video Content through Fully Automatic Dynamic Captioning

Mocanu, B., Țapu, R., & Zaharia, T. B. (2019) · E-Health and Bioengineering Conference (EHB) · doi:10.1109/ehb47216.2019.8970038 · Cited by 8

End-To-End Lip Synchronisation Based on Pattern Classification

Kim, Y. J., Heo, H. S., Chung, S.-W., & Lee, B. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383616 · Cited by 9

Invertable Frowns

Magnusson, I., Sankaranarayanan, A., & Lippman, A. (2021) · doi:10.1145/3476099.3484317 · Cited by 8

Lip Reading in Cantonese

Xiao, Y., Teng, L., Zhu, A., Liu, X., & Tian, P. (2022) · IEEE Access · doi:10.1109/access.2022.3204677 · Cited by 8

Multi-Modal Gaze Following in Conversational Scenarios

Hou, Y., Zhang, Z., Horányi, N., Moon, J., Cheng, Y., & Chang, H. J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00122 · Cited by 9

Speech-Driven Facial Animation Using Polynomial Fusion of Features

Kefalas, T., Vougioukas, K., Panagakis, Y., Petridis, S., Kossaifi, J., & Pantić, M. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054469 · Cited by 9

Detection of Audio-Video Synchronization Errors Via Event Detection

Ebenezer, J. P., Wu, Y., Wei, H., Sethuraman, S., & Liu, Z. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414924 · Cited by 11

MAAS: Multi-modal Assignation for Active Speaker DetectionPreprint

Alcázar, J. L., Heilbron, F. C., Thabet, A., & Ghanem, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.03682 · Cited by 8

Trusted Media Challenge Dataset and User Study

Chen, W., Chua, S. L. B., Winkler, S., & Ng, S.-K. (2022) · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · doi:10.1145/3511808.3557715 · Cited by 7

Multimodal Fusion for Talking Face Generation Utilizing Speech-Related Facial Action Units

Liu, Z., Liu, X., Chen, S., Liu, J., Wang, L., & Bi, C. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3672565 · Cited by 7

Audio-Driven Talking Face Generation with Stabilized Synchronization Loss

Yaman, D., Eyiokur, F. İ., Bärmann, L., Ekenel, H. K., & Waibel, A. H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72655-2_24 · Cited by 7

LR-ASD: Lightweight and Robust Network for Active Speaker Detection

Liao, J., Duan, H., Feng, K., Zhao, W., Yang, Y., Chen, L., & Chen, Y. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02399-2 · Cited by 8

MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animation

Lin, Y., Fung, H., Xu, J., Ren, Z., Lau, A. S. M., Yin, G., & Li, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02444 · Cited by 7

Decoupled Two-Stage Talking Head Generation via Gaussian-Landmark-Based Neural Radiance Fields

Ma, B., Cao, Y., & Zhang, L. (2025) · Computational Visual Media · doi:10.26599/cvm.2025.9450482 · Cited by 7

Using audio-visual information to understand speaker activity: Tracking active speakers on and off screen

Hoover, K., Chaudhuri, S., Pantofaru, C., Sturdy, I., & Slaney, M. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461891 · Cited by 7

Audio-Driven Deformation Flow for Effective Lip Reading

Feng, D., Yang, S., Shan, S., & Chen, X. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956316 · Cited by 7

A Real-Time Active Speaker Detection System Integrating an Audio-Visual Signal with a Spatial Querying Mechanism

Gurvich, I., Leichter, I., Palle, D. R., Asher, Y., Vinnikov, A., Abramovski, I., Gopal, V., Cutler, R., & Krupka, E. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446169 · Cited by 7

Statistics-Aware Audio-Visual Deepfake Detector

Astrid, M., Ghorbel, E., & Aouada, D. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10648224 · Cited by 7

Audio-Visual Generalized Zero-Shot Learning using Pre-Trained Large Multi-Modal Models

Kurzendörfer, D., Mercea, O.-B., Koepke, A. S., & Akata, Z. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00269 · Cited by 8

Perceptual Evaluation of Audio-Visual Synchrony Grounded in Viewers’ Opinion Scores

Goncalves, L., Mathur, P., Lavania, C., Cekic, M., Federico, M., & Han, K. J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72986-7_17 · Cited by 8

ReSyncer: Rewiring Style-Based Generator for Unified Audio-Visually Synced Facial Performer

Guan, J., Xu, Z., Zhou, H., Wang, K., He, S., Zhang, Z., Liang, B., Feng, H., Ding, E., Liu, J., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72940-9_20 · Cited by 7

A lightweight approach to real-time speaker diarization: from audio toward audio-visual data streams

Kynych, F., Červa, P., Žďánský, J., Svendsen, T. K., & Salvi, G. (2024) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-024-00382-2 · Cited by 7

HyperLips: hyper control lips with high resolution decoder for talking face generation

Chen, Y., Yao, Y., Li, Z., Wang, W., Zhang, Y., Yang, H. S., & Wen, X. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05914-z · Cited by 9

FunnyNet: Audiovisual Learning of Funny Moments in Videos

Liu, Z.-S., Courant, R., & Kalogeiton, V. S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26316-3_26 · Cited by 7

Association between different sensory modalities based on concurrent time series data obtained by a collaborative reservoir computing model

Kanemura, I., & Kitano, K. (2023) · Scientific Reports · doi:10.1038/s41598-023-27385-x · Cited by 6

A Novel Distance Learning for Elastic Cross-Modal Audio-Visual Matching

Wang, R., Huang, H., Zhang, X., Ma, J., & Zheng, A. (2019) · IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2019.00-70 · Cited by 7

Deep emotion recognition based on audio–visual correlation

Hajarolasvadi, N., & Demirel, H. (2020) · IET Computer Vision · doi:10.1049/iet-cvi.2020.0013 · Cited by 8

Look Who’s Not Talking

Kwon, Y., Heo, H. S., Huh, J., Lee, B., & Chung, J. S. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383502 · Cited by 7

Detecting Adversarial Attacks On Audiovisual Speech RecognitionPreprint

Ma, P., Petridis, S., & Pantić, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.08639 · Cited by 7

Families In Wild Multimedia (FIW-MM): A Multi-Modal Database for Recognizing KinshipPreprint

Robinson, J. P., Khan, Z., Yin, Y., Shao, M., & Fu, Y. (2020) · arXiv (Cornell University) · Cited by 7

INFP: Audio-Driven Interactive Head Generation in Dyadic Conversations

Zhu, Y., Zhang, L., Rong, Z., Hu, T., Liang, S., & Ge, Z. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00997 · Cited by 10

Canonswap: High-Fidelity and Consistent Video Face Swapping Via Canonical Space Modulation

Luo, X., Zhu, Y., Liu, Y., Lin, L., Wan, C., Cai, Z., Li, Y., & Huang, S. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00938 · Cited by 6

A Simple and Efficient method for Dubbed Audio Sync Detection using Compressive Sensing

Vajpayee, A., Zhang, Z., Jain, A., & Bhat, V. (2023) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw58289.2023.00063 · Cited by 6

3-D Facial Priors Guided Local–Global Motion Collaboration Transforms for One-Shot Talking-Head Video Synthesis

Chen, Y., Zeng, R., & Xiong, S. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3323684 · Cited by 7

TRAVID: An End-to-End Video Translation Framework

Adhikary, P. K., Sugandhi, B., Ghimire, S., Pal, S., & Pakray, P. (2023) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2023.ijcnlp-demo.1 · Cited by 6

VoxMM: Rich Transcription of Conversations in the Wild

Kwak, D., Jung, J., Nam, K.-H., Jang, Y., Jung, J.-W., Watanabe, S., & Chung, J. S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446300 · Cited by 6

MILG: Realistic lip-sync video generation with audio-modulated image inpainting

Bao, H., Zhang, X., Wang, Q., Liang, K., Wang, Z., Ji, S., & Chen, W. (2024) · Visual Informatics · doi:10.1016/j.visinf.2024.08.002 · Cited by 7

EmoSpeaker: One-Shot Fine-Grained Emotion-Controlled Talking Face Generation

Feng, G., Cheng, H., Li, Y., Ma, Z., Li, C., Qian, Z., Miao, Q., & Pun, C. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3651074 · Cited by 6

Spotting words in silent speech videos: a retrieval-based approach

Jha, A., Namboodiri, V. P., & Jawahar, C. V. (2019) · Machine Vision and Applications · doi:10.1007/s00138-019-01006-y · Cited by 6

Talking Faces: Audio-to-Video Face Generation

Wang, Y., Song, L., Wu, W., Qian, C., He, R., & Loy, C. C. (2022) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-030-87664-7_8 · Cited by 6

Audio-Visual Activity Guided Cross-Modal Identity Association for Active Speaker Detection

Sharma, R. A., & Narayanan, S. S. (2023) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2023.3267269 · Cited by 6

Multimodal Transformer Distillation for Audio-Visual Synchronization

Chen, X., Wu, H., Wang, C.-C., Lee, H.-Y., & Jang, J. R. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446372 · Cited by 6

LSTM‐based japanese speaker identification using an omnidirectional camera and voice information

Nakamura, E., Kageyama, Y., & Hirose, S. (2022) · IEEJ Transactions on Electrical and Electronic Engineering · doi:10.1002/tee.23555 · Cited by 6

MODEFORMER: Modality-Preserving Embedding For Audio-Video Synchronization Using Transformers

Gupta, A., Tripathi, R., & Jang, W. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097209 · Cited by 6

Cross-Domain First Person Audio-Visual Action Recognition through Relative Norm AlignmentPreprint

Planamente, M., Plizzari, C., Alberti, E., & Barbara Caputo, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.01689 · Cited by 12

Data-Driven Advancements in Lip Motion Analysis: A Review

Torrie, S. A., Sumsion, A. W., Lee, D.-J., & Sun, Z. (2023) · Electronics · doi:10.3390/electronics12224698 · Cited by 6

Scaling Multilingual Visual Speech Recognition

Prajwal, K. R., Hegde, S. B., & Zisserman, A. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890395 · Cited by 5

Intelligent recognition of visual speech based on custom CNN and Optimized Quaternion Charlier Moments using PSO

Ogri, O. E., El-Mekkaoui, J., Benslimane, M., Hjouji, A., Saidi, A., Ahmad, M., Elmannai, H., & El‐Latif, A. A. A. (2025) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2025.103824 · Cited by 5

HOMA: Towards Generic Human-Object Interaction in Multimodal Driven Human Animation with Weak Conditions

Huang, Z., Zhou, Z., Cao, J., Ma, Y., Chen, Y., Rao, Z., Xu, Z., Wang, H., Lin, Q., Zhou, Y., et al. (2025) · SIGGRAPH Asia Conference Papers · doi:10.1145/3757377.3763861 · Cited by 7

Semantic-aware hyper-space deformable neural radiance fields for facial avatar reconstruction

Jin, K., Gu, X., Wang, Z., Kuang, Z., Wu, Z., Tan, M., & Yu, J. (2024) · Pattern Recognition Letters · doi:10.1016/j.patrec.2024.08.004 · Cited by 5

KMTalk: Speech-Driven 3D Facial Animation with Key Motion Embedding

Xu, Z., Gong, S., Tang, J., Liang, L., Huang, Y., Li, H., & Huang, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72992-8_14 · Cited by 5

Enhancing Real-World Active Speaker Detection With Multi-Modal Extraction Pre-Training

Tao, R., Qian, X., Das, R. K., Gao, X., Wang, J., & Li, H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521791 · Cited by 7

Text-to-Speech With Lip Synchronization Based on Speech-Assisted Text-to-Video Alignment and Masked Unit Prediction

Ahn, Y., Chae, J.-W., & Shin, J. W. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3537949 · Cited by 7

APES: Audiovisual Person Search in Untrimmed Video

Alcázar, J. L., Heilbron, F. C., Mai, L., Perazzi, F., Lee, J., Arbeláez, P., & Ghanem, B. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00188 · Cited by 6

Cross Modal Video Representations for Weakly Supervised Active Speaker Localization

Sharma, R. A., Somandepalli, K., & Narayanan, S. S. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3229975 · Cited by 5

DR2: Disentangled Recurrent Representation Learning for Data-efficient Speech Video Synthesis

Zhang, C., Wang, C., Zhao, Y., Cheng, S., Luo, L., & Guo, X. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00609 · Cited by 6

FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model

Yao, Z., Cheng, X., & Huang, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681238 · Cited by 5

A Survey of Lipreading Methods Based on Deep Learning

HAO, M., MAMUT, M., & Ubul, K. (2020) · International Conference on Image Processing and Machine Vision (IPMV) · doi:10.1145/3421558.3421563 · Cited by 5

SeeHear: Signer Diarisation and a New Dataset

Albanie, S., Varol, G., Momeni, L., Afouras, T., Brown, A., Zhang, C., Coto, E., Camgöz, N. C., Saunders, B., Dutta, A., et al. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414856 · Cited by 5

Automated Lip-Reading Robotic System Based on Convolutional Neural Network and Long Short-Term Memory

Gholipour, A., Taheri, A., & Mohammadzade, H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90525-5_7 · Cited by 5

Autolv: Automatic Lecture Video Generator

Wang, W., Song, Y., & Jha, S. K. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897436 · Cited by 5

Wavsyncswap: End-To-End Portrait-Customized Audio-Driven Talking Face Generation

Bao, W., Chen, L., Zhou, C., Yang, S., & Wu, Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094807 · Cited by 5

Data-driven Communicative Behaviour Generation: A Survey

Oralbayeva, N., Aly, A., Sandygulova, A., & Belpaeme, T. (2023) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3609235 · Cited by 6

Synthesizing Photorealistic Virtual Humans Through Cross-Modal Disentanglement

Ravichandran, S., Texler, O., Dinev, D., & Kang, H. J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00445 · Cited by 5

On the Audio-visual Synchronization for Lip-to-Speech Synthesis

Niu, Z., & Mak, B. K.-W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00721 · Cited by 5

Visual Speech Recognition with Lightweight Psychologically Motivated Gabor Features

Zhang, X., Xu, Y. H., Abel, A. K., Smith, L. S., Watt, R. J., Hussain, A., & Gao, C. (2020) · Entropy · doi:10.3390/e22121367 · Cited by 5

Detection of Audio-Video Synchronization Errors Via Event DetectionPreprint

Ebenezer, J. P., Wu, Y., Wei, H., Sethuraman, S., & Liu, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.10116 · Cited by 5

Look Who's Talking: Active Speaker Detection in the WildPreprint

Kim, Y. J., Heo, H.-S., Choe, S., Chung, S.-W., Kwon, Y., Lee, B., Kwon, Y., & Chung, J. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.07640 · Cited by 5

SingAvatar: High-fidelity Audio-driven Singing Avatar Synthesis

Ma, W., Tang, A., Ling, J., Xue, H., Liao, H., Zhu, Y., & Song, L. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687925 · Cited by 4

FAIR-VID: A Multimodal Pre-Processing Pipeline for Student Application Analysis

Laukaitis, A., Kalibatienė, D., Jodenytė, D., Normantas, K., Jancevičius, J., Jankauskas, M., & Serackis, A. (2025) · Applied Sciences · doi:10.3390/app152413127 · Cited by 6

MCDubber: Multimodal Context-Aware Expressive Video Dubbing

Zhao, Y., Jia, Z., Liu, R., Hu, D., Bao, F., & Gao, G. (2024) · Communications in computer and information science · doi:10.1007/978-981-96-1045-7_14 · Cited by 4

Unsupervised Federated Learning for Face Recognition in Decentralized Environments

Solomon, E. (2025) · International Conference on Information and Computer Technologies (ICICT) · doi:10.1109/icict64582.2025.00022 · Cited by 4

TalkingFlow: Talking Facial Landmark Generation with Multi-Scale Normalizing Flow Network

Liang, S., Zhou, Z., Li, R., Zhang, J., & Bao, H. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747663 · Cited by 4

End to End Lip Synchronization with a Temporal AutoEncoderPreprint

Shalev, Y., & Wolf, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.16224

Learning to lip read words by watching videos

Chung, J. S., & Zisserman, A. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.02.001 · Cited by 97

A Deep Learning Approach to Learn Lip Sync from Audio

Bhuiyan, M. I., Mahato, M., Hassan, M. N., & Rahman, M. H. (2021)

End-to-End Lip Synchronisation.Preprint

Kim, Y. J., Heo, H. S., Chung, S.-W., & Lee, B. (2020) · arXiv (Cornell University)

End-To-End Lip Synchronisation Based on Pattern Classification

Kim, Y. J., Heo, H. S., Chung, S.-W., & Lee, B. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383616 · Cited by 9