Out of Time: Automated Lip Sync in the Wild

Very Deep Convolutional Networks for Large-Scale Image Recognition

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint

Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273

Untitled work

(1981) · Cited by 11,963

Caffe: Convolutional Architecture for Fast Feature Embedding

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077

Two-Stream Convolutional Networks for Action Recognition in Videos

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756

Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences

Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465

Learning a Similarity Metric Discriminatively, with Application to Face Verification

Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335

Speaker Verification using Convolutional Neural NetworksPreprint

Salehghaffari, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.05427 · Cited by 27

DialogueNeRF: towards realistic avatar face-to-face conversation video generation

Yan, Y., Zhou, Z., Wang, Z., Gao, J., & Yang, X. (2024) · Visual Intelligence · doi:10.1007/s44267-024-00057-8 · Cited by 19

Deepfakes in digital media forensics: Generation, AI-based detection and challenges

Bendiab, G., Haiouni, H., Moulas, I., & Shiaeles, S. N. (2024) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2024.103935 · Cited by 24

Predicting Personalized Head Movement From Short Video and Speech Signal

Yi, R., Ye, Z., Sun, Z., Zhang, J., Zhang, G., Wan, P., Bao, H., & Liu, Y. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3207606 · Cited by 19

Rethinking Audio-Visual Synchronization for Active Speaker Detection

Wuerkaixi, A., Zhang, Y., Duan, Z., & Zhang, C. (2022) · Machine learning for signal processing ... · doi:10.1109/mlsp55214.2022.9943352 · Cited by 19

Face-Dubbing++: LIP-Synchronous, Voice Preserving Translation Of Videos

Waibel, A. H., Behr, M., Yaman, D., Eyiokur, F. İ., Nguyen, T. N., Mullov, C., Demirtaş, M. A., Kantarcı, A., Constantin, S., & Ekenel, H. K. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193719 · Cited by 19

Joint Learning of Audio–Visual Saliency Prediction and Sound Source Localization on Multi-face Videos

Qiao, M., Liu, Y., Xu, M., Deng, X., Li, B., Hu, W., & Borji, A. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01950-3 · Cited by 19

AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model

Yeo, J. H., Kim, M., Choi, J., Kim, D. H., & Ro, Y. M. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3352388 · Cited by 22

TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Styles

Ma, Y., Wang, S., Ding, Y., Ma, B., Lv, T., Fan, C., Hu, Z., Deng, Z., & Yu, X. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3581808 · Cited by 29

On Attention Modules for Audio-Visual SynchronizationPreprint

Khosravan, N., Ardeshir, S., & Puri, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06071 · Cited by 19

Hearing and Seeing Abnormality: Self-Supervised Audio-Visual Mutual Learning for Deepfake Detection

Sung, C.-S., Chen, J.-C., & Chen, C. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095247 · Cited by 18

Visualtts: TTS with Accurate Lip-Speech Synchronization for Automatic Voice Over

Lu, J., Şişman, B., Liu, R., Zhang, M., & Li, H. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746421 · Cited by 18

End-to-End Lip-Reading Without Large-Scale Data

Fernandez-Lopez, A., & Sukno, F. M. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3182274 · Cited by 19

Visual-audio correspondence and its effect on video tipping: Evidence from Bilibili vlogs

Li, B., & Zhao, J. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103347 · Cited by 19

An arabic visual speech recognition framework with CNN and vision transformers for lipreading

Baaloul, A., Benblidia, N., Reguieg, F. Z., Bouakkaz, M., & Felouat, H. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18237-5 · Cited by 20

Probabilistic Speech-Driven 3D Facial Motion Synthesis: New Benchmarks, Methods, and Applications

Yang, K., Ranjan, A., Chang, J.-H. R., Vemulapalli, R., & Tuzel, O. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02577 · Cited by 19

MMHead: Towards Fine-grained Multi-modal 3D Facial Animation

Wu, S., Li, Y., Yan, Y., Duan, H., Liu, Z., & Zhai, G. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681366 · Cited by 18

Learning to Cut by Watching Movies

Pardo, A., Heilbron, F. C., Alcázar, J. L., Thabet, A., & Ghanem, B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00678 · Cited by 19

Multimodal Speaker Diarization Using a Pre-Trained Audio-Visual Synchronization Model

Ahmad, R., Zubair, S., Alquhayz, H., & Ditta, A. (2019) · Sensors · doi:10.3390/s19235163 · Cited by 17

On Gaze Deployment to Audio-Visual Cues of Social Interactions

Boccignone, G., Cuculo, V., D’Amelio, A., Grossi, G., & Lanzarotti, R. (2020) · IEEE Access · doi:10.1109/access.2020.3021211 · Cited by 18

Look Who’s Talking: Active Speaker Detection in the Wild

Kim, Y. J., Heo, H.-S., Choe, S., Chung, S.-W., Kwon, Y., Lee, B., Kwon, Y., & Chung, J. S. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-2041 · Cited by 25

Talking Face Generation with Multilingual TTS

Song, H., Woo, S. H., Lee, J., Yang, S., Cho, H., Lee, Y., Choi, D., & Kim, K. W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02074 · Cited by 17

Generation of virtual digital human for customer service industry

Sun, Y., Sun, Z., Wen, Y., Ye, S., Lv, T., Yu, M., Yi, R., Gao, L., & Liu, Y. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.07.018 · Cited by 18

DEEP-HEAR: A Multimodal Subtitle Positioning System Dedicated to Deaf and Hearing-Impaired People

Țapu, R., Mocanu, B., & Zaharia, T. B. (2019) · IEEE Access · doi:10.1109/access.2019.2925806 · Cited by 20

End-to-End Multi-Person Audio/Visual Automatic Speech Recognition

Braga, O., Makino, T., Siohan, O., & Liao, H. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053974 · Cited by 18

Improved Active Speaker Detection based on Optical Flow

Huang, C. X., & Koishida, K. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00483 · Cited by 18

Efficient End-to-End Sentence-Level Lipreading with Temporal Convolutional Networks

Zhang, T., He, L., Li, X., & Feng, G. (2021) · Applied Sciences · doi:10.3390/app11156975 · Cited by 17

Cross-Modal Cognitive Consensus Guided Audio–Visual Segmentation

Shi, Z., Wu, Q., Meng, F., Xu, L., & Li, H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521746 · Cited by 17

Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild

Hegde, S. B., Prajwal, K. R., Mukhopadhyay, R., Namboodiri, V. P., & Jawahar, C. V. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548081 · Cited by 16

CA-Wav2Lip: Coordinate Attention-based Speech To Lip Synthesis In The Wild

Wang, K.-C., Zhang, J., Huang, J., Li, Q. L., Sun, M.-T., Sakai, K., & Ku, W. (2023) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp58114.2023.00018 · Cited by 16

StyleTalk++: A Unified Framework for Controlling the Speaking Styles of Talking Heads

Wang, S., Ma, Y., Ding, Y., Hu, Z., Fan, C., Lv, T., Deng, Z., & Yu, X. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3357808 · Cited by 16

TalkNCE: Improving Active Speaker Detection with Talk-Aware Contrastive Learning

Jung, C., Lee, S., Nam, K.-H., Rho, K., Kim, Y. J., Jang, Y., & Chung, J. S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448124 · Cited by 16

EmoFace: Audio-driven Emotional 3D Face Animation

Liu, C., Lin, Q., Zeng, Z., & Pan, Y. (2024) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr58804.2024.00060 · Cited by 16

A Comprehensive Review of Recent Advances in Deep Neural Networks for Lipreading With Sign Language Recognition

Rathipriya, N., & Maheswari, N. (2024) · IEEE Access · doi:10.1109/access.2024.3463969 · Cited by 23

Audio and visual modality combination in speech processing applications

Potamianos, G., Marcheret, E., Mroueh, Y., Goel, V., Koumbaroulis, A., Vartholomaios, A., & Thermos, S. (2017) · ACM eBooks · doi:10.1145/3015783.3015797 · Cited by 16

Augmentation Adversarial Training for Self-Supervised Speaker Representation Learning

Kang, J., Huh, J., Heo, H. S., & Chung, J. S. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3200915 · Cited by 16

Self-Supervised Music Motion Synchronization Learning for Music-Driven Conducting Motion Generation

Liu, F., Chen, D., Zhou, R.-Z., Yang, S., & Xu, F. (2022) · Journal of Computer Science and Technology · doi:10.1007/s11390-022-2030-z · Cited by 15

Generating Talking Face With Controllable Eye Movements by Disentangled Blinking Feature

Liu, S., & Hao, J. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3199412 · Cited by 16

Parametric Implicit Face Representation for Audio-Driven Facial Reenactment

Huang, R., Lai, P., Qin, Y., & Li, G. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01227 · Cited by 15

Wav2Lip‐HR: Synthesising clear high‐resolution talking head in the wild

Liang, C., Wang, Q., Chen, Y., & Tang, M. (2023) · Computer Animation and Virtual Worlds · doi:10.1002/cav.2226 · Cited by 16

FaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio

Xu, C., Liu, Y., Xing, J., Wang, W., Sun, M., Dan, J., Huang, T., Li, S., Cheng, Z.-Q., Tai, Y. Y., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00129 · Cited by 20

Audio-Synchronized Visual Animation

Zhang, L., Mo, S., Zhang, Y., & Morgado, P. M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72940-9_1 · Cited by 27

Robust One Shot Audio to Video Generation

Kumar, N., Goel, S., Narang, A., & Mujtaba, H. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00393 · Cited by 16

End-to-End Sentence-Level Multi-View Lipreading Architecture with Spatial Attention Module Integrated Multiple CNNs and Cascaded Local Self-Attention-CTC

Jeon, S., & Kim, M. S. (2022) · Sensors · doi:10.3390/s22093597 · Cited by 16

StableFace: Analyzing and Improving Motion Stability for Talking Face Generation

Ling, J., Tan, X., Chen, L., Li, R., Zhang, Y., Zhao, S., & Song, L. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3333552 · Cited by 19

Sonic: Shifting Focus to Global Audio Perception in Portrait Animation

Ji, X., Hu, X., Xu, Z., Zhu, J., Lin, C., He, Q., Zhang, J., Luo, D., Chen, Y., Lin, Q., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00027 · Cited by 21

CALLip: Lipreading using Contrastive and Attribute Learning

Huang, Y., Liang, X.-F., & Fang, C. (2021) · ACM Multimedia · doi:10.1145/3474085.3475420 · Cited by 17

MELDER: The Design and Evaluation of a Real-time Silent Speech Recognizer for Mobile Devices

Pandey, L., & Arif, A. S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642348 · Cited by 15

Speech Enhancement for Multimodal Speaker Diarization System

Ahmad, R., Zubair, S., & Alquhayz, H. (2020) · IEEE Access · doi:10.1109/access.2020.3007312 · Cited by 14

Automated Video Labelling: Identifying Faces by Corroborative Evidence

Brown, A., Coto, E., & Zisserman, A. (2021) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr51284.2021.00019 · Cited by 14

Semi-supervised classification-aware cross-modal deep adversarial data augmentation

Wang, S., Wu, Z., He, G., Wang, S., Sun, H., & Fan, F. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.05.029 · Cited by 14

Emotion Recognition in Speech Using Cross-Modal Transfer in the WildPreprint

Albanie, S., Nagrani, A., Vedaldi, A., & Zisserman, A. (2018) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.1808.05561 · Cited by 17

An optimal 3D convolutional neural network based lipreading method

He, L., Ding, B., Wang, H., & Zhang, T. (2021) · IET Image Processing · doi:10.1049/ipr2.12337 · Cited by 14

Speech4Mesh: Speech-Assisted Monocular 3D Facial Reconstruction for Speech-Driven 3D Facial Animation

He, S., He, H., Yang, S., Wu, X., Xia, P., Yin, B., Liu, C., Dai, L.-R., & Xu, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01305 · Cited by 14

ReliTalk: Relightable Talking Portrait Generation from a Single Video

Qiu, H., Chen, Z., Jiang, Y., Zhou, H., Fan, X., Yang, L., Wu, W., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02007-9 · Cited by 13

AE-NeRF: Audio Enhanced Neural Radiance Field for Few Shot Talking Head Synthesis

Li, D., Zhao, K., Wang, W., Peng, B., Zhang, Y., Dong, J., & Tan, T. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28086 · Cited by 13

Increasing Importance of Joint Analysis of Audio and Video in Computer Vision: A Survey

Shahabaz, A., & Sarkar, S. (2024) · IEEE Access · doi:10.1109/access.2024.3391817 · Cited by 13

Wav2NeRF: Audio-driven realistic talking head generation via wavelet-based NeRF

Shin, A.-H., Lee, J. H., Hwang, J., Kim, Y., & Park, G.-M. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105104 · Cited by 13

Tampered Speaker Inconsistency Detection with Phonetically Aware Audio-visual Features

Korshunov, P., Halstead, M., Castán, D., Graciarena, M., McLaren, M., Burns, B., Lawson, A., & Marcel, S. (2019) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 14

Deep Learning-Based Approach for Arabic Visual Speech Recognition

Ullah, I., Zahid, H., Algarni, F., & Khan, M. A. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2022.019450 · Cited by 14

More than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speech

Hassid, M., Ramanovich, M. T., Shillingford, B., Wang, M., Ye, J., & Remez, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01033 · Cited by 13

Multi-modal cognitive computing

李, 学. (2022) · Scientia Sinica Informationis · doi:10.1360/ssi-2022-0226 · Cited by 14

Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis

Song, L., Wu, W., Fu, C., Loy, C. C., & He, R. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3210002 · Cited by 14

Stochastic Latent Talking Face Generation Toward Emotional Expressions and Head Poses

Sheng, Z., Nie, L., Zhang, M., Chang, X., & Yan, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3311039 · Cited by 16

Watch to Listen Clearly: Visual Speech Enhancement Driven Multi-modality Speech Recognition

Xu, B., Wang, J., Lu, C., & Guo, Y. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093314 · Cited by 13

Lip Reading modeling with Temporal Convolutional Networks for medical support applications

Kastaniotis, D., Tsourounis, D., & Fotopoulos, S. (2020) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei51763.2020.9263634 · Cited by 13

X2Face: A network for controlling face generation by using images, audio, and pose codesPreprint

Wiles, O., Koepke, A. S., & Zisserman, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.10550 · Cited by 13

Speech2Video: Cross-Modal Distillation for Speech to Video Generation

Si, S., Wang, J., Qu, X., Cheng, N., Wei, W., Zhu, X., & Xiao, J. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-1996 · Cited by 12

MI3S: A multimodal large language model assisted quality assessment framework for AI-generated talking heads

Zhou, Y., Zhang, Z., Wu, S., Jia, J., Jiang, Y., Sun, W., Liu, X., Min, X., & Zhai, G. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104321 · Cited by 15

DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embedding

Choi, J., Hong, J. H., & Ro, Y. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00718 · Cited by 20

Generalizing sentence-level lipreading to unseen speakers: a two-stream end-to-end approach

Li, Y., Xue, F., Wu, L. Y., Xie, Y., & Li, S. (2024) · Multimedia Systems · doi:10.1007/s00530-023-01226-3 · Cited by 12

Say Anything with Any Style

Tan, S., Ji, B., Ding, Y., & Pan, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28314 · Cited by 12

One-shot motion talking head generation with audio-driven model

Tang, P., Zhao, H., Meng, W., & Wang, Y. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129344 · Cited by 12

Multimodal Active Speaker Detection and Virtual Cinematography for Video Conferencing

Cutler, R., Mehran, R., Johnson, S., Zhang, C., Kirk, A. G., Whyte, O., & Kowdle, A. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053171 · Cited by 12

Dynamic Subtitles: A Multimodal Video Accessibility Enhancement Dedicated to Deaf and Hearing Impaired Users

Țapu, R., Mocanu, B., & Zaharia, T. B. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00313 · Cited by 15

Expression-tailored talking face generation with adaptive cross-modal weighting

Zeng, D., Zhao, S., Zhang, J., Liu, H., & Li, K. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.025 · Cited by 12

Sound Localization by Self-supervised Time Delay Estimation

Chen, Z., Fouhey, D. F., & Owens, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19809-0_28 · Cited by 12

StyleLipSync: Style-based Personalized Lip-sync Video Generation

Ki, T., & Min, D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02088 · Cited by 12

Give Ear to My Face: Modelling Multimodal Attention to Social Interactions

Boccignone, G., Cuculo, V., D’Amelio, A., Grossi, G., & Lanzarotti, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11012-3_27 · Cited by 12

CN-CELEB: a challenging Chinese speaker recognition datasetPreprint

Fan, Y. B., Kang, J., Li, L., Li, K., Chen, H., Cheng, S., Zhang, P., Zhou, Z., Cai, Y., & Wang, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.01799 · Cited by 12

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head SynthesisPreprint

Guo, Y., Chen, K., Liang, S., Liu, Y., Bao, H., & Zhang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11078 · Cited by 12

FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesis

Wang, M., Wang, Q., Jiang, F., Fan, Y., Zhang, Y., Qi, Y., Zhao, K., & Xu, M. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755217 · Cited by 57

Learning Music-Dance Representations Through Explicit-Implicit Rhythm Synchronization

Yu, J., Pu, J., Cheng, Y., Feng, R., & Shan, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3303690 · Cited by 16

Multilingual video dubbing—a technology review and current challenges

Bigioi, D., & Corcoran, P. (2023) · Frontiers in Signal Processing · doi:10.3389/frsip.2023.1230755 · Cited by 20

Audio-Semantic Enhanced Pose-Driven Talking Head Generation

Liu, M., Li, D., Li, Y., Song, X., & Nie, L. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3414412 · Cited by 11

Learning Adaptive Spatial Coherent Correlations for Speech-Preserving Facial Expression Manipulation

Chen, T., Lin, J., Yang, Z., Qing, C., & Lin, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00694 · Cited by 11

Learn2Talk: 3D Talking Face Learns From 2D Talking Face

Zhuang, Y., Cheng, B., Cheng, Y., Jin, Y., Liu, R., Li, C., Cheng, X., Liao, J., & Lin, J. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3476275 · Cited by 17

Disentangled Speech Embeddings Using Cross-Modal Self-Supervision

Nagrani, A., Chung, J. S., Albanie, S., & Zisserman, A. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054057 · Cited by 13

A Survey of Audio Synthesis and Lip-syncing for Synthetic Video Generation

Kadam, A., Rane, S., Mishra, A., Sahu, S., Singh, S. K., & Pathak, S. (2021) · EAI Endorsed Transactions on Creative Technologies · doi:10.4108/eai.14-4-2021.169187 · Cited by 11

Federated Learning for Privacy Preserving On-Device Speaker Recognition

Woubie, A., & Bäckström, T. (2021) · doi:10.21437/spsc.2021-1 · Cited by 11

Context-Aware Talking-Head Video Editing

Yang, S., Wang, W., Ling, J., Peng, B., Tan, X., & Dong, J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611765 · Cited by 11

On The Role of Visual Cues in Audiovisual Speech Enhancement

Aldeneh, Z., Kumar, A. P., Theobald, B.-J., Marchi, E., Kajarekar, S. S., Naik, D. K., & Abdelaziz, A. H. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414263 · Cited by 11

A multi-purpose audio-visual corpus for multi-modal Persian speech recognition: The Arman-AV dataset

Peymanfard, J., Heydarian, S., Lashini, A., Zeinali, H., Mohammadi, M. R., & Mozayani, N. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121648 · Cited by 11

Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video

Wu, X., Hu, P., Wu, Y., Lyu, X., Cao, Y., Shan, Y., Yang, W., Sun, Z., & Qi, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02026 · Cited by 12

Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation

Yaman, D., Eyiokur, F. İ., Bärmann, L., Aktı, Ş., Ekenel, H. K., & Waibel, A. H. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00607 · Cited by 10

VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior

Sun, X., Zhang, L., Zhu, H., Zhang, P., Zhang, B., Ji, X., Zhou, K., Gao, D., Bo, L., & Cao, X. (2025) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv66043.2025.00071 · Cited by 22

Best of Both Worlds: Multi-Task Audio-Visual Automatic Speech Recognition and Active Speaker Detection

Braga, O., & Siohan, O. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746036 · Cited by 11

Unsupervised learning of style-aware facial animation from real acting performances

Paier, W., Hilsmann, A., & Eisert, P. (2023) · Graphical Models · doi:10.1016/j.gmod.2023.101199 · Cited by 10

LPIPS-AttnWav2Lip: Generic audio-driven lip synchronization for talking head generation in the wild

Chen, Z. H., Wang, X., Xie, L., Yuan, H., & Pan, H. (2023) · Speech Communication · doi:10.1016/j.specom.2023.103028 · Cited by 10

Multi-view visual speech recognition based on multi task learning

Han, H., Kang, S., & Yoo, C. D. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8297030 · Cited by 10

End to End Lip Synchronization with a Temporal AutoEncoderPreprint

Shalev, Y., & Wolf, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.16224

Learning to lip read words by watching videos

Chung, J. S., & Zisserman, A. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.02.001 · Cited by 97

A Deep Learning Approach to Learn Lip Sync from Audio

Bhuiyan, M. I., Mahato, M., Hassan, M. N., & Rahman, M. H. (2021)

End-to-End Lip Synchronisation.Preprint

Kim, Y. J., Heo, H. S., Chung, S.-W., & Lee, B. (2020) · arXiv (Cornell University)

End-To-End Lip Synchronisation Based on Pattern Classification

Kim, Y. J., Heo, H. S., Chung, S.-W., & Lee, B. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383616 · Cited by 9