Combining Residual Networks with LSTMs for Lipreading

Cited by (348)

Items 101–200 of 348

1. SynthVSR: Scaling Up Visual Speech RecognitionWith Synthetic Supervision
   Xubo Liu, Egor Lakomkin, Konstantinos Vougioukas, Pingchuan Ma, Honglie Chen, Ruiming Xie, Morrie Doulaty, Niko Moritz, Jáchym Kolář, Stavros Petridis et al. · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
2. Word Spotting in Silent Lip Videos
   Abhishek Jha, Vinay P. Namboodiri, C. V. Jawahar · 2018 · IEEE Winter Conference on Applications of Computer Vision
3. Lip as biometric and beyond: a survey
   Debbrota Paul Chowdhury, Ritu Kumari, Sambit Bakshi, Manmath Narayan Sahoo, Abhijit Das · 2021 · Multimedia Tools and Applications
4. FATALRead - Fooling visual speech recognition models
   Anup Kumar Gupta, Puneet Gupta, Esa Rahtu · 2021 · Applied Intelligence
5. AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model
   Jeong Hun Yeo, Minsu Kim, Jeongsoo Choi, Dae Hoe Kim, Yong Man Ro · 2024 · IEEE Transactions on Multimedia
6. My Lips Are Concealed: Audio-Visual Speech Enhancement Through Obstructions
   Triantafyllos Afouras, Joon Son Chung, Andrew Zisserman · 2019 · Interspeech (USB)
7. E2E-V2SResNet: Deep residual convolutional neural networks for end-to-end video driven speech synthesis
   Nasir Saleem, Jiechao Gao, Muhammad Irfan, Elena Verdú, Javier Parra Fuente · 2022 · Image and Vision Computing
8. An Efficient Software for Building LIP Reading Models Without Pains
   Dalu Feng, Shuang Yang, Shiguang Shan · 2021 · IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
9. Analyzing lower half facial gestures for lip reading applications: Survey on vision techniques
   Preethi Jayappa Seegehalli, Niranjana Krupa B · 2023 · Computer Vision and Image Understanding
10. Unified Cross-Modal Attention: Robust Audio-Visual Speech Recognition and Beyond
    Jiahong Li, Chenda Li, Yifei Wu, Yanmin Qian · 2024 · IEEE/ACM Transactions on Audio Speech and Language Processing
11. Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERT
    Bowen Shi, Abdelrahman Mohamed, Wei-Ning Hsu · 2022 · Interspeech (USB)
12. Efficient Audio-Visual Speech Enhancement Using Deep U-Net With Early Fusion of Audio and Video Information and RNN Attention Blocks
    Jung-Wook Hwang, Rae‐Hong Park, Hyung‐Min Park · 2021 · IEEE Access
13. Neural Dubber: Dubbing for Videos According to Scripts
    Chenxu Hu, Tian, Qiao, Tingle Li, Yu-Ping Wang, Yuxuan Wang, Hang Zhao · 2021 · arXiv (Cornell University)
14. SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer
    Young-Hu Park, Rae‐Hong Park, Hyung‐Min Park · 2025 · Neurocomputing
15. SpotFast Networks with Memory Augmented Lateral Transformers for Lipreading
    Peratham Wiriyathammabhum · 2020 · Communications in computer and information science
16. Visual Speech Recognition: A Deep Learning Approach
    Navin Kumar Mudaliar, Kavita Hegde, Anand Ramesh, Varsha Patil · 2020 · International Conference on Communication and Electronics Systems (ICCES)
17. Using Deep Convolutional LSTM Networks for Learning Spatiotemporal Features
    Logan Courtney, R.S. Sreenivas · 2020 · Lecture notes in computer science
18. CALLip: Lipreading using Contrastive and Attribute Learning
    Yiyang Huang, Xue-Feng Liang, Chaowei Fang · 2021 · ACM Multimedia
19. Time-Domain Audio-Visual Speech Separation on Low Quality Videos
    Yifei Wu, Chenda Li, Jinfeng Bai, Zhongqin Wu, Yanmin Qian · 2022 · IEEE International Conference on Acoustics Speech and Signal Processing
20. Taxonomic resolution of coral image classification with Convolutional Neural Network
    Badugu Reshma, B. Rahul, Kannanchery Ramanathan Sreenath, Kapil Kumar Joshi, Grinson George · 2022 · Aquatic Ecology
21. Research on Robust Audio-Visual Speech Recognition Algorithms
    Wenfeng Yang, Pengyi Li, Wei Yang, Yuxing Liu, Yulong He, Ovanes Petrosian, Aleksandr Davydenko · 2023 · Mathematics
22. Audiovisual speech recognition based on a deep convolutional neural network
    R Shashidhar, Sudarshan Patilkulkarni, Vinayakumar Ravi, Gururaj H.L., Moez Krichen · 2023 · Data Science and Management
23. MELDER: The Design and Evaluation of a Real-time Silent Speech Recognizer for Mobile Devices
    Laxmi Pandey, Ahmed Sabbir Arif · 2024 · CHI Conference on Human Factors in Computing Systems
24. Multimodal Integration for Large-Vocabulary Audio-Visual Speech Recognition
    Wentao Yu, Steffen Zeiler, Dorothea Kolossa · 2020 · European Signal Processing Conference (EUSIPCO)
25. Alternative Visual Units for an Optimized Phoneme-Based Lipreading System
    Helen L. Bear, Richard Harvey · 2019 · Applied Sciences
26. AV(SE)2: Audio-Visual Squeeze-Excite Speech Enhancement
    Michael L. Iuzzolino, Kazuhito Koishida · 2020 · IEEE International Conference on Acoustics Speech and Signal Processing
27. Attentive Fusion Enhanced Audio-Visual Encoding for Transformer Based Robust Speech Recognition
    Liangfa Wei, Jie Zhang, Junfeng Hou, Li-Rong Dai · 2020 · arXiv (Cornell University)
28. Importance-Aware Information Bottleneck Learning Paradigm for Lip Reading
    Changchong Sheng, Li Liu, Wanxia Deng, Liang Bai, Zhong Liu, Songyang Lao, Gangyao Kuang, Matti Pietikäinen · 2022 · IEEE Transactions on Multimedia
29. Multi-modal Language models in bioacoustics with zero-shot transfer: a case study
    Zhongqi Miao, Benjamin Elizalde, Soham Deshmukh, Justin A. Kitzes, Huaming Wang, Rahul M. Dodhia, Juan Lavista Ferres · 2025 · Scientific Reports
30. Visually Assisted Time-Domain Speech Enhancement
    Elham Ideli, Sharpe Bruce, Ivan V. Bajić, Rodney G. Vaughan · 2019 · IEEE Global Conference on Signal and Information Processing
31. Audio-Visual Speech Enhancement Method Conditioned in the Lip Motion and Speaker-Discriminative Embeddings
    Koichiro Ito, Masaaki Yamamoto, Kenji Nagamatsu · 2021 · IEEE International Conference on Acoustics Speech and Signal Processing
32. Fusing Information Streams in End-to-End Audio-Visual Speech Recognition
    Wentao Yu, Steffen Zeiler, Dorothea Kolossa · 2021 · IEEE International Conference on Acoustics Speech and Signal Processing
33. Deep Learning-Based Approach for Arabic Visual Speech Recognition
    Insaf Ullah, Hira Zahid, Fahad Algarni, Muhammad Asghar Khan · 2021 · Computers, materials & continua/Computers, materials & continua (Print)
34. Watch to Listen Clearly: Visual Speech Enhancement Driven Multi-modality Speech Recognition
    Bo Xu, Jacob Wang, Cheng Lu, Yandong Guo · 2020 · IEEE Winter Conference on Applications of Computer Vision
35. Lip Reading modeling with Temporal Convolutional Networks for medical support applications
    Dimitris Kastaniotis, Dimitrios Tsourounis, Spiros Fotopoulos · 2020 · International Congress on Image and Signal Processing (CISP)
36. New frontiers in artificial intelligence for biodiversity research and conservation with multimodal language models
    Zhongqi Miao, Yuanhan Zhang, Zalan Fabian, Andres Hernandez Celis, Sara Beery, Chunyuan Li, Ziwei Liu, Amrita Gupta, Md Nasir, Wanhua Li et al. · 2025 · Methods in Ecology and Evolution
37. Generalizing sentence-level lipreading to unseen speakers: a two-stream end-to-end approach
    Yu Li, Feng Xue, Lin Yuanbo Wu, Yincen Xie, Shujie Li · 2024 · Multimedia Systems
38. Neuromorphic Lip-Reading with Signed Spiking Gated Recurrent Units
    Manon Dampfhoffer, Thomas Mesquida · 2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
39. FastLR
    Jinglin Liu, Yi Ren, Zhou Zhao, Chen Zhang, Baoxing Huai, Jing Yuan · 2020 · ACM International Conference on Multimedia (ACM MM)
40. Robust Audio-Visual Speech Recognition Based on Hybrid Fusion
    Hong Liu, Wenhao Li, Bing Yang · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
41. Audio-Visual Speech Recognition Using A Two-Step Feature Fusion Strategy
    Hong Liu, Wanlu Xu, Bing Yang · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
42. Self-Supervised Audio-Visual Speech Representations Learning by Multimodal Self-Distillation
    Jingxuan Zhang, Genshun Wan, Zhen-Hua Ling, Jia Pan, Jianqing Gao, Cong Liu · 2023 · IEEE International Conference on Acoustics Speech and Signal Processing
43. The speaker-independent lipreading play-off; a survey of lipreading machines
    Jake Burton, David Frank, Mahdi Saleh, Nassir Navab, Helen L. Bear · 2018 · IEEE International Conference on Image Processing, Applications and Systems (IPAS)
44. Speaker-Independent Visual Speech Recognition with the Inception V3 Model
    Timothy Israel Santos, Andrew K. Abel, Nick Wilson, Yan Xu · 2021 · IEEE Spoken Language Technology Workshop (SLT)
45. Fine-grained talking face generation with video reinterpretation
    Huang, Xin, Wang, Mingjie, Gong, Minglun · 2021 · The Visual Computer
46. LipGen: Viseme-Guided Lip Video Generation for Enhancing Visual Speech Recognition
    Bowen Hao, Dongliang Zhou, Xiaojie Li, Xingyu Zhang, Liang Xie, Jianlong Wu, Erwei Yin · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
47. Boosting Lip Reading with a Multi-View Fusion Network
    Xueyi Zhang, Chengwei Zhang, Jinping Sui, Changchong Sheng, Wanxia Deng, Li Liu · 2022 · IEEE International Conference on Multimedia and Expo (ICME)
48. Robust Audio-Visual ASR with Unified Cross-Modal Attention
    Jiahong Li, Chenda Li, Yifei Wu, Yanmin Qian · 2023 · IEEE International Conference on Acoustics Speech and Signal Processing
49. Part-Based Lipreading for Audio-Visual Speech Recognition
    Ziling Miao, Hong Liu, Bing Yang · 2020 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
50. Audio-Visual Multi-Talker Speech Recognition in a Cocktail Party
    Yifei Wu, Chenda Li, Song Yang, Zhongqin Wu, Yanmin Qian · 2021 · Interspeech (USB)
51. Audiovisual speaker indexing for Web-TV automations
    Nikolaos Vryzas, Lazaros Vrysis, Charalampos A. Dimoulas · 2021 · Expert Systems with Applications
52. Advances and Challenges in Deep Lip Reading
    Marzieh Oghbaie, Arian Sabaghi, Kooshan Hashemifard, Mohammad Kazem Akbari · 2021 · arXiv (Cornell University)
53. Cross-Modal Language Modeling in Multi-Motion-Informed Context for Lip Reading
    Xi Ai, Bin Fang · 2023 · IEEE/ACM Transactions on Audio Speech and Language Processing
54. BRAVEn: Improving Self-supervised pre-training for Visual and Auditory Speech Recognition
    Alexandros Haliassos, Andreas Zinonos, Rodrigo Mira, Stavros Petridis, Maja Pantić · 2024 · IEEE International Conference on Acoustics Speech and Signal Processing
55. Learning Speaker-specific Lip-to-Speech Generation
    Munender Varshney, Ravindra Yadav, Vinay P. Namboodiri, Rajesh Mahanand Hegde · 2022 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
56. Relaxed Attention for Transformer Models
    Timo Lohrenz, Björn Möller, Zhengyang Li, Tim Fingscheidt · 2023 · International Joint Conference on Neural Networks (IJCNN)
57. Lip-Reading with Limited-Data Network
    Adriana Fernandez-Lopez, Federico M. Sukno · 2019 · European Signal Processing Conference (EUSIPCO)
58. Speaker-Dependent Visual Command Recognition in Vehicle Cabin: Methodology and Evaluation
    Denis Ivanko, Dmitry Ryumin, Alexandr Axyonov, Alexey Mihajlovich Kashevnik · 2021 · Lecture notes in computer science
59. AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation
    Rongjie Huang, Huadai Liu, Xize Cheng, Yi Ren, Linjun Li, Zhenhui Ye, Jinzheng He, Lichao Zhang, Jinglin Liu, Xiang Yin et al. · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
60. LIP-READING VIA DEEP NEURAL NETWORKS USING HYBRID VISUAL FEATURES
    Fatemeh Vakhshiteh, Farshad Almasganj, Ahmad Nickabadi · 2018 · Image Analysis & Stereology
61. Transformer-Based Lip-Reading with Regularized Dropout and Relaxed Attention
    Zhengyang Li, Timo Lohrenz, Matthias Dunkelberg, Tim Fingscheidt · 2023 · IEEE Spoken Language Technology Workshop (SLT)
62. Detecting Adversarial Attacks on Audiovisual Speech Recognition
    Pingchuan Ma, Stavros Petridis, Maja Pantić · 2021 · IEEE International Conference on Acoustics Speech and Signal Processing
63. Development of Visual and Audio Speech Recognition Systems Using Deep Neural Networks
    Denis Ivanko, Dmitry Ryumin · 2021 · International Conference on Computer Graphics and Vision (GraphiCon)
64. Design and Evaluation of a Silent Speech-Based Selection Method for Eye-Gaze Pointing
    Laxmi Pandey, Ahmed Sabbir Arif · 2022 · Proceedings of the ACM on Human-Computer Interaction
65. Audio-visual speech recognition based on joint training with audio-visual speech enhancement for robust speech recognition
    Jung-Wook Hwang, Jeongkyun Park, Rae‐Hong Park, Hyung‐Min Park · 2023 · Applied Acoustics
66. Urbanization diminishes net ecosystem productivity by changing the landscape pattern
    Han Chen, Yizhao Wei, Jinhui Jeanne Huang‬‬‬‬ · 2024 · Agricultural and Forest Meteorology
67. Spatiotemporal Feature Enhancement for Lip-Reading: A Survey
    Yinuo Ma, Xiao Na Sun · 2025 · Applied Sciences
68. Spotting Visual Keywords from Temporal Sliding Windows
    Yue Yao, Tianyu Wang, Heming Du, Liang Zheng, Tom Gedeon · 2019 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
69. Lip Reading in Cantonese
    Yewei Xiao, Lianwei Teng, Aosu Zhu, Xuanming Liu, Picheng Tian · 2022 · IEEE Access
70. Audio-Driven Deformation Flow for Effective Lip Reading
    Dalu Feng, Shuang Yang, Shiguang Shan, Xilin Chen · 2022 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
71. Learning Cross-Lingual Visual Speech Representations
    Andreas Zinonos, Alexandros Haliassos, Pingchuan Ma, Stavros Petridis, Maja Pantić · 2023 · IEEE International Conference on Acoustics Speech and Signal Processing
72. Now You’re Speaking My Language: Visual Language Identification
    Triantafyllos Afouras, Joon Son Chung, Andrew Zisserman · 2020 · Interspeech (USB)
73. Lip Reading in Greek words at unconstrained driving scenario
    Dimitris Kastaniotis, Dimitrios Tsourounis, Aristotelis Koureleas, Bojidar Peev, Christos Theoharatos, Spiros Fotopoulos · 2019 · International Conference on Information, Intelligence, Systems & Applications (IISA)
74. Detecting Adversarial Attacks On Audiovisual Speech Recognition
    Ma, Pingchuan, Stavros Petridis, Maja Pantić · 2019 · arXiv (Cornell University)
75. When deep learning deciphers silent video: a survey on automatic deep lip reading
    Marzieh Oghbaie, Arian Sabaghi, Kooshan Hashemifard, Mohammad Akbari · 2025 · Multimedia Tools and Applications
76. Modality-Agnostic Deepfakes Detection
    Yu Cai, Peng Chen, Jiahe Tian, Jin Liu, Jiao Dai, Xi Wang, Shan Jia, Siwei Lyu, Jizhong Han · 2025 · ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec)
77. A Comprehensive Survey of Advancement in Lip Reading Models: Techniques and Future Directions
    Sampada Deshpande, Kalyani Shirsath, Amey Pashte, Pratham Loya, Sandip Shingade, Vijay Sambhe · 2025 · IET Image Processing
78. Multi-modal co-learning for silent speech recognition based on ultrasound tongue images
    Minghao Guo, Jianguo Wei, Ruiteng Zhang, Yu Zhao, Qiang Fang · 2024 · Speech Communication
79. Cross-Attention Fusion of Visual and Geometric Features for Large-Vocabulary Arabic Lipreading
    Samar Daou, Achraf Ben Hamadou, Ahmed Rekik, Abdelaziz Kallel · 2025 · Technologies
80. Cross-language Speech Dependent Lip-synchronization
    Abhishek Jha, Vikram Voleti, Vinay P. Namboodiri, C. V. Jawahar · 2019 · IEEE International Conference on Acoustics Speech and Signal Processing
81. Channel Enhanced Temporal-Shift Module for Efficient Lipreading
    Hao Li, Mutallip Mamut, Nurbiya Yadikar, Yali Zhu, Kurban Ubul · 2021 · Lecture notes in computer science
82. VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection
    Joanna H. Hong, Minsu Kim, Yong Man Ro · 2022 · Lecture notes in computer science
83. RETRACTED ARTICLE: Application of deep learning in Mandarin Chinese lip-reading recognition
    Guangxin Xing, Lingkun Han, Yelong Zheng, Meirong Zhao · 2023 · EURASIP Journal on Wireless Communications and Networking · Retracted
84. Comparing heterogeneous visual gestures for measuring the diversity of visual speech signals
    Helen L. Bear, Richard Harvey · 2018 · Computer Speech & Language
85. Lip Motion Magnification Network for Lip Reading
    Xueyi Zhang, Changchong Sheng, Li Liu · 2021 · International Conference on Big Data and Information Analytics (BigDIA)
86. Resource-Adaptive Deep Learning for Visual Speech Recognition
    Alexandros Koumparoulis, Gerasimos Potamianos, Samuel Thomas, Edmilson Da Silva Morais · 2020 · Interspeech (USB)
87. Contrastive Learning of Global and Local Audio-Visual Representations.
    Shuang Ma, Zhaoyang Zeng, Daniel McDuff, Yale Song · 2021 · arXiv (Cornell University)
88. LRWR: Large-Scale Benchmark for Lip Reading in Russian language
    Evgeniy Egorov, Vasiliy Kostyumov, Mikhail Konyk, Sergey Kolesnikov · 2021 · arXiv (Cornell University)
89. Visual Keyword Spotting with Attention
    K R Prajwal, Liliane Momeni, Triantafyllos Afouras, Andrew Zisserman · 2021 · arXiv (Cornell University)
90. Data-Driven Advancements in Lip Motion Analysis: A Review
    Shad A. Torrie, Andrew W. Sumsion, Dah-Jye Lee, Zheng Sun · 2023 · Electronics
91. Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation
    Minsu Kim, Jeong Hun Yeo, Se Jin Park, Hyeongseop Rha, Yong Man Ro · 2024 · ACM International Conference on Multimedia (ACM MM)
92. Intelligent recognition of visual speech based on custom CNN and Optimized Quaternion Charlier Moments using PSO
    Omar El Ogri, Jaouad El-Mekkaoui, Mohamed Benslimane, Amal Hjouji, Abdelali Saidi, Musheer Ahmad, Hela Elmannai, Ahmed A. Abd El‐Latif · 2025 · Ain Shams Engineering Journal
93. Multi-modal Deep Learning Approach to Improve Sentence level Sinhala Sign Language Recognition
    H. H. S. N. Haputhanthri, H. M. N. Tennakoon, M. A. S. M. Wijesekara, B. H. R. Pushpananda, H. N. D. Thilini · 2023 · International Journal on Advances in ICT for Emerging Regions (ICTer)
94. Collaborative Viseme Subword and End-to-End Modeling for Word-Level Lip Reading
    Hang Chen, Qing Wang, Jun Du, Genshun Wan, Shi-Fu Xiong, Bao-Ci Yin, Jia Pan, Chin‐Hui Lee · 2024 · IEEE Transactions on Multimedia
95. Visual speech recognition using compact hypercomplex neural networks
    Iason-Ioannis Panagos, Giorgos Sfikas, Christophoros Nikou · 2024 · Pattern Recognition Letters
96. Lip Reading Bengali Words
    Md. Masudur Rahman, Md Rashad Tanjim, Saraf Sumaita Hasan, Sayeed Md. Shaiban, Mohammad Ashrafuzzaman Khan · 2022 · International Conference on Algorithms, Computing and Artificial Intelligence (ACAI)
97. Target speaker lipreading by audio–visual self-distillation pretraining and speaker adaptation
    Jing-Xuan Zhang, Tingzhi Mao, Longjiang Guo, Jin Li, Lichen Zhang · 2025 · Expert Systems with Applications
98. Speech Recognition Using Historian Multimodal Approach
    Eslam E. El Maghraby, Amr M. Gody, Mohamed Hesham Farouk · 2019 · The Egyptian Journal of Language Engineering /The Egyptian Journal of Language Engineering
99. A Survey of Lipreading Methods Based on Deep Learning
    MINGFENG HAO, MUTELEP MAMUT, Kurban Ubul · 2020 · International Conference on Image Processing and Machine Vision (IPMV)
100. Toward Language-independent Lip Reading: A Transfer Learning Approach
     Andrei - Cosmin Jitaru, Liviu–Daniel Stefan, Bogdan Emanuel Ionescu · 2021 · International Symposium on Signals, Circuits and Systems