Combining Residual Networks with LSTMs for Lipreading

Cited by (348)

Items 201–300 of 348

1. Speaker-Independent Audio-Visual Speech Separation Based on Transformer in Multi-Talker Environments
   Jing Wang, Yiyu Luo, Weiming Yi, Xiang Xie · 2022 · IEICE Transactions on Information and Systems
2. Reliability-Based Large-Vocabulary Audio-Visual Speech Recognition
   Wentao Yu, Steffen Zeiler, Dorothea Kolossa · 2022 · Sensors
3. Visual Speech Recognition with Lightweight Psychologically Motivated Gabor Features
   Xuejie Zhang, Yan Hui Xu, Andrew K. Abel, Leslie S. Smith, Roger J. Watt, Amir Hussain, Chengxiang Gao · 2020 · Entropy
4. MobiVSR: A Visual Speech Recognition Solution for Mobile Devices
   Nilay Shrivastava, Saxena, Astitwa, Yaman Kumar, Rajiv Ratn Shah, Debanjan Mahata, Amanda J. Stent · 2019 · arXiv (Cornell University)
5. Towards Practical Lipreading with Distilled and Efficient Models
   Ma, Pingchuan, Brais Martínez, Stavros Petridis, Maja Pantić · 2020 · arXiv (Cornell University)
6. Contrastive Learning of Global-Local Video Representations
   Shuang Ma, Zhaoyang Zeng, Daniel McDuff, Yale Song · 2021 · arXiv (Cornell University)
7. Cross-language lipreading by reconstructing Spatio-Temporal relations in 3D convolution
   Jiangfan Feng, Renhua Long · 2022 · Displays
8. Lip Reading Using Temporal Adaptive Module
   Jian Huang, Lianwei Teng, Yewei Xiao, Aosu Zhu, Xuanming Liu · 2023 · Communications in computer and information science
9. Visual speech recognition using attention-enhanced ResNet and hybrid recurrent-transformer encoder with quantity-ratio curriculum learning for low-resource languages
   Griffani Megiyanto Rahmatullah, Shanq-Jang Ruan, Lieber Po‐Hung Li · 2025 · Neurocomputing
10. Chinese Mandarin Lipreading using Cascaded Transformers with Multiple Intermediate Representations
    Xinghua Ma, Shilin Wang · 2022 · Proceedings - International Conference on Image Processing
11. On‐device audio‐visual multi‐person wake word spotting
    Yidi Li, Guoquan Wang, Zhan Chen, Hao Tang, Hong Liu · 2023 · CAAI Transactions on Intelligence Technology
12. IMPROVED AUTOMATIC LIP-READING BASED ON THE EVALUATION OF INTENSITY LEVEL OF SPEAKER’S EMOTION
    Denis Ivanko, Елена Витальевна Рюмина, Dmitry Ryumin · 2023 · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences
13. EMOLIPS: Towards Reliable Emotional Speech Lip-Reading
    Dmitry Ryumin, Елена Витальевна Рюмина, Denis Ivanko · 2023 · Mathematics
14. The Collaboration of 3D Convolutions and CRO-TSM in Lipreading
    Yangzhao Xiang, Mutellip Mamut, Nurbiya Yadikar, Ghalipjan Ibrahim, Kurban Ubul · 2024 · IEEE International Conference on Acoustics Speech and Signal Processing
15. Sla-former: conformer using shifted linear attention for audio-visual speech recognition
    Yewei Xiao, Jian Huang, Xuanming Liu, Aosu Zhu · 2024 · Complex & Intelligent Systems
16. Speaker Embedding Informed Audiovisual Active Speaker Detection for Egocentric Recordings
    Jason Clarke, Yoshihiko Gotoh, Stefan Goetze · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
17. Spectrum-guided Spatial Feature Enhancement Network for event-based lip-reading
    Yi Zhang, Xiuping Liu, Hongchen Tan, Xin Shane Li · 2025 · Neurocomputing
18. Deep Weighted Feature Descriptors for Lip Reading of Kannada Language
    M. S. Nandini, Trisiladevi C. Nagavi, Nagappa U. Bhajantri · 2019 · International Conference on Signal Processing and Integrated Networks (SPIN)
19. Learning the Relative Dynamic Features for Word-Level Lipreading
    Hao Li, Nurbiya Yadikar, Yali Zhu, Mutallip Mamut, Kurban Ubul · 2022 · Sensors
20. Derin Öğrenme ile Dudak Okuma Üzerine Detaylı Bir Araştırma
    Ali Erbey, Necaattin Barışçı · 2022 · Uluslararası mühendislik araştırma ve geliştirme dergisi
21. End-to-End Chinese Lip-Reading Recognition Based on Multi-modal Fusion
    Yixian Liu, Chuoya Lin, Mingchen Wang, Simin Liang, Zhuohui Chen, Ling Chen · 2022 · IEEE International Conference on Frontiers Technology of Information and Computer (ICFTIC)
22. Addressee Detection Using Facial and Audio Features in Mixed Human–Human and Human–Robot Settings: A Deep Learning Framework
    Fiseha B. Tesema, Jason J. Gu, Wei Song, Hong Qi Wu, Shiqiang Zhu, Zheyuan Lin, Min Huang, Wen Wang, Rajesh Kumar · 2023 · IEEE Systems Man and Cybernetics Magazine
23. Active Speaker Detection Using Audio, Visual, and Depth Modalities: A Survey
    Siti Nur Aisyah Binti Mohd Robi, Muhammad Atiff Zakwan Bin Mohd Ariffin, Mohd Azri Mohd Izhar, Norulhusna Binti Ahmad, Hazilah Mad Kaidi · 2024 · IEEE Access
24. Construction of word level Tibetan Lip Reading Dataset
    Zhenye Gan, Hao Zeng, Hongwu Yang, Shihua Zhou · 2020 · International Conference on Information Communication and Signal Processing (ICICSP)
25. Lip Motion Recognition for Indonesian Vowel Phonemes Using 3D Convolutional Neural Networks
    Maxalmina, Maxalmina Satria Kahfi, Kurniawan Nur Ramadhani, Anditya Arifianto · 2020 · International Conference of Computer and Informatics Engineering (IC2IE)
26. Large-vocabulary Audio-visual Speech Recognition in Noisy Environments
    Wentao Yu, Steffen Zeiler, Dorothea Kolossa · 2021 · IEEE International Workshop on Multimedia Signal Processing (MMSP)
27. End-to-end Visual Speech Recognition for Human-Robot Interaction
    Denis Ivanko, Dmitry Ryumin, Maxim Markitantov · 2022
28. Lip Reading Using Deformable 3D Convolution and Channel-Temporal Attention
    Chen Peng, Jun Li, Jie Chai, Zhong‐Qiu Zhao, Housen Zhang, Weidong Tian · 2022 · Lecture notes in computer science
29. 3D Feature Pyramid Attention Module for Robust Visual Speech Recognition
    Jingyun Xiao · 2018 · arXiv (Cornell University)
30. Learning from Videos with Deep Convolutional LSTM Networks
    Logan Courtney, R.S. Sreenivas · 2019 · arXiv (Cornell University)
31. Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention
    Chen, Hang, Jun Du, Yu Hen Hu, Li-Rong Dai, Chin‐Hui Lee, Baocai Yin · 2020 · arXiv (Cornell University)
32. End-to-end Audio-visual Speech Recognition with Conformers
    Ma, Pingchuan, Stavros Petridis, Maja Pantić · 2021 · arXiv (Cornell University)
33. New frontiers in AI for biodiversity research and conservation with multimodal language models
    Zhongqi Miao, Yuanhan Zhang, Zalan Fabian, Andres Hernandez Celis, Sara Beery, Chunyuan Li, Ziwei Liu, Amrita Gupta, Md Nasir, W. Li et al. · 2024
34. A multistream attention based neural network for visual speech recognition and sign language understanding
    Fatma M. Talaat, Basma Mohammed Hassan · 2025 · Scientific Reports
35. Improving Audiovisual Active Speaker Detection in Egocentric Recordings with the Data-Efficient Image Transformer
    Jason Clarke, Yoshihiko Gotoh, Stefan Goetze · 2023 · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
36. Large-Scale Unsupervised Audio Pre-Training for Video-to-Speech Synthesis
    Triantafyllos Kefalas, Yannis Panagakis, Maja Pantić · 2024 · IEEE/ACM Transactions on Audio Speech and Language Processing
37. Cantonese sentence dataset for lip‐reading
    Yewei Xiao, Xuanming Liu, Lianwei Teng, Aosu Zhu, Picheng Tian, Jian Huang · 2024 · IET Image Processing
38. Arabic Lip Reading With Limited Data Using Deep Learning
    Zamen Jabr, Sauleh Eetemadi, Nasser Mozayani · 2024 · IEEE Access
39. GSLip: A Global Lip-Reading Framework with Solid Dilated Convolutions
    Junxia Jiang, Zhong‐Qiu Zhao, Yi Yang, Weidong Tian · 2024 · International Joint Conference on Neural Networks (IJCNN)
40. New insights on the role of auxiliary information in target speaker extraction
    Mohamed Elminshawi, Wolfgang Mack, Srikanth Raj Chetupalli, Soumitro Chakrabarty, Emanuël A. P. Habets · 2024 · Frontiers in Signal Processing
41. Hybrid Multidimensional Deep Convolutional Neural Network for Multimodal Fusion
    Olena А. Vynokurova, Dmytro Peleshko · 2020 · IEEE International Conference on Data Stream Mining & Processing (DSMP)
42. Hybrid Deep Convolutional Neural Network with Multimodal Fusion
    Olena А. Vynokurova, Dmytro Peleshko, Marta Peleshko · 2020 · Communications in computer and information science
43. Modern automatic recognition technologies for visual communication tools
    V. O. Yachnaya, Vadim R. Lutsiv, Roman Olegovich Malashin · 2023 · Computer Optics
44. Efficient Audiovisual Fusion for Active Speaker Detection
    Fiseha B. Tesema, Jason J. Gu, Wei Song, Hong Bing Wu, Shiqiang Zhu, Zheyuan Lin · 2023 · IEEE Access
45. Deep Visual Forced Alignment: Learning to Align Transcription with Talking Face Video
    Minsu Kim, Chae Won Kim, Yong Man Ro · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence
46. ALIGNVSR: AUDIO-VISUAL CROSS-MODAL ALIGNMENT FOR VISUAL SPEECH RECOGNITION
    Zehua Liu, Xiaolou Li, Chen Chen, Li Guo, Lantian Li, Dong Wang · 2025 · International Conference on Communication and Information Processing (ICCIP)
47. Audio-Visual Predictive Coding for Self-Supervised Visual Representation Learning
    Mani Kumar Tellamekala, Michel Valstar, Michael P. Pound, Timo Giesbrecht · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
48. Text Caption Generation Based on Lip Movement of Speaker in Video Using Neural Network
    Dipti Pawade, Avani M.Sakhapara, Chaitya Shah, Jigar Wala, Ankitmani Tripathi, Bhavikk Shah · 2019 · Communications in computer and information science
49. Visual Speech Recognition in Natural Scenes Based on Spatial Transformer Networks
    Jin Yu, Shilin Wang · 2020 · IEEE International Conference on Anti-counterfeiting, Security, and Identification (ASID)
50. Tibetan lip reading based on D3D
    Zhenye Gan, Xinke Yu, Hao Zeng, Tianqin Zhao · 2021 · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE)
51. Practice of the Conformer Enhanced Audio-Visual Hubert on Mandarin and English
    Xiaoming Ren, Chao Li, Shenjian Wang, Biao Li · 2023 · IEEE International Conference on Acoustics Speech and Signal Processing
52. On the Importance of Video Action Recognition for Visual Lipreading
    Xinshuo Weng · 2019 · arXiv (Cornell University)
53. A Novel Sentence‐Level Visual Speech Recognition System for Vietnamese Language Using ResNet3D and Zipformer
    Phat Nguyen Huu, Thach Ho Sy · 2025 · Modelling and Simulation in Engineering
54. Dual-Stream Former: A Dual-Branch Transformer Architecture for Visual Speech Recognition
    Sanghun Jeon, Jieun Lee, Yong‐Ju Lee · 2025 · AI
55. Interpreting the Role of Visemes in Audio-Visual Speech Recognition
    Aristeidis Papadopoulos, Naomi Harte · 2025 · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
56. Developing a Lightweight Model for Lip-reading
    I Wayan Wiprayoga Wisesa, Shanq-Jang Ruan · 2023 · IEEE International Conference on Consumer Electronics - Taiwan (ICCE-Taiwan)
57. Improving Visual Speech Recognition for Small-Scale Datasets via Speaker Embedding
    Jinghan Wu, Yakun Zhang, Xingyu Zhang, Changyan Zheng, Yan Ye, Erwei Yin · 2023 · International Conference on Software Engineering and Computer Science (CSECS)
58. Toward Micro Lip Reading in the Wild: Dataset, Theory, and Practices
    Ran Wang, Yingsong Cheng, Anqi Cao, Shengtao Zhong, Xiang Liao, Yanjiu He, Han Ye, Chutian Sun, Qinlao Zhao, Min Du et al. · 2025 · IEEE Transactions on Automation Science and Engineering
59. Recognizing Indonesian words based on visual cues of lip movement using deep learning
    Griffani Megiyanto Rahmatullah, Shanq-Jang Ruan, Lieber Po‐Hung Li · 2025 · Measurement
60. AV-CPL: Continuous Pseudo-labeling for Audio-Visual Speech Recognition
    Andrew Rouditchenko, Ronan Collobert, T. Likhomanenko · 2025 · Lecture notes in computer science
61. Semi-Supervised Learning for Multimodal Speech and Emotion Recognition
    Yuanchao Li · 2021 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
62. Unsupervised domain adaptation for lip reading based on cross-modal knowledge distillation
    Yuki Takashima, Ryoichi Takashima, Ryota Tsunoda, Ryo Aihara, Tetsuya Takiguchi, Yasuo Ariki, Nobuaki Motoyama · 2021 · EURASIP Journal on Audio Speech and Music Processing
63. Noise robust speech recognition system using multimodal audio-visual approach using different deep learning classification techniques
    Eslam E. El Maghraby, Amr M. Gody · 2020 · International Journal of Advanced Computer Research
64. Speech Guided Disentangled Visual Representation Learning for Lip Reading
    Ya Zhao, Cheng Ma, Zunlei Feng, Mingli Song · 2021 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
65. Siamese decoupling network for speaker-independent lipreading
    Longbin Lu, Xuebin Xu, Jun Fu · 2022 · Journal of Electronic Imaging
66. "Notic My Speech" -- Blending Speech Patterns With Multimedia
    Dhruva Sahrawat, Yaman Kumar, Shashwat Aggarwal, Yifang Yin, Rajiv Ratn Shah, Roger Zimmermann · 2020 · arXiv (Cornell University)
67. FastLR: Non-Autoregressive Lipreading Model with Integrate-and-Fire
    Jinglin Liu, Yi Cheng Ren, Zhou Zhao, Chen Zhang, Baoxing Huai, Nicholas Jing Yuan · 2020 · arXiv (Cornell University)
68. Disentangling Homophemes in Lip Reading using Perplexity Analysis
    Souheil Fenghour, Daqing Chen, Kun Guo, Perry Xiao · 2020 · arXiv (Cornell University)
69. Integration of Audio video Speech Recognition using LSTM and Feed Forward Convolutional Neural Network
    R Shashidhar, Sudarshan Patil Kulkarni · 2021 · Research Square
70. Fusing information streams in end-to-end audio-visual speech recognition
    Wentao Yu, Steffen Zeiler, Dorothea Kolossa · 2021 · arXiv (Cornell University)
71. Lips Reading Using 3D Convolution and LSTM
    Rohan Inamdar, S. Kavin Sundarr, Deepen Khandelwal, K. B. Ajeyprasaath · 2023 · Preprints.org
72. Phoneme-based lipreading of silent sentences
    Menghan Deng, Shengwu Xiong · 2022 · Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC)
73. Speaker Adaptation for Lip Reading with Robust Entropy Minimization and Adaptive Pseudo Labels
    Hao Shen, Weihao Jiang, Junjie Huang · 2024 · International Conference on Computing, Machine Learning, and Data Science (CMLDS)
74. Training Strategies for Modality Dropout Resilient Multi-Modal Target Speaker Extraction
    Srikanth Korse, Mohamed Elminshawi, Emanuël A. P. Habets, Srikanth Raj Chetupalli · 2024 · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)
75. Lip-Reading Classification of Turkish Digits Using Ensemble Learning Architecture Based on 3DCNN
    Ali Erbey, Necaattin Barışçı · 2025 · Applied Sciences
76. LipMVCL:Lipreading Based on Multi-view and Collaborative Learning
    Junyu Li, Yu Li, Shujie Li, Feng Xue · 2025 · Lecture notes in computer science
77. Advanced Lip-Reading Techniques: Leveraging ST-CNN-BiGRU and CTC-Greedy Decoding for Improved Text Transcription
    A. Kavya Varshini, C. Jayaashri, S. Padmini · 2025 · Lecture notes in networks and systems
78. TD3Net: A temporal densely connected multi-dilated convolutional network for lipreading
    Byung Hoon Lee, Wooseok Shin, Sung Won Han · 2025 · Journal of Visual Communication and Image Representation
79. LipMSTA: Multi-scale Spatio-Temporal Attention for Lip-Reading
    Furen Bai, Wenjuan Li, Minfeng Lu, Qifei Zhang · 2025 · Lecture notes in computer science
80. Evaluating Lip-Reading Approaches: Comparative Study of Recent Techniques
    Hiba Gamal, Dina Elsayad, Safaa El-Sayed Amin, Hala M. Ebied · 2025 · International Conference on Machine Intelligence and Smart Innovation (ICMISI)
81. Visual-Informed Speech Enhancement Using Attention-Based Beamforming
    Chihyun Liu, Jiaxuan Fan, Mingtung Sun, Michael Anthony, Mingsian R. Bai, Yu Tsao · 2025 · IEEE Transactions on Audio Speech and Language Processing
82. FDCNet: Frequency Domain Channel Attention and Convolution for Lipreading
    Qianxi Yan, Q H Zhang, Lei Zhang, Linkun Yu, Lei Sheng · 2026 · IEEE International Conference on Acoustics Speech and Signal Processing
83. LipSense: Empowering the Visually Challenged Students with Lipreading Technology
    Vishnu Sandeep Turumella, Anoop S. Babu, M S Sumi Suresh · 2026 · Procedia Computer Science
84. Generating Audio from Lip Movements Visual Input: A Survey
    Krishna Suresh, G. Gopakumar, Subhasri Duttagupta · 2021 · Advances in intelligent systems and computing
85. BenAV: a Bengali Audio-Visual Corpus for Visual Speech Recognition
    Ashish Pondit, Muhammad Eshaque Ali Rukon, Anik Das, Muhammad Ashad Kabir · 2021 · Lecture notes in computer science
86. Audio-visual multimodal speech recognition method fusing audio and video data
    Jian Ming Zhao, Zhiwei Zhang, Yuqing Cui, Wenqian Qiang, WeiQiang Dai, ZheJun Kuang, Lijuan Shi · 2022 · International Conference on Digital Signal and Computer Communications (DSCC)
87. Exploiting Deep Learning for Sentence-Level Lipreading
    Isabella Wu, Xin Wang · 2023 · International Joint Conference on Neural Networks (IJCNN)
88. End-to-End Lip Reading in Romanian with Cross-Lingual Domain Adaptation and Lateral Inhibition
    Emilian-Claudiu Mănescu, Răzvan-Alexandru Smădu, Andrei-Marius Avram, Dumitru-Clementin Cercel, Florin Pop · 2023 · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT)
89. Cycle-Consistent Generative Adversarial Network Architectures for Audio Visual Speech Recognition
    Yibo He, Kah Phooi Seng, Li-Minn Ang, Xingyu Zhao · 2023 · IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC)
90. An End-to-End Mandarin Audio-Visual Speech Recognition Model with a Feature Enhancement Module
    Jinxin Wang, Chao Yang, Zhongwen Guo, Xiaomei Li, Weigang Wang · 2023 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
91. End-to-end visual speech recognition for human-robot interaction
    Denis Ivanko, Dmitry Ryumin, Maxim Markitantov · 2024 · AIP conference proceedings
92. CMFF-Face: Attention-Based Cross-Modal Feature Fusion for High-Quality Audio-Driven Talking Face Generation
    Guangzhe Zhao, Yanan Liu, Xueping Wang, Feihu Yan · 2024 · International Conference on Multimedia Retrieval
93. Lipreading using Joint Preception Temporal Convolutional Network
    Xihui Li, Zhenhua Tan, Ziwei Cheng, Xiaoer Wu · 2023 · International Conference on Mobility, Sensing and Networking (MSN)
94. Deep Learning Based Lipreading Assistant
    Sameer Somkuwar, Amey Rathi, Somesh Todankar, Rajendra Yelalwar · 2024 · OPJU International Technology Conference on Smart Computing for Innovation and Advancement in Industry (OTCON)
95. Robust Audiovisual Liveness Detection for Biometric Authentication Using Deep Joint Embedding and Dynamic Time Warping
    Amit Aides, David Dov, Hagai Aronowitz · 2018 · IEEE International Conference on Acoustics Speech and Signal Processing
96. Deep Audio-visual System for Closed-set Word-level Speech Recognition
    Yougen Yuan, Wei Tang, Minhao Fan, Yue Cao, Peng Zhang, Lei Xie · 2019 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
97. Analisis Pembacaan Gerakan Bibir Menggunakan Gabungan Arsitektur Convolutional Neural Network dan Recurrent Neural Network
    Akwila Feliciano Pradiptatmaka, Nanik Suciati, Dini Adni Navastara · 2021 · Jurnal Teknik ITS
98. LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild
    Shuang Yang, Yuanhang Zhang, Dalu Feng, Mingmin Yang, Chenhao Wang, Jingyun Xiao, Long, Keyu, Shiguang Shan, Xilin Chen · 2018 · arXiv (Cornell University)
99. Read and Attend: Temporal Localisation in Sign Language Videos
    Gül Varol, Liliane Momeni, Samuel Albanie, Triantafyllos Afouras, Andrew Zisserman · 2021 · arXiv (Cornell University)
100. Selective Hearing through Lip-reading
     Zexu Pan, Ruijie Tao, Chenglin Xu, Haizhou Li · 2021 · arXiv (Cornell University)