Hybrid LBPH-CNN for Interactive Web Interface-Based Multi-Face Emotion Recognition
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
The foundation of contemporary human-computer interaction is facial expression recognition; yet, it is still difficult to develop algorithms that are accurate and useful for multi-face, real-world situations. In order to achieve robust, multi-face emotion classification, this research introduces a hybrid architecture that combines a proprietary Convolutional Neural Network (CNN) with Local Binary Pattern Histogram (LBPH) texture data. Streamlit is used to deploy the system as an interactive online application that allows users to observe real-time detections, upload photographs, and examine face histograms. The hybrid model outperforms pure LBPH (58.4%) on the FER2013 benchmark with 68.5% test accuracy, and it can compete with deeper CNNs that need a lot more processing power. More significantly, the system achieves nearly flawless predictions on a real-world group shot with four faces: 99.8% for Happy and 86.7% for Neutral. 48x48 greyscale inputs reduce accuracy by 10.2%, according to an ablation study on input resolution, whereas values larger than 96x96 give marginal improvements at high computational expense. The article offers a thorough analysis of LBPH-CNN fusion, contrasts it with cutting-edge techniques, and addresses the trade-offs between learned and hand-crafted features. The source code is completely open-source and can be used as a model for easily accessible and efficient emotion-aware applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Constants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509 · cited 1×
“…FER2013 dataset [20] - 28,709 training images, 3,589 for validation, and 3,589 for testing, rescaled to 96×96 grayscale across seven emotion classes (angry, disgust, fear, happy, neutral, sad, and surprise) which correspond to the six basic emotions of Ekman and Friesen plus a neutral class [21].”
Deep Facial Expression Recognition: A Survey
Li, S., & Deng, W. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2981446 · Cited by 1,753
Challenges in Representation Learning: A Report on Three Machine Learning Contests
Goodfellow, I. J., Erhan, D., Carrier, P. L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-42051-1_16 · Cited by 1,719
Going deeper in facial expression recognition using deep neural networks
Mollahosseini, A., Chan, D., & Mahoor, M. H. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477450 · Cited by 1,086
Liao, J., Lin, Y., Ma, T., He, S., Liu, X., & He, G. (2023) · Sensors · doi:10.3390/s23094204 · Cited by 63
A deep-learning-based facial expression recognition method using textural features
Mukhopadhyay, M., Dey, A., & Kahali, S. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-08005-7 · Cited by 59
Facial Expression Recognition System on SoC FPGA
Vinh, P. T., & Quang Vinh, T. (2019) · 2019 International Symposium on Electrical and Electronics Engineering (ISEE) · doi:10.1109/isee2.2019.8921140 · Cited by 22 · cited 1×
“Vinh and Vinh [12] implemented a dedicated convolution engine on a SoC FPGA and classified FER2013 emotions at 66% accuracy while sustaining 15 fps at 130 MHz.”
Jiang, C.-S., Liu, Z., & She, J. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3303389 · Cited by 18
Hybrid CNNLBP using Facial Emotion Recognition based on Deep Learning Approach
Depuru, S., Vaishnavi, K., Manogna, B., Sri, K. J., Preethi, A. A., & Priyanka, C. (2023) · International Conference on Artificial Intelligence and Smart Energy (ICAIS) · doi:10.1109/icais56108.2023.10073918 · Cited by 10
Haeruddin, H., Herman, H., & Hendri, P. P. (2023) · Jurnal Teknologi Terpadu · doi:10.54914/jtt.v9i1.613 · Cited by 7
Comparative survey analysis of the CNN and LBPH Face Recognition Learning Algorithms
Kittur, D. A., & Tenneti, D. M. (2023) · International Conference on Contemporary Computing · doi:10.1145/3607947.3607978 · Cited by 3
Enhancing Face Emotion Recognition through LBP, SIFT boosted CNN Classification
Reddy, K. G., & Basha, M. M. (2023) · International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT) · doi:10.1109/icaiccit60255.2023.10466117 · Cited by 3
The Memory Efficiency in a Receptionist Robot's Face Recognition System Using LBPH Algorithm
Yudi, E. D., Kunang, Y. N., & Zarkasi, A. (2024) · Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) · doi:10.29207/resti.v8i6.6048 · Cited by 2
Katti, A. G., & Chidananda Murthy, M., V (2025) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v14.i4.pp2734-2740 · Cited by 2
Self-citationDeep Leaning-Based Facial Expression Recognition in FER2013 Database: An in-Vehicle Application
Sahoo, G. K., Ponduru, J., Das, S. K., & Singh, P. (2022) · 2022 IEEE 19th India Council International Conference (INDICON) · doi:10.1109/indicon56171.2022.10040121
Research works printed but not linked: 25
- K Priya, 2025, Multimodal approach to decoding facial expressions using LBPH and deep learning techniques, 2025 International Conference on Intelligent Systems, Security, and Communication (ICISSC), 1
- A G Katti, 2025, A fusion convolution neural network-local binary pattern histogram algorithm for emotion recognition in human, IAES International Journal of Artificial Intelligence (IJ-AI), 14, 2734, 10.11591/ijai.v14.i4.pp2734-2740 · DOI
- K Priya, 2025, Multimodal Approach to Decoding Facial Expressions Using LBPH and Deep Learning Techniques, 2025 International Conference on Intelligent Systems, Security, and Communication (ICISSC), 1
- H I Dino, Facial expression classification based on K-Nearest Neighbors, Journal of Physics: Conference Series, 1530
- P Kumar, 2023, Multimodal emotion recognition using facial expressions and speech: A deep learning approach, Journal of Ambient Intelligence and Humanized Computing, 14, 2345
- H M S Hussain, 2025, The memory efficiency in a receptionist robot's face recognition system using LBPH algorithm, Core.ac.uk
- 2025, Real-time emotion recognition from facial expressions using convolutional neural network with Fer2013 dataset, Amrita Vishwa Vidyapeetham
- F Xue, 2023, Transferable facial expression recognition with vision transformer, IEEE Transactions on Affective Computing, 14, 1156
- Y Zhang, 2023, Contrastive learning for facial expression recognition in the wild, IEEE Transactions on Image Processing, 32, 1234
- P A Baffour, 2024, Feature Extraction by Traditional Machine Learning and Deep Learning for Facial Expression Classification, IJFMR
- M Abdeldayem, Improving Facial Expression Recognition in real-world Environments, IAES International Journal of Artificial Intelligence
- A Deshmukh, 2023, Lightweight convolutional neural networks for facial expression recognition on edge devices, Proc. IEEE/CVF Winter Conf. Applications of Computer Vision (WACV), 2980
- Y Fan, 2023, Efficient emotion recognition from facial expressions with attention-guided knowledge distillation, IEEE Transactions on Multimedia, 25, 4321
- K Wang, 2022, A dual-stream network with LBP and depthwise separable convolutions for real-time facial expression recognition, IEEE Signal Processing Letters, 29, 1565
- R Jain, 2023, An ensemble of lightweight CNNs for facial expression recognition in resource-constrained environments, Journal of Real-Time Image Processing, 20
- M Z Uddin, 2023, Facial expression recognition using hybrid CNN and LBP features with attention mechanism for human-robot interaction, IEEE Transactions on Industrial Informatics, 19, 2980
- T Zhang, 2023, Cross-dataset facial expression recognition via unsupervised domain adaptation with style transfer, IEEE Transactions on Biometrics, Behavior, and Identity Science, 5, 537
- H S Kang, 2024, Real-time facial expression recognition on mobile devices using quantized CNNs and temporal smoothing, IEEE Access, 12, 23456
- P Gupta, 2024, Federated learning for privacy-preserving facial expression recognition in edge networks, Proc. IEEE Int. Conf. Communications (ICC), 1
- L Chen, 2024, Grad-CAM guided explainable facial expression recognition for clinical depression screening, IEEE Journal of Biomedical and Health Informatics, 28, 2890
- S R Dubey, 2023, Multi-scale LBP and lightweight CNN for facial expression recognition in the wild, Pattern Recognition Letters, 168, 89
- A K Tyagi, 2023, Streamlit-based deployment of deep learning models for affective computing: A case study on FER2013, Software Impacts, 18
- M A H Akhand, 2022, Hybrid feature extraction from LBP and CNN for robust facial expression recognition under variable illumination, Journal of King Saud University -Computer and Information Sciences, 34, 5678
- N Otberdout, 2022, Dynamic facial expression recognition using spatiotemporal LBP and residual networks, IEEE Transactions on Image Processing, 31, 4502
- T O Ajayi, 2023, Comparative analysis of Haar cascade, MTCNN, and RetinaFace for real-time face detection in emotion recognition systems, Proc. IEEE AFRICON, 1
Metadata
- Authors
- Katti, A. G., & M V, C. M.
- Affiliations
- Sri Siddhartha Academy of Higher Education (IN)
- Venue
- International Journal of Reconfigurable and Embedded Systems (IJRES)
- Publisher
- Elsevier BV
- Published
- 2026
- Volume
- 15
- Issue
- 3
- Pages
- 859-859
- ISSN
- 2089-4864 (ISSN-L)
- OpenAlex
- W7162434333
- Cited by
- 0
- References
- 10
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by-sa
- Locations
- International Journal of Reconfigurable and Embedded Systems (IJRES) (publishedVersion, cc-by-sa)
- SSRN Electronic Journal (acceptedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- facial expression recognition, local binary pattern histogram, convolutional neural networks, hybrid feature fusion, Streamlit web interface, input resolution, real-time emotion recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.