Multimodal Emotion Recognition using Facial Expression and Hand Gesture Analysis for Safety Applications
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
This paper presents a real-time multimodal emotion recognition system integrating facial expression analysis and hand gesture recognition to detect distress conditions and trigger emergency alerts. Facial emotions are recognized by a pretrained CNN and gestures by contour detection and Convex Hull analysis, with decision-level fusion. The system reports real-time operation with roughly 180–220 ms latency per frame.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“10.1007/s00500-023-09477-y”
Cited work 10.1007/s00500-023-09477-y · retracted 2024-01-04 · notice 10.1007/s00500-023-09477-y · this paper published 2026-04-21
Citations
Cites
1 retracted
Talaat, F. M., Ali, Z. H., Mostafa, R. R., & El-Rashidy, N. M. (2024) · Soft Computing · doi:10.1007/s00500-023-09477-y · Cited by 89
RetractedVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303 · cited 1×
“In July 2010, it will have tracked landmarks, enhanced image data, emotion and AU labels [8].”
Energy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1355 · Cited by 3,684
Challenges in Representation Learning: A Report on Three Machine Learning Contests
Goodfellow, I. J., Erhan, D., Carrier, P. L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-42051-1_16 · Cited by 1,719
Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799905 · Cited by 999
Physiology of the Autonomic Nervous System
McCorry, L. K. (2007) · American Journal of Pharmaceutical Education · doi:10.5688/aj710478 · Cited by 888
Research works printed but not linked: 3
- Barlow, 1993, The Electroencephalogram: Its Patterns and Origins
- 10.5555/3298023.3298188 · doi:10.5555/3298023.3298188
- Wu, Quantized convolutional neural networks for mobile devices, 4820
Metadata
- Authors
- Thota, A., Sri, N. D., Dinesh, K., & Prasannatha, A.
- Affiliations
- Lakireddy Bali Reddy College of Engineering,Department of CSE,AP
- Venue
- 2026 9th International Conference on Trends in Electronics and Informatics (ICOEI)
- Publisher
- IEEE
- Published
- 2026-04-21
- Pages
- 1428-1436
- OpenAlex
- W7163363928
- Cited by
- 0
- References
- 21
- FWCI
- 0.00
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Trends in Electronics and Informatics (ICOEI) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- multimodal emotion recognition, facial expression analysis, hand gesture recognition, distress detection, emergency alerting, decision fusion, real-time emotion recognition, safety monitoring, FER2013, convex hull algorithm, contour detection, assistive systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multimodal Emotion Recognition using Facial Expression and Hand Gesture Analysis for Safety Applications. https://app.cochat.ai/papers/10.1109/icoei68323.2026.11542103
- The paper
- Thota, A., Sri, N. D., Dinesh, K., & Prasannatha, A. (2026). Multimodal Emotion Recognition using Facial Expression and Hand Gesture Analysis for Safety Applications. 2026 9th International Conference on Trends in Electronics and Informatics (ICOEI). https://doi.org/10.1109/icoei68323.2026.11542103
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.