Multimodal emotion recognition model via hybrid model with improved feature level fusion on facial and EEG feature set
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
This paper presents a multimodal emotion-recognition model using facial and EEG feature sets with improved feature-level fusion and a hybrid deep model. It targets better joint representation learning for emotion classification.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
International Journal of Innovative Research in Science, Engineering and Technology
(2014) · International Journal of Innovative Research in Science Engineering and Technology · doi:10.15680/ijirset · Cited by 1,090
CTNet: Conversational Transformer Network for Emotion Recognition
Lian, Z., Liu, B., & Tao, J. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3049898 · Cited by 296
Zhang, X., Liu, J., Shen, J., Li, S., Hou, K., Hu, B., Gao, J., Zhang, T., & Hu, B. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2987575 · Cited by 206
Cross-Subject Multimodal Emotion Recognition Based on Hybrid Fusion
Cimtay, Y., Ekmekcioglu, E., & Caglar-Ozhan, S. (2020) · IEEE Access · doi:10.1109/access.2020.3023871 · Cited by 200
European signal processing conference
Jain, V. (1980) · IEEE Acoustics, Speech, and Signal Processing Newsletter · doi:10.1109/msp.1980.237652 · Cited by 189
Emotion Recognition from Multimodal Physiological Signals for Emotion Aware Healthcare Systems
Ayata, D., Yaslan, Y., & Kamasak, M. E. (2020) · Journal of Medical and Biological Engineering · doi:10.1007/s40846-019-00505-7 · Cited by 182 · cited 1×
“Because this strategy approaches the classification problem by extracting features from each modality independently, it cannot learn patterns that exist across several data modalities [14].”
Classification of Image using Convolutional Neural Network (CNN)
Hossain, M. A., & Sajib, M. S. A. (2019) · Global Journal of Computer Science and Technology · doi:10.34257/gjcstdvol19is2pg13 · Cited by 160
Multimodal Emotion Recognition With Transformer-Based Self Supervised Feature Fusion
Siriwardhana, S., Kaluarachchi, T., Billinghurst, M., & Nanayakkara, S. (2020) · IEEE Access · doi:10.1109/access.2020.3026823 · Cited by 158
A multimodal hierarchical approach to speech emotion recognition from audio and text
Singh, P., Srivastava, R., Rana, K. P. S., & Kumar, V. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107316 · Cited by 131
Self-citationExpression-EEG Based Collaborative Multimodal Emotion Recognition Using Deep AutoEncoder
Zhang, H. (2020) · IEEE Access · doi:10.1109/access.2020.3021994 · Cited by 122
Research works printed but not linked: 5
- Aggarwal K, Mijwil MM, Al-Mistarehi AH, Alomari S, Gök M, Alaabdin AMZ, Abdulrhman SH (2022) Has the future started? The current growth of artificial intelligence, machine learning, and deep learning. Iraqi J Comput Sci Math 3(1):115–123
- Cimtay Y, Ekmekcioglu E, Caglar-Ozhan S (2020) Cross-subject multimodal emotion recognition based on hybrid fusion. IEEE Access 8:168865–168878. https://doi.org/10.1109/ACCESS.2020.3023871 · DOI · Paper page
- Guo H, Gao Z (2023) Multimodal sentiment recognition based on Bi-LSTM and fusion mechanism. Acad J Comput Inf Sci 6(6):127–132
- Ahad AR, Paul T, Shammi UA, Shammi UA (2018) A study on face detection using Viola-Jones algorithm for various backgrounds, angels and distances. IJBSCHS 23:27–36
- Duzenli T, Ozkurt N (2011) Comparison of wavelet-based feature extraction methods for speech/music discrimination. IU-JEEE 11:1355–1362
Cited by
Hybrid Fusion Paradigm in Advanced Process Monitoring: A Panoramic Review and Future Perspectives
Ali, H., Safdar, R., Liu, J., Manan, T. S. B. A., Hu, G., Rasool, M. H., Yao, Y., & Gao, F. (2025) · Industrial & Engineering Chemistry Research · doi:10.1021/acs.iecr.5c02759 · Cited by 67
Shaon, M. S. H., Karim, T., Shakil, M. S., & Hasan, M. Z. (2024) · Healthcare Analytics · doi:10.1016/j.health.2024.100353 · Cited by 43
An explainable Artificial Intelligence software system for predicting diabetes
Srinivasu, P. N., Ahmed, S., Hassaballah, M., & Almusallam, N. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e36112 · Cited by 42
Metaheuristics for pruning convolutional neural networks: A comparative study
Palakonda, V., Tursunboev, J., Kang, J., & Moon, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.126326 · Cited by 34
Singh, S. K., & Patnaik, K. S. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.109173 · Cited by 24
Metadata
- Authors
- Singh, P., Tripathi, M. K., Patil, M. B., Shivendra, & Neelakantappa, M.
- Affiliations
- Galgotias University (IN)
- Vardhaman College of Engineering (IN)
- Corresponding author
- Tripathi, Mukesh Kumar
- Venue
- Multimedia Tools and Applications
- Published
- 2024-04-26
- Volume
- 84
- Issue
- 1
- Pages
- 1-36
- ISSN
- 1380-7501 (ISSN-L)
- 1573-7721
- OpenAlex
- W4395674629
- Cited by
- 38
- References
- 35
- Citations by year
- 2026: 7 · 2025: 25 · 2024: 6
- FWCI
- 15.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Multimedia Tools and Applications (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Keywords
- multimodal emotion recognition, EEG, facial expressions, feature fusion, wavelet features, common spatial pattern, texture features, gray level co-occurrence matrix, Viola-Jones face detection, LSTM, hybrid model
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multimodal emotion recognition model via hybrid model with improved feature level fusion on facial and EEG feature set. https://app.cochat.ai/papers/10.1007/s11042-024-19171-2
- The paper
- Singh, P., Tripathi, M. K., Patil, M. B., Shivendra, & Neelakantappa, M. (2024). Multimodal emotion recognition model via hybrid model with improved feature level fusion on facial and EEG feature set. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-024-19171-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.