Coupled Multimodal Emotional Feature Analysis Based on Broad-Deep Fusion Networks in Human–Robot Interaction

Learning Spatiotemporal Features with 3D Convolutional Networks

Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593 · see citing works

Affective Computing

Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382 · see citing works

Multimodal Machine Learning: A Survey and Taxonomy

Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018 · see citing works

Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture

Chen, C. L. P., & Liu, Z. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2716952 · Cited by 1,957 · see citing works

A review of affective computing: From unimodal analysis to multimodal fusion

Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644 · see citing works

Convolutional MKL Based Multimodal Emotion Recognition and Sentiment Analysis

Poria, S., Chaturvedi, I., Cambria, E., & Hussain, A. (2016) · Proceedings · doi:10.1109/icdm.2016.0055 · Cited by 624 · see citing works

Spatial–Temporal Recurrent Neural Network for Emotion Recognition

Zhang, T., Zheng, W., Cui, Z., Zong, Y., & Li, Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2788081 · Cited by 595 · see citing works

Entity-Sensitive Attention and Fusion Network for Entity-Level Multimodal Sentiment Classification

Yu, J., Jiang, J., & Xia, R. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2957872 · Cited by 235 · see citing works

Multimodal Sentiment Analysis of Spanish Online Videos

Rosas, V. P., Mihalcea, R. F., & Morency, L. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.9 · Cited by 228 · see citing works

A Bimodal Face and Body Gesture Database for Automatic Analysis of Human Nonverbal Affective Behavior

Gunes, H., & Piccardi, M. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.39 · Cited by 206 · see citing works

Softmax regression based deep sparse autoencoder network for facial emotion recognition in human-robot interaction

Chen, L., Zhou, M., Su, W., Wu, M., She, J., & Hirota, K. (2017) · Information Sciences · doi:10.1016/j.ins.2017.10.044 · Cited by 196 · see citing works

Two-layer fuzzy multiple random forest for speech emotion recognition in human-robot interaction

Chen, L., Su, W., Yu, F., Wu, M., She, J., & Hirota, K. (2019) · Information Sciences · doi:10.1016/j.ins.2019.09.005 · Cited by 195 · see citing works

Real-Time Video Emotion Recognition Based on Reinforcement Learning and Domain Knowledge

Zhang, K., Li, Y., Wang, J., Cambria, E., & Li, X. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3072412 · Cited by 184 · see citing works

A Multi-Task Learning Framework for Emotion Recognition Using 2D Continuous Space

Xia, R., & Liu, Y. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2512598 · Cited by 182 · see citing works

Visual Tracking With Convolutional Random Vector Functional Link Network

Zhang, L., & Suganthan, P. N. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2588526 · Cited by 167 · see citing works

Spatio-temporal convolutional features with nested LSTM for facial expression recognition

Yu, Z., Liu, G., Liu, Q., & Deng, J. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.07.028 · Cited by 162 · see citing works

Deep spatio-temporal feature fusion with compact bilinear pooling for multimodal emotion recognition

Nguyen, D., Nguyen, K., Sridharan, S., Dean, D., & Fookes, C. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.06.005 · Cited by 106 · see citing works

Weight-Adapted Convolution Neural Network for Facial Expression Recognition in Human–Robot Interaction

Wu, M., Su, W., Chen, L., Liu, Z., Cao, W., & Hirota, K. (2019) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2019.2897330 · Cited by 89 · see citing works

Automatic Emotion Recognition for Groups: A Review

Veltmeijer, E. A., Gerritsen, C., & Hindriks, K. V. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3065726 · Cited by 81 · see citing works

Three-Layer Weighted Fuzzy Support Vector Regression for Emotional Intention Understanding in Human–Robot Interaction

Chen, L., Zhou, M., Wu, M., She, J., Liu, Z., Dong, F., & Hirota, K. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2018.2809691 · Cited by 73 · see citing works

Developing crossmodal expression recognition based on a deep neural model

Barros, P. V. A., & Wermter, S. (2016) · Adaptive Behavior · doi:10.1177/1059712316664017 · Cited by 72 · see citing works

Facial Expressions Recognition Based on Cognition and Mapped Binary Patterns

Qi, C., Li, M., Wang, Q., Zhang, H., Xing, J., Gao, Z., & Zhang, H. (2018) · IEEE Access · doi:10.1109/access.2018.2816044 · Cited by 67 · see citing works

Facial Expression Recognition via Deep Action Units Graph Network Based on Psychological Mechanism

Liu, Y. M., Zhang, X., Lin, Y., & Wang, H. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2019.2917711 · Cited by 67 · see citing works

Dynamic Emotion Understanding in Human–Robot Interaction Based on Two-Layer Fuzzy SVR-TS Model

Chen, L., Wu, M., Zhou, M., Liu, Z., She, J., & Hirota, K. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2017.2756447 · Cited by 65 · see citing works

A Fuzzy Deep Neural Network with Sparse Autoencoder for Emotional Intention Understanding in Human-Robot Interaction

Chen, L., Su, W., Wu, M., Pedrycz, W., & Hirota, K. (2020) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2020.2966167 · Cited by 59 · see citing works

Deep FisherNet for Image Classification

Tang, P., Wang, X., Shi, B., Bai, X., Liu, W., & Zhuowen Tu, A. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2874657 · Cited by 56 · see citing works

Supervised Learning Achieves Human-Level Performance in MOBA Games: A Case Study of Honor of Kings

Ye, D., Chen, G.-B., Zhao, P., Qiu, F., Yuan, B., Zhang, W., Chen, S., Sun, M., Li, X., Li, S., et al. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3029475 · Cited by 56 · see citing works

A Real-Time Action Representation With Temporal Encoding and Deep Compression

Liu, K., Liu, W., Ma, H., Tan, M., & Gan, C. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2984569 · Cited by 50 · see citing works

Video-based Facial Expression Recognition using Graph Convolutional Networks

Liu, D., Zhang, H., & Zhou, P. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9413094 · Cited by 49 · see citing works

Affect recognition from facial movements and body gestures by hierarchical deep spatio-temporal features and fusion strategy

Sun, B., Cao, S., He, J. Y. D., & Yu, L. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.11.021 · Cited by 46 · see citing works

Multiset Canonical Correlations Using Globality Preserving Projections With Applications to Feature Extraction and Recognition

Yuan, Y.-H., & Sun, Q. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2288062 · Cited by 43 · see citing works

Facial Expression Recognition via Broad Learning System

Zhang, T., Liu, Z., Wang, X., Xing, X., Chen, C. L. P., & Chen, E. (2018) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2018.00328 · Cited by 43 · see citing works

Arousal Recognition Using Audio-Visual Features and FMRI-Based Brain Response

Han, J., Ji, X., Hu, X., Guo, L., & Liu, T. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2411280 · Cited by 37 · see citing works

On the Crossroad of Artificial Intelligence: A Revisit to Alan Turing and Norbert Wiener

Li, L., Zheng, N., & Wang, F. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2884315 · Cited by 36 · see citing works

Canonical Correlation Analysis Regularization: An Effective Deep Multiview Learning Baseline for RGB-D Object Recognition

Tang, L., Yang, Z.-X., & Jia, K. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2866587 · Cited by 31 · see citing works

Multi-SVM based Dempster–Shafer theory for gesture intention understanding using sparse coding feature

Chen, L., Yu, F., Maram, M. A., Wang, Y., Wu, M., Hirota, K., & Pedrycz, W. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105787 · Cited by 30 · see citing works

Computational Study of Primitive Emotional Contagion in Dyadic Interactions

Varni, G., Hupont, I., Clavel, C., & Chetouani, M. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2778154 · Cited by 26 · see citing works

CNN-based Broad Learning with Efficient Incremental Reconstruction Model for Facial Emotion Recognition

Chen, L., Li, M., Lai, X., Hirota, K., & Pedrycz, W. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.12.2754 · Cited by 21 · see citing works

Audio-Facial Laughter Detection in Naturalistic Dyadic Conversations

Türker, B. B., Yemez, Y., Sezgin, T. M., & Erzin, E. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2754256 · Cited by 15 · see citing works

Affective state recognition from hand gestures and facial expressions using Grassmann manifolds

Verma, B., & Choudhary, A. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10341-6 · Cited by 15 · see citing works

Social Neighborhood Graph and Multigraph Fusion Ranking for Multifeature Image Retrieval

Liu, S., Sun, M., Feng, L., Qiao, H., Chen, S., & Liu, Y. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2984676 · Cited by 15 · see citing works

Identifying Human Behaviors Using Synchronized Audio-Visual Cues

Vrigkas, M., Nikou, C., & Kakadiaris, I. A. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2507168 · Cited by 14 · see citing works

M2Lens: Visualizing and Explaining Multimodal Models for Sentiment Analysis

Wang, X., He, J., Jin, Z., Yang, M., Wang, Y., & Qu, H. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114794 · Cited by 6 · see citing works

Multimodal Emotion Recognition with Deep Learning: Advancements, challenges, and future directions

Vijayaraghavan, G., Mala, T., Dhanasekaran, P., & Uma, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102218 · Cited by 246 · see citing works

A Systematic Review on Multimodal Emotion Recognition: Building Blocks, Current State, Applications, and Challenges

Kalateh, S., Estrada-Jimenez, L. A., Nikghadam-Hojjati, S., & Barata, J. (2024) · IEEE Access · doi:10.1109/access.2024.3430850 · Cited by 151 · see citing works

Grain Crop Yield Prediction Using Machine Learning Based on UAV Remote Sensing: A Systematic Literature Review

Yuan, J., Zhang, Y., Zheng, Z., Yao, W., Wang, W., & Guo, L. (2024) · Drones · doi:10.3390/drones8100559 · Cited by 68 · see citing works

Weakening the Dominant Role of Text: CMOSI Dataset and Multimodal Semantic Enhancement Network

Jin, C., Luo, C., Yan, M. G., Zhao, G., Zhang, G., & Zhang, S. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3282953 · Cited by 44 · see citing works

DISD-Net: A Dynamic Interactive Network With Self-Distillation for Cross-Subject Multi-Modal Emotion Recognition

Cheng, C., Liu, W., Wang, X., Feng, L., & Jia, Z. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3535344 · Cited by 37 · see citing works

MDKAT: Multimodal Decoupling With Knowledge Aggregation and Transfer for Video Emotion Recognition

Wang, J., Wang, C., Guo, L., Zhao, S., Wang, D., Zhang, S., Zhao, X., Yu, J., Wang, Y., Yang, Y., et al. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3571534 · Cited by 35 · see citing works

CMIRNet: Cross-Modal Interactive Reasoning Network for Referring Image Segmentation

Xu, M., Xiao, T., Liu, Y., Tang, H., Hu, Y., & Nie, L. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3508752 · Cited by 21 · see citing works

Humanoid robot heads for human-robot interaction: A review

Li, Y., Zhu, L., Zhang, Z., Guo, M., Li, Z., Li, Y., & Hashimoto, M. (2023) · Science China Technological Sciences · doi:10.1007/s11431-023-2493-y · Cited by 22 · see citing works

AO-UOD: A Novel Paradigm for Underwater Object Detection Using Acousto–Optic Fusion

Yu, F., Xiao, F., Li, C., Cheng, E., & Yuan, F. (2025) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2025.3529121 · Cited by 18 · see citing works

Reinforcement Learning-Based Admittance Control for Physical Human–Robot Interaction With Output Constraints

Gao, H., Yang, Y., Liu, J., & Sun, C. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3576586 · Cited by 14 · see citing works

Adaptive key-frame selection-based facial expression recognition via multi-cue dynamic features hybrid fusion

Pan, B., Hirota, K., Dai, Y., Jia, Z., Fukushima, E. F., & She, J. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120138 · Cited by 12 · see citing works

Multi-level feature decomposition and fusion model for video-based multimodal emotion recognition

Liu, X., He, G., Li, S., Yang, F., He, S., & He, S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110744 · Cited by 12 · see citing works

Causal Inference for Modality Debiasing in Multimodal Emotion Recognition

Kim, J., Hong, J., & Choi, Y. (2024) · Applied Sciences · doi:10.3390/app142311397 · Cited by 11 · see citing works

Broad learning systems: An overview of recent advances, applications, challenges and future directions

Chu, Y., Guo, Y. L., Ding, W., Cao, H., & Ping, P. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130337 · Cited by 9 · see citing works

Learning Sequential Variation Information for Dynamic Facial Expression Recognition

Pan, B., Hirota, K., Dai, Y., Jia, Z., Shao, S., & She, J. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3548669 · Cited by 8 · see citing works

An Emotion Recognition Method for Humanoid Robot Body Movements Based on a PSO-BP-RMSProp Neural Network

Gao, W., Jiang, T., Zhai, W., & Zha, F. (2024) · Sensors · doi:10.3390/s24227227 · Cited by 7 · see citing works

Highly Condensed All-MLP Architecture for Long-Term Human Motion Prediction

Liu, S., Zhang, S., Gao, F., & Feng, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3583597 · Cited by 5 · see citing works

Trust as a design principle in human–robot collaboration: a review of explainable and adaptive control

Elgohr, A. T., Rashad, M., El-Gendy, E. M., Shaaban, W., & Saafan, M. M. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11554-1 · Cited by 6 · see citing works

Enhancing Facial Expression Recognition With AI Agents: A Semisupervised Guided Adaptive $\beta$-VAE Coupled With Interval Type-2 Fuzzy Classifier

Aquib, M., Verma, N. K., & Akhtar, M. J. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3565225 · Cited by 3 · see citing works

A broad-deep fusion network-based fuzzy emotional intention inference model for teaching validity evaluation

Li, M., Chen, L., Wu, M., & Hirota, K. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119837 · Cited by 3 · see citing works

BotBR: Social Bot Detection with Balanced Feature Fusion and Reliability-Enhanced Graph Learning

Lin, Q., & Zhou, J. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3729908 · Cited by 3 · see citing works

AI-Based Affective Interaction System in Emotion-Aware Social Robots

xu, C., Zhang, H., Zhou, Z., & Jiang, Y. (2025) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001425590165 · Cited by 3 · see citing works

Robust self-organizing fuzzy neural network with data immunity evaluation for industrial process modeling

Liu, Z., Cai, G., & Han, H.-G. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108504 · Cited by 2 · see citing works

Modality emotion semantic correlation analysis for multimodal emotion recognition

Zhang, Y., Xie, D., Luo, D., & Sun, B. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110467 · Cited by 2 · see citing works

EMERSK -- Explainable Multimodal Emotion Recognition with Situational Knowledge

Palash, M., & Bhargava, B. (2023) · arXiv · doi:10.48550/arxiv.2306.08657 · Cited by 25 · see citing works

Detection of Negative Emotions in Short Texts Using Deep Neural Networks

Camacho-Vázquez, L. A., Camacho-Vázquez, V. A., Jiménez, S., & Sidorov, G. (2025) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2024.0457 · Cited by 1 · see citing works

Multimodal Aspect-Based Sentiment Analysis With Plugin-Enhanced Large Language Models

Tian, Y., Song, Y., & Zhang, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3622470 · Cited by 1 · see citing works

Textualized multimodal priors and gated causal explanations for emotion recognition in conversations: a unified LLM framework

Wang, X., Xie, L., Wang, M., & Wang, Z. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.131363 · Cited by 1 · see citing works

Multimodal Neural Network Model for Intelligent Diagnosis of Melanoma Skin Disease

Panchal, A. V., & Patel, D. M. K. M. (2024) · International Conference on Contemporary Computing and Informatics (IC3I) · doi:10.1109/ic3i61595.2024.10829327 · Cited by 1 · see citing works

Adaptive Modality Balanced Online Knowledge Distillation for Brain–Eye–Computer-Based Dim Object Detection

Li, Z., Yan, C., Lan, Z., Xiang, X., Zhou, H., Lai, J., & Tang, D. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3605710 · Cited by 1 · see citing works

Augmented Cognition: Life as we don't know itPreprint

Hipólito, I. (2023) · doi:10.31234/osf.io/x4m2g

Emotion Recognition Through Computer Vision: Challenges, Techniques, and Applications

Oliveira, A., Pellenz, M. E., & Teixeira, M. A. S. (2025) · IEEE International Conference on Industrial Technology (ICIT) · doi:10.1109/icit63637.2025.10965299

Theoretical Approaches, Practical Applications and Development Trends of Intelligent Control

Wang, K. (2025) · Applied and Computational Engineering · doi:10.54254/2755-2721/2025.tj23498

Embedding Comparator for Evolutionary Neural Architecture Search via Contrastive Learning

Zhang, X., Xue, Y., & Neri, F. (2025) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec65147.2025.11043127

A Self-Adaptive Robot Parameter Calibration Method via Broad-Deep Fusion Networks

Chen, C., Kong, Y., Du, G., Wang, X., 官全龙, Zhu, X., Wang, Z., & Liu, P. X. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3614842

Emotional State Correlation in Human-Robot Collaborative Manufacturing via Deep CCA

Sattorova, Z. I., Pushpa Raj, S., Soni, S., George, S., & Bakhromdjanovna, M. Z. (2025) · International Conference on Intelligent Technologies for Sustainable Electric and Communications Systems (iTech SECOM) · doi:10.1109/itechsecom64750.2025.11307377

Emotion-augmented continual learning for empathic robot behavior

Zhao, Y., Zhang, T., Liu, S., Ji, Y., & Wu, W. L. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.131075

Light Field Referring Segmentation: A Benchmark and an LLM-Based Approach

Tian, S., Xu, Q., Gui, H., Su, T., Li, Y., & Wang, Q. (2026) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2026.3659013

Human-Robot Interaction Optimization Through Behavioural Data Analysis and Sequential Deep Models

Dommari, S., & Tiwari, S. (2025) · International Conference on Intelligent Systems for Cybersecurity (ISCS) · doi:10.1109/iscs69371.2025.11386246

EmoFusion: Anchor-Guided Multimodal Emotion Recognition With Emotion-Specific Token Learning and Cross-Modal Complement

Ren, J., Chen, X., Cai, X., Guo, K., Chen, L., & Wei, J. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3668129

Multimodal Deep Learning for Emotionally Intelligent Human-Robot Interaction

Thakur, K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-0298-8.ch002

A Collaborative Edge-Cloud Architecture for Low-Latency Multimodal Emotion Recognition in Human-Robot Interaction

Tsai, H.-C., Wang, J.-F., & Liu, J.-M. (2025) · International Conference on Orange Technology (ICOT) · doi:10.1109/icot68409.2025.11425649

Modality-Mix Learning: Promoting Multimodal Learning Through Multilabel Objective

Lu, N., Tan, Z., Han, Z., & Zhu, S. (2026) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2026.3677806

Application of Ethnic Music Retrieval System Integrating Multimodal Attention Mechanism in Humanoid Robot Education Interaction

Sun, L., & Zhou, Z. (2026) · International Journal of Humanoid Robotics · doi:10.1142/s0219843626400153

Emotion Recognition in Sign Language Conversation

Wang, Y., Mao, K., Obi, T., Shao, M., & Funakoshi, K. (2026) · IEEE RO-MAN · doi:10.1109/ro-man72286.2026.11714658

S$^{2}$HS: Submodality Label-Aware Self-Distillation for Hard-Sentiment Learning in Multimodal Sentiment Analysis

Wang, W., Huang, J., & Xu, B. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3700026

Context-Aware Human Behavior Recognition using an Ensemble Classifier with Fuzzy Logic Fusion of Facial, Postural, and Scene Features

Jain, A., Singh, R. K., & Nigam, S. (2026) · International Conference Big Data and Machine Learning · doi:10.1109/icbdml68582.2026.11544930

Learning Dynamic Frame Semantics for Multimodal Sentiment Analysis

Zhuang, J., He, T., Hou, Y., Ong, Y.-S., & Zhang, Q. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3706491

DVSF: Disentanglement and Variational Semantic Fusion for Multimodal Sentiment Analysis

Zhang, D., Xiao, Q., He, X., & Zhang, J. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582567

IGS2-DFER: Intensity-Guided Adaptive-Window Keyframe Sampling with Multi-branch Spectral Channel Attention for Dynamic Facial Expression Recognition

Zhu, K., Liu, G., Cao, Z., Wang, X., & Liu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2864-5_21

Human-centric multimodal data processing for human-robot collaboration: A survey

Li, Q., Liu, M., Liu, S., Liu, X., Cui, H., & Liu, J. (2026) · Computers & Industrial Engineering · doi:10.1016/j.cie.2026.112271

A Cross-Attention-Based Framework for Multimodal Sentiment Analysis

Shen, Y. (2026) · IEEE International Conference on Electronics, Energy Systems and Power Engineering (EESPE) · doi:10.1109/eespe68405.2026.11648747

Multimodal Fusion for Enhanced Emotion Recognition Using Physiological Signals

Teeparthi, T., & Rao, M. R. N. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-14775-2_28

Multimodal Information-Based Broad and Deep Learning Model for Emotion Understanding

Li, M., Chen, L., Wu, M., Pedrycz, W., & Hirota, K. (2021) · Chinese Control Conference (CCC) · doi:10.23919/ccc52363.2021.9549897 · Cited by 6 · see citing works

A Novel Supervised Bimodal Emotion Recognition Approach Based on Facial Expression and Body Gesture

Yan, J., Lu, G., Bai, X., Li, H., Sun, N., & Liang, R. (2018) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1587/transfun.e101.a.2003 · Cited by 12 · see citing works

Multimodal Emotion Analysis Based on Visual, Acoustic and Linguistic Features

Koren, L., Stipanĉić, T., Ričko, A., & Orsag, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05061-9_23 · Cited by 5 · see citing works

MMFN: Emotion recognition by fusing touch gesture and facial expression information

Li, Y., Meng, Q., Wang, Y., & Hou, H.-R. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120469 · Cited by 19 · see citing works

Decision-Level Fusion Method for Emotion Recognition using Multimodal Emotion Recognition Information

Song, K.-S., Nho, Y., Seo, J.-H., & Kwon, D. (2018) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/urai.2018.8441795 · Cited by 35 · see citing works