Affect Recognition from Face and Body: Early Fusion vs. Late Fusion

Gunes, H., Piccardi, M.·2006·2005 IEEE International Conference on Systems, Man and Cybernetics
DOI 10.1109/icsmc.2005.1571679

Cited by (191)

Items 101–191 of 191

  1. Facial Expression Recognition System
    Ewa Piątkowska · 2010 · Digital Commons-DePaul (DePaul University)
  2. Input Dropout for Spatially Aligned Modalities
    Sébastien de Blois, Mathieu Garon, Christian Gagné, Jean‐François Lalonde · 2020 · Proceedings - International Conference on Image Processing
  3. Combining RSSI and Accelerometer Features for Room-Level Localization
    Athina Tsanousa, Vasileios-Rafail Xefteris, Γεώργιος Μεδίτσκος, Stefanos Vrochidis, Ioannis Yiannis Kompatsiaris · 2021 · Sensors
  4. HetMAML
    Jiayi Chen, Aidong Zhang · 2021 · ACM International Conference on Information and Knowledge Management (CIKM)
  5. Mining Inconsistent Emotion Recognition Results With the Multidimensional Model
    Agnieszka Landowska, Teresa Zawadzka, Michał Zawadzki · 2021 · IEEE Access
  6. Collaborative similarity metric learning for face recognition in the wild
    Batuhan Gündoğdu, Michael J. Bianco · 2020 · IET Image Processing
  7. A Practical Multimodal Fusion System With Uncertainty Modeling for Robust Visual and Affective Applications
    Lei Pan, Xingyu Han, Xiaoming Liu, Yang Liu · 2025 · IEEE Access
  8. Building Multi-model Collaboration in Detecting Multimedia Semantic Concepts
    Hsin-Yu Ha, Fausto C. Fleites, Shu‐Ching Chen · 2013 · International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom)
  9. Teardrops on My Face: Automatic Weeping Detection From Nonverbal Behavior
    Dennis Küster, Lars Steinert, Marc Baker, Nikhil Bhardwaj, Eva G. Krumhuber · 2023 · IEEE Transactions on Affective Computing
  10. Feature Importance Estimation Using Gradient Based Method for Multimodal Fused Neural Networks
    Muneeza Azmat, Adam Michael Alessio · 2022 · IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC)
  11. Stance Detection Based on User Feature Fusion
    Weidong Huang, Yuan Wang, Yang Jin-yuan, Yijun Xu · 2022 · Computational Intelligence and Neuroscience
  12. Auditive Emotion Recognition for Empathic AI-Assistants
    Roswitha Duwenbeck, Elsa Andrea Kirchner · 2024 · Künstliche Intell.
  13. Using Different Information Channels for Affect-Aware Video Games - A Case Study
    Mariusz Szwoch, Wioleta Szwoch · 2018 · Advances in intelligent systems and computing
  14. Fusion of LiDAR and Camera Images in End-to-end Deep Learning for Steering an Off-road Unmanned Ground Vehicle
    Narada Dilp Warakagoda, Johann A. Dirdal, Erlend Faxvaag · 2019 · International Conference on Information Fusion (FUSION)
  15. Latent-Based Adversarial Neural Networks for Facial Affect Estimations
    Decky Aspandi, Adria Mallol-Ragolta, Björn Wolfgang Schuller, Xavier Binefa · 2020 · International Conference on Automatic Face and Gesture Recognition
  16. Early vs. Late Multimodal Fusion for Recognizing Confusion in Collaborative Tasks
    Anisha Ashwath, Michael Peechatt, Cecilia Ovesdotter Alm, Reynold Bailey · 2023 · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)
  17. Multimodal recognition of frustration during game-play with deep neural networks
    Carlos de la Fuente, Francisco J. Castellanos, Jose J. Valero-Mas, Jorge Calvo-Zaragoza · 2022 · Multimedia Tools and Applications
  18. Evaluation Criteria for Affect-Annotated Databases
    Agata Kołakowska, Agnieszka Landowska, Mariusz Szwoch, Wioleta Szwoch, Michał R. Wróbel · 2015 · Communications in computer and information science
  19. Temporal alignment using the incremental unit framework
    Casey Kennington, Ting Han, David Schlangen · 2017 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  20. Low-Rank Constrained Latent Domain Adaptation Co-Regression for Robust Depression Recognition
    Jianwen Tao, Haote Xu, Jianjing Fu · 2019 · IEEE Access
  21. A Transparent Framework towards the Context-Sensitive Recognition of Conversational Engagement.
    Alexander Heimerl, Tobias Baur, Elisabeth André · 2020 · OPUS (Augsburg University)
  22. Decompose the Sounds and Pixels, Recompose the Events
    Varshanth R. Rao, Md Ibrahim Khalil, Haoda Li, Peng Dai, Juwei Lu · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  23. EEG-Based Serious Games
    Olga Sourina, Yisi Liu · 2015 · Gaming media and social effects
  24. Integrating Deep Learning with Correlation-based Multimedia Semantic Concept Detection
    Hsin-Yu Ha · 2015
  25. Emotion Classification Using Advanced Machine Learning Techniques Applied to Wearable Physiological Signals Data
    Bahareh Nakisa · 2019 · Queensland University of Technology
  26. Smart Technologies and Our Sense of Self: Going Beyond Epistemic Counter-Profiling
    Sylvie Delacroix, Michael Veale · 2019
  27. FAT-LSTM: A Multimodal Data Fusion Model with Gating and Attention-Based LSTM for Time-Series Classification
    Pouya Hosseinzadeh, Omar Bahri, Soukaïna Filali Boubrahimi, Shah Muhammad Hamdi · 2024 · Lecture notes in computer science
  28. Fusion of Embeddings Networks for Robust Combination of Text Dependent and Independent Speaker Recognition
    Ruirui Li, Chelsea J.‐T. Ju, Zeya Chen, Hongda Mao, Oğuz H. Elibol, Andreas Stolcke · 2021 · Interspeech (USB)
  29. Gesture based fear recognition using nonperformance dataset from VR horror games
    Xinyi Fu, Cheng Qi Xue, Qiuyi Yin, Yu Jiang, Ye Li, Yichen Cai, Weilin Sun · 2021 · International Conference on Affective Computing and Intelligent Interaction and workshops
  30. Ontological Model for Contextual Data Defining Time Series for Emotion Recognition and Analysis
    Teresa Zawadzka, Wojciech Waloszek, Aleksandra Karpus, Sara Zapalowska, Michał R. Wróbel · 2021 · IEEE Access
  31. A Structural Design and Interaction Algorithm of Smart Microscope Embedded on Virtual and Real Fusion Technologies
    Kang Wang, Zhiquan Feng, Jian Li, Rui Han · 2019 · IEEE Access
  32. Adversarial-based neural networks for affect estimations in the wild
    Decky Aspandi, Adria Mallol-Ragolta, Björn Wolfgang Schuller, Xavier Binefa · 2020 · arXiv (Cornell University)
  33. HetMAML: Task-Heterogeneous Model-Agnostic Meta-Learning for Few-Shot Learning Across Modalities
    Jiayi Chen, Aidong Zhang · 2021 · arXiv (Cornell University)
  34. An Overview of Emotion Recognition from Body Movement
    Laleh Ebdali Takalloo, Kin Fun Li, Kosuke Takano · 2022 · Lecture notes in networks and systems
  35. Alleviating Matching Bias in Marketing Recommendations
    Jun-Peng Fang, Qing Cui, Gong-Duo Zhang, Caizhi Tang, Lihong Gu, Longfei Li, Jinjie Gu, Jun Zhou, Fei Qing Wu · 2023 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
  36. Person re-identification based on multi-scale feature fusion and multi-attention mechanism
    Jiacheng Pu, Wei Zou · 2023 · Signal Image and Video Processing
  37. MAAL: Multimodality-Aware Autoencoder-based Affordance Learning for 3D Articulated Objects
    Yuanzhi Liang, Xiaohan Wang, Linchao Zhu, Yi Yang · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  38. MaliciousIDE – software development environment that evokes emotions
    Michał R. Wróbel, Adam Zielke · 2018 · Annals of Computer Science and Information Systems
  39. Smile Intensity Detection in Multiparty Interaction using Deep Learning
    Philine Witzig, James Kennedy, Cristina Segalin · 2019 · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)
  40. Tensor-Based Emotional Category Classification via Visual Attention-Based Heterogeneous CNN Feature Fusion
    Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama · 2020 · Sensors
  41. Integration in Multichannel Emotion Recognition
    Grzegorz Brodny, Agnieszka Landowska · 2018 · Conference on Human System Interactions
  42. Discovering Domain-Invariant Subspace for Depression Recognition by Jointly Exploiting Appearance and Dynamics Feature Representations
    Jianwen Tao, Haote Xu · 2019 · IEEE Access
  43. Automatic recognition of engagement and emotion in a group of children
    Jaebok Kim · 2018
  44. A Comparative Analysis of Early Fusion Architectures for Multimodal Gas Detection Using Machine Learning Models
    Greeshma Arya, Ashish Bagwari, Sanskriti Agarwal, Jasleen Kaur Aneja, Ciro R. Rodriguez · 2024 · Instrumentation Mesure Métrologie
  45. Shyness Trait Recognition for Schoolchildren via Multi-View Features of Online Writing
    Xuetao Tian, Liping Jing, Fang Luo, Sheng Zhang · 2021 · IEEE Transactions on Affective Computing
  46. Self-supervised learning with multimodal remote sensed maps for seafloor visual class inference
    Cailei Liang, José Cappelletto, Miquel Massot‐Campos, Adrian Bodenmann, Veerle A.I. Huvenne, Catherine Wardell, Brian J. Bett, Darryl Newborough, Blair Thornton · 2025 · The International Journal of Robotics Research
  47. Scoreboard Architectural Pattern and Integration of Emotion Recognition Results
    Agnieszka Landowska, Grzegorz Brodny · 2018 · IEEE Access
  48. Detection of Face Position and Orientation Using Depth Data
    Mariusz Szwoch, Paweł Pieniążek · 2015 · Advances in intelligent systems and computing
  49. On Privileged Information Driven Robust Face Verification: A Siamese Convolutional Neural Network Approach
    Ruohan Zong · 2020 · IEEE International Conference on Big Data (BigData)
  50. taochen at SemEval-2022 Task 5: Multimodal Multitask Learning and Ensemble Learning
    Chen Tao, Jung‐Jae Kim · 2022 · International Workshop on Semantic Evaluation (SemEval)
  51. Cooperative Reasoning on Knowledge Graph and Corpus: A Multi-agentReinforcement Learning Approach
    Yunan Zhang, Xiang Cheng, Heting Gao, ChengXiang Zhai · 2019 · arXiv (Cornell University)
  52. Evaluating the impact of modeling choices on the performance of integrated genetic and clinical models
    Theodore J. Morley, Drew Wilimitis, Michael A. Ripperger, Hyunjoon Lee, Yu Zhou, Lide Han, Jooeun Kang, William U. Meyerson, Jordan W. Smoller, Karmel W. Choi et al. · 2024 · Genetics in Medicine
  53. Leveraging dynamic feature fusion of self & cross-attention for robust multimodal emotion recognition
    Jian Kim, Hyunoh Kang, Haneul Pyeon, Dahuin Jung · 2025 · ICT Express
  54. G 2 D: Boosting Multimodal Learning with Gradient-Guided Distillation
    Mohammed Rakib, Arunkumar Bagavathi · 2025 · IEEE/CVF International Conference on Computer Vision (ICCV)
  55. Deep Multimodal Fusion for Emotion Recognition from Facial and Acoustic Cues
    Aditya Rathor, Archit Tiwari, Aditya Raut, Seba Susan · 2026 · Lecture notes in networks and systems
  56. Feature Fusion Based Parallel Graph Convolutional Neural Network for Image Annotation
    Mengke Wang, Yan Liu, Weifeng Liu, Baodi Liu · 2023 · Neural Processing Letters
  57. ARIF: An Adaptive Attention-Based Cross-Modal Representation Integration Framework
    Chengzhi Liu, Zihong Luo, Yifei Bi, Zile Huang, Dong Shu, Jiheng Hou, Hongchen Wang, Kaiyu Liang · 2024 · Lecture notes in computer science
  58. Differential Diagnosis of Thyroid Tumors Through Information Fusion from Multiphoton Microscopy Images Using Fusion Autoencoder
    Harshith Reddy Kethireddy, A. Tejaswee, Lucian George Eftimie, Radu Hristu, George A. Stanciu, Angshuman Paul · 2024 · Lecture notes in computer science
  59. A target tracking system using sensors of multiple modalities
    Shuqing Zeng · 2013 · International Journal of Vehicle Autonomous Systems
  60. SeLF: A Deep Neural Network Based Multimodal Sequential Late Fusion Approach for Human Emotion Recognition
    Anitha Modi, Priyanka Sharma · 2019 · Communications in computer and information science
  61. Early-fusion based pulsar identification with smart under-sampling
    ShiChuan Zhang, Xiangcong Kong, Yueying Zhou, Ling-Yao Chen, Xiao-Ying 小盈 Zheng 郑, Chun-Ling 春玲 Xu 许, Baoqiang Lao, Tao An · 2021 · Research in Astronomy and Astrophysics
  62. Multi-stream Fusion for Speaker Classification
    Izhak Shafran J · 2007 · Lecture notes in computer science
  63. Exploiting inter-conceptual relationships to boost SVM classification .
    Gert-Jan Poulisse · 2007
  64. Affective Body Language Detection and Generation for Socially Assistive Robots
    Derek McColl · 2015 · TSpace (University of Toronto)
  65. Fusion of Embeddings Networks for Robust Combination of Text Dependent and Independent Speaker Recognition
    Ruirui Li, Chelsea J.‐T. Ju, Zeya Chen, Hongda Mao, Oğuz H. Elibol, Andreas Stolcke · 2021 · arXiv (Cornell University)
  66. Visual Emotion Recognition: Status and Key Issues
    Alice Caplier · 2013 · Wiley eBooks
  67. Acquisition and indexing of RGB-D recordings for facial expressions and emotion recognition
    Mariusz Szwoch · 2015
  68. Classification of Three Different Emotion by Physiological Parameters
    Eun-Hye Jang, Byoung‐Jun Park, Sang‐Hyeob Kim, Jin‐Hun Sohn · 2012 · Journal of the Ergonomics Society of Korea
  69. Perceive EEmotion from facial expressions
    Preeti Jha, Hemant Makwana · 2017 · International Conference on Electronics, Communication and Aerospace Technology (ICECA)
  70. Literature Survey and Datasets
    Soujanya Poria, Amir Hussain, Erik Cambria · 2018 · Socio-affective computing
  71. Real-Time Facial Expression and Speech Emotion Recognition App Development on Mobile Phones using Cloud Computing
    Humaid Alshamsi · 2018
  72. Multimodal non-linear latent semantic method for information retrieval
    Contreras Ordoñez, Víctor Hugo · 2019
  73. Self-Recurrent Learning and Gap Sample Feature Synthesis-Based Object Detection Method
    Lvjiyuan Jiang, Haifeng Wang, Kai Yan, Chengjiang Zhou, Songlin Li, Junpeng Dang, Rong Chang, Jie Peng, Yanbin Fang, Chenkai Dai et al. · 2021 · Mathematical Problems in Engineering
  74. Facial Emotion Recognition for Citizens with Traumatic Brain Injury for Therapeutic Robot Interaction
    Chaudhary Muhammad Aqdus Ilyas · 2021
  75. Multi-Modal Colour Extraction Using Deep Learning Techniques
    Karthik Kulkarni, Prakash H. Patil, Suvarna G. Kanakaraddi · 2022 · International Conference on Emerging Research in Electronics, Computer Science and Technology (ICERECT)
  76. Ontology-Based Method for Analysis of Inconsistency Factors in Emotion Recognition
    Teresa Zawadzka, Wojciech Waloszek, Michał Zawadzki · 2023 · Proceedings of the International Conference on Information Systems Development
  77. Stress Detection:Detecting, Monitoring, and Reducing Stress in Cyber-Security Operation Centers Using Facial Expression Recognition Software
    Tiffany Davis-Stewart · 2024 · SSRN Electronic Journal
  78. Multimodal Representation Learning by Hybrid Transformer with Multi-level Fusion
    Yi Wu, Hongquan Xu, Jiaqing Zhang · 2024 · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE)
  79. Studying the Occluded: Hand-Over-Face Gestures in Human Avatars
    Monica Duta · 2024 · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)
  80. Predicting Seafloor Visual Classes from Multimodal Remote Sensed Priors using Location-Guided Self-supervised Learning
    Cailei Liang, José Cappelletto, Adrian Bodenmann, Stephen R. Turnock, Blair Thornton, Veerle A.I. Huvenne, Catherine Wardell · 2024 · IEEE/OES Autonomous Underwater Vehicles
  81. Multimodal Information Fusion based on Event Embeddings and Spatial-Temporal Graph Convolution Networks
    Qiuwei Deng, Yunlong Tian, Fei Yin, Wentao Zhang · 2025 · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT)
  82. JIT-Align: A Semantic Alignment-Based Ranking Framework for Just-In-Time Defect Prediction
    Yujie Ye, Huiqun Yu, Guisheng Fan, Yuguo Liang, Jianan Dong, Wentao Chen · 2025 · IEEE Annual International Computer Software and Applications Conference (COMPSAC)
  83. Preliminary Results of Emotions Detection with AMIGO App
    Yulia Kumar, Dov Kruger, Jose Marchena, J. Jenny Li · 2025 · IEEE Integrated STEM Education Conference (ISEC)
  84. Multimodal Learning with Intermediate Fusion for Enhanced Arrhythmia Classification
    Melissa Matteo, Mahjabeen Tamanna Abed, Xinghui Zhao · 2025 · 2025 IEEE International Conference on Data Mining Workshops (ICDMW)
  85. Modality Equilibrium Matters: Minor-Modality-Aware Adaptive Alternating for Cross-Modal Memory Enhancement
    Xiang Shi, Rui Zhang, Yu Liu, Yinpeng Liu, Zhu Liang, Qikai Cheng, Wei Ping Lu · 2026 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  86. Dual-Branch EEG Drowsiness Detection with Quantum-Inspired Channel Bagging and Interpretable Random Forests via Late Fusion
    Peng Wen, Yan Li, Zhaohui Tang, Abdulkadir Şengür, U Rajendra Acharya · 2026 · SSRN Electronic Journal
  87. BCAF: Bimodal Connection Attention Fusion for Robust Emotion Recognition From Speech and Text
    Jiachen Luo, Huy Phan, Lin Wang, Joshua Reiss · 2026 · IEEE Transactions on Multimedia
  88. Multimodal Fusion and Adaptive Learning for Cardiopulmonary Classification
    Mahjabeen Tamanna Abed, Xinghui Zhao · 2026 · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB)
  89. Multimodal Earthquake Detection Using Deep Learning and Late Fusion Techniques
    Ushar Soni, Aaradhya Jain, Sourabh Singh Verma, Jayendra Yadav, Karuna Choudhary · 2026 · International Conference on NextGen Data Science and Analytics (ICNDSA)
  90. Predicting female and male participants' contact-exchange decisions from time-segmented multimodal behavioral features in speed dating
    Asahi Ogushi, Naoki Azuma, Ryo Ishii, Akihiro Miyata · 2026 · Frontiers in Computer Science
  91. U-IMANet: U-Shape Interactive Multimodal Attention Network for Audio-Visual Scene Classification
    Tianwei Liang, Ming Yin · 2026 · Lecture notes in computer science