The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Affective multimodal human-computer interaction
Abstract
Social and emotional intelligence are aspects of human intelligence that have been argued to be better predictors than IQ for measuring aspects of success in life, especially in social interactions, learning, and adapting to what is important. When it comes to machines, not all of them will need such skills. Yet to have machines like computers, broadcast systems, and cars, capable of adapting to their users and of anticipating their wishes, endowing them with the ability to recognize user's affective states is necessary. This article discusses the components of human affect, how they might be integrated into computers, and how far are we from realizing affective multimodal human-computer interaction.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous software primarily dealt with offline emotion recognition that cause post-processing of the learner's data.”
From Towards multimodal emotion recognition in e-learning environments (2016) · cites this paper as Pantic, Sebe, Cohn, & Huang, 2005
In the citing paper
“The application context is restricted by the fact that such software can only manage a small set of expressions from frontal view faces without facial hair, glasses provided that there is constant illumination.”
From Towards multimodal emotion recognition in e-learning environments (2016) · cites this paper as Pantic, Sebe, Cohn, & Huang, 2005
Citations
Cites
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding
EKMAN, P., & FRIESEN, W. V. (1969) · Semiotica · doi:10.1515/semi.1969.1.1.49 · Cited by 3,316
Comprehensive database for facial expression analysis
Takeo Kanade, A., Cohn, J. F., & Tian, Y. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840611 · Cited by 2,644
Self-citationToward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334
A Survey on Visual Surveillance of Object Motion and Behaviors
Hu, W., Tan, T. N., Wang, L., & Maybank, S. J. (2004) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2004.829274 · Cited by 2,156
Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis.
Ambady, N., & Rosenthal, R. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.256 · Cited by 2,003
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640
Acoustic profiles in vocal emotion expression
Banse, R., & Scherer, K. R. (1996) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.70.3.614 · Cited by 1,546
Watson, D., Weber, K., Assenheimer, J. S., Clark, L. A., Strauss, M. E., & McCormick, R. A. (1995) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.104.1.3 · Cited by 1,423
Web-Based Database for Facial Expression Analysis
Pantić, M., Valstar, M., Rademaker, R. M., & Maat, L. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2005.1521424 · Cited by 1,124
Flagged first, then by citations
Research works printed but not linked: 8
- 10.5555/795661.796218 · DOI
- Garg , A. , Naphade , M. , Huang , T.S. Modeling video using input/output Markov models with application to multimodal event detection. Handbook of Video Databases: Design and Applications, B. Furth, O. Marques, and B. Furth , Eds. , 2003 . Garg, A., Naphade, M., Huang, T.S. Modeling video using input/output Markov models with application to multimodal event detection. Handbook of Video Databases: Design and Applications, B. Furth, O. Marques, and B. Furth, Eds., 2003.
- 10.5555/795661.796240 · DOI
- 10.5555/795661.796155 · DOI
- Larsen , R.J. and Diener , E . Promises and problems with the circumplex model of emotion. Emotion, vol. 13, Review of Personality and Social Psychology, M. S. Clark, Ed., Sage Publications , Newbury Park, USA , 1992 , 25 -- 59 . Larsen, R.J. and Diener, E. Promises and problems with the circumplex model of emotion. Emotion, vol. 13, Review of Personality and Social Psychology, M. S. Clark, Ed., Sage Publications, Newbury Park, USA, 1992, 25--59.
- 10.5555/265013 · DOI
- 10.5555/1949767.1949859 · DOI
- 10.5555/1896300.1896449 · DOI
Cited by
Sorted by citations
Items 201–231 of 231
A spatio-temporal approach to the analysis of facial actions
Valstar, M. (2008)
An Empirical Study of Dimensional Reduction Techniques for Facial Action Units DetectionPreprint
Hui, Z., & Chu, W.-S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.08039
Three Philosophers and a Design for Expressive Gestural Interaction
Danylak, R. (2009) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-60750-049-0-541
The Applied Roles of Graphics in E-Learning
Hai-Jew, S. (2010) · IGI Global eBooks · doi:10.4018/978-1-60566-972-4.ch003
Multi-modal Korean Emotion Recognition with Consistency Regularization
Kim, J., & Kang, P. (2021) · Journal of Korean Institute of Industrial Engineers · doi:10.7232/jkiie.2021.47.6.549
Multimodal Data Collection and Processing for Applied Affective Computing
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502403
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502399
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502412
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502413
Applied Affective Computing in Built Environments
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502409
Machine Learning Approaches for Applied Affective Computing
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502402
Affective Computing for Enhancing Well-Being
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502408 · Cited by 1
Synthesizing Natural and Believable Emotional Expressions
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502406
Addressing Ethical Issues of Affective Computing
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502410
Emotions as Studied in Psychology and Cognitive Science
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502401
Efficient Low-Resolution Human Pose Estimation with Knowledge Bridge
Li, Z., Zhang, F., & Chen, L. (2023) · China Automation Congress (CAC) · doi:10.1109/cac59555.2023.10451190
Multi-Stream Temporal Networks for Emotion Recognition in Children and in the Wild
Filntisis, P. P., Efthymiou, N., Potamianos, G., & Maragos, P. A. (2023) · Springer eBooks · doi:10.1007/978-3-031-50269-9_10
The Science of Emotion: Decoding and Analysis of Human Emotional Landscape
Marruthachalam, R., Amudha, P., & Sivakumari, S. (2024) · The Springer series in applied machine learning · doi:10.1007/978-3-031-63821-3_1
Semiotic Analysis for Gestural and Emotional Human-Computer Interaction
Danylak, R. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39238-2_51
Robust facial expression analysis for affect-based interaction
Mourão, A. (2012) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Yi, Y., & Liu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-12392-3_28
Li, H., Chen, H., Liu, Y., Pan, W., Wang, S., & Wu, J. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2645770
A video dataset for Multi-Emotion and Interpersonal relation analysis
Guerdelli, H., Ferrari, C., Berretti, S., Barhoumi, W., & Bimbo, A. D. (2026) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2026.104869
Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Dataset
Zhang, Z., Song, P., Hu, J., Jia, J., Yang, X., & Chang, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37038-9_15 · Cited by 3
Trustworthy Multimodal Learning via Uncertainty-aware Feature Modulation and Reliability AuditingPreprint
Choi, S., Ali, M., Pack, C., & Lee, E. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7327625
Carvalho, C., Torres, J. M., & Moreira, R. S. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831116
Wang, Z., Lin, Y., Zhao, X., Huang, Y., Zhou, Z., Xue, W., Cai, W., & Jin, Y. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831173
Metadata
- Authors
- Pantic, M., Sebe, N., Cohn, J. F., & Huang, T.
- Affiliations
- Delft University of Technology, The Netherlands
- University of Amsterdam (NL)
- University of Pittsburgh (US)
- University of Illinois Urbana-Champaign (US)
- Venue
- Proceedings of the 13th annual ACM international conference on Multimedia
- Publisher
- ACM
- Published
- 2005-11-06
- Pages
- 669-676
- OpenAlex
- W2028975938
- Cited by
- 234
- References
- 50
- Citations by year
- 2026: 9 · 2025: 11 · 2024: 8 · 2023: 8 · 2022: 23 · 2021: 6 · 2020: 10 · 2019: 9 · 2018: 11 · 2017: 9 · 2016: 7 · 2015: 12 · 2014: 6 · 2013: 14 · 2012: 8
- FWCI
- 25.50
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Multimedia (ACM MM) (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- Institutional Research Information System (Università degli Studi di Trento) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- affective computing, multimodal human-computer interaction, affective states, social-emotional intelligence, user modeling, adaptive systems, emotion recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
