Emotion recognition from audiovisual information
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
We report preliminary results on emotion recognition by machine from joint audiovisual input of facial video and speech. The results show potential advantages in using both modalities over either modality alone. The recognition rate for audio alone is about 75% and video alone about 70%. Using audiovisual data we achieved 97% without increasing the number of features. The improvement in performance is accredited to the complementary property between the two modalities. A possible application is in natural human-computer interfaces.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Murray, I. R., & Arnott, J. L. (1993) · The Journal of the Acoustical Society of America · doi:10.1121/1.405558 · Cited by 1,098
Facial emotion recognition using multi-modal information
De Silva, L. C., Miyasato, T., & Nakatsu, R. (2002) · Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat. No.97TH8237) · doi:10.1109/icics.1997.647126 · Cited by 319
Self-citationHuman expression recognition from motion using a radial basis function network architecture
Rosenblum, M., Yacoob, Y., & Davis, L. S. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.536309 · Cited by 284
Research works printed but not linked: 7
- 10.1109/34.598232 · DOI · Paper page
- 10.1037/0033-2909.115.2.268 · doi:10.1037/0033-2909.115.2.268 · Paper page
- tao, 1998, Connected Vibrations: A Modal Analysis Approach To Non-rigid Motion Tracking, Proc IEEE Comput Vision and Patt Recog '98 (CVPR'98)
- 10.1109/ROMAN.1995.531943 · doi:10.1109/roman.1995.531943
- picard, 1997, Affective Computing
- scherer, 1996, Adding The Affective Dimension: A New Look In Speech Analysis And Synthesis, Proc Int Conf Spoken Lang Process
- 10.1109/ICSLP.1996.608022 · doi:10.1109/icslp.1996.608022 · Paper page
Cited by
Analysis of emotion recognition using facial expressions, speech and multimodal information
Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C. M., Kazemzadeh, A., Lee, S., Neumann, U., & Narayanan, S. (2004) · Proceedings of the 6th international conference on Multimodal interfaces · doi:10.1145/1027933.1027968 · Cited by 840
Schuller, B., Batliner, A., Steidl, S., & Seppi, D. (2011) · Speech Communication · doi:10.1016/j.specom.2011.01.011 · Cited by 758
Emotion detection from text and speech: a survey
Sailunaz, K., Dhaliwal, M., Rokne, J., & Alhajj, R. (2018) · Social Network Analysis and Mining · doi:10.1007/s13278-018-0505-2 · Cited by 260
MULTIMODAL EMOTION RECOGNITION
Sebe, N., Cohen, I., & Huang, T. S. (2005) · Handbook of Pattern Recognition and Computer Vision · doi:10.1142/9789812775320_0021 · Cited by 201
“Chen et al.(8) have shown this experimentally.”
Self-citationAffect Recognition from Face and Body: Early Fusion vs. Late Fusion
Gunes, H., & Piccardi, M. (2006) · 2005 IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/icsmc.2005.1571679 · Cited by 191
Metadata
- Authors
- Chen, L. S., Tao, H., Huang, T. S., Miyasato, T., & Nakatsu, R.
- Venue
- 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175)
- Publisher
- IEEE
- Published
- 2002-11-27
- Pages
- 83-88
- OpenAlex
- W2171746100
- Cited by
- 54
- References
- 3
- FWCI
- 6.89
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.