Hierarchical fusion of visual and physiological signals for emotion recognition
The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We found that in previous studies [19], [20], [21], decision-level fusion methods are not only easy to implement but also exhibit better performance than feature-level fusion.”
From Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG (2024) · cites this paper as [19]
Citations
Cites
Physiological time-series analysis using approximate entropy and sample entropy
Richman, J. S., & Moorman, J. R. (2000) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.2000.278.6.h2039 · Cited by 7,880 · cited 1×
“RichmanandMoorman(2000)proposedSam-pleEntropy(SampEn)asanewcomplexitymeasure.”
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093 · cited 2×
“Koelstra et al. (2011) collected EEG and various peripheral signals.”
BackgroundA Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Multiscale entropy analysis of biological signals
Costa, M., Goldberger, A. L., & Peng, C.-K. (2005) · Physical Review E · doi:10.1103/physreve.71.021906 · Cited by 2,482 · cited 1×
“Consideringthemultipletimescale, Costaetal.”
Facial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300 · cited 1×
“Typical approaches include texture features (Shan et al. 2009; Littlewort et al. 2004), geographical feature (Walecki et al. 2015) and optical flow feature (Wöllmer et al. 2013).”
MethodUniversals and cultural differences in the judgments of facial expressions of emotion.
Ekman, P., Friesen, W. V., O'Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Krause, R., LeCompte, W. A., Pitcairn, T., Ricci-Bitti, P. E., et al. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.53.4.712 · Cited by 1,763
Challenges in Representation Learning: A Report on Three Machine Learning Contests
Goodfellow, I. J., Erhan, D., Carrier, P. L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-42051-1_16 · Cited by 1,719
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664 · cited 11×
“To evaluate the proposed method, we experiment on MAHNOB-HCI (Soleymani et al. 2011) dataset and analyze the result.”
BackgroundMethodInfluentialA review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644 · cited 1×
“Recently, multi-modal emotion recognition becomes the mainstream (Poria et al. 2017).”
BackgroundEEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597 · cited 2×
“Among them, EEG is widely used as a physiological signal closely related to emotion and directly captured from the brain area (Song et al. 2018; Khalili and Moradi 2009).”
Background
Research works printed but not linked: 2
Cited by
Automated emotion recognition: Current trends and future perspectives
Maithri, M., Raghavendra, U., Gudigar, A., Samanth, J., Barua, P. D., Murugappan, M., Chakole, Y., & Acharya, U. R. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106646 · Cited by 172
Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG
Pan, J., Fang, W., Zhang, Z., Chen, B., Zhang, Z., & Wang, S. (2024) · IEEE Open Journal of Engineering in Medicine and Biology · doi:10.1109/ojemb.2023.3240280 · Cited by 121
“We found that in previous studies [19], [20], [21], decision-level fusion methods are not only easy to implement but also exhibit better performance than feature-level fusion.”
ResultMultimodal emotion recognition: A comprehensive review, trends, and challenges
Ramaswamy, M. P. A., & Palaniswamy, S. (2024) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1563 · Cited by 70
Emotion Recognition based on fusion of multimodal physiological signals using LSTM and GRU
Priyadarshini, N., & Aravinth, J. (2023) · International Conference on Secure Cyber Computing and Communications (ICSCCC) · doi:10.1109/icsccc58608.2023.10176510 · Cited by 22
Bussolan, A., Baraldo, S., Gambardella, L. M., & Valente, A. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731373 · Cited by 8
“An example of a multimodal approach applied to the emotional domain can be found in [19].”
Background
Metadata
- Authors
- Fang, Y., Rong, R., & Huang, J.
- Affiliations
- Shanghai University (CN)
- Chinese Academy of Sciences (CN)
- Corresponding author
- Fang, Yuchun
- Venue
- Multidimensional Systems and Signal Processing
- Published
- 2021-04-05
- Volume
- 32
- Issue
- 4
- Pages
- 1103-1121
- ISSN
- 0923-6082 (ISSN-L)
- 1573-0824
- OpenAlex
- W3144083005
- Cited by
- 17
- References
- 51
- Citations by year
- 2025: 3 · 2024: 6 · 2023: 4 · 2022: 3 · 2021: 1
- FWCI
- 3.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Multidimensional Systems and Signal Processing (publishedVersion)
- Funders
- National Natural Science Foundation of China (61976132)
- Shanghai Natural Science Foundation (19ZR1419200)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- emotion recognition, multimodal fusion, facial expressions, EEG, linear frequency cepstral coefficients, sample entropy, feature-level fusion, decision fusion, video sequences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Hierarchical fusion of visual and physiological signals for emotion recognition. https://app.cochat.ai/papers/10.1007/s11045-021-00774-z
- The paper
- Fang, Y., Rong, R., & Huang, J. (2021). Hierarchical fusion of visual and physiological signals for emotion recognition. Multidimensional Systems and Signal Processing. https://doi.org/10.1007/s11045-021-00774-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.