Multimodal emotion recognition based on manifold learning and convolution neural network
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The deep learning model can automatically extract features compared to traditional emotion recognition methods [6].”
From Multimodal Emotion Recognition From EEG Signals and Facial Expressions (2023) · cites this paper as [6]
Citations
Cites
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585 · cited 2×
“The noise and artifacts are removed by the filters in the pre-preprocessing of the DEAP dataset [29].”
BackgroundMethodDEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093 · cited 14×
“The DEAP dataset consists of 32 subjects watching 40 one-minute music videos with different emotions respectively, detecting and recording EEG and peripheral physiological signals.”
MethodInfluentialA Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664 · cited 1×
“MSST is a multivariate extension of the synchrosqueezing transform method to process multi-channel signals and can obtain compact time-frequency distribution covering the mutual components among the channels, thereby capturing the changing oscillatory dynamics of the signals [26].”
MethodA review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644 · cited 1×
“At present, feature-level fusion and decision-level fusion are usually used in multimodal fusion [22].”
BackgroundEmotionMeter: A Multimodal Framework for Recognizing Human Emotions
Zheng, W.-L., Liu, W., Lu, Y., Lu, B.-L., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797176 · Cited by 1,276 · cited 2×
“Emotion is associated with many external and internal activities of the human body, which plays an important role in human behavior decision-making [40].”
BackgroundIdentifying Stable Patterns over Time for Emotion Recognition from EEG
Zheng, W.-L., Zhu, J.-Y., & Lu, B.-L. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2712143 · Cited by 990
Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers
Atkinson, J., & Campos, D. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.10.049 · Cited by 506
Learning Affective Features With a Hybrid Deep Model for Audio–Visual Emotion Recognition
Zhang, S., Zhang, S., Huang, T., Gao, W., & Tian, Q. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2719043 · Cited by 346 · cited 1×
“In multimodal emotion recognition, feature extraction and multimodal fusion are the most important steps [37].”
BackgroundCross-Subject Emotion Recognition Using Flexible Analytic Wavelet Transform From EEG Signals
Gupta, V., Chopda, M. D., & Pachori, R. B. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2883497 · Cited by 293 · cited 1×
“To comprehensively investigate the channel-specific nature of EEG signals, Gupta et al. [8] proposed a flexible analytic wavelet transform (FAWT) to decompose the EEG signal into different sub-band signals and to extract the features from the decomposed sub-band signals of EEG signal.”
Santamaria-Granados, L., Munoz-Organero, M., Ramirez-Gonzalez, G., Abdulhay, E., & Arunkumar, N. (2019) · IEEE Access · doi:10.1109/access.2018.2883213 · Cited by 289 · cited 1×
“[24] used deep CNN to automatically extract features of ECG and electrophysiological response signals, conducted emotional prediction through the fully connected network layer, and compared with the time, frequency, and non-linear features of physiological signals extracted from classical machine learning methods.”
Method
Research works printed but not linked: 2
- Wu M, Su WJ, Chen LF, Pedrycz W, Hirota K (2020) Two-stage fuzzy fusion based-convolution neural network for dynamic emotion recognition. IEEE Trans Affect Comput, in press
- Zhao X, Jiang Z (2019) A tangent distance preserving dimensionality reduction algorithm. arXiv, arXiv:1902.05373v1. · arXiv
Cited by
Emotion recognition from unimodal to multimodal analysis: A review
Ezzameli, K., & Mahersia, H. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101847 · Cited by 187
Samal, P., & Hashmi, M. F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10690-2 · Cited by 188
Multimodal Emotion Recognition From EEG Signals and Facial Expressions
Wang, S., Qu, J., Zhang, Y., & Zhang, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3263670 · Cited by 124
“The deep learning model can automatically extract features compared to traditional emotion recognition meth-ods [6].”
BackgroundSelf-citationReview of Studies on Emotion Recognition and Judgment Based on Physiological Signals
Lin, W., & Li, C. (2023) · Applied Sciences · doi:10.3390/app13042573 · Cited by 142
“In terms of new models, Zhang et al. [4] presented a multimodal emotion recognition model based on manifold learning and a convolutional neural network, and the test results showed that the presented model achieved high identification accuracy.”
Emotion recognition based on multiple physiological signals
Li, Q., Liu, Y., Yan, F., Zhang, Q., & Liu, C. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.104989 · Cited by 83
Metadata
- Authors
- Zhang, Y., Cheng, C., & Zhang, Y.
- Affiliations
- Liaoning Normal University (CN)
- Corresponding author
- Zhang, Yong
- Venue
- Multimedia Tools and Applications
- Published
- 2022-04-18
- Volume
- 81
- Issue
- 23
- Pages
- 33253-33268
- ISSN
- 1380-7501 (ISSN-L)
- 1573-7721
- OpenAlex
- W4223909097
- Cited by
- 67
- References
- 38
- Citations by year
- 2026: 7 · 2025: 18 · 2024: 26 · 2023: 13 · 2022: 3
- FWCI
- 13.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Multimedia Tools and Applications (publishedVersion)
- Funders
- National Natural Science Foundation of China (61772252)
- Natural Science Foundation of Liaoning Province (2019-MS-216)
- Scientific Research Foundation of the Education Department of Liaoning Province (LJKZ0965)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- multimodal emotion recognition, physiological signals, EEG, eye movement signals, peripheral physiological signals, manifold learning, feature fusion, valence and arousal, deep convolutional neural networks, DEAP dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multimodal emotion recognition based on manifold learning and convolution neural network. https://app.cochat.ai/papers/10.1007/s11042-022-13149-8
- The paper
- Zhang, Y., Cheng, C., & Zhang, Y. (2022). Multimodal emotion recognition based on manifold learning and convolution neural network. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-022-13149-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.