The DOI matches its Crossref record; 46 of the 47 references it cites were found in a registry or an index.
Learning Salient Features for Speech Emotion <newline/>Recognition Using Convolutional <newline/>Neural Networks
Abstract
As an essential way of human emotional behavior understanding, speech emotion recognition (SER) has attracted a great deal of attention in human-centered signal processing. Accuracy in SER heavily depends on finding good affect- related , discriminative features. In this paper, we propose to learn affect-salient features for SER using convolutional neural networks (CNN). The training of CNN involves two stages. In the first stage, unlabeled samples are used to learn local invariant features (LIF) using a variant of sparse auto-encoder (SAE) with reconstruction penalization. In the second step, LIF is used as the input to a feature extractor, salient discriminative feature analysis (SDFA), to learn affect-salient, discriminative features using a novel objective function that encourages feature saliency, orthogonality, and discrimination for SER. Our experimental results on benchmark datasets show that our approach leads to stable and robust recognition performance in complex scenes (e.g., with speaker and language variation, and environment distortion) and outperforms several well-established SER features.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“neglecting to model the emotion-related correlations within frequency domain during the time-frequency joint learning”
From Speech Emotion Recognition via an Attentive Time–Frequency Neural Network (2023) · cites this paper as [8]
Experimental — accuracy not yet measuredIn the citing paper
“recent spectrogram-based works mainly focus on modeling the long-term dependency in time domain”
From Speech Emotion Recognition via an Attentive Time–Frequency Neural Network (2023) · cites this paper as [8]
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892 · cited 1×
“We use the spectrogram of the speech signal as the input of CNN.”
MethodRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Recently, it has been shown that unsupervised feature leaning is very helpful for ASR [43] and image understanding [2], [10].”
BackgroundA Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
A database of German emotional speech
Burkhardt, F., Paeschke, A., Rolfes, M., Sendlmeier, W. F., & Weiss, B. (2005) · Interspeech 2005 · doi:10.21437/interspeech.2005-446 · Cited by 2,365 · cited 1×
“The second is Berlin Emotional Database (Emo-DB) [3], which also includes seven emotions (i.”
BackgroundSurvey on speech emotion recognition: Features, classification schemes, and databases
El Ayadi, M., Kamel, M. S., & Karray, F. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.09.020 · Cited by 2,073
Toward detecting emotions in spoken dialogs
Lee, C. M., & Narayanan, S. S. (2005) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2004.838534 · Cited by 988 · cited 1×
“An alternative procedure for detecting emotions using lexical information is found in [18].”
Method(2009) · neural information processing systems · Cited by 962
Emotional speech recognition: Resources, features, and methods
Ververidis, D., & Kotropoulos, C. (2006) · Speech Communication · doi:10.1016/j.specom.2006.04.003 · Cited by 925 · cited 1×
“In the following, we first briefly review the classification strategies, and then focus on feature extraction methods, as they are more related to this work.”
MethodSpeech emotion recognition using hidden Markov models
Nwe, T. L., Foo, S. W., & De Silva, L. C. (2003) · Speech Communication · doi:10.1016/s0167-6393(03)00099-2 · Cited by 920
Schuller, B., Rigoll, G., & Lang, M. (2004) · 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.2004.1326051 · Cited by 426 · cited 1×
“In [34], a spotting algorithm that searches for emotional keywords or phrases in the utterances was employed.”
Method
Research works printed but not linked: 1
- steidl, 2009, Automatic Classification of Emotion-Related User States in Spontaneous Children's Speech
Cited by
Speech emotion recognition using deep 1D & 2D CNN LSTM networks
Zhao, J., Mao, X., & Chen, L. (2019) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.08.035 · Cited by 1,044
A review of emotion recognition using physiological signals
Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., & Yang, X. (2018) · Sensors · doi:10.3390/s18072074 · Cited by 923
“One is using human physical signals such as facial expression [4], speech [5], gesture, posture, etc.”
BackgroundAdieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network
Trigeorgis, G., Ringeval, F., Brueckner, R., Marchi, E., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472669 · Cited by 904
“In the field of paralinguistics, several studies have been carried out using CNNs for feature learning, e.g., recently by Milde and Biemann [14], and Mao et al. [15].”
MethodAkçay, M. B., & Oğuz, K. (2020) · Speech Communication · doi:10.1016/j.specom.2019.12.001 · Cited by 721
Speech Emotion Recognition Using Deep Learning Techniques: A Review
Khalil, R. A., Jones, E., Babar, M. I., Jan, T., Zafar, M. H., & Alhussain, T. (2019) · IEEE Access · doi:10.1109/access.2019.2936124 · Cited by 702
“Preprocessing is an aditionaltask usually required to be carried out before recognition of emotion from the speech signal [120].”
BackgroundInfluential
Metadata
- Authors
- Mao, Q., Dong, M., Huang, Z., & Zhan, Y.
- Affiliations
- Jiangsu University (CN)
- Wayne State University (US)
- Venue
- IEEE Transactions on Multimedia
- Published
- 2014-12
- Volume
- 16
- Issue
- 8
- Pages
- 2203-2213
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W2087618018
- Cited by
- 568
- References
- 47
- Citations by year
- 2026: 19 · 2025: 24 · 2024: 46 · 2023: 72 · 2022: 73 · 2021: 83 · 2020: 67 · 2019: 59 · 2018: 53 · 2017: 46 · 2016: 15 · 2015: 11
- FWCI
- 33.30
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Multimedia (publishedVersion)
- Funders
- the National Nature Science Foundation of China (61272211, 61170126)
- the Six Talent Peaks Foundation of Jiangsu Province
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- speech emotion recognition, discriminative feature learning, local invariant features, sparse autoencoders, feature saliency, unsupervised feature learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learning Salient Features for Speech Emotion <newline/>Recognition Using Convolutional <newline/>Neural Networks. https://app.cochat.ai/papers/10.1109/tmm.2014.2360798
- The paper
- Mao, Q., Dong, M., Huang, Z., & Zhan, Y. (2014). Learning Salient Features for Speech Emotion <newline/>Recognition Using Convolutional <newline/>Neural Networks. IEEE Transactions on Multimedia. https://doi.org/10.1109/tmm.2014.2360798
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.