The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
A CNN-Assisted Enhanced Audio Signal Processing for Speech Emotion Recognition
Open accessAbstract
Speech is the most significant mode of communication among human beings and a potential method for human-computer interaction (HCI) by using a microphone sensor. Quantifiable emotion recognition using these sensors from speech signals is an emerging area of research in HCI, which applies to multiple applications such as human-reboot interaction, virtual reality, behavior assessment, healthcare, and emergency call centers to determine the speaker’s emotional state from an individual’s speech. In this paper, we present major contributions for; (i) increasing the accuracy of speech emotion recognition (SER) compared to state of the art and (ii) reducing the computational complexity of the presented SER model. We propose an artificial intelligence-assisted deep stride convolutional neural network (DSCNN) architecture using the plain nets strategy to learn salient and discriminative features from spectrogram of speech signals that are enhanced in prior steps to perform better. Local hidden patterns are learned in convolutional layers with special strides to down-sample the feature maps rather than pooling layer and global discriminative features are learned in fully connected layers. A SoftMax classifier is used for the classification of emotions in speech. The proposed technique is evaluated on Interactive Emotional Dyadic Motion Capture (IEMOCAP) and Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) datasets to improve accuracy by 7.85% and 4.5%, respectively, with the model size reduced by 34.5 MB. It proves the effectiveness and significance of the proposed SER technique and reveals its applicability in real-world applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
(2014) · Cited by 33,419
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
Convolutional Neural Networks for Speech Recognition
Abdel-Hamid, O., Mohamed, A.-R., Jiang, H., Deng, L., Penn, G., & Yu, D. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2339736 · Cited by 2,262
Livingstone, S. R., & Russo, F. A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0196391 · Cited by 1,883
Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network
Trigeorgis, G., Ringeval, F., Brueckner, R., Marchi, E., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472669 · Cited by 904
Mao, Q., Dong, M., Huang, Z., & Zhan, Y. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2360798 · Cited by 568
Evaluating deep learning architectures for Speech Emotion Recognition
Fayek, H. M., Lech, M., & Cavedon, L. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.02.013 · Cited by 554 · cited 1×
“Haytham et al. [38] described a neural network and RNN-based technique for SER using spectrograms of frames to train DNN, which has a high computational coast and did not achieve high accuracy.”
MethodCASIA Online and Offline Chinese Handwriting Databases
Liu, C., Yin, F., Wang, D.-H., & Wang, Q. (2011) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.17 · Cited by 517
3-D Convolutional Recurrent Neural Networks With Attention Model for Speech Emotion Recognition
Chen, M., He, X., Yang, J., & Zhang, H. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2860246 · Cited by 503
Zhang, S., Zhang, S., Huang, T., & Gao, W. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2766843 · Cited by 441
SVM or deep learning? A comparative study on remote sensing image classification
Liu, P., Choo, K.-K. R., Wang, L., & Huang, F. (2017) · Soft Computing · doi:10.1007/s00500-016-2247-2 · Cited by 267
Speech emotion recognition based on feature selection and extreme learning machine decision tree
Liu, Z.-T., Wu, M., Cao, W.-H., Mao, J.-W., Xu, J.-P., & Tan, G.-Z. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.07.050 · Cited by 267
Bagged support vector machines for emotion recognition from speech
Bhavan, A., Chauhan, P., Hitkul, & Shah, R. R. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.104886 · Cited by 248
Deep features-based speech emotion recognition for smart affective services
Badshah, A. M., Rahim, N., Ullah, N., Ahmad, J., Muhammad, K., Lee, M. Y., Kwon, S., & Baik, S. W. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5292-7 · Cited by 182
Self-citationSpectrogram based multi-task audio classification
Zeng, Y., Mao, H., Peng, D., & Yi, Z. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5539-3 · Cited by 178
3D CNN-Based Speech Emotion Recognition Using K-Means Clustering and Spectrograms
Hajarolasvadi, N., & Demirel, H. (2019) · Entropy · doi:10.3390/e21050479 · Cited by 172
Speech Emotion Recognition Using Spectrogram & Phoneme Embedding
Yenigalla, P., Kumar, A., Tripathi, S., Singh, C., Kar, S., & Vepa, J. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1811 · Cited by 164
Cross Lingual Speech Emotion Recognition: Urdu vs. Western Languages
Latif, S., Qayyum, A., Usman, M., & Qadir, J. (2018) · International Conference on Frontiers of Information Technology (FIT) · doi:10.1109/fit.2018.00023 · Cited by 147
Zhu, L., Chen, L., Zhao, D., Zhou, J., & Zhang, W. (2017) · Sensors · doi:10.3390/s17071694 · Cited by 133
Advanced LSTM: A Study About Better Time Dependency Modeling in Emotion Recognition
Tao, F., & Liu, G. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461750 · Cited by 109
Adversarial Auto-Encoders for Speech Based Emotion Recognition
Sahu, S., Gupta, R., Sivaraman, G., AbdAlmageed, W., & Espy-Wilson, C. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1421 · Cited by 101
Random Deep Belief Networks for Recognizing Emotions from Speech Signals
Wen, G., Li, H., Huang, J., Li, D., & Xun, E. (2017) · Computational Intelligence and Neuroscience · doi:10.1155/2017/1945630 · Cited by 97
CycleGAN-Based Emotion Style Transfer as Data Augmentation for Speech Emotion Recognition
Bao, F., Neumann, M., & Vu, N. T. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2293 · Cited by 92
Luo, D., Zou, Y., & Huang, D. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1832 · Cited by 85
Learning Temporal Clusters Using Capsule Routing for Speech Emotion Recognition
Jalal, M. A., Loweimi, E., Moore, R. K., & Hain, T. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-3068 · Cited by 80
Alkaya, A., & Eker, İ. (2011) · ISA Transactions · doi:10.1016/j.isatra.2010.12.004 · Cited by 75
Memento: An Emotion-driven Lifelogging System with Wearables
Jiang, S., Li, Z., Zhou, P., & Li, M. (2019) · ACM Transactions on Sensor Networks · doi:10.1145/3281630 · Cited by 59
Exploring Hashing and Cryptonet Based Approaches for Privacy-Preserving Speech Emotion Recognition
Dias, M. S., Abad, A., & Trancoso, I. M. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461451 · Cited by 46
End-to-End Speech Command Recognition with Capsule Network
Bae, J., & Kim, D. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1888 · Cited by 41
From Real to Complex: Enhancing Radio-based Activity Recognition Using Complex-Valued CSI
Wei, B. W., Hu, W. S., Yang, M., & Chou, C. T. (2019) · ACM Transactions on Sensor Networks · doi:10.1145/3338026 · Cited by 37
An Interdisciplinary Review of Smart Vehicular Traffic and Its Applications and Challenges
Fiore, U., Florea, A., & Lechuga, G. P. (2019) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan8010013 · Cited by 29
Sendra, A. L., Bellido, J. G., Carrasco, A., & Barbancho, J. (2018) · Sensors · doi:10.3390/s18061803 · Cited by 19
Kang, S.-J., Kim, D., & Kim, Y. (2019) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147719864886 · Cited by 14
ULearn: understanding and reacting to student frustration using deep learning, mobile vision and NLP
Grewe, L. L., & Hu, C. (2019) · Signal processing, sensor fusion, and target recognition. Conference · doi:10.1117/12.2518262 · Cited by 12
Memento: An Emotion Driven Lifelogging System with Wearables
Jiang, S., Zhou, P., Li, Z., & Li, M. (2017) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn.2017.8038411 · Cited by 11
Cited by
Khare, S. K., Blanes-Vidal, V., Nadimi, E. S., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102019 · Cited by 469
Deep learning for motor imagery EEG-based classification: A review
Al-Saegh, A., Dawwd, S. A., & Abdul-Jabbar, J. M. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2020.102172 · Cited by 437
Clustering-Based Speech Emotion Recognition by Incorporating Learned Features and Deep BiLSTM
Mustaqeem, Sajjad, M., & Kwon, S. (2020) · IEEE Access · doi:10.1109/access.2020.2990405 · Cited by 402
Self-citationA Comprehensive Review of Speech Emotion Recognition Systems
Wani, T. M., Gunawan, T. S., Qadri, S. A. A., Kartiwi, M., & Ambikairajah, E. (2021) · IEEE Access · doi:10.1109/access.2021.3068045 · Cited by 376
Khan, N., Ullah, F. U. M., Afnan, Ullah, A., Lee, M. Y., & Baik, S. W. (2021) · IEEE Access · doi:10.1109/access.2020.3047732 · Cited by 98
Metadata
- Authors
- Mustaqeem, & Kwon, S.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2019-12-28
- Volume
- 20
- Issue
- 1
- Pages
- 183
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W2997700007
- Cited by
- 392
- References
- 36
- FWCI
- 46.72
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.