DeepVANet: A Deep End-to-End Network for Multi-modal Emotion Recognition
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Ekman, P. (1992) · Psychological Review · doi:10.1037//0033-295x.99.3.550 · Cited by 2,372
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Bulat, A., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.116 · Cited by 1,464
Bulat, A., & Tzimiropoulos, G. (2017) · Nottingham ePrints (University of Nottingham) · Cited by 1,277
A review of emotion recognition using physiological signals
Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., & Yang, X. (2018) · Sensors · doi:10.3390/s18072074 · Cited by 923
A Brief Review of Facial Emotion Recognition Based on Visual Information
Ko, B. (2018) · Sensors · doi:10.3390/s18020401 · Cited by 724
Emotion Recognition based on EEG using LSTM Recurrent Neural Network
Alhagry, S., Aly, A., & A., R. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.081046 · Cited by 645
An automated system for epilepsy detection using EEG brain signals based on deep learning approach
Ullah, I., Hussain, M., Qazi, E.-U.-H., & Aboalsamh, H. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.04.021 · Cited by 622
Human Emotion Recognition: Review of Sensors and Methods
Dzedzickis, A., Kaklauskas, A., & Bucinskas, V. (2020) · Sensors · doi:10.3390/s20030592 · Cited by 582
Recurrent Neural Networks for Emotion Recognition in Video
Ebrahimi Kahou, S., Michalski, V., Konda, K., Memisevic, R., & Pal, C. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2830596 · Cited by 379
Emotion Recognition from Multi-Channel EEG through Parallel Convolutional Recurrent Neural Network
Yang, Y., Wu, Q., Qiu, M., Wang, Y., & Chen, X. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489331 · Cited by 325
Context-Aware Emotion Recognition Networks
Lee, J., Kim, S., Kim, S., Park, J., & Sohn, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01024 · Cited by 323
Emotion Recognition Using Multimodal Deep Learning
Liu, W., Zheng, W.-L., & Lu, B.-L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46672-9_58 · Cited by 301
Ghimire, D., & Lee, J. (2013) · Sensors · doi:10.3390/s130607714 · Cited by 291
EEG-Based BCI Emotion Recognition: A Survey
Torres, E. P., Torres, E. A., Hernández-Álvarez, M., & Yoo, S. G. (2020) · Sensors · doi:10.3390/s20185083 · Cited by 291
AFEW-VA database for valence and arousal estimation in-the-wild
Kossaifi, J., Tzimiropoulos, G., Todorovic, S., & Pantic, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.02.001 · Cited by 236
Utilizing Deep Learning Towards Multi-Modal Bio-Sensing and Vision-Based Affective Computing
Siddharth, Jung, T.-P., & Sejnowski, T. J. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2916015 · Cited by 232
Fusion of facial expressions and EEG for implicit affective tagging
Koelstra, S., & Patras, I. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.10.002 · Cited by 228
Multimodal Emotion Recognition Using Deep Neural Networks
Tang, H., Liu, W., Zheng, W.-L., & Lu, B.-L. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70093-9_86 · Cited by 194
Audio-Visual Affect Recognition
Zeng, Z., Tu, J., Liu, M., Huang, T. S., Pianfetti, B., Roth, D., & Levinson, S. (2007) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2006.886310 · Cited by 136
Combining Facial Expressions and Electroencephalography to Enhance Emotion Recognition
Huang, Y., Yang, J., Liu, S., & Pan, J. (2019) · Future Internet · doi:10.3390/fi11050105 · Cited by 124
Expression-EEG Based Collaborative Multimodal Emotion Recognition Using Deep AutoEncoder
Zhang, H. (2020) · IEEE Access · doi:10.1109/access.2020.3021994 · Cited by 122
Salama, E. S., El-Khoribi, R. A., Shoman, M. E., & Wahby Shalaby, M. A. (2021) · Egyptian Informatics Journal · doi:10.1016/j.eij.2020.07.005 · Cited by 117
C-GCN: Correlation Based Graph Convolutional Network for Audio-Video Emotion Recognition
Nie, W., Ren, M., Nie, J., & Zhao, S. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3032037 · Cited by 105
Yan, J., Zheng, W., Xu, Q., Lu, G., Li, H., & Wang, B. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2557721 · Cited by 102
Emotion Classification in Arousal Valence Model using MAHNOB-HCI Database
Wiem, M. B. H., & Lachiri, Z. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.080344 · Cited by 101
A real time facial expression classification system using Local Binary Patterns
Happy, S. L., George, A., & Routray, A. (2012) · 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI) · doi:10.1109/ihci.2012.6481802 · Cited by 92
A real-time robust facial expression recognition system using HOG features
Kumar, P., Happy, S. L., & Routray, A. (2016) · International Conference on Computing, Analytics and Security Trends · doi:10.1109/cast.2016.7914982 · Cited by 90
An Efficient Approach to EEG-Based Emotion Recognition using LSTM Network
Anubhav, A., Nath, D., Singh, M., Sethia, D., Kalra, D., & Indu, S. (2020) · IEEE International Colloquium on Signal Processing & Its Applications (CSPA) · doi:10.1109/cspa48992.2020.9068691 · Cited by 62
3D-CNN for Facial Emotion Recognition in Videos
Haddad, J. E., Lézoray, O., & Hamel, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64559-5_23 · Cited by 62
Brain-Computer Interface (BCI): Types, Processing Perspectives and Applications
Panoulas, K. J., Hadjileontiadis, L. J., & Panas, S. M. (2010) · Smart innovation, systems and technologies · doi:10.1007/978-3-642-13396-1_14 · Cited by 51
End-to-End Continuous Emotion Recognition from Video Using 3D Convlstm Networks
Huang, J., Li, Y., Tao, J., Lian, Z., & Yi, J. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461963 · Cited by 35
EEG Emotion Recognition Based on Granger Causality and CapsNet Neural Network
Guo, J., Fang, F., Wang, W., & Ren, F. (2018) · IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS) · doi:10.1109/ccis.2018.8691230 · Cited by 23
RealSmileNet: A Deep End-to-End Network for Spontaneous and Posed Smile Recognition
Yang, Y., Hossain, M. Z., Gedeon, T., & Rahman, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69541-5_2 · Cited by 11
Self-citation(1996)
Research works printed but not linked: 1
- Kingma, D.P., Ba, J.L.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014) · arXiv
Cited by
EEG-Based Multimodal Emotion Recognition: A Machine Learning Perspective
Liu, H., Lou, T., Zhang, Y., Wu, Y., Xiao, Y., Jensen, C. S., & Zhang, D. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3369130 · Cited by 175
Self-citationUsing transformers for multimodal emotion recognition: Taxonomies and state of the art review
Hazmoune, S., & Bougamouza, F. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108339 · Cited by 169
Multimodal Emotion Recognition From EEG Signals and Facial Expressions
Wang, S., Qu, J., Zhang, Y., & Zhang, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3263670 · Cited by 124
“DeepVANet [24] pre-trained on the AFEW-VA database as an encoder to extract facial features.”
MethodSelf-citationBrain Emotion Perception Inspired EEG Emotion Recognition With Deep Reinforcement Learning
Li, D., Li, X., Wang, Z., & Yang, H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3265730 · Cited by 83
Emotion recognition using cross-modal attention from EEG and facial expression
Cui, R., Chen, W., & Li, M. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112587 · Cited by 32
Metadata
- Authors
- Zhang, Y., Hossain, M. Z., & Rahman, S.
- Affiliations
- Australian National University (AU)
- North South University (BD)
- Corresponding author
- Rahman, Shafin
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2021
- Volume
- LNCS-12934
- Issue
- Part III
- Pages
- 227-237
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W3193776664
- Cited by
- 29
- References
- 38
- Citations by year
- 2025: 10 · 2024: 10 · 2023: 6 · 2022: 2 · 2021: 1
- FWCI
- 5.28
- Type
- conference paper
- Language
- en
- Open access
- green
- inria.hal.science
- Licence
- cc-by
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Lecture notes in computer science (publishedVersion)
- HAL (submittedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- multimodal emotion recognition, facial expression recognition, EEG, electrocardiogram, ConvLSTM, 1D convolutional neural network, end-to-end deep learning, DEAP dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.