The DOI matches its Crossref record; 266 of the 266 references it cites were found in a registry or an index.
Emotion recognition and artificial intelligence: A systematic review (2014–2023) and research recommendations
Open accessAbstract
Emotion recognition is the ability to precisely infer human emotions from numerous sources and modalities using questionnaires, physical signals, and physiological signals. Recently, motion recognition has gained attention because of its diverse application areas, like affective computing, healthcare, human–robot interactions, and market research. This paper provides a comprehensive and systematic review of emotion recognition techniques of the current decade. The paper includes emotion recognition using physical and physiological signals. Physical signals involve speech and facial expression, while physiological signals include electroencephalogram, electrocardiogram, galvanic skin response, and eye tracking. The paper provides an introduction to various emotion models, stimuli used for emotion elicitation, and the background of existing automated emotion recognition systems. This paper covers comprehensive searching and scanning of well-known datasets followed by design criteria for review. After a thorough analysis and discussion, we selected 142 journal articles using PRISMA guidelines. The review provides a detailed analysis of existing studies and available datasets of emotion recognition. Our review analysis also presented potential challenges in the existing literature and directions for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–266 of 266
A novel facial emotion recognition scheme based on graph mining
Hassan, A. K. A., & Mohammed, S. N. (2019) · Defence Technology · doi:10.1016/j.dt.2019.12.006 · Cited by 58
Khare, S. K., Gaikwad, N. B., & Bajaj, V. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3204076 · Cited by 58
Self-citationJerritta, S., Murugappan, M., Khairunizam, W., & Yaacob, S. (2013) · Expert Systems · doi:10.1111/exsy.12014 · Cited by 57
A self-learned decomposition and classification model for schizophrenia diagnosis
Khare, S. K., & Bajaj, V. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106450 · Cited by 57
Self-citation2014 12th International Conference on Signal Processing (ICSP)
(2014) · doi:10.1109/icsp32469.2014 · Cited by 56
Caruelle, D., Shams, P., Gustafsson, A., & Lervik-Olsen, L. (2022) · Marketing Letters · doi:10.1007/s11002-021-09609-0 · Cited by 55
eSEE-d: Emotional State Estimation Based on Eye-Tracking Dataset
Skaramagkas, V., Ktistakis, E., Manousos, D., Kazantzaki, E., Tachos, N. S., Tripoliti, E. E., Fotiadis, D. I., & Tsiknakis, M. (2023) · Brain Sciences · doi:10.3390/brainsci13040589 · Cited by 55
DASPS: A Database for Anxious States based on a Psychological StimulationPreprint
Baghdadi, A., Aribi, Y., Fourati, R., Halouani, N., Siarry, P., & Alimi, A. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.02942 · Cited by 54
Emotion recognition based on fusion of long short-term memory networks and SVMs
Chen, T., Yin, H., Yuan, X., Gu, Y., Ren, F., & Sun, X. N. (2021) · Digital Signal Processing · doi:10.1016/j.dsp.2021.103153 · Cited by 53
Emotion Recognition Based on Brain-Computer Interface Systems
Rached, T. S., & Perkusich, Â. (2013) · InTech eBooks · doi:10.5772/56227 · Cited by 52
Tadalagi, M., & Joshi, A. M. (2021) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-021-02358-2 · Cited by 52
Shoelace pattern-based speech emotion recognition of the lecturers in distance education: ShoePat23
Tanko, D., Doğan, Ş., Demir, F. B., Bayğın, M., Sahin, S. E., & Tuncer, T. (2022) · Applied Acoustics · doi:10.1016/j.apacoust.2022.108637 · Cited by 52
Wu, Q., Dey, N., Shi, F., Crespo, R. A. G., & Sherratt, R. S. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107752 · Cited by 50
Analysis of EEG entropy during visual evocation of emotion in schizophrenia
Chu, W.-L., Huang, M.-W., Jian, B., & Cheng, K. (2017) · Annals of General Psychiatry · doi:10.1186/s12991-017-0157-z · Cited by 47
Murugappan, M., Alshuaib, W. B., Bourisly, A. K., Khare, S. K., Sruthi, S., & Bajaj, V. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242014 · Cited by 46
Self-citationEmotional speech comprehension in children and adolescents with autism spectrum disorders
Sourn‐Bissaoui, S. L., Aguert, M., Girard, P., Chevreuil, C., & Laval, V. (2013) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2013.03.002 · Cited by 45
Galvanic Skin Response Data Classification for Emotion Detection
Setyohadi, D. B., Kusrohmaniah, S., Gunawan, S. B., Pranowo, P., & Prabuwono, A. S. (2018) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v8i5.pp4004-4014 · Cited by 42
Multi-modal Correlated Network for emotion recognition in speech
Ren, M., Nie, W., Liu, A.-A., & Su, Y. (2019) · Visual Informatics · doi:10.1016/j.visinf.2019.10.003 · Cited by 41
Oğuz, F. E., Alkan, A., & Schöler, T. (2023) · Signal Image and Video Processing · doi:10.1007/s11760-023-02606-y · Cited by 41
Explicit Facial Emotion Processing in Patients With Dissociative Seizures
Pick, S., Mellers, J. D. C., & Goldstein, L. H. (2016) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000327 · Cited by 38
CyTex: Transforming speech to textured images for speech emotion recognition
Bakhshi, A., Harimi, A., & Chalup, S. K. (2022) · Speech Communication · doi:10.1016/j.specom.2022.02.007 · Cited by 38
Uyanık, H., Özçelik, S. T. A., Duranay, Z. B., Şengür, A., & Acharya, U. R. (2022) · Diagnostics · doi:10.3390/diagnostics12102508 · Cited by 38
Self-citationMultilevel Data and Decision Fusion Using Heterogeneous Sensory Data for Autonomous Vehicles
Ignatious, H. A., El‐Sayed, H., & Kulkarni, P. (2023) · Remote Sensing · doi:10.3390/rs15092256 · Cited by 38
Derbali, M., Jarrah, M., & Randhawa, P. (2023) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2023.0140112 · Cited by 37
Multi-stage classification of emotional speech motivated by a dimensional emotion model
Xiao, Z., Dellandréa, E., Dou, W., & Chen, L. (2009) · Multimedia Tools and Applications · doi:10.1007/s11042-009-0319-3 · Cited by 35
Tiwari, S., & Agarwal, S. (2021) · Big Data · doi:10.1089/big.2020.0256 · Cited by 34
Blanes‐Vidal, V., Bælum, J., Nadimi, E. S., Løfstrøm, P., & Christensen, L. P. (2014) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2014.05.041 · Cited by 33
Self-citationCantuaria, M. L., Brandt, J. G., & Blanes‐Vidal, V. (2023) · Environmental Research · doi:10.1016/j.envres.2023.115770 · Cited by 31
Self-citationA Review of Federated Meta-Learning and Its Application in Cyberspace Security
Liu, F., Li, M., Liu, X., Xue, T., Ren, J. F., & Zhang, C. (2023) · Electronics · doi:10.3390/electronics12153295 · Cited by 31
Facial emotion classification using concatenated geometric and textural features
Sen, D., Datta, S., & Raman, B. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6537-9 · Cited by 30
Hybrid spatiotemporal models for sentiment classification via galvanic skin response
Sun, X. N., Hong, T., Li, C., & Ren, F. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.05.061 · Cited by 30
Understanding Emotion Changes in Mobile Experience Sampling
Kang, S., Park, C. Y., Kim, A., Cha, N., & Lee, U. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501944 · Cited by 29
Goshvarpour, A., Abbasi, A., Goshvarpour, A., & Danishvar, S. (2017) · Signal Image and Video Processing · doi:10.1007/s11760-017-1092-9 · Cited by 28
Kumar, R. J. R., Sundaram, M., & Arumugam, N. (2020) · The Visual Computer · doi:10.1007/s00371-020-01988-1 · Cited by 28
Revealing Preference in Popular Music Through Familiarity and Brain Response
Sangnark, S., Autthasan, P., Ponglertnapakorn, P., Chalekarn, P., Sudhawiyangkul, T., Trakulruangroj, M., Songsermsawad, S., Assabumrungrat, R., Amplod, S., Ounjai, K., et al. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3073040 · Cited by 28
Emotion Recognition With Knowledge Graph Based on Electrodermal Activity
Fordson, H. P., Xing, X., Guo, K., & Xu, X. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.911767 · Cited by 28
Robust Human Face Emotion Classification Using Triplet-Loss-Based Deep CNN Features and SVM
Haider, I., Yang, H.-J., Lee, G.-S., & Kim, S.-H. (2023) · Sensors · doi:10.3390/s23104770 · Cited by 28
Maeng, J., Kang, D.-H., & Kim, D. (2020) · Electronics · doi:10.3390/electronics9121988 · Cited by 27
Gupta, S., Singh, A., & Ranjan, J. (2023) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-023-01861-z · Cited by 27
Hammad, D. S., & Monkaresi, H. (2022) · Traitement du signal · doi:10.18280/ts.390105 · Cited by 22
McKay, E., Cornish, K. M., & Kirk, H. (2022) · Clinical Child Psychology and Psychiatry · doi:10.1177/13591045221141770 · Cited by 22
Yang, Z., & Huang, Y. J. (2021) · Evolutionary Intelligence · doi:10.1007/s12065-020-00532-3 · Cited by 21
Face processing in young adults with autism and ADHD: An event related potentials study
Aydın, Ü., Cañigueral, R., Tye, C., & McLoughlin, G. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1080681 · Cited by 20
Facial expression-based indicators of schizophrenia: Evidence from recent research
Mandal, M. K., Habel, U., & Gur, R. C. (2023) · Schizophrenia Research · doi:10.1016/j.schres.2023.01.016 · Cited by 19
A NOVEL SIGNAL-BASED FUSION APPROACH FOR ACCURATE MUSIC EMOTION RECOGNITION
Goshvarpour, A., Abbasi, A., Goshvarpour, A., & Danishvar, S. (2016) · Biomedical Engineering Applications Basis and Communications · doi:10.4015/s101623721650040x · Cited by 18
Minhad, K. N., Ali, S. H. M., & Reaz, M. B. I. (2017) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 17
Raghavendra, U., Gudigar, A., Chakole, Y., Kasula, P., Puthankattil, S. D., Kadri, N. A., Ciaccio, E. J., & Acharya, U. R. (2021) · Expert Systems · doi:10.1111/exsy.12803 · Cited by 15
Self-citationIvanov, R. A., Владимирович, К. Ф., Zavarzin, E. A., Klimenko, A. I., Milakhina, N. S., Matushkin, Y. G., Savostyanov, A. N., & Lashin, S. A. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12010053 · Cited by 15
Denız, E., Sobahi, N. M., Omar, N., Şengür, A., & Acharya, U. R. (2022) · Health Information Science and Systems · doi:10.1007/s13755-022-00201-y · Cited by 14
Self-citationFuzzy‐HMM modeling for emotion detection using electrocardiogram signals
Pan, S., & Li, W. (2020) · Asian Journal of Control · doi:10.1002/asjc.2375 · Cited by 12
Parkinson’s Disease Detection based on Changes of Emotions during Speech
Skibińska, J., & Bürget, R. (2020) · International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT) · doi:10.1109/icumt51630.2020.9222446 · Cited by 12
Li, Y., Deng, J., Wu, Q., & Wang, Y. (2021) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2021.06.002 · Cited by 12
Gait-Based Emotion Detection of Children with Autism Spectrum Disorders: A Preliminary Investigation
Jamil, N., Khir, N. H. M., Ismail, M., & Razak, F. H. A. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.12.305 · Cited by 11
An anti-attack method for emotion categorization from images
Shehu, H. A., Browne, W. N., & Eisenbarth, H. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109456 · Cited by 11
Maturana, W., Lobo, I., Landeira-Fernández, J., & Mograbi, D. C. (2023) · Physiology & Behavior · doi:10.1016/j.physbeh.2023.114250 · Cited by 11
A note on the affective computing systems and machines: a classification and appraisal
Weichbroth, P., & Sroka, W. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.09.441 · Cited by 10
Emotion recognition and baseline cortisol levels relationship in early Alzheimer disease
Ferrer, I., Ferré‐González, L., García‐Lluch, G., Peña‐Bautista, C., Álvarez-Sánchez, L., Baquero, M., & Cháfer‐Pericás, C. (2023) · Biological Psychology · doi:10.1016/j.biopsycho.2023.108511 · Cited by 10
Facial Expression Recognition of Emotional Situations in Mild and Moderate Alzheimer’s Disease
Brandt, M., Silva, F. D. O., Neto, J. P. S., Baptista, M. A. T., Belfort, T. T., Lacerda, I. B., & Dourado, M. C. N. (2023) · Journal of Geriatric Psychiatry and Neurology · doi:10.1177/08919887231175432 · Cited by 10
Learning implicit sentiments in Alzheimer's disease recognition with contextual attention features
Liu, N., Yuan, Z., Chen, Y., Liu, C., & Wang, L. (2023) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2023.1122799 · Cited by 9
Goshvarpour, A., Abbasi, A., Goshvarpour, A., & Danishvar, S. (2016) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.22038/ijmp.2016.7960 · Cited by 7
Loughborough University Multimodal Emotion Dataset - 2
Ekmekcioǧlu, E., & Çimtay, Y. (2020) · Figshare · doi:10.6084/m9.figshare.12644033 · Cited by 7
Righi, S., Gronchi, G., Ramat, S., Gavazzi, G., Cecchi, F., & Viggiano, M. P. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01069-5 · Cited by 5
Exploring Pupil Position as An Eye-Tracking Feature for Four-Class Emotion Classification In VR
Lim, J. Z., Mountstephens, J., & Teo, J. (2021) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2129/1/012069 · Cited by 4
Sacco, L., Morellini, L., & Cerami, C. (2023) · Frontiers in Neurology · doi:10.3389/fneur.2023.1162510 · Cited by 3
Cited by
The AI-mediated intimacy economy: a paradigm shift in digital interactions
Bozdağ, A. A. (2025) · AI & SOCIETY · doi:10.1007/s00146-024-02132-6 · Cited by 42
Creating safe environments for children: prevention of trauma in the Extended Verse
Jane Patel, N. (2025) · Empathic Computing · doi:10.70401/ec.2025.0003 · Cited by 4
AI-Driven Learning: Current Applications, Challenges, and Future Prospects
Ismail, I. A., Alkhateeb, M. O., & Alkaabi, M. H. (2025) · Advances in Computational Intelligence and Robotics · doi:10.4018/979-8-3693-7873-1.ch001 · Cited by 1
Metadata
- Authors
- Khare, S. K., Blanes-Vidal, V., Nadimi, E. S., & Acharya, U. R.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2024-02
- Volume
- 102
- Pages
- 102019
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W4386800155
- Cited by
- 469
- References
- 266
- FWCI
- 23.65
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.