Emotion assessment using Machine Learning and low-cost wearable devices
Abstract
The advancement in bioelectrical measurement technologies and the push towards a higher impact of the Brain Computer Interfaces and Affective Computing in the daily life have made non-invasive and low-priced devices available to the large population to record physiological states. The aim of this study is the assessment of the abilities of the MUSE headband, together with the Shimmer GSR+ device, to assess the emotional state of people during stimuli exposure. Twenty-four pictures from the IAPS database were showed to 54 subjects and were evaluated in their emotional values by means of the Self-Assessment Manikin (SAM). Using a Machine Learning approach, fifty-two scalar features were extracted from the signals and used to train 6 binary classifiers to predict the valence and arousal elicited by each stimulus. In all classifiers we obtained accuracies ranging from 53.6% to 69.9%, confirming that these devices are able to give information about the emotional state.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Authors in [104] and [105] introduce TinyML as a medical embedded system for diagnosis of focal liver lesion (FLL) using a DNN model trained on liver images obtained using ultrasound imaging.
“The authors in [104] and [105] introduce TinyML as a medical embedded system for the diagnosis of of focal liver lesion (FLL) using a DNN model trained on liver images that were priory obtained using ultrasound imaging.”
From A Comprehensive Survey on TinyML (2023) · cites this paper as [105]
Cites
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371 · see citing works
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 1× · see citing works
“In fact, according to the Russell’s circumplex model [9], the knowledge of both arousal and valence is a sufficient condition to uniquely identify the emotions.”
MethodMeasuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538 · see citing works
A Real-Time QRS Detection Algorithm
Pan, J., & Tompkins, W. J. (1985) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1985.325532 · Cited by 7,855 · see citing works
International Affective Picture System (IAPS) : Technical Manual and Affective Ratings
Lang, P. J. (1995) · Medical Entomology and Zoology · Cited by 2,916 · see citing works
ICLabel: An automated electroencephalographic independent component classifier, dataset, and website
Pion-Tonachini, L., Kreutz-Delgado, K., & Makeig, S. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.05.026 · Cited by 2,331 · see citing works
Mauss, I. B., & Robinson, M. D. (2009) · Cognition and Emotion · doi:10.1080/02699930802204677 · Cited by 2,078 · see citing works
Emotions Recognition Using EEG Signals: A Survey
Alarcao, S. M., & Fonseca, M. J. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2714671 · Cited by 1,201 · see citing works
Differential entropy feature for EEG-based emotion classification
Duan, R.-N., Zhu, J., & Lu, B. (2013) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2013.6695876 · Cited by 1,108 · see citing works
EEG artifact removal—state-of-the-art and guidelines
Urigüen, J. A., & García-Zapirain, B. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/3/031001 · Cited by 973 · see citing works
A review of emotion recognition using physiological signals
Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., & Yang, X. (2018) · Sensors · doi:10.3390/s18072074 · Cited by 923 · see citing works
cvxEDA: a Convex Optimization Approach to Electrodermal Activity Processing
Greco, A., Valenza, G., Lanatà, A., Scilingo, E. P., & Citi, L. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2474131 · Cited by 605 · see citing works
The distance function effect on k-nearest neighbor classification for medical datasets
Hu, L., Huang, M., Ke, S., & Tsai, C. (2016) · SpringerPlus · doi:10.1186/s40064-016-2941-7 · Cited by 455 · see citing works
Choosing MUSE: Validation of a Low-Cost, Portable EEG System for ERP Research
Krigolson, O. E., Williams, C. C., Norton, A., Hassall, C. D., & Colino, F. L. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00109 · Cited by 438 · see citing works
Emotion classification based on gamma-band EEG
Li, M., & Lu, B. (2009) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2009.5334139 · Cited by 413 · see citing works
Bota, P. J., Wang, C., Fred, A. L. N., & Silva, H. (2019) · IEEE Access · doi:10.1109/access.2019.2944001 · Cited by 329 · see citing works
A Review on the Computational Methods for Emotional State Estimation from the Human EEG
Kim, M., Kim, M., Oh, E., & Kim, S.-P. (2013) · Computational and Mathematical Methods in Medicine · doi:10.1155/2013/573734 · Cited by 295 · see citing works
EEG-Based Emotion Recognition Using Frequency Domain Features and Support Vector Machines
Wang, X., Nie, D., & Lu, B. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24955-6_87 · Cited by 277 · see citing works
Wearable-Based Affect Recognition—A Review
Schmidt, P., Reiss, A., Dürichen, R., & Laerhoven, K. V. (2019) · Sensors · doi:10.3390/s19194079 · Cited by 267 · see citing works
Usability of four commercially-oriented EEG systems
Hairston, W. D., Whitaker, K. W., Ries, A. J., Vettel, J. M., Bradford, J. C., Kerick, S. E., & McDowell, K. (2014) · Journal of Neural Engineering · doi:10.1088/1741-2560/11/4/046018 · Cited by 216 · see citing works
Emotional ratings and skin conductance response to visual, auditory and haptic stimuli
Gatti, E., Calzolari, E., Maggioni, E., & Obrist, M. (2018) · Scientific Data · doi:10.1038/sdata.2018.120 · Cited by 158 · see citing works
Kleckner, I. R., Jones, R. M., Wilder-Smith, O., Wormwood, J. B., Akcakaya, M., Quigley, K. S., Lord, C., & Goodwin, M. S. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2017.2758643 · Cited by 121 · see citing works
Development of a Novel Wearable Ring-Shaped Biosensor
Santarelli, L., Diyakonova, O., Betti, S., Esposito, D., Castro, E., & Cavallo, F. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8513330 · Cited by 8 · see citing works
EEG correlation at a distance: A re-analysis of two studies using a machine learning approach
Bilucaglia, M., Pederzoli, L., Giroldini, W., Prati, E., & Tressoldi, P. E. (2019) · F1000Research · doi:10.12688/f1000research.17613.2 · Cited by 7 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
A Comprehensive Survey on TinyML
Abadade, Y., Temouden, A., Bamoumen, H., Benamar, N., Chtouki, Y., & Hafid, A. S. (2023) · IEEE Access · doi:10.1109/access.2023.3294111 · Cited by 366 · see citing works
“The authors in [104] and [105] aimed to construct a smart wearable device to achieve the recognition of emotions through physiological signals emitted by the human body.”
BackgroundMethodMachine Learning for Healthcare Wearable Devices: The Big Picture
Sabry, F., Eltaras, T., Labda, W., Alzoubi, K., & Malluhi, Q. (2022) · Journal of Healthcare Engineering · doi:10.1155/2022/4653923 · Cited by 321 · see citing works
Heydari, S., & Mahmoud, Q. H. (2025) · Sensors · doi:10.3390/s25103191 · Cited by 162 · see citing works
Behavioral and Physiological Signals-Based Deep Multimodal Approach for Mobile Emotion Recognition
Yang, K., Wang, C., Gu, Y., Sarsenbayeva, Z., Tag, B., Dingler, T., Wadley, G., & Gonçalves, J. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3100868 · Cited by 106 · see citing works
Accuracy and Precision of Wearable Devices for Real-Time Monitoring of Swimming Athletes
Cosoli, G., Antognoli, L., Veroli, V., & Scalise, L. (2022) · Sensors · doi:10.3390/s22134726 · Cited by 69 · see citing works
Ronca, V., Martinez-Levy, A. C., Vozzi, A., Giorgi, A., Aricò, P., Capotorto, R., Borghini, G., Flumeri, G. D., & Babiloni, F. (2023) · Sensors · doi:10.3390/s23135847 · Cited by 75 · see citing works
Smart Consumer Wearables as Digital Diagnostic Tools: A Review
Chakrabarti, S., Biswas, N., Jones, L., Kesari, S., & Ashili, S. (2022) · Diagnostics · doi:10.3390/diagnostics12092110 · Cited by 68 · see citing works
Cross-subject EEG emotion classification based on few-label adversarial domain adaption
Wang, Y., Liu, J., Ruan, Q., Wang, S., & Wang, C. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115581 · Cited by 47 · see citing works
Employing of machine learning and wearable devices in healthcare system: tasks and challenges
Saad, H. S., Zaki, J. F. W., & Abdelsalam, M. M. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10197-z · Cited by 51 · see citing works
Assessing the Emotional Response in Social Communication: The Role of Neuromarketing
Zito, M., Fici, A., Bilucaglia, M., Ambrogetti, F. S., & Russo, V. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.625570 · Cited by 40 · see citing works
Self-citationOnline Learning for Wearable EEG-Based Emotion Classification
Moontaha, S., Schumann, F. E. F., & Bert Arnrich, A. (2023) · Sensors · doi:10.3390/s23052387 · Cited by 38 · see citing works
Survey on Emotion Sensing Using Mobile Devices
Yang, K., Tag, B., Wang, C., Gu, Y., Sarsenbayeva, Z., Dingler, T., Wadley, G., & Gonçalves, J. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3220484 · Cited by 31 · see citing works
Towards Ubiquitous Personalized Music Recommendation with Smart Bracelets
Li, J., He, Z., Cui, Y., Wang, C., Chen, C., Yu, C. L., Zhang, M., Liu, Y., & Ma, S. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550333 · Cited by 21 · see citing works
User Stress Modeling through Galvanic Skin Response
Satti, F. A., Hussain, M., Hussain, J., Kim, T., Lee, S., & Chung, T. (2021) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1109/imcom51814.2021.9377380 · Cited by 16 · see citing works
Job Assessment Through Bioelectrical Measures: A Neuromanagement Perspective
Zito, M., Bilucaglia, M., Fici, A., Gabrielli, G., & Russo, V. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.673012 · Cited by 18 · see citing works
Self-citationGLADA: Global and Local Associative Domain Adaptation for EEG-Based Emotion Recognition
Pan, T., Su, N., Shan, J., Tang, Y., Zhong, G., Jiang, T., & Zuo, N. (2024) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2024.3432752 · Cited by 14 · see citing works
Machine Learning Human Behavior Detection Mechanism Based on Python Architecture
Jinnuo, Z., Goyal, S. B., Verma, C., Raboacă, M. S., & Mihălţan, T. C. (2022) · Mathematics · doi:10.3390/math10173159 · Cited by 12 · see citing works
Bilucaglia, M., Laureanti, R., Zito, M., Circi, R., Fici, A., Russo, V., & Mainardi, L. T. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9630625 · Cited by 6 · see citing works
Self-citationMachine Learning in Wearable Healthcare Devices
Sureja, N., Mehta, K., Shah, V., & Patel, G. M. (2023) · Springer eBooks · doi:10.1007/978-981-99-0393-1_13 · Cited by 6 · see citing works
Using Wearable Devices for Emotion Recognition in Mobile Human- Computer Interaction: A Review
Wang, T., & Zhang, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17618-0_16 · Cited by 5 · see citing works
Valesi, R., Gabrielli, G., Zito, M., Bellati, M., Bilucaglia, M., Caponetto, A., Fici, A., Galanto, A., Falcone, M. G., & Russo, V. (2023) · Behavioral Sciences · doi:10.3390/bs13070596 · Cited by 9 · see citing works
Self-citationSpectral differences in resting-state EEG associated to individual Emotional Styles
Bilucaglia, M., Laureanti, R., Circi, R., Zito, M., Bellati, M., Fici, A., Rivetti, F., Mainardi, L. T., & Russo, V. (2022) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc48229.2022.9871191 · Cited by 2 · see citing works
Self-citationBravo, B. N., Jiménez, M. V. J., Fernández‐Aguilar, L., Nieto, M., Toledano-González, A., Cantero, M. J., Ros, L., & Latorre, J. M. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1266758 · Cited by 2 · see citing works
Rahmalina, R., & Gunawan, W. (2024) · Cogent Social Sciences · doi:10.1080/23311886.2024.2376309 · Cited by 2 · see citing works
Low-invasive Neurophysiological Evaluation of Human Emotional State on Teleworkers
Ronca, V., Flumeri, G. D., Giorgi, A., Vozzi, A., Aricò, P., Sciaraffa, N., Tamborra, L., Simonetti, I., Florio, A. D., Babiloni, F., et al. (2021) · International Joint Conference on Computational Intelligence · doi:10.5220/0010726700003063 · Cited by 2 · see citing works
Classification of Mental State Using a Muse Headband and Machine Learning Algorithm
Rahman, K. K. M., & Nasor, K. M. (2024) · Lecture notes in electrical engineering · doi:10.1007/978-981-97-0562-7_34 · Cited by 1 · see citing works
Ensembling EEG bands for Mental State Assessment
Yen, W.-T., Zhang, Y. J., Chung, K., Lin, L. N., & Chang, Y. (2022) · International Conference on System Science and Engineering · doi:10.1109/icsse55923.2022.9947359 · Cited by 1 · see citing works
Arousal and Emotional Valence-level Estimations using Non-contact Environmental Sensing
Isogami, T., & Komuro, N. (2023) · IEEE International Conference on Consumer Electronics - Taiwan (ICCE-Taiwan) · doi:10.1109/icce-taiwan58799.2023.10226916 · Cited by 1 · see citing works
Emotions Recognition Based on Physiological Signals Using Machine Learning Techniques
Kumar, T., Singh, R. C., & Kumar, R. (2023) · International Conference on Technological Advancements in Computational Sciences (ICTACS) · doi:10.1109/ictacs59847.2023.10390266 · Cited by 1 · see citing works
TrueWatch: Polygraph Examination With Smartwatches
Alper, R., & Guri, M. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3435409 · Cited by 1 · see citing works
Nirkhi, S. M., Patil, V., Bhat, R., & Patil, S. (2025) · AIP conference proceedings · doi:10.1063/5.0234354 · Cited by 1 · see citing works
Teaching a computer to assess hypnotic depth: A pilot studyPreprint
Obukhov, N. V., Naish, P. L. N., Solnyshkina, I. E., Siourdaki, T. G., & Martynov, I. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.13.467562
Corallo, F., Cappadona, I., D'Aleo, P., Duca, A., Bramanti, P., & Pagano, M. C. (2023) · doi:10.2196/preprints.54984
- Authors
- Laureanti, R., Bilucaglia, M., Zito, M., Circi, R., Fici, A., Rivetti, F., Valesi, R., Oldrini, C., Mainardi, L. T., & Russo, V.
- Affiliations
- Politecnico di Milano (IT)
- IULM University (IT)
- Venue
- 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
- Publisher
- IEEE
- Published
- 2020-07
- Volume
- 2020
- Pages
- 576-579
- ISSN
- 2375-7477 (ISSN-L)
- OpenAlex
- W3082775944
- Cited by
- 33
- References
- 24
- Citations by year
- 2025: 2 · 2024: 6 · 2023: 8 · 2022: 9 · 2021: 8
- FWCI
- 6.08
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (publishedVersion)
- PubMed (publishedVersion)
- Aisberg (University of Bergamo) (submittedVersion)
- Virtual Community of Pathological Anatomy (University of Castilla La Mancha) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Keywords
- emotion measurement, Muse headband, skin conductance, electrodermal activity, valence and arousal prediction, IAPS images, Self-Rating Manikin, low-cost wearable device, affective computing
- MeSH terms
- Machine Learning, Wearable Electronic Devices, Arousal, Emotions, Humans, Brain-Computer Interfaces
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review