Interactive emotional content communications system using portable wireless biofeedback device
Abstract
In this paper, we implemented an interactive emotional content communication system using a portable wireless biofeedback device to support convenient emotion recognition and immersive emotional content representation for users. The newly designed system consists of the portable wireless biofeedback device and a novel emotional content rendering system. The former performs the acquisition and transmission of three different physiological signals (photoplethysmography, skin temperature, and galvanic skin response) to the remote emotional content rendering system via Bluetooth links in real time. The latter displays video content concurrently manipulated using the feedback of the user¿s emotional state. The results of effectiveness of the system indicated that the response time of the emotional content communication system was nearly instant, the changes of between emotional contents and emotional states base on physiological signals was corresponded. The user¿s concentration was increased by watching the measuredemotion- based rendered visual stimuli. In the near future, the users of this proposed system will be able to create further substantial user-oriented content based on emotional changes.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Conventional stress monitoring devices using commercial physiological sensors have bulky size to be worn or carried for daily time use.
“The conventional researches about stress monitoring devices are focused on designing completed systems using commercial physiological sensors; thereby having bulky size41 to be worn or carried for daily time use.”
From A Flexible and Wearable Human Stress Monitoring Patch (2016) · cites this paper as [41]
Cites
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · see citing works
Davies, A., & Fennessy, P. (2001) · Elsevier eBooks · doi:10.1016/b978-0-240-51590-8.50007-x · Cited by 4,378 · see citing works
Autonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188 · cited 1× · see citing works
“A. Emotion Recognition using Physiological Signals As previously mentioned, real-time emotion recognition is a great challenge for the current methodology because of the high demands for robustness and comfort.”
MethodEmotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603 · see citing works
Emotion recognition based on physiological changes in music listening
Kim, J., & André, E. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.26 · Cited by 1,079 · see citing works
Self-citationPhysiological signals based human emotion Recognition: a review
Jerritta, S., Murugappan, M., Nagarajan, R., & Khairunizam, W. (2011) · IEEE International Colloquium on Signal Processing & Its Applications (CSPA) · doi:10.1109/cspa.2011.5759912 · Cited by 349 · see citing works
Autonomic nervous system response patterns specificity to basic emotions
Collet, C., Vernet-Maury, E., Delhomme, G., & Dittmar, A. (1997) · Journal of the Autonomic Nervous System · doi:10.1016/s0165-1838(96)00108-7 · Cited by 287 · see citing works
Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech
Castellano, G., Kessous, L., & Caridakis, G. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85099-1_8 · Cited by 267 · see citing works
Recognizing Human Emotional State From Audiovisual Signals
Wang, Y., & Guan, L. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.921734 · Cited by 213 · see citing works
Emotion representation and physiology assignments in digital systems
Peter, C., & Herbon, A. (2006) · Interacting with Computers · doi:10.1016/j.intcom.2005.10.006 · Cited by 150 · see citing works
Audio–Visual Affective Expression Recognition Through Multistream Fused HMM
Zeng, Z., Tu, J., Pianfetti, B., & Huang, T. S. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.921737 · Cited by 134 · see citing works
Emotion Recognition in Text for 3-D Facial Expression Rendering
Calix, R. A., Mallepudi, S. A., Chen, B., & Knapp, G. M. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2052026 · Cited by 52 · see citing works
Emotion recognition with consideration of facial expression and physiological signals
Chang, C., Tsai, J.-S., Wang, C., & Chung, P. (2009) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb.2009.4925739 · Cited by 51 · see citing works
Cognitive face analysis system for future interactive TV
An, K. H., & Chung, M. J. (2009) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2009.5373798 · Cited by 37 · see citing works
Based on Support Vector Regression for emotion recognition using physiological signals
Chang, C., Zheng, J.-Y., & Wang, C. (2010) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596878 · Cited by 24 · see citing works
Wearable Systems for Service based on Physiological Signals
Ryoo, D.-W., Kim, Y. S., & Lee, J.-W. (2005) · doi:10.1109/iembs.2005.1616961 · Cited by 20 · see citing works
Batliner, A., Hönig, F., Nöth, E., & Wagner, J. (2009) · INFM-OAR (INFN Catania) · doi:10.5281/zenodo.41642 · Cited by 20 · see citing works
Smart cameras: 2D affine models for determining subject facial expressions
Bacivarov, I., Corcoran, P., & Ionita, M. C. (2010) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2010.5505930 · Cited by 19 · see citing works
Robust Gaze Tracking Method for Stereoscopic Virtual Reality Systems
Lee, E. C., Park, K. R., Whang, M. C., & Park, J. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73110-8_76 · Cited by 18 · see citing works
Self-citationAre Computers Capable of Understanding Our Emotional States?
Whang, M. C., Lim, J. S., Park, K. R., Cho, Y., & Boucsein, W. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73331-7_22 · Cited by 8 · see citing works
Self-citationThe study on emotion recognition by time-dependent parameters of autonomic nervous response
Kim, J., Whang, M., Kim, Y., & Woo, J. (2008) · 감성과학 · Cited by 6 · see citing works
Self-citationKim, J., Whang, M., & Woo, J. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02574-7_9 · Cited by 5 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
A Flexible and Wearable Human Stress Monitoring Patch
Yoon, S., Sim, J. K., & Cho, Y.-H. (2016) · Scientific Reports · doi:10.1038/srep23468 · Cited by 151 · see citing works
Self-citationChen, M., Zhou, P., & Fortino, G. (2016) · IEEE Access · doi:10.1109/access.2016.2641480 · Cited by 150 · see citing works
Real-Time Speech Emotion Analysis for Smart Home Assistants
Chatterjee, R., Mazumdar, S., Sherratt, R. S., Halder, R., Maitra, T., & Giri, D. (2021) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2021.3056421 · Cited by 135 · see citing works
Minhad, K. N., Ali, S. H. M., & Reaz, M. B. I. (2017) · Journal of Transport & Health · doi:10.1016/j.jth.2017.11.001 · Cited by 64 · see citing works
Oh, S., Lee, J., & Kim, D. K. (2020) · Sensors · doi:10.3390/s20030866 · Cited by 59 · see citing works
Self-citationYang, N., Dey, N., Sherratt, R. S., & Shi, F. (2020) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-179963 · Cited by 36 · see citing works
Interactive emotional lighting system using physiological signals
Kim, D. K., Ahn, S.-M., Park, S., & Whang, M. (2013) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2013.6689687 · Cited by 26 · see citing works
Self-citationKim, H., Ben‐Othman, J., Mokdad, L., & Bellavista, P. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3024059 · Cited by 18 · see citing works
IOT enabled sensor in multimodal intelligent applications for children with special needs
Rahman, M. A., & Bhuiyan, M. (2015) · Internet Technologies and Applications (ITA) · doi:10.1109/itecha.2015.7317425 · Cited by 12 · see citing works
On the Influence of Emotional Feedback on Emotion Awareness and Gaze Behavior
Ringeval, F., Sonderegger, A., Noris, B., Billard, A., Sauer, J., & Lalanne, D. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.80 · Cited by 11 · see citing works
Comparative analysis of affective and physiological responses to emotional movies
Kim, D.-K., Cho, Y., & Park, K.-S. (2018) · Human-centric Computing and Information Sciences · doi:10.1186/s13673-018-0138-5 · Cited by 11 · see citing works
Self-citationMulti-task emotion communication system with dynamic resource allocations
Zhou, P., Hossain, M. S., Zong, X., Muhammad, G., Amin, S. U., & Humar, I. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.03.003 · Cited by 8 · see citing works
Efficacy of Using Retro Games in Multimodal Biofeedback Systems for Mental Relaxation
Chand, K., & Khosla, A. (2022) · International Journal of Gaming and Computer-Mediated Simulations · doi:10.4018/ijgcms.295874 · Cited by 4 · see citing works
A Framework for the Creating, Expressing and Sharing of User’s Emotion
Park, K.-S., Cho, Y., & Kim, D. K. (2014) · International Journal of Multimedia and Ubiquitous Engineering · doi:10.14257/ijmue.2014.9.1.39 · Cited by 4 · see citing works
Self-citationOn Virtual Emotion Barrier in Internet of Things
Kim, H., Ben‐Othman, J., Cho, S., & Mokdad, L. (2018) · International Conference on Communications · doi:10.1109/icc.2018.8422624 · Cited by 4 · see citing works
Real-Time Mobile Emotional Content Player Using Smartphone Camera-Based PPG Measurement
Lee, H., & Kim, D. K. (2019) · Mobile Information Systems · doi:10.1155/2019/5820437 · Cited by 4 · see citing works
Self-citationChand, K., & Khosla, A. (2022) · Journal of Information Technology Research · doi:10.4018/jitr.299922 · Cited by 4 · see citing works
Mediating individual affective experience through the emotional photo frame
Kim, D. K., Cho, Y., & Park, K.-S. (2015) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-140296 · Cited by 4 · see citing works
Self-citationDelay-Bounded Virtual Emotion Recognition Using IoT Barriers in Advanced Smart Environment
Kim, H., Ben‐Othman, J., Mokdad, L., Neilson, G., & Bellavista, P. (2019) · Globecom · doi:10.1109/globecom38437.2019.9013423 · Cited by 2 · see citing works
Half-Against-Half Multi-class SVM Classify Physiological Response-based Emotion Recognition
Vanny, M., Ko, K.-E., Park, S.-M., & Sim, K.-B. (2013) · Journal of Korean institute of intelligent systems · doi:10.5391/jkiis.2013.23.3.262
Spiridon, E. (2017) · Liverpool John Moores University · doi:10.24377/ljmu.t.00006829
On Seamless Hole-free Virtual Emotion Barrier in IoT-enabled Smart Cities
Kim, H., & Lim, K. (2018) · IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON) · doi:10.1109/uemcon.2018.8796772
- Authors
- Kim, D., Kim, J., Lee, E., Whang, M., & Cho, Y.
- Affiliations
- Sangmyung University (KR)
- National Institute for Mathematical Sciences (KR)
- Venue
- IEEE Transactions on Consumer Electronics
- Published
- 2011-11
- Volume
- 57
- Issue
- 4
- Pages
- 1929-1936
- ISSN
- 0098-3063 (ISSN-L)
- OpenAlex
- W2118026452
- Cited by
- 22
- References
- 22
- Citations by year
- 2022: 2 · 2021: 1 · 2020: 3 · 2019: 3 · 2018: 3 · 2017: 2 · 2016: 2 · 2015: 2 · 2014: 1 · 2013: 3
- FWCI
- 1.65
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Consumer Electronics (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Keywords
- emotion recognition, biofeedback device, physiological signals, photoplethysmography, skin temperature, skin conductance, Bluetooth, immersive media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review