The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
ASCERTAIN: Emotion and Personality Recognition Using Commercial Sensors
Abstract
We present ASCERTAIN-a multimodal databaASe for impliCit pERsonaliTy and Affect recognitIoN using commercial physiological sensors. To our knowledge, ASCERTAIN is the first database to connect personality traits and emotional states via physiological responses. ASCERTAIN contains big-five personality scales and emotional self-ratings of 58 users along with their Electroencephalogram (EEG), Electrocardiogram (ECG), Galvanic Skin Response (GSR) and facial activity data, recorded using off-the-shelf sensors while viewing affective movie clips. We first examine relationships between users' affective ratings and personality scales in the context of prior observations, and then study linear and non-linear physiological correlates of emotion and personality. Our analysis suggests that the emotion-personality relationship is better captured by non-linear rather than linear statistics. We finally attempt binary emotion and personality trait recognition using physiological features. Experimental results cumulatively confirm that personality differences are better revealed while comparing user responses to emotionally homogeneous videos, and above-chance recognition is achieved for both affective and personality dimensions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303
Influence of extraversion and neuroticism on subjective well-being: Happy and unhappy people
Costa, P. T., & McCrae, R. R. (1980) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.38.4.668 · Cited by 2,652 · cited 1×
“relate with positive valence in a number of works [52].”
BackgroundEmotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
An overlap invariant entropy measure of 3D medical image alignment
Studholme, C., Hill, D. L. G., & Hawkes, D. J. (1999) · Pattern Recognition · doi:10.1016/s0031-3203(98)00091-0 · Cited by 2,180
Emotion elicitation using films
Gross, J. J., & Levenson, R. W. (1995) · Cognition & Emotion · doi:10.1080/02699939508408966 · Cited by 2,179
Exposure and affect: Overview and meta-analysis of research, 1968–1987.
Bornstein, R. F. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.106.2.265 · Cited by 1,970 · cited 1×
“mere exposure effect observed in [49] attributing liking to familiarity.”
BackgroundA Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Eysenck, H. J. (1991) · Explorations in Temperament · doi:10.1007/978-1-4899-0643-4_7 · Cited by 1,332
A 3D Facial Expression Database For Facial Behavior Research
Yin, L., Wei, X., Sun, Y., Wang, J., & Rosato, M. J. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.6 · Cited by 1,171
Emotion recognition based on physiological changes in music listening
Kim, J., & Andre, E. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.26 · Cited by 1,082
Using linguistic cues for the automatic recognition of personality in conversation and text
Mairesse, F., Walker, M. A., Mehl, M. R., & Moore, R. K. (2007) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2349 · Cited by 1,046
Web-Based Database for Facial Expression Analysis
Pantic, M., Valstar, M., Rademaker, R., & Maat, L. (2005) · 2005 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2005.1521424 · Cited by 1,039
Toward detecting emotions in spoken dialogs
Lee, C. M., & Narayanan, S. S. (2005) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2004.838534 · Cited by 988
Modeling naturalistic affective states via facial and vocal expressions recognition
Caridakis, G., Malatesta, L., Kessous, L., Amir, N., Raouzaiou, A., & Karpouzis, K. (2006) · International Conference on Multimodal Interaction · doi:10.1145/1180995.1181029 · Cited by 932
A Survey of Personality Computing
Vinciarelli, A., & Mohammadi, G. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2330816 · Cited by 540
Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals
Lisetti, C. L., & Nasoz, F. (2004) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s1110865704406192 · Cited by 432
Olguin, D. O., Waber, B. N., Kim, T., Mohan, A., Ara, K., & Pentland, A. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2006638 · Cited by 420
Emotion recognition in human–computer interaction
Fragopanagos, N., & Taylor, J. G. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.03.006 · Cited by 414
DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses
Abadi, M. K., Subramanian, R., Kia, S. M., Avesani, P., Patras, I., & Sebe, N. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2392932 · Cited by 365
Self-citationDouglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., Martin, J.-C., Devillers, L., Abrilian, S., Batliner, A., et al. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74889-2_43 · Cited by 321
How to find trouble in communication
Batliner, A., Fischer, K., Huber, R., Spilker, J., & Nöth, E. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00079-1 · Cited by 280
Relationships among extraversion, openness to experience, and sensation seeking
Aluja, A., Garcı́a, Ó., & Garcı́a, L. F. (2003) · Personality and Individual Differences · doi:10.1016/s0191-8869(02)00244-1 · Cited by 248
Witvliet, C. V. O., & Vrana, S. R. (2007) · Cognition & Emotion · doi:10.1080/02699930601000672 · Cited by 246
Fusion of facial expressions and EEG for implicit affective tagging
Koelstra, S., & Patras, I. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.10.002 · Cited by 228
Emotion Recognition Based on Joint Visual and Audio Cues
Sebe, N., Cohen, I., Gevers, T., & Huang, T. S. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.489 · Cited by 202
Self-citationVideo Affective Content Analysis: A Survey of State-of-the-Art Methods
Wang, S., & Ji, Q. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2432791 · Cited by 195
Personality, media preferences, and cultural participation
Kraaykamp, G., & Eijck, K. V. (2005) · Personality and Individual Differences · doi:10.1016/j.paid.2004.11.002 · Cited by 194
SALSA: A Novel Dataset for Multimodal Group Behavior Analysis
Alameda-Pineda, X., Staiano, J., Subramanian, R., Batrinca, L., Ricci, E., Lepri, B., Lanz, O., & Sebe, N. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2496269 · Cited by 171
Self-citationFriends don't lie: inferring personality traits from social network structure
Staiano, J., Lepri, B., Aharony, N., Pianesi, F., Sebe, N., & Pentland, A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370266 · Cited by 169
Self-citationPersonality and the EEG: Arousal and emotional arousability
Stenberg, G. (1992) · Personality and Individual Differences · doi:10.1016/0191-8869(92)90025-k · Cited by 145
Batliner, A. M., Hacker, C., Steidl, S., Nöth, E., D’Arcy, S., Russell, M. J., & Wong, M. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2g6tkyi6gw2r · Cited by 144
Personality modulates the effects of emotional arousal and valence on brain activation
Kehoe, E. G., Toomey, J. M., Balsters, J. H., & Bokde, A. L. W. (2011) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr059 · Cited by 118
Joho, H., Staiano, J., Sebe, N., & Jose, J. (2010) · Multimedia tools and applications · doi:10.1007/s11042-010-0632-x · Cited by 104
Self-citationSpace speaks: towards socially and personality aware visual surveillance
Zen, G., Lepri, B., Ricci, E., & Lanz, O. (2010) · doi:10.1145/1878039.1878048 · Cited by 101
Why Extraverts Are Happier Than Introverts: The Role of Mood Regulation
Lischetzke, T., & Eid, M. (2006) · Journal of Personality · doi:10.1111/j.1467-6494.2006.00405.x · Cited by 96
Individual differences in the experience of emotions
Winter, K. A., & Kuiper, N. A. (1997) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00057-3 · Cited by 95
Connecting Meeting Behavior with Extraversion—A Systematic Study
Lepri, B., Subramanian, R., Kalimeri, K., Staiano, J., Pianesi, F., & Sebe, N. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.17 · Cited by 93
Self-citationLexical Predictors Of Personality Type
Argamon, S., Dhawle, S., Koppel, M., & Pennebaker, J. W. (2005) · Cited by 87
Sullivan, S., Campbell, A., Hutton, S. B., & Ruffman, T. (2015) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbv033 · Cited by 85
Clarifying the relation between neuroticism and positive emotions
Ng, S. H. (2009) · Personality and Individual Differences · doi:10.1016/j.paid.2009.01.049 · Cited by 79
Personality, event-related potential (ERP) and heart rate (HR) in emotional word processing
Pascalis, V. D., Strippoli, E., Riccardi, P., & Vergari, F. (2003) · Personality and Individual Differences · doi:10.1016/s0191-8869(03)00159-4 · Cited by 76
Subramanian, R., Yan, Y., Staiano, J., Lanz, O., & Sebe, N. (2013) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2522848.2522862 · Cited by 70
Self-citationPredicting the Valence of a Scene from Observers’ Eye Movements
Tavakoli, H. R., Atyabi, A., Rantanen, A. P., Laukka, S. J., Nefti‐Meziani, S., & Heikkilä, J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0138198 · Cited by 70
Subramanian, R., Shankar, D., Sebe, N., & Melcher, D. (2014) · Journal of Vision · doi:10.1167/14.3.31 · Cited by 65
Self-citationEffects of Personality Types on the Use of Television Genre
Shim, J. W., & Paul, B. (2007) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838150701304852 · Cited by 42
Tok, S., Koyuncu, M., Dural, S., & Çatıkkaş, F. (2010) · Personality and Individual Differences · doi:10.1016/j.paid.2010.04.020 · Cited by 40
Implicit User-centric Personality Recognition Based on Physiological Responses to Emotional Videos
Wache, J., Subramanian, R., Abadi, M. K., Vieriu, R.-L., Sebe, N., & WINKLER, S. S. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2820736 · Cited by 38
Self-citationAbadi, M. K., Correa, J. A. M., Wache, J., Yang, H., Patras, I., & Sebe, N. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163100 · Cited by 36
Self-citationNeuroticism, Extraversion, Conscientiousness and Stress: Physiological Correlates
Brouwer, A.-M., van Schaik, M. G., Korteling, J. E., van Erp, J. B. F., & Toet, A. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2326402 · Cited by 33
Physiological Correlates of the Big 5: Autonomic Responses to Video Presentations
Brumbaugh, C. C., Kothuri, R., Marci, C. D., Siefert, C. J., & PFAFF, D. (2013) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-013-9234-5 · Cited by 31
Don't ask me what i'm like, just watch and listen
Srivastava, R., Feng, J., Roy, S., Yan, S., & Sim, T. (2012) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2393347.2393397 · Cited by 23
Linking Openness and Intellect in Childhood and Adulthood
Mervielde, I., Fruyt, F. D., & Jarmuz, S. (1998) · Psychology Press eBooks · doi:10.4324/9781410601223-10 · Cited by 22
Cited by
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806
AMIGOS: A Dataset for Affect, Personality and Mood Research on Individuals and Groups
Miranda-Correa, J. A., Abadi, M. K., Sebe, N., & Patras, I. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2884461 · Cited by 709
Self-citationHuman Emotion Recognition: Review of Sensors and Methods
Dzedzickis, A., Kaklauskas, A., & Bucinskas, V. (2020) · Sensors · doi:10.3390/s20030592 · Cited by 582
Khare, S. K., Blanes-Vidal, V., Nadimi, E. S., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102019 · Cited by 469
Self-Supervised ECG Representation Learning for Emotion Recognition
Sarkar, P., & Etemad, A. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3014842 · Cited by 383
Metadata
- Authors
- Subramanian, R., Wache, J., Abadi, M. K., Vieriu, R. L., Winkler, S., & Sebe, N.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2018-04-01
- Volume
- 9
- Issue
- 2
- Pages
- 147-160
- ISSN
- 1949-3045 (ISSN-L)
- OpenAlex
- W2547146855
- Cited by
- 535
- References
- 54
- FWCI
- 36.28
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.