MoodExplorer: Towards Compound Emotion Detection via Smartphone Sensing
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Social psychology and neuroscience had confirmed that emotion state exerts a significant effect on human communication, perception, social behavior and decision making. With the wide availability of smartphones equipped with microphone, accelerometer, GPS, and other source of sensors, it is worthwhile to explore the possibility of automatic emotion detection via smartphone sensing. Particularly, we focus on a novel research problem that tries to detect the compound emotion (a set of multiple dimensional basic emotions) of smartphone users. We observe that users' self-reported emotional states have high correlation with their smartphone usage patterns and sensing data. Based on the observations, we exploit a feature extraction and selection algorithm to find the most significant features. We further adopt a factor graph model to tackle the correlations between features and emotion labels, and propose a machine learning algorithm for compound emotion detection based on the smartphone sensing data. The proposed mechanism is implemented as an APP called MoodExplorer in Android platform. Extensive experiments conducted on the smartphone data collected from 30 university students show that MoodExplorer can recognize users' compound emotions with 76.0% exact match on average.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gross, J. J., & John, O. P. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.348 · Cited by 11,929 · cited 1×
“Last but not least, understanding the emotion state and its evolution is important to evaluate individual’s psychological health and mental well-being [10][19].”
BackgroundFactor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 2×
“In this paper, we adopt the factor graph model [24] to describe the correlation between basic emotions and the correlation between features and emotion labels.”
BackgroundMethodCrawford, J. R., & Henry, J. D. (2004) · British Journal of Clinical Psychology · doi:10.1348/0144665031752934 · Cited by 2,957 · cited 1×
“One frequently used measure for general affective states is the Positive and Negative Affect Schedule (PANAS) model [9].”
MethodA Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
POSNER, J., RUSSELL, J. A., & PETERSON, B. S. (2005) · Development and Psychopathology · doi:10.1017/s0954579405050340 · Cited by 2,602 · cited 2×
“The Circumplex mood model [35] employed a two-dimensional circumplex to represent the emotional state of the participants: the pleasure dimension measures the degree of positive and negative feelings, and the activeness dimension measures the likelihood for a user to take action under the mood state.”
BackgroundMethodFowler, J. H., & Christakis, N. A. (2008) · BMJ · doi:10.1136/bmj.a2338 · Cited by 1,990
Universals and cultural differences in the judgments of facial expressions of emotion.
Ekman, P., Friesen, W. V., O'Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Krause, R., LeCompte, W. A., Pitcairn, T., Ricci-Bitti, P. E., et al. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.53.4.712 · Cited by 1,763
Identifying influential and susceptible members of social networks
Aral, S., & Walker, D. (2012) · Science · doi:10.1126/science.1215842 · Cited by 1,047 · cited 1×
“According to the study of [2], peoples’ emotion states are influenced by their friends or the socially contact persons.”
BackgroundHappiness is greater in natural environments
MacKerron, G., & Mourato, S. (2013) · Global Environmental Change · doi:10.1016/j.gloenvcha.2013.03.010 · Cited by 899 · cited 1×
“Nowadays, with the rapid adoption of smartphones, researchers have shown that it is possible to adopt smartphone sensing data to infer and detect human mental well-being such as stress, anxiety, depression, emotion, and mood [8][31][37][41][42][51].”
BackgroundCompound facial expressions of emotion
Du, S., Tao, Y., & Martinez, A. M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1322355111 · Cited by 806
Distinctions between emotion and mood
Beedie, C., Terry, P., & Lane, A. (2005) · Cognition and Emotion · doi:10.1080/02699930541000057 · Cited by 593 · cited 1×
“The phrases mood and emotion are highly related but have slight difference in several aspects [5].”
BackgroundCanzian, L., & Musolesi, M. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2805845 · Cited by 477 · cited 2×
“We compute the Pearson correlation coefficient [47] using the similar methods mentioned in [7][18].”
MethodEmotion recognition using wireless signals
Zhao, M., Adib, F., & Katabi, D. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973762 · Cited by 461
MoodScope: building a mood sensor from smartphone usage patterns
LiKamWa, R., Liu, Y., Lane, N. D., & Zhong, L. (2013) · Proceeding of the 11th annual international conference on Mobile systems, applications, and services · doi:10.1145/2462456.2464449 · Cited by 444 · cited 5×
“Nowadays smartphones are widely used in people’s daily lives for business, social and entertainment purposes [4][30].”
BackgroundMethodInfluentialThe painful face – Pain expression recognition using active appearance models
Ashraf, A. B., Lucey, S., Cohn, J. F., Chen, T., Ambadar, Z., Prkachin, K. M., & Solomon, P. E. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.05.007 · Cited by 355
Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits
Bogomolov, A., Lepri, B., Ferron, M., Pianesi, F., & Pentland, A. (. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654933 · Cited by 217
DeepMood: Forecasting Depressed Mood Based on Self-Reported Histories via Recurrent Neural Networks
Suhara, Y., Xu, Y., & Pentland, A. '. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052676 · Cited by 163 · cited 1×
“Nowadays, with the rapid adoption of smartphones, researchers have shown that it is possible to adopt smartphone sensing data to infer and detect human mental well-being such as stress, anxiety, depression, emotion, and mood [8][31][37][41][42][51].”
BackgroundDeepMood: Modeling Mobile Phone Typing Dynamics for Mood Detection
Cao, B., Zheng, L., Zhang, C., Yu, P. S., Piscitello, A., Zulueta, J., Ajilore, O., Ryan, K., & Leow, A. D. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098086 · Cited by 145 · cited 2×
“DeepMood [8] detected bipolar affective disorder utilizing typing dynamics and accelerometer sensor data in the smartphone based on multi-view neural network.”
BackgroundMethodMobile Sensing at the Service of Mental Well-being: a Large-scale Longitudinal Study
Servia-Rodríguez, S., Rachuri, K. K., Mascolo, C., Rentfrow, P. J., Lathia, N., & Sandstrom, G. M. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052618 · Cited by 134 · cited 1×
“3 Detection of human mental well-being based on smartphones Nowadays, with the rapid adoption of smartphones, researchers have shown that it is possible to adopt smartphone sensing data to infer and detect human mental well-being such as stress, anxiety, depression, emotion, and mood [8][31][37][41][42][51].”
BackgroundSentence-level Emotion Classification with Label and Context Dependence
Li, S., Huang, L., Wang, R., & Zhou, G. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1101 · Cited by 66
Cited by
de Vries, L. P., Baselmans, B. M. L., & Bartels, M. (2021) · Journal of Happiness Studies · doi:10.1007/s10902-020-00324-7 · Cited by 255
Wearables, smartphones, and artificial intelligence for digital phenotyping and health
Perez-Pozuelo, I., Spathis, D., Clifton, E. A., & Mascolo, C. (2020) · Elsevier · doi:10.17863/cam.60922 · Cited by 47
Sultana, M., Al-Jefri, M., & Lee, J. (2020) · JMIR mHealth and uHealth · doi:10.2196/17818 · Cited by 46
Passive mobile sensing and psychological traits for large scale mood prediction
Spathis, D., Servia-Rodriguez, S., Farrahi, K., Mascolo, C., & Rentfrow, J. (2019) · Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3329189.3329213 · Cited by 40
Beyond Mobile Apps: A Survey of Technologies for Mental Well-Being
Woodward, K., Kanjo, E., Brown, D. J., McGinnity, T. M., Inkster, B., Macintyre, D. J., & Tsanas, A. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3015018 · Cited by 18
Metadata
- Authors
- Zhang, X., Li, W., Chen, X., & Lu, S.
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2018-01-08
- Volume
- 1
- Issue
- 4
- Pages
- 1-30
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W2783583489
- Cited by
- 102
- References
- 20
- FWCI
- 18.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.