Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health
Open accessAbstract
While accurately predicting mood and wellbeing could have a number of important clinical benefits, traditional machine learning (ML) methods frequently yield low performance in this domain. We posit that this is because a one-size-fits-all machine learning model is inherently ill-suited to predicting outcomes like mood and stress, which vary greatly due to individual differences. Therefore, we employ Multitask Learning (MTL) techniques to train personalized ML models which are customized to the needs of each individual, but still leverage data from across the population. Three formulations of MTL are compared: i) MTL deep neural networks, which share several hidden layers but have final layers unique to each task; ii) Multi-task Multi-Kernel learning, which feeds information across tasks through kernel weights on feature types; and iii) a Hierarchical Bayesian model in which tasks share a common Dirichlet Process prior. We offer the code for this work in open source. These techniques are investigated in the context of predicting future mood, stress, and health using data collected from surveys, wearable sensors, smartphone logs, and the weather. Empirical results demonstrate that using MTL to account for individual differences provides large performance improvements over traditional machine learning methods and provides personalized, actionable insights.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
StudentLife combined sensing and self-reports to assess the impact of student workload on stress, whereas Snapshot tracked their mood and sleep.
“For instance, StudentLife [63] combined sensing and self-reports to assess the impact of student workload on stress, whereas Snapshot [160] tracked their mood and sleep.”
From Human-centred artificial intelligence for mobile health sensing: challenges and opportunities (2023) · cites this paper as [160]
Some recent works employ recurrent neural networks, feed-forward layers, multi-task learning and autoencoders to fill in missing sensor data, or to learn better representations.
“Some recent works employ recurrent neural networks [20], feed-forward layers [159], multi-task learning [160] and autoencoders to fill in missing sensor data [161], or to learn better representations [162].”
From Human-centred artificial intelligence for mobile health sensing: challenges and opportunities (2023) · cites this paper as [160]
Individual fairness arises in several tasks where the target manifests itself differently in distinct human subjects, including fatigue in runners, stress and emotion in voice, and mood prediction from wearable sensors.
“In addition to group-level fairness, individual fairness arises in several tasks where the target manifests itself differently in distinct (human) subjects. This ranges from the expression of fatigue in runners (54), to stress and emotion in voice (55, 56), and, crucially, mood prediction from wearable sensors (46).”
From Personalised depression forecasting using mobile sensor data and ecological momentary assessment (2022) · cites this paper as [46]
Taylor et al. reported that personalized Multitask Learning improved prediction accuracies by 11-21% over non-personalized models.
“Our findings also corroborate the results of Taylor et al. (46), who report that personalized Multitask Learning (shared common layers neural network, multi-kernel learning using support vector machines, and hierarchical Bayesian models with a common Dirichlet process prior) improved prediction accuracies by 11–21% over non-personalized models.”
From Personalised depression forecasting using mobile sensor data and ecological momentary assessment (2022) · cites this paper as [46]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
(2014) · Cited by 33,419 · see citing works
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392 · see citing works
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · see citing works
(1999) · Cited by 7,995 · see citing works
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · see citing works
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093 · see citing works
Psychological Stress and Susceptibility to the Common Cold
Cohen, S., Tyrrell, D. A. J., & Smith, A. P. (1991) · New England Journal of Medicine · doi:10.1056/nejm199108293250903 · Cited by 1,712 · see citing works
Temperament, personality, and the mood and anxiety disorders.
Clark, L. A., Watson, D., & Mineka, S. (1994) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.103.1.103 · Cited by 1,685 · see citing works
Veenhoven, R. (2008) · Journal of Happiness Studies · doi:10.1007/s10902-006-9042-1 · Cited by 771 · see citing works
The Evidence Framework Applied to Classification Networks
Mackay, D. (1992) · Neural Computation · doi:10.1162/neco.1992.4.5.720 · Cited by 724 · see citing works
Multi-task learning for classification with dirichlet process priors
Xue, Y., Liao, X., Carin, L., Krishnapuram, B., & Bartlett, P. (2007) · Cited by 478 · see citing works
Canzian, L., & Musolesi, M. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2805845 · Cited by 477 · see citing works
A Bayesian/Information Theoretic Model of Learning to Learn via Multiple Task Sampling
Baxter, J. (1997) · Machine Learning · doi:10.1023/a:1007327622663 · Cited by 460 · see citing works
MoodScope: building a mood sensor from smartphone usage patterns
LiKamWa, R., Liu, Y., Lane, N. D., & Zhong, L. (2013) · Proceeding of the 11th annual international conference on Mobile systems, applications, and services · doi:10.1145/2462456.2464449 · Cited by 444 · see citing works
To transfer or not to transfer
Rosenstein, M. T. (2005) · Cited by 429 · see citing works
Personality, self-esteem, and demographic predictions of happiness and depression
Cheng, H., & Furnham, A. (2003) · Personality and Individual Differences · doi:10.1016/s0191-8869(02)00078-8 · Cited by 413 · see citing works
Spark: The Revolutionary New Science of Exercise and the Brain
Ratey, J. J., & Hagerman, E. (2008) · Medical Entomology and Zoology · Cited by 394 · see citing works
Smartphone-Based Recognition of States and State Changes in Bipolar Disorder Patients
Grunerbl, A., Muaremi, A., Osmani, V., Bahle, G., Ohler, S., Troster, G., Mayora, O., Haring, C., & Lukowicz, P. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2343154 · Cited by 384 · see citing works
Does the perception that stress affects health matter? The association with health and mortality.
Keller, A., Litzelman, K., Wisk, L. E., Maddox, T., Cheng, E. R., Creswell, P. D., & Witt, W. P. (2012) · Health Psychology · doi:10.1037/a0026743 · Cited by 375 · see citing works
Automatic identification of artifacts in electrodermal activity data
Taylor, S., Jaques, N., Chen, W., Fedor, S., Sano, A., & Picard, R. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318762 · Cited by 279 · see citing works
Self-citationMulti-task reinforcement learning
Wilson, A., Fern, A., Ray, S., & Tadepalli, P. V. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273624 · Cited by 262 · see citing works
Learning with Hierarchical-Deep Models
Salakhutdinov, R., Tenenbaum, J. B., & Torralba, A. B. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.269 · Cited by 232 · see citing works
Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits
Bogomolov, A., Lepri, B., Ferron, M., Pianesi, F., & Pentland, A. (. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654933 · Cited by 217 · see citing works
Improving multiview face detection with multi-task deep convolutional neural networks
Zhang, C., & Zhang, Z. (2014) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2014.6835990 · Cited by 210 · see citing works
Spark: The Revolutionary New Science of Exercise and the Brain
Hobart, M. (2008) · Psychiatric Services · doi:10.1176/appi.ps.59.8.939 · Cited by 205 · see citing works
BOWER, B., BYLSMA, L. M., MORRIS, B. H., & ROTTENBERG, J. (2010) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2009.00816.x · Cited by 192 · see citing works
Detecting Work Stress in Offices by Combining Unobtrusive Sensors
Koldijk, S., Neerincx, M. A., & Kraaij, W. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2610975 · Cited by 184 · see citing works
A Multi-Task Learning Framework for Emotion Recognition Using 2D Continuous Space
Xia, R., & Liu, Y. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2512598 · Cited by 182 · see citing works
DeepMood: Forecasting Depressed Mood Based on Self-Reported Histories via Recurrent Neural Networks
Suhara, Y., Xu, Y., & Pentland, A. '. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052676 · Cited by 163 · see citing works
Predicting students' happiness from physiology, phone, mobility, and behavioral data
Jaques, N., Taylor, S., Azaria, A., Ghandeharioun, A., Sano, A., & Picard, R. W. (2015) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2015.7344575 · Cited by 140 · see citing works
Self-citationCome rain or come shine: Individual differences in how weather affects mood.
Klimstra, T. A., Frijns, T., Keijsers, L., Denissen, J. J. A., Raaijmakers, Q. A. W., van Aken, M. A. G., Koot, H. M., van Lier, P. A. C., & Meeus, W. (2011) · Emotion · doi:10.1037/a0024649 · Cited by 101 · see citing works
MoodScope: Building a Mood Sensor from Smartphone Usage Patterns
LiKamWa, R., Liu, Y., Lane, N. D., & Zhong, L. (2012) · Rice Research Repository (Rice University) · Cited by 97 · see citing works
Zhang, B., Provost, E. M., & Essl, G. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2684799 · Cited by 83 · see citing works
Neural network multitask learning for traffic flow forecasting
Jin, F., & Sun, S. (2008) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2008.4634057 · Cited by 70 · see citing works
Happiness Recognition from Mobile Phone Data
Bogomolov, A., Lepri, B., & Pianesi, F. (2013) · 2013 International Conference on Social Computing · doi:10.1109/socialcom.2013.118 · Cited by 67 · see citing works
New Methods for Stress Assessment and Monitoring at the Workplace
Carneiro, D. R., Nováis, P., Augusto, J. C., & Payne, N. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2699633 · Cited by 66 · see citing works
Aichele, S., Rabbitt, P., & Ghisletta, P. (2016) · Psychological Science · doi:10.1177/0956797615626906 · Cited by 39 · see citing works
Li, J., Wang, X., & Hovy, E. H. (2014) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2661829.2662090 · Cited by 37 · see citing works
Multi-task and multi-view learning of user state
Kandemir, M., Vetek, A., Gönen, M., Arto Klami, A., & Samuel Kaski, A. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.02.057 · Cited by 36 · see citing works
Busk, J., Faurholt‐Jepsen, M., Frost, M. M., Bardram, J. E., Kessing, L. V., & Winther, O. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-00867-6 · Cited by 26 · see citing works
Dopamine and circadian rhythms in seasonal affective disorder
Partonen, T. (1996) · Medical Hypotheses · doi:10.1016/s0306-9877(96)90079-1 · Cited by 17 · see citing works
Personality Factors in Stress and Anxiety
Brebner, J. (2018) · Taylor & Francis eBooks · doi:10.4324/9781315825724-2 · Cited by 7 · see citing works
Flagged first, then by citations
2 of the 45 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- [10]Jaques N Multi-task, multi-kernel learning for estimating individual wellbeing NIPS 2015 Workshop on Multimodal ML 898 2015
- [34]Sano A Measuring college students sleep, stress and mental health with wearable sensors and mobile phones Ph D dissertation MIT 2015
Cited by
Sorted by citations
Self-Supervised ECG Representation Learning for Emotion Recognition
Sarkar, P., & Etemad, A. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3014842 · Cited by 411 · see citing works
Personalized machine learning for robot perception of affect and engagement in autism therapy
Rudovic, O., Lee, J., Dai, M., Schuller, B., & Picard, R. W. (2018) · Science Robotics · doi:10.1126/scirobotics.aao6760 · Cited by 316 · see citing works
Self-citationWearable-Based Affect Recognition—A Review
Schmidt, P., Reiss, A., Dürichen, R., & Laerhoven, K. V. (2019) · Sensors · doi:10.3390/s19194079 · Cited by 289 · see citing works
EntropyHub: An open-source toolkit for entropic time series analysis
Flood, M. W., & Grimm, B. P. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259448 · Cited by 136 · see citing works
Behavioral and Physiological Signals-Based Deep Multimodal Approach for Mobile Emotion Recognition
Yang, K., Wang, C., Gu, Y., Sarsenbayeva, Z., Tag, B., Dingler, T., Wadley, G., & Gonçalves, J. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3100868 · Cited by 106 · see citing works
Li, B., & Sano, A. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3397318 · Cited by 100 · see citing works
Self-citationA Random Forest Regression Method With Selected-Text Feature For Depression Assessment
Sun, B., Zhang, Y., He, J. Y. D., Yu, L., Xu, Q., Li, D., & Wang, Z. (2017) · doi:10.1145/3133944.3133951 · Cited by 89 · see citing works
Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks
Umematsu, T., Sano, A., Taylor, S., & Picard, R. W. (2019) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi.2019.8834624 · Cited by 81 · see citing works
Self-citationDetection and monitoring of stress using wearables: a systematic review
Pinge, A., Gad, V. R., Jaisighani, D., Ghosh, S., & Sen, S. (2024) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1478851 · Cited by 104 · see citing works
Meyerhoff, J., Liu, T., Kording, K. P., Ungar, L. H., Kaiser, S. M., Karr, C. J., & Mohr, D. C. (2021) · Journal of Medical Internet Research · doi:10.2196/22844 · Cited by 82 · see citing works
Mentis, A.-F. A., Lee, D., & Roussos, P. (2024) · Molecular Psychiatry · doi:10.1038/s41380-023-02047-6 · Cited by 75 · see citing works
Adler, D. A., Wang, F., Mohr, D. C., & Choudhury, T. (2022) · PLoS ONE · doi:10.1371/journal.pone.0266516 · Cited by 79 · see citing works
Adler, D. A., Tseng, E., Moon, K. C., Young, J. Q., Kane, J. M., Moss, E., Mohr, D. C., & Choudhury, T. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555531 · Cited by 77 · see citing works
A Multitask Learning Approach to Personalized Blood Glucose Prediction
Daniels, J., Herrero, P., & Georgiou, P. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3100558 · Cited by 76 · see citing works
Exploring Individual Differences of Public Speaking Anxiety in Real-Life and Virtual Presentations
Yadav, M., Sakib, M. N., Nirjhar, E. H., Feng, K., Behzadan, A. H., & Chaspari, T. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3048299 · Cited by 68 · see citing works
Saganowski, S. (2022) · Electronics · doi:10.3390/electronics11030496 · Cited by 65 · see citing works
Shuvo, M. M. H., & ISLAM, S. K. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3233486 · Cited by 65 · see citing works
Booth, B. M., Vrzáková, H., Mattingly, S. M., Martinez, G. J., Faust, L. J., & D’Mello, S. K. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3188006 · Cited by 66 · see citing works
EmoBed: Strengthening Monomodal Emotion Recognition via Training with Crossmodal Emotion Embeddings
Han, J., Zhang, Z., Ren, Z. X., & Schuller, B. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2928297 · Cited by 64 · see citing works
Liu, J., Goetz, J., Sen, S., & Tewari, A. (2021) · JMIR mhealth and uhealth · doi:10.2196/23728 · Cited by 61 · see citing works
Sükei, E., Norbury, A., Pérez-Rodríguez, M. M., Olmos, P. M., & Artés-Rodrı́guez, A. (2021) · JMIR mhealth and uhealth · doi:10.2196/24465 · Cited by 62 · see citing works
Busk, J., Faurholt-Jepsen, M., Frost, M., Bardram, J. E., Vedel Kessing, L., & Winther, O. (2020) · JMIR mhealth and uhealth · doi:10.2196/15028 · Cited by 58 · see citing works
Wearable Technology in Clinical Practice for Depressive Disorder
Fedor, S., Lewis, R., Pedrelli, P., Mischoulon, D., Curtiss, J. E., & Picard, R. W. (2023) · New England Journal of Medicine · doi:10.1056/nejmra2215898 · Cited by 57 · see citing works
Self-citationMulti-target affect detection in the wild
Schmidt, P., Dürichen, R., Reiss, A., Laerhoven, K. V., & Plötz, T. (2019) · International Symposium on Wearable Computers · doi:10.1145/3341163.3347741 · Cited by 57 · see citing works
Using Autoencoders to Automatically Extract Mobility Features for Predicting Depressive States
Mehrotra, A., & Musolesi, M. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3264937 · Cited by 54 · see citing works
Personalized Wellbeing Prediction using Behavioral, Physiological and Weather Data
Yu, H., Klerman, E. B., Picard, R. W., & Sano, A. (2019) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi.2019.8834456 · Cited by 53 · see citing works
Self-citationPersonalized mental stress detection with self-organizing map: From laboratory to the field
Tervonen, J., Puttonen, S., Sillanpää, M. J., Hopsu, L., Homorodi, Z., Keränen, J., Pajukanta, J., Tolonen, A. J., Lämsä, A., & Mäntyjärvi, J. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103935 · Cited by 51 · see citing works
Identifying Mobile Sensing Indicators of Stress-Resilience
Adler, D. A., Tseng, V. W.-S., Qi, G., Scarpa, J. R., Sen, S., & Choudhury, T. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3463528 · Cited by 50 · see citing works
Detection of Artifacts in Ambulatory Electrodermal Activity Data
Gashi, S., Lascio, E. D., Stancu, B., Swain, V. D., Mishra, V., Gjoreski, M., & Silvia Santini, B. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3397316 · Cited by 49 · see citing works
Unsupervised Human Activity Representation Learning with Multi-task Deep Clustering
Ma, H., Zhang, Z., Li, W., & Lu, S. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3448074 · Cited by 48 · see citing works
Personalised depression forecasting using mobile sensor data and ecological momentary assessment
Kathan, A., Harrer, M., Küster, L., Triantafyllopoulos, A., He, X., Milling, M., Gerczuk, M., Yan, T., Rajamani, S. T., Heber, E., et al. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.964582 · Cited by 47 · see citing works
Toward Assessing and Recommending Combinations of Behaviors for Improving Health and Well-Being
Nosakhare, E., & Picard, R. W. (2020) · ACM Transactions on Computing for Healthcare · doi:10.1145/3368958 · Cited by 46 · see citing works
Self-citationWearables, smartphones, and artificial intelligence for digital phenotyping and health
Perez-Pozuelo, I., Spathis, D., Clifton, E. A. D., & Cecilia Mascolo, C. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-820077-3.00003-1 · Cited by 49 · see citing works
Using Machine Learning in Burnout Prediction: A Survey
Grządzielewska, M. (2021) · Child and Adolescent Social Work Journal · doi:10.1007/s10560-020-00733-w · Cited by 46 · see citing works
Using behavioral rhythms and multi-task learning to predict fine-grained symptoms of schizophrenia
Tseng, V. W.-S., Sano, A., Ben-Zeev, D., Brian, R., Campbell, A. T., Hauser, M., Kane, J. M., Scherer, E. A., Wang, R., Wang, W., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-71689-1 · Cited by 44 · see citing works
Self-citationDaytime Data and LSTM can Forecast Tomorrow’s Stress, Health, and Happiness
Umematsu, T., Sano, A., & Picard, R. W. (2019) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8856862 · Cited by 44 · see citing works
Self-citationDeep Learning Approaches for Stress Detection: A Survey
Kyrou, M., Kompatsiaris, I., & Petrantonakis, P. C. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3455371 · Cited by 50 · see citing works
Personalization of Deep Learning
Schneider, J., & Vlachos, M. (2021) · Springer eBooks · doi:10.1007/978-3-658-32182-6_14 · Cited by 44 · see citing works
Passive mobile sensing and psychological traits for large scale mood prediction
Spathis, D., Servia-Rodriguez, S., Farrahi, K., Mascolo, C., & Rentfrow, J. (2019) · Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3329189.3329213 · Cited by 40 · see citing works
Audio-Visual Automatic Group Affect Analysis
Sharma, G., Dhall, A., & Cai, J. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3104170 · Cited by 40 · see citing works
Aalbers, G., Hendrickson, A. T., Abeele, M. M. P. V., & Keijsers, L. (2022) · JMIR mHealth and uHealth · doi:10.2196/37469 · Cited by 30 · see citing works
Li, J., & Sun, X. N. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1071 · Cited by 39 · see citing works
Hierarchical classification of insects with multitask learning and anomaly detection
Bjerge, K., Geissmann, Q., Alison, J., Mann, H. M. R., Høye, T. T., Dyrmann, M., & Karstoft, H. (2023) · Ecological Informatics · doi:10.1016/j.ecoinf.2023.102278 · Cited by 38 · see citing works
Beyond Supervised Learning for Pervasive Healthcare
Gu, X., Deligianni, F., Han, J., Liu, X., Chen, W., Yang, G., & Lo, B. P. L. (2023) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2023.3296938 · Cited by 41 · see citing works
Lopez-Martinez, D., Peng, K., Lee, A. M., Borsook, D., & Picard, R. W. (2019) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw.2019.8925076 · Cited by 37 · see citing works
Self-citationYu, H., & Sano, A. (2020) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc44109.2020.9176242 · Cited by 37 · see citing works
Self-citationKolenik, T. (2022) · Internet of things · doi:10.1007/978-3-030-91181-2_7 · Cited by 34 · see citing works
A survey on kernel-based multi-task learning
Ruiz, C., Alaíz, C. M., & Dorronsoro, J. R. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127255 · Cited by 33 · see citing works
Sequence Multi-task Learning to Forecast Mental Wellbeing from Sparse Self-reported Data
Spathis, D., Servia-Rodriguez, S., Farrahi, K., Mascolo, C., & Rentfrow, J. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330730 · Cited by 30 · see citing works
Human-centred artificial intelligence for mobile health sensing: challenges and opportunities
Dang, T., Spathis, D., Ghosh, A., & Mascolo, C. (2023) · Royal Society Open Science · doi:10.1098/rsos.230806 · Cited by 30 · see citing works
AttX: Attentive Cross-Connections for Fusion of Wearable Signals in Emotion Recognition
Bhatti, A., Behinaein, B., Hungler, P. C., & Etemad, A. (2024) · ACM Transactions on Computing for Healthcare · doi:10.1145/3653722 · Cited by 32 · see citing works
Stress Detection System for Working Pregnant Women Using an Improved Deep Recurrent Neural Network
Sharma, S. D., Sharma, S., Singh, R., Gehlot, A., Priyadarshi, N., & Twala, B. (2022) · Electronics · doi:10.3390/electronics11182862 · Cited by 28 · see citing works
Liu, S., Koch, K., Zhou, Z., Föll, S., He, X., Menke, T., Fleisch, E., & Wortmann, F. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3478078 · Cited by 27 · see citing works
Lascio, E. D., Gashi, S., Hidalgo, J. S., Nale, B., Debus, M. E., & Silvia Santini, B. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3411821 · Cited by 25 · see citing works
Physiological responses to pain in cancer patients: A systematic review
Moscato, S., Cortelli, P., & Chiari, L. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106682 · Cited by 25 · see citing works
Busk, J., Faurholt‐Jepsen, M., Frost, M. M., Bardram, J. E., Kessing, L. V., & Winther, O. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-00867-6 · Cited by 26 · see citing works
Guo, Y., Wang, S.-J., Plummer, V., Du, Y., Song, T.-P., & Wang, N. C. (2024) · Journal of Nursing Management · doi:10.1155/2024/9428519 · Cited by 24 · see citing works
Tlachac, M., Flores, R., Reisch, M., Houskeeper, K., & Rundensteiner, E. A. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534596 · Cited by 24 · see citing works
Jafarlou, S., Lai, J., Azimi, I., Mousavi, Z. A., Labbaf, S., Jain, R., Dutt, N. D., Borelli, J. L., & Rahmani, A. M. (2022) · JMIR Formative Research · doi:10.2196/39425 · Cited by 24 · see citing works
Forecasting stress, mood, and health from daytime physiology in office workers and students
Umematsu, T., Sano, A., Taylor, S., Tsujikawa, M., & Picard, R. W. (2020) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc44109.2020.9176706 · Cited by 24 · see citing works
Self-citationMultitask Learning for Mental Health: Depression, Anxiety, Stress (DAS) Using Wearables
Saylam, B., & İncel, Ö. D. (2024) · Diagnostics · doi:10.3390/diagnostics14050501 · Cited by 23 · see citing works
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398 · Cited by 25 · see citing works
Self-citationFrank, A. C., Li, R., Peterson, B. S., & Narayanan, S. S. (2023) · JMIR Mental Health · doi:10.2196/45572 · Cited by 25 · see citing works
Han, J., Zhang, Z., Pantić, M., & Schuller, B. W. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.08.002 · Cited by 22 · see citing works
A Reproducible Stress Prediction Pipeline with Mobile Sensor Data
Zhang, P., Jung, G., Alikhanov, J., Ahmed, U., & Lee, U. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3678578 · Cited by 21 · see citing works
Physiological Time-Series Fusion With Hybrid Attention for Adaptive Recognition of Pain
Jiang, M., Li, Y., He, J., Yang, Y., Xie, H. M., & Chen, X. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3456441 · Cited by 21 · see citing works
Awada, M., Becerik-Gerber, B., Lucas, G. M., & Roll, S. C. (2023) · Italian National Conference on Sensors · doi:10.3390/s23218694 · Cited by 17 · see citing works
Singh, G., Phukan, O. C., Gupta, R., & Nayyar, A. (2023) · International Journal of Communication Systems · doi:10.1002/dac.5657 · Cited by 19 · see citing works
Liu, S., Koch, K., Zhou, Z., Maritsch, M., He, X., Fleisch, E., & Wortmann, F. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3131742 · Cited by 19 · see citing works
Sun, X., Yao, F., & Ding, C. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3252359 · Cited by 19 · see citing works
Beyond Detection: Towards Actionable Sensing Research in Clinical Mental Healthcare
Adler, D. A., Yang, Y., Viranda, T., Xu, X., Mohr, D. C., Meter, A. V., Tartaglia, J., Jacobson, N. C., Wang, F., Estrin, D. L., et al. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699755 · Cited by 19 · see citing works
Multimodal Pain Recognition in Postoperative Patients: Machine Learning Approach
Subramanian, A., Cao, R., Naeini, E. K., Aqajari, S. A. H., Hughes, T. D., Calderon, M.-D., Zheng, K., Dutt, N. D., Liljeberg, P., Salanterä, S., et al. (2024) · JMIR Formative Research · doi:10.2196/67969 · Cited by 18 · see citing works
Liu, H., Lou, S. S., Warner, B. C., Harford, D. R., Kannampallil, T., & Lu, C. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539056 · Cited by 24 · see citing works
Magal, N., Rab, S. L., Goldstein, P., Simon, L., Jiryis, T., & Admon, R. (2022) · Chronic Stress · doi:10.1177/24705470221100987 · Cited by 18 · see citing works
Modality Fusion Network and Personalized Attention in Momentary Stress Detection in the Wild
Yu, H., Vaessen, T., Myin‐Germeys, I., & Sano, A. (2021) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii52823.2021.9597459 · Cited by 17 · see citing works
Self-citationWang, X., Takashima, K., Adachi, T., Finn, P., Sharlin, E., & Kitamura, Y. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3381016 · Cited by 17 · see citing works
Incorporating Forthcoming Events and Personality Traits in Social Media Based Stress Prediction
Li, N., Zhang, H., & Feng, L. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3076294 · Cited by 12 · see citing works
A Personalised Approach to Audiovisual Humour Recognition and its Individual-level Fairness
Kathan, A., Amiriparian, S., Christ, L., Triantafyllopoulos, A., Müller, N., Konig, A. S., & Schuller, B. W. (2022) · doi:10.1145/3551876.3554800 · Cited by 16 · see citing works
Wang, Z., Larrazabal, M. A., Rucker, M., Toner, E. R., Daniel, K. E., Kumar, S., Boukhechba, M., Teachman, B. A., & Barnes, L. E. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610916 · Cited by 15 · see citing works
The Google Health Digital Well-Being Study: Protocol for a Digital Device Use and Well-Being Study
McDuff, D., Barakat, A., Winbush, A., Jiang, A., Cordeiro, F., Crowley, R. N., Kahn, L. E., Hernandez, J., & Allen, N. B. (2023) · JMIR Research Protocols · doi:10.2196/49189 · Cited by 19 · see citing works
Dissecting the heterogeneity of “in the wild” stress from multimodal sensor data
Nagaraj, S., Goodday, S., Hartvigsen, T., Boch, A., Garg, K., Gowda, S. C. M., Foschini, L., Ghassemi, M., Friend, S. H., & Goldenberg, A. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00975-9 · Cited by 15 · see citing works
AFL: An Adaptively Federated Multitask Learning for Model Sharing in Industrial IoT
Zhao, C., Gao, Z., Wang, Q., Xiao, K., & Mo, Z. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3125989 · Cited by 15 · see citing works
de Vries, S., van Oost, F., Smaling, H. J. A., de Knegt, N. C., Cluitmans, P. J. M., Smits, R., & Meinders, E. R. (2023) · Assistive Technology · doi:10.1080/10400435.2023.2261045 · Cited by 14 · see citing works
Simon, L., Rab, S. L., Goldstein, P., Magal, N., & Admon, R. (2022) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2022.105925 · Cited by 15 · see citing works
Darvariu, V.-A., Convertino, L., Mehrotra, A., & Musolesi, M. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3380997 · Cited by 14 · see citing works
Torkamaan, H., & Ziegler, J. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432207 · Cited by 14 · see citing works
Laporte, M., Gjoreski, M., & Langheinrich, M. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610892 · Cited by 18 · see citing works
Lopez-Martinez, D., Peng, K., Steele, S. C., Lee, A. J., Borsook, D., & Picard, R. W. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545823 · Cited by 13 · see citing works
Self-citationUncovering Bias in Personal Informatics
Yfantidou, S., Sermpezis, P., Vakali, A. I., & Baeza-Yates, R. A. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610914 · Cited by 13 · see citing works
Diaz-Ramos, R. E., Noriega, I., Trejo, L. A., Stroulia, E., & Cao, B. (2023) · JMIR Research Protocols · doi:10.2196/48210 · Cited by 12 · see citing works
Personality psychology is getting personal: Advancing the field through personalization
Modersitzki, N., Phan, L. V., McDonald, S., Wright, A. G. C., & Renner, K. (2025) · European Journal of Personality · doi:10.1177/08902070251316915 · Cited by 12 · see citing works
Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data
Liang, P. P., Liu, T., Cai, A., Muszyński, M., Ishii, R., Allen, N., Auerbach, R. P., Brent, D. A., Salakhutdinov, R., & Morency, L. (2021) · doi:10.18653/v1/2021.acl-long.322 · Cited by 12 · see citing works
Integrating wearable sensor data and self-reported diaries for personalized affect forecasting
Yang, Z., Wang, Y., Yamashita, K. S., Khatibi, E., Azimi, I., Dutt, N. D., Borelli, J. L., & Rahmani, A. M. (2024) · Smart Health · doi:10.1016/j.smhl.2024.100464 · Cited by 11 · see citing works
Berkemeier, L., Kamphuis, W., Brouwer, A.-M., de Vries, H., Schadd, M. P. D., van Baardewijk, J. U., Oldenhuis, H. K. E., Verdaasdonk, R. M., & van Gemert‐Pijnen, J. E. W. C. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3474098 · Cited by 14 · see citing works
A Survey on Sensor-Based Techniques for Continuous Stress Monitoring in Knowledge Work Environments
Kallio, J., Vildjiounaite, E., Tervonen, J., & López, M. B. (2025) · ACM Transactions on Computing for Healthcare · doi:10.1145/3720551 · Cited by 14 · see citing works
Nishimura, Y., Hossain, T., Sano, A., Isomura, S., Arakawa, Y., & Inoue, S. (2022) · Smart innovation, systems and technologies · doi:10.1007/978-981-19-0361-8_1 · Cited by 11 · see citing works
Self-citationAn effective multitask neural networks for predicting mechanical properties of steel
Ban, Y., Hou, J., Wang, X., & Zhao, G. (2023) · Materials Letters · doi:10.1016/j.matlet.2023.135236 · Cited by 11 · see citing works
Probabilistic Latent Variable Modeling for Assessing Behavioral Influences on Well-Being
Nosakhare, E., & Picard, R. W. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330738 · Cited by 11 · see citing works
Self-citationReal-Life Validation of Emotion Detection System with Wearables
Kunc, D., Komoszyńska, J., Perz, B., Kazienko, P., & Saganowski, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-06527-9_5 · Cited by 11 · see citing works
Systematic Evaluation of Personalized Deep Learning Models for Affect Recognition
Han, Y., Zhang, P., park, M., & Lee, U. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699724 · Cited by 10 · see citing works
- Authors
- Taylor, S., Jaques, N., Nosakhare, E., Sano, A., & Picard, R.
- Affiliations
- MIT Media Lab (US)
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2020-04-01
- Volume
- 11
- Issue
- 2
- Pages
- 200-213
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- PMC
- PMC7266106
- OpenAlex
- W2779582454
- Cited by
- 251
- References
- 45
- Citations by year
- 2026: 15 · 2025: 24 · 2024: 37 · 2023: 36 · 2022: 55 · 2021: 30 · 2020: 28 · 2019: 17 · 2018: 7 · 2017: 1 · 2016: 1
- FWCI
- 18.74
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- IEEE Transactions on Affective Computing (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc-sa)
- Funders
- MIT Media Lab Consortium
- National Institutes of Health (R01GM105018)
- Samsung
- NEC Corporation
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- mood prediction, stress prediction, health prediction, multi-task learning, personalized machine learning, individual differences, Bayesian hierarchical model, Dirichlet process, wearable sensors, meteorological observations, well-being
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
