The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
A survey on big data-driven digital phenotyping of mental health
Abstract
The landscape of mental health has undergone tremendous changes within the last two decades, but the research on mental health is still at the initial stage with substantial knowledge gaps and the lack of precise diagnosis. Nowadays, big data and artificial intelligence offer new opportunities for the screening and prediction of mental problems. In this review paper, we outline the vision of digital phenotyping of mental health (DPMH) by fusing the enriched data from ubiquitous sensors, social media and healthcare systems, and present a broad overview of DPMH from sensing and computing perspectives. We first conduct a systematical literature review and propose the research framework, which highlights the key aspects related with mental health, and discuss the challenges elicited by the enriched data for digital phenotyping. Next, five key research strands including affect recognition, cognitive analytics, behavioral anomaly detection, social analytics, and biomarker analytics are unfolded in the psychiatric context. Finally, we discuss various open issues and the corresponding solutions to underpin the digital phenotyping of mental health.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Centrality in social networks conceptual clarification
Freeman, L. C. (1978) · Social Networks · doi:10.1016/0378-8733(78)90021-7 · Cited by 17,062
Vos, T., Abajobir, A. A., Abate, K. H., Abbafati, C., Abbas, K. M., Abd-Allah, F., Abdulkader, R. S., Abdulle, A. M., Abebo, T. A., Abera, S. F., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32154-2 · Cited by 13,220
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880
Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., Musacchio, K. M., Jaroszewski, A. C., Chang, B. P., & Nock, M. K. (2017) · Psychological Bulletin · doi:10.1037/bul0000084 · Cited by 3,784
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
Walker, E. R., McGee, R. E., & Druss, B. G. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.2502 · Cited by 2,976
Kassebaum, N. J., Arora, M., Barber, R. M., Bhutta, Z. A., Brown, J., Carter, A., Casey, D. C., Charlson, F. J., Coates, M. M., Coggeshall, M., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31460-x · Cited by 2,163
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835
Recognizing action units for facial expression analysis
Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
The NIMH Research Domain Criteria (RDoC) Project: Precision Medicine for Psychiatry
Insel, T. R. (2014) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14020138 · Cited by 1,472
Sentiment strength detection in short informal text
Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., & Kappas, A. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21416 · Cited by 1,449
Network Dissection: Quantifying Interpretability of Deep Visual Representations
Bau, D., Zhou, B., Khosla, A., Oliva, A., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.354 · Cited by 1,389
Thomée, S., Härenstam, A., & Hagberg, M. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-66 · Cited by 1,269
Sleep and mental disorders: a meta-analysis of polysomnographic research
Baglioni, C., Nanovska, S., Regen, W., Spiegelhalder, K., Feige, B., Nissen, C., Reynolds, C. F., & Riemann, D. (2016) · Psychological Bulletin · doi:10.1037/bul0000053 · Cited by 1,074
Speech emotion recognition using hidden Markov models
Nwe, T. L., Foo, S. W., & De Silva, L. C. (2003) · Speech Communication · doi:10.1016/s0167-6393(03)00099-2 · Cited by 920
Digital Phenotyping: Technology for a New Science of Behavior
Insel, T. R. (2017) · JAMA · doi:10.1001/jama.2017.11295 · Cited by 833
Trautmann, S., Rehm, J., & Wittchen, H. (2016) · The EMBO Reports · doi:10.15252/embr.201642951 · Cited by 798
Torous, J., Kiang, M. V., Lorme, J., & Onnela, J.-P. (2016) · JMIR Mental Health · doi:10.2196/mental.5165 · Cited by 758
Harnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health
Onnela, J.-P., & Rauch, S. L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.7 · Cited by 726
Quantifying Mental Health Signals in Twitter
Coppersmith, G., Dredze, M., & Harman, C. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3207 · Cited by 722
Deep Learning for Emotion Recognition on Small Datasets using Transfer Learning
Ng, H.-W., Nguyen, V. D., Vonikakis, V., & Winkler, S. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2830593 · Cited by 657
Facebook language predicts depression in medical records
Eichstaedt, J. C., Smith, R. J., Merchant, R. M., Ungar, L. H., Crutchley, P., Preoţiuc-Pietro, D., Asch, D. A., & Schwartz, H. A. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1802331115 · Cited by 643
Explainable Prediction of Medical Codes from Clinical Text
Mullenbach, J., Wiegreffe, S., Duke, J., Sun, J., & Eisenstein, J. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1100 · Cited by 597
Processing of facial emotion expression in major depression: a review
Bourke, C., Douglas, K., & Porter, R. (2010) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048674.2010.496359 · Cited by 557
Evaluating deep learning architectures for Speech Emotion Recognition
Fayek, H. M., Lech, M., & Cavedon, L. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.02.013 · Cited by 554
Instagram photos reveal predictive markers of depression
Reece, A. G., & Danforth, C. M. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0110-z · Cited by 519
Social media as a measurement tool of depression in populations
De Choudhury, M., Counts, S., & Horvitz, E. (2013) · Proceedings of the 5th Annual ACM Web Science Conference · doi:10.1145/2464464.2464480 · Cited by 497
Canzian, L., & Musolesi, M. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2805845 · Cited by 477
Facial emotion processing in major depression: a systematic review of neuroimaging findings
Stuhrmann, A., Suslow, T., & Dannlowski, U. (2011) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-1-10 · Cited by 440
Jain, S. H., Powers, B. W., Hawkins, J. B., & Brownstein, J. S. (2015) · Nature Biotechnology · doi:10.1038/nbt.3223 · Cited by 425
Nonlinear feature based classification of speech under stress.
Zhou, G., Hansen, J. H. L., & Kaiser, J. F. (2001) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.905995 · Cited by 409
Integrated treatment of substance use and psychiatric disorders
Kelly, T. M., & Daley, D. C. (2013) · Social Work in Public Health · doi:10.1080/19371918.2013.774673 · Cited by 378
Identifying emotional states using keystroke dynamics
Epp, C., Lippold, M., & Mandryk, R. L. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979046 · Cited by 364
Predicting suicidal behavior from longitudinal electronic health records.
Barak-Corren, Y., Castro, V. M., Javitt, S., Hoffnagle, A. G., Dai, Y., Perlis, R. H., Nock, M. K., Smoller, J. W., & Reis, B. Y. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16010077 · Cited by 339
Affective Cognition and its Disruption in Mood Disorders
Elliott, R., Zahn, R., Deakin, J. F. W., & Anderson, I. M. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.77 · Cited by 330
Reporting Mental Health Symptoms: Breaking Down Barriers to Care with Virtual Human Interviewers
Lucas, G. M., Rizzo, A., Gratch, J., Scherer, S., Stratou, G., Boberg, J., & Morency, L.-P. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00051 · Cited by 308
Loneliness and Eating Disorders
Levine, M. P. (2012) · The Journal of Psychology · doi:10.1080/00223980.2011.606435 · Cited by 259
Social participation and mental health: moderating effects of gender, social role and rurality
Takagi, D., Kondo, K., & Kawachi, I. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-701 · Cited by 250
Recognition of dietary activity events using on-body sensors
Amft, O., & Tröster, G. (2008) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2007.11.007 · Cited by 220
Jan, A., Meng, H., Gaus, Y. F. B. A., & Zhang, F. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2017.2721552 · Cited by 219
iSleep: unobtrusive sleep quality monitoring using smartphones
Hao, T., Xing, G., & Zhou, G. (2013) · Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2517351.2517359 · Cited by 216
Analysis of Chewing Sounds for Dietary Monitoring
Amft, O., Stäger, M., Lukowicz, P., & Tröster, G. (2005) · Lecture Notes in Computer Science · doi:10.1007/11551201_4 · Cited by 216
DeepMood: Forecasting Depressed Mood Based on Self-Reported Histories via Recurrent Neural Networks
Suhara, Y., Xu, Y., & Pentland, A. '. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052676 · Cited by 163
Mota, N. B., Copelli, M., & Ribeiro, S. (2017) · npj Schizophrenia · doi:10.1038/s41537-017-0019-3 · Cited by 157
DeepMood: Modeling Mobile Phone Typing Dynamics for Mood Detection
Cao, B., Zheng, L., Zhang, C., Yu, P. S., Piscitello, A., Zulueta, J., Ajilore, O., Ryan, K., & Leow, A. D. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098086 · Cited by 145
Global research challenges and opportunities for mental health and substance-use disorders
Baingana, F., al'Absi, M., Becker, A. E., & Pringle, B. (2015) · Nature · doi:10.1038/nature16032 · Cited by 138
Modeling and Understanding Visual Attributes of Mental Health Disclosures in Social Media
Manikonda, L., & De Choudhury, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025932 · Cited by 116
Zero-Effort In-Home Sleep and Insomnia Monitoring using Radio Signals
Hsu, C.-Y., Ahuja, A., Yue, S., Hristov, R., Kabelac, Z., & Katabi, D. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130924 · Cited by 97
Suicide risk in long-term care facilities: a systematic review
Mezuk, B., Rock, A., Lohman, M. C., & Choi, M. (2014) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4142 · Cited by 95
Joint modeling of heterogeneous sensing data for depression assessment via multi-task learning
Lu, J., Shang, C., Yue, C., Morillo, R., Ware, S., Kamath, J., Bamis, A., Russell, A., Wang, B., & Bi, J. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3191753 · Cited by 85
Cited by
The Digital Therapeutic Alliance and Human-Computer Interaction
D'Alfonso, S., Lederman, R., Bucci, S., & Berry, K. (2020) · JMIR Mental Health · doi:10.2196/21895 · Cited by 90
Metadata
- Authors
- Liang, Y., Zheng, X., & Zeng, D. D.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2019-12
- Volume
- 52
- Pages
- 290-307
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2947379793
- Cited by
- 158
- References
- 53
- FWCI
- 20.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.