Machine Learning in Mental Health: A Systematic Review of the HCI Literature to Support the Development of Effective and Implementable ML Systems
The DOI matches its Crossref record; 217 of the 217 references it cites were found in a registry or an index.
Abstract
High prevalence of mental illness and the need for effective mental health care, combined with recent advances in AI, has led to an increase in explorations of how the field of machine learning (ML) can assist in the detection, diagnosis and treatment of mental health problems. ML techniques can potentially offer new routes for learning patterns of human behavior; identifying mental health symptoms and risk factors; developing predictions about disease progression; and personalizing and optimizing therapies. Despite the potential opportunities for using ML within mental health, this is an emerging research area, and the development of effective ML-enabled applications that are implementable in practice is bound up with an array of complex, interwoven challenges. Aiming to guide future research and identify new directions for advancing development in this important domain, this article presents an introduction to, and a systematic review of, current ML work regarding psycho-socially based mental health conditions from the computing and HCI literature. A quantitative synthesis and qualitative narrative review of 54 papers that were included in the analysis surfaced common trends, gaps, and challenges in this space. Discussing our findings, we (i) reflect on the current state-of-the-art of ML work for mental health, (ii) provide concrete suggestions for a stronger integration of human-centered and multi-disciplinary approaches in research and development, and (iii) invite more consideration of the potentially far-reaching personal, social, and ethical implications that ML models and interventions can have, if they are to find widespread, successful adoption in real-world mental health contexts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“a growing body of research is beginning to demonstrate the importance of user-centered design for work on ML tools [57,122].”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [122]
In the citing paper
“suicide prediction algorithms' false positives could result in an individual being wrongly detained by a health service [43], whilst false negatives could mean an otherwise preventable suicide is missed [40].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [43]
In the citing paper
“Regarding ML models, the majority of related literature has applied some kind of supervised learning, such as logistic regression or SVMs, which cannot capture nonlinear combinations of features.”
From Human-centred artificial intelligence for mobile health sensing: challenges and opportunities (2023) · cites this paper as [158]
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
A Global Measure of Perceived Stress
Cohen, S., Kamarck, T., & Mermelstein, R. (1983) · Journal of Health and Social Behavior · doi:10.2307/2136404 · Cited by 32,807 · cited 1×
“[38] Sheldon Cohen, Tom Kamarck, and Robin Mermelstein.”
BackgroundDevelopment and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433 · cited 1×
“5 Examples of assessment scales used include, for depression: PHQ-8 and PHQ-9 [97], Epidemiological Study Depression Scale [9] and MADRS depression rating system [126]; for mania the Mania Rating Scale (MRS) [213]; for mood HAMD mood scores (Hamilton rating scale for depression) [50]; for affect: PANAS for positive an…”
MethodLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“To structure the identification and selection of relevant articles for our review, we followed the PRIMSA literature review guidelines [104, 123].”
MethodRussell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 1×
“Examples of EMA’s used include: Experience Sampling Method (ESM) based on two-dimensional Circumplex model of emotion [162]; PAM picture library to assess mood [151]; EMAs built on single item stress survey [182]; Stress Monitoring Test (SMT) [139].”
MethodA new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962 · cited 1×
“5 Examples of assessment scales used include, for depression: PHQ-8 and PHQ-9 [97], Epidemiological Study Depression Scale [9] and MADRS depression rating system [126]; for mania the Mania Rating Scale (MRS) [213]; for mood HAMD mood scores (Hamilton rating scale for depression) [50]; for affect: PANAS for positive an…”
MethodRudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955 · cited 1×
“By offering new routes to improving our understanding of human behaviors and predicting or optimizing outcomes [85, 173], ML approaches are increasingly being explored for mental health (e.”
BackgroundA Rating Scale for Mania: Reliability, Validity and Sensitivity
Young, R. C., Biggs, J. T., Ziegler, V. E., & Meyer, D. A. (1978) · British Journal of Psychiatry · doi:10.1192/bjp.133.5.429 · Cited by 8,744 · cited 2×
“5 Examples of assessment scales used include, for depression: PHQ-8 and PHQ-9 [97], Epidemiological Study Depression Scale [9] and MADRS depression rating system [126]; for mania the Mania Rating Scale (MRS) [213]; for mood HAMD mood scores (Hamilton rating scale for depression) [50]; for affect: PANAS for positive an…”
MethodGriffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898 · cited 1×
“02- 07- 474 [97] Kurt Kroenke, and Robert L.”
UCLA loneliness scale (version 3): reliability, validity, and factor structure
Russell, D. W. (1996) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6601_2 · Cited by 5,800 · cited 1×
“com/sf36); for levels of social isolation and connectedness: 20-item UCLA loneliness scale [163]; and for physical activity: Yale Physical Activity Survey (YPAS) [47].”
MethodLipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Screening for Depression in Well Older Adults: Evaluation of a Short Form of the CES-D
Andresen, E. M., Malmgren, J. A., Carter, W. B., & Patrick, D. L. (1994) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(18)30622-6 · Cited by 5,403 · cited 1×
“5 Examples of assessment scales used include, for depression: PHQ-8 and PHQ-9 [97], Epidemiological Study Depression Scale [9] and MADRS depression rating system [126]; for mania the Mania Rating Scale (MRS) [213]; for mood HAMD mood scores (Hamilton rating scale for depression) [50]; for affect: PANAS for positive an…”
MethodNew well-being measures: Short scales to assess flourishing and positive and negative feelings
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D.-W., Oishi, S., & Biswas-Diener, R. (2010) · Social Indicators Research · doi:10.1007/s11205-009-9493-y · Cited by 4,980 · cited 1×
“007 [46] Ed Diener, Derrick Wirtz, William Tov, Chu Kim-Prieto, Dong-won Choi, Shigehiro Oishi, and Robert BiswasDiener.”
BackgroundAndresen, E. M., Malmgren, J. A., Carter, W. B., & Patrick, D. L. (1994) · PubMed · Cited by 4,426
(2018) · Cited by 3,510
Contextual Design: Defining Customer-Centered Systems
Beyer, H. R., & Holtzblatt, K. (1997) · Cited by 3,229
(2007) · PubMed Central · Cited by 2,521
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474 · cited 1×
“00388 [66] Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumeé III, and Kate Crawford.”
BackgroundGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 1×
“00388 [66] Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumeé III, and Kate Crawford.”
BackgroundRosenstiel, A. K., & Keefe, F. J. (1983) · Pain · doi:10.1016/0304-3959(83)90125-2 · Cited by 2,314 · cited 2×
“5 Examples of assessment scales used include, for depression: PHQ-8 and PHQ-9 [97], Epidemiological Study Depression Scale [9] and MADRS depression rating system [126]; for mania the Mania Rating Scale (MRS) [213]; for mood HAMD mood scores (Hamilton rating scale for depression) [50]; for affect: PANAS for positive an…”
MethodWriting narrative literature reviews for peer-reviewed journals: secrets of the trade
Green, B. N., Johnson, C. D., & Adams, A. (2006) · Journal of Chiropractic Medicine · doi:10.1016/s0899-3467(07)60142-6 · Cited by 2,224 · cited 1×
“To provide a knowledge base to inform future research, our analysis of the computing literature presents a quantitative synthesis and qualitative narrative overview [69] of ML applications in mental health.”
MethodNahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171
Proceedings of the Genetic and Evolutionary Computation Conference, GECCO 2019
Auger, A., & Stützle, T. (2019) · Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) · Cited by 1,749
Wang, R., Chen, F., Chen, Z., Li, T., Harari, G., Tignor, S., Zhou, X., Ben-Zeev, D., & Campbell, A. T. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2632048.2632054 · Cited by 1,116 · cited 16×
“The remaining records primarily captured data from individuals who were described as ‘normal users’, ‘healthy subjects’, ‘students’ or ‘older adults’ [44, 67, 139, 140, 153, 168, 179, 193, 201, 217, 218, 222], or for whom data was sampled from public social media (n = 8, plus 1 record that also includes a diagnostic s…”
BackgroundMethodInfluentialPower to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084 · cited 1×
“2558020 [7] Saleema Amershi, Maya Cakmak, William Bradley Knox, and Todd Kulesza.”
BackgroundBuilding better biomarkers: brain models in translational neuroimaging
Woo, C.-W., Chang, L. J., Lindquist, M. A., & Wager, T. D. (2017) · Nature Neuroscience · doi:10.1038/nn.4478 · Cited by 1,056
Public Health Ethics: Mapping the Terrain
Childress, J. F., Faden, R. R., Gaare, R. D., Gostin, L. O., Kahn, J., Bonnie, R. J., Kass, N. E., Mastroianni, A. C., Moreno, J. D., & Nieburg, P. (2002) · Journal of Law, Medicine & Ethics · doi:10.1111/j.1748-720x.2002.tb00384.x · Cited by 1,055 · cited 1×
“Here, arguably, requirements for consent are balanced with protection of anonymity, feasibility constraints, and the potential benefits to the public that may arise from a better understanding, or detection of mental health status (a perspective that may be informed by public health ethics [35]).”
BackgroundMachine learning in mental health: a scoping review of methods and applications
Shatte, A. B. R., Hutchinson, D. M., & Teague, S. J. (2019) · Psychological Medicine · doi:10.1017/s0033291719000151 · Cited by 1,047
Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls
Arbabshirani, M. R., Plis, S., Sui, J., & Calhoun, V. D. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.079 · Cited by 912
Michie, S., Yardley, L., West, R., Patrick, K., & Greaves, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7126 · Cited by 865
Stigma: ignorance, prejudice or discrimination?
Thornicroft, G., Rose, D., Kassam, A., & Sartorius, N. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.106.025791 · Cited by 826 · cited 1×
“However, data collection is costly and particularly complicated where information is deeply personal as well as sensitive due to the stigma that is often associated with mental conditions [29, 53, 116, 190].”
BackgroundPersonal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning
Mohr, D. C., Zhang, M., & Schueller, S. M. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-044949 · Cited by 802
Machine Learning for Precision Psychiatry: Opportunities and Challenges
Bzdok, D., & Meyer-Lindenberg, A. (2018) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2017.11.007 · Cited by 796 · cited 1×
“[25] Danilo Bzdok, and Andreas Meyer-Lindenberg.”
Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012) · American Journal of Public Health · doi:10.2105/ajph.2012.300755 · Cited by 762 · cited 1×
“The field of Implementation Science often describes this as the initial stage in what presents a complex, multifaceted process of moving important research innovation into actual work flows; and for sustaining and scaling-up effective healthcare interventions [68].”
BackgroundProceedings of the 26th AAAI Conference on Artificial Intelligence (AAAI'12)
Hoffmann, J., & Selman, B. (2012) · HAL · Cited by 754
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743 · cited 1×
“[1] Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y.”
BackgroundManipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Vaughan, J. W., & Wallach, H. (2018) · arXiv · doi:10.48550/arxiv.1802.07810 · Cited by 711
A survey for assessing physical activity among older adults
DIPIETRO, L., CASPERSEN, C. J., OSTFELD, A. M., & NADEL, E. R. (1993) · Medicine & Science in Sports & Exercise · doi:10.1249/00005768-199305000-00016 · Cited by 708 · cited 1×
“1007/s11205- 009- 9493- y [47] Loretta Dipietro, Carl J.”
Discovering Shifts to Suicidal Ideation from Mental Health Content in Social Media
De Choudhury, M., Kiciman, E., Dredze, M., Coppersmith, G., & Kumar, M. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858207 · Cited by 683 · cited 1×
“[42] Munmun De Choudhury, Emre Kiciman, Mark Dredze, Glen Coppersmith, and Mrinal Kumar.”
BackgroundA critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence
Bates, R. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.04.011 · Cited by 623 · cited 1×
“The principle of beneficence however does not only entail encouraging human flourishing and wellbeing by doing the right thing, but also suggests to ‘do it well’ [13].”
Background“Participant” Perceptions of Twitter Research Ethics
Fiesler, C., & Proferes, N. (2018) · Social Media + Society · doi:10.1177/2056305118763366 · Cited by 528 · cited 1×
“1177/0165551517740835 [58] Casey Fiesler, and Nicholas Proferes.”
Understanding the Effect of Accuracy on Trust in Machine Learning Models
Yin, M., Wortman Vaughan, J., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300509 · Cited by 527 · cited 1×
“This demonstrates the need for more research investigating how an appropriate interpretation of ML outputs by laypeople can be supported (see also recent work by [212]).”
BackgroundAVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge
Valstar, M., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R., & Pantic, M. (2016) · Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2988257.2988258 · Cited by 503
Current State of Text Sentiment Analysis from Opinion to Emotion Mining
Yadollahi, A., Shahraki, A. G., & Zaiane, O. R. (2018) · ACM Computing Surveys · doi:10.1145/3057270 · Cited by 489 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundKessler, R. C., Heeringa, S., Lakoma, M. D., Petukhova, M., Rupp, A. E., Schoenbaum, M., Wang, P. S., & Zaslavsky, A. M. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08010126 · Cited by 486 · cited 1×
“Increases in the occurrence and global burden of mental illness have made the prevention and treatment of mental disorders a public health priority [90, 91, 204, 207].”
BackgroundIntelligibility and Accountability: Human Considerations in Context-Aware Systems
Bellotti, V., & Edwards, K. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_05 · Cited by 471 · cited 1×
“3209869 [15] Victoria Bellotti, and Keith Edwards.”
Taylor, S. E., Welch, W. T., Kim, H. S., & Sherman, D. K. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01987.x · Cited by 419 · cited 1×
“Examples of EMA’s used include: Experience Sampling Method (ESM) based on two-dimensional Circumplex model of emotion [162]; PAM picture library to assess mood [151]; EMAs built on single item stress survey [182]; Stress Monitoring Test (SMT) [139].”
MethodLee, Y., Ragguett, R.-M., Mansur, R. B., Boutilier, J. J., Rosenblat, J. D., Trevizol, A., Brietzke, E., Lin, K., Pan, Z., Subramaniapillai, M., et al. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.08.073 · Cited by 408 · cited 3×
“, [100]), or discuss approaches to identify key behavioral markers for clinical states from mobile mental health sensing data [124, 158].”
BackgroundCountering Adversarial Images using Input Transformations
Guo, C., Rana, M., Cissé, M., & van der Maaten, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00117 · Cited by 394 · cited 1×
“3386298 [74] Chuan Guo, Mayank Rana, Moustapha Cisse, and Laurens Van Der Maaten.”
BackgroundThe need to approximate the use-case in clinical machine learning
Saeb, S., Lonini, L., Jayaraman, A., Mohr, D. C., & Kording, K. P. (2017) · GigaScience · doi:10.1093/gigascience/gix019 · Cited by 367
Koza, J. R., Bennett, F. H., Andre, D., & Keane, M. A. (1996) · Artificial Intelligence in Design ’96 · doi:10.1007/978-94-009-0279-4_9 · Cited by 361 · cited 1×
“ML algorithms build mathematical models based on training data to make predictions or decisions without being explicitly programmed [93].”
BackgroundBaig, M. M., GholamHosseini, H., Moqeem, A. A., Mirza, F., & Lindén, M. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0760-1 · Cited by 351
A healthcare monitoring system using random forest and internet of things (IoT)
Kaur, P., Kumar, R., & Kumar, M. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-7327-8 · Cited by 317 · cited 1×
“6042686 [88] Pavleen Kaur, Ravinder Kumar, and Munish Kumar.”
BackgroundSteps to take before intelligent user interfaces become real
Höök, K. (2000) · Interacting with Computers · doi:10.1016/s0953-5438(99)00006-5 · Cited by 315
Designing mobile health technology for bipolar disorder: a field trial of the monarca system
Bardram, J. E., Frost, M., Szántó, K., Faurholt-Jepsen, M., Vinberg, M., & Kessing, L. V. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481364 · Cited by 304 · cited 1×
“These include mobile apps and wearable devices to assist symptom monitoring and health risk assessments [12, 48], computerized treatments [49, 157, 171], and mental health peer or community support [99, 137,”
BackgroundIntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety
Mohr, D. C., Tomasino, K. N., Lattie, E. G., Palac, H. L., Kwasny, M. J., Weingardt, K., Karr, C. J., Kaiser, S. M., Rossom, R. C., Bardsley, L. R., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6645 · Cited by 301
Behavioral Modeling for Mental Health using Machine Learning Algorithms
Srividya, M., Mohanavalli, S., & Bhalaji, N. (2018) · Journal of Medical Systems · doi:10.1007/s10916-018-0934-5 · Cited by 267 · cited 12×
“The remaining records primarily captured data from individuals who were described as ‘normal users’, ‘healthy subjects’, ‘students’ or ‘older adults’ [44, 67, 139, 140, 153, 168, 179, 193, 201, 217, 218, 222], or for whom data was sampled from public social media (n = 8, plus 1 record that also includes a diagnostic s…”
BackgroundMethodInfluentialBringing Transparency Design into Practice
Eiband, M., Schneider, H., Bilandzic, M., Fazekas-Con, J., Haug, M., & Hussmann, H. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172961 · Cited by 250 · cited 1×
“[52] Malin Eiband, Hanna Schneider, Mark Bilandzic, Julian Fazekas-Con, Mareike Haug, and Heinrich Hussmann.”
BackgroundYang, Q., Steinfeld, A., & Zimmerman, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300468 · Cited by 247 · cited 1×
“For early examples of HCI approaches to assist the interpretation and use of ML-enabled interventions, see recent work in healthcare more broadly, such as personalized fitness apps [52], or clinical support tools in critical surgery decisions [210].”
MethodPassive and In-Situ assessment of mental and physical well-being using mobile sensors
Rabbi, M., Ali, S., Choudhury, T., & Berke, E. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030164 · Cited by 243
Continuous stress detection using a wrist device: in laboratory and real life
Gjoreski, M., Gjoreski, H., Luštrek, M., & Gams, M. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct · doi:10.1145/2968219.2968306 · Cited by 230 · cited 1×
“09010 [67] Martin Gjoreski, Hristijan Gjoreski, Mitja Luštrek, and Matjaž Gams.”
BackgroundLee, M. K., Jain, A., Cha, H. J., Ojha, S., & Kusbit, D. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359284 · Cited by 223 · cited 1×
“2); or the perceived fairness of a decision-making process [102].”
BackgroundSanches, P., Janson, A., Karpashevich, P., Nadal, C., Qu, C., Daudén Roquet, C., Umair, M., Windlin, C., Doherty, G., Höök, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300475 · Cited by 221 · cited 4×
“[170], which mapped the design space of technologies for supporting affective health as reported in HCI; and identified that most innovation has occurred in the areas of automated diagnosis, and self-tracking.”
BackgroundResultInfluentialSelf-citationSocial sensing for epidemiological behavior change
Madan, A., Cebrian, M., Lazer, D., & Pentland, A. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864394 · Cited by 219 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundDe-identification of clinical notes via recurrent neural network and conditional random field
Liu, Z., Tang, B., Wang, X., & Chen, Q. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.05.023 · Cited by 218 · cited 1×
“Papers were excluded if they described topics of neuroscience, neurobiology or neurological conditions – including cell structure, cortex and (f)MRI research (n = 22 [3, 54, 59, 72, 92, 94, 95, 96, 98, 103, 108, 115, 117, 131, 146, 180, 183, 185, 195, 199, 214, 220]), and in one case epilepsy [5].”
BackgroundA Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media
Chancellor, S., Birnbaum, M. L., Caine, E. D., Silenzio, V. M. B., & De Choudhury, M. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287587 · Cited by 214 · cited 10×
“This selection criterion is consistent with the mental health literature and other systematic reviews on affective mental health [29, 170].”
BackgroundResultInfluentialPark, A., Conway, M., & Chen, A. T. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2017.09.001 · Cited by 204
The High-Conductance State of Cortical Networks
Kumar, A., Schrader, S., Aertsen, A., & Rotter, S. (2008) · Neural Computation · doi:10.1162/neco.2008.20.1.1 · Cited by 199 · cited 1×
“3928/0048- 5713- 20020901- 06 [98] Arvind Kumar, Sven Schrader, Ad Aertsen, and Stefan Rotter.”
Doherty, G., Coyle, D., & Sharry, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208602 · Cited by 198 · cited 1×
“3300416 [49] Gavin Doherty, David Coyle, and John Sharry.”
BackgroundSelf-citationMulti-level Attention Network using Text, Audio and Video for Depression Prediction
Ray, A., Kumar, S., Reddy, R., Mukherjee, P., & Garg, R. (2019) · doi:10.1145/3347320.3357697 · Cited by 196 · cited 12×
“Several papers (n = 7) described complex multi-modal systems, or frameworks that built on everyday technology [82, 140, 193, 222], robot [154], or human/ virtual agent [155, 184] interactions.”
BackgroundMethodInfluentialRohani, D. A., Faurholt-Jepsen, M., Kessing, L. V., & Bardram, J. E. (2017) · doi:10.2196/preprints.9691 · Cited by 195 · cited 2×
“, [100]), or discuss approaches to identify key behavioral markers for clinical states from mobile mental health sensing data [124, 158].”
BackgroundThunderSVM: A Fast SVM Library on GPUs and CPUs
Wen, Z., Shi, J., Li, Q., He, B., & Chen, J. (2018) · UWA Profiles and Research Repository (UWA) · Cited by 185
User-level psychological stress detection from social media using deep neural network
Lin, H., Jia, J., Guo, Q., Xue, Y., Li, Q., Huang, J., Cai, L., & Feng, L. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654945 · Cited by 178 · cited 1×
“’ [33, 105, 211, 219] as a mechanism for ‘diagnostic’ ground truth, as this does not conform with clinical assessment tools such as the DSM [8].”
BackgroundPAM: a photographic affect meter for frequent, in situ measurement of affect
Pollak, J. P., Adams, P., & Gay, G. K. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979047 · Cited by 177 · cited 5×
“EMAs are often short questions designed to capture in-situ real time information about a person’s experience [ 128 ]. xamples of EMA’s used include the following: Experience Sampling Method (ESM) based on two-dimensional Circumplex odel of emotion [ 162 ]; PAM picture library to assess mood [ 151 ]; EMAs built on sing…”
MethodInfluentialPocket Skills: A Conversational Mobile Web App To Support Dialectical Behavioral Therapy
Schroeder, J., Wilkes, C., Rowan, K., Toledo, A., Paradiso, A., Czerwinski, M., Mark, G., & Linehan, M. M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173972 · Cited by 175 · cited 1×
“These include mobile apps and wearable devices to assist symptom monitoring and health risk assessments [12, 48], computerized treatments [49, 157, 171], and mental health peer or community support [99, 137,”
BackgroundChancellor, S., Baumer, E. P. S., & De Choudhury, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359249 · Cited by 172 · cited 1×
“3287587 [30] Stevie Chancellor, Eric P.”
Ecological momentary interventions for depression and anxiety
Schueller, S. M., Aguilera, A., & Mohr, D. C. (2017) · Depression and Anxiety · doi:10.1002/da.22649 · Cited by 168
Computational neuroimaging strategies for single patient predictions
Stephan, K. E., Schlagenhauf, F., Huys, Q. J. M., Raman, S., Aponte, E. A., Brodersen, K. H., Rigoux, L., Moran, R. J., Daunizeau, J., Dolan, R. J., et al. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.038 · Cited by 166
Semi-Supervised Approach to Monitoring Clinical Depressive Symptoms in Social Media
Yazdavar, A. H., Al-Olimat, H. S., Ebrahimi, M., Bajaj, G., Banerjee, T., Thirunarayan, K., Pathak, J., & Sheth, A. (2017) · Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2017 · doi:10.1145/3110025.3123028 · Cited by 165 · cited 10×
“Only one of the papers explicitly described the use of semi-supervised learning techniques [211] that combine labelled and unlabeled data in their model; and few papers (n = 6) reported the use of novel methods.”
BackgroundMethodInfluentialO'Leary, K., Schueller, S. M., Wobbrock, J. O., & Pratt, W. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173905 · Cited by 164
What about Mood Swings: Identifying Depression on Twitter with Temporal Measures of Emotions
Chen, X., Sykora, M. D., Jackson, T., & Elayan, S. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3184558.3191624 · Cited by 153 · cited 12×
“APPENDIX .1 Examples of Common ML Models or Techniques in Each ML Algorithm Category Supervised Unsupervised Semi-supervised Novel Methods L odels/ echniques Support Vector Machines (SVM) k -Nearest neighbors ( k -NN) Naïve Bayes (NB) Regression analysis, e.g., Logistic Regression (LR), Lasso Supervised Latent Dirichl…”
BackgroundMethodInfluentialPopTherapy: Coping with Stress through Pop-Culture
Paredes, P., Giald-Bachrach, R., Czerwinski, M., Roseway, A., Rowan, K., & Hernandez, J. (2014) · Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2014.255070 · Cited by 152
Exploratory Analysis of Social Media Prior to a Suicide Attempt
Coppersmith, G., Ngo, K., Leary, R., & Wood, A. (2016) · Proceedings of the Third Workshop on Computational Lingusitics and Clinical Psychology · doi:10.18653/v1/w16-0311 · Cited by 150 · cited 1×
“A [40] Glen Coppersmith, Kim Ngo, Ryan Leary, and Anthony Wood.”
BackgroundDeepMood: Modeling Mobile Phone Typing Dynamics for Mood Detection
Cao, B., Zheng, L., Zhang, C., Yu, P. S., Piscitello, A., Zulueta, J., Ajilore, O., Ryan, K., & Leow, A. D. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098086 · Cited by 145 · cited 10×
“Here, success of newly developed models is primarily reported through performance measures of the ‘accuracy of the (best) classifier’ or ‘robustness of clustering’ [2, 4, 6, 23, 27, 33, 44, 45, 50, 57, 61, 62, 63, 64, 67, 86, 89, 112, 122, 128, 133, 134, 135, 136, 139, 141, 144, 145, 152, 153, 155, 165, 168, 176, 177,…”
BackgroundMethodInfluentialThe Language of LGBTQ+ Minority Stress Experiences on Social Media
Saha, K., Kim, S. C., Reddy, M. D., Carter, A. J., Sharma, E., Haimson, O. L., & Choudhury, M. D. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3361108 · Cited by 141
Fairness Behind a Veil of Ignorance: A Welfare Analysis for Automated Decision MakingPreprint
Heidari, H., Ferrari, C., Gummadi, K. P., & Krause, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04959 · Cited by 140 · cited 1×
“002 [76] Hoda Heidari, Claudio Ferrari, Krishna P.”
Digital Exclusion Among Mental Health Service Users: Qualitative Investigation
Greer, B., Robotham, D., Simblett, S., Curtis, H., Griffiths, H., & Wykes, T. (2019) · Journal of Medical Internet Research · doi:10.2196/11696 · Cited by 135 · cited 1×
“1016%2FS0899- 3467(07)60142- 6 [70] Ben Greer, Dan Robotham, Sara Simblett, Hannah Curtis, Helena Griffiths, and Til Wykes.”
BackgroundToward fairness in AI for people with disabilities SBG@a research roadmap
Guo, A., Kamar, E., Vaughan, J. W., Wallach, H., & Morris, M. R. (2020) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3386296.3386298 · Cited by 128
Modeling Stress with Social Media Around Incidents of Gun Violence on College Campuses
Saha, K., & De Choudhury, M. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134727 · Cited by 124 · cited 25×
“DOI: https://doi.org/10.1145/3287560.3287587 [30] Stevie Chancellor, Eric P. S. Baumer, and Munmun De Choudhury.”
BackgroundMethodInfluentialTrauma Coping Self-Efficacy: A context-specific self-efficacy measure for traumatic stress.
Benight, C. C., Shoji, K., James, L. E., Waldrep, E. E., Delahanty, D. L., & Cieślak, R. (2015) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/tra0000045 · Cited by 123 · cited 1×
“1207/S15327051HCI16234 _ 05 [16] Charles C.”
Gaur, M., Kursuncu, U., Alambo, A., Sheth, A., Daniulaityte, R., Thirunarayan, K., & Pathak, J. (2018) · International Conference on Information and Knowledge Management · doi:10.1145/3269206.3271732 · Cited by 116 · cited 1×
“2797159 [64] Manas Gaur, Ugur Kursuncu, Amanuel Alambo, Amit Sheth, Raminta Daniulaityte, Krishnaprasad Thirunarayan, and Jyotishman Pathak.”
BackgroundPrediction of Mood Instability with Passive Sensing
Morshed, M. B., Saha, K., Li, R. C., D’Mello, S. K., Choudhury, M. D., Abowd, G. D., & Plötz, T. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3351233 · Cited by 116
A Weakly Supervised Learning Framework for Detecting Social Anxiety and Depression
Salekin, A., Eberle, J. W., Glenn, J. J., Teachman, B. A., & Stankovic, J. A. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3214284 · Cited by 113 · cited 11×
“The remaining records primarily captured data from individuals who were described as ‘normal users’, ‘healthy subjects’, ‘students’ or ‘older adults’ [44, 67, 139, 140, 153, 168, 179, 193, 201, 217, 218, 222], or for whom data was sampled from public social media (n = 8, plus 1 record that also includes a diagnostic s…”
BackgroundMethodInfluentialDesigning Contestability: Interaction Design, Machine Learning, and Mental Health
Hirsch, T., Merced, K., Narayanan, S., Imel, Z. E., & Atkins, D. C. (2017) · Proceedings of the 2017 Conference on Designing Interactive Systems · doi:10.1145/3064663.3064703 · Cited by 110 · cited 10×
“Here, the majority of papers reported uses of mobile phone sensors for data collection (n = 9) or analyzed audio signals (n = 6 [23, 31, 77, 78, 122, 168]).”
BackgroundInfluentialRichards, D., Timulak, L., O'Brien, E., Hayes, C., Vigano, N., Sharry, J., & Doherty, G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.10.005 · Cited by 109
Self-citationCorrelations and Population Dynamics in Cortical Networks
Kriener, B., Tetzlaff, T., Aertsen, A., Diesmann, M., & Rotter, S. (2008) · Neural Computation · doi:10.1162/neco.2008.02-07-474 · Cited by 108 · cited 1×
“[ [96] Birgit Kriener, Tom Tetzlaff, Ad Aertsen, Markus Diesmann, and Stefan Rotter.”
Howard, A., Zhang, C., & Horvitz, E. (2017) · IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO) · doi:10.1109/arso.2017.8025197 · Cited by 106 · cited 1×
“[80] Ayanna Howard, Cha Zhang, and Eric Horvitz.”
BackgroundErnala, S. K., Birnbaum, M. L., Candan, K. A., Rizvi, A. F., Sterling, W. A., Kane, J. M., & De Choudhury, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300364 · Cited by 106 · cited 1×
“[53] Sindhu Kiranmai Ernala, Michael L.”
Moments of Change: Analyzing Peer-Based Cognitive Support in Online Mental Health Forums
Pruksachatkun, Y., Pendse, S. R., & Sharma, A. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300294 · Cited by 101
Thieme, A., Wallace, J., Meyer, T. D., & Olivier, P. L. (2015) · British HCI Conference · doi:10.1145/2783446.2783586 · Cited by 96 · cited 2×
“, general mental health or wellbeing [188]); and practices to support mental health more broadly (e.”
BackgroundSelf-citationBone, D., Lee, C.-C., Chaspari, T., Gibson, J., & Narayanan, S. S. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2718581 · Cited by 96 · cited 1×
“3291383 [20] Daniel Bone, Chi-Chun Lee, Theodora Chaspari, James Gibson, and Shrikanth Narayanan.”
Identification of Imminent Suicide Risk Among Young Adults using Text Messages
Nobles, A. L., Glenn, J. J., Kowsari, K., Teachman, B. A., & Barnes, L. E. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173987 · Cited by 93 · cited 16×
“Examples include: the analysis of written suicide notes [145]; of suicidality periods from the SMS messages of individuals with a history of suicidal behaviors [134]; and of suicide risk at time of a person’s referral to mental health services [192], and subsequent periods [2].”
BackgroundMethodInfluentialSemi-Supervised Discriminative Classification Robust to Sample-Outliers and Feature-Noises
Adeli, E., Thung, K.-H., An, L., Wu, G., Shi, F., Wang, T., & Shen, D. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2794470 · Cited by 91 · cited 1×
“[3] Ehsan Adeli, Kim-Han Thung, Le An, Guorong Wu, Feng Shi, Tao Wang, and Dinggang Shen.”
BackgroundCyberbullying Detection and Classification Using Information Retrieval Algorithm
Nandhini, B. S., & Sheeba, J. I. (2015) · International Conference on Advanced Research in Computer Science Engineering & Technology (ICARCSET) · doi:10.1145/2743065.2743085 · Cited by 90 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundSmartphone-centred wearable sensors network for monitoring patients with bipolar disorder
Puiatti, A., Mudda, S., Giordano, S., & Mayora, O. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6090613 · Cited by 90 · cited 1×
“Examples of EMA’s used include: Experience Sampling Method (ESM) based on two-dimensional Circumplex model of emotion [162]; PAM picture library to assess mood [151]; EMAs built on single item stress survey [182]; Stress Monitoring Test (SMT) [139].”
MethodTorous, J. B., & Nebeker, C. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6793 · Cited by 88 · cited 1×
“, through the Connected and Open Research Ethics (CORE) program that manages shared healthcare resources and helps navigate many of the complex, ethical and practical challenges involved in collecting sensitive healthcare data [191].”
BackgroundUsing linguistic and topic analysis to classify sub-groups of online depression communities
Nguyen, T., O’Dea, B., Larsen, M. E., Phung, D., Venkatesh, S., & Christensen, H. M. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3128-x · Cited by 86 · cited 12×
“In the context of social media analysis, a number of papers (n = 5) further aimed to better understand the linguistic characteristics of mental health-related content shared in online communities; focusing primarily on Reddit(2) posts, and in one case, data from Live Journal(3) [133].”
BackgroundMethodInfluentialHealth Technologies 'In the Wild': Experiences of Engagement with Computerised CBT
Rennick‐Egglestone, S., Knowles, S. E., Toms, G. R., Bee, P., Lovell, K., & Bower, P. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858128 · Cited by 85
Yang, Q., Steinfeld, A. M., & Zimmerman, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09612 · Cited by 80 · cited 1×
“For early examples of HCI approaches to assist the interpretation and use of ML-enabled interventions, see recent work in healthcare more broadly, such as personalized fitness apps [52], or clinical support tools in critical surgery decisions [210].”
MethodChikersal, P., Belgrave, D. C. M., Doherty, G. J., Enrique, Á., Palacios, J. E., Richards, D., & Thieme, A. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376341 · Cited by 79 · cited 1×
“[34] Prerna Chikersal, Danielle Belgrave, Gavin Doherty, Angel Enrique, Jorge E.”
BackgroundSelf-citationDependence of Neuronal Correlations on Filter Characteristics and Marginal Spike Train Statistics
Tetzlaff, T., Rotter, S., Stark, E., Abeles, M., Aertsen, A., & Diesmann, M. (2008) · Neural Computation · doi:10.1162/neco.2008.05-07-525 · Cited by 78 · cited 1×
“Papers were excluded if they described topics of neuroscience, neurobiology or neurological conditions – including cell structure, cortex and (f)MRI research (n = 22 [3, 54, 59, 72, 92, 94, 95, 96, 98, 103, 108, 115, 117, 131, 146, 180, 183, 185, 195, 199, 214, 220]), and in one case epilepsy [5].”
BackgroundShaping Trust Through Transparent Design: Theoretical and Experimental Guidelines
Lyons, J. B., Sadler, G. G., Koltai, K., Battiste, H., Ho, N., Hoffmann, L. C., Smith, D. E., Johnson, W. W., & Shively, R. J. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-41959-6_11 · Cited by 78 · cited 1×
“This is needed to better enable laypeople to calibrate their understanding of a system’s capabilities and limitations to reduce risks of over-reliance on potentially over-confident predictions [109, 111].”
BackgroundThe tao of inference in privacy-protected databases
Bindschaedler, V., Grubbs, P., Cash, D., Ristenpart, T., & Shmatikov, V. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3236187.3236217 · Cited by 75 · cited 1×
“[18] Vincent Bindschaedler, Paul Grubbs, David Cash, Thomas Ristenpart, and Vitaly Shmatikov.”
BackgroundFairness-Aware Machine Learning: Practical Challenges and Lessons Learned
Bird, S., Kenthapadi, K., Kıcıman, E., & Mitchell, M. (2019) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3289600.3291383 · Cited by 74 · cited 1×
“[19] Sarah Bird, Krishnaram Kenthapadi, Emre Kiciman, and Margaret Mitchell.”
BackgroundData Mining for Business Applications
Cao, L., Yu, P. S., Chengqi Zhang, B., & Zhang, H. (2008) · Springer eBooks · doi:10.1007/978-0-387-79420-4 · Cited by 71
Using natural language processing to classify suicide notes
Pestian, J. P., Matykiewicz, P., Grupp‐Phelan, J., Lavanier, S., Combs, J., & Kowatch, R. A. (2008) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.3115/1572306.1572327 · Cited by 71
Fatima, I., Mukhtar, H., Ahmad, H. F., & Rajpoot, K. (2018) · Journal of Information Science · doi:10.1177/0165551517740835 · Cited by 66
Doherty, K., Belisario, J. S. M., Cohn, M., Mastellos, N., Morrison, C. P., Car, J., & Doherty, G. J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300416 · Cited by 64 · cited 1×
“1249/00005768- 199305000- 00016 [48] Kevin Doherty, José Marcano-Belisario, Martin Cohn, Nikolaos Mastellos, Cecily Morrison, Josip Car, and Gavin”
BackgroundSelf-citationAnalyzing Engagement in a Web-Based Intervention Platform Through Visualizing Log-Data
Morrison, C., & Doherty, G. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3575 · Cited by 62 · cited 1×
“, SilverCloud Health(10) [49, 127, 157]) or mobile mental health apps (e.”
BackgroundSelf-citationA Contextual Data Mining Approach Toward Assisting the Treatment of Anxiety Disorders
Panagiotakopoulos, T., Lyras, D. P., Livaditis, M., Sgarbas, K., Anastassopoulos, G. C., & Lymberopoulos, D. K. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2038905 · Cited by 60 · cited 13×
“The remaining records primarily captured data from individuals who were described as ‘normal users’, ‘healthy subjects’, ‘students’ or ‘older adults’ [44, 67, 139, 140, 153, 168, 179, 193, 201, 217, 218, 222], or for whom data was sampled from public social media (n = 8, plus 1 record that also includes a diagnostic s…”
BackgroundMethodInfluentialThe SRI AVEC-2014 Evaluation System
Mitra, V., Shriberg, E. E., McLaren, M., Kathol, A., Richey, C., Vergyri, D., & Graciarena, M. (2014) · International Workshop on Audio/Visual Emotion Challenge (AVEC) · doi:10.1145/2661806.2661818 · Cited by 59 · cited 13×
“APPENDIX .1 Examples of Common ML Models or Techniques in Each ML Algorithm Category Supervised Unsupervised Semi-supervised Novel Methods L odels/ echniques Support Vector Machines (SVM) k -Nearest neighbors ( k -NN) Naïve Bayes (NB) Regression analysis, e.g., Logistic Regression (LR), Lasso Supervised Latent Dirichl…”
BackgroundMethodInfluentialData science for mental health: a UK perspective on a global challenge
McIntosh, A. M., Stewart, R., John, A., Smith, D. J., Davis, K., Sudlow, C., Corvin, A., Nicodemus, K. K., Kingdon, D., Hassan, L., et al. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30089-x · Cited by 59 · cited 4×
“However, data collection is costly and particularly complicated where information is deeply personal as well as sensitive due to the stigma that is often associated with mental conditions [29, 53, 116, 190].”
BackgroundMethodInfluentialOpportunities in Machine Learning for Healthcare.Preprint
Ghassemi, M., Naumann, T., Schulam, P., Beam, A. L., & Ranganath, R. (2018) · arXiv (Cornell University) · Cited by 59
Improving Smartphone Users' Affect and Wellbeing with Personalized Positive Psychology Interventions
Jeong, S., & Breazeal, C. (2016) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/2974804.2974831 · Cited by 58 · cited 1×
“[84] Sooyeon Jeong and Cynthia Lynn Breazeal.”
Developing a Comprehensive Framework for Multimodal Feature Extraction
McNamara, Q., de la Vega, A. I., & Yarkoni, T. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098075 · Cited by 56 · cited 1×
“Papers were excluded if they described topics of neuroscience, neurobiology or neurological conditions – including cell structure, cortex and (f)MRI research (n = 22 [3, 54, 59, 72, 92, 94, 95, 96, 98, 103, 108, 115, 117, 131, 146, 180, 183, 185, 195, 199, 214, 220]), and in one case epilepsy [5].”
BackgroundHirsch, T., Soma, C. S., Merced, K., Kuo, P. B., Dembe, A., Caperton, D. D., Atkins, D. C., & Imel, Z. E. (2018) · Designing Interactive Systems Conference · doi:10.1145/3196709.3196776 · Cited by 54 · cited 10×
“[78] Audio (counselling session) Improving treatment User study of a ML system to automatically assess the motivational Interviewing (MI) skills of psychotherapists directly from the audio recording of a counselling session.”
BackgroundInfluentialEx-ray: Data mining and mental health
Diederich, J., Al-Ajmi, A., & Yellowlees, P. (2006) · Applied Soft Computing · doi:10.1016/j.asoc.2006.04.007 · Cited by 53
Classification of Helpful Comments on Online Suicide Watch Forums
Kavuluru, R., Ramos-Morales, M., Holaday, T. C., Garcia‐Williams, A. G., Haye, L., & Cerel, J. (2016) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/2975167.2975170 · Cited by 53 · cited 1×
“1007/ s11042- 019- 7327- 8 [89] Ramakanth Kavuluru, María Ramos-Morales, Tara Holaday, Amanda G.”
Analysing EOG signal features for the discrimination of eye movements with wearable devices
Vidal, M., Bulling, A., & Gellersen, H. W. (2011) · doi:10.1145/2029956.2029962 · Cited by 51
Mental health analysis using deep learning for feature extraction
Joshi, D., Makhija, M., Nabar, Y., Nehete, N., & Patwardhan, M. S. (2018) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3152494.3167990 · Cited by 48 · cited 10×
“[86] Social media: Twitter Detecting symptoms/ condition Development of a model to identify different types of mental health conditions from peoples’ social media tweets.”
BackgroundMethodInfluentialAn integrated framework for suicide risk prediction
Tran, T., Phung, D., Luo, W., Harvey, R., Berk, M., & Venkatesh, S. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2488196 · Cited by 47 · cited 12×
“APPENDIX .1 Examples of Common ML Models or Techniques in Each ML Algorithm Category Supervised Unsupervised Semi-supervised Novel Methods L odels/ echniques Support Vector Machines (SVM) k -Nearest neighbors ( k -NN) Naïve Bayes (NB) Regression analysis, e.g., Logistic Regression (LR), Lasso Supervised Latent Dirichl…”
BackgroundMethodInfluentialDistance-Based Computational Models for Facilitating Robot Interaction with Children
Feil-Seifer, D., & Matarić, M. J. (2012) · Journal of Human-Robot Interaction · doi:10.5898/jhri.1.1.feil-seifer · Cited by 46 · cited 1×
“v13:3 [60] David Feil-Seifer and Maja J.”
Lederman, R., Gleeson, J., Wadley, G., D’alfonso, S., Rice, S., Santesteban-Echarri, O., & Alvarez-Jimenez, M. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3301421 · Cited by 46
Voodoo Machine Learning for Clinical PredictionsPreprint
Saeb, S., Lonini, L., Jayaraman, A., et al. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/059774 · Cited by 44
Thieme, A., McCarthy, J., Johnson, P., Phillips, S., Wallace, J., Lindley, S. E., Ladha, K., Jackson, D., Nowacka, D., Rafiev, A., et al. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858182 · Cited by 42
Self-citationZakaria, C., Balan, R., & Lee, Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359139 · Cited by 42 · cited 18×
“The remaining records primarily captured data from individuals who were described as ‘normal users’, ‘healthy subjects’, ‘students’ or ‘older adults’ [44, 67, 139, 140, 153, 168, 179, 193, 201, 217, 218, 222], or for whom data was sampled from public social media (n = 8, plus 1 record that also includes a diagnostic s…”
BackgroundMethodInfluentialPassive mobile sensing and psychological traits for large scale mood prediction
Spathis, D., Servia-Rodriguez, S., Farrahi, K., Mascolo, C., & Rentfrow, J. (2019) · Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3329189.3329213 · Cited by 40 · cited 13×
“, Emotion Sense [176, 177], SNAPSHOT(7) [135], and StudentLife(8) [128]).”
BackgroundMethodInfluentialFrogner, J. I., Noori, F. M., Halvorsen, P., Hicks, S. A., Garcia-Ceja, E., Tørresen, J., & Riegler, M. A. (2019) · doi:10.1145/3347444.3356238 · Cited by 39 · cited 1×
“3194508 [62] Joakim Ihle Frogner, Farzan Majeed Noori, Pål Halvorsen, Steven Alexander Hicks, Enrique Garcia-Ceja, Jim”
BackgroundDoryab, A., Frost, M. M., Faurholt‐Jepsen, M., Kessing, L. V., & Bardram, J. E. (2014) · Personal and Ubiquitous Computing · doi:10.1007/s00779-014-0826-8 · Cited by 38 · cited 1×
“2208602 [50] Afsaneh Doryab, Mads Frost, et al.”
Can Spike Coordination Be Differentiated from Rate Covariation?
Staude, B., Rotter, S., & Grün, S. (2008) · Neural Computation · doi:10.1162/neco.2008.06-07-550 · Cited by 37 · cited 1×
“Papers were excluded if they described topics of neuroscience, neurobiology or neurological conditions – including cell structure, cortex and (f)MRI research (n = 22 [3, 54, 59, 72, 92, 94, 95, 96, 98, 103, 108, 115, 117, 131, 146, 180, 183, 185, 195, 199, 214, 220]), and in one case epilepsy [5].”
BackgroundAlam, M. G. R., Cho, E. J., Huh, E.-N., & Hong, C. S. (2014) · Proceedings of the 8th International Conference on Ubiquitous Information Management and Communication · doi:10.1145/2557977.2558020 · Cited by 36 · cited 10×
“4), or mentioned needs for data security through secure data storage and handling [6, 82, 153, 201].”
BackgroundMethodInfluential(2019) · Springer eBooks · doi:10.1007/978-3-030-03553-2 · Cited by 34
A Health Social Network Recommender System
Song, I., Dillon, D., Goh, T. J., & Sung, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25044-6_29 · Cited by 32 · cited 2×
“We also excluded neurodevelopmental disorders such as autism or ADHD [ 60 , 175 ] that resent primarily as behavioral conditions.”
BackgroundToward inverse generative social science using multi-objective genetic programming
Vu, T. M., Probst, C., Epstein, J. M., Brennan, A., Strong, M., & Purshouse, R. C. (2019) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3321707.3321840 · Cited by 32
A step towards quantifying when an algorithm can and cannot predict an individual's wellbeing
DeMasi, O., & Recht, B. (2017) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3123024.3125609 · Cited by 31 · cited 1×
“[44] Orianna DeMasi and Benjamin Recht.”
Sequence Multi-task Learning to Forecast Mental Wellbeing from Sparse Self-reported Data
Spathis, D., Servia-Rodriguez, S., Farrahi, K., Mascolo, C., & Rentfrow, J. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330730 · Cited by 30 · cited 11×
“, Emotion Sense [176, 177], SNAPSHOT(7) [135], and StudentLife(8) [128]).”
BackgroundMethodInfluentialSelecting Learning Algorithms for Simultaneous Identification of Depression and Comorbid Disorders
Ojeme, B., & Mbogho, A. J. W. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.08.174 · Cited by 29 · cited 14×
“Here, success of newly developed models is primarily reported through performance measures of the ‘accuracy of the (best) classifier’ or ‘robustness of clustering’ [2, 4, 6, 23, 27, 33, 44, 45, 50, 57, 61, 62, 63, 64, 67, 86, 89, 112, 122, 128, 133, 134, 135, 136, 139, 141, 144, 145, 152, 153, 155, 165, 168, 176, 177,…”
BackgroundMethodInfluentialThieme, A., Belgrave, D. C. M., Sano, A., & Doherty, G. J. (2020) · interactions · doi:10.1145/3381342 · Cited by 27
Self-citationCross-validation of bimodal health-related stress assessment
van den Broek, E. L., van der Sluis, F., & Dijkstra, T. (2013) · Personal and Ubiquitous Computing · doi:10.1007/s00779-011-0468-z · Cited by 26 · cited 12×
“APPENDIX .1 Examples of Common ML Models or Techniques in Each ML Algorithm Category Supervised Unsupervised Semi-supervised Novel Methods L odels/ echniques Support Vector Machines (SVM) k -Nearest neighbors ( k -NN) Naïve Bayes (NB) Regression analysis, e.g., Logistic Regression (LR), Lasso Supervised Latent Dirichl…”
BackgroundMethodInfluentialBourahmoune, K., & Amagasa, T. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/805 · Cited by 26 · cited 1×
“[21] Katia Bourahmoune and Toshiyuki Amagasa.”
Virtual reality prototype for measurement of expression characteristics in emotional situations
Han, K., Ku, J. H., Kim, K. K., Jang, H. J., Park, J., Kim, J., Kim, C. H., Choi, M., Kim, I. Y., & Kim, S. I. (2009) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2008.12.002 · Cited by 25 · cited 1×
“00117 [75] Kiwan Han, Jeonghun Ku, Kwanguk Kim, Hee Jeong Jang, Junyoung Park, Jae-Jin Kim, Chan Hyung Kim, Min-”
BackgroundTech giants enter mental health
Eyre, H. A., Singh, A., & Reynolds, C. F. (2016) · World Psychiatry · doi:10.1002/wps.20297 · Cited by 25 · cited 1×
“[56] even suggest that the field of “mental health captures arguably the largest amount of data of any medical specialty” (p.”
BackgroundPervasive Computing Paradigms for Mental Health
Cipresso, P., Matic, A., & Lopez, G. 1. (2014) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-032-26235-6 · Cited by 25
Improving heart rate variability measurements from consumer smartwatches with machine learning
Maritsch, M., Bérubé, C., Kraus, M., Lehmann, V., Züger, T., Feuerriegel, S., Kowatsch, T., & Wortmann, F. (2019) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3341162.3346276 · Cited by 24 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundMental Workload Management as a Tool in e-Learning Scenarios
Pimenta, A., Gonçalves, S., Carneiro, D. R., Fdez‐Riverola, F., Neves, J., & Nováis, P. (2015) · International Conference on Pervasive and Embedded Computing and Communication Systems · doi:10.5220/0005237700250032 · Cited by 23 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundA Multimodal Approach for Predicting Changes in PTSD Symptom Severity
Mallol-Ragolta, A., Dhamija, S., & Boult, T. E. (2018) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3242969.3242981 · Cited by 23 · cited 12×
“APPENDIX .1 Examples of Common ML Models or Techniques in Each ML Algorithm Category Supervised Unsupervised Semi-supervised Novel Methods L odels/ echniques Support Vector Machines (SVM) k -Nearest neighbors ( k -NN) Naïve Bayes (NB) Regression analysis, e.g., Logistic Regression (LR), Lasso Supervised Latent Dirichl…”
BackgroundMethodInfluentialComputer Assisted Analysis System of Electroencephalogram for Diagnosing Epilepsy
Ahmad, M. A., Khan, N., & Majeed, W. (2014) · International Conference on Pattern Recognition · doi:10.1109/icpr.2014.583 · Cited by 22 · cited 1×
“[5] Malik Anas Ahmad, Nadeem Ahmad Khan, and Waqas Majeed.”
BackgroundTeenagers’ Stress Detection Based on Time-Sensitive Micro-blog Comment/Response Actions
Zhao, L., Jia, J., & Feng, L. (2015) · IFIP Advances in Information and Communication Technology · doi:10.1007/978-3-319-25261-2_3 · Cited by 22 · cited 1×
“’ [33, 105, 211, 219] as a mechanism for ‘diagnostic’ ground truth, as this does not conform with clinical assessment tools such as the DSM [8].”
BackgroundDesigning Effective Movement Digital Biomarkers for Unobtrusive Emotional State Mobile Monitoring
Mehrotra, A., & Musolesi, M. (2017) · doi:10.1145/3089341.3089342 · Cited by 22 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundMining Free-Text Medical Notes for Suicide Risk Assessment
Adamou, M., Antoniou, G., Greasidou, E., Lagani, V., Charonyktakis, P., & Tsamardinos, I. (2018) · Proceedings of the 10th Hellenic Conference on Artificial Intelligence · doi:10.1145/3200947.3201020 · Cited by 22 · cited 1×
“3174156 [2] Marios Adamou, Grigoris Antoniou, Elissavet Greasidou, Vincenzo Lagani, Paulos Charonyktakis, and Ioannis”
BackgroundA Comparison of Descriptive Models of a Single Spike Train by Information-Geometric Measure
Nakahara, H., Амари, Ш.-И., & Richmond, B. J. (2006) · Neural Computation · doi:10.1162/089976606775623289 · Cited by 21
Disruptions, Dilemmas and Paradoxes: Ethical Matter(s) in Design Research
Nathan, L. P., Thieme, A., Tatar, D. G., & Branham, S. M. (2016) · Interacting with Computers · doi:10.1093/iwc/iww034 · Cited by 21
Self-citationEmergence of population synchrony in a layered network of the cat visual cortex
Kremkow, J., Kumar, A., Rotter, S., & Aertsen, A. (2006) · Neurocomputing · doi:10.1016/j.neucom.2006.10.130 · Cited by 20 · cited 1×
“1007/978- 94- 009- 0279- 4 _ 9 [94] Jens Kremkow, Arvind Kumar, Stefan Rotter, and Ad Aertsen.”
Galiatsatos, D., Κωνσταντοπούλου, Γ., Anastassopoulos, G. C., Nerantzaki, M., Assimakopoulos, K., & Lymberopoulos, D. K. (2015) · International Conference on Engineering Applications of Neural Networks · doi:10.1145/2797143.2797159 · Cited by 19 · cited 1×
“3356238 [63] Dimitrios Galiatsatos, Georgia Konstantopoulou, George Anastassopoulos, Marina Nerantzaki, Konstantinos”
BackgroundA Real-time Image Analysis System for Computer-Assisted Diagnosis of Neurological Disorders
Tan, T., Guan, L., & Burne, J. A. (1999) · Real-Time Imaging · doi:10.1006/rtim.1998.0139 · Cited by 19
Young, S. D., & Garett, R. (2018) · JMIR Mental Health · doi:10.2196/mental.8971 · Cited by 18
Kriegeskorte, N., Bodurka, J., & Bandettini, P. A. (2008) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.20166 · Cited by 17 · cited 1×
“Papers were excluded if they described topics of neuroscience, neurobiology or neurological conditions – including cell structure, cortex and (f)MRI research (n = 22 [3, 54, 59, 72, 92, 94, 95, 96, 98, 103, 108, 115, 117, 131, 146, 180, 183, 185, 195, 199, 214, 220]), and in one case epilepsy [5].”
BackgroundOviatt, S. L., Schuller, B. W., Cohen, P. R., Sonntag, D., Potamianos, G., & Krüger, A. (2018) · Cited by 16
Sidahmed, H., Prokofyeva, E., & Blaschko, M. B. (2015) · Information Sciences · doi:10.1016/j.ins.2015.03.069 · Cited by 15
Expressive Biosignals: Authentic Social Cues for Social Connection
Liu, F. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3299081 · Cited by 15 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundA Mobile App for Patients and Those Who Care About Them: A Case Study for Veterans with PTSD + Anger
Barish, G., Aralis, H. J., Elbogen, E. B., & Lester, P. E. (2019) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3329189.3329248 · Cited by 15 · cited 1×
“079 [11] Greg Barish, Hilary Aralis, Eric Elbogen, and Patricia Lester.”
BackgroundCoyle, D., Thieme, A., Linehan, C., Balaam, M., Wallace, J., & Lindley, S. E. (2014) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.05.008 · Cited by 15
Self-citationPatterson, D. A., & Cloud, R. N. (1999) · CRC Press eBooks · doi:10.1201/9781003759973-6 · Cited by 14
Statistical analysis of spatially embedded networks: From grid to random node positions
Voges, N., Aertsen, A., & Rotter, S. (2006) · Neurocomputing · doi:10.1016/j.neucom.2006.10.126 · Cited by 14 · cited 1×
“Papers were excluded if they described topics of neuroscience, neurobiology or neurological conditions – including cell structure, cortex and (f)MRI research (n = 22 [3, 54, 59, 72, 92, 94, 95, 96, 98, 103, 108, 115, 117, 131, 146, 180, 183, 185, 195, 199, 214, 220]), and in one case epilepsy [5].”
BackgroundReducing Incarceration through Prioritized Interventions
Bauman, M. J., Boxer, K. S., Lin, T.-Y., Salomon, E., Naveed, H., Haynes, L., Walsh, J., Helsby, J., Yoder, S., Sullivan, R., et al. (2018) · Proceedings of the 1st ACM SIGCAS Conference on Computing and Sustainable Societies · doi:10.1145/3209811.3209869 · Cited by 14 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundAutomatic Prediction of Depression in Older Age
Yang, H., & Bath, P. A. (2019) · International Conference on Medical and Health Informatics (ICMHI) · doi:10.1145/3340037.3340042 · Cited by 14 · cited 14×
“1145/3057270 209] Hui Yang and Peter A. Bath.”
BackgroundMethodInfluentialThe Application of User Event Log Data for Mental Health and Wellbeing Analysis
Turkington, R., Mulvenna, M. D., Bond, R., O.Neill, S., & Armour, C. (2018) · Electronic workshops in computing · doi:10.14236/ewic/hci2018.4 · Cited by 13 · cited 6×
“ML approaches also have potential for enabling more targeted adjustments to treatment through advancing our understanding of what types of interventions, or their form of delivery, may work most effectively for particular people [11, 172, 194].”
BackgroundMethodInfluentialProbabilistic Latent Variable Modeling for Assessing Behavioral Influences on Well-Being
Nosakhare, E., & Picard, R. W. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330738 · Cited by 13 · cited 11×
“, Emotion Sense [176, 177], SNAPSHOT(7) [135], and StudentLife(8) [128]).”
BackgroundMethodInfluentialMultimodal Machine Learning for Interactive Mental Health Therapy
Tavabi, L. (2019) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3340555.3356095 · Cited by 13 · cited 12×
“Several papers (n = 7) described complex multi-modal systems, or frameworks that built on everyday technology [82, 140, 193, 222], robot [154], or human/ virtual agent [155, 184] interactions.”
BackgroundMethodInfluentialA feature-based selection technique for reduction of large scale data
Chauhan, R., & Kaur, H. (2017) · International Journal of Data Analysis Techniques and Strategies · doi:10.1504/ijdats.2017.086630 · Cited by 13
Feng, C., Gao, H., Ling, X. B., Ji, J., & Ma, Y. (2018) · International Conference on Bioinformatics and Computational Biology (ICBCB) · doi:10.1145/3194480.3194508 · Cited by 12 · cited 1×
“[61] Chaonan Feng, Huimin Gao, Xuefeng B.”
Inferring Functional Brain States Using Temporal Evolution of Regularized Classifiers
Zhdanov, A. V., Hendler, T., Ungerleider, L. G., & Intrator, N. (2007) · Computational Intelligence and Neuroscience · doi:10.1155/2007/52609 · Cited by 11 · cited 1×
“Papers were excluded if they described topics of neuroscience, neurobiology or neurological conditions – including cell structure, cortex and (f)MRI research (n = 22 [3, 54, 59, 72, 92, 94, 95, 96, 98, 103, 108, 115, 117, 131, 146, 180, 183, 185, 195, 199, 214, 220]), and in one case epilepsy [5].”
BackgroundLearning structurally consistent undirected probabilistic graphical models
Roy, S., Lane, T. D. R., & Werner‐Washburne, M. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553490 · Cited by 11 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundA multi-modal human robot interaction framework based on cognitive behavioral therapy model
Rastogi, N., Keshtkar, F., & Miah, S. (2018) · doi:10.1145/3279963.3279968 · Cited by 11
Improving Heart Rate Variability Measurements from Consumer Smartwatches with Machine Learning
Maritsch, M., Bérubé, C., Kraus, M., Lehmann, V. F., Züger, T., Feuerriegel, S., Kowatsch, T., & Wortmann, F. (2019) · Alexandria (UniSG) (University of St.Gallen) · doi:10.7892/boris.138443 · Cited by 11
Knowledge discovery from doctor-patient relationship
Aguilar–Ruiz, J. S., Costa, R. L., & Divina, F. (2004) · ACM Symposium on Applied Computing · doi:10.1145/967900.967960 · Cited by 9 · cited 8×
“[4] Questionnaire Assessing patient-clinician relationship Development of knowledge model for describing the relationship between (psychiatric) patients and their doctors in a hospital context.”
BackgroundMethodInfluentialChang, K.-H., Chan, M. K., & Canny, J. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979859 · Cited by 9 · cited 10×
“Many of these works focus on the (early) detection (and monitoring) of depression or its symptoms (n = 10) [31, 33, 44, 57, 62, 122, 136 154, 211, 222], most often through the analysis of acoustic features of speech [31, 122] or Twitter tweets [33, 86, 211].”
BackgroundMethodInfluentialBayesian Estimation of Stimulus Responses in Poisson Spike Trains
Lehky, S. R. (2004) · Neural Computation · doi:10.1162/089976604323057407 · Cited by 9
Human-Machine and Human-Robot Interaction for Long-Term User Engagement and Behavior Change
Matarić, M. J. (2019) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3300061.3300141 · Cited by 9
Ranking neurons for mining structure-activity relations in biological neural networks: NeuronRank
Gürel, T., Raedt, L. D., & Rotter, S. (2006) · Neurocomputing · doi:10.1016/j.neucom.2006.10.064 · Cited by 8 · cited 1×
“0307752101 [72] Tayfun Gürel, Luc De Raedt, and Stefan Rotter.”
BackgroundData collection requirements for mobile connected health: an end user development approach
Veiga, J. J. D., & Ward, T. E. (2016) · doi:10.1145/3001854.3001856 · Cited by 8 · cited 1×
“Further excluded were papers that described ML research outside a specific focus on mental health (n = 16 [21, 26, 32, 43, 75, 81, 88, 114, 118, 120, 160, 167, 200, 208, 215, 221]); or that otherwise did not fit thematically (n = 20 [11, 14, 18, 29, 30, 36, 55, 87, 101, 107, 110, 113, 138, 143, 147, 174, 178, 194, 197…”
BackgroundComputational Methods to Understand Deviant Mental Wellness Communities
Chancellor, S. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3173021 · Cited by 8
A multimodal adaptive dialogue manager for depressive and anxiety disorder screening
Tsiakas, K., Watts, L., Lutterodt, C., Γιαννακόπουλος, Θ., Papangelis, A., Gatchel, R. J., Karkaletsis, V., & Makedon, F. S. (2015) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/2769493.2769572 · Cited by 7
DeHaas, D., Craig, J., Rickert, C., Eppstein, M. J., Haake, P., & Stor, K. (2007) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1276958.1277331 · Cited by 7 · cited 1×
“[43] Drew DeHaas, Jesse Craig, Colin Rickert, Margaret J.”
BackgroundProceedings of the 1st Workshop on Digital Biomarkers
(2017) · doi:10.1145/3089341 · Cited by 7
Research works printed but not linked: 15
- American Psychiatry Association . 2019. Diagnostic and Statistical Manual of Mental Disorders (DSM--5). Last retrieved 7 th July 2019 from https://www.psychiatry.org/psychiatrists/practice/dsm. American Psychiatry Association. 2019. Diagnostic and Statistical Manual of Mental Disorders (DSM--5). Last retrieved 7 th July 2019 from https://www.psychiatry.org/psychiatrists/practice/dsm.
- Leo Breiman and Adele Cutler . 2007. Random Forests-Classification Description. Department of Statistics , University of California , Berkeley. Leo Breiman and Adele Cutler. 2007. Random Forests-Classification Description. Department of Statistics, University of California, Berkeley.
- Moustapha M. Cisse , Yossi Adi , Natalia Neverova , and Joseph Keshet . 2017 . Houdini: Fooling deep structured visual and speech recognition mossdels with adversarial examples . In Proceedings of the s Neural Information Processing Systems (NIPS’17) . 6977--6987. Moustapha M. Cisse, Yossi Adi, Natalia Neverova, and Joseph Keshet. 2017. Houdini: Fooling deep structured visual and speech recognition mossdels with adversarial examples. In Proceedings of the s Neural Information Processing Systems (NIPS’17). 6977--6987.
- Jason A. Colquitt , and Jessica B . Rodell . 2015 . Measuring justice and fairness. In Oxford Handbook of Justice in the Workplace. Vol. 187 , Oxford University Press , 202. Jason A. Colquitt, and Jessica B. Rodell. 2015. Measuring justice and fairness. In Oxford Handbook of Justice in the Workplace. Vol. 187, Oxford University Press, 202.
- Emad N. Eskandar and Barry J. Richmond. 1991. Decoding of neuronal signals in visual pattern recognition . In Proceedings of the 4th International Conference on Neural Information Processing Systems (NIPS’91) . J. E. Moody, S. J. Hanson, and R. P. Lippmann (Eds.), Morgan Kaufmann Publishers Inc., San Francisco, CA, 356--363. Emad N. Eskandar and Barry J. Richmond. 1991. Decoding of neuronal signals in visual pattern recognition. In Proceedings of the 4th International Conference on Neural Information Processing Systems (NIPS’91). J. E. Moody, S. J. Hanson, and R. P. Lippmann (Eds.), Morgan Kaufmann Publishers Inc., San Francisco, CA, 356--363.
- 10.5555/1343031.1343035 · doi:10.5555/1343031.1343035
- Natasha Jaques , Sara Taylor , Ehimwenma Nosakhare , Akane Sano , and Rosalind Picard . 2016 . Multi-task learning for predicting health, stress, and happiness . In Proceedings of the NIPS Workshop on Machine Learning for Healthcare. Last Retrieved 14th September 2019 from https://pdfs.semanticscholar.org/b228/7a406985980515d5cc63e9b37fb17c5186f8.pdf. Natasha Jaques, Sara Taylor, Ehimwenma Nosakhare, Akane Sano, and Rosalind Picard. 2016. Multi-task learning for predicting health, stress, and happiness. In Proceedings of the NIPS Workshop on Machine Learning for Healthcare. Last Retrieved 14th September 2019 from https://pdfs.semanticscholar.org/b228/7a406985980515d5cc63e9b37fb17c5186f8.pdf.
- Maria Madsen , and Shirley Gregor . 2000 . Measuring human-computer trust . In Proceedings of the 11th Australasian Conference on Information Systems. Vol. 53 , 6--8. Maria Madsen, and Shirley Gregor. 2000. Measuring human-computer trust. In Proceedings of the 11th Australasian Conference on Information Systems. Vol. 53, 6--8.
- Sharon Oviatt Björn Schuller Philip R. Cohen Daniel Sonntag Gerasimos Potamianos and Antonio Krüger (Eds.). 2018. The Handbook of Multimodal-Multisensor Interfaces. ACM and Morgan 8 Claypool xvii--xix. DOI:https://doi.org/10.1145/3107990.3107991 · DOI
- 10.5555/1827616.1827621 · doi:10.5555/1827616.1827621
- 10.1300/j017v16n02_05 · doi:10.1300/j017v16n02_05
- 10.5555/1572306.1572327 · doi:10.5555/1572306.1572327
- Koustuv Saha , Benjamin Sugar , John Torous , Bruno Abrahao , Emre Kıcıman , and Munmun De Choudhury . 2019 . A social media study on the effects of psychiatric medication use . In Proceedings of the International AAAI Conference on Web and Social Media 13 , 1 (2019), 440--451. DOI:https://wvvw.aaai.org/ojs/index.php/ICWSM/article/view/3242 Koustuv Saha, Benjamin Sugar, John Torous, Bruno Abrahao, Emre Kıcıman, and Munmun De Choudhury. 2019. A social media study on the effects of psychiatric medication use. In Proceedings of the International AAAI Conference on Web and Social Media 13, 1 (2019), 440--451. DOI:https://wvvw.aaai.org/ojs/index.php/ICWSM/article/view/3242
- Oliver Theobald . 2017. Machine Learning for Absolute Beginners. A Plain English Introduction . Scatterplot Press . Oliver Theobald. 2017. Machine Learning for Absolute Beginners. A Plain English Introduction. Scatterplot Press.
- Frank W. Weathers , Brett T. Litz , Debra S. Herman , Jennifer A. Huska , and Terence M. Keane . 1993. The PTSD checklist (PCL): Reliability, validity, and diagnostic utility . In Proceedings of the Annual Convention of the International Society for Traumatic Stress Studies. Vol. 462 . Frank W. Weathers, Brett T. Litz, Debra S. Herman, Jennifer A. Huska, and Terence M. Keane. 1993. The PTSD checklist (PCL): Reliability, validity, and diagnostic utility. In Proceedings of the Annual Convention of the International Society for Traumatic Stress Studies. Vol. 462.
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Remote patient monitoring using artificial intelligence: Current state, applications, and challenges
Shaik, T., Tao, X., Higgins, N., Li, L., Gururajan, R., Zhou, X., & Acharya, U. R. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1485 · Cited by 515
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Gao, L., Biderman, S., Black, S., Golding, L., Hoppe, T., Foster, C., Phang, J., He, H., Thite, A., Nabeshima, N., et al. (2021) · arXiv · doi:10.48550/arxiv.2101.00027 · Cited by 492
Technology Acceptance in Mobile Health: Scoping Review of Definitions, Models, and Measurement
Nadal, C., Sas, C., & Doherty, G. (2020) · Journal of Medical Internet Research · doi:10.2196/17256 · Cited by 320
Self-citationUncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., Tickoo, O., et al. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462571 · Cited by 300
“, [81, 173]).”
Metadata
- Authors
- Thieme, A., Belgrave, D., & Doherty, G.
- Affiliations
- Microsoft Research (United Kingdom) (GB)
- Trinity College Dublin (IE)
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2020-08-17
- Volume
- 27
- Issue
- 5
- Pages
- 1-53
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W3042379185
- Cited by
- 406
- References
- 217
- Citations by year
- 2026: 53 · 2025: 91 · 2024: 82 · 2023: 63 · 2022: 82 · 2021: 29 · 2020: 6
- FWCI
- 40.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion)
- Funders
- Adapt Centre and Marie Sklodowska-Curie (722022)
- SFI (13/RC/2106)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Keywords
- mental disorder detection, psychiatric diagnosis, personalized treatment, behavioral pattern recognition, mental health risk factors, disease progression prediction, human-centered design, interdisciplinary research, ethical implications of AI, clinical implementation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.