A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media
The DOI matches its Crossref record; 85 of the 86 references it cites were found in a registry or an index.
Abstract
Powered by machine learning techniques, social media provides an unobtrusive lens into individual behaviors, emotions, and psychological states. Recent research has successfully employed social media data to predict mental health states of individuals, ranging from the presence and severity of mental disorders like depression to the risk of suicide. These algorithmic inferences hold great potential in supporting early detection and treatment of mental disorders and in the design of interventions. At the same time, the outcomes of this research can pose great risks to individuals, such as issues of incorrect, opaque algorithmic predictions, involvement of bad or unaccountable actors, and potential biases from intentional or inadvertent misuse of insights. Amplifying these tensions, there are also divergent and sometimes inconsistent methodological gaps and under-explored ethics and privacy dimensions. This paper presents a taxonomy of these concerns and ethical challenges, drawing from existing literature, and poses questions to be resolved as this research gains traction. We identify three areas of tension: ethics committees and the gap of social media research; questions of validity, data, and machine learning; and implications of this research for key stakeholders. We conclude with calls to action to begin resolving these interdisciplinary dilemmas.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“if a user decides to 'drop out' from social media after their data has been collected, their health data may still be stored [34].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [34]
In the citing paper
“One consideration is the dignity of developers, who may have no training in healthcare and could find emotional content traumatic [34].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [34]
In the citing paper
“may not be practically feasible for social media or other large datasets encompassing millions of individuals [34].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [34]
In the citing paper
“Social media data may be problematic on numerous counts: it may be an inaccurate representation of an individuals' mental state (given one's self-portrayal on social media can differ markedly from offline behaviours); it may include other users who have been 'tagged' (who themselves have a right to privacy); and it may be difficult to anonymise [32,34].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [34]
In the citing paper
“users generally expect their privacy to be respected online [37], with most feeling their data should not be used for mental health research without their explicit consent [34].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [34]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
boyd, D., & Crawford, K. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.678878 · Cited by 5,479
Detecting influenza epidemics using search engine query data
Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., & Brilliant, L. (2009) · Nature · doi:10.1038/nature07634 · Cited by 4,295
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687 · cited 1×
“This emerged in scrutinized experimental studies of Facebook data [52], where researchers manipulated the mood of millions of Facebook users without consent.”
BackgroundHow stigma interferes with mental health care.
Corrigan, P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.7.614 · Cited by 3,648
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“However, deep learning has a key limitation – they do not produce intelligible feature sets for human understanding [10].”
BackgroundPrivacy as Contextual IntegrityPreprint
Nissenbaum, H. F. (2004) · SSRN Electronic Journal · Cited by 2,961
What Makes Clinical Research Ethical?
Emanuel, E. J. (2000) · JAMA · doi:10.1001/jama.283.20.2701 · Cited by 2,710 · cited 1×
“In clinical studies, this obligation is at the forefront of experimental design [32].”
BackgroundThe Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
Writing About Emotional Experiences as a Therapeutic Process
Pennebaker, J. W. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00403.x · Cited by 2,486 · cited 1×
“processing [11] and psychology [71] to represent text as cues of well-being, these studies described mood shifts around political”
BackgroundLenggenhager, J. (1947) · PubMed · Cited by 1,772
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700 · cited 5×
“[73] Andrew G Reece and Christopher M Danforth.”
BackgroundInfluentialPredicting Depression via Social Media
De Choudhury, M., Gamon, M., Counts, S., & Horvitz, E. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14432 · Cited by 1,579 · cited 6×
“used clinically validated depression measures to find Twitter users who tested for major depressive disorder [28].”
BackgroundMethodInfluentialEysenbach, G. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1157 · Cited by 1,351 · cited 1×
“” [33] This famously includes the use of human-generated data to predict influenza outbreaks through search engines [36].”
BackgroundFacebook Profiles Reflect Actual Personality, Not Self-Idealization
Back, M. D., Stopfer, J. M., Vazire, S., Gaddis, S., Schmukle, S. C., Egloff, B., & Gosling, S. D. (2010) · Psychological Science · doi:10.1177/0956797609360756 · Cited by 1,169 · cited 1×
“Besides establishing that psychological and health states can be inferred from this data, these findings show that people use social media to discuss their personal mood and activities honestly and candidly instead of their idealized versions [3].”
BackgroundDiurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures
Golder, S. A., & Macy, M. W. (2011) · Science · doi:10.1126/science.1202775 · Cited by 1,155 · cited 1×
“events [7], geographic differences in expressed well-being [79], and the seasonality and temporality of mood variation [38].”
BackgroundHuman Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Department of Health and Human Services
(2002) · Handbook of Research Design & Social Measurement · doi:10.4135/9781412984386.n104 · Cited by 1,032
You Are What You Tweet: Analyzing Twitter for Public Health
Paul, M., & Dredze, M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14137 · Cited by 947 · cited 13×
“Researchers also used social media data to track the spread of disease [76] and to analyze other ailments on population-scale user bases from Twitter [70].”
BackgroundInfluentialModeling Public Mood and Emotion: Twitter Sentiment and Socio-Economic Phenomena
Bollen, J., Mao, H., & Pepe, A. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14171 · Cited by 936
“But the data is already public”: on the ethics of research in Facebook
Zimmer, M. (2010) · Ethics and Information Technology · doi:10.1007/s10676-010-9227-5 · Cited by 900 · cited 2×
“consent [5, 58] and contextual data integrity [85, 90]; data protection, anonymization, and privacy [17, 45, 94, 93]; methodological rigor [66, 70, 53]; bias and validity [40, 66]; and implications of the research for different stakeholders [8, 18].”
BackgroundTemporal patterns of happiness and information in a global social network: hedonometrics and Twitter
Dodds, P. S., Harris, K. D., Kloumann, I. M., Bliss, C. A., & Danforth, C. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026752 · Cited by 809 · cited 13×
“Researchers also used social media data to track the spread of disease [76] and to analyze other ailments on population-scale user bases from Twitter [70].”
BackgroundInfluentialSocial Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763 · cited 4×
“By gathering data from social media, we bias our data to those who use social media, meaning it is likely a younger and more technologically literate sample than the population as a whole [66].”
BackgroundInfluentialSocial Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kiciman, E. (2016) · doi:10.2139/ssrn.2886526 · Cited by 763
Quantifying Mental Health Signals in Twitter
Coppersmith, G., Dredze, M., & Harman, C. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3207 · Cited by 722 · cited 7×
“This can also be seen in automatic screening and text processing systems, like advertising recommendations, which could scan Twitter posts for self-reported diagnoses of mental disorders [19, 21] and send advertisements for prescription drugs.”
BackgroundMethodInfluentialDiscovering Shifts to Suicidal Ideation from Mental Health Content in Social Media
De Choudhury, M., Kiciman, E., Dredze, M., Coppersmith, G., & Kumar, M. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858207 · Cited by 683 · cited 3×
“Research has examined other disorders, such as post-traumatic stress disorder [21], anxiety [81], schizophrenia [6, 60], eating disorders [13, 14, 25], and suicidal ideation [30, 29, 39].”
Background“Participant” Perceptions of Twitter Research Ethics
Fiesler, C., & Proferes, N. (2018) · Social Media + Society · doi:10.1177/2056305118763366 · Cited by 528 · cited 2×
“In fact, a recent survey study, though not specific to the mental health domain, found that few social media users were aware that their public content could be used by researchers, and the majority felt that researchers should not be able to use tweets without consent [34].”
Background(2007) · Cited by 521
Instagram photos reveal predictive markers of depression
Reece, A. G., & Danforth, C. M. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0110-z · Cited by 519 · cited 11×
“Automated image analysis can identify self-harm photos on Flickr [89], signs of depression through Instagram images [73], and mental health disclosures on Reddit [56].”
BackgroundInfluentialPredicting postpartum changes in emotion and behavior via social media
De Choudhury, M., Counts, S., & Horvitz, E. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466447 · Cited by 462 · cited 8×
“We find this interpretation consistent across different countries and in different research environments [21, 84, 26].”
BackgroundInfluentialPrediction and explanation in social systems
Hofman, J. M., Sharma, A., & Watts, D. J. (2017) · Science · doi:10.1126/science.aal3856 · Cited by 429 · cited 1×
“Next, we discuss ethical challenges arising from a need for algorithmic interpretability and performance [43].”
BackgroundWhere are human subjects in big data research? the emerging ethics divide
Metcalf, J., & Crawford, K. (2016) · Big Data & Society · doi:10.1177/2053951716650211 · Cited by 394 · cited 4×
“IRBs, deliberately transform people into “research subjects” in scientific inquiry; this transformation prescribes people with certain rights, protections, and obligations that must be protected [58].”
BackgroundInfluentialCharacterizing and predicting postpartum depression from shared facebook data
De Choudhury, M., Counts, S., Horvitz, E. J., & Hoff, A. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531675 · Cited by 379 · cited 2×
“also sought to identify new mothers who might be suffering from postpartum depression using Facebook and Twitter data [26, 27].”
BackgroundNatural language processing in mental health applications using non-clinical texts
CALVO, R. A., MILNE, D. N., HUSSAIN, M. S., & CHRISTENSEN, H. (2017) · Natural Language Engineering · doi:10.1017/s1351324916000383 · Cited by 362 · cited 1×
“processing [11] and psychology [71] to represent text as cues of well-being, these studies described mood shifts around political”
BackgroundRecognizing Depression from Twitter Activity
Tsugawa, S., Kikuchi, Y., Kishino, F., Nakajima, K., Itoh, Y., & Ohsaki, H. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702280 · Cited by 334 · cited 4×
“We find this interpretation consistent across different countries and in different research environments [21, 84, 26].”
BackgroundInfluentialFrom ADHD to SAD: Analyzing the Language of Mental Health on Twitter through Self-Reported Diagnoses
Coppersmith, G., Dredze, M., Harman, C., & Hollingshead, K. (2015) · Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w15-1201 · Cited by 332 · cited 6×
“EMNLP, October, 1348–1353.”
MethodInfluentialMeasuring post traumatic stress disorder in Twitter
Coppersmith, G., Harman, C., & Dredze, M. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14574 · Cited by 316 · cited 8×
“This can also be seen in automatic screening and text processing systems, like advertising recommendations, which could scan Twitter posts for self-reported diagnoses of mental disorders [19, 21] and send advertisements for prescription drugs.”
BackgroundMethodInfluentialBruckman, A. (2002) · Ethics and Information Technology · doi:10.1023/a:1021316409277 · Cited by 274 · cited 2×
“” [92] Is is appropriate to observe online health communities for research if it violates this contextual integrity? What about benign discussions on personal social media accounts? As Bruckman recommends, one way to resolve this contextual gap is by asking for permission through community leaders [9], which is feasib…”
BackgroundMethodIs bigger always better? potential biases of big data derived from social network sites
Hargittai, E. (2015) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716215570866 · Cited by 268 · cited 2×
“consent [5, 58] and contextual data integrity [85, 90]; data protection, anonymization, and privacy [17, 45, 94, 93]; methodological rigor [66, 70, 53]; bias and validity [40, 66]; and implications of the research for different stakeholders [8, 18].”
BackgroundEthical challenges of big data in public health
Vayena, E., Salathé, M., Madoff, L. C., & Brownstein, J. S. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1003904 · Cited by 268 · cited 2×
“consent [5, 58] and contextual data integrity [85, 90]; data protection, anonymization, and privacy [17, 45, 94, 93]; methodological rigor [66, 70, 53]; bias and validity [40, 66]; and implications of the research for different stakeholders [8, 18].”
BackgroundResearching Mental Health Disorders in the Era of Social Media: Systematic Review
Wongkoblap, A., Vadillo, M. A., & Curcin, V. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7215 · Cited by 268 · cited 1×
“Systematic literature reviews and recommendations are beginning to be published [91, 5, 18]; in fact, the taxonomy we present here was”
BackgroundData, privacy, and the greater good
Horvitz, E., & Mulligan, D. (2015) · Science · doi:10.1126/science.aac4520 · Cited by 267 · cited 4×
“consent [5, 58] and contextual data integrity [85, 90]; data protection, anonymization, and privacy [17, 45, 94, 93]; methodological rigor [66, 70, 53]; bias and validity [40, 66]; and implications of the research for different stakeholders [8, 18].”
BackgroundInfluentialA topology of Twitter research: disciplines, methods, and ethics
Zimmer, M., & Proferes, N. J. (2014) · Aslib Journal of Information Management · doi:10.1108/ajim-09-2013-0083 · Cited by 257 · cited 5×
“[34] Casey Fiesler and Nicholas Proferes.”
BackgroundInfluentialTowards Assessing Changes in Degree of Depression through Facebook
Schwartz, H. A., Eichstaedt, J., Kern, M. L., Park, G., Sap, M., Stillwell, D., Kosinski, M., & Ungar, L. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3214 · Cited by 256 · cited 3×
“Work also now explores the symptomatology of mental disorders, such as the severity of mental illness [13, 78] and stress connected to mental health [55].”
BackgroundAn unobtrusive behavioral model of "gross national happiness"
Kramer, A. D. I. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753369 · Cited by 247 · cited 13×
“New insights could prevent the development of latent conditions, mitigate the impact of emerging disorders, or as exemplified by Facebook’s new suicide AI, new opportunities to intervene with life-saving assistance.”
BackgroundInfluentialCharacterisation of mental health conditions in social media using Informed Deep Learning
Gkotsis, G., Oellrich, A., Velupillai, S., Liakata, M., Hubbard, T. J. P., Dobson, R. J. B., & Dutta, R. (2017) · Scientific Reports · doi:10.1038/srep45141 · Cited by 239 · cited 6×
“Automated image analysis can identify self-harm photos on Flickr [89], signs of depression through Instagram images [73], and mental health disclosures on Reddit [56].”
BackgroundMethodInfluential“Go Away”: Participant Objections to Being Studied and the Ethics of Chatroom Research
Hudson, J. M., & Bruckman, A. (2004) · The Information Society · doi:10.1080/01972240490423030 · Cited by 236 · cited 2×
“Behavior in these communities indicate that these groups may have no intention of being discovered by others [13], and they may outright refuse participation in research [47].”
BackgroundCheng, Q., Li, T. M., Kwok, C.-L., Zhu, T., & Yip, P. S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7276 · Cited by 235 · cited 2×
“status is a growing area of research interest across sub-disciplines of CS and is gaining traction in relevant domains [6, 15].”
BackgroundSocial media, big data, and mental health: current advances and ethical implications
Conway, M., & O’Connor, D. (2016) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2016.01.004 · Cited by 231
Ethical research protocols for social media health research
Benton, A., Coppersmith, G., & Dredze, M. (2017) · Proceedings of the First ACL Workshop on Ethics in Natural Language Processing · doi:10.18653/v1/w17-1612 · Cited by 219 · cited 4×
“Unlike in public health [5], predicting mental health states, even if with public data, borders on medical diagnosis, such as predicting the presence of schizophrenia.”
BackgroundInfluentialCharacterizing Geographic Variation in Well-Being Using Tweets
Schwartz, H., Eichstaedt, J., Kern, M., Dziurzynski, L., Lucas, R., Agrawal, M., Park, G., Lakshmikanth, S., Jha, S., Seligman, M., et al. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14442 · Cited by 218 · cited 1×
“events [7], geographic differences in expressed well-being [79], and the seasonality and temporality of mood variation [38].”
BackgroundA Depression Detection Model Based on Sentiment Analysis in Micro-blog Social Network
Wang, X., Zhang, C., Ji, Y., Sun, L., Wu, L., & Bao, Z. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40319-4_18 · Cited by 217 · cited 1×
“After these works, researchers began to replicate, extend, generalize, and improve on these findings [63, 78, 74] and in different cultural contexts and social media sites, beyond just English-speaking Twitter [84, 88].”
BackgroundDetecting Anxiety through Reddit
Shen, J. H., & Rudzicz, F. (2017) · Proceedings of the Fourth Workshop on Computational Linguistics and Clinical Psychology –- From Linguistic Signal to Clinical Reality · doi:10.18653/v1/w17-3107 · Cited by 209 · cited 3×
“Research has examined other disorders, such as post-traumatic stress disorder [21], anxiety [81], schizophrenia [6, 60], eating disorders [13, 14, 25], and suicidal ideation [30, 29, 39].”
BackgroundThe Language of Social Support in Social Media and Its Effect on Suicidal Ideation Risk
De Choudhury, M., & Kiciman, E. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14891 · Cited by 202 · cited 1×
“Research has examined other disorders, such as post-traumatic stress disorder [21], anxiety [81], schizophrenia [6, 60], eating disorders [13, 14, 25], and suicidal ideation [30, 29, 39].”
BackgroundQuantifying and Predicting Mental Illness Severity in Online Pro-Eating Disorder Communities
Chancellor, S., Lin, Z., Goodman, E. L., Zerwas, S., & De Choudhury, M. (2016) · Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing · doi:10.1145/2818048.2819973 · Cited by 188 · cited 12×
“Given that demographic attributes such as age are inferrable from social media language [80], should we research online eating disorder communities, knowing a large subset of these individuals are likely minors [13, 14]? When should data scientists consider vulnerable populations, and how should we protect this data?…”
BackgroundInfluentialSelf-citationUser-level psychological stress detection from social media using deep neural network
Lin, H., Jia, J., Guo, Q., Xue, Y., Li, Q., Huang, J., Cai, L., & Feng, L. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654945 · Cited by 178 · cited 3×
“Performance using deep learning techniques has seen noticeable improvements in predictive power in this space [37, 55].”
BackgroundMethodQuantifying the Language of Schizophrenia in Social Media
Mitchell, M., Hollingshead, K., & Coppersmith, G. (2015) · Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w15-1202 · Cited by 172 · cited 4×
“Another implication is the ability to design interventions, one of the most mentioned applications of this technology in the literature [60, 26, 73].”
BackgroundMethodInfluentialBirnbaum, M. L., Ernala, S. K., Rizvi, A. F., De Choudhury, M., & Kane, J. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7956 · Cited by 168 · cited 6×
“These collaborations are fruitful and have greatly benefit prior research [13, 6, 44].”
BackgroundMethodInfluentialSelf-citationModeling Spread of Disease from Social Interactions
Sadilek, A., Kautz, H., & Silenzio, V. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14235 · Cited by 167 · cited 1×
“Researchers also used social media data to track the spread of disease [76] and to analyze other ailments on population-scale user bases from Twitter [70].”
BackgroundSelf-citationExploratory Analysis of Social Media Prior to a Suicide Attempt
Coppersmith, G., Ngo, K., Leary, R., & Wood, A. (2016) · Proceedings of the Third Workshop on Computational Lingusitics and Clinical Psychology · doi:10.18653/v1/w16-0311 · Cited by 150 · cited 9×
“EMNLP, October, 1348–1353.”
BackgroundMethodInfluentialAddressing Conceptual Gaps in Big Data Research Ethics: An Application of Contextual Integrity
Zimmer, M. (2018) · Social Media + Society · doi:10.1177/2056305118768300 · Cited by 143 · cited 1×
“” [92] Is is appropriate to observe online health communities for research if it violates this contextual integrity? What about benign discussions on personal social media accounts? As Bruckman recommends, one way to resolve this contextual gap is by asking for permission through community leaders [9], which is feasib…”
BackgroundDon’t quote me: reverse identification of research participants in social media studies
Ayers, J. W., Caputi, T. L., Nebeker, C., & Dredze, M. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0036-2 · Cited by 129
Activities on Facebook Reveal the Depressive State of Users
Park, S., Lee, S. W., Kwak, J., Cha, M., & Jeong, B. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2718 · Cited by 128 · cited 4×
“Studies that do interact with subjects, through surveys of crowdworkers [73] or individuals recruited through word of mouth, advertisements [73] or through apps [68], tend to declare appropriate ethics board approval.”
BackgroundInfluentialModeling and Understanding Visual Attributes of Mental Health Disclosures in Social Media
Manikonda, L., & De Choudhury, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025932 · Cited by 116 · cited 4×
“As Bruckman recommends, one way to resolve this contextual gap is by asking for permission through community leaders [9], which is feasible for Reddit or public Facebook groups.”
InfluentialDetecting Suicidal Ideation in Chinese Microblogs with Psychological Lexicons
Huang, X., Zhang, L., Chiu, D., Liu, T., Li, X., & Zhu, T. (2014) · IEEE International Conference on Ubiquitous Intelligence and Computing, Autonomic and Trusted Computing, and Scalable Computing and Communications (UIC-ATC-ScalCom) · doi:10.1109/uic-atc-scalcom.2014.48 · Cited by 114 · cited 1×
“Datasets too have expanded to social networks other than Twitter and Facebook, like SinaWeibo [46], Instagram [73, 13], Tumblr [14, 82], and Reddit [77, 37].”
BackgroundEthical issues in using Twitter for population-level depression monitoring: a qualitative study
Mikal, J., Hurst, S., & Conway, M. (2016) · BMC Medical Ethics · doi:10.1186/s12910-016-0105-5 · Cited by 114 · cited 3×
“This work is beginning through interview studies [59], and we push researchers to provide future work in this area.”
BackgroundThe emotional wellbeing of researchers: considerations for practice
Moncur, W. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466248 · Cited by 110 · cited 1×
“Those who engage with this content can be traumatized by these encounters, and traditional approaches to research design do not take into account the researcher’s own emotional well-being [61].”
BackgroundDetecting and Characterizing Eating-Disorder Communities on Social Media
Wang, T., Brede, M., Ianni, A., & Mentzakis, E. (2017) · Proceedings of the Tenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3018661.3018706 · Cited by 110 · cited 1×
“There are several standard approaches in the research on assessing ground truth of mental health status, including self-disclosure of mental health state [19, 21, 87], specific hashtag use [37, 14], and community participation [81].”
BackgroundAnorexia on Tumblr: A Characterization Study
De Choudhury, M. (2015) · Proceedings of the 5th International Conference on Digital Health 2015 · doi:10.1145/2750511.2750515 · Cited by 99 · cited 2×
“Research has examined other disorders, such as post-traumatic stress disorder [21], anxiety [81], schizophrenia [6, 60], eating disorders [13, 14, 25], and suicidal ideation [30, 29, 39].”
BackgroundRecovery Amid Pro-Anorexia: Analysis of Recovery in Social Media
Chancellor, S., Mitra, T., & De Choudhury, M. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858246 · Cited by 96 · cited 7×
“Given that demographic attributes such as age are inferrable from social media language [80], should we research online eating disorder communities, knowing a large subset of these individuals are likely minors [13, 14]? When should data scientists consider vulnerable populations, and how should we protect this data?…”
BackgroundInfluentialSelf-citationUsing Topic Modeling to Improve Prediction of Neuroticism and Depression in College Students
Resnik, P., Garron, A., & Resnik, R. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1133 · Cited by 88 · cited 2×
“After these works, researchers began to replicate, extend, generalize, and improve on these findings [63, 78, 74] and in different cultural contexts and social media sites, beyond just English-speaking Twitter [84, 88].”
BackgroundMonitoring Tweets for Depression to Detect At-risk Users
Jamil, Z., Inkpen, D., Buddhitha, P., & White, K. (2017) · Proceedings of the Fourth Workshop on Computational Linguistics and Clinical Psychology –- From Linguistic Signal to Clinical Reality · doi:10.18653/v1/w17-3104 · Cited by 88 · cited 1×
“However, in practical use of these systems, false negatives mean that mental health status is missed and may go untreated, as mentioned in prior work [82, 49].”
BackgroundConway, M. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3617 · Cited by 83 · cited 1×
“consent [5, 58] and contextual data integrity [85, 90]; data protection, anonymization, and privacy [17, 45, 94, 93]; methodological rigor [66, 70, 53]; bias and validity [40, 66]; and implications of the research for different stakeholders [8, 18].”
BackgroundInferring Mood Instability on Social Media by Leveraging Ecological Momentary Assessments
Saha, K., Chan, L., De Barbaro, K., Abowd, G. D., & De Choudhury, M. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130960 · Cited by 77
Guan, L., Hao, B., Cheng, Q., Yip, P. S., & Zhu, T. (2015) · JMIR Mental Health · doi:10.2196/mental.4227 · Cited by 76 · cited 1×
“Research has examined other disorders, such as post-traumatic stress disorder [21], anxiety [81], schizophrenia [6, 60], eating disorders [13, 14, 25], and suicidal ideation [30, 29, 39].”
BackgroundSocial Monitoring for Public Health
Paul, M. J., & Dredze, M. H. (2017) · Synthesis lectures on information concepts, retrieval, and services · doi:10.1007/978-3-031-02311-8 · Cited by 76 · cited 1×
“sideration of study design, identifying target conditions, methods, and ethics [69].”
BackgroundToward Macro-Insights for Suicide Prevention: Analyzing Fine-Grained Distress at Scale
Homan, C., Johar, R., Liu, T., Lytle, M., Silenzio, V., & Ovesdotter Alm, C. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3213 · Cited by 69 · cited 1×
“These collaborations are fruitful and have greatly benefit prior research [13, 6, 44].”
BackgroundSelf-citationBhattacharya, K., Ghosh, A., Monsivais, D., Dunbar, R., & Kaski, K. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-016-0097-x · Cited by 68
Understanding and Discovering Deliberate Self-harm Content in Social Media
Wang, Y., Tang, J., Li, J., Li, B., Wan, Y., Mellina, C., O'Hare, N., & Chang, Y. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052555 · Cited by 62 · cited 3×
“These algorithms can also reveal symptomatology linked to psychiatric challenges, such as self-harm [89], severity of distress [13], or cognitive distortions [82].”
BackgroundDetecting Cognitive Distortions Through Machine Learning Text Analytics
Simms, T., Ramstedt, C., Rich, M., Richards, M., Martinez, T., & Giraud-Carrier, C. (2017) · 2017 IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2017.39 · Cited by 42 · cited 3×
“These algorithms can also reveal symptomatology linked to psychiatric challenges, such as self-harm [89], severity of distress [13], or cognitive distortions [82].”
BackgroundOn minorities and outliers: The case for making Big Data small
Welles, B. F. (2014) · Big Data & Society · doi:10.1177/2053951714540613 · Cited by 40 · cited 2×
“Foucault-Welles brings light to the discriminatory impacts of aggregating analysis of social data that erases differences of minority groups [90].”
BackgroundDiscrimination in Online Advertising: A Multidisciplinary Inquiry
Datta, A. J., Datta, A., Makagon, J., Mulligan, D. K., & Tschantz, M. C. (2018) · Cited by 36
Instagram photos reveal predictive markers of depressionPreprint
Reece, A. G., & Danforth, C. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.03282 · Cited by 34 · cited 11×
“Automated image analysis can identify self-harm photos on Flickr [89], signs of depression through Instagram images [73], and mental health disclosures on Reddit [56].”
BackgroundInfluentialContextual Consent: Ethical Mining of Social Media for Health ResearchPreprint
Norval, C., & Henderson, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.07765 · Cited by 30 · cited 1×
“Norval and Henderson unpack various theories of privacy to analyze whether informed consent should be gathered in social media health research for patient information [65], while Mikal et al.”
BackgroundDefining patients with depressive disorder by using textual information
Nakamura, T., Kubo, K., Yasuyuki, U., & Aramaki, E. (2014) · National Conference on Artificial Intelligence · Cited by 4
Research works printed but not linked: 7
- Joshua Barrie . 2014. People are freaking out over this new anti-suicide twitter app. (Nov . 2014 ). https:/www.businessinsider.com/people-freaking-out-over-samaritans-twitter-app-2014-11. Joshua Barrie. 2014. People are freaking out over this new anti-suicide twitter app. (Nov. 2014). https:/www.businessinsider.com/people-freaking-out-over-samaritans-twitter-app-2014-11.
- Katherine Carpenter and David Dittrich . 2011 . Bridging the distance: removing the technology buffer and seeking consistent ethical analysis in computer security research . In 1st International Digital Ethics Symposium. Loyola University Chicago Center for Digital Ethics and Policy. Katherine Carpenter and David Dittrich. 2011. Bridging the distance: removing the technology buffer and seeking consistent ethical analysis in computer security research. In 1st International Digital Ethics Symposium. Loyola University Chicago Center for Digital Ethics and Policy.
- Brent Hecht et al. 2018. It's time to do something: mitigating the negative impacts of computing through a change to the peer review process. (Mar. 2018). https://acm-fca.org/2018/03/29/negativeimpacts/. Brent Hecht et al. 2018. It's time to do something: mitigating the negative impacts of computing through a change to the peer review process. (Mar. 2018). https://acm-fca.org/2018/03/29/negativeimpacts/.
- Dan Muriello , Lizzy Donahue , Danny Ben-David , Umut Ozertem , and Reshef Shilon . 2018. Under the hood: suicide prevention tools powered by ai. (Feb . 2018 ). https://code.fb.com/ml-applications/under-the-hood-suicide-prevention-tools-powered-by-ai/. Dan Muriello, Lizzy Donahue, Danny Ben-David, Umut Ozertem, and Reshef Shilon. 2018. Under the hood: suicide prevention tools powered by ai. (Feb. 2018). https://code.fb.com/ml-applications/under-the-hood-suicide-prevention-tools-powered-by-ai/.
- 10.5555/3154569 · doi:10.5555/3154569
- Guy Rosen . 2017. Getting our community help in real time. (Nov . 2017 ). https://newsroom.fb.com/news/2017/11/getting-our-community-help-in-real-time/. Guy Rosen. 2017. Getting our community help in real time. (Nov. 2017). https://newsroom.fb.com/news/2017/11/getting-our-community-help-in-real-time/.
- James Vincent . 2017. Facebook is using ai to spot users with suicidal thoughts and send them help. (Nov . 2017 ). https:/www.theverge.com/2017/11/28/16709224/facebook-suicidal-thoughts-ai-help. James Vincent. 2017. Facebook is using ai to spot users with suicidal thoughts and send them help. (Nov. 2017). https:/www.theverge.com/2017/11/28/16709224/facebook-suicidal-thoughts-ai-help.
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
“Using social media for mental health work also remains a catalyst for ethical tensions, and a recent review offers a practical taxonomy of these tensions as well as guidance for navigating through these ongoing challenges 77 .”
BackgroundSocial Media and Mental Health: Benefits, Risks, and Opportunities for Research and Practice
Naslund, J. A., Bondre, A., Torous, J., & Aschbrenner, K. A. (2020) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00134-x · Cited by 746
“With research increasingly showing the valuable insights that social media data can yield about mental health states, greater attention to the ethical concerns with using individual data in this way is necessary (Chancellor et al. 2019).”
BackgroundInfluentialMethods in predictive techniques for mental health status on social media: a critical review
Chancellor, S., & De Choudhury, M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0233-7 · Cited by 557
Self-citationLee, E. E., Torous, J., De Choudhury, M., Depp, C. A., Graham, S. A., Kim, H.-C., Paulus, M. P., Krystal, J. H., & Jeste, D. V. (2021) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.02.001 · Cited by 429
Thieme, A., Belgrave, D., & Doherty, G. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3398069 · Cited by 406
“This selection criterion is consistent with the mental health literature and other systematic reviews on affective mental health [29, 170].”
BackgroundResultInfluential
Metadata
- Authors
- Chancellor, S., Birnbaum, M. L., Caine, E. D., Silenzio, V. M. B., & De Choudhury, M.
- Affiliations
- Georgia Institute of Technology (US)
- Northwell Health (US)
- University of Rochester (US)
- Georgia Tech, Atlanta, GA, US
- Venue
- Proceedings of the Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2019-01-29
- Pages
- 79-88
- OpenAlex
- W2908543495
- Cited by
- 214
- References
- 86
- Citations by year
- 2026: 21 · 2025: 27 · 2024: 27 · 2023: 33 · 2022: 42 · 2021: 35 · 2020: 18 · 2019: 11
- FWCI
- 27.70
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Funders
- National Institutes of Health (R01GM112697)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- mental health prediction, social media, ethical conflicts, algorithmic bias, privacy, ethics committees, mental disorder detection, suicide risk prediction, stakeholder implications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.