The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Discovering Shifts to Suicidal Ideation from Mental Health Content in Social Media
Open accessAbstract
History of mental illness is a major factor behind suicide risk and ideation. However research efforts toward characterizing and forecasting this risk is limited due to the paucity of information regarding suicide ideation, exacerbated by the stigma of mental illness. This paper fills gaps in the literature by developing a statistical methodology to infer which individuals could undergo transitions from mental health discourse to suicidal ideation. We utilize semi-anonymous support communities on Reddit as unobtrusive data sources to infer the likelihood of these shifts. We develop language and interactional measures for this purpose, as well as a propensity score matching based statistical approach. Our approach allows us to derive distinct markers of shifts to suicidal ideation. These markers can be modeled in a prediction framework to identify individuals likely to engage in suicidal ideation in the future. We discuss societal and ethical implications of this research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,502
Cognitive Therapy for Depression: (675542012-001)
(2012) · PsycEXTRA Dataset · doi:10.1037/e675542012-001 · Cited by 9,663
SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHING
Caliendo, M., & Kopeinig, S. (2008) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2007.00527.x · Cited by 6,238
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Assessment of suicidal intention: The Scale for Suicide Ideation.
Beck, A. T., Kovacs, M., & Weissman, A. (1979) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.47.2.343 · Cited by 3,419
Psychological autopsy studies of suicide: a systematic review.
CAVANAGH, J. T. O., CARSON, A. J., SHARPE, M., & LAWRIE, S. M. (2003) · Psychological Medicine · doi:10.1017/s0033291702006943 · Cited by 2,207
Causal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173 · cited 1×
“To do so, we work within the potential outcomes framework [57, 34] for causal modeling, applying stratified propensity score matching to estimate causal effects [56].”
Baumeister, R. F. (1990) · Psychological Review · doi:10.1037/0033-295x.97.1.90 · Cited by 1,919 · cited 2×
“A central challenge in public health revolves around how to identify individuals who are at risk for taking their own lives [3, 8, 66].”
Predicting Depression via Social Media
De Choudhury, M., Gamon, M., Counts, S., & Horvitz, E. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14432 · Cited by 1,579
Self-citationRelationship between hopelessness and ultimate suicide: a replication with psychiatric outpatients
(1990) · American Journal of Psychiatry · doi:10.1176/ajp.147.2.190 · Cited by 1,120
Large margin classification using the perceptron algorithm
Freund, Y., & Schapire, R. E. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279985 · Cited by 1,071
You Are What You Tweet: Analyzing Twitter for Public Health
Paul, M., & Dredze, M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14137 · Cited by 947
Self-citationCausal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · Thammasat University Digital Collections · Cited by 838
Mental Health Discourse on reddit: Self-Disclosure, Social Support, and Anonymity
De Choudhury, M., & De, S. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14526 · Cited by 836 · cited 1×
“The choice of these measures is motivated by literature that examines associations between the behavioral expression of individuals and their responses to crises, including vulnerability due to mental illness [13, 23].”
Commentary: Suicide as Psychache
SHNEIDMAN, E. S. (1993) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199303000-00001 · Cited by 775 · cited 4×
“A number of mental health disorders, such as depression, tend to be closely related to suicide [65].”
InfluentialQuantifying Mental Health Signals in Twitter
Coppersmith, G., Dredze, M., & Harman, C. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3207 · Cited by 722
Self-citationLarge Margin Classification Using the Perceptron Algorithm
Freund, Y., & Schapire, R. E. (1999) · Machine Learning · doi:10.1023/a:1007662407062 · Cited by 604
Smith, E. A., & Senter, R. J. (1967) · PubMed · Cited by 587
(2007) · Cited by 521
Social media and suicide: A public health perspective
Luxton, D. D., June, J. D., & Fairall, J. M. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300608 · Cited by 469
Predicting postpartum changes in emotion and behavior via social media
De Choudhury, M., Counts, S., & Horvitz, E. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466447 · Cited by 462
Self-citationClassification of suicidal behaviors: I. Quantifying intent and medical lethality
(1975) · American Journal of Psychiatry · doi:10.1176/ajp.132.3.285 · Cited by 460
Correlations Genuine and Spurious in Pearson and Yule
Aldrich, J. (1995) · Statistical Science · doi:10.1214/ss/1177009870 · Cited by 402
Characterizing and predicting postpartum depression from shared facebook data
De Choudhury, M., Counts, S., Horvitz, E. J., & Hoff, A. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531675 · Cited by 379
Self-citationTracking Suicide Risk Factors Through Twitter in the US
Jashinsky, J., Burton, S. H., Hanson, C. L., West, J., Giraud-Carrier, C., Barnes, M. D., & Argyle, T. (2014) · Crisis · doi:10.1027/0227-5910/a000234 · Cited by 342
Recognizing Depression from Twitter Activity
Tsugawa, S., Kikuchi, Y., Kishino, F., Nakajima, K., Itoh, Y., & Ohsaki, H. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702280 · Cited by 334
From ADHD to SAD: Analyzing the Language of Mental Health on Twitter through Self-Reported Diagnoses
Coppersmith, G., Dredze, M., Harman, C., & Hollingshead, K. (2015) · Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w15-1201 · Cited by 332
Self-citationExpressing emotion in text-based communication
Hancock, J. T., Landrigan, C., & Silver, C. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240764 · Cited by 327
Mark my words! linguistic style accommodation in social media
Danescu-Niculescu-Mizil, C., Gamon, M., & Dumais, S. (2011) · International World Wide Web Conference (WWW) · doi:10.1145/1963405.1963509 · Cited by 325
Measuring post traumatic stress disorder in Twitter
Coppersmith, G., Harman, C., & Dredze, M. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14574 · Cited by 316
Self-citationTowards Assessing Changes in Degree of Depression through Facebook
Schwartz, H. A., Eichstaedt, J., Kern, M. L., Park, G., Sap, M., Stillwell, D., Kosinski, M., & Ungar, L. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3214 · Cited by 256
AffectAura: an intelligent system for emotional memory
McDuff, D., Karlson, A., Kapoor, A., Roseway, A., & Czerwinski, M. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208525 · Cited by 242
Changing risk behaviors and adopting health behaviors: The role of self-efficacy beliefs
Schwarzer, R., & Fuchs, R. (1995) · Self-Efficacy in Changing Societies · doi:10.1017/cbo9780511527692.011 · Cited by 221
LEWINSOHN, P. M., GOTLIB, I. H., & SEELEY, J. R. (1995) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199509000-00021 · Cited by 217
Nock, M. K., & Kazdin, A. E. (2002) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3101_07 · Cited by 196
Yule, G. U. (1897) · Journal of the Royal Statistical Society · doi:10.2307/2979746 · Cited by 189
Word use in emotional narratives about failed romantic relationships and subsequent mental health
Boals, A., & Klein, K. (2005) · Journal of Language and Social Psychology · doi:10.1177/0261927x05278386 · Cited by 188
Mark My Words! Linguistic Style Accommodation in Social Media
Danescu-Niculescu-Mizil, C., Gamon, M., & Dumais, S. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1105.0673 · Cited by 185
The epidemiology of teen suicide: an examination of risk factors.
Shaffer, D. (1988) · PubMed · Cited by 184
Detecting Changes in Suicide Content Manifested in Social Media Following Celebrity Suicides
Kumar, M., Dredze, M. H., Coppersmith, G., & Choudhury, M. D. (2015) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/2700171.2791026 · Cited by 174
Self-citationQuantifying the Language of Schizophrenia in Social Media
Mitchell, M., Hollingshead, K., & Coppersmith, G. (2015) · Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w15-1202 · Cited by 172
Self-citationEstimating county health statistics with twitter
Culotta, A. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557139 · Cited by 171
The Wiley Blackwell Encyclopedia of Health, Illness, Behavior, and Society
(2014) · Wiley eBooks · doi:10.1002/9781118410868 · Cited by 170
Identity Management and Mental Health Discourse in Social Media
Pavalanathan, U., & Choudhury, M. D. (2015) · International World Wide Web Conference (WWW) · doi:10.1145/2740908.2743049 · Cited by 162
Perception Differences between the Depressed and Non-Depressed Users in Twitter
Park, M., McDonald, D. W., & Cha, M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14425 · Cited by 162
Sueki, H. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.08.047 · Cited by 155
Analysing the connectivity and communication of suicidal users on twitter
Colombo, G. B., Burnap, P., Hodorog, A., & Scourfield, J. (2015) · Computer Communications · doi:10.1016/j.comcom.2015.07.018 · Cited by 149
Toward an Integrative Model of Suicide Attempt: A Cognitive Psychological Approach
Dieserud, G., Røysamb, E., Ekeberg, Ø., & Kraft, P. (2001) · Suicide and Life-Threatening Behavior · doi:10.1521/suli.31.2.153.21511 · Cited by 143
Suicide Announcement on Facebook
Ruder, T. D., Hatch, G. M., Ampanozi, G., Thali, M. J., & Fischer, N. (2011) · Crisis · doi:10.1027/0227-5910/a000086 · Cited by 142
Machine Classification and Analysis of Suicide-Related Communication on Twitter
Burnap, P., Colombo, W., & Scourfield, J. (2015) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/2700171.2791023 · Cited by 141
Multi-class machine classification of suicide-related communication on Twitter
Burnap, P., Colombo, G. B., Amery, R., Hodorog, A., & Scourfield, J. (2017) · Online Social Networks and Media · doi:10.1016/j.osnem.2017.08.001 · Cited by 135
Sense of coherence, self‐esteem, depression and hopelessness as correlates of reattempting suicide
Petrie, K. J., & Brook, R. (1992) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1992.tb00996.x · Cited by 126
Predicting National Suicide Numbers with Social Media Data
Won, H., Myung, W., Song, G.-Y., Lee, W.-H., Kim, J., Carroll, B. J., & Kim, D. K. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061809 · Cited by 125
The Prevention of Suicidal Behaviors: An Overview
Silverman, M. M., & Maris, R. W. (1995) · Suicide and Life-Threatening Behavior · doi:10.1111/j.1943-278x.1995.tb00389.x · Cited by 113
Leavitt, A. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675175 · Cited by 113
"I can't get no sleep": discussing #insomnia on twitter
Jamison-Powell, S., Linehan, C., Daley, L., Garbett, A., & Lawson, S. W. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208612 · Cited by 105
Priester, M. J., & Clum, G. A. (1993) · Journal of Counseling Psychology · doi:10.1037/0022-0167.40.1.79 · Cited by 104
Impulsivity in suicidal and nonsuicidal adolescents
Kashden, J., Fremouw, W. J., Callahan, T. S., & Franzen, M. D. (1993) · Research on Child and Adolescent Psychopathology · doi:10.1007/bf00917538 · Cited by 103
Maclean, D. L., Gupta, S., Lembke, A., Manning, C. D., & Heer, J. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675146 · Cited by 95
Bonner, R. L., & Rich, A. R. (1988) · Cognitive Therapy and Research · doi:10.1007/bf01205009 · Cited by 93
Responses to a Self-Presented Suicide Attempt in Social Media
Fu, K., Cheng, Q., Wong, P. W. C., & Yip, P. S. F. (2013) · Crisis · doi:10.1027/0227-5910/a000221 · Cited by 77
Assessment of hopelessness in suicidal patients
Glanz, L. M., Haas, G. L., & Sweeney, J. A. (1995) · Clinical Psychology Review · doi:10.1016/0272-7358(94)00040-9 · Cited by 76
Affective incoherence: When affective concepts and embodied reactions clash.
Centerbar, D. B., Schnall, S., Clore, G. L., & Garvin, E. D. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.94.4.560 · Cited by 75
Cognitive characteristics of suicidal and nonsuicidal psychiatric inpatients
Ellis, T. E., & Ratliff, K. G. (1986) · Cognitive Therapy and Research · doi:10.1007/bf01173750 · Cited by 73
Social structure and depression in TrevorSpace
Homan, C. M., Lu, N., Tu, X. M., Lytle, M. C., & Silenzio, V. (2014) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2531602.2531704 · Cited by 68
Unraveling abstinence and relapse: smoking cessation reflected in social media
Murnane, E. L., & Counts, S. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557145 · Cited by 64
Linguistic Markers of Secrets and Sensitive Self-Disclosure in Twitter
Houghton, D., & Joinson, A. (2012) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2012.415 · Cited by 40
Affective and character pathology of suicidal adolescent and young adult inpatients.
Clarkin, J. F., Friedman, R. C., Hurt, S., Corn, R., & Aronoff, M. S. (1984) · PubMed · Cited by 39
Thomas, K. M., & Duke, M. P. (2007) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/1931-3896.1.4.204 · Cited by 38
Anxiety disorders, comorbidity, and suicide attempts in adolescence: a preliminary investigation
Pawlak, C., Pascual-Sánchez, T., Raë, P., Fischer, W., & Ladame, F. (1999) · European Psychiatry · doi:10.1016/s0924-9338(99)80730-5 · Cited by 36
Cognitive Predictors of Depression and Suicide Ideation
Prezant, D. W., & Neimeyer, R. A. (1988) · Suicide and Life-Threatening Behavior · doi:10.1111/j.1943-278x.1988.tb00161.x · Cited by 33
Stack, S. J. (2014) · Wiley eBooks · doi:10.1002/9781118410868.wbehibs067 · Cited by 27
Cognitive Therapy for Depression
(1981) · Social Casework · doi:10.1177/104438948106200107 · Cited by 15
Research works printed but not linked: 9
- APA American Psychiatric Association, 1980, American Psychiatric Association, and others
- Beck Aaron T, Cognitive therapy of depression
- 10.1037/0022-006X.47.2.343 · doi:10.1037/0022-006x.47.2.343 · Paper page
- Coppersmith Glen, 2014, International Conference on Weblogs and Social Media (ICWSM).
- Choudhury Munmun De, 2014, Proc. ICWSM. AAAI.
- Choudhury Munmun De, 2013, AAAI Conference on Weblogs and Social Media.
- Cheng Qijin, 2015, Paul WC Wong, and Paul SF Yip
- 10.1145/2806416.2806594 · DOI
- Park Minsu, 2013, Proceedings of ICWSM.
Cited by
Personal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning
Mohr, D. C., Zhang, M., & Schueller, S. M. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-044949 · Cited by 802
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763
Self-citationSocial Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kiciman, E. (2016) · doi:10.2139/ssrn.2886526 · Cited by 763
Detecting depression and mental illness on social media: an integrative review
Guntuku, S. C., Yaden, D. B., Kern, M. L., Ungar, L. H., & Eichstaedt, J. C. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.07.005 · Cited by 722
Methods in predictive techniques for mental health status on social media: a critical review
Chancellor, S., & De Choudhury, M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0233-7 · Cited by 557
Metadata
- Authors
- De Choudhury, M., Kiciman, E., Dredze, M., Coppersmith, G., & Kumar, M.
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Volume
- 2016
- Pages
- 2098-2110
- OpenAlex
- W2405042511
- Cited by
- 683
- References
- 74
- FWCI
- 115.26
- Type
- conference paper
- Language
- en
- Open access
- green
- Funders
- National Institutes of Health (1R01GM11269701)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.