The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Validating Machine Learning Algorithms for Twitter Data Against Established Measures of Suicidality
Open accessAbstract
Background: One of the leading causes of death in the United States (US) is suicide and new methods of assessment are needed to track its risk in real time. Objective: Our objective is to validate the use of machine learning algorithms for Twitter data against empirically validated measures of suicidality in the US population. Methods: Using a machine learning algorithm, the Twitter feeds of 135 Mechanical Turk (MTurk) participants were compared with validated, self-report measures of suicide risk. Results: Our findings show that people who are at high suicidal risk can be easily differentiated from those who are not by machine learning algorithms, which accurately identify the clinically significant suicidal rate in 92% of cases (sensitivity: 53%, specificity: 97%, positive predictive value: 75%, negative predictive value: 93%). Conclusions: Machine learning algorithms are efficient in differentiating people who are at a suicidal risk from those who are not. Evidence for suicidality can be measured in nonclinical populations using social media data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The interpersonal theory of suicide.
Van Orden, K. A., Witte, T. K., Cukrowicz, K. C., Braithwaite, S. R., Selby, E. A., & Joiner, T. E. (2010) · Psychological Review · doi:10.1037/a0018697 · Cited by 5,292
Self-citationBaumeister, R. F. (1990) · Psychological Review · doi:10.1037/0033-295x.97.1.90 · Cited by 1,919 · cited 1×
“Other prominent theories focus on hopelessness [51] and escape from the self [52]; none include achievement as a key theoretical component.”
Hauser, D. J., & Schwarz, N. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0578-z · Cited by 1,739
Reputation as a sufficient condition for data quality on Amazon Mechanical Turk
Peer, E., Vosgerau, J., & Acquisti, A. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0434-y · Cited by 1,618 · cited 1×
“Researchers studying MTurk data collection recommended involving high reputation participants (those with a high number of completed and approved HITs) and including attention control checks [35].”
Eysenbach, G. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1157 · Cited by 1,351
Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J., Ramey, S. L., Shure, M. B., & Long, B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.10.1013 · Cited by 1,253 · cited 1×
“This is an important step forward, because the most effective interventions target individuals who are mostly at risk, ideally with an approach that is tailored to their specific needs [50].”
Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures
Golder, S. A., & Macy, M. W. (2011) · Science · doi:10.1126/science.1202775 · Cited by 1,155 · cited 1×
“in the context of social media data [37,38] and has been previously proved to correlate in meaningful ways with suicidality [39-41].”
Van Orden, K. A., Witte, T. K., Gordon, K. H., Bender, T. W., & Joiner, T. E. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.1.72 · Cited by 1,126
Pignone, M. P., Gaynes, B. N., Rushton, J. L., Burchell, C. M., Orleans, C. T., Mulrow, C. D., & Lohr, K. N. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-10-200205210-00013 · Cited by 1,086
Quantifying Mental Health Signals in Twitter
Coppersmith, G., Dredze, M., & Harman, C. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3207 · Cited by 722
Cited by
Methods in predictive techniques for mental health status on social media: a critical review
Chancellor, S., & De Choudhury, M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0233-7 · Cited by 557
Predicting Anxiety, Depression and Stress in Modern Life using Machine Learning Algorithms
Priya, A., Garg, S., & Tigga, N. P. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.03.442 · Cited by 458
Researching Mental Health Disorders in the Era of Social Media: Systematic Review
Wongkoblap, A., Vadillo, M. A., & Curcin, V. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7215 · Cited by 268
Suicidal Ideation Detection: A Review of Machine Learning Methods and Applications
Ji, S., Pan, S., Li, X., Cambria, E., Long, G., & Huang, Z. (2021) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2020.3021467 · Cited by 257
Haines-Delmont, A., Chahal, G., Bruen, A. J., Wall, A., Khan, C. T., Sadashiv, R., & Fearnley, D. (2020) · JMIR mhealth and uhealth · doi:10.2196/15901 · Cited by 87
Ebert, D. D., Harrer, M., Apolinário-Hagen, J., & Baumeister, H. (2019) · Advances in Experimental Medicine and Biology · doi:10.1007/978-981-32-9721-0_29 · Cited by 76
The Role of Big Data Analytics in Predicting Suicide
Kessler, R. C., Bernecker, S. L., Bossarte, R. M., Luedtke, A. R., McCarthy, J. F., Nock, M. K., Pigeon, W. R., Petukhova, M. V., Sadikova, E., VanderWeele, T. J., et al. (2019) · Personalized Psychiatry · doi:10.1007/978-3-030-03553-2_5 · Cited by 44
Cloud-Based Sentiment Analysis for Interactive Agents
Keijsers, M., Bartneck, C., & Kazmi, H. S. (2019) · Proceedings of the 7th International Conference on Human-Agent Interaction · doi:10.1145/3349537.3351883 · Cited by 9
Metadata
- Authors
- Braithwaite, S. R., Giraud-Carrier, C., West, J., Barnes, M. D., & Hanson, C. L.
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2016-05-16
- Volume
- 3
- Issue
- 2
- Pages
- e21
- ISSN
- 2368-7959 (ISSN-L)
- OpenAlex
- W2407086192
- Cited by
- 193
- References
- 14
- FWCI
- 29.10
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.