The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Detecting suicidality on Twitter
Open accessAbstract
Twitter is increasingly investigated as a means of detecting mental health status, including depression and suicidality, in the population. However, validated and reliable methods are not yet fully established. This study aimed to examine whether the level of concern for a suicide-related post on Twitter could be determined based solely on the content of the post, as judged by human coders and then replicated by machine learning. From 18th February 2014 to 23rd April 2014, Twitter was monitored for a series of suicide-related phrases and terms using the public Application Program Interface (API). Matching tweets were stored in a data annotation tool developed by the Commonwealth Scientific and Industrial Research Organisation (CSIRO). During this time, 14,701 suicide-related tweets were collected: 14% were randomly (n = 2000) selected and divided into two equal sets (Set A and B) for coding by human researchers. Overall, 14% of suicide-related tweets were classified as ‘strongly concerning’, with the majority coded as ‘possibly concerning’ (56%) and the remainder (29%) considered ‘safe to ignore’. The overall agreement rate among the human coders was 76% (average κ = 0.55). Machine learning processes were subsequently applied to assess whether a ‘strongly concerning’ tweet could be identified automatically. The computer classifier correctly identified 80% of ‘strongly concerning’ tweets and showed increasing gains in accuracy; however, future improvements are necessary as a plateau was not reached as the amount of data increased. The current study demonstrated that it is possible to distinguish the level of concern among suicide-related tweets, using both human coders and an automatic machine classifier. Importantly, the machine classifier replicated the accuracy of the human coders. The findings confirmed that Twitter is used by individuals to express suicidality and that such posts evoked a level of concern that warranted further investigation. However, the predictive power for actual suicidal behaviour is not yet known and the findings do not directly identify targets for intervention.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 11,390
Introduction to modern information retrieval
Dillon, M. (1983) · Information Processing & Management · doi:10.1016/0306-4573(83)90062-6 · Cited by 5,909
Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., et al. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111704 · Cited by 5,157 · cited 1×
“However, given the link between suicidal ideation and suicide (Large and Nielssen, 2012; Posner et al., 2011), serious consideration should be given to individuals who use Twitter to communicate thoughts of suicide.”
BackgroundComputing Inter-Rater Reliability for Observational Data: An Overview and Tutorial
Hallgren, K. A. (2012) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.08.1.p023 · Cited by 3,884
A maximum entropy approach to natural language processing
Berger, A. L., Pietra, V. J. D., & Pietra, S. A. D. (1996) · doi:10.5555/234285.234289 · Cited by 3,065
Making Large-Scale Support Vector Machine Learning Practical
Joachims, T. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0015 · Cited by 1,613
Greenwood, S., Perrin, A., & Duggan, M. (2016) · Cited by 1,032
Reducing Suicide--A National Imperative
(2002) · PsycEXTRA Dataset · doi:10.1037/e719942007-001 · Cited by 902
Social media and suicide: A public health perspective
Luxton, D. D., June, J. D., & Fairall, J. M. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300608 · Cited by 469
Prinstein, M. J., Nock, M. K., Simon, V., Aikins, J. W., Cheah, C. S. L., & Spirito, A. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.1.92 · Cited by 435
Tracking Suicide Risk Factors Through Twitter in the US
Jashinsky, J., Burton, S. H., Hanson, C. L., West, J., Giraud-Carrier, C., Barnes, M. D., & Argyle, T. (2014) · Crisis · doi:10.1027/0227-5910/a000234 · Cited by 342
The Impact of Suicide on the Family
Cerel, J., Jordan, J. R., & Duberstein, P. R. (2008) · Crisis · doi:10.1027/0227-5910.29.1.38 · Cited by 315
Reducing Suicide: A National Imperative
WONG, N. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.8.1534 · Cited by 222
Big Data and the brave new world of social media research
Schroeder, R. (2014) · Big Data & Society · doi:10.1177/2053951714563194 · Cited by 170
E-Health Interventions for Suicide Prevention
Christensen, H. M., Batterham, P. J., & O’Dea, B. (2014) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph110808193 · Cited by 149
Self-citationPredicting National Suicide Numbers with Social Media Data
Won, H., Myung, W., Song, G.-Y., Lee, W.-H., Kim, J., Carroll, B. J., & Kim, D. K. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061809 · Cited by 125
Recurrence of suicidal ideation across depressive episodes
Williams, J. M. G., Crane, C., Barnhofer, T., van der Does, W. A. J., & Segal, Z. V. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.01.002 · Cited by 122
Suicidal communication of persons attempting suicide and responses of significant others
Wolk‐Wasserman, D. (1986) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1986.tb02715.x · Cited by 89
Responses to a Self-Presented Suicide Attempt in Social Media
Fu, K., Cheng, Q., Wong, P. W. C., & Yip, P. S. F. (2013) · Crisis · doi:10.1027/0227-5910/a000221 · Cited by 77
Suicidal Ideation as an Articulation of Intent: A Focus for Suicide Prevention?
McAuliffe, C. (2002) · Archives of Suicide Research · doi:10.1080/13811110214524 · Cited by 72
Bailey, R. K., Patel, T. C., Avenido, J., Patel, M., Jaleel, M., Barker, N. C., Khan, J. A., All, S., & Jabeen, S. (2011) · Journal of the National Medical Association · doi:10.1016/s0027-9684(15)30388-6 · Cited by 66
WASSERMAN, D., THANH, T. T. H., MINH, P. T. D., GOLDSTEIN, M., NORDENSKIÖLD, A., & WASSERMAN, C. (2008) · World Psychiatry · doi:10.1002/j.2051-5545.2008.tb00152.x · Cited by 58 · cited 1×
“Some individuals have communicated their suicidal thoughts and plans to friends and family prior to suicide (Wasserman et al., 2008; Wolk-Wasserman, 1986); however, it is accepted that many do not disclose their intent.”
BackgroundEthical Considerations and Social Media: A Case of Suicidal Postings on Facebook
Lehavot, K., Ben‐Zeev, D., & Neville, R. E. (2012) · Journal of Dual Diagnosis · doi:10.1080/15504263.2012.718928 · Cited by 52
Hunting Suicide Notes in Web 2.0 - Preliminary Findings
Huang, Y., Goh, T., & Liew, C. L. (2007) · International Symposium on Multimedia · doi:10.1109/ismw.2007.43 · Cited by 35
Change of suicidal ideation induced by suicide attempt
Matsuishi, K., Kitamura, N., Sato, M., Nagai, K., HUH, S., ARIYOSHI, K., Sato, S., & Mita, T. (2005) · Psychiatry and Clinical Neurosciences · doi:10.1111/j.1440-1819.2005.01421.x · Cited by 29
Suicidal Ideation and Later Suicide
Large, M. M. B., & Nielssen, O. B. (2012) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.11111674 · Cited by 24
The Lancet Technology: November, 2014
Lee, N. (2014) · The Lancet · doi:10.1016/s0140-6736(14)62267-4 · Cited by 17
Challenges in the Control and Regulation of Suicide Promotion and Assistance over the Internet
Mishara, B. L., & Weisstub, D. N. (2013) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137351692_5 · Cited by 3
Cited by
Machine learning in mental health: a scoping review of methods and applications
Shatte, A. B. R., Hutchinson, D. M., & Teague, S. J. (2019) · Psychological Medicine · doi:10.1017/s0033291719000151 · Cited by 1,047
A comprehensive survey on sentiment analysis: Approaches, challenges and trends
Birjali, M., Kasri, M., & Beni-Hssane, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107134 · Cited by 921
Methods in predictive techniques for mental health status on social media: a critical review
Chancellor, S., & De Choudhury, M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0233-7 · Cited by 557
Natural language processing of social media as screening for suicide risk
Coppersmith, G., Leary, R., Crutchley, P., & Fine, A. (2018) · Biomedical Informatics Insights · doi:10.1177/1178222618792860 · Cited by 506
Toward clinical digital phenotyping: a timely opportunity to consider purpose, quality, and safety
Huckvale, K., Venkatesh, S., & Christensen, H. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0166-1 · Cited by 433
Self-citation
Metadata
- Authors
- O'Dea, B., Wan, S., Batterham, P. J., Calear, A. L., Paris, C., & Christensen, H.
- Venue
- Internet Interventions
- Publisher
- Elsevier BV
- Published
- 2015-05
- Volume
- 2
- Issue
- 2
- Pages
- 183-188
- ISSN
- 2214-7829 (ISSN-L)
- OpenAlex
- W2129587854
- Cited by
- 439
- References
- 29
- FWCI
- 51.62
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.