Suicide-related Twitter Content in Response to a National Mental Health Awareness Campaign and the Association between the Campaign and Suicide Rates in Ontario
Open accessThe DOI matches its Crossref record; 20 of the 22 references it cites were found in a registry or an index, and 2 are not checked yet.
Abstract
OBJECTIVE: Mental health awareness (MHA) campaigns have been shown to be successful in improving mental health literacy, decreasing stigma, and generating public discussion. However, there is a dearth of evidence regarding the effects of these campaigns on behavioral outcomes such as suicides. Therefore, the objective of this article is to characterize the association between the event and suicide in Canada's most populous province and the content of suicide-related tweets referencing a Canadian MHA campaign (Bell Let's Talk Day [BLTD]). METHODS: Suicide counts during the week of BTLD were compared to a control window (2011 to 2016) to test for associations between the BLTD event and suicide. Suicide tweets geolocated to Ontario, posted in 2016 with the BLTD hashtag were coded for specific putatively harmful and protective content. RESULTS: = 3,763) mainly included content related to general comments about suicide death (68%) and suicide being a problem (42.8%) with little putatively helpful content such as stories of resilience (0.6%) and messages of hope (2.2%). CONCLUSIONS: In Ontario, this national mental health media campaign was associated with a high volume of suicide-related tweets but not necessarily including content expected to diminish suicide rates. Campaigns like BLTD should strongly consider greater attention to suicide-related messaging that promotes help-seeking and resilience. This may help to further decrease stigmatization, and potentially, reduce suicide rates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In relation to suicide, the media play a major role in influencing stigmatising knowledge (ignorance) and attitudes (prejudice), and can perpetuate stigma through irresponsible portrayals of individuals who have self-harmed or died by suicide or reduce stigma through by disseminating helpful information or mobilising campaigns to improve public opinion and attitudes.303,304”
From The Lancet Commission on ending stigma and discrimination in mental health (2022) · cites this paper as [304]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Phillips, D. P. (1974) · American Sociological Review · doi:10.2307/2094294 · Cited by 1,063 · cited 2×
“As previously described, social learning theory predicts that Werther narratives, if propagated through BLTD, could cause harm while Papageno narratives might confer benefit.(9-12) Examining suicide counts, we did not find evidence of either a Werther or Papageno effect.”
BackgroundRole of media reports in completed and prevented suicide: Werther v. Papageno effects
Niederkrotenthaler, T., Voracek, M., Herberth, A., Till, B., Strauss, M., Etzersdorfer, E., Eisenwort, B., & Sonneck, G. (2010) · British Journal of Psychiatry · doi:10.1192/bjp.bp.109.074633 · Cited by 719 · cited 2×
“Alternatively, media reports emphasizing coping and resilience in the face of suicidal crises can be associated with fewer suicides across a population, a phenomenon known as the Papageno effect.(10-12) Based on social learning theory, we would expect that Werther narratives disseminated as part of MHA campaigns like…”
BackgroundSelf-citationMarchant, A., Hawton, K., Stewart, A., Montgomery, P., Singaravelu, V., Lloyd, K., Purdy, N., Daine, K., & John, A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0181722 · Cited by 464 · cited 1×
“This may be especially important given that people who experience suicidal ideation, particularly youth, are often social media users and frequently use it as a platform to communicate distress.(20-23) Thus, social media platforms like Twitter have been proposed as important venues for intervention/disseminating suici…”
BackgroundTracking Suicide Risk Factors Through Twitter in the US
Jashinsky, J., Burton, S. H., Hanson, C. L., West, J., Giraud-Carrier, C., Barnes, M. D., & Argyle, T. (2014) · Crisis · doi:10.1027/0227-5910/a000234 · Cited by 342 · cited 1×
“Thus, social media platforms like Twitter have been proposed as important venues for intervention/disseminating suicide prevention information.(13,24-26) The results of this study suggest that BLTD and similar campaigns should consider revisiting and augmenting their aims over time.”
BackgroundMass media interventions for reducing mental health-related stigma
Clement, S., Lassman, F., Barley, E., Evans-Lacko, S., Williams, P., Yamaguchi, S., Slade, M., Rüsch, N., & Thornicroft, G. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009453.pub2 · Cited by 284
Public awareness campaigns about depression and suicide: a review
Dumesnil, H., & Verger, P. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.9.1203 · Cited by 264 · cited 1×
“Indeed, there is even a dearth of evidence regarding campaigns explicitly aimed at educating the public about suicide which have been shown to produce modest improvements in knowledge but not necessarily improved health outcomes.(6) Bell Let’s Talk is a Canadian organization that promotes mental health and well-being,…”
BackgroundWang, P., Wang, X., Wu, Y., Xie, X., Wang, X., Zhao, F., Ouyang, M., & Lei, L. (2018) · Personality and Individual Differences · doi:10.1016/j.paid.2018.02.008 · Cited by 221 · cited 1×
“This may be especially important given that people who experience suicidal ideation, particularly youth, are often social media users and frequently use it as a platform to communicate distress.(20-23) Thus, social media platforms like Twitter have been proposed as important venues for intervention/disseminating suici…”
BackgroundThe relationship between media reporting of suicide and actual suicide in Australia
Pirkis, J. E., Burgess, P. M., Francis, C., Blood, R. W., & Jolley, D. J. (2006) · Social Science & Medicine · doi:10.1016/j.socscimed.2005.11.033 · Cited by 172 · cited 1×
“, years in which the campaign occurred) according to previously established procedures.(12,13,14) Exposure windows were predefined as 7-day epochs spanning day 0 to day þ6 with day 0 specified as BLTD in each year.”
MethodExtracting psychiatric stressors for suicide from social media using deep learning
Du, J., Zhang, Y., Luo, J., Jia, Y., Wei, Q., Tao, C., & Xu, H. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0632-8 · Cited by 161 · cited 1×
“Thus, social media platforms like Twitter have been proposed as important venues for intervention/disseminating suicide prevention information.(13,24-26) The results of this study suggest that BLTD and similar campaigns should consider revisiting and augmenting their aims over time.”
BackgroundSueki, H. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.08.047 · Cited by 155 · cited 1×
“This may be especially important given that people who experience suicidal ideation, particularly youth, are often social media users and frequently use it as a platform to communicate distress.(20-23) Thus, social media platforms like Twitter have been proposed as important venues for intervention/disseminating suici…”
BackgroundSinyor, M., Schaffer, A., Nishikawa, Y., Redelmeier, D. A., Niederkrotenthaler, T., Sareen, J., Levitt, A. J., Kiss, A., & Pirkis, J. (2018) · Canadian Medical Association Journal · doi:10.1503/cmaj.170698 · Cited by 108 · cited 4×
“All suicide-related tweets geolocated to Ontario, posted from July 1, 2015, to June 30, 2016, were identified by a mediatracking company (Infomart) for a larger study examining Twitter content and suicide.(13) Note that a comprehensive set of tweets were only available to our research team for this 1year epoch (in con…”
BackgroundMethodRobinson, J., Hill, N. T. M., Thorn, P., Battersby, R., Teh, Z., Reavley, N. J., Pirkis, J., Lamblin, M., Rice, S., & Skehan, J. (2018) · PLOS ONE · doi:10.1371/journal.pone.0206584 · Cited by 101
Hansson, L., Stjernswärd, S., & Svensson, B. (2016) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12609 · Cited by 95 · cited 1×
“Mental health awareness (MHA) campaigns have been shown to be successful in improving mental health literacy, decreasing stigma and generating public discussion.(1-3) They may also result in improved health outcomes.”
BackgroundFahey, R. A., Matsubayashi, T., & Ueda, M. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.10.004 · Cited by 74 · cited 1×
“This may be especially important given that people who experience suicidal ideation, particularly youth, are often social media users and frequently use it as a platform to communicate distress.(20-23) Thus, social media platforms like Twitter have been proposed as important venues for intervention/disseminating suici…”
BackgroundBooth, R. G., Allen, B. N., Bray Jenkyn, K. M., Li, L., & Shariff, S. Z. (2018) · JMIR Mental Health · doi:10.2196/mental.8808 · Cited by 73 · cited 8×
“For example, MHA campaigns have been associated with an increase in the use of inpatient and outpatient mental health services.(4,5) However, despite the global proliferation of MHA campaigns, the effects on suicide of awareness campaigns that do not explicitly focus on safe suicide messaging and/or suicide prevention…”
BackgroundInfluentialSinyor, M., Schaffer, A., Heisel, M. J., Picard, A., Adamson, G., Cheung, C. P., Katz, L. Y., Jetly, R., & Sareen, J. (2018) · The Canadian Journal of Psychiatry · doi:10.1177/0706743717753147 · Cited by 59
Niederkrotenthaler, T., & Till, B. (2019) · The British Journal of Psychiatry · doi:10.1192/bjp.2019.259 · Cited by 57 · cited 2×
“Alternatively, media reports emphasizing coping and resilience in the face of suicidal crises can be associated with fewer suicides across a population, a phenomenon known as the Papageno effect.(10-12) Based on social learning theory, we would expect that Werther narratives disseminated as part of MHA campaigns like…”
BackgroundSelf-citationThe use of technology in Suicide Prevention
Larsen, M. E., Cummins, N., Boonstra, T. W., O'Dea, B., Tighe, J., Nicholas, J., Shand, F., Epps, J., & Christensen, H. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7320081 · Cited by 47 · cited 1×
“Thus, social media platforms like Twitter have been proposed as important venues for intervention/disseminating suicide prevention information.(13,24-26) The results of this study suggest that BLTD and similar campaigns should consider revisiting and augmenting their aims over time.”
BackgroundThe association between Twitter content and suicide
Sinyor, M., Williams, M., Zaheer, R., Loureiro, R., Pirkis, J., Heisel, M. J., Schaffer, A., Redelmeier, D. A., Cheung, A., & Niederkrotenthaler, T. (2020) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867420969805 · Cited by 37 · cited 4×
“However, groups of tweets with specific putatively harmful and protective content were associated with subsequent increases and decreases in suicides respectively.(12) Therefore, the results presented here identify a potential opportunity for BLTD organizers and others promoting large mental health–related events on s…”
BackgroundMethodResultImpact of a mass media mental health campaign on psychiatric emergency department visits
Cheng, J. M., Benassi, P., de Oliveira, C., Zaheer, J., Collins, M. F., & Kurdyak, P. A. (2016) · Canadian Journal of Public Health · doi:10.17269/cjph.107.5265 · Cited by 30 · cited 1×
“For example, MHA campaigns have been associated with an increase in the use of inpatient and outpatient mental health services.(4,5) However, despite the global proliferation of MHA campaigns, the effects on suicide of awareness campaigns that do not explicitly focus on safe suicide messaging and/or suicide prevention…”
BackgroundMok, K., Donovan, R. J., Hocking, B. M., Maher, B., Lewis, R., & Pirkis, J. (2016) · International Journal of Mental Health Promotion · doi:10.1080/14623730.2016.1209423 · Cited by 21 · cited 1×
“Mental health awareness (MHA) campaigns have been shown to be successful in improving mental health literacy, decreasing stigma and generating public discussion.(1-3) They may also result in improved health outcomes.”
BackgroundThe Relationship Between Suicide-Related Twitter Events and Suicides in Ontario From 2015 to 2016
Sinyor, M., Williams, M., Zaheer, R., Loureiro, R., Pirkis, J., Heisel, M. J., Schaffer, A., Cheung, A., Redelmeier, D. A., & Niederkrotenthaler, T. (2020) · Crisis · doi:10.1027/0227-5910/a000684 · Cited by 15 · cited 2×
“Previous studies by our group have demonstrated that large, suiciderelated Twitter events in Canada often did not include clear Werther or Papageno narratives and, like BLTD, were not associated with changes in suicide rates.(17) However, groups of tweets with specific putatively harmful and protective content were as…”
BackgroundMethod
Research works printed but not linked: 2
- Clement S, 2013, Cochrane Database Syst Rev
- Niederkrotenthaler T, 2019, Br J Psychiatry, 1
Cited by
The Lancet Commission on ending stigma and discrimination in mental health
Thornicroft, G., Sunkel, C., Alikhon Aliev, A., Baker, S., Brohan, E., el Chammay, R., Davies, K., Demissie, M., Duncan, J., Fekadu, W., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(22)01470-2 · Cited by 748
“303,304 The use of stigmatising language can have effects related to suicide.”
Background“The potential of social media in health promotion beyond creating awareness: an integrative review”
Ghahramani, A., de Courten, M., & Prokofieva, M. (2022) · BMC Public Health · doi:10.1186/s12889-022-14885-0 · Cited by 188
A Systematic Review of the Impacts of Media Mental Health Awareness Campaigns on Young People
Tam, M. T., Wu, J. M., Zhang, C. C., Pawliuk, C., & Robillard, J. M. (2024) · Health Promotion Practice · doi:10.1177/15248399241232646 · Cited by 65
“A study examining suicide counts in a region found no significant change in suicide counts before and after the mental health campaign (Côté et al., 2021).”
BackgroundMethodInfluentialDraganidis, A., Fernando, A. N., West, M. L., & Sharp, G. (2024) · Social Science & Medicine · doi:10.1016/j.socscimed.2024.117231 · Cited by 46
Sinyor, M., Ekstein, D., Prabaharan, N., Fıksenbaum, L., Vandermeer, C., Schaffer, A., Pirkis, J., Heisel, M. J., Goldstein, B. I., Redelmeier, D. A., et al. (2024) · The Canadian Journal of Psychiatry · doi:10.1177/07067437231223334 · Cited by 14
Metadata
- Authors
- Côté, D., Williams, M., Zaheer, R., Niederkrotenthaler, T., Schaffer, A., & Sinyor, M.
- Affiliations
- Sunnybrook Health Science Centre (CA)
- Medical University of Vienna (AT)
- Corresponding author
- Sinyor, Mark
- Venue
- The Canadian Journal of Psychiatry
- Publisher
- SAGE Publications
- Published
- 2021-02-10
- Volume
- 66
- Issue
- 5
- Pages
- 460-467
- ISSN
- 0706-7437 (ISSN-L)
- 1497-0015
- PMC
- PMC8107951
- OpenAlex
- W3127223191
- Cited by
- 13
- References
- 20
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 3 · 2023: 1 · 2022: 3
- FWCI
- 1.19
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The Canadian Journal of Psychiatry (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Innovation Fund of the Alternative Funding Plan from the Academic Health Sciences Centres of Ontario
- Mental Health Research Canada
- University of Toronto Department of Psychiatry Excellence Fund
- Ministry of Research and Innovation
- American Foundation for Suicide Prevention
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Keywords
- mental health awareness campaigns, suicide, social media, suicide prevention messaging, help-seeking, resilience, stigma, Ontario, suicide rates
- MeSH terms
- Suicide Prevention, Health Promotion, Humans, Mental Health, Ontario, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.