CoChat

Suicide prevention and depression apps’ suicide risk assessment and management: a systematic assessment of adherence to clinical guidelines

Open access
Martinengo, Laura, Van Galen, Louise, Lum, Elaine, Kowalski, Martin, Subramaniam, Mythily, Car, Josip · 2019 · BMC Medicine
Cited by 155

The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.

Abstract

Background: There are an estimated 800,000 suicides per year globally, and approximately 16,000,000 suicide attempts. Mobile apps may help address the unmet needs of people at risk. We assessed adherence of suicide prevention advice in depression management and suicide prevention apps to six evidence-based clinical guideline recommendations: mood and suicidal thought tracking, safety plan development, recommendation of activities to deter suicidal thoughts, information and education, access to support networks, and access to emergency counseling. Methods: A systematic assessment of depression and suicide prevention apps available in Google Play and Apple’s App Store was conducted. Apps were identified by searching 42matters in January 2019 for apps launched or updated since January 2017 using the terms “depression,” “depressed,” “depress,” “mood disorders,” “suicide,” and “self-harm.” General characteristics of apps, adherence with six suicide prevention strategies identified in evidence-based clinical guidelines using a 50-question checklist developed by the study team, and trustworthiness of the app based on HONcode principles were appraised and reported as a narrative review, using descriptive statistics. Results: The initial search yielded 2690 potentially relevant apps. Sixty-nine apps met inclusion criteria and were systematically assessed. There were 20 depression management apps (29%), 3 (4%) depression management and suicide prevention apps, and 46 (67%) suicide prevention apps. Eight (12%) depression management apps were chatbots. Only 5/69 apps (7%) incorporated all six suicide prevention strategies. Six apps (6/69, 9%), including two apps available in both app stores and downloaded more than one million times each, provided an erroneous crisis helpline number. Most apps included emergency contact information (65/69 apps, 94%) and direct access to a crisis helpline through the app (46/69 apps, 67%). Conclusions: Non-existent or inaccurate suicide crisis helpline phone numbers were provided by mental health apps downloaded more than 2 million times. Only five out of 69 depression and suicide prevention apps offered all six evidence-based suicide prevention strategies. This demonstrates a failure of Apple and Google app stores, and the health app industry in self-governance, and quality and safety assurance. Governance levels should be stratified by the risks and benefits to users of the app, such as when suicide prevention advice is provided.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12916-019-1461-z

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 26 references

Research works printed but not linked: 17

  1. Matthay EC. Suicide falls by a third globally. BMJ. 2019;364:l416. https://doi.org/10.1136/bmj.l416. · DOI
  2. Hawton K, ICC C, Haw C, Saunders K. Risk factors for suicide in individuals with depression: a systematic review. J Affect Disord. 2013;147(1–3):17–28. https://doi.org/10.1016/j.jad.2013.01.004. · DOI · Paper page
  3. Zalsman G, Hawton K, Wasserman D, et al. Suicide prevention strategies revisited: 10-year systematic review. Lancet Psychiatry. 2016;3(7):646–59. https://doi.org/10.1016/S2215-0366(16)30030-X. · DOI · Paper page
  4. Pearson A, Saini P, Da Cruz D, et al. Primary care contact prior to suicide in individuals with mental illness. Br J Gen Pract. 2009;59(568):825–32. https://doi.org/10.3399/bjgp09X472881. · DOI · Paper page
  5. Frey LM, Hans JD, Cerel J. Perceptions of suicide stigma: how do social networks and treatment providers compare? Crisis. 2016;37(2):95–103 https://doi.org/10.1027/0227-5910/a000358. · DOI · Paper page
  6. de Beurs D, Kirtley O, Kerkhof A, Portzky G, O'Connor RC. The role of mobile phone technology in understanding and preventing suicidal behavior. Crisis. 2015;36(2):79–82. https://doi.org/10.1027/0227-5910/a000316. · DOI · Paper page
  7. Christensen H, Batterham PJ, O'Dea B. E-health interventions for suicide prevention. Int J Environ Res Public Health. 2014;11(8):8193–212. https://doi.org/10.3390/ijerph110808193. · DOI · Paper page
  8. de la Torre I, Castillo G, Arambarri J, López-Coronado M, Franco MA. Mobile apps for suicide prevention: review of virtual stores and literature. JMIR Mhealth Uhealth. 2017;5(10):e130. https://doi.org/10.2196/mhealth.8036. · DOI
  9. Moher D, Liberati A, Tetzlaff J, Altman DG, The PG. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009;6(7):e1000097. https://doi.org/10.1371/journal.pmed.1000097. · DOI · Paper page
  10. Stanley B, Brown GK. Safety planning intervention: a brief intervention to mitigate suicide risk. Cogn Behav Pract. 2012;19(2):256–64. https://doi.org/10.1016/j.cbpra.2011.01.001. · DOI · Paper page
  11. Cohen JA. Coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46. https://doi.org/10.1177/001316446002000104. · DOI · Paper page
  12. Lum E, Jimenez G, Huang Z, et al. Decision support and alerts of apps for self-management of blood glucose for type 2 diabetes. JAMA. 2019;321(15):1530–2. https://doi.org/10.1001/jama.2019.1644. · DOI
  13. Huckvale K, Adomaviciute S, Prieto JT, Leow MK, Car J. Smartphone apps for calculating insulin dose: a systematic assessment. BMC Med. 2015;13:106. https://doi.org/10.1186/s12916-015-0314-7. · DOI · Paper page
  14. Huckvale K, Car M, Morrison C, Car J. Apps for asthma self-management: a systematic assessment of content and tools. BMC Med. 2012;10(1):144. https://doi.org/10.1186/1741-7015-10-144. · DOI · Paper page
  15. Assing Hvidt E, Ploug T, Holm S. The impact of telephone crisis services on suicidal users: a systematic review of the past 45 years. Mental Health Review Journal. 2016;21(2):141–60. https://doi.org/10.1108/MHRJ-07-2015-0019. · DOI
  16. PsyberGuide - App review summary. https://psyberguide.org/about-psyberguide/. Accessed 18 Sept 2019.
  17. Wykes T, Schueller S. Why reviewing apps is not enough: transparency for trust (T4T) principles of responsible health app marketplaces. J Med Internet Res. 2019;21(5):e12390. https://doi.org/10.2196/12390. · DOI

Cited by

See all 155

Metadata

Authors
Martinengo, L., Van Galen, L., Lum, E., Kowalski, M., Subramaniam, M., & Car, J.
Venue
BMC Medicine
Published
2019-12
Volume
17
Issue
1
Pages
231-231
ISSN
1741-7015 (ISSN-L)
OpenAlex
W2995061552
Cited by
155
References
26
FWCI
23.31
Type
journal article
Language
en
Open access
gold
Licence
Funders
  • Lee Kong Chian School of Medicine, Nanyang Technological University (NA)
  • NTU Research Scholarship (NA)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Suicide prevention and depression apps’ suicide risk assessment and management: a systematic assessment of adherence to clinical guidelines. https://app.cochat.ai/papers/10.1186/s12916-019-1461-z
The paper
Martinengo, L., Van Galen, L., Lum, E., Kowalski, M., Subramaniam, M., & Car, J. (2019). Suicide prevention and depression apps’ suicide risk assessment and management: a systematic assessment of adherence to clinical guidelines. BMC Medicine. https://doi.org/10.1186/s12916-019-1461-z

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.