The effect of a therapeutic smartphone application on suicidal ideation in young adults: Findings from a randomized controlled trial in Australia.
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index; 30 of the 52 sources its claims cite were checked for support.
Abstract
Background: Suicidal ideation is a major risk for a suicide attempt in younger people, such that reducing severity of ideation is an important target for suicide prevention. Smartphone applications present a new opportunity for managing ideation in young adults; however, confirmatory evidence for efficacy from randomized trials is lacking. The objective of this study was to assess whether a therapeutic smartphone application ("LifeBuoy") was superior to an attention-matched control application at reducing the severity of suicidal ideation.Methods and Findings: In this 2-arm parallel, double-blind, randomized controlled trial, 455 young adults from Australia experiencing recent suicidal ideation and aged 18 to 25 years were randomly assigned in a 2:2 ratio to use a smartphone application for 6 weeks in May 2020, with the final follow-up in October 2020. The primary outcome was change in suicidal ideation symptom severity scores from baseline (T0) to postintervention (T1) and 3-month postintervention follow-up (T2), measured using the Suicidal Ideation Attributes Scale (SIDAS). Secondary outcomes were symptom changes in depression (Patient Health Questionnaire-9, PHQ-9), generalized anxiety (Generalized Anxiety Disorder-7, GAD-7), distress (Distress Questionnaire-5, DQ5), and well-being (Short Warwick-Edinburgh Mental Well-Being Scale, SWEMWBS). This trial was conducted online, using a targeted social media recruitment strategy. The intervention groups were provided with a self-guided smartphone application based on dialectical behavior therapy (DBT; "LifeBuoy") to improve emotion regulation and distress tolerance. The control group were provided a smartphone application that looked like LifeBuoy ("LifeBuoy-C"), but delivered general (nontherapeutic) information on a range of health and lifestyle topics. Among 228 participants randomized to LifeBuoy, 110 did not complete the final survey; among 227 participants randomized to the control condition, 91 did not complete the final survey. All randomized participants were included in the intent-to-treat analysis for the primary and secondary outcomes. There was a significant time × condition effect for suicidal ideation scores in favor of LifeBuoy at T1 (p < 0.001, d = 0.45) and T2 (p = 0.007, d = 0.34). There were no superior intervention effects for LifeBuoy on any secondary mental health outcomes from baseline to T1 or T2 [p-values: 0.069 to 0.896]. No serious adverse events (suicide attempts requiring medical care) were reported. The main limitations of the study are the lack of sample size calculations supporting the study to be powered to detect changes in secondary outcomes and a high attrition rate at T2, which may lead efficacy to be overestimated.Conclusions: LifeBuoy was associated with superior improvements in suicidal ideation severity, but not secondary mental health outcomes, compared to the control application, LifeBuoy-C. Digital therapeutics may need to be purposefully designed to target a specific health outcome to have efficacy.Trial Registration: Australian New Zealand Clinical Trials Registry ACTRN12619001671156.
Overview
CoChat Summary
## TL;DR
In this 2-arm randomized controlled trial of 455 Australian young adults aged 18–25 years with recent suicidal ideation, the DBT-based smartphone app LifeBuoy reduced suicidal ideation more than an attention-matched control app at both postintervention and 3-month follow-up. The app did not improve secondary mental health outcomes, and the paper notes high attrition by the final follow-up.
## Key findings
- 455 participants were randomized 2:2 to LifeBuoy (n = 228) or LifeBuoy-C (n = 227); 73.0% completed T1 and 55.8% completed T2.
- For the primary outcome, LifeBuoy showed a greater reduction in SIDAS scores from baseline to postintervention than control: LifeBuoy B = −8.05, d = −1.02 vs control B = −3.14, d = −0.37; the between-group difference at T1 was B = −4.43, p < 0.001, d = 0.45.
- The superiority persisted at 3 months: the LifeBuoy vs control difference on SIDAS remained significant at T2 (B = −3.51, p = 0.007, d = 0.34), with an overall T0–T2 time × condition effect favoring LifeBuoy (LifeBuoy B = −8.91 vs control B = −4.91).
- No superior intervention effects were found for secondary outcomes (PHQ-9, GAD-7, DQ5, SWEMWBS); the abstract reports p-values from 0.069 to 0.896 for these comparisons.
## Methods
- 2-arm parallel, double-blind, randomized controlled trial conducted online in Australia, with recruitment via Facebook advertisements between May 11 and May 22, 2020.
- Sample: community (nonclinical) adults aged 18–25 years who had experienced suicidal thoughts in the past 12 months, owned a smartphone, and were fluent in English; excluded if recent suicide attempt within 1 month or current/lifetime psychosis or bipolar disorder.
- Analysis: intent-to-treat linear mixed models with repeated measures across baseline (T0), postintervention (T1), and 3-month follow-up (T2); primary outcome was SIDAS, with secondary outcomes PHQ-9, GAD-7, DQ5, and SWEMWBS.
## Limitations
- The paper states that it lacked sample size calculations/power for secondary outcomes and notes that high attrition at T2 “may lead efficacy to be overestimated.”
- The discussion says the sample was biased toward females, LGBTQI persons, and participants who had previously received treatment, which limits generalizability.
- The final survey attrition rate was 45%, and the paper states that participants who dropped out had more severe baseline clinical profiles; this suggests possible attrition bias (evident in the text).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
27 Valid · 0 Not valid · 15 Not checked · 68 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“prior evidence shows one-third of youth with suicidal ideation will develop a suicide plan, and 60% with a plan will make a suicide attempt [7].”
§ The effect of a therapeutic smartphone application on suicidal ideation in young adults: Findings from a randomized controlled trial in Australia > Introduction
What the sources say
- Supportedcites [7] Nock MK, Green JG, Hwang I, McLaughlin KA, Sampson NA, Zaslavsky AM, et al. Prevalence, correlates, and treatment of lifetime suicidal behavior among adolescents: results from the National Comorbidity Survey Replication Adolescent Supplement. JAMA Psychiat. 2013; 70(3): 300– 10. PMC3886236 23303463 source
The Results section reports that 33.4% of adolescent ideators develop a suicide plan and 60.8% of those with a plan make an attempt. The Comment section likewise summarizes these figures as approximately one-third and 60%, matching the citing sentence. (LLM, conf=0.95)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“prior evidence shows one-third of youth with suicidal ideation will develop a suicide plan, and 60% with a plan will make a suicide attempt [7].”
§ The effect of a therapeutic smartphone application on suicidal ideation in young adults: Findings from a randomized controlled trial in Australia > Introduction
What the sources say
- Supportedcites [7] Nock MK, Green JG, Hwang I, McLaughlin KA, Sampson NA, Zaslavsky AM, et al. Prevalence, correlates, and treatment of lifetime suicidal behavior among adolescents: results from the National Comorbidity Survey Replication Adolescent Supplement. JAMA Psychiat. 2013; 70(3): 300– 10. PMC3886236 23303463 source
The Results section (Prevalence and age-of-onset of suicidal behaviors) reports that 60.8% of adolescents with suicidal ideation and a plan go on to make an attempt. The Comment section also states that approximately 60% of youth with a plan make a suicide attempt. (LLM, conf=0.95)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although pooled findings indicate that the odds of a future suicide attempt are only 1.88 times higher among individuals with suicidal ideation than those without [5]”
§ The effect of a therapeutic smartphone application on suicidal ideation in young adults: Findings from a randomized controlled trial in Australia > Introduction
What the sources say
- Supportedcites [5] Ribeiro JD, Franklin JC, Fox KR, Bentley KH, Kleiman EM, Chang BP, et al. Self-injurious thoughts and behaviors as risk factors for future suicide ideation, attempts, and death: a meta-analysis of longitudinal studies. Psychol Med. 2016; 46(2): 225– 36. doi: 10.1017/S0033291715001804 26370729 PMC4774896 source
The Results, under “Risk factor category analyses—Suicidal ideation,” report that prior suicidal ideation predicts subsequent suicide attempts with a weighted mean odds ratio of 1.88. This matches the citing sentence’s pooled estimate; the supplied passage does not include a page number. (LLM, conf=0.94)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Power analyses determined that a sample size of 189 participants per intervention group would be sufficient to detect an effect size of 0.30 [14] for our primary outcome at postintervention with at least 80% power and an α criterion of 0.05.”
§ The effect of a therapeutic smartphone application on suicidal ideation in young adults: Findings from a randomized controlled trial in Australia > Study design and participants > Statistical analyses
What the sources say
- Partly supportedcites [14] Torok M, Han J, Baker S, Werner-Seidler A, Wong I, Larsen ME, et al. Suicide prevention using self-guided digital interventions: a systematic review and meta-analysis of randomised controlled trials. Lancet Digital Health. 2020; 2(1): e25– 36. doi: 10.1016/S2589-7500(19)30199-2 33328037 sourceExperimental — accuracy not yet measured
The citation is attached to the assumed effect size of 0.30, not to the citing authors’ power calculation. The Other non-CBT interventions section reports an imputed post-intervention effect estimate of −0.31 for direct interventions, close to 0.30 in magnitude. That is a conditional estimate, however; the paper reports an overall post-intervention effect of −0.18, so it does not establish 0.30 as the general effect size for the citing study’s primary outcome. (LLM, conf=0.76)
hedgedn = 189- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It is also noteworthy that the immediate effect of Lifebuoy on suicidal ideation in our postintervention period (d = 0.45) is comparable to the pooled effects reported for the intensive face-to-face DBT treatment of suicidal ideation (e.g., d = 0.48) [32].”
§ The effect of a therapeutic smartphone application on suicidal ideation in young adults: Findings from a randomized controlled trial in Australia > Discussion
What the sources say
- Partly supportedcites [32] Kothgassner OD, Robinson K, Goreis A, Ougrin D, Plener PL. Does treatment method matter? A meta-analysis of the past 20 years of research on therapeutic interventions for self-harm and suicidal ideation in adolescents. Borderline Personal Disord Emot Dysregulation. 2020; 7(1): 9. PMC7216729 32426138 sourceExperimental — accuracy not yet measured
The Discussion (Applicability of the results; page not available) reports a pooled DBT-A effect of d = 0.48 for suicidal ideation in adolescents compared with control interventions. Our copy does not establish that this pooled estimate specifically represents intensive face-to-face treatment. The LifeBuoy result and the judgment that the two effects are comparable are the citing authors’ own comparison, not findings attributed to this source. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
47 more claims · 6 with their cited sources checked
Create a free account to see all 110 claims and every source verdict.
- Probably not a substantial claim. 25
- It may state two separate claims as one. 43
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The studies conducted by Sun et al [61], Simonsson et al [66], and Torok et al [64] found no superior effects of the treatment on depressive symptoms.”
The cited source says what the claim attributes to it.
In the citing paper
“Only 3 studies [64,65,68] were eligible for a meta-analysis analyzing the treatment effect on well-being.”
The cited source says what the claim attributes to it.
In the citing paper
“In contrast, others found only partial differences [58], equal effects, or no differences between groups [55,64].”
The cited source says what the claim attributes to it.
In the citing paper
“The main analyses showed that LifeBuoy was associated with significant reductions in the severity of suicidal ideation in the intervention condition compared to the control group [25]”
Statistics that don’t add up
Each reported p-value recomputed from its test statistic and degrees of freedom.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“χ2(1) = 6.60, p = 0.10”
§ The effect of a therapeutic smartphone application on suicidal ideation in young adults: Findings from a randomized controlled trial in Australia > Results > Attrition from assessment
Reported p = .1 · recomputed p = .010
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Doesn’t add upχ²(1) = 6.6reported p = .1 · recomputed p = .010The two fall on opposite sides of .05
“χ2(1) = 6.60, p = .10”
- Consistentz = -4.43reported p < .001 · recomputed p < .001
“Z = −4.43, p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · cited 2×
“Recent depression symptoms (in past 2 weeks) were measured by the Patient Health Questionnaire-9 (PHQ9; Kroenke, Spitzer [27]), a reliable and valid 9-item measure (Cronbach’s α = 0.”
MethodInfluentialA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 8×
“To this end, linear mixed models for repeated measures analyses were used to examine primary (SIDAS) and secondary outcomes (PHQ-9, GAD-7, DQ5, and SWEMWBS) across T0, T1, and T2, including all available data from participants.”
MethodInfluentialCognitive-Behavioral Treatment of Borderline Personality Disorder
Cary, G. L. (1994) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1994.48.1.155 · Cited by 6,283
The Three-Step Theory (3ST): A New Theory of Suicide Rooted in the “Ideation-to-Action” Framework
Klonsky, E. D., & May, A. M. (2015) · International Journal of Cognitive Therapy · doi:10.1521/ijct.2015.8.2.114 · Cited by 1,799
Nock, M. K., Green, J. G., Hwang, I., McLaughlin, K. A., Sampson, N. A., Zaslavsky, A. M., & Kessler, R. C. (2013) · JAMA Psychiatry · doi:10.1001/2013.jamapsychiatry.55 · Cited by 1,666 · cited 1×
“88 times higher among individuals with suicidal ideation than those without [5], prior evidence shows one-third of youth with suicidal ideation will develop a suicide plan, and 60% with a plan will make a suicide attempt [7].”
BackgroundWang, P. S., Aguilar-Gaxiola, S., Alonso, J., Angermeyer, M. C., Borges, G., Bromet, E. J., Bruffaerts, R., de Girolamo, G., de Graaf, R., Gureje, O., et al. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61414-7 · Cited by 1,655 · cited 1×
“2% of those in need accessing such services in low-to middle-income countries, while access rates are 2 to 3 times greater in higher income countries [9].”
BackgroundComputer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442 · cited 1×
“dropout is 74% for unsupervised digital therapeutics [37], which is problematic as low engagement has been shown to reduce the efficacy [38].”
BackgroundRibeiro, J. D., Franklin, J. C., Fox, K. R., Bentley, K. H., Kleiman, E. M., Chang, B. P., & Nock, M. K. (2016) · Psychological Medicine · doi:10.1017/s0033291715001804 · Cited by 1,346 · cited 3×
“88 times higher among individuals with suicidal ideation than those without [5], prior evidence shows one-third of youth with suicidal ideation will develop a suicide plan, and 60% with a plan will make a suicide attempt [7].”
BackgroundStewart-Brown, S., Tennant, A., Tennant, R., Platt, S., Parkinson, J., & Weich, S. (2009) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-7-15 · Cited by 1,251
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
Erskine, H. E., Moffitt, T. E., Copeland, W. E., Costello, E. J., Ferrari, A. J., Patton, G., Degenhardt, L., Vos, T., Whiteford, H. A., & Scott, J. G. (2015) · Psychological Medicine · doi:10.1017/s0033291714002888 · Cited by 688 · cited 1×
“Increasing trends in youth suicide alongside the substantial and unchanging mental health burden among those aged 0 to 24 years [8] creates considerable uncertainty as to whether there is sufficient availability of treatment services and workforce capacity to meet supply and demand needs over the coming decades.”
BackgroundFirth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · cited 1×
“This latter finding, together with meta-analytic evidence that smartphone applications have a moderate effect on depressive symptoms [18] and a small effect of anxiety symptoms [19], shows promise for these interventions.”
ResultTorous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546 · cited 2×
“By the final survey, the attrition from assessment rate was 45%, consistent with prior clinical trials of smartphone interventions [36].”
BackgroundResultOugrin, D., Tranah, T., Stahl, D., Moran, P., & Asarnow, J. R. (2015) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2014.10.009 · Cited by 508 · cited 1×
“DBT is one of the most effective therapeutic approaches for reducing suicidal thoughts and suicide attempts in young people [25].”
Backgroundvan Spijker, B. A. J., Batterham, P. J., Calear, A. L., Farrer, L., Christensen, H., Reynolds, J., & Kerkhof, A. J. F. M. (2014) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12084 · Cited by 492 · cited 1×
“At each survey time point, if participants exceeded cutoff scores of 21 or greater on the Suicidal Ideation Attributes Scale (SIDAS) [26], the research team was alerted via email.”
Self-citationLehtimaki, S., Martic, J., Wahl, B., Foster, K. T., & Schwalbe, N. (2021) · JMIR Mental Health · doi:10.2196/25847 · Cited by 488 · cited 1×
“Certainly, while cognitive behavioral therapy (CBT) has been successfully translated into digital interventions for depression and anxiety [35], it appears to have little impact on ideation or other suicidal outcomes in comparison to alternative therapies such as DBT [14].”
BackgroundHom, M. A., Stanley, I. H., & Joiner, T. E. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.05.006 · Cited by 462 · cited 2×
“It is estimated that up to 70% of those aged 12 to 18 years with suicidal thoughts and/or behaviors do not actively utilize mental health services because of embarrassment and stigma, difficulty expressing suicide concerns, lack of support, and a preference for self-reliance [12].”
BackgroundMoskowitz, D. S., & Young, S. N. (2006) · Journal of Psychiatry and Neuroscience · doi:10.1139/jpn.0602 · Cited by 457 · cited 1×
“Also, the inclusion of novel methods, such as ecological momentary assessment (EMA) and data linkage [42,43], in this trial would have improved the capture of real-time and long-term impacts of LifeBuoy on suicide ideation, attempt, and death, which would further strengthen causal inferences regarding the contribution…”
BackgroundDialectical behavior therapy is effective for the treatment of suicidal behavior: A meta-analysis
DeCou, C. R., Comtois, K. A., & Landes, S. J. (2019) · Behavior Therapy · doi:10.1016/j.beth.2018.03.009 · Cited by 439 · cited 1×
“The LifeBuoy application is primarily based on dialectical behavior therapy (DBT), a specific modified form of cognitive behavior therapy designed to treat persistent emotional dysregulation as a means to preventing selfharm and suicidal behaviors [21].”
MethodKauer, S. D., Reid, S. C., Crooke, A. H. D., Khor, A., Hearps, S. J. C., Jorm, A. F., Sanci, L., & Patton, G. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1858 · Cited by 404 · cited 1×
“The potential for the digital placebo effect to influence efficacy is demonstrated in a prior study of a smartphone application for adolescents to self-monitor symptoms of depression; the study found that without any direct therapeutic intervention, self-monitoring significantly reduced symptoms [40].”
BackgroundGan, D. Z. Q., McGillivray, L., Han, J., Christensen, H., & Torok, M. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.764079 · Cited by 305 · cited 1×
“dropout is 74% for unsupervised digital therapeutics [37], which is problematic as low engagement has been shown to reduce the efficacy [38].”
BackgroundSelf-citationMeta-Analysis and Systematic Review Assessing the Efficacy of Dialectical Behavior Therapy (DBT)
Panos, P. T., Jackson, J. W., Hasan, O., & Panos, A. (2014) · Research on Social Work Practice · doi:10.1177/1049731513503047 · Cited by 299 · cited 1×
“When delivered in its face-to-face modality, DBT is a lengthy (4 to 6 months duration) multicomponent program involving individual psychotherapy, multifamily group skills training, coaching, and weekly therapist team consultation [33].”
BackgroundTorok, M., Han, J., Baker, S., Werner-Seidler, A., Wong, I., Larsen, M. E., & Christensen, H. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30199-2 · Cited by 273
Self-citationCONSORT: An Evolving Tool to Help Improve the Quality of Reports of Randomized Controlled Trials
Moher, D. (1998) · JAMA · doi:10.1001/jama.279.18.1489 · Cited by 241 · cited 3×
“This study is reported as per the Consolidated Standards of Reporting Trials (CONSORT) guideline (S1 CONSORT Checklist) [23].”
BackgroundMethodInfluentialTighe, J., Shand, F., Ridani, R., Mackinnon, A., De La Mata, N., & Christensen, H. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013518 · Cited by 227 · cited 4×
“Second, unlike this trial, neither of the previously referenced trials of smartphone applications [16,17] provided an application that exactly replicated the aesthetics and design of the interventional application to the control condition.”
BackgroundMethodResultInfluentialSelf-citationFranklin, J. C., Fox, K. R., Franklin, C. R., Kleiman, E. M., Ribeiro, J. D., Jaroszewski, A. C., Hooley, J. M., & Nock, M. K. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000093 · Cited by 217 · cited 5×
“Second, unlike this trial, neither of the previously referenced trials of smartphone applications [16,17] provided an application that exactly replicated the aesthetics and design of the interventional application to the control condition.”
BackgroundMethodResultInfluentialThe digital placebo effect: mobile mental health meets clinical psychiatry
Torous, J., & Firth, J. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00565-9 · Cited by 200
Meerwijk, E. L., Parekh, A., Oquendo, M. A., Allen, I. E., Franck, L. S., & Lee, K. A. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)00064-x · Cited by 181
Evans, R., White, J., Turley, R., Slater, T., Morgan, H., Strange, H., & Scourfield, J. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.09.020 · Cited by 180 · cited 1×
“Suicide attempt and ideation are estimated to occur in around 1% and 11% of community-based young people each year, respectively [6], while suicide mortality occurs in less than 0.”
BackgroundWitt, K., Spittal, M. J., Carter, G., Pirkis, J., Hetrick, S., Currier, D., Robinson, J., & Milner, A. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1458-0 · Cited by 179 · cited 1×
“Adults can readily access and benefit from technology-enabled solutions that directly target suicidal ideation and/or behaviors [14,15]; however, the evidence for this is largely derived from trials of web-based programs rather than smartphone interventions.”
BackgroundRichards, J. E., Whiteside, U., Ludman, E. J., Pabiniak, C., Kirlin, B., Hidalgo, R., & Simon, G. (2019) · Psychiatric Services · doi:10.1176/appi.ps.201800342 · Cited by 167 · cited 1×
“Prior research suggests that nondisclosure is not uncommon—and may be related to fear of stigmatization, uncertainty of repercussions, and prioritization of other mental health issues [45].”
BackgroundKothgassner, O. D., Robinson, K., Goreis, A., Ougrin, D., & Plener, P. L. (2020) · Borderline Personality Disorder and Emotion Dysregulation · doi:10.1186/s40479-020-00123-9 · Cited by 163
Urban/rural and gender differentials in suicide rates: East and West
Yip, P. S. F., Callanan, C., & Yuen, H. P. (2000) · Journal of Affective Disorders · doi:10.1016/s0165-0327(99)00058-0 · Cited by 161 · cited 1×
“Similar patterns of higher sucide rates and reduced access to mental health services are echoed in rural and remote regions of high income countries [10,11].”
BackgroundBatterham, P. J., Sunderland, M., Carragher, N., Calear, A. L., Mackinnon, A. J., & Slade, T. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.10.005 · Cited by 146 · cited 8×
“To this end, linear mixed models for repeated measures analyses were used to examine primary (SIDAS) and secondary outcomes (PHQ-9, GAD-7, DQ5, and SWEMWBS) across T0, T1, and T2, including all available data from participants.”
BackgroundMethodInfluentialRising suicide rates among adolescents in England and Wales
Bould, H., Mars, B., Moran, P., Biddle, L., & Gunnell, D. (2019) · The Lancet · doi:10.1016/s0140-6736(19)31102-x · Cited by 146 · cited 1×
“Globally, around one-third of all suicides occur among those aged 15 to 29 years [1], and rates of youth suicide are rising in many countries, including Australia [2], the United Kingdom [3], and the United States [4].”
BackgroundYoung People Seeking Help Online for Mental Health: Cross-Sectional Survey Study
Pretorius, C., Chambers, D., Cowan, B., & Coyle, D. (2019) · JMIR Mental Health · doi:10.2196/13524 · Cited by 143 · cited 1×
“Since many young people seek help directly online, via their phones [22], we opted to test the intervention as an app available in the app store and promoted the trial via social media.”
BackgroundEffectiveness of Online Self-Help for Suicidal Thoughts: Results of a Randomised Controlled Trial
van Spijker, B. A. J., van Straten, A., & Kerkhof, A. J. F. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090118 · Cited by 142
Fitzpatrick, T., Perrier, L., Shakik, S., Cairncross, Z., Tricco, A. C., Lix, L., Zwarenstein, M., Rosella, L., & Henry, D. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.6019 · Cited by 100 · cited 1×
“Also, the inclusion of novel methods, such as ecological momentary assessment (EMA) and data linkage [42,43], in this trial would have improved the capture of real-time and long-term impacts of LifeBuoy on suicide ideation, attempt, and death, which would further strengthen causal inferences regarding the contribution…”
BackgroundAkers, L., & Gordon, J. S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9372 · Cited by 87 · cited 1×
“, interests, demographics, and geography) may reduce the likelihood that they are seen by those who would be ineligible on key inclusion criteria [46].”
BackgroundDe Jaegere, E., van Landschoot, R., van Heeringen, K., van Spijker, B. A. J., Kerkhof, A. J. F. M., Mokkenstorm, J. K., & Portzky, G. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.05.003 · Cited by 71 · cited 1×
“This finding is not new but has not received much attention; similar trials also report high rates of prior treatment engagement (60% or higher; [31,44]).”
ResultRural suicide rates and availability of health care providers
Fiske, A., Gatz, M., & Hannell, E. (2005) · Journal of Community Psychology · doi:10.1002/jcop.20069 · Cited by 39 · cited 1×
“Similar patterns of higher sucide rates and reduced access to mental health services are echoed in rural and remote regions of high income countries [10,11].”
BackgroundHan, J., McGillivray, L., Wong, Q. J., Werner-Seidler, A., Wong, I., Calear, A., Christensen, H., & Torok, M. (2020) · JMIR Research Protocols · doi:10.2196/23655 · Cited by 17 · cited 2×
“The trial protocol (S1 Protocol) was prospectively registered on the Australian New Zealand Clinical Trials Registry (ACTRN12619001671156) and has also been published elsewhere [24].”
BackgroundMethodSelf-citationUS suicide rates in young people are highest since 2000
Mahase, E. (2019) · BMJ · doi:10.1136/bmj.l4289 · Cited by 9 · cited 1×
“Globally, around one-third of all suicides occur among those aged 15 to 29 years [1], and rates of youth suicide are rising in many countries, including Australia [2], the United Kingdom [3], and the United States [4].”
Background
Research works printed but not linked: 2
- World Health Organization. LIVE LIFE: Preventing Suicide. Geneva:WHO; 2018.
- Rideout V, Fox S. Digital Health Practices, Social Media Use, and Mental Well-Being Among Teens and Young Adults in the United States. [Internet]. USA: Hopelab and Well Being Trust; 2018. [cited 2021 Aug 3]. Available from: https://assets.hopelab.org/wp-content/uploads/2020/08/a-national-survey-by-hopelab-and-well-being-trust-2018.pdf.
Cited by
O’Connor, E., Perdue, L. A., Coppola, E. L., Henninger, M. L., Thomas, R. G., & Gaynes, B. N. (2023) · JAMA · doi:10.1001/jama.2023.7787 · Cited by 126
The Safety of Digital Mental Health Interventions: Systematic Review and Recommendations
Taher, R., Hsu, C.-W., Hampshire, C., Fialho, C., Heaysman, C., Stahl, D., Shergill, S., & Yiend, J. (2023) · JMIR Mental Health · doi:10.2196/47433 · Cited by 68
Bear, H. A., Ayala‐Nunes, L., Ramos, G., Manchanda, T., Fernandes, B., Chabursky, S., Walper, S., Watkins, E. R., & Fazel, M. S. (2024) · Journal of Medical Internet Research · doi:10.2196/48964 · Cited by 78
Digital Mental Health Interventions for Young People Aged 16-25 Years: Scoping Review
Potts, C., Kealy, C., McNulty, J. M., Madrid‐Cagigal, A., Wilson, T., Mulvenna, M. D., O’Neill, S. M., Donohoe, G. J., & Barry, M. M. (2025) · Journal of Medical Internet Research · doi:10.2196/72892 · Cited by 75
“[150,151], imi [75,85], LifeBuoy [94,101], Mindfulness Virtual Community [139,141], Spark [55,93], Step-by-Step [128,130], Tita [162,164], and Whitu [156,157].”
Systematic review and meta-analysis of adverse events in clinical trials of mental health apps
Linardon, J., Fuller-Tyszkiewicz, M., Firth, J., Goldberg, S. B., Anderson, C., McClure, Z., & Torous, J. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01388-y · Cited by 44
Metadata
- Authors
- Torok, M., Han, J., McGillivray, L., Wong, Q., Werner-Seidler, A., O’Dea, B., Calear, A., & Christensen, H.
- Affiliations
- UNSW Sydney (AU)
- Western Sydney University (AU)
- Australian National University (AU)
- Corresponding author
- Torok, Michelle
- ORCID
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-05-31
- Volume
- 19
- Issue
- 5
- Pages
- e1003978
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC9154190
- OpenAlex
- W4281686890
- Cited by
- 71
- References
- 43
- Citations by year
- 2026: 16 · 2025: 16 · 2024: 18 · 2023: 15 · 2022: 5
- FWCI
- 11.89
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ANU Open Research (Australian National University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Australian Rotary Health (RG192840)
- National Health and Medical Research Council (1138710)
- S & C Roth Family Foundation (RG20210528)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Social Sciences › Psychology › Clinical Psychology › Personality Disorders and Psychopathology
- Keywords
- suicidal ideation, mobile application, Lifebuoy, dialectical behavior therapy, young adults, suicide prevention, emotion regulation, distress tolerance, depression, generalized anxiety disorder, psychological distress, well-being, digital mental health interventions, COVID-19 pandemic, self-guided intervention, attrition
- MeSH terms
- Smartphone, Australia, Humans, Surveys and Questionnaires, Suicide, Attempted, Young Adult, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

