Cited by 66Mental Health Research TopicsSuicide and Self-Harm StudiesMental Health via Writing

Modelling suicide ideation from beep to beep: application of network analysis to ecological momentary assessment data

Open access
Rath, Dajana, de Beurs, Derek, Hallensleben, Nina, Spangenberg, Lena, Glaesmer, Heide, Forkmann, Thomas·2019·Internet Interventions

Abstract

•EMA data were analyzed using network analysis (e.g., temporal networks).•Suicidal ideation at t was predicted by itself and perceived burdensomeness at t - 1.•Suicidal ideation at t - 1 predicted perceived burdensomeness, depression etc. at t.•At the same beep, suicidal ideation was related to all variables in the network.•Patients with higher average suicidal ideation had higher average hopelessness.

AI snapshot

Written from the paper’s full text.

TL;DR

This study re-analyzed ecological momentary assessment data from 74 psychiatric inpatients with depressive disorder and current/lifetime suicidal ideation using multilevel vector autoregression to estimate temporal, contemporaneous, and between-subjects networks. Suicidal ideation was prospectively predicted mainly by itself and perceived burdensomeness, while contemporaneously it was most strongly associated with hopelessness and related to all other assessed variables.

Key findings

  • In the temporal network, suicidal ideation at time t was predicted only by perceived burdensomeness (fixed effects coefficient 0.06, p < .05) and suicidal ideation at t − 1 (0.26, p < .001). Suicidal ideation at t − 1 predicted perceived burdensomeness (0.10, p < .001), hopelessness (0.11, p < .001), depressiveness (0.08, p = .001), and positive affect (−0.08, p < .001); no temporal relation was found with thwarted belongingness or anxiety.
  • In the contemporaneous network, suicidal ideation was most strongly associated with hopelessness and was associated with all other variables; positive affect had a strong negative correlation with depression.
  • In the between-subjects network, participants with higher average hopelessness also had higher average suicidal ideation; no other between-subjects relation between suicidal ideation and any other variable was found.
  • The sample completed 89.7% of EMA assessments on average (min = 75%, max = 100%), yielding 4295 valid observations.

Methods

  • Seventy-four psychiatric inpatients with a primary unipolar depressive disorder and current or lifetime suicidal ideation were assessed over 6 days with 10 signal-contingent EMA prompts per day (maximum 60 assessments), randomly between 8:00 am and 8:00 pm with at least 30 minutes between prompts. Measures included suicidal ideation, perceived burdensomeness, thwarted belongingness, depressiveness, hopelessness, positive affect, and anxiety (16 items used for network analysis).
  • Multilevel vector autoregression (mlVAR) models in R were used to estimate temporal, contemporaneous, and between-subjects networks. Variables were standardized and scaled within persons; networks were graphed with qgraph using the Fruchterman-Reingold algorithm. Data were not detrended because Dickey-Fuller tests indicated all variables were stationary (all p < .01).

Limitations

  • The paper states the sample consisted only of inpatients with Major Depression, so findings should be generalized cautiously to other diagnoses; the inpatient setting may slightly diminish ecological validity. It also states uncertainty about whether the EMA design (10 assessments/day, 30–120 min intervals, 8 am–8 pm) captured the natural course of suicidal ideation, potentially missing late evenings, early mornings, and nights.
  • The paper states that important risk factors such as defeat and entrapment were not included, only self-reports were used, and the study was likely underpowered to detect more subtle dynamic relations. It also states that network connections should be interpreted as hypothesis-generating indications of potential causality, not true causal relationships.
  • Evident from the text: missing data were handled via listwise deletion, which may affect the analyzed sample; the paper does not discuss this as a limitation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1016/j.invent.2019.100292

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 38 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    Suicidal ideation at time t−1 predicted positive affect at time t (fixed effects coefficient −0.08, p < .001).

    “Suicidal ideation at t − 1 predicted perceived burdensomeness, depression etc. at t.”
    • Also stated in: § Temporal network · plain
      “SI, however, predicted perceived burdensomeness (0.10, p < .001), hopelessness (0.11, p < .001), depressiveness (0.08, p = .001), and positive affect (−0.08, p < .001) over time.”
    Quote in the paperSubstantial claim
  • Findingown data

    Suicidal ideation at time t was predicted by perceived burdensomeness at time t−1 (fixed effects coefficient 0.06, p < .05).

    “Suicidal ideation at t was predicted by itself and perceived burdensomeness at t – 1.”
    • Also stated in: § Temporal network · plain
      “SI at time point t was solely predicted by perceived burdensomeness (fixed effects coefficient: 0.06, p < .05) and SI at t − 1 (fixed effects coefficient: 0.26, p < .001).”
    Quote in the paperSubstantial claim
  • Findingown data

    Patients with higher average suicidal ideation had higher average hopelessness.

    “Patients with higher average suicidal ideation had higher average hopelessness.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Suicidal ideation at time t−1 predicted hopelessness at time t (fixed effects coefficient 0.11, p < .001).

    “Suicidal ideation at t − 1 predicted perceived burdensomeness, depression etc. at t.”
    • Also stated in: § Temporal network · plain
      “SI, however, predicted perceived burdensomeness (0.10, p < .001), hopelessness (0.11, p < .001), depressiveness (0.08, p = .001), and positive affect (−0.08, p < .001) over time.”
    Quote in the paperSubstantial claim
  • Findingown data

    Suicidal ideation at time t was predicted by suicidal ideation at time t−1 (fixed effects coefficient 0.26, p < .001).

    “Suicidal ideation at t was predicted by itself and perceived burdensomeness at t – 1.”
    • Also stated in: § Temporal network · plain
      “SI at time point t was solely predicted by perceived burdensomeness (fixed effects coefficient: 0.06, p < .05) and SI at t − 1 (fixed effects coefficient: 0.26, p < .001).”
    Quote in the paperSubstantial claim
  • May combine two claims. 18
  • The quote only partly states this claim. 1
  • Classified as probably not a substantial claim. 20
  • May combine two claims. The quote only partly states this claim.

    Findingown data

    In the temporal network, suicidal ideation at t was solely predicted by itself and the level of perceived burdensomeness at t − 1; only perceived burdensomeness had a direct temporal impact on suicidal ideation.

    “SI at t was solely predicted by itself and the level of perceived burdensomeness at t − 1”
    • Also stated in: § Discussion · plain
      “Regarding the IPTS variables, only perceived burdensomeness had a direct temporal impact on SI.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Anxiety did not predict or was not predicted by any other variables at time t−1.

    “Anxiety was only predicted by itself, but neither influenced nor was influenced by any other variables at t − 1.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The contemporaneous network revealed a direct relation between suicidal ideation, perceived burdensomeness, and thwarted belongingness; both thwarted belongingness and perceived burdensomeness are related to suicidal ideation at the same measurement.

    “The contemporaneous network also revealed a direct relation between SI, perceived burdensomeness, and thwarted belongingness.”
    • Also stated in: § Discussion · plain
      “According to the results from the contemporaneous network, both thwarted belongingness and perceived burdensomeness are related to SI at the same measurement”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Suicidal behavior may emerge as the result of an interaction between many different psychological, social, and biological variables.

    “Suicidal behavior may emerge as the result of an interaction between many different psychological, social, and biological variables (Hawton and Van Heeringen, 2000; O'Connor and Nock, 2014).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Hawton and Van Heeringen, 2000

      Not checked in the free run.

    • cites O'Connor and Nock, 2014

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisereasoning

    Temporal networks can be indicative of potential causality given that one variable preceded the other in time.

    “These networks are called temporal networks, as they can be indicative of potential causality given that one variable preceded the other in time.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Network analysis extends previously used multilevel analysis by controlling for autoregressive effects of all variables included in the network (not only autoregressive effects of SI), by revealing temporal and contemporaneous associations as well as between-subjects differences, and by offering a visual representation of the relations between all assessed variables.

    “In sum, network analysis extends previously used multilevel analysis by controlling for autoregressive effects of all variables included in the network (not only autoregressive effects of SI), by revealing temporal and contemporaneous associations as well as between-subjects differences, and by offering a visual representation of the relations between all assessed variables.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    The well-known psychological risk factors hopelessness, perceived burdensomeness, and thwarted belongingness co-occurred with suicidal ideation, but did not predict suicidal ideation at short-term follow up.

    “Importantly, the well-known psychological risk factors hopelessness, perceived burdensomeness, and thwarted belongingness co-occurred with SI, but did not predict SI at short-term follow up.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Kleiman et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    The relation over time could also be explained by variables that had not been measured; therefore, temporal networks are mainly useful for hypothesis generating.

    “The relation over time could also be explained by variables that had not been measured. Therefore, temporal networks are mainly useful for hypothesis generating.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    According to the network perspective in psychopathology, mental health problems (in this case suicidal ideation) develop as a result of interacting symptoms or risk factors.

    “According to the network perspective in psychopathology, mental health problems (in our case SI) develop as a result of interacting symptoms or risk factors (Borsboom, 2017).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Borsboom, 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Kleiman et al. (2017) reported similar results for psychological risk factors associated with suicidal ideation, such as hopelessness, perceived burdensomeness, and thwarted belongingness.

    “Kleiman et al. (2017) reported similar results not only for SI, but also for psychological risk factors associated with SI, such as hopelessness, perceived burdensomeness, and thwarted belongingness.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kleiman et al., 2017 source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    One proposed hypothesis from the network perspective on suicidal behavior is that a suicide attempt is the result of the interaction between different risk factors, such as hopelessness, depression, impulsivity, and suicidal ideation.

    “One proposed hypothesis from the network perspective on suicidal behavior is that a suicide attempt is the result of the interaction between different risk factors, such as hopelessness, depression, impulsivity, and suicidal ideation (De Beurs, 2017).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites De Beurs, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Differences between cross-sectional and temporal analyses have been reported, leading Kleiman and Nock to distinguish between correlates, predictors, and predictors of change for suicidal ideation.

    “Differences between cross-sectional and temporal analyses have also been reported by Kleiman and Nock (2018) and Ben-Zeev et al. (2012), which led Kleiman and Nock to distinguish between correlates, predictors, and predictors of change for SI (Kleiman and Nock, 2018).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Kleiman and Nock, 2018

      Not checked in the free run.

    • cites Ben-Zeev et al., 2012 source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Hopelessness, perceived burdensomeness (but not thwarted belongingness), and suicidal ideation at t−1 prospectively predicted suicidal ideation at t.

    “Second, hopelessness, perceived burdensomeness (but not thwarted belongingness), and SI at t − 1 prospectively predicted SI at t (Hallensleben et al., 2019).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Hallensleben et al., 2019 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    When the dynamical relations between risk factors are sufficiently strong, they can be self-sustained via a negative feedback loop.

    “When the dynamical relations between risk factors are sufficiently strong, they can be self-sustained via a negative feedback loop (Borsboom, 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Borsboom, 2017 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    As the time between two assessments in this study was between 30 and 120 min, the temporal network offers insights into relations between variables within this short period of time.

    “As in our study the time between two assessments was between 30 and 120 min, the temporal network offers insights into relations between variables within this short period of time.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Momentary intrusive suicidal thoughts seem to make people feel hopeless and a burden for others 30 to 120 min afterwards, which in turn might make them feel isolated further 30 to 120 min later.

    “At least with our design, momentary intrusive suicidal thoughts seem to make people feel hopeless and a burden for others 30 to 120 min afterwards, which in turn might make them feel isolated (in terms of higher thwarted belongingness) further 30 to 120 min later.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    First EMA studies demonstrated high fluctuations of suicidal ideation over time, even from hour to hour, and large intrapersonal differences in fluctuations.

    “First EMA studies not only demonstrated high fluctuations of suicidal ideation (SI) over time, even from hour to hour (cf. preliminary data analysis by Hallensleben et al., 2017; Kleiman et al., 2017), but also large intrapersonal differences in fluctuations.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Hallensleben et al., 2017 source

      Not checked in the free run.

    • cites Kleiman et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Kleiman and Nock (2018) concluded that well-known risk factors, such as hopelessness and perceived burdensomeness, are most useful to predict suicidal ideation at the moment, but less useful to predict suicidal ideation over time.

    “concluding that well-known risk factors, such as hopelessness and perceived burdensomeness, are most useful to predict SI at the moment, but less useful to predict SI over time.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kleiman and Nock (2018)

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    According to the Interpersonal Theory of Suicidal Behavior, high levels of perceived burdensomeness and thwarted belongingness can lead to suicidal ideation.

    “According to the IPTS, high levels of perceived burdensomeness and thwarted belongingness can lead to SI.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Joiner, 2007

      Not checked in the free run.

    • cites Van Orden et al., 2010 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    All risk factors within the network were connected with each other, none of them being isolated.

    “Additionally, all risk factors within the network were connected with each other, none of them being isolated.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites De Beurs et al., 2019 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Participants completed 89.7% of the EMA assessments on average (min = 75%, max = 100%), resulting in 4295 valid observations.

    “Participants completed 89.7% of the EMA assessments on average (min = 75%, max = 100%), resulting in 4295 valid observations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Time order is a necessary (but not sufficient) condition for causality.

    “This time order is a necessary (but not sufficient) condition for causality.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    Network analysis of EMA data extends previously used multilevel analysis by offering a visualization of the relation between all variables and an insight into both within and between-subjects effects.

    “Network analysis of EMA data extends our previously used multilevel analysis by offering a visualization of the relation between all variables and an insight into both the within and between-subjects effects.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    The connections within the networks should only be interpreted as indications of potential causal relationships and serve as hypothesis generating networks.

    “Finally, the connections within the networks should only be interpreted as indications of potential causal relationships, and serve as hypothesis generating networks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Literature on thwarted belongingness suggests that it influences suicidal ideation via perceived burdensomeness.

    “Literature on thwarted belongingness does indeed suggest that it influences SI via perceived burdensomeness (e.g., Rogers and Joiner, 2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rogers and Joiner, 2019

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Risk factors can be associated with, predictive of, or related to change in suicidal ideation.

    “As stated by Kleiman and Nock (2018), risk factors can be associated with, predictive of, or related to change in SI.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kleiman and Nock (2018)

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationown data

    Because the sample only consisted of patients with Major Depression, conclusions should be cautious for patients with any other diagnosis and suicidal ideation.

    “A limitation of this study is the sample only consisting of patients with a Major Depression. Hence, we should be cautious when concluding for patients with any other diagnosis and suicidal ideation.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationcitation

    The findings are in line with both EMA studies on suicidal ideation and more traditional epidemiological studies.

    “This is in line with both EMA studies on SI (Hallensleben et al., 2019; Kleiman et al., 2017) and more traditional epidemiological studies (e.g. Franklin et al., 2017).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Hallensleben et al., 2019 source

      Not checked in the free run.

    • cites Kleiman et al., 2017 source

      Not checked in the free run.

    • cites Franklin et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Other studies report perceived burdensomeness to be associated more directly with suicidal ideation compared to thwarted belongingness.

    “This is in line with other studies reporting perceived burdensomeness to be associated more directly with SI compared to thwarted belongingness (Hames et al., 2015; Ma et al., 2016).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Hames et al., 2015 source

      Not checked in the free run.

    • cites Ma et al., 2016

      Not checked in the free run.

29 of 29
  • The authors state this as an assumption.

    Participants with high levels of perceived burdensomeness, thwarted belongingness, hopelessness, and depressiveness on average would also show high levels of suicidal ideation.

    “Finally, we assumed that participants with high levels of perceived burdensomeness, thwarted belongingness, hopelessness, and depressiveness on average would also show high levels of SI.”
  • The paper relies on this without support.

    This is the first study in suicide research applying network analysis on EMA data to better understand the relation between suicidal ideation and several psychological risk factors.

    “To the best of our knowledge, this is the first study in suicide research applying network analysis on EMA data to better understand the relation between SI and several psychological risk factors.”
2 of 2

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Most reports failed to establish independent temporal predictors of suicidal ideation severity: of twelve articles fitting temporal prediction models, four failed to establish significant predictors after accounting for ideation at the previous time point, and five did not control for prior ideation.

    “Most reports failed to establish independent temporal predictors of suicidal ideation severity: of twelve articles fitting temporal prediction models (47, 51, 52, 55–57, 60, 73, 74, 76, 77), four failed to establish significant predictors after accounting for ideation at the previous time point (47, 52, 55), and five did not control for prior ideation (51, 60, 73, 74, 76).”
  • The most consistent evidence for other predictors was found for momentary negative affect, hopelessness and burdensomeness, which predicted increased momentary suicidal ideation within-day.

    “Regarding other predictors, the most consistent evidence was found for momentary negative affect, hopelessness and burdensomeness. These variables predicted increased momentary suicidal ideation within-day (47, 56, 57, 60).”
  • Digital phenotyping of suicidal ideators based on EMA data has so far been implemented by few.

    “but so far implemented by few (50, 57, 70).”
  • EMA data has revealed notable inter-individual differences in suicide symptom profiles.

    “EMA data has revealed notable inter-individual differences in suicide symptom profiles (57)”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Limitation says the sample consisted only of patients with major depression

    Minor

    The discussion characterizes the sample as consisting only of patients with major depression, but Table 1 lists five participants with dysthymia and 69 with major depression.

  • Reported EMA completion rate does not match valid observations

    Minor

    The 4295 valid observations out of 4440 possible assessments represent 96.7%, not the reported average completion rate of 89.7%.

    Reported 89.7 · recomputed 96.734234

  • Discussion reverses the direction of the positive-affect finding

    Minor

    The discussion says SI at time t led to less positive affect at the preceding assessment. The results instead report that SI predicted positive affect at a subsequent assessment.

3 of 3

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Rath, D., de Beurs, D., Hallensleben, N., Spangenberg, L., Glaesmer, H., & Forkmann, T.
Affiliations
  • University of Duisburg-Essen (DE)
  • Leipzig University (DE)
Corresponding author
Rath, Dajana
Venue
Internet Interventions
Publisher
Elsevier BV
Published
2019-12
Volume
18
Pages
100292
ISSN
2214-7829 (ISSN-L)
OpenAlex
W2991246777
Cited by
66
References
54
Citations by year
2026: 6 · 2025: 7 · 2024: 11 · 2023: 8 · 2022: 14 · 2021: 17 · 2020: 3
FWCI
10.02
Type
journal article
Language
en
Open access
Locations
  • Internet Interventions (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
Funders
German Research Foundation (SP 1556/1-1, GL 818/1-1, FO 784/1-1)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
  • Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
  • Social Sciences › Psychology › Social Psychology › Mental Health via Writing
Keywords
suicidal ideation, perceived burdensomeness, hopelessness, depression, dynamic networks, ecological momentary assessment, network analysis, suicide risk prediction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review