Assessing suicidality in real time: a psychometric evaluation of self-report items for the assessment of suicidal ideation and its proximal risk factors using ecological momentary assessments
Abstract
Suicidal ideation is a major risk factor for suicidal behavior and has recently been shown to be fluctuating in studies applying ecological momentary assessments (EMAs). The aims of this study are to introduce a reliable and valid item set for assessing suicidal ideation and relevant proximal risk factors that can be used in future EMA studies within suicidology. Additionally, we provide data on the ability of the items to capture moment-to-moment variability and discuss feasibility aspects of EMA studies on suicidal ideation in a clinical sample. Psychiatric inpatients diagnosed with a depressive disorder (N = 74) rated a set of 28 items measuring suicidal ideation, thwarted belongingness, perceived burdensomeness, depression, anxiety, hopelessness, and positive affect 10 times per day on 6 consecutive days. In addition, these constructs were assessed by self-report questionnaires before and after the EMA period. Intraclass correlations and mean squared successive differences were calculated as indicators of item variability. Reliability was calculated at the prompt (within-person) and the person (between-person) level, applying an approach based on multilevel factor analysis. Convergent validity was assessed by correlating the EMA scores with a self-report questionnaire measuring the same constructs. All items demonstrated moment-to-moment-variability and substantial within-person variance. Moreover, all items and scales, except those assessing anxiety, showed satisfying reliability at the prompt and the person level, and correlations indicated convergent validity of the EMA item set. Compliance with the EMAs was excellent (89.7%). Researchers are encouraged to apply this useful tool in future EMA studies in the field of suicidology. (PsycINFO Database Record (c) 2018 APA, all rights reserved).
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The most frequent primary co-morbid diagnoses in the reviewed studies were depressive disorders and borderline personality disorder, but inclusion was typically based on a recent history of self-reported suicidal thoughts and behaviors.
“Most frequent primary co-morbid diagnoses were depressive disorders (83, 84, 86) and borderline personality disorder [BPD (58, 64, 82)]; however, inclusion was typically based on (recent) history of self-reported STBs to ensure sufficient number of observations of STBs during the assessment period.”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [84]
Response rates were higher in the afternoons and on weekend days.
“Response rates were higher in the afternoons (83) and on weekend days (84).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [84]
Compliance rates declined over time, indicating participant fatigue effects.
“Compliance rates declined over time (i.e., participants exhibited fatigue effects) (80, 84, 85).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [84]
In general, participants reported their experiences overall as neutral-to-positive but time consuming or burdensome, and that they would be open to participating in similar research in the future.
“In general, participants reported their experiences overall as neutral-to-positive but time consuming (or burdensome), and that they would be open to participating in similar research in the future (80, 84, 85).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [84]
Ten reviewed studies reported whether any suicide attempts occurred during the study period; in four studies no such events occurred.
“Ten studies reported whether any suicide attempts occurred during the study period: in four studies no such events occurred (45, 47, 84).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [84]
Following a 6-day EMA assessment with 10 prompts per day, 16% of a sample of depressed inpatients reported that they had felt stressed and/or burdened by the assessments.
“Following a 6-day EMA assessment with 10 prompts per day, 16% of a sample of depressed inpatients reported that they had felt stressed and/or burdened by the assessments (84)”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [84]
Cited by
Sorted by citations
Eisele, G., Vachon, H., Lafit, G., Kuppens, P., Houben, M., Myin-Germeys, I., & Viechtbauer, W. (2022) · Assessment · doi:10.1177/1073191120957102 · Cited by 459 · see citing works
“This hypothesis was based on previous research where declines in compliance over time have been repeatedly observed (e.g., Courvoisier et al., 2012; Forkmann et al., 2018; Rintala et al., 2018; Silvia et al., 2013).”
MethodResultHallensleben (2019) · doi:10.1016/j.eurpsy.2018.11.003 · Cited by 210 · see citing works
“In order to extend current evidence and examine the assumptions of the ITPS more stringently [16,20], we 1) applied a high-frequency sampling scheme (10 signals per day within a time frame of 12 hours), 2) assessed all variables of interest with two items (ensuring reliable assessment) [25], 3) distinguished between p…”
BackgroundMethodResultInfluentialSelf-citationDon't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research
Kivelä, L., van der Does, W. A. J., Riese, H., & Antypa, N. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.876595 · Cited by 163 · see citing works
Use of Ecological Momentary Assessment to Study Suicidal Thoughts and Behavior: a Systematic Review
Sedano-Capdevila, A., Porras-Segovia, A., Bello, H. J., Baca-García, E., & Barrigon, M. L. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-021-01255-7 · Cited by 148 · see citing works
Detecting suicidal thoughts: The power of ecological momentary assessment
Gratch, I., Choo, T., Galfalvy, H., Keilp, J. G., Itzhaky, L., Mann, J. J., Oquendo, M. A., & Stanley, B. (2021) · Depression and Anxiety · doi:10.1002/da.23043 · Cited by 120 · see citing works
“It has been suggested that similar items of the SSI, such as the “wish to die” item, be reformulated as “wish to die by suicide” to capture more active ideation through EMA (Forkmann et al., 2018).”
BackgroundResultA network perspective on suicidal behavior: understanding suicidality as a complex system
de Beurs, D., Bockting, C., Kerkhof, A., Scheepers, F., O’Connor, R., Penninx, B., & van de Leemput, I. (2021) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12676 · Cited by 119 · see citing works
“All variables demonstrated moment-to-moment variability, and substantial within person variance (Forkmann et al., 2018).”
BackgroundGlenn, C. R., Kleiman, E. M., Kearns, J. C., Santee, A. C., Esposito, E. C., Conwell, Y., & Alpert-Gillis, L. J. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2020.1741377 · Cited by 104 · see citing works
Porras-Segovia, A., Molina-Madueño, R. M., Berrouiguet, S., López-Castroman, J., Barrigón, M. L., Pérez-Rodríguez, M. S., Marco, J. H., Díaz-Oliván, I., de León, S., Courtet, P., et al. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.067 · Cited by 85 · see citing works
Kuehn, K. S., Dora, J., Harned, M. S., Foster, K. T., Song, F., Smith, M. R., & King, K. M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01340-8 · Cited by 90 · see citing works
Entrapment and suicide risk: The development of the 4-item Entrapment Scale Short-Form (E-SF)
De Beurs, D., Cleare, S., Wetherall, K., Eschle-Byrne, S., Ferguson, E., B O'Connor, D., & C O'Connor, R. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.112765 · Cited by 77 · see citing works
Using intensive time sampling methods to capture daily suicidal ideation: A systematic review
Ammerman, B. A., & Law, K. C. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.10.121 · Cited by 74 · see citing works
Eisele, G. V., Vachon, H., Lafit, G., Kuppens, P., Houben, M., Myin‐Germeys, I., & Viechtbauer, W. (2020) · doi:10.31234/osf.io/zf4nm · Cited by 60 · see citing works
Rath, D., de Beurs, D., Hallensleben, N., Spangenberg, L., Glaesmer, H., & Forkmann, T. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100292 · Cited by 66 · see citing works
Self-citationHadzic, A., Spangenberg, L., Hallensleben, N., Forkmann, T., Rath, D., Strauß, M., Kersting, A., & Glaesmer, H. (2020) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2019.152158 · Cited by 64 · see citing works
Self-citationEisele, G. V., Vachon, H., Lafit, G., Tuyaerts, D., Houben, M., Kuppens, P., Myin‐Germeys, I., & Viechtbauer, W. (2022) · Psychological Assessment · doi:10.1037/pas0001177 · Cited by 64 · see citing works
Spears, A. P., Gratch, I., Nam, R. J., Goger, P., & Christine, B. W. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2022.2145567 · Cited by 57 · see citing works
“To our knowledge, only one study to date (Forkmann et al., 2018) has offered a comprehensive look into the psychometric properties of a suicide assessment created explicitly for EMA.”
BackgroundThe use of advanced technology and statistical methods to predict and prevent suicide
Kleiman, E. M., Glenn, C. R., & Liu, R. T. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00175-y · Cited by 63 · see citing works
“For example, there is only limited validation of EMA assessments of suicidal thinking 54 .”
BackgroundDefeat, entrapment, and suicidal ideation: Twelve‐month trajectories
Höller, I., Rath, D., Teismann, T., Glaesmer, H., Lucht, L., Paashaus, L., Schönfelder, A., Juckel, G., & Forkmann, T. (2021) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12777 · Cited by 49 · see citing works
“…to other risk factors such as thwarted | 11HÖLLER Et aL. belongingness, perceived burdensomeness, capability for suicide, interoception, and suicidal ideation itself (Forkmann et al., 2018; Höller et al., 2021; Hallensleben et al., 2019; Kleiman et al., 2017; Spangenberg et al., 2015, 2019).”
BackgroundResultInfluentialSelf-citationFirst-onset and persistence of suicidal ideation in university students: A one-year follow-up study
Blasco, M. J., Vilagut, G., Alayo, I., Almenara, J., Cebrià, A. I., Echeburúa, E., Gabilondo, A., Gili, M., Lagares, C., Piqueras, J. A., et al. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.05.035 · Cited by 48 · see citing works
“However, it should be noted that including information about issues taking place close to the outcome is very relevant (Forkmann et al., 2018; Mościcki, 1997).”
BackgroundResearch on the pathophysiology, treatment, and prevention of suicide: practical and ethical issues
Nugent, A. C., Ballard, E. D., Park, L. T., & Zarate, C. A. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2301-6 · Cited by 45 · see citing works
“That is, regardless of whether subjects were suicidal or not at screening, suicidal ideation tends to fluctuate with time [85].”
BackgroundStenzel, J.-S., Höller, I., Rath, D., Hallensleben, N., Spangenberg, L., Glaesmer, H., & Forkmann, T. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17134685 · Cited by 43 · see citing works
“The item set proved to be feasible in previous studies and showed high reliability as well as convergent validity [25].”
BackgroundSelf-citationBrüdern, J., Hallensleben, N., Höller, I., Spangenberg, L., Forkmann, T., Rath, D., Strauß, M., Kersting, A., & Glaesmer, H. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-03716-6 · Cited by 44 · see citing works
“All items have shown very good reliability on person and prompt level [14].”
BackgroundMethodInfluentialSelf-citationSchönfelder, A., Hallensleben, N., Spangenberg, L., Forkmann, T., Rath, D., & Glaesmer, H. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.11.063 · Cited by 41 · see citing works
Self-citationRabasco, A., & Sheehan, K. G. (2021) · Archives of Suicide Research · doi:10.1080/13811118.2021.1903635 · Cited by 41 · see citing works
“Study Citation 1 Czyz et al., 2018; Czyz, Glenn, et al., 2019; Czyz, Horwitz, et al., 2019 2 Forkmann et al., 2018; Hadzic et al., 2020; Hallensleben et al., 2018; Hallensleben et al., 2019; Spangenberg et al., 2019 3 Husky et al., 2014, 2017 4 Kleiman et al., 2017 (Study 1); Kleiman, Coppersmith,…”
BackgroundParrish, E. M., Chalker, S. A., Cano, M., Moore, R. C., Pinkham, A. E., Harvey, P. D., Joiner, T. E., Lieberman, A. J., Granholm, E. L., & Depp, C. A. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.06.022 · Cited by 40 · see citing works
“The Interpersonal Needs Questionnaire (INQ-15).”
BackgroundResultInfluentialSIMON: A Digital Protocol to Monitor and Predict Suicidal Ideation
Sels, L., Homan, S., Ries, A., Santhanam, P., Scheerer, H., Colla, M., Vetter, S., Seifritz, E., Galatzer‐Levy, I. R., Kowatsch, T., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.554811 · Cited by 32 · see citing works
Murray, A. L., Xiao, Z., Zhu, X., Speyer, L. G., Yang, Y., Brown, R., Katus, L., Eisner, M., & Ribeaud, D. (2023) · Stress and Health · doi:10.1002/smi.3229 · Cited by 36 · see citing works
“Besides this, Forkmann et al. (2018) evaluated the psychometric properties of an item set for the assessment of suicidal ideation (i.e., passive and active suicidal ideation) and relevant proximal risk factors (e.g., anxiety, depression).”
Peters, E. M., Dong, L. Y., Thomas, T., Khalaj, S., Balbuena, L., Baetz, M., Osgood, N., & Bowen, R. (2022) · Archives of Suicide Research · doi:10.1080/13811118.2020.1783410 · Cited by 34 · see citing works
Sander, L., Beisemann, M., Doebler, P., Micklitz, H. M., Kerkhof, A. J. F. M., Cuijpers, P. J., Batterham, P. J., Calear, A. L., Christensen, H. M., Jaegere, E. D., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/46771 · Cited by 34 · see citing works
“Ecological momentary assessment and mobile-sensing studies may be a fruitful next step in this regard to identify interacting variables of individual networks with higher temporal resolution and allow for the examination of between-subject and within-subject differences [69,70].”
Höller, I., Stenzel, J.-S., Rath, D., & Forkmann, T. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18094893 · Cited by 27 · see citing works
“, suicidal ideation or negative affect [42]), the assessment of interoceptive accuracy and awareness is more challenging, since it requires the collection of both self-reported information and the number of heartbeats in given time-frames.”
BackgroundResultSelf-citationGerner, J. L., Moscardini, E. H., Mitchell, S. M., Hill, R. M., & Tucker, R. P. (2023) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12991 · Cited by 27 · see citing works
Kivelä, L. M. M., Fiß, F., van der Does, W. A. J., & Antypa, N. (2023) · Assessment · doi:10.1177/10731911231216053 · Cited by 25 · see citing works
Søholm, U., Broadley, M. M., Zaremba, N., Divilly, P., Nefs, G., MAHMOUDI, Z., de Galan, B. E., Pedersen‐Bjergaard, U., Brennan, A., Pollard, D. J., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-051651 · Cited by 25 · see citing works
Janssens, J. J., Kiekens, G., Jaeken, M., & Kirtley, O. J. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102467 · Cited by 26 · see citing works
Ernst, M., Gemke, T. J., Olivi, L. J., & O’Connor, R. C. (2024) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.13120 · Cited by 22 · see citing works
“However, the proportion of individuals with suicide attempts was comparable to previous investigations in German inpatient units (Forkmann et al., 2018).”
InfluentialLuk, J. W., Pruitt, L. D., Smolenski, D. J., Tucker, J., Workman, D. E., & Belsher, B. E. (2021) · Journal of Clinical Psychology · doi:10.1002/jclp.23202 · Cited by 21 · see citing works
Factor Structure and Validation of the Revised Suicide Crisis Inventory in a Korean Population
Park, J. Y., Rogers, M. L., Bloch‐Elkouby, S., Richards, J. A., Lee, S., GALYNKER, I. I., & You, S. (2023) · Psychiatry Investigation · doi:10.30773/pi.2022.0208 · Cited by 22 · see citing works
Al‐Dajani, N., & Czyz, E. K. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2022.2051525 · Cited by 19 · see citing works
“Previous EMA and daily diary studies have found that TB and PB fluctuate significantly across short intervals of time (Czyz et al., 2019; Forkmann et al., 2018; Hallensleben et al., 2019; Kleiman et al., 2017), thus providing support for their dynamic nature as hypothesized by the theory.”
Thoth: An intelligent model for assisting individuals with suicidal ideation
Heckler, W. F., Feijó, L. P., de Carvalho, J. V., & Barbosa, J. L. V. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120918 · Cited by 19 · see citing works
The impact of social connection on near-term suicidal ideation.
Ammerman, B. A., & Jacobucci, R. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115338 · Cited by 15 · see citing works
Lucht, L., Spangenberg, L., Forkmann, T., Hallensleben, N., Rath, D., Strauß, M., & Glaesmer, H. (2022) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2741 · Cited by 18 · see citing works
Self-citationJiang, A., Al‐Dajani, N., King, C. A., Hong, V., Koo, H. J., & Czyz, E. K. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115347 · Cited by 18 · see citing works
Rath, D., Teismann, T., Höller, I., Glaesmer, H., Paashaus, L., Schönfelder, A., Juckel, G., & Forkmann, T. (2021) · Journal of Clinical Psychology · doi:10.1002/jclp.23159 · Cited by 17 · see citing works
Self-citationWolford‐Clevenger, C., Flores, L. Y., & Stuart, G. L. (2021) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12790 · Cited by 16 · see citing works
Spangenberg, L., Friedrich, M., Forkmann, T., Hallensleben, N., Schönfelder, A., Rath, D., Paashaus, L., Teismann, T., & Glaesmer, H. (2022) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1940 · Cited by 14 · see citing works
Self-citationGangel, M. J., Kemmerly, R., Wilson, L., Glickson, S., Frazier, P. A., Tennen, H. A., & Jayawickreme, E. (2023) · Clinical Psychological Science · doi:10.1177/21677026231182329 · Cited by 17 · see citing works
“These ω s were calculated following the procedure described by Viechtbauer (2017; see also Forkmann et al., 2018).”
MethodJacobucci, R., Ammerman, B. A., & McClure, K. E. (2024) · Journal of Clinical Psychology · doi:10.1002/jclp.23728 · Cited by 18 · see citing works
Complex PTSD symptoms predict positive symptoms of psychosis in the flow of daily life
Panayi, P., PETERS, E. R., Bentall, R. P., Hardy, A., Berry, K., Sellwood, W., Dudley, R. E. J., Longden, E., Underwood, R., Steel, C., et al. (2024) · Psychological Medicine · doi:10.1017/s0033291724001934 · Cited by 15 · see citing works
“…(mCFA) was conducted to verify the factor structure of multi-item ESM constructs whilst accounting for the hierarchical structure of the data (Forkmann et al., 2018 Multilevel regressions were used to test whether cross-sectional scores on validated questionnaires at baseline predicted ESM…”
MethodUpegui-Arango, L. D., Forkmann, T., Nielsen, T., Hallensleben, N., Glaesmer, H., Spangenberg, L., Teismann, T., Juckel, G., & Boecker, M. (2020) · PLoS ONE · doi:10.1371/journal.pone.0232030 · Cited by 15 · see citing works
Self-citationAdams, L. B., Igbinedion, G., DeVinney, A., Azasu, E., Nestadt, P. S., Thrul, J., & Joe, S. (2021) · JMIR Research Protocols · doi:10.2196/31241 · Cited by 13 · see citing works
“Based on previous EMA feasibility studies, our goal was for the duration and length of our EMA survey to last 2-3 minutes, with 20 or fewer items [17,39].”
MethodDaily impulsivity: Associations with suicidal ideation in unipolar depressive psychiatric inpatients
Lucht, L., Hallensleben, N., Nina, W., Forkmann, T., Rath, D., Glaesmer, H., & Spangenberg, L. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114357 · Cited by 13 · see citing works
Self-citationSøholm, U., Broadley, M. M., Zaremba, N., Divilly, P., Nefs, G., Carlton, J., Mader, J. K., Baumann, P. M., Gomes, M., Martine‐Edith, G., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0283148 · Cited by 13 · see citing works
“Internal consistency is highly dependent on number of questions in the scale [15], and similar within-person ω-values for two-question scales have been reported in other EMA studies and found acceptable [41,42].”
ResultSelf-citationWilliams, A. J., Arcelus, J., Townsend, E., & Michail, M. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.916164 · Cited by 12 · see citing works
Núñez, D. E., Villacura-Herrera, C., Gaete, J., Meza, D., Andaur, J., & Robinson, J. (2023) · Current Psychology · doi:10.1007/s12144-023-05422-2 · Cited by 11 · see citing works
“…literature highlights its prominent role as predictor of subsequent suicidal behavior (Berman, 2017), its heterogeneous and fluctuating nature (Forkmann et al., 2018; Kleiman et al., 2017), and the current uncertainty about how to interpret, assess and treat it in different settings (Harmer…”
Smartphone-based text obtained via passive sensing as it relates to direct suicide risk assessment
Ammerman, B. A., Kleiman, E. M., O’Brien, C., Knorr, A. C., Bell, K., Ram, N., Robinson, T. N., Reeves, B., & Jacobucci, R. (2025) · Psychological Medicine · doi:10.1017/s0033291725001199 · Cited by 11 · see citing works
“…assessed momentary (i.e., ‘ At this moment …’ ) passive SI (i.e., ‘ Life is not worth living for me ’ ; ‘ There are more reasons to die than to live for me ’ ) and active SI (i.e., ‘ I think about taking my life ’ ; ‘ I want to die ’ ), which have been previously validated (Forkmann et al., 2018).”
Janssen, W. C., van Raak, J., van der Lucht, Y., van Ballegooijen, W., & Mérelle, S. Y. M. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.871841 · Cited by 10 · see citing works
“(37) also found that several EMA items, including some of the items used in this study, correlated with longer, validated scales measuring the same constructs.”
ResultAdams, L. B., Watts, T., DeVinney, A., Haroz, E. E., Thrul, J., Brooks, J. R., Campbell, M. N., Antoine, D. G., Cook, B. L., Joe, S., et al. (2024) · JMIR Formative Research · doi:10.2196/48992 · Cited by 13 · see citing works
“Although participant burden, noncompliance, and reactivity to the protocol measures have been cited as potential limitations to EMA approaches, studies using this methodology to assess STB demonstrate a favorable median response rate of 70%, suggesting feasibility [25,27-30].”
BackgroundMethodResultInfluentialUnderstanding Patterns of Adolescent Suicide Ideation: Implications for Risk Assessment
Miranda, R., Ortin‐Peralta, A., Rosario‐Williams, B., Kelly, T. F., Macrynikola, N., & Sullivan, S. R. (2021) · Springer eBooks · doi:10.1007/978-3-030-82465-5_9 · Cited by 13 · see citing works
Bayliss, L. T., Hughes, C. D., Lamont‐Mills, A., & du Plessis, C. (2023) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.13025 · Cited by 11 · see citing works
Jacobucci, R., Ammerman, B. A., & Ram, N. (2024) · JMIR Formative Research · doi:10.2196/55999 · Cited by 11 · see citing works
“Multimedia Appendix 1 [27,28] shows details for EMA questions to access risk factors.”
BackgroundChoo, T.-H. J., Wall, M. M., Brodsky, B. S., Herzog, S., Mann, J. J., Stanley, B., & Galfalvy, H. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.05.093 · Cited by 10 · see citing works
Mandel, A. A., Revzina, O., Hunt, S., & Rogers, M. L. (2024) · Behaviour Research and Therapy · doi:10.1016/j.brat.2024.104602 · Cited by 11 · see citing works
Chen, T., Niu, L., Zhu, J., Hou, X., Tao, H., Ma, Y., Silenzio, V., Lin, K., & Zhou, L. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1358604 · Cited by 11 · see citing works
Technology-Based Ecological Momentary Assessment in Clinical Psychology
Colombo, D., Suso‐Ribera, C., Fernández‐Álvarez, J., Cipresso, P., García‐Palacios, A., Riva, G., & Botella, C. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00003-0 · Cited by 9 · see citing works
Love, H. A., Morgan, P. C., & Smith, P. N. (2024) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.13125 · Cited by 8 · see citing works
Measuring Psychopathology in Daily Life
Wright, A. G. C., Ringwald, W. R., & Zimmermann, J. (2025) · Clinical Psychological Science · doi:10.1177/21677026241291549 · Cited by 19 · see citing works
“For instance, intensive longitudinal measures have been designed and tested for impulsivity (Tomko et al., 2014), narcissism (Edershile et al., 2019), interpersonal behavior (Woods et al., 2023), hostility (Murray et al., 2022), and suicide (Forkmann et al., 2018).”
Renault, H., Freeman, C. R., Banica, I., Sandre, A., Ethridge, P., Park, J., & Weinberg, A. (2023) · Psychophysiology · doi:10.1111/psyp.14376 · Cited by 9 · see citing works
Hallensleben, N., Glaesmer, H., Forkmann, T., Rath, D., Strauß, M., Kersting, A., & Spangenberg, L. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17134873 · Cited by 9 · see citing works
“Thus, the average compliance with EMA assessments was about 90%, with a minimum of 75% and a maximum of 100%, as has already been reported [28].”
BackgroundMethodSelf-citationPerceived responsiveness in suicidal ideation: An experience sampling study in psychiatric patients
Sels, L., Homan, S., Reis, H. T., Horn, A. B., Revol, J., Scholz, U., Kowatsch, T., & Kleim, B. (2024) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.13095 · Cited by 8 · see citing works
Landrum, K. R., Akiba, C. F., Pence, B. W., Akello, H., Chikalimba, H., Dussault, J. M., Hosseinipour, M. C., Kanzoole, K., Kulisewa, K., Malava, J., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281711 · Cited by 7 · see citing works
Ball, M. I., Fishbein, N. S., Ramlal, N., Hu, N., Maimone, J. S., Bear, A., Kleiman, E. M., Stein, M. B., Nock, M. K., & Bentley, K. H. (2025) · Behavior Therapy · doi:10.1016/j.beth.2025.05.007 · Cited by 8 · see citing works
“Previous research has used and validated the same or similar items for use in EMA studies (e.g., Coppersmith et al., 2024; Forkmann et al., 2018; Kleiman et al., 2017).”
Spangenberg, L., Glaesmer, H., Hallensleben, N., Schönfelder, A., Rath, D., Forkmann, T., & Teismann, T. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.02.047 · Cited by 7 · see citing works
Self-citationEcological Momentary Assessment
Rabasco, A., & Andover, M. S. (2021) · Comprehensive Clinical Psychology · doi:10.1016/b978-0-12-818697-8.00189-8 · Cited by 8 · see citing works
A test of invariance of the construct of suicidal ideation across three diverse samples
Mandel, A. A., Kleiman, E. M., Johnson, S. L., Rogers, M. L., Jobes, D. A., & Joiner, T. E. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.02.055 · Cited by 8 · see citing works
Kraiss, J. T., Glaesmer, H., Forkmann, T., Spangenberg, L., Hallensleben, N., Schreiber, D., & Höller, I. (2024) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2024.07.050 · Cited by 6 · see citing works
Self-citationA FAIR intensive longitudinal data archive on prolonged grief in daily life
Pociūnaitė-Ott, J., & Lenferink, L. I. M. (2025) · European Journal of Psychotraumatology · doi:10.1080/20008066.2025.2526885 · Cited by 6 · see citing works
“First, quality of sleep that was rated in the first assessment of the day with the question ‘I slept well last night’ derived from Forkmann et al. (2018).”
Veilleux, J. C., Clift, J. B., Brott, K. H., Warner, E. A., Schreiber, R. E., Henderson, H. M., & Shelton, D. (2024) · Cognition & Emotion · doi:10.1080/02699931.2024.2305400 · Cited by 9 · see citing works
“…location, activity, whether alone or with others, degree of hunger and tiredness) associated with momentary self-criticism, a practice in line with other studies evaluating state versions of attributes more commonly measured as individual di ff erences (Forkmann et al., 2018; Veilleux et al., 2018).”
ResultMurray, A. L., Xiao, Z., Zhu, X., Speyer, L. G., Yang, Y., Brown, R., Katus, L., Eisner, M., & Ribeaud, D. (2022) · doi:10.31234/osf.io/d9pc7 · Cited by 6 · see citing works
Wastler, H. M., Manges, M. E., Thompson, E., & Bornheimer, L. A. (2025) · Early Intervention in Psychiatry · doi:10.1111/eip.13640 · Cited by 6 · see citing works
“Four previously validated items were used to assess suicidal ideation during EMA (Forkmann et al. 2018): how much have you… felt that life is not worth living, felt that there are more reasons to die than live, wanted to die and thought about taking your life.”
Wastler, H. M., Cowan, H. R., Breitborde, N. J. K., Tabares, J. V., Yu, M., Pan, X. J., Boettner, B. L., Browning, C. R., & Bryan, C. J. (2025) · Schizophrenia Bulletin · doi:10.1093/schbul/sbaf042 · Cited by 5 · see citing works
Blacutt, M. E., Jacobucci, R., & Ammerman, B. A. (2025) · Journal of Psychopathology and Clinical Science · doi:10.1037/abn0001048 · Cited by 5 · see citing works
Passive vs Active Nighttime Smartphone Use as Markers of Next-Day Suicide Risk
Jacobucci, R., Jones, S. G., Blacutt, M. E., & Ammerman, B. A. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.42675 · Cited by 5 · see citing works
Mackenhauer, J., Winsløv, J.-H., Holmskov, J., Brødsgaard, I., Larsen, T. G., & Mainz, J. (2021) · Crisis · doi:10.1027/0227-5910/a000787 · Cited by 6 · see citing works
Liu, R. T., Bettis, A. H., Lawrence, H. R., Walsh, R. F. L., Sheehan, A. E., Pollak, O. H., Stephenson, A. R., Kautz, M. M., & Marlowe, R. (2024) · Assessment (Odessa, Fla.) · doi:10.1177/10731911241249438 · Cited by 4 · see citing works
“The one identified study that reported on the psycho-metrics of an EMA measure of STBs (Forkmann et al., 2018) was with an adult sample and thus ineligible for inclusion in the current review.”
Exploring Predictors of Passive Versus Active Suicidal Ideation
Spangenberg, L., Glaesmer, H., Hallensleben, N., Schreiber, D., Forkmann, T., & Kaurin, A. (2025) · Crisis · doi:10.1027/0227-5910/a000999 · Cited by 5 · see citing works
“…happy]) was supported by multilevel confirmatory factor analysis and the measures demonstrated good to excellent reliability on the person-level ( v s > 0.80s) and satisfying reliability on the prompt-level ( v s > 0.70s with the exception of anxiety with v = 0.58; see Forkmann et al., 2018).”
InfluentialSelf-citationByrne, M. E., Bernstein, R. A., Pine, D. S., & Kircanski, K. (2023) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2023.0025 · Cited by 5 · see citing works
“Following previous work (Forkmann et al., 2018; Geldhof et al., 2014; Sideridis et al., 2018), psychometric properties of EMA items were examined at both the between-and within-person levels in the current study.”
InfluentialEisele, G. V., Vachon, H., Lafit, G., et al. (2021) · doi:10.31234/osf.io/k8me6 · Cited by 5 · see citing works
“Also, previously reported decreases in compliance over time in the same data set (Eisele et al., 2020) and other ESM data (Forkmann et al., 2018; Ono et al., 2019; Rintala et al., 2018; Silvia et al., 2013) are consistent with a fatigue effect.”
ResultVidal, I. N. S., Nieto, M., Ricarte, J. J., Alcantud, M. D. V., Hallford, D. J., & Ros, L. (2024) · PeerJ · doi:10.7717/peerj.18673 · Cited by 5 · see citing works
Hendley, T., Gerner, J. L., Bolner, J., Moscardini, E. H., Tucker, R. P., & Hill, R. M. (2025) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-025-10214-y · Cited by 5 · see citing works
“…flaws regarding measuring suicide attempts (Hom et al., 2016), but seem more promising with regards to measuring suicidal ideation and risk factors (Forkmann et al., 2018), however, more research is needed to examine how different item language impacts par - ticipant responses and whether those…”
Clark, K. A., Phillips, K. F. V., Park, E., Argiros, A. P., Nikolaidis-Konstas, A., Sexton, J., Cyperski, M. A., Kleiman, E. M., & Pachankis, J. E. (2025) · PLoS ONE · doi:10.1371/journal.pone.0330204 · Cited by 7 · see citing works
“…to select items that were previously found to be valid and reliable in EMA studies assessing suicidal ideation and related psychosocial constructs [76], our momentary assessments of distal and proximal minority stressors were adapted from scales that have not been previously evaluated in EMA…”
Spangenberg, L., Böhler, L., Hoke, T.-M., Serebriakova, J., Eimen, J., Forkmann, T., Strauß, M., Stengler, K., & Glaesmer, H. (2025) · Digital Health · doi:10.1177/20552076251339265 · Cited by 8 · see citing works
Self-citationKim, H., Kwon, S., Park, S., Kang, C., & Kim, H. (2025) · BMC Nursing · doi:10.1186/s12912-025-03432-y · Cited by 4 · see citing works
To delay or not to delay: procrastination and suicide prevention
Baston, R. (2024) · Philosophical Psychology · doi:10.1080/09515089.2024.2360129 · Cited by 4 · see citing works
“Desires are transient, and psychological data indicates that the intensity of the desire for death can fluctuate significantly over time (Forkmann et al., 2018; Kleiman et al., 2018).”
Hofmann, V. E., Glombiewski, J. A., Kininger, F., & Scholten, S. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-089319 · Cited by 5 · see citing works
“79 Participants receive € 50 for their general participation and additional € 50 for each EMA phase in which they complete at least 80% of the questionnaires, resulting in a maximum financial incentive of € 150.”
Forkmann, T., Eimen, J., Plein, L., Höller, I., Böhler, L., Schönfelder, A., Hallensleben, N., Schreiber, D. S., Paashaus, L., Juckel, G., et al. (2024) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2024.100822 · Cited by 4 · see citing works
Self-citationVeilleux, J. C., Clift, J. B., Brott, K. H., Warner, E. A., Schreiber, R. E., Henderson, H., & Shelton, D. (2023) · doi:10.31234/osf.io/2dcvf · Cited by 4 · see citing works
MacNeil, S., Renaud, J., & Gouin, J. (2024) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2024.43.5.492 · Cited by 3 · see citing works
Shin, K. E., Gratch, I., & Christine, B. W. (2025) · JCPP Advances · doi:10.1002/jcv2.70063 · Cited by 3 · see citing works
“Most of these studies found that patients were more likely to report experiencing suicidal ideation (SI) in real - time via EMA than retrospectively at the end of the assessment period (e.g., Czyz et al., 2018; Forkmann et al., 2018; Gratch, Choo, et al., 2021).”
InfluentialHarris, L. M., Lusich, R., Wu, K., Stancil, J., Moussaoui, J. R., Cash, E. D., Levinson, C. A., & Smith, A. R. (2026) · Behavior Therapy · doi:10.1016/j.beth.2026.01.001 · Cited by 3 · see citing works
Lühr, M., Großmann, T., Bayer, N., Bückle, S., Fegert, J. M., Happich, F., Müller, S., Rassenhofer, M., Reininghaus, U., Schockenhoff, T., et al. (2026) · Psychiatry Research · doi:10.1016/j.psychres.2026.117051 · Cited by 3 · see citing works
- Authors
- Forkmann, T., Spangenberg, L., Rath, D., Hallensleben, N., Hegerl, U., Kersting, A., & Glaesmer, H.
- Affiliations
- University of Duisburg-Essen (DE)
- Leipzig University (DE)
- Universitätsklinikum Aachen (DE)
- ORCID
- Venue
- Journal of Abnormal Psychology
- Published
- 2018-11
- Volume
- 127
- Issue
- 8
- Pages
- 758-769
- ISSN
- 0021-843X (ISSN-L)
- 1939-1846
- OpenAlex
- W2896910592
- Cited by
- 165
- References
- 0
- Citations by year
- 2026: 24 · 2025: 35 · 2024: 26 · 2023: 23 · 2022: 14 · 2021: 19 · 2020: 15 · 2019: 6 · 2018: 2
- FWCI
- 12.36
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Abnormal Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Keywords
- suicidal ideation, ecological momentary assessment, suicidal behavior, proximal risk factors, thwarted belongingness, perceived burdensomeness, hopelessness, positive affect, anxiety, depression, convergent validity, psychiatric inpatients, depressive disorders
- MeSH terms
- Ecological Momentary Assessment, Suicide Prevention, Adolescent, Adult, Aged, Aged, 80 and over, Female, Humans, Male, Middle Aged, Psychometrics, Risk Factors, Reproducibility of Results, Young Adult, Self Report, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
