Examination of real-time fluctuations in suicidal ideation and its risk factors: Results from two ecological momentary assessment studies
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Two studies examined 2 important but previously unanswered questions about the experience of suicidal ideation: (a) How does suicidal ideation vary over short periods of time?, and (b) To what degree do risk factors for suicidal ideation vary over short periods and are such changes associated with changes in suicidal ideation? Participants in Study 1 were 54 adults who had attempted suicide in the previous year and completed 28 days of ecological momentary assessment (EMA; average of 2.51 assessments per day; 2,891 unique assessments). Participants in Study 2 were 36 adult psychiatric inpatients admitted for suicide risk who completed EMA throughout their time in the hospital (average stay of 10.32 days; average 2.48 assessments per day; 649 unique assessments). These studies revealed 2 key findings: (a) For nearly all participants, suicidal ideation varied dramatically over the course of most days: more than 1-quarter (Study 1 = 29%; Study 2 = 28%) of all ratings of suicidal ideation were a standard deviation above or below the previous response from a few hours earlier and nearly all (Study 1 = 94.1%; Study 2 = 100%) participants had at least 1 instance of intensity of suicidal ideation changing by a standard deviation or more from 1 response to the next. (b) Across both studies, well-known risk factors for suicidal ideation such as hopelessness, burdensomeness, and loneliness also varied considerably over just a few hours and correlated with suicidal ideation, but were limited in predicting short-term change in suicidal ideation. These studies represent the most fine-grained examination of suicidal ideation ever conducted. The results advance the understanding of how suicidal ideation changes over short periods and provide a novel method of improving the short-term prediction of suicidal ideation. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, studies showing considerable fluctuations in suicidal thoughts throughout the day (2, 40–42) suggest that the relative importance of reasons to die and reasons to live might also be subject to rapid changes.”
From Ambivalence model of suicidality [ABS-model]: an orientation model for the treatment of suicidal individuals (2024) · cites this paper as [42]
In the citing paper
“Hallensleben and colleagues (2) could demonstrate that if measured 10 times a day across seven days, 36% of the variance in active suicidal ideation is accounted for by within-person-variability (see also e.g., 41, 42).”
From Ambivalence model of suicidality [ABS-model]: an orientation model for the treatment of suicidal individuals (2024) · cites this paper as [42]
In the citing paper
“The recursive character of suicide ideation has been shown in other studies (Hallensleben et al., 2018; Kleiman et al., 2017).”
From Exploring the psychology of suicidal ideation: a theory driven network analysis. (2019) · cites this paper as Kleiman et al., 2017
In the citing paper
“Personality tends to be more stable over time, whereas we know from mobile phone studies that suicide ideation fl uctuates heavily over time (Hallensleben et al., 2018; Kleiman et al., 2017).”
From Exploring the psychology of suicidal ideation: a theory driven network analysis. (2019) · cites this paper as Kleiman et al., 2017
In the citing paper
“In one EMA study of adults with recent suicidal behaviors, suicide risk factors such as hopelessness, burdensomeness, and loneliness were found to vary significantly throughout the day; however, these risk factors did not predict changes in SI within a time span of 4 to 8 h (33).”
From New methods for assessing rapid changes in suicide risk (2021) · cites this paper as [33]
32 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
The interpersonal theory of suicide.
Van Orden, K. A., Witte, T. K., Cukrowicz, K. C., Braithwaite, S. R., Selby, E. A., & Joiner, T. E. (2010) · Psychological Review · doi:10.1037/a0018697 · Cited by 5,292
Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., Musacchio, K. M., Jaroszewski, A. C., Chang, B. P., & Nock, M. K. (2017) · Psychological Bulletin · doi:10.1037/bul0000084 · Cited by 3,784 · cited 2×
“As noted in a recent meta-analysis on the prediction of suicidal outcomes (Franklin et al., 2017), less than 1% of suicide risk factor research is focused on time frames of a week or less, the period most important to clinicians tasked with making decisions about the short-term risk of their…”
BackgroundSelf-citationA manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397 · cited 1×
“This highlights the need to not just increase reproducibility of psychological science but to also actually engage in replication attempts (Ebersole, Axt, & Nosek, 2016; Munafò et al., 2017; Nosek, Spies, & Motyl, 2012).”
BackgroundJoiner, T. (2007) · Harvard University Press eBooks · doi:10.2307/j.ctvjghv2f · Cited by 2,425
(1985) · American Journal of Psychiatry · doi:10.1176/ajp.142.5.559 · Cited by 1,723
Nock, M. K., Holmberg, E. B., Photos, V. I., & Michel, B. D. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.3.309 · Cited by 1,352
Self-citationRibeiro, J. D., Franklin, J. C., Fox, K. R., Bentley, K. H., Kleiman, E. M., Chang, B. P., & Nock, M. K. (2016) · Psychological Medicine · doi:10.1017/s0033291715001804 · Cited by 1,346 · cited 1×
“…that these risk factors, long believed to be fairly stable over short periods of time (i.e., a meta-analytic review found that the median time between assessments of suicidal ideation was 24 months; Ribeiro et al., 2016), actually vary quite dramatically over short time periods of hours and days.”
BackgroundSelf-citationRisk factors for suicide in psychiatric outpatients: A 20-year prospective study.
Brown, G. K., Beck, A. T., Steer, R. A., & Grisham, J. R. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.3.371 · Cited by 1,317
Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
Schmidt, S. (2009) · Review of General Psychology · doi:10.1037/a0015108 · Cited by 1,125
The Replication Recipe: What makes for a convincing replication?
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner-Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & van 't Veer, A. (2014) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.10.005 · Cited by 705 · cited 1×
“This specific replication paradigm (i.e., close replication; Brandt et al., 2014; Finkel, Eastwick, & Reis, 2015) is important because beyond the need to know if our findings replicate in general, it is important to know if our findings generalize across the spectrum of severity of suicide risk.”
Nock, M. K., Prinstein, M. J., & Sterba, S. K. (2009) · Journal of Abnormal Psychology · doi:10.1037/a0016948 · Cited by 662 · cited 1×
“Nock et al. (2009) assessed participants twice per day for 2 weeks, providing a relatively coarse assessment of suicidal ideation over only 14 days.”
Self-citationWarning signs for suicide: theory, research, and clinical applications
Rudd, M. D., Berman, A. L., Joiner, T. E., Nock, M. K., Silverman, M. M., Mandrusiak, M., Van Orden, K., & Witte, T. (2006) · Suicide and Life-Threatening Behavior · doi:10.1521/suli.2006.36.3.255 · Cited by 548
Self-citationThe Mean Square Successive Difference
von Neumann, J., Kent, R. H., Bellinson, H. R., & Hart, B. I. (1941) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731746 · Cited by 534
Prediction of eventual suicide in psychiatric inpatients by clinical ratings of hopelessness
Beck, A. T., Brown, G., & Steer, R. A. (1989) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.57.2.309 · Cited by 448
Single-item measurement of suicidal behaviors: Validity and consequences of misclassification
Millner, A. J., Lee, M. D., & Nock, M. K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0141606 · Cited by 361
Self-citationImproving the Short-Term Prediction of Suicidal Behavior
Glenn, C. R., & Nock, M. K. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.004 · Cited by 328 · cited 1×
“The importance of understanding short-term risk factors (or “warning signs”; Rudd et al., 2006) has been understood for some time (Glenn & Nock, 2014; Nock, 2016).”
BackgroundSelf-citationDiurnal mood variation in major depressive disorder
Peeters, F., Berkhof, J., Delespaul, P., Rottenberg, J., & Nicolson, N. A. (2006) · Emotion · doi:10.1037/1528-3542.6.3.383 · Cited by 306
Ebner-Priemer, U. W., Eid, M., Kleindienst, N., Stabenow, S., & Trull, T. J. (2009) · Journal of Abnormal Psychology · doi:10.1037/a0014868 · Cited by 288
Suicide in mental health in-patients and within 3 months of discharge: National clinical survey
Meehan, J., Kapur, N., Hunt, I. M., Turnbull, P., Robinson, J., Bickley, H., Parsons, R., Flynn, S., Burns, J., Amos, T., et al. (2006) · British Journal of Psychiatry · doi:10.1192/bjp.188.2.129 · Cited by 244 · cited 1×
“This is important given the high risk associated with the time immediately after discharge, the first four weeks of which present a higher risk of suicide than the entire 48 remaining weeks in the first year after discharge combined (Bickley et al., 2013; Meehan et al., 2006).”
BackgroundLectures on Clinical Psychiatry.
(1906) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1906.02510420061028 · Cited by 206 · cited 1×
“The idea that suicidal ideation may vary over a short period of time is not a new one and has been noted since the time of Kraepelin (Kraepelin & Johnstone, 1913) but has not yet been formally studied.”
BackgroundFinkel, E. J., Eastwick, P. W., & Reis, H. T. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000007 · Cited by 202
Quantifying the impact of recent negative life events on suicide attempts
Bagge, C. L., Glenn, C. R., & Lee, H.-J. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0030371 · Cited by 201 · cited 3×
“These findings are similar to an earlier study by Bagge et al. (2014) that reported an ICC of .45 when using a timeline follow-back methodology to assess suicidal ideation in the 24 hr before a suicide attempt. To put this variability into context, suicidal ideation, with an ICC of .53 in Study 1 and .67 in Study 2 (i…”
ResultInfluentialSuicidal Ideation in College Students Varies Across Semesters: The Mediating Role of Belongingness
Van Orden, K. A., Witte, T. K., James, L. M., Castro, Y., Gordon, K. H., Braithwaite, S. R., Hollar, D. L., & Joiner, T. E. (2008) · Suicide and Life-Threatening Behavior · doi:10.1521/suli.2008.38.4.427 · Cited by 200 · cited 1×
“T hi s ar tic le is in te nd ed so le ly fo r th e pe rs on al us e of th e in di vi du al us er an d is no t to be di ss em in at ed br oa dl y. college students, with ideation being the highest during the summer semester (Van Orden et al., 2008).”
Ome sweet ome: what can the genome tell us about the connectome?
Lichtman, J. W., & Sanes, J. R. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.08.010 · Cited by 178 · cited 1×
“Indeed, many fields, such as biology (Grimaldi & Engel, 2007), immunology (Grimaldi & Engel, 2007), and neuroscience (Lichtman & Sanes, 2008) hold descriptive studies in high regard for their ability to verify existing hypotheses and generate new ones.”
BackgroundPeters, M. L., Sorbi, M. J., Kruise, D. A., Kerssens, J. J., Verhaak, P. F. M., & Bensing, J. M. (2000) · Pain · doi:10.1016/s0304-3959(99)00206-7 · Cited by 177 · cited 1×
“We calculated ICC and RMSSD statistics using the Psych R package (Revelle, 2016).”
MethodWray, T. (2014) · Alcohol Research: Current Reviews · doi:10.35946/arcr.v36.1.03 · Cited by 159
Stability and fluctuation of personality disorder features in daily life.
Wright, A. G. C., & Simms, L. J. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000169 · Cited by 153 · cited 1×
“In line with recent work exploring the short-term variability of personality factors (Wright & Simms, 2016), we explored variability in suicidal ideation statistically and visually.”
BackgroundTinbergen, N. (1974) · Science · doi:10.1126/science.185.4145.20 · Cited by 149 · cited 1×
“For decades, leading scholars (Kagan, 2007; Tinbergen, 1974) have suggested that psychological science has not progressed as quickly as other sciences because it has lacked the ability for the intensive study of phenomena of interest in their natural environment, which is what is needed to truly…”
BackgroundLinks, P. S., Eynan, R., Heisel, M. J., Barr, A., Korzekwa, M., McMain, S., & Ball, J. S. (2007) · Journal of Personality Disorders · doi:10.1521/pedi.2007.21.1.72 · Cited by 129 · cited 1×
“Fourth, the EMA compliance rates in both studies (62.75% in Study 1 and 62.0% in Study 2), although similar to some related EMA studies (e.g., 58.1% in a sample of individuals with borderline personality disorder; Links et al., 2007), are still somewhat low.”
ResultInfluentialSuicide within two weeks of discharge from psychiatric inpatient care: a case-control study
Bickley, H., Hunt, I. M., Windfuhr, K., Shaw, J., Appleby, L., & Kapur, N. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201200026 · Cited by 129 · cited 1×
“This is important given the high risk associated with the time immediately after discharge, the first four weeks of which present a higher risk of suicide than the entire 48 remaining weeks in the first year after discharge combined (Bickley et al., 2013; Meehan et al., 2006).”
BackgroundFeasibility and validity of ecological momentary assessment in the investigation of suicide risk
Husky, M., Olié, E., Guillaume, S., Genty, C., Swendsen, J., & Courtet, P. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.08.019 · Cited by 124 · cited 1×
“%) is in line with, albeit slightly lower than, other similar studies of past suicide attempters (e.g., 66.7% in Husky et al., 2014).”
ResultInfluentialReal-time predictors of suicidal ideation: mobile assessment of hospitalized depressed patients
Ben-Zeev, D., Young, M. A., & Depp, C. A. (2012) · Psychiatry Research · doi:10.1016/j.psychres.2011.11.025 · Cited by 122 · cited 1×
“Ben-Zeev et al. (2012) used short-term retrospective prompts that assessed average suicidal ideation since the last study prompt, which did not allow assessment of severity of suicidal ideation as it actually occurred.”
BackgroundWhy Descriptive Science Still Matters
Grimaldi, D. A., & Engel, M. S. (2007) · BioScience · doi:10.1641/b570802 · Cited by 122 · cited 1×
“Indeed, many fields, such as biology (Grimaldi & Engel, 2007), immunology (Grimaldi & Engel, 2007), and neuroscience (Lichtman & Sanes, 2008) hold descriptive studies in high regard for their ability to verify existing hypotheses and generate new ones.”
BackgroundBagge, C. L., Littlefield, A. K., Conner, K. R., Schumacher, J. A., & Lee, H. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.04.010 · Cited by 84 · cited 3×
“Moreover, the ICCs for suicidal ideation were similar to those identified in retrospective studies of ideation within a 24-hr period (Bagge et al., 2014).”
BackgroundMethodResultInfluentialKagan, J. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00049.x · Cited by 84 · cited 2×
“For decades, leading scholars (Kagan, 2007; Tinbergen, 1974) have suggested that psychological science has not progressed as quickly as other sciences because it has lacked the ability for the intensive study of phenomena of interest in their natural environment, which is what is needed to truly…”
BackgroundScientists’ Reputations Are Based on Getting It Right, Not Being Right
Ebersole, C. R., Axt, J. R., & Nosek, B. A. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002460 · Cited by 70
Fraser, L. S. M., Burnell, M., Salter, L. C., Fourkala, E.-O., Kalsi, J., Ryan, A., Gessler, S., Gidron, Y., Steptoe, A., & Menon, U. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005093 · Cited by 59 · cited 1×
“Supporting our approach, Fraser et al. (2014) showed that a two-item measure of hopelessness correlated strongly with the full hopelessness scale (r .93); however, more work validating the appropriateness of a one-item measure of these variables is needed, and recent work on the use of single-item…”
MethodNock, M. K. (2016) · Depression and Anxiety · doi:10.1002/da.22528 · Cited by 40 · cited 1×
“The importance of understanding short-term risk factors (or “warning signs”; Rudd et al., 2006) has been understood for some time (Glenn & Nock, 2014; Nock, 2016).”
BackgroundSelf-citationHopelessness and Suicidal Behavior: An Overview
Beck, A. T. (1975) · JAMA · doi:10.1001/jama.1975.03260240050026 · Cited by 11
The Interpersonal Theory of Suicide: A useful theory?
Orden, V., & Kimberly, A. (2015) · Cited by 7
Cited by
The integrated motivational–volitional model of suicidal behaviour
O'Connor, R. C., & Kirtley, O. J. (2018) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2017.0268 · Cited by 1,781
Ideation-to-action theories of suicide: a conceptual and empirical update
Klonsky, E. D., Saffer, B. Y., & Bryan, C. J. (2018) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2017.07.020 · Cited by 673
Annual Research Review: Suicide among youth – epidemiology, (potential) etiology, and treatment
Cha, C. B., Franz, P. J., M. Guzmán, E., Glenn, C. R., Kleiman, E. M., & Nock, M. K. (2018) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12831 · Cited by 602
“…work in Ecological Momentary Assessment (EMA) suggests that monitoring suicidal thoughts multiple times a day shows the high variability and shortterm volatility of this clinical outcome, and the importance of monitoring risk factors within similar short-term time frames (Kleiman et al., 2017).”
BackgroundSelf-citationWrzus, C., & Neubauer, A. B. (2023) · Assessment · doi:10.1177/10731911211067538 · Cited by 500
McClelland, H., Evans, J. J., Nowland, R., Ferguson, E., & O'Connor, R. C. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.004 · Cited by 466
“…primarily white participants (Fulginiti et al, 2018; Gallagher et al. 2014; Hom et al. 2019; Joiner and Rudd, 1996; Kleiman et al., 2017 Study 1; Kleiman et al., 2017, Study 2; Pietrzak et al., 2017; Schinka et al., 2013) while Salzinger (2007) recruited predominantly Hispanic participants…”
BackgroundMethodResultInfluential
Metadata
- Authors
- Kleiman, E. M., Turner, B. J., Fedor, S., Beale, E. E., Huffman, J. C., & Nock, M. K.
- Affiliations
- Harvard University (US)
- University of Victoria (CA)
- MIT Media Lab (US)
- Massachusetts General Hospital (US)
- ORCID
- Venue
- Journal of Abnormal Psychology
- Published
- 2017-08
- Volume
- 126
- Issue
- 6
- Pages
- 726-738
- ISSN
- 0021-843X (ISSN-L)
- 1939-1846
- OpenAlex
- W2613960323
- Cited by
- 831
- References
- 44
- Citations by year
- 2026: 110 · 2025: 116 · 2024: 115 · 2023: 99 · 2022: 110 · 2021: 99 · 2020: 70 · 2019: 61 · 2018: 41 · 2017: 9
- FWCI
- 61.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Abnormal Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Chet and Will Griswold Suicide Prevention Fund
- Pershing Square Venture Fund for Research on the Foundations of Human Behavior
- John T. and Catherine D. MacArthur Foundation
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Keywords
- suicidal ideation, within-person variability, temporal fluctuations, risk factors, hopelessness, perceived burdensomeness, loneliness, suicide attempters, psychiatric inpatients, suicide risk, short-term forecasting, ecological momentary assessment
- MeSH terms
- Ecological Momentary Assessment, Adolescent, Adult, Female, Humans, Length of Stay, Male, Risk Factors, Time Factors, Cost of Illness, Young Adult, Suicidal Ideation, Hope
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.