Feasibility and acceptability of ecological momentary assessment with high-risk suicidal adolescents following acute psychiatric care
Abstract
Objective: The study purpose was to examine the feasibility and acceptability of intensive ecological momentary assessment (EMA) among high-risk adolescents with suicidal thoughts and behaviors following discharge from acute psychiatric care.Method: Fifty-three adolescents, 12–18 years old, and their parents, were recruited following discharge from acute psychiatric care for suicide risk. The study included a baseline assessment (adolescent and parent), 28 days of EMA surveys (5x per day) and wrist actigraphy (adolescent), and an interview at the end of the 28-day monitoring period (adolescent). Adolescents’ outpatient clinicians were also surveyed about the study.Results: Study feasibility was indicated by a reasonable enrollment rate, high adherence to wearing the actigraphy device, and good adherence to EMA surveys (highest in the first week with significant drop-off in subsequent weeks). Adolescents reported their overall experience in the study was positive, the questions were understandable, their responses to questions were generally accurate, and the surveys were minimally burdensome. The study procedures did not appear to be iatrogenic; suicide attempts and rehospitalizations were not study related and occurred at a rate comparable to other adolescents at the recruitment site. Adolescents’ clinicians reported that the study was somewhat positive and minimally burdensome for them, and somewhat positive for their patients and families.Conclusions: This study demonstrated that intensive EMA designs are feasible and acceptable among high-risk suicidal youth following acute psychiatric care. Specific procedures are provided for keeping adolescents safe during intensive EMA studies, including detailed information about the risk and safety monitoring plan.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most reviewed studies (78%, n = 18) were conducted in adult samples, and less frequently in adolescent samples (22%, n = 5).
“Most studies (78%, n = 18) were conducted in adult, and less frequently in adolescent samples [22%, n = 5; (45, 67, 72, 80, 85)].”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [85]
Approximately one fourth (26%; n = 6) of reviewed studies supplemented signal-contingent sampling with event-contingent sampling, but none used event-contingent sampling alone.
“Approximately one fourth (26%; n = 6) of studies supplemented signal-contingent sampling with event-contingent sampling [i.e., participants were encouraged to self-initiate additional entries when experiencing STBs (45, 47, 61, 69, 85)], but none of the studies used event-contingent sampling alone.”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [85]
Compliance rates were not significantly related to suicide history or current depressive symptom or suicidal ideation severity.
“Compliance rates were not significantly related to suicide history or current depressive symptom or suicidal ideation severity (65, 66, 71, 85, 88).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [85]
Compliance rates declined over time, indicating participant fatigue effects.
“Compliance rates declined over time (i.e., participants exhibited fatigue effects) (80, 84, 85).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [85]
In general, participants reported their experiences overall as neutral-to-positive but time consuming or burdensome, and that they would be open to participating in similar research in the future.
“In general, participants reported their experiences overall as neutral-to-positive but time consuming (or burdensome), and that they would be open to participating in similar research in the future (80, 84, 85).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [85]
In three studies following adolescents recently discharged from inpatient treatment after a suicide attempt or severe ideation, the incidence of suicide attempts over 28 days was 6%, 8%, and 9%.
“Three studies followed adolescents who were recently discharged from inpatient treatment after a suicide attempt or severe ideation. In 28 days, the incidence of suicide attempts was 6% (55), 8% (72), and 9% (85).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [85]
Two reviewed studies required that each participant had an individualized safety plan in place established by their treating physician, and another study instructed participants on how to make one prior to participation.
“Two studies required that each participant had an individualized safety plans in place established by their treating physician (61, 85), and another study instructed participants on how to make one prior to participation (88).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [85]
Maintaining compliance with EMA remains a challenge, especially when assessment periods grow long, as compliance decreases over time with each subsequent week of EMA.
“Regardless, maintaining compliance with EMA remains a challenge, especially when assessment periods grow long, as compliance decreases over time with each subsequent week of EMA [see e.g., (80, 85)].”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [85]
Many of the reviewed studies used monetary rewards for increasing or sustaining compliance.
“Many of the reviewed studies used monetary rewards for increasing or sustaining compliance [see e.g., (85, 88)].”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [85]
Cites
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · see citing works
Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., et al. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111704 · Cited by 5,157 · see citing works
Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., Musacchio, K. M., Jaroszewski, A. C., Chang, B. P., & Nock, M. K. (2017) · Psychological Bulletin · doi:10.1037/bul0000084 · Cited by 3,784 · see citing works
Self-citationNock, M. K., Borges, G., Bromet, E. J., Cha, C. B., Kessler, R. C., & Lee, S. (2008) · Epidemiologic Reviews · doi:10.1093/epirev/mxn002 · Cited by 2,897 · see citing works
Self-harm and suicide in adolescents
Hawton, K., Saunders, K. E., & O'Connor, R. C. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60322-5 · Cited by 2,306 · see citing works
Sheehan, D. V., Sheehan, K. H., Shytle, R. D., Janavs, J., Bannon, Y., Rogers, J. E., Milo, K. M., Stock, S. L., & Wilkinson, B. (2010) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.09m05305whi · Cited by 1,730 · see citing works
Nock, M. K., Green, J. G., Hwang, I., McLaughlin, K. A., Sampson, N. A., Zaslavsky, A. M., & Kessler, R. C. (2013) · JAMA Psychiatry · doi:10.1001/2013.jamapsychiatry.55 · Cited by 1,666 · see citing works
Nock, M. K., Holmberg, E. B., Photos, V. I., & Michel, B. D. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.3.309 · Cited by 1,352 · see citing works
Journal of the American Academy of Child & Adolescent Psychiatry
ScienceDirect (1987) · Cited by 1,338 · see citing works
Kleiman, E. M., Turner, B. J., Fedor, S., Beale, E. E., Huffman, J. C., & Nock, M. K. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000273 · Cited by 831 · see citing works
Self-citationNock, M. K., Prinstein, M. J., & Sterba, S. K. (2009) · Journal of Abnormal Psychology · doi:10.1037/a0016948 · Cited by 662 · see citing works
Suicide Rates After Discharge From Psychiatric Facilities: A Systematic Review and Meta-analysis
Chung, D. T., Ryan, C. J., Hadzi-Pavlovic, D., Singh, S. P., Stanton, C., & Large, M. M. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.1044 · Cited by 651 · see citing works
Trends of Suicidal Behaviors Among High School Students in the United States: 1991–2017
Lindsey, M. A., Sheftall, A. H., Xiao, Y., & Joe, S. (2019) · Pediatrics · doi:10.1542/peds.2019-1187 · Cited by 416 · see citing works
Wen, C. K. F., Schneider, S., Stone, A. A., & Spruijt-Metz, D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6641 · Cited by 350 · see citing works
Torous, J. B., Onnela, J., & Keshavan, M. S. (2017) · Translational Psychiatry · doi:10.1038/tp.2017.25 · Cited by 349 · see citing works
Improving the Short-Term Prediction of Suicidal Behavior
Glenn, C. R., & Nock, M. K. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.004 · Cited by 328 · see citing works
Self-citationProximal psychiatric risk factors for suicidality in youth: the Great Smoky Mountains Study.
Foley, D. L., Goldston, D. B., Costello, E. J., & Angold, A. C. (2006) · PubMed · doi:10.1001/archpsyc.63.9.1017 · Cited by 322 · see citing works
Heron, K. E., Everhart, R. S., McHale, S. M., & Smyth, J. M. (2017) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsx078 · Cited by 283 · see citing works
Real-time assessment of suicidal thoughts and behaviors
Kleiman, E. M., & Nock, M. K. (2018) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2017.07.026 · Cited by 239 · see citing works
Self-citationLittlewood, D. L., Kyle, S. D., Carter, L.-A., Peters, S., Pratt, D., & Gooding, P. (2019) · Psychological Medicine · doi:10.1017/s0033291718001009 · Cited by 209 · see citing works
van Roekel, E., Keijsers, L., & Chung, J. M. (2019) · Journal of Research on Adolescence · doi:10.1111/jora.12471 · Cited by 191 · see citing works
Forkmann, T., Spangenberg, L., Rath, D., Hallensleben, N., Hegerl, U., Kersting, A., & Glaesmer, H. (2018) · Journal of Abnormal Psychology · doi:10.1037/abn0000381 · Cited by 165 · see citing works
Developmental Approach to Prevent Adolescent Suicides
Wyman, P. A. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.05.039 · Cited by 141 · see citing works
Hallensleben, N., Spangenberg, L., Forkmann, T., Rath, D., Hegerl, U., Kersting, A., Kallert, T. W., & Glaesmer, H. (2018) · Crisis · doi:10.1027/0227-5910/a000464 · Cited by 125 · see citing works
Feasibility and validity of ecological momentary assessment in the investigation of suicide risk
Husky, M., Olié, E., Guillaume, S., Genty, C., Swendsen, J., & Courtet, P. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.08.019 · Cited by 124 · see citing works
Czyz, E. K., King, C. A., & Nahum-Shani, I. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.06.031 · Cited by 112 · see citing works
Copeland, W. E., Goldston, D. B., & Costello, E. J. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2017.08.015 · Cited by 104 · cited 1× · see citing works
“Youth with STBs report significant impairment in academic and social domains (Copeland et al., 2017; Foley et al., 2006) and are substantial utilizers of healthcare services (CDC, 2017a).”
BackgroundHusky, M., Swendsen, J., Ionita, A., Jaussent, I., Genty, C., & Courtet, P. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.06.035 · Cited by 95 · see citing works
Microanalysis of Adolescent Suicide Attempters and Ideators During the Acute Suicidal Episode
Negron, R., Piacentini, J. C., Graae, F., Davies, M., & Shaffer, D. (1997) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/s0890-8567(09)66559-x · Cited by 87 · see citing works
Does assessing suicidality frequently and repeatedly cause harm? a randomized control study
Law, M. K., Furr, R. M., Arnold, E. M., Mneimne, M., Jaquett, C., & Fleeson, W. (2015) · Psychological Assessment · doi:10.1037/pas0000118 · Cited by 82 · see citing works
Suicidal Behavior and Self-Disclosure in Adolescent Psychiatric Inpatients
Horesh, N., Zalsman, G., & Apter, A. (2004) · The Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000146738.78222.e5 · Cited by 80 · see citing works
Cha, C. B., Tezanos, K. M., Peros, O. M., Ng, M. Y., Ribeiro, J. D., Nock, M. K., & Franklin, J. C. (2018) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12344 · Cited by 77 · see citing works
Kleiman, E. M., Glenn, C. R., & Liu, R. T. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2019.1666400 · Cited by 68 · see citing works
Self-citationGoldstein, T. R., Merranko, J. A., Krantz, M. L., Garcia, M., Franzen, P. L., Levenson, J. C., Axelson, D., Birmaher, B. B., & Frank, E. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.04.049 · Cited by 55 · see citing works
Resting-state functional connectivity and inflexibility of daily emotions in major depression
Kirshenbaum, J. S., Ordaz, S. J., Kircanski, K., Ho, T. C., Davis, E., Camacho, M. C., & Gotlib, I. H. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.01.040 · Cited by 44 · see citing works
Ben‐Zeev, D., Scherer, E. A., Brian, R., Mistler, L. A., Campbell, A. T., & Wang, R. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201700077 · Cited by 36 · see citing works
Kleiman, E. M., Millner, A. J., Joyce, V. W., Nash, C. C., Buonopane, R. J., & Nock, M. K. (2019) · JMIR mhealth and uhealth · doi:10.2196/13725 · Cited by 34 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199 · see citing works
Neural correlates associated with suicide and nonsuicidal self-injury in youth
Auerbach, R. P., Pagliaccio, D., Allison, G. O., Alqueza, K. L., & Alonso, M. F. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.06.002 · Cited by 204 · see citing works
Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research
Kivelä, L., van der Does, W. A. J., Riese, H., & Antypa, N. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.876595 · Cited by 163 · see citing works
Use of Ecological Momentary Assessment to Study Suicidal Thoughts and Behavior: a Systematic Review
Sedano-Capdevila, A., Porras-Segovia, A., Bello, H. J., Baca-García, E., & Barrigon, M. L. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-021-01255-7 · Cited by 148 · see citing works
Glenn, C. R., Kleiman, E. M., Kandlur, R., Esposito, E. C., & Liu, R. T. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2021.1969654 · Cited by 79 · see citing works
Self-citationHamilton, J. L., Tsypes, A., Zelazny, J., Sewall, C. J. R., Rode, N., Merranko, J., Brent, D. A., Goldstein, T. R., & Franzen, P. L. (2023) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13651 · Cited by 71 · see citing works
Rapid intensification of suicide risk preceding suicidal behavior among primary care patients
Bryan, C. J., Allen, M. H., Wastler, H. M., Bryan, A. O., Baker, J. C., May, A. M., & Thomsen, C. J. (2023) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12948 · Cited by 23 · see citing works
Multidimensional variability in ecological assessments predicts two clusters of suicidal patients.
Bonilla-Escribano, P., Ramírez, D., Baca-García, E., Courtet, P., Artés-Rodríguez, A., & López-Castromán, J. (2023) · Scientific Reports · doi:10.1038/s41598-023-30085-1 · Cited by 17 · see citing works
Schatten, H. T., Brick, L. A., Holman, C. S., & Czyz, E. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114174 · Cited by 17 · see citing works
- Authors
- Glenn, C. R., Kleiman, E. M., Kearns, J. C., Santee, A. C., Esposito, E. C., Conwell, Y., & Alpert-Gillis, L. J.
- Affiliations
- University of Rochester Medicine (US)
- Rutgers, The State University of New Jersey (US)
- University of Rochester (US)
- Department of Psychiatry, University of Rochester Medical Center
- Corresponding author
- Glenn, Catherine R.
- ORCID
- Venue
- Journal of Clinical Child & Adolescent Psychology
- Publisher
- Informa UK Limited
- Published
- 2020-04-02
- Volume
- 51
- Issue
- 1
- Pages
- 32-48
- ISSN
- 1537-4416 (ISSN-L)
- 1537-4424
- OpenAlex
- W3014688601
- Cited by
- 104
- References
- 37
- Citations by year
- 2026: 14 · 2025: 24 · 2024: 16 · 2023: 16 · 2022: 17 · 2021: 15 · 2020: 1
- FWCI
- 11.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Child & Adolescent Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- American Foundation for Suicide Prevention (YIG-1-054-16)
- Medical Center, University of Rochester (pilot)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Keywords
- ecological momentary assessment, suicidal adolescents, suicide risk, at-risk youth, acute psychiatric care, post-discharge monitoring, wrist actigraphy, feasibility, acceptability, clinician perspectives
- MeSH terms
- Ecological Momentary Assessment, Adolescent, Child, Feasibility Studies, Humans, Surveys and Questionnaires, Suicide, Attempted, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review