Cited by 339Suicide and Self-Harm StudiesMachine Learning in HealthcareMental Health via Writing

The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.

Predicting suicidal behavior from longitudinal electronic health records.

Barak-Corren, Yuval, Castro, Victor M., Javitt, Solomon, Hoffnagle, Alison G., Dai, Yael, Perlis, Roy H., Nock, Matthew K., Smoller, Jordan W., Reis, Ben Y.·2017·American Journal of Psychiatry

DOI 10.1176/appi.ajp.2016.16010077

Open this paper in CoChat — free account

Abstract

OBJECTIVE: The purpose of this article was to determine whether longitudinal historical data, commonly available in electronic health record (EHR) systems, can be used to predict patients' future risk of suicidal behavior. METHOD: Bayesian models were developed using a retrospective cohort approach. EHR data from a large health care database spanning 15 years (1998-2012) of inpatient and outpatient visits were used to predict future documented suicidal behavior (i.e., suicide attempt or death). Patients with three or more visits (N=1,728,549) were included. ICD-9-based case definition for suicidal behavior was derived by expert clinician consensus review of 2,700 narrative EHR notes (from 520 patients), supplemented by state death certificates. Model performance was evaluated retrospectively using an independent testing set. RESULTS: Among the study population, 1.2% (N=20,246) met the case definition for suicidal behavior. The model achieved sensitive (33%-45% sensitivity), specific (90%-95% specificity), and early (3-4 years in advance on average) prediction of patients' future suicidal behavior. The strongest predictors identified by the model included both well-known (e.g., substance abuse and psychiatric disorders) and less conventional (e.g., certain injuries and chronic conditions) risk factors, indicating that a data-driven approach can yield more comprehensive risk profiles. CONCLUSIONS: Longitudinal EHR data, commonly available in clinical settings, can be useful for predicting future risk of suicidal behavior. This modeling approach could serve as an early warning system to help clinicians identify high-risk patients for further screening. By analyzing the full phenotypic breadth of the EHR, computerized risk screening approaches may enhance prediction beyond what is feasible for individual clinicians.

Integrity signals

Registry

Crossref · 10.1176/appi.ajp.2016.16010077

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Suicide and suicidal behavior
Nock, M. K., Borges, G., Bromet, E. J., Cha, C. B., Kessler, R. C., & Lee, S. (2008) · Epidemiologic Reviews · doi:10.1093/epirev/mxn002 · Cited by 2,897
Self-citation
Cross-national prevalence and risk factors for suicidal ideation, plans and attempts
Nock, M. K., Borges, G., Bromet, E. J., Alonso, J., Angermeyer, M., Beautrais, A., Bruffaerts, R., Chiu, W. T., de Girolamo, G., Gluzman, S., et al. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.107.040113 · Cited by 2,654
Self-citation
Clinical versus mechanical prediction: a meta-analysis
Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.1.19 · Cited by 1,640
Machine learning for medical diagnosis: history, state of the art and perspective
Kononenko, I. (2001) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(01)00077-x · Cited by 1,306
Clinical correlates of inpatient suicide
Busch, K. A., Fawcett, J., & Jacobs, D. G. (2003) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v64n0105 · Cited by 750
Measuring the Suicidal Mind: Implicit Cognition Predicts Suicidal Behavior
Nock, M. K., Park, J. M., Finn, C. T., Deliberto, T. L., Dour, H. J., & Banaji, M. R. (2010) · Psychological Science · doi:10.1177/0956797610364762 · Cited by 624
Self-citation
Predicting Suicides After Psychiatric Hospitalization in US Army Soldiers: The Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS)
Kessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447
Self-citation
Improving the Short-Term Prediction of Suicidal Behavior
Glenn, C. R., & Nock, M. K. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.004 · Cited by 328
Self-citation
Trends in US emergency department visits for attempted suicide and self-inflicted injury, 1993-2008.
Ting, S. A., Sullivan, A. F., Boudreaux, E. D., Miller, I., & Camargo, C. A. (2012) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2012.03.020 · Cited by 252
Prenatal antidepressant exposure is associated with risk for attention-deficit hyperactivity disorder but not autism spectrum disorder in a large health system
Clements, C. C., Castro, V. M., Blumenthal, S. R., Rosenfield, H. R., Murphy, S. N., Fava, M., Erb, J. L., Churchill, S. E., Kaimal, A. J., Doyle, A. E., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.90 · Cited by 197
Self-citation

Flagged first, then by citations

Show all 26 references

Research works printed but not linked: 2

Nalichowski R, 2006, AMIA Annu Symp Proc, 1044
Haerian K, 2012, AMIA Annu Symp Proc, 2012, 1244

Sorted by citations

Improving Suicide Prevention Through Evidence-Based Strategies: A Systematic Review
Mann, J. J., Michel, C. A., & Auerbach, R. P. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20060864 · Cited by 655
Prediction Models for Suicide Attempts and Deaths: A Systematic Review and Simulation
Belsher, B. E., Smolenski, D. J., Pruitt, L. D., Bush, N. E., Beech, E. H., Workman, D. E., Morgan, R. L., Evatt, D. P., Tucker, J., & Skopp, N. A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0174 · Cited by 540
Predicting Suicide Attempts and Suicide Deaths Following Outpatient Visits Using Electronic Health Records
Simon, G. E., Johnson, E., Lawrence, J. M., Rossom, R. C., Ahmedani, B., Lynch, F. L., Beck, A., Waitzfelder, B., Ziebell, R., Penfold, R. B., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17101167 · Cited by 400
Severity and Variability of Depression Symptoms Predicting Suicide Attempt in High-Risk Individuals
Melhem, N., Porta, G., Oquendo, M. A., Zelazny, J. M., Keilp, J. G., Iyengar, S., Burke, A. K., Birmaher, B. B., Stanley, B., Mann, J. J., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.4513 · Cited by 261
Characterisation of mental health conditions in social media using Informed Deep Learning
Gkotsis, G., Oellrich, A., Velupillai, S. U., Liakata, M., Hubbard, T., Dobson, R., & Dutta, R. (2017) · Scientific Reports · doi:10.1038/srep45141 · Cited by 255
Machine learning model to predict mental health crises from electronic health records
Garriga, R., Mas, J., Abraha, S., Nolan, J., Harrison, O., Tadros, G., & Matic, A. (2022) · Nature Medicine · doi:10.1038/s41591-022-01811-5 · Cited by 229
Suicide prediction models: a critical review of recent research with recommendations for the way forward
Kessler, R. C., Bossarte, R. M., Luedtke, A., Zaslavsky, A. M., & Zubizarreta, J. R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0531-0 · Cited by 234
Identifying Suicide Ideation and Suicidal Attempts in a Psychiatric Clinical Research Database using Natural Language Processing
Fernandes, A. C., Dutta, R., Velupillai, S. U., Sanyal, J., Stewart, R. J., & Chandran, D. (2018) · Scientific Reports · doi:10.1038/s41598-018-25773-2 · Cited by 168
Machine learning in suicide science: Applications and ethics
Linthicum, K. P., Schafer, K. M., & Ribeiro, J. D. (2019) · Behavioral Sciences & the Law · doi:10.1002/bsl.2392 · Cited by 163
Prediction of suicide attempts using clinician assessment, patient self-report, and electronic health records
Nock, M. K., Millner, A. J., Ross, E. L., Kennedy, C. J., Al-Suwaidi, M., Barak-Corren, Y., Castro, V. M., Castro-Ramirez, F., Lauricella, T., Murman, N., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.44373 · Cited by 157
Self-citation
A survey on big data-driven digital phenotyping of mental health
Liang, Y., Zheng, X., & Zeng, D. D. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.04.001 · Cited by 164
Machine learning for suicide risk prediction in children and adolescents with electronic health records
Su, C., Aseltine, R. H., Doshi, R., Chen, K., Rogers, S. C., & Wang, F. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-01100-0 · Cited by 163
Using Machine Learning to Predict Complications in Pregnancy: A Systematic Review
Bertini, A., Salas, R., Chabert, S., Sobrevía, L., & Pardo, F. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2021.780389 · Cited by 167
Prediction of Sex-Specific Suicide Risk Using Machine Learning and Single-Payer Health Care Registry Data From Denmark
Gradus, J. L., Rosellini, A. J., Horváth–Puhó, E., Street, A. E., Galatzer‐Levy, I. R., Jiang, T., Lash, T. L., & Sørensen, H. T. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.2905 · Cited by 143
Advancing the Understanding of Suicide: The Need for Formal Theory and Rigorous Descriptive Research
Millner, A. J., Robinaugh, D. J., & Nock, M. K. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.06.007 · Cited by 161
Self-citation
Digital Phenotyping: Data-Driven Psychiatry to Redefine Mental Health
Oudin, A., Maatoug, R., Bourla, A., Ferreri, F., Bonnot, O., Millet, B., Schoeller, F., Mouchabac, S., & Adrien, V. (2023) · Journal of Medical Internet Research · doi:10.2196/44502 · Cited by 156
Significant shared heritability underlies suicide attempt and clinically predicted probability of attempting suicide
Ruderfer, D. M., Walsh, C. G., Aguirre, M. W., Tanigawa, Y., Ribeiro, J. D., Franklin, J. C., & Rivas, M. A. (2020) · Molecular Psychiatry · doi:10.1038/s41380-018-0326-8 · Cited by 134
Clinical Text Mining
Dalianis, H. (2018) · Springer eBooks · doi:10.1007/978-3-319-78503-5 · Cited by 217
Clinical text classification research trends: Systematic literature review and open issues
Mujtaba, G., Shuib, L., Idris, N., Hoo, W. L., Raj, R. G., Khowaja, K., Shaikh, K., & Nweke, H. F. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.09.034 · Cited by 123
Understanding suicide risk within the Research Domain Criteria (RDoC) framework: A meta-analytic review
Glenn, C. R., Kleiman, E. M., Cha, C. B., Deming, C. A., Franklin, J. C., & Nock, M. K. (2017) · Depression and Anxiety · doi:10.1002/da.22686 · Cited by 128
Self-citation
The Secondary Use of Electronic Health Records for Data Mining: Data Characteristics and Challenges
Sarwar, T., Seifollahi, S., Chan, J., Zhang, X., Aksakallı, V., Hudson, I. L., Verspoor, K. M., & Cavedon, L. (2022) · ACM Computing Surveys · doi:10.1145/3490234 · Cited by 151
Machine and deep learning for longitudinal biomedical data: a review of methods and applications
Cascarano, A., Mur-Petit, J., Hernández-González, J., Camacho, M., Eadie, N. D. T., Gkontra, P., Chadeau‐Hyam, M., Vitria, J. M., & Lekadir, K. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10561-w · Cited by 147
Genome-Wide Association Study of Suicide Death and Polygenic Prediction of Clinical Antecedents
Docherty, A. R., Shabalin, A. A., DiBlasi, E., Monson, E., Mullins, N., Adkins, D. E., Bacanu, S.-A., Bakian, A. V., Crowell, S., Chen, D., et al. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.19101025 · Cited by 124
The use of electronic health records for psychiatric phenotyping and genomics
Smoller, J. W. (2017) · American Journal of Medical Genetics Part B Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32548 · Cited by 127
Self-citation
The Lancet Commission on self-harm
Moran, P., Chandler, A., Dudgeon, P., Kirtley, O. J., Knipe, D. W., Pirkis, J., Sinyor, M., Allister, R., Ansloos, J. P., Ball, M. A., et al. (2024) · The Lancet · doi:10.1016/s0140-6736(24)01121-8 · Cited by 143
Self-citation
Big Brain Data: On the Responsible Use of Brain Data from Clinical and Consumer-Directed Neurotechnological Devices
Kellmeyer, P. (2018) · Neuroethics · doi:10.1007/s12152-018-9371-x · Cited by 121
Artificial intelligence and suicide prevention: A systematic review
Lejeune, A., Glaz, A. L., Perron, P.-A., Sebti, J., Baca‐García, E., Walter, M., Lemey, C., & Berrouiguet, S. (2022) · European Psychiatry · doi:10.1192/j.eurpsy.2022.8 · Cited by 130
Development of an early-warning system for high-risk patients for suicide attempt using deep learning and electronic health records
Zheng, L., Wang, O., Hao, S., Ye, C., Liu, M., Xia, M., Sabo, A. N., Markovic, L., Stearns, F., Kanov, L., et al. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0684-2 · Cited by 116
Identification of suicidal behavior among psychiatrically hospitalized adolescents using natural language processing and machine learning of electronic health records
Carson, N. J., Mullin, B. O., Román, M. J. S., Lu, F. Q., Yang, K. G., Menezes, M., & Cook, B. L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211116 · Cited by 113
Validation of an Electronic Health Record–Based Suicide Risk Prediction Modeling Approach Across Multiple Health Care Systems
Barak‐Corren, Y., Castro, V. M., Nock, M. K., Mandl, K. D., Madsen, E. M., Seiger, A. N., Adams, W. G., Applegate, R. J., Bernstam, E. V., Klann, J. G., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.1262 · Cited by 102
Self-citation
Natural language processing and machine learning of electronic health records for prediction of first-time suicide attempts
Tsui, F. R., Shi, L., Ruiz, V., Ryan, N. D., Biernesser, C. L., Iyengar, S., Walsh, C. G., & Brent, D. A. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab011 · Cited by 105
Which PHQ-9 Items Can Effectively Screen for Suicide? Machine Learning Approaches
Kim, S., Lee, H.-K., & Lee, K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18073339 · Cited by 99
Columbia-Suicide Severity Rating Scale Screen Version: initial screening for suicide risk in a psychiatric emergency department
Bjureberg, J., Dahlin, M., Carlborg, A., Edberg, H., Haglund, A., & Runeson, B. (2021) · Psychological Medicine · doi:10.1017/s0033291721000751 · Cited by 111
Translating promise into practice: a review of machine learning in suicide research and prevention
Kirtley, O. J., van Mens, K., Hoogendoorn, M., Kapur, N., & de Beurs, D. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00254-6 · Cited by 100
Alcohol Use Disorder and Risk of Suicide in a Swedish Population-Based Cohort
Edwards, A. C., Ohlsson, H., Sundquist, J., Sundquist, K., & Kendler, K. S. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2019.19070673 · Cited by 98
The prediction of suicide in severe mental illness: development and validation of a clinical prediction rule (OxMIS)
Fazel, S., Wolf, A., Larsson, H., Mallett, S., & Fanshawe, T. R. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0428-3 · Cited by 95
Testing Suicide Risk Prediction Algorithms Using Phone Measurements With Patients in Acute Mental Health Settings: Feasibility Study
Haines-Delmont, A., Chahal, G., Bruen, A. J., Wall, A., Khan, C. T., Sadashiv, R., & Fearnley, D. (2020) · JMIR mhealth and uhealth · doi:10.2196/15901 · Cited by 87
Consensus Statement on Ethical & Safety Practices for Conducting Digital Monitoring Studies with People at Risk of Suicide and Related Behaviors
Nock, M. K., Kleiman, E. M., Abraham, M. E., Bentley, K. H., Brent, D. A., Buonopane, R. J., Castro‐Ramirez, F., Cha, C. B., Dempsey, W., Draper, J., et al. (2020) · Psychiatric Research and Clinical Practice · doi:10.1176/appi.prcp.20200029 · Cited by 89
Self-citation
Identification of Imminent Suicide Risk Among Young Adults using Text Messages
Nobles, A. L., Glenn, J. J., Kowsari, K., Teachman, B. A., & Barnes, L. E. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173987 · Cited by 92
The performance of machine learning models in predicting suicidal ideation, attempts, and deaths: A meta-analysis and systematic review
Kusuma, K., Larsen, M. E., Quiroz, J. C., Gillies, M. B., Burnett, A., Qian, J., & Torok, M. H. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.09.050 · Cited by 94
Predicting imminent suicidal thoughts and nonfatal attempts: The role of complexity
Ribeiro, J. D., Huang, X., Fox, K. R., Walsh, C. G., & Linthicum, K. P. (2019) · Clinical Psychological Science · doi:10.1177/2167702619838464 · Cited by 75
Prospective Validation of an Electronic Health Record–Based, Real-Time Suicide Risk Model
Walsh, C. G., Johnson, K. B., Ripperger, M., Sperry, S., Harris, J., Clark, N., Fielstein, E., Novak, L., Robinson, K., & Stead, W. W. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.1428 · Cited by 78
Identifying depression in the National Health and Nutrition Examination Survey data using a deep learning algorithm
Oh, J., Yun, K., Maoz, U., Kim, T.-S., & Chae, J. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.06.034 · Cited by 80
Risk assessment tools and data-driven approaches for predicting and preventing suicidal behavior
Velupillai, S., Hadlaczky, G., Baca-Garcia, E., Gorrell, G. M., Werbeloff, N., Nguyen, D., Patel, R., Leightley, D., Downs, J., Hotopf, M., et al. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00036 · Cited by 76
Applying Machine Learning Approaches to Suicide Prediction Using Healthcare Data: Overview and Future Directions
Boudreaux, E. D., Rundensteiner, E. A., Liu, F., Wang, B., Larkin, C., Agu, E., Ghosh, S., Semeter, J., Simon, G. E., & Davis-Martin, R. E. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.707916 · Cited by 79
Suicidal behaviour prediction models using machine learning techniques: A systematic review
Nordin, N., Zainol, Z. B., Noor, M. H. M., & Chan, L. F. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102395 · Cited by 84
Predicting future suicidal behaviour in young adults, with different machine learning techniques: A population-based longitudinal study
van Mens, K., de Schepper, C., Wijnen, B. F. M., Koldijk, S., Schnack, H. G., de Looff, P. C., Lokkerbol, J., Wetherall, K., Cleare, S., O'Connor, D. B., et al. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.03.081 · Cited by 73
Identifying the relative importance of non-suicidal self-injury features in classifying suicidal ideation, plans, and behavior using exploratory data mining
Burke, T. A., Jacobucci, R., Ammerman, B. A., Piccirillo, M. L., McCloskey, M. S., Heimberg, R. G., & Alloy, L. B. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.01.045 · Cited by 74
Impact of Electronic Health Records on Information Practices in Mental Health Contexts: Scoping Review
Kariotis, T. C., Prictor, M., Chang, S., & Gray, K. M. (2022) · Journal of Medical Internet Research · doi:10.2196/30405 · Cited by 90
Prospective prediction of suicide attempts in community adolescents and young adults, using regression methods and machine learning
Miché, M., Studerus, E., Meyer, A. H., Gloster, A. T., Beesdo‐Baum, K., Wïttchen, H., & Lieb, R. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.093 · Cited by 69
Association of Nondiscrimination Policies With Mental Health Among Gender Minority Individuals
McDowell, A., Raifman, J., Progovac, A. M., & Rose, S. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.0770 · Cited by 72
Psychiatry in the Digital Age: A Blessing or a Curse?
Roth, C. B., Papassotiropoulos, A., Brühl, A. B., Lang, U. E., & Huber, C. G. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18168302 · Cited by 76
Classification of Suicide Attempts through a Machine Learning Algorithm Based on Multiple Systemic Psychiatric Scales
Oh, J., Yun, K., Hwang, J.-H., & Chae, J. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00192 · Cited by 67
Challenges and Opportunities for Using Big Health Care Data to Advance Medical Science and Public Health
Shortreed, S. M., Cook, A. J., Coley, R. Y., Bobb, J. F., & Nelson, J. C. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwy292 · Cited by 74
Accuracy requirements for cost-effective suicide risk prediction among primary care patients in the US
Ross, E. L., Zuromski, K. L., Reis, B. Y., Nock, M. K., Kessler, R. C., & Smoller, J. W. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.0089 · Cited by 65
Self-citation
Role of machine learning algorithms in suicide risk prediction: a systematic review-meta analysis of clinical studies
Ehtemam, H., Esfahlani, S. S., Sanaei, A., Ghaemi, M. M., Hajesmaeel‐Gohari, S., Rahimisadegh, R., Bahaadinbeigy, K., Ghasemian, F., & Shirvani, H. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02524-0 · Cited by 69
Can machine-learning methods really help predict suicide?
McHugh, C. M., & Large, M. M. B. (2020) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000609 · Cited by 67
Assessing and Minimizing Re-identification Risk in Research Data Derived from Health Care Records
Simon, G. E., Shortreed, S. M., Coley, R. Y., Penfold, R. B., Rossom, R. C., Waitzfelder, B. E., Sanchez, K., & Lynch, F. L. (2019) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.5334/egems.270 · Cited by 63
Associations Between Natural Language Processing–Enriched Social Determinants of Health and Suicide Death Among US Veterans
Mitra, A., Pradhan, R., Melamed, R., Chen, K., Hoaglin, D. C., Tucker, K. L., Reisman, J. I., Yang, Z., Liu, W., Tsai, J., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.3079 · Cited by 57
Machine Learning and Electronic Health Records: A Paradigm Shift
Adkins, D. E. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16101169 · Cited by 58
Screening pregnant women for suicidal behavior in electronic medical records: diagnostic codes vs. clinical notes processed by natural language processing
Zhong, Q., Karlson, E. W., Gelaye, B., Finan, S., Avillach, P., Smoller, J. W., Cai, T., & Williams, M. A. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0617-7 · Cited by 58
Self-citation
Development and validation of a pancreatic cancer risk model for the general population using electronic health records: An observational study
Appelbaum, L., Cambronero, J., Stevens, J. P., Horng, S., Pollick, K., Silva, G., Haneuse, S., Piatkowski, G., Benhaga, N., Duey, S., et al. (2020) · European Journal of Cancer · doi:10.1016/j.ejca.2020.10.019 · Cited by 55
The use of advanced technology and statistical methods to predict and prevent suicide
Kleiman, E. M., Glenn, C. R., & Liu, R. T. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00175-y · Cited by 65
Machine learning-based prediction for self-harm and suicide attempts in adolescents
Su, R., John, J. R., & Lin, P. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115446 · Cited by 72
Enabling Open-Science Initiatives in Clinical Psychology and Psychiatry Without Sacrificing Patients’ Privacy: Current Practices and Future Challenges
Walsh, C. G., Xia, W., Li, M., Denny, J. C., Harris, P. A., & Malin, B. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917749652 · Cited by 55
Integration of Face-to-Face Screening With Real-time Machine Learning to Predict Risk of Suicide Among Adults
Wilimitis, D., Turer, R. W., Ripperger, M. A., McCoy, A. B., Sperry, S. H., Fielstein, E. M., Kurz, T. L., & Walsh, C. G. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.12095 · Cited by 51
Detection of Suicidality in Adolescents with Autism Spectrum Disorders: Developing a Natural Language Processing Approach for Use in Electronic Health Records.
Downs, J. M., Velupillai, S. U., Gkotsis, G., Holden, R., Kikoler, M., Dean, H., Fernandes, A. C., & Dutta, R. (2017) · PubMed Central · Cited by 54
Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System
Kessler, R. C., Bauer, M. S., Bishop, T. M., Demler, O. V., Dobscha, S. K., Gildea, S. M., Goulet, J. L., Karras, E., Kreyenbuhl, J., Landes, S. J., et al. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00390 · Cited by 52
Self-citation
Protecting Life While Preserving Liberty: Ethical Recommendations for Suicide Prevention With Artificial Intelligence
McKernan, L. C., Clayton, E. W., & Walsh, C. G. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00650 · Cited by 52
Predicting Barriers to Treatment for Depression in a U.S. National Sample: A Cross-Sectional, Proof-of-Concept Study
Chekroud, A. M., Foster, D. F., Zheutlin, A. B., Gerhard, D. M., Roy, B., Koutsouleris, N., Chandra, A., Esposti, M. D., Subramanyan, G., Gueorguieva, R. V., et al. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201800094 · Cited by 51
Use of natural language processing in electronic medical records to identify pregnant women with suicidal behavior: towards a solution to the complex classification problem
Zhong, Q., Mittal, L. P., Nathan, M., Brown, K. M., Gonzalez, D. K., Cai, T. A., Finan, S., Gelaye, B., Avillach, P., Smoller, J. W., et al. (2018) · European Journal of Epidemiology · doi:10.1007/s10654-018-0470-0 · Cited by 51
Self-citation
The Differences Between Individuals Engaging in Nonsuicidal Self-Injury and Suicide Attempt Are Complex (vs. Complicated or Simple)
Huang, X., Ribeiro, J. D., & Franklin, J. C. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00239 · Cited by 54
Identifying Predictors of Suicide in Severe Mental Illness: A Feasibility Study of a Clinical Prediction Rule (Oxford Mental Illness and Suicide Tool or OxMIS)
Senior, M., Burghart, M., Yu, R., Kormilitzin, A., Liu, Q., Vaci, N., Nevado‐Holgado, A. J., Pandit, S. A., Zlodre, J., & Fazel, S. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00268 · Cited by 50
Reconciling Statistical and Clinicians’ Predictions of Suicide Risk
Simon, G. E., Matarazzo, B. B., Walsh, C. G., Smoller, J. W., Boudreaux, E. D., Yarborough, B. J. H., Shortreed, S. M., Coley, R. Y., Ahmedani, B. K., Doshi, R., et al. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000214 · Cited by 44
Self-citation
Complex modeling with detailed temporal predictors does not improve health records-based suicide risk prediction
Shortreed, S. M., Walker, R. L., Johnson, E., Wellman, R., Cruz, M., Ziebell, R. A., Coley, R. Y., Yaseen, Z. S., Dharmarajan, S. H., Penfold, R. B., et al. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00772-4 · Cited by 46
The Role of Big Data Analytics in Predicting Suicide
Kessler, R. C., Bernecker, S. L., Bossarte, R. M., Luedtke, A. R., McCarthy, J. F., Nock, M. K., Pigeon, W. R., Petukhova, M. V., Sadikova, E., VanderWeele, T. J., et al. (2019) · Personalized Psychiatry · doi:10.1007/978-3-030-03553-2_5 · Cited by 44
Self-citation
Sex Disparities in Cardiovascular Device Evaluations
Ghare, M. I., Chandrasekhar, J., Mehran, R., Ng, V. G., Grines, C. L., & Lansky, A. J. (2019) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2018.10.048 · Cited by 43
Predicting self-harm within six months after initial presentation to youth mental health services: A machine learning study
Iorfino, F., Ho, N., Carpenter, J. S., Cross, S. P. M., Davenport, T. A., Hermens, D. F., Yee, H. F., Nichles, A., Zmicerevska, N., Guastella, A. J., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243467 · Cited by 44
Comparing machine learning to a rule-based approach for predicting suicidal behavior among adolescents: Results from a longitudinal population-based survey
van Vuuren, C. L., van Mens, K., Beurs, D. P. D., Lokkerbol, J., van der Wal, M. F., Cuijpers, P. J., & Chinapaw, M. J. M. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.09.018 · Cited by 44
Machine‐Learning prediction of comorbid substance use disorders in ADHD youth using Swedish registry data
Zhang‐James, Y., Chen, Q., Kuja‐Halkola, R., Lichtenstein, P., Larsson, H., & Faraone, S. V. (2020) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13226 · Cited by 47
Improving Suicide Prevention in Primary Care for Differing Levels of Behavioral Health Integration: A Review
Spottswood, M., Lim, C. T., Davydow, D., & Huang, H. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.892205 · Cited by 40
“Novel risk factors can also be identified (149).”
Background
Characterization of time-variant and time-invariant assessment of suicidality on Reddit using C-SSRS
Gaur, M., Aribandi, V., Alambo, A., Kursuncu, U., Thirunarayan, K., Beich, J., Pathak, J., & Sheth, A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250448 · Cited by 40
Suicide‐specific mortality among patients with treatment‐resistant major depressive disorder, major depressive disorder with prior suicidal ideation or suicide attempts, or major depressive disorder alone
Kern, D. M., Canuso, C. M., Daly, E., Johnson, J., Fu, D., Doherty, T., Blauer-Peterson, C. J., & Cepeda, M. S. (2023) · Brain and Behavior · doi:10.1002/brb3.3171 · Cited by 44
Predicting mechanical restraint of psychiatric inpatients by applying machine learning on electronic health data
Danielsen, A. A., Fenger, M. H. J., Østergaard, S. D., Nielbo, K. L., & Mors, O. (2019) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13061 · Cited by 38
Assessment of a Risk Index for Suicide Attempts Among US Army Soldiers With Suicide Ideation
Zuromski, K. L., Bernecker, S. L., Gutierrez, P. M., Joiner, T. E., King, A. J., Liu, H., Naifeh, J. A., Nock, M. K., Sampson, N. A., Zaslavsky, A. M., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.0766 · Cited by 38
Self-citation
Predicting suicide with the SAD PERSONS scale
Katz, C., Randall, J. R., Sareen, J., Chateau, D. G., Walld, R., Leslie, W. D., Wang, J., & Bolton, J. M. (2017) · Depression and Anxiety · doi:10.1002/da.22632 · Cited by 37
Comparison of Suicide Risk by Mental Illness: a Retrospective Review of 14-Year Electronic Medical Records
Song, Y., Rhee, S. J., Lee, H., Kim, M. J., Shin, D., & Ahn, Y. M. (2020) · Journal of Korean Medical Science · doi:10.3346/jkms.2020.35.e402 · Cited by 42
Prediction across healthcare settings: a case study in predicting emergency department disposition
Barak‐Corren, Y., Chaudhari, P. P., Perniciaro, J. L., Waltzman, M. L., Fine, A. M., & Reis, B. Y. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00537-x · Cited by 42
Self-citation
Outpatient Engagement and Predicted Risk of Suicide Attempts in Fibromyalgia
McKernan, L. C., Lenert, M. C., Crofford, L. J., & Walsh, C. G. (2018) · Arthritis Care & Research · doi:10.1002/acr.23748 · Cited by 37
Implementing Machine Learning Models for Suicide Risk Prediction in Clinical Practice: Focus Group Study With Hospital Providers
Bentley, K. H., Zuromski, K. L., Fortgang, R. G., Madsen, E., Kessler, D. T., Lee, H., Nock, M. K., Reis, B. Y., Castro, V. M., & Smoller, J. W. (2022) · JMIR Formative Research · doi:10.2196/30946 · Cited by 33
Self-citation
What health records data are required for accurate prediction of suicidal behavior?
Simon, G. E., Shortreed, S. M., Johnson, E., Rossom, R. C., Lynch, F. L., Ziebell, R. A., & Penfold, A. R. B. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz136 · Cited by 35
Patient perspectives on acceptability of, and implementation preferences for, use of electronic health records and machine learning to identify suicide risk
Yarborough, B. J. H., & Stumbo, S. P. (2021) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2021.02.008 · Cited by 35
Machine learning algorithms and their predictive accuracy for suicide and self-harm: Systematic review and meta-analysis
Spittal, M. J., Guo, X. A., Kang, L., Kirtley, O. J., Clapperton, A., Hawton, K. E., Kapur, N., Pirkis, J., & Carter, G. L. (2025) · PLoS Medicine · doi:10.1371/journal.pmed.1004581 · Cited by 41
Comparison of traditional model-based statistical methods with machine learning for the prediction of suicide behaviour
Grendas, L. N., Chiapella, L. C., Rodante, D., & Daray, F. M. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.11.029 · Cited by 35
Improving Suicide Prevention Through Evidence-Based Strategies: A Systematic Review
Mann, J. J., Michel, C. A., & Auerbach, R. P. (2023) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.23021004 · Cited by 34
Combining clinical notes with structured electronic health records enhances the prediction of mental health crises
Garriga, R., Buda, T. S., Guerreiro, J., Iglesias, J. O., Aguerri, I. E., & Matić, A. (2023) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101260 · Cited by 36
Research Domain Criteria scores estimated through natural language processing are associated with risk for suicide and accidental death
McCoy, T. H., Pellegrini, A. M., & Perlis, R. H. (2019) · Depression and Anxiety · doi:10.1002/da.22882 · Cited by 31
Self-citation
Theory of Mind and Suicidality: A Meta-Analysis
Nestor, B. A., & Sutherland, S. L. (2021) · Archives of Suicide Research · doi:10.1080/13811118.2021.1939209 · Cited by 33
Association of Online Risk Factors With Subsequent Youth Suicide-Related Behaviors in the US
Sumner, S. A., Ferguson, B., Bason, B., Dink, J., Yard, E. E., Hertz, M. F., Hilkert, B., Holland, K. M., Mercado-Crespo, M., Tang, S., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.25860 · Cited by 31
A Critical Review of Text Mining Applications for Suicide Research
Boggs, J. M., & Kafka, J. M. (2022) · Current Epidemiology Reports · doi:10.1007/s40471-022-00293-w · Cited by 32

Authors: Barak-Corren, Y., Castro, V. M., Javitt, S., Hoffnagle, A. G., Dai, Y., Perlis, R. H., Nock, M. K., Smoller, J. W., & Reis, B. Y.
Affiliations: From the Predictive Medicine Group, Boston Children’s Hospital Informatics Program, Boston; the Technion, Israeli Institute of Technology, Haifa, Israel; the Partners Research Information Systems and Computing, Boston; the Department of Psychiatry, Massachusetts General Hospital, Boston; the Psychiatric and Neurodevelopmental Genetics Unit, Center for Human Genetic Research, Massachusetts General Hospital, Boston; the Department of Psychology, Harvard University, Boston; and Harvard Medical School, Boston.
Boston Children's Hospital (US)
ORCID: Castro, Victor M.
Dai, Yael
Perlis, Roy H.
Nock, Matthew K.
Smoller, Jordan W.
Reis, Ben Y.
Venue: American Journal of Psychiatry
Publisher: American Psychiatric Association Publishing
Published: 2017-02-01
Volume: 174
Issue: 2
Pages: 154-162
ISSN: 0002-953X (ISSN-L)
1535-7228
DOI: 10.1176/appi.ajp.2016.16010077
OpenAlex: W2509888018
Cited by: 339
References: 26
Citations by year: 2026: 23 · 2025: 43 · 2024: 32 · 2023: 41 · 2022: 38 · 2021: 48 · 2020: 37 · 2019: 41 · 2018: 26 · 2017: 10
FWCI: 34.32
Type: journal article
Language: en
Open access: closed
Locations: American Journal of Psychiatry (publishedVersion)
PubMed (publishedVersion)
Funders: Pfizer
Massachusetts General Hospital
Tommy Fuss Fund
Harvard University
Department of Psychology, Harvard University
National Institute of Mental Health (K24MH094614)
Topics: Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
Social Sciences › Psychology › Social Psychology › Mental Health via Writing
Keywords: suicidal behavior, suicide risk prediction, electronic health records, suicide attempts, suicide mortality, risk factors, substance abuse, mental illness, injuries, chronic disease, early warning systems, risk screening
MeSH terms: Adult, Aged, Mental Disorders, Female, Humans, Longitudinal Studies, Male, Massachusetts, Middle Aged, Registries, Suicide, Suicide, Attempted, Case-Control Studies, Risk Assessment, Substance-Related Disorders, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Predicting suicidal behavior from longitudinal electronic health records.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks