Machine learning enhances prediction of illness course: a longitudinal study in eating disorders
Open accessAbstract
Background: Psychiatric disorders, including eating disorders (EDs), have clinical outcomes that range widely in severity and chronicity. The ability to predict such outcomes is extremely limited. Machine-learning (ML) approaches that model complexity may optimize the prediction of multifaceted psychiatric behaviors. However, the investigations of many psychiatric concerns have not capitalized on ML to improve prognosis. This study conducted the first comparison of an ML approach (elastic net regularized logistic regression) to traditional regression to longitudinally predict ED outcomes. Methods: Females with heterogeneous ED diagnoses completed demographic and psychiatric assessments at baseline (n= 415) and Year 1 (n= 320) and 2 (n= 277) follow-ups. Elastic net and traditional logistic regression models comprising the same baseline variables were compared in ability to longitudinally predict ED diagnosis, binge eating, compensatory behavior, and underweight BMI at Years 1 and 2. Results: Elastic net models had higher accuracy for all outcomes at Years 1 and 2 [average Area Under the Receiving Operating Characteristics Curve (AUC) = 0.78] compared to logistic regression (average AUC = 0.67). Model performance did not deteriorate when the most important predictor was removed or an alternative ML algorithm (random forests) was applied. Baseline ED (e.g. diagnosis), psychiatric (e.g. hospitalization), and demographic (e.g. ethnicity) characteristics emerged as important predictors in exploratory predictor importance analyses. Conclusions: ML algorithms can enhance the prediction of ED symptoms for 2 years and may identify important risk markers. The superior accuracy of ML for predicting complex outcomes suggests that these approaches may ultimately aid in advancing precision medicine for serious psychiatric disorders.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The elastic net algorithm was used because penalization improves prediction accuracy and maintains clinical interpretability compared with less transparent machine learning algorithms.
“We used the elastic net algorithm, given substantial evidence that penalization improves prediction accuracy,25–27 alongside its well-established accuracy and robustness28,29 and ability to maintain clinical interpretability compared with less transparent machine learning algorithms (eg, random forests, neural networks).”
From A pilot study using frequent inpatient assessments of suicidal thinking to predict short-term postdischarge suicidal behavior (2021) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Kuhn, M., & Johnson, K. (2013) · doi:10.1007/978-1-4614-6849-3 · Cited by 6,788 · cited 3× · see citing works
“…although cross-validation is an accepted ML practice for investigations with smaller sample sizes and we conducted upsampling within the training (but not test) datasets (Kuhn & Johnson, 2013), it has the potential to yield overly optimistic models (Smith, Seaman, Wood, Royston, & White, 2014).”
MethodRisk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., Musacchio, K. M., Jaroszewski, A. C., Chang, B. P., & Nock, M. K. (2017) · Psychological Bulletin · doi:10.1037/bul0000084 · Cited by 3,784 · see citing works
The assessment of binge eating severity among obese persons
Gormally, J., Black, S., Daston, S., & Rardin, D. (1982) · Addictive Behaviors · doi:10.1016/0306-4603(82)90024-7 · Cited by 2,129 · see citing works
Flexible Imputation of Missing Data
van Buuren, S. (2012) · doi:10.1201/b11826 · Cited by 2,022 · see citing works
Berg, K. C., Peterson, C. B., Frazier, P., & Crow, S. J. (2012) · International Journal of Eating Disorders · doi:10.1002/eat.20931 · Cited by 1,042 · see citing works
Self-citationRecovery from anorexia nervosa and bulimia nervosa at 22-year follow-up
Eddy, K. T., Tabri, N., Thomas, J. J., Murray, H. B., Keshaviah, A., Hastings, E., Edkins, K., Krishna, M., Herzog, D. B., Keel, P. K., et al. (2017) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.15m10393 · Cited by 535 · see citing works
Ogutu, J. O., Schulz-Streeck, T., & Piepho, H.-P. (2012) · BMC Proceedings · doi:10.1186/1753-6561-6-s2-s10 · Cited by 440 · see citing works
Addressing critical gaps in the treatment of eating disorders
Kazdin, A. E., Fitzsimmons‐Craft, E. E., & Wilfley, D. E. (2017) · International Journal of Eating Disorders · doi:10.1002/eat.22670 · Cited by 389 · see citing works
Relapse in anorexia nervosa: a survival analysis
CARTER, J. C., BLACKMORE, E., SUTANDAR-PINNOCK, K., & WOODSIDE, D. B. (2004) · Psychological Medicine · doi:10.1017/s0033291703001168 · Cited by 389 · see citing works
Stice, E., Fisher, M., & Lowe, M. R. (2004) · Psychological Assessment · doi:10.1037/1040-3590.16.1.51 · Cited by 364 · see citing works
Berg, K. C., Stiles‐Shields, E. C., Swanson, S. A., Peterson, C. B., Lebow, J., & Le Grange, D. (2012) · International Journal of Eating Disorders · doi:10.1002/eat.20948 · Cited by 126 · see citing works
Self-citationGuided self-help for eating disorders: a systematic review and metaregression
Traviss‐Turner, G. D., West, R. M., & Hill, A. J. (2017) · European Eating Disorders Review · doi:10.1002/erv.2507 · Cited by 98 · see citing works
A 4-year prospective study of eating disorder NOS compared with full eating disorder syndromes
Agras, W. S., Crow, S., Mitchell, J. E., Halmi, K. A., & Bryson, S. (2009) · International Journal of Eating Disorders · doi:10.1002/eat.20708 · Cited by 97 · see citing works
Self-citationPredicting imminent suicidal thoughts and nonfatal attempts: The role of complexity
Ribeiro, J. D., Huang, X., Fox, K. R., Walsh, C. G., & Linthicum, K. P. (2019) · Clinical Psychological Science · doi:10.1177/2167702619838464 · Cited by 75 · see citing works
Prediction of remission in obsessive compulsive disorder using a novel machine learning strategy
Askland, K. D., Garnaat, S., Sibrava, N. J., Boisseau, C. L., Strong, D., Mancebo, M., Greenberg, B., Rasmussen, S., & Eisen, J. (2015) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1463 · Cited by 75 · see citing works
A path to defining excellence in intensive treatment for eating disorders
Guarda, A. S., Wonderlich, S., Kaye, W., & Attia, E. (2018) · International Journal of Eating Disorders · doi:10.1002/eat.22899 · Cited by 28 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Wang, S. B., Coppersmith, D. D. L., Kleiman, E. M., Bentley, K. H., Millner, A. J., Fortgang, R., Mair, P., Dempsey, W., Huffman, J. C., & Nock, M. K. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.0591 · Cited by 98 · see citing works
Self-citationForrest, L. N., Jacobucci, R. C., & Grilo, C. M. (2022) · Psychological Medicine · doi:10.1017/s0033291720002287 · Cited by 21 · see citing works
Mensinger, J. L., Cox, S. A., & Henretty, J. R. (2021) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000962 · Cited by 18 · see citing works
- Authors
- Haynos, A. F., Wang, S. B., Lipson, S., Peterson, C. B., Mitchell, J. E., Halmi, K. A., Agras, W. S., & Crow, S. J.
- Affiliations
- University of Minnesota (US)
- Harvard University (US)
- University of North Dakota (US)
- Cornell University (US)
- Stanford Medicine (US)
- Corresponding author
- Haynos, Ann F.
- ORCID
- Venue
- Psychological Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2020-02-28
- Volume
- 51
- Issue
- 8
- Pages
- 1392-1402
- ISSN
- 0033-2917 (ISSN-L)
- 1469-8978
- PMC
- PMC7483262
- OpenAlex
- W3007991891
- Cited by
- 73
- References
- 16
- Citations by year
- 2026: 11 · 2025: 15 · 2024: 15 · 2023: 13 · 2022: 10 · 2021: 5 · 2020: 4
- FWCI
- 3.20
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psychological Medicine (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (K23MH112867, T32MH082761)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Eating Disorders and Behaviors
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- eating disorders, machine learning, binge eating, compensatory behavior, risk indicators, precision medicine, longitudinal prediction, random forest
- MeSH terms
- Machine Learning, Feeding and Eating Disorders, Bulimia, Female, Humans, Longitudinal Studies, Binge-Eating Disorder
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review