CoChat

External validation of the international risk prediction algorithm for major depressive episode in the US general population: the PredictD-US study

Open access
Nigatu, Yeshambel T., Liu, Yan, Wang, JianLi · 2016 · BMC Psychiatry

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Multivariable risk prediction algorithms are useful for making clinical decisions and for health planning. While prediction algorithms for new onset of major depression in the primary care attendees in Europe and elsewhere have been developed, the performance of these algorithms in different populations is not known. The objective of this study was to validate the PredictD algorithm for new onset of major depressive episode (MDE) in the US general population. METHODS: Longitudinal study design was conducted with approximate 3-year follow-up data from a nationally representative sample of the US general population. A total of 29,621 individuals who participated in Wave 1 and 2 of the US National Epidemiologic Survey on Alcohol and Related Conditions (NESARC) and who did not have an MDE in the past year at Wave 1 were included. The PredictD algorithm was directly applied to the selected participants. MDE was assessed by the Alcohol Use Disorder and Associated Disabilities Interview Schedule, based on the DSM-IV criteria. RESULTS: Among the participants, 8 % developed an MDE over three years. The PredictD algorithm had acceptable discriminative power (C-statistics = 0.708, 95 % CI: 0.696, 0.720), but poor calibration (p < 0.001) with the NESARC data. In the European primary care attendees, the algorithm had a C-statistics of 0.790 (95 % CI: 0.767, 0.813) with a perfect calibration. CONCLUSIONS: The PredictD algorithm has acceptable discrimination, but the calibration capacity was poor in the US general population despite of re-calibration. Therefore, based on the results, at current stage, the use of PredictD in the US general population for predicting individual risk of MDE is not encouraged. More independent validation research is needed.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12888-016-0971-x

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Discrimination graph: Receiver operating characteristic (ROC) curve
Fig. 1 Discrimination graph: Receiver operating characteristic (ROC) curveCC BY · PubMed Central
Fig. 2 The predicted risk proportion versus observed risk proportion of major depressive episode by 10 groups
Fig. 2 The predicted risk proportion versus observed risk proportion of major depressive episode by 10 groupsCC BY · PubMed Central
Fig. 3 Plots of mean predicted probability against observed probability of Major Depressive. Episode within deciles of predicted risk without (a) and with re-calibration (b)
Fig. 3 Plots of mean predicted probability against observed probability of Major Depressive. Episode within deciles of predicted risk without (a) and with re-calibration (b)CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 33 references

Cited by

See all 21

Metadata

Authors
Nigatu, Y. T., Liu, Y., & Wang, J.
Affiliations
University of Calgary (CA)
Corresponding author
Nigatu, Yeshambel T.
Venue
BMC Psychiatry
Published
2016-07-22
Volume
16
Issue
1
Pages
256-256
ISSN
1471-244X (ISSN-L)
OpenAlex
W2499474258
Cited by
18
References
33
Citations by year
2022: 1 · 2021: 4 · 2020: 4 · 2019: 2 · 2018: 5 · 2017: 2
FWCI
4.72
Type
journal article
Language
en
Open access
Locations
  • BMC Psychiatry (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • Canadian Institutes of Health Research (114970_1)
  • National Institute on Alcohol Abuse and Alcoholism
  • National Institute on Drug Abuse
Topics
  • Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
  • Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
Keywords
major depressive episode, depression risk prediction, external validation, algorithm calibration, discrimination (statistics), NESARC, cross-population generalizability
MeSH terms
Adult, Algorithms, Major Depressive Disorder, Depressive Disorder, Major, Female, Humans, Longitudinal Studies, Male, Middle Aged, Predictive Value of Tests, Primary Health Care, Risk Factors, United States, Prevalence, Risk Assessment, Diagnostic and Statistical Manual of Mental Disorders

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: External validation of the international risk prediction algorithm for major depressive episode in the US general population: the PredictD-US study. https://app.cochat.ai/papers/10.1186/s12888-016-0971-x
The paper
Nigatu, Y. T., Liu, Y., & Wang, J. (2016). External validation of the international risk prediction algorithm for major depressive episode in the US general population: the PredictD-US study. BMC Psychiatry. https://doi.org/10.1186/s12888-016-0971-x

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.