The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Applications of machine learning algorithms to predict therapeutic outcomes in depression: A meta-analysis and systematic review
Abstract
BACKGROUND No previous study has comprehensively reviewed the application of machine learning algorithms in mood disorders populations. Herein, we qualitatively and quantitatively evaluate previous studies of machine learning-devised models that predict therapeutic outcomes in mood disorders populations. METHODS We searched Ovid MEDLINE/PubMed from inception to February 8, 2018 for relevant studies that included adults with bipolar or unipolar depression; assessed therapeutic outcomes with a pharmacological, neuromodulatory, or manual-based psychotherapeutic intervention for depression; applied a machine learning algorithm; and reported predictors of therapeutic response. A random-effects meta-analysis of proportions and meta-regression analyses were conducted. RESULTS We identified 639 records: 75 full-text publications were assessed for eligibility; 26 studies (n=17,499) and 20 studies (n=6325) were included in qualitative and quantitative review, respectively. Classification algorithms were able to predict therapeutic outcomes with an overall accuracy of 0.82 (95% confidence interval [CI] of [0.77, 0.87]). Pooled estimates of classification accuracy were significantly greater (p < 0.01) in models informed by multiple data types (e.g., composite of phenomenological patient features and neuroimaging or peripheral gene expression data; pooled proportion [95% CI] = 0.93[0.86, 0.97]) when compared to models with lower-dimension data types (pooledproportion=0.68[0.62,0.74]to0.85[0.81,0.88]). LIMITATIONS Most studies were retrospective; differences in machine learning algorithms and their implementation (e.g., cross-validation, hyperparameter tuning); cannot infer importance of individual variables fed into learning algorithm. CONCLUSIONS Machine learning algorithms provide a powerful conceptual and analytic framework capable of integrating multiple data types and sources. An integrative approach may more effectively model neurobiological components as functional modules of pathophysiology embedded within the complex, social dynamics that influence the phenomenology of mental disorders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
(2016) · Cited by 11,679
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472
THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL
CLOPPER, C. J., & PEARSON, E. S. (1934) · Biometrika · doi:10.1093/biomet/26.4.404 · Cited by 5,003
mixOmics: An R package for ‘omics feature selection and multiple data integration
Rohart, F., Gautier, B., Singh, A., & Lê Cao, K.-A. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005752 · Cited by 4,056
Trivedi, M. H., Rush, A. J., Wisniewski, S. R., Nierenberg, A. A., Warden, D., Ritz, L., Norquist, G., Howland, R. H., Lebowitz, B., McGrath, P. J., et al. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.1.28 · Cited by 3,879
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955
Transformations Related to the Angular and the Square Root
Freeman, M. F., & Tukey, J. W. (1950) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729756 · Cited by 2,628
Estimating the true global burden of mental illness
Vigo, D., Thornicroft, G., & Atun, R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00505-2 · Cited by 2,494
Resting-state connectivity biomarkers define neurophysiological subtypes of depression
Drysdale, A. T., Grosenick, L., Downar, J., Dunlop, K., Mansouri, F., Meng, Y., Fetcho, R. N., Zebley, B., Oathes, D. J., Etkin, A., et al. (2017) · Nature Medicine · doi:10.1038/nm.4246 · Cited by 2,170
Metaprop: a Stata command to perform meta-analysis of binomial data
Nyaga, V. N., Arbyn, M., & Aerts, M. (2014) · Archives of Public Health · doi:10.1186/2049-3258-72-39 · Cited by 2,139
Raison, C. L., Rutherford, R. E., Woolwine, B. J., Shuo, C., Schettler, P., Drake, D. F., Haroon, E., & Miller, A. H. (2013) · JAMA Psychiatry · doi:10.1001/2013.jamapsychiatry.4 · Cited by 1,617
Classification and prediction of clinical Alzheimer's diagnosis based on plasma signaling proteins
Ray, S., Britschgi, M., Herbert, C., Takeda-Uchimura, Y., Boxer, A., Blennow, K., Friedman, L. F., Galasko, D. R., Jutel, M., Karydas, A., et al. (2007) · Nature Medicine · doi:10.1038/nm1653 · Cited by 1,048
Orrù, G., Pettersson-Yeo, W., Marquand, A. F., Sartori, G., & Mechelli, A. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.004 · Cited by 1,012
Computational psychiatry as a bridge from neuroscience to clinical applications
Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4238 · Cited by 1,002
Toward a comprehensive developmental model for major depression in women
Kendler, K. S., Gardner, C. O., & Prescott, C. A. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.7.1133 · Cited by 962
Insel, T. R., & Cuthbert, B. N. (2015) · Science · doi:10.1126/science.aab2358 · Cited by 840
Machine Learning for Precision Psychiatry: Opportunities and Challenges
Bzdok, D., & Meyer-Lindenberg, A. (2018) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2017.11.007 · Cited by 796
Cross-trial prediction of treatment outcome in depression: a machine learning approach
Chekroud, A. M., Zotti, R. J., Shehzad, Z., Gueorguieva, R., Johnson, M. K., Trivedi, M. H., Cannon, T. D., Krystal, J. H., & Corlett, P. R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00471-x · Cited by 676
Inflammation and clinical response to treatment in depression: A meta-analysis
Strawbridge, R., Arnone, D., Danese, A., Papadopoulos, A., Herane Vives, A., & Cleare, A. J. (2015) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.06.007 · Cited by 666
Network Medicine — From Obesity to the “Diseasome”
Barabási, A.-L. (2007) · New England Journal of Medicine · doi:10.1056/nejme078114 · Cited by 541
Köhler, C. A., Freitas, T. H., Stubbs, B., Maes, M., Solmi, M., Veronese, N., de Andrade, N. Q., Morris, G., Fernandes, B. S., Brunoni, A. R., et al. (2017) · Molecular Neurobiology · doi:10.1007/s12035-017-0632-1 · Cited by 449
The binomial distribution of meta-analysis was preferred to model within-study variability
Hamza, T. H., van Houwelingen, H. C., & Stijnen, T. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.016 · Cited by 385
Clustering of depression and inflammation in adolescents previously exposed to childhood adversity
Miller, G. E., & Cole, S. W. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.02.034 · Cited by 331
Chekroud, A. M., Gueorguieva, R., Krumholz, H. M., Trivedi, M. H., Krystal, J. H., & McCarthy, G. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0025 · Cited by 276
A wavelet-based technique to predict treatment outcome for Major Depressive Disorder
Mumtaz, W., Xia, L., Mohd Yasin, M. A., Azhar Ali, S. S., & Malik, A. S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0171409 · Cited by 268
Redlich, R., Opel, N., Grotegerd, D., Dohm, K., Zaremba, D., Bürger, C., Münker, S., Mühlmann, L., Wahl, P., Heindel, W., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.0316 · Cited by 267
Kessler, R. C., van Loo, H. M., Wardenaar, K. J., Bossarte, R. M., Brenner, L. A., Cai, T., Ebert, D. D., Hwang, I., Li, J., de Jonge, P., et al. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.198 · Cited by 254
Rethorst, C. D., Toups, M. S., Greer, T. L., Nakonezny, P. A., Carmody, T. J., Grannemann, B. D., Huebinger, R. M., Barber, R. C., & Trivedi, M. H. (2013) · Molecular Psychiatry · doi:10.1038/mp.2012.125 · Cited by 211
Gadad, B. S., Jha, M. K., Czysz, A., Furman, J. L., Mayes, T. L., Emslie, M. P., & Trivedi, M. H. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.001 · Cited by 205
Rumshisky, A., Ghassemi, M., Naumann, T., Szolovits, P., Castro, V. M., McCoy, T. H., & Perlis, R. H. (2016) · Translational Psychiatry · doi:10.1038/tp.2015.182 · Cited by 189
Combining clinical variables to optimize prediction of antidepressant treatment outcomes
Iniesta, R., Malki, K., Maier, W., Rietschel, M., Mors, O., Hauser, J., Henigsberg, N., Dernovsek, M. Z., Souery, D., Stahl, D., et al. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.03.016 · Cited by 179
Patel, M. J., Andreescu, C., Price, J. C., Edelman, K. L., Reynolds, C. F., & Aizenstein, H. J. (2015) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4262 · Cited by 168
van Waarde, J. A., Scholte, H. S., van Oudheusden, L. J. B., Verwey, B., Denys, D., & van Wingen, G. A. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.78 · Cited by 164
Bailey, N. W., Hoy, K. E., Rogasch, N. C., Thomson, R. H., McQueen, S., Elliot, D., Sullivan, C. M., Fulcher, B. D., Daskalakis, Z. J., & Fitzgerald, P. B. (2018) · Brain Stimulation · doi:10.1016/j.brs.2017.10.015 · Cited by 162
Khodayari-Rostamabad, A., Reilly, J. P., Hasey, G. M., de Bruin, H., & MacCrimmon, D. J. (2013) · Clinical Neurophysiology · doi:10.1016/j.clinph.2013.04.010 · Cited by 161
Liu, F., Guo, W., Yu, D., Gao, Q. C., Gao, K., Xue, Z., Du, H., Zhang, J., Tan, C., Liu, Z., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040968 · Cited by 147
Rosenblat, J. D., Lee, Y., & McIntyre, R. S. (2017) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.15r10583 · Cited by 138
Self-citationEtkin, A., Patenaude, B., Song, Y. J. C., Usherwood, T., Rekshan, W. R., Schatzberg, A. F., Rush, A. J., & Williams, L. M. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.333 · Cited by 138
An extended random-effects approach to modeling repeated, overdispersed count data
Molenberghs, G., Verbeke, G. N., & Demétrio, C. G. B. (2007) · Lifetime Data Analysis · doi:10.1007/s10985-007-9064-y · Cited by 138
Costafreda, S. G., Khanna, A., Mourao-Miranda, J., & Fu, C. H. Y. (2009) · NeuroReport · doi:10.1097/wnr.0b013e3283294159 · Cited by 129
Trivedi, M. H., Morris, D. W., Wisniewski, S. R., Lesser, I. M., Nierenberg, A. A., Daly, E., Kurian, B. T., Gaynes, B. N., Balasubramani, G. K., & Rush, A. J. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12020250 · Cited by 129
Computational nosology and precision psychiatry
Friston, K. J., Redish, A. D., & Gordon, J. A. (2017) · Computational Psychiatry · doi:10.1162/cpsy_a_00001 · Cited by 126
Neuroanatomy of verbal working memory as a diagnostic biomarker for depression
Marquand, A. F., Mourão-Miranda, J., Brammer, M. J., Cleare, A. J., & Fu, C. H. Y. (2008) · Neuroreport · doi:10.1097/wnr.0b013e328310425e · Cited by 125
Al-Kaysi, A. M., Al-Ani, A., Loo, C. K. A., Powell, T. Y., Martin, D. M., Breakspear, M. J., & Boonstra, T. W. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.10.021 · Cited by 112
Refining Prediction in Treatment-Resistant Depression
Kautzky, A., Dold, M., Bartova, L., Spies, M., Vanicek, T., Souery, D., Montgomery, S., Mendlewicz, J., Zohar, J., Fabbri, C., et al. (2017) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.16m11385 · Cited by 101
Efficacy of Vortioxetine on Cognitive Functioning in Working Patients With Major Depressive Disorder
McIntyre, R. S., Florea, I., Tonnoir, B., Loft, H., Lam, R. W., & Christensen, M. C. (2017) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.16m10744 · Cited by 100
Self-citationEffect of Electroconvulsive Therapy on Striatal Morphometry in Major Depressive Disorder
Wade, B., Joshi, S. H., Njau, S. N., Leaver, A. M., Vasavada, M. M., Woods, R. P., Gutman, B. A., Thompson, P. M., Espinoza, R. T., & Narr, K. L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.48 · Cited by 99
Kautzky, A., Baldinger, P., Souery, D., Montgomery, S., Mendlewicz, J., Zohar, J., Serretti, A., Lanzenberger, R. R., & Kasper, S. F. (2015) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.01.001 · Cited by 96
Korgaonkar, M. S., Rekshan, W. R., Gordon, E., Rush, A. J., Williams, L. M., Blasey, C. M., & Grieve, S. M. (2014) · EBioMedicine · doi:10.1016/j.ebiom.2014.12.002 · Cited by 90
Data-Driven Phenotypic Categorization for Neurobiological Analyses: Beyond DSM-5 Labels
Dam, N. T. V., O’Connor, D. A., Marcelle, E. T., Ho, E. J., Craddock, R. C., Tobe, R. H., Gabbay, V., Hudziak, J. J., Castellanos, F. X., LEVENTHAL, B. L., et al. (2016) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.06.027 · Cited by 86
Cognition in major depressive disorder: a ‘Systemically Important Functional Index’ (SIFI)
McIntyre, R. S., & Lee, Y. (2016) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000221 · Cited by 85
Self-citationGuilloux, J., Bassi, S., Ding, Y., Walsh, C., Turecki, G., Tseng, G. C., Cyranowski, J. M., & Sibille, E. L. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.226 · Cited by 71
Jain, F. A., Hunter, A. M., Brooks, J. O., & Leuchter, A. F. (2013) · Depression and Anxiety · doi:10.1002/da.22045 · Cited by 66
Neural network analysis in pharmacogenetics of mood disorders
Serretti, A., & Smeraldi, E. (2004) · BMC Medical Genetics · doi:10.1186/1471-2350-5-27 · Cited by 59
Symptom Clusters as Predictors of Late Response to Antidepressant Treatment
Trivedi, M. H., Morris, D. W., Grannemann, B. D., & Mahadi, S. (2005) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v66n0816 · Cited by 55
Belzeaux-R, R., Lin, C., Ding, Y., Bergon, A., Ibrahim, E. C., Turecki, G., Tseng, G. C., & Sibille, E. L. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.07.009 · Cited by 31
Khodayari-Rostamabad, A., Reilly, J. P., Hasey, G., de Bruin, H., & MacCrimmon, D. J. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6091584 · Cited by 28
Serretti, A., Zanardi, R., Mandelli, L., Smeraldi, E., & Colombo, C. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.08.008 · Cited by 26
Thibodeau, M. A., Quilty, L. C., Fruyt, F. D., Bolle, M. D., Rouillon, F., & Bagby, R. M. (2014) · Depression and Anxiety · doi:10.1002/da.22293 · Cited by 26
Brain‐derived neurotrophic factor, impaired glucose metabolism, and bipolar disorder course
Mansur, R. B., Santos, C. M., Rizzo, L. B., Asevedo, E. D. M., da Cunha, G. R., Noto, M. N., Pedrini, M., Zeni‐Graiff, M., Cordeiro, Q., Vinberg, M., et al. (2016) · Bipolar Disorders · doi:10.1111/bdi.12399 · Cited by 24
Self-citationSuicide Prediction With Machine Learning
Rakesh, G. (2017) · American Journal of Psychiatry Residents Journal · doi:10.1176/appi.ajp-rj.2017.120105 · Cited by 12
Toward a Systems Biology of Mood Disorder
McIntosh, A. M. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.10.009 · Cited by 8
Cited by
McIntyre, R. S., Alsuwaidan, M., Baune, B. T., Berk, M., Demyttenaere, K., Goldberg, J. F., Gorwood, P., Ho, R., Kasper, S., Kennedy, S. H., et al. (2023) · World Psychiatry · doi:10.1002/wps.21120 · Cited by 836
Self-citationMcIntyre, R. S., Rosenblat, J. D., Nemeroff, C. B., Sanacora, G., Murrough, J. W., Berk, M., Brietzke, E., Dodd, S., Gorwood, P., Ho, R., et al. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20081251 · Cited by 731
Self-citationThe promise of machine learning in predicting treatment outcomes in psychiatry
Chekroud, A. M., Bondar, J., Delgadillo, J., Doherty, G., Wasil, A., Fokkema, M., Cohen, Z., Belgrave, D., DeRubeis, R., Iniesta, R., et al. (2021) · World Psychiatry · doi:10.1002/wps.20882 · Cited by 531
Thieme, A., Belgrave, D., & Doherty, G. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3398069 · Cited by 406
Bickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184
Metadata
- Authors
- Lee, Y., Ragguett, R.-M., Mansur, R. B., Boutilier, J. J., Rosenblat, J. D., Trevizol, A., Brietzke, E., Lin, K., Pan, Z., Subramaniapillai, M., Chan, T. C. Y., Fus, D., Park, C., Musial, N., Zuckerman, H., Chen, V. C.-H., Ho, R., Rong, C., & McIntyre, R. S.
- Venue
- Journal of Affective Disorders
- Publisher
- Elsevier BV
- Published
- 2018-12
- Volume
- 241
- Pages
- 519-532
- ISSN
- 0165-0327 (ISSN-L)
- OpenAlex
- W2885069035
- Cited by
- 408
- References
- 70
- FWCI
- 4.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.