Detecting Neuroimaging Biomarkers for Depression: A Meta-analysis of Multivariate Pattern Recognition Studies
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Multiple studies have examined functional and structural brain alteration in patients diagnosed with major depressive disorder (MDD). The introduction of multivariate statistical methods allows investigators to utilize data concerning these brain alterations to generate diagnostic models that accurately differentiate patients with MDD from healthy control subjects (HCs). However, there is substantial heterogeneity in the reported results, the methodological approaches, and the clinical characteristics of participants in these studies. METHODS: We conducted a meta-analysis of all studies using neuroimaging (volumetric measures derived from T1-weighted images, task-based functional magnetic resonance imaging [MRI], resting-state MRI, or diffusion tensor imaging) in combination with multivariate statistical methods to differentiate patients diagnosed with MDD from HCs. RESULTS: Thirty-three (k = 33) samples including 912 patients with MDD and 894 HCs were included in the meta-analysis. Across all studies, patients with MDD were separated from HCs with 77% sensitivity and 78% specificity. Classification based on resting-state MRI (85% sensitivity, 83% specificity) and on diffusion tensor imaging data (88% sensitivity, 92% specificity) outperformed classifications based on structural MRI (70% sensitivity, 71% specificity) and task-based functional MRI (74% sensitivity, 77% specificity). CONCLUSIONS: Our results demonstrate the high representational capacity of multivariate statistical methods to identify neuroimaging-based biomarkers of depression. Future studies are needed to elucidate whether multivariate neuroimaging analysis has the potential to generate clinically useful tools for the differential diagnosis of affective disorders and the prediction of both treatment response and functional outcome.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Power, J. D., Barnes, K. A., Snyder, A. Z., Schlaggar, B. L., & Petersen, S. E. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.018 · Cited by 7,429
Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients
Beck, A. T., Steer, R. A., Ball, R., & Ranieri, W. F. (1996) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6703_13 · Cited by 5,965
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910 · cited 3×
“A statistical test for funnel plot asymmetry is provided by a regression of logDOR with 1 ffiffiffiffiffiffiffi ESS p weighted by ESS (44).”
InfluentialThe influence of head motion on intrinsic functional connectivity MRI
Van Dijk, K. R. A., Sabuncu, M. R., & Buckner, R. L. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.044 · Cited by 2,344
Kaiser, R. H., Andrews-Hanna, J. R., Wager, T. D., & Pizzagalli, D. A. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.0071 · Cited by 2,281
Cross-national epidemiology of DSM-IV major depressive episode
Bromet, E., Andrade, L. H., Hwang, I., Sampson, N. A., Alonso, J., de Girolamo, G., de Graaf, R., Demyttenaere, K., Hu, C., Iwata, N., et al. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-90 · Cited by 2,221
for the ENIGMA-Major Depressive Disorder Working Group, Schmaal, L., Veltman, D. J., van Erp, T. G. M., Sämann, P. G., Frodl, T., Jahanshad, N., Loehrer, E., Tiemeier, H., Hofman, A., et al. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.69 · Cited by 1,172
Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12070999 · Cited by 1,163 · cited 1×
“For example, the recent investigation of the test-retest reliability of the diagnostic categories of the DSM-5 indicated that MDD was diagnosed with limited accuracy (81).”
Satterthwaite, T. D., Wolf, D. H., Loughead, J., Ruparel, K., Elliott, M. A., Hakonarson, H., Gur, R. C., & Gur, R. E. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.12.063 · Cited by 1,125
Kapur, S., Phillips, A. G., & Insel, T. R. (2012) · Molecular Psychiatry · doi:10.1038/mp.2012.105 · Cited by 980
Manea, L., Gilbody, S., & McMillan, D. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2014.09.009 · Cited by 795
Zeng, L.-L., Shen, H., Liu, L., Wang, L., Li, B., Fang, P., Zhou, Z., Li, Y., & Hu, D. (2012) · Brain · doi:10.1093/brain/aws059 · Cited by 748 · cited 1×
“…studies have successfully used multivariate statistical methods to guide the diagnosis of depression based on structural magnetic resonance imaging (sMRI) data (19,21,25 – 27), resting-state functional MRI (rsfMRI) data (26,28 – 34), and task-based functional MRI (fMRI) data (35 – 39).”
Eaton, W. W. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830230023003 · Cited by 489 · cited 1×
“(26) assessed a sample of subjects with late-life depression, and thus these results may not generalize to individual subjects with first depressive episodes that usually occur at age 30 (73).”
Disease state prediction from resting state functional connectivity
Craddock, R. C., Holtzheimer, P. E., Hu, X. P., & Mayberg, H. S. (2009) · Magnetic Resonance in Medicine · doi:10.1002/mrm.22159 · Cited by 411
Wolfers, T., Buitelaar, J. K., Beckmann, C. F., Franke, B., & Marquand, A. F. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.001 · Cited by 290 · cited 1×
“To address these limitations, investigators have begun to apply multivariate statistical methods to the analysis of neuroimaging data (15,16).”
Diagnostic neuroimaging across diseases
Klöppel, S., Abdulkadir, A., Jack, C. R., Koutsouleris, N., Mourão-Miranda, J., & Vemuri, P. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.11.002 · Cited by 279
Self-citationMeta-analysis of molecular imaging of serotonin transporters in major depression
Gryglewski, G., Lanzenberger, R., Kranz, G. S., & Cumming, P. (2014) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2014.82 · Cited by 227 · cited 1×
“Scientists have posited that neuroimaging holds “ diagnostic potential ” given fi ndings in multiple studies of signi fi cant anomalies in brain structure (3 – 5), function (6 – 8), and neurochemistry (9,10) in patients with depression.”
Cao, H., Plichta, M. M., Schäfer, A., Haddad, L., Grimm, O., Schneider, M., Esslinger, C., Kirsch, P., Meyer-Lindenberg, A., & Tost, H. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.09.013 · Cited by 227 · cited 1×
“The lower performance of classifiers based on taskbased fMRI data compared to DTI and rsfMRI data might be caused by the lower test/re-test reliability of this method (72), the dependency on cognitive performance on this task, habituation while performing the task or variable degree of validity of the employed paradig…”
Kambeitz, J. P., & Howes, O. D. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.07.034 · Cited by 96 · cited 1×
“Scientists have posited that neuroimaging holds “ diagnostic potential ” given fi ndings in multiple studies of signi fi cant anomalies in brain structure (3 – 5), function (6 – 8), and neurochemistry (9,10) in patients with depression.”
Self-citationMa, Q., Zeng, L.-L., Shen, H., Liu, L., & Hu, D. (2013) · Brain Research · doi:10.1016/j.brainres.2012.12.002 · Cited by 95
Lythe, K. E., Moll, J., Gethin, J. A., Workman, C. I., Green, S., Lambon Ralph, M. A., Deakin, J. F. W., & Zahn, R. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.1813 · Cited by 91 · cited 1×
“(88) reported that neuroimaging-based models allow the prediction of recurrence risk of medication-free patients with MDD with 75% accuracy.”
Self-citationGuo, H., Cao, X., Liu, Z., Li, H., Chen, J., & Zhang, K. (2012) · NeuroReport · doi:10.1097/wnr.0b013e32835a650c · Cited by 46
Predicting clinical responses in major depression using intrinsic functional connectivity
Qin, J., Shen, H., Zeng, L.-L., Jiang, W., Liu, L., & Hu, D. (2015) · NeuroReport · doi:10.1097/wnr.0000000000000407 · Cited by 43
Cited by
Machine Learning Approaches for Clinical Psychology and Psychiatry
Dwyer, D. B., Falkai, P., & Koutsouleris, N. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045037 · Cited by 966
Self-citationFrom promise to practice: towards the realisation of AI-informed mental health care
Koutsouleris, N., Hauser, T. U., Skvortsova, V., & De Choudhury, M. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00153-4 · Cited by 251
Self-citationAbd-Alrazaq, A., AlSaad, R., Shuweihdi, F., Ahmed, A., Aziz, S., & Sheikh, J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00828-5 · Cited by 138
“This may be attributed to the fact that the previous reviews focused on the performance of AI based on only self-reported data collected using mobile-based PHQ-9 14 or neuroimaging data 15 .”
Systematic misestimation of machine learning performance in neuroimaging studies of depression
Flint, C., Cearns, M., Opel, N., Redlich, R., Mehler, D. M. A., Emden, D., Winter, N. R., Leenings, R., Eickhoff, S. B., Kircher, T., et al. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01020-7 · Cited by 120
“In addition to sample size, other issues such as data leakage [13], are likely contributing to the systematic overestimation seen in the literature.”
InfluentialSanfelici, R., Dwyer, D. B., Antonucci, L. A., & Koutsouleris, N. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.02.009 · Cited by 82
Self-citation
Metadata
- Authors
- Kambeitz, J., Cabral, C., Sacchet, M. D., Gotlib, I. H., Zahn, R., Serpa, M. H., Walter, M., Falkai, P., & Koutsouleris, N.
- Venue
- Biological Psychiatry
- Publisher
- Elsevier BV
- Published
- 2017-09
- Volume
- 82
- Issue
- 5
- Pages
- 330-338
- ISSN
- 0006-3223 (ISSN-L)
- OpenAlex
- W2555699120
- Cited by
- 235
- References
- 24
- FWCI
- 1.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.