Separating generalized anxiety disorder from major depression using clinical, hormonal, and structural MRI data: A multimodal machine learning study
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Background: Generalized anxiety disorder (GAD) is difficult to recognize and hard to separate from major depression (MD) in clinical settings. Biomarkers might support diagnostic decisions. This study used machine learning on multimodal biobehavioral data from a sample of GAD, MD and healthy subjects to differentiate subjects with a disorder from healthy subjects (case‐classification) and to differentiate GAD from MD (disorder‐classification). Methods: Subjects with GAD (n = 19), MD without GAD (n = 14), and healthy comparison subjects (n = 24) were included. The sample was matched regarding age, sex, handedness and education and free of psychopharmacological medication. Binary support vector machines were used within a nested leave‐one‐out cross‐validation framework. Clinical questionnaires, cortisol release, gray matter (GM), and white matter (WM) volumes were used as input data separately and in combination. Results: Questionnaire data were well‐suited for case‐classification but not disorder‐classification (accuracies: 96.40%, p < .001; 56.58%, p > .22). The opposite pattern was found for imaging data (case‐classification GM/WM: 58.71%, p = .09/43.18%, p > .66; disorder‐classification GM/WM: 68.05%, p = .034/58.27%, p > .15) and for cortisol data (38.02%, p = .84; 74.60%, p = .009). All data combined achieved 90.10% accuracy (p < .001) for case‐classification and 67.46% accuracy (p = .0268) for disorder‐classification. Conclusions: In line with previous evidence, classification of GAD was difficult using clinical questionnaire data alone. Particularly cortisol and GM volume data were able to provide incremental value for the classification of GAD. Findings suggest that neurobiological biomarkers are a useful target for further research to delineate their potential contribution to diagnostic processes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A fast diffeomorphic image registration algorithm
Ashburner, J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.007 · Cited by 8,122 · cited 1×
“Subsequently, the segmented data were modulated and DARTEL- normalized (Ashburner, 2007) to MNI space.”
MethodDevelopment and validation of the Penn State Worry Questionnaire
Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990) · Behaviour Research and Therapy · doi:10.1016/0005-7967(90)90135-6 · Cited by 5,099
Pruessner, J. C., Kirschbaum, C., Meinlschmid, G., & Hellhammer, D. H. (2003) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(02)00108-7 · Cited by 3,638
Kessler, R. C., Petukhova, M., Sampson, N. A., Zaslavsky, A. M., & Wittchen, H. (2012) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1359 · Cited by 2,947
Fearing the unknown: A short version of the Intolerance of Uncertainty Scale
Carleton, R. N., Norton, M. A. P. J., & Asmundson, G. J. G. (2007) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2006.03.014 · Cited by 2,288 · cited 1×
“Clinical groups revealed comparable scores in each questionnaire except the intolerance of uncertainty scale- 12 (Carleton et al., 2007), for which GAD subjects scored significantly higher than MD subjects.”
ResultPlummer, F., Manea, L., Trepel, D., & McMillan, D. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.11.005 · Cited by 1,882
Depression and cortisol responses to psychological stress: A meta-analysis
Burke, H. M., Davis, M. C., Otte, C., & Mohr, D. C. (2005) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2005.02.010 · Cited by 1,194 · cited 1×
“This is in line with the metaanalysis by Burke et al. (2005) indicating cortisol release in response to psychological stress in MD being comparable to healthy subjects but contrary to a report indicating also comparable cortisol release in GAD (Gerra et al., 2000).”
ResultKempton, M. J., Salvador, Z., Munafò, M. R., Geddes, J. R., Simmons, A., Frangou, S., & Williams, S. C. R. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.60 · Cited by 886 · cited 5×
“There is no study directly comparing GM volumes in pure GAD and pure MD, but results from work investigating structural correlates within one of the disorders suggest decreased GM volume in frontal areas for MD (Bora, Fornito, et al., 2012; Bora, Harrison, et al. 2012; Du et al., 2012; Kempton et al., 2011; Sacher et…”
BackgroundMethodResultInfluentialMajor depressive disorder and hypothalamic-pituitary-adrenal axis activity
Vreeburg, S. A., Hoogendijk, W. J. G., van Pelt, J., DeRijk, R. H., Verhagen, J. C. M., van Dyck, R., Smit, J. H., Zitman, F. G., & Penninx, B. W. J. H. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.50 · Cited by 792
Increasingly certain about uncertainty: Intolerance of uncertainty across anxiety and depression
Carleton, R. N., Mulvogue, M. K., Thibodeau, M. A., McCabe, R. E., Antony, M. M., & Asmundson, G. J. G. (2012) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2012.01.011 · Cited by 775 · cited 1×
“On the other hand, while both the PSWQ and IUS- 12 measure constructs closely related to GAD, neither worrying nor intolerance of uncertainty are exclusively related to GAD but also present in MD (Carleton et al., 2012; Chelminski & Zimmerman, 2003; Gentes & Ruscio, 2011; Starcevic, 1995).”
BackgroundBora, E., Fornito, A., Pantelis, C., & Yücel, M. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.03.049 · Cited by 763
Hair cortisol, stress exposure, and mental health in humans: A systematic review
Staufenbiel, S. M., Penninx, B. W. J. H., Spijker, A. T., Elzinga, B. M., & van Rossum, E. F. C. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2012.11.015 · Cited by 736
Gentes, E. L., & Ruscio, A. M. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.05.001 · Cited by 601
Beesdo, K., Pine, D. S., Lieb, R., & Wittchen, H.-U. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.177 · Cited by 494
Hippocampal volume, memory, and cortisol status in major depressive disorder: Effects of treatment
Vythilingam, M., Vermetten, E., Anderson, G. M., Luckenbaugh, D., Anderson, E. R., Snow, J., Staib, L. H., Charney, D. S., & Bremner, J. D. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.04.002 · Cited by 477
Human and economic burden of generalized anxiety disorder
Hoffman, D. L., Dukes, E. M., & Wittchen, H.-U. (2008) · Depression and Anxiety · doi:10.1002/da.20257 · Cited by 438
Neuroimaging-aided differential diagnosis of the depressive state
Takizawa, R., Fukuda, M., Kawasaki, S., Kasai, K., Mimura, M., Pu, S., Noda, T., Niwa, S.-I., & Okazaki, Y. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.126 · Cited by 337 · cited 2×
“Supervised machine learning algorithms such as support vector machines (SVM) have been used to investigate the potential use of these biomarkers for separating different disorders based on their neural correlates (Grotegerd et al., 2013; Lim et al., 2013; Lueken, Hilbert, Wittchen, Reif, & Hahn, 2015; MacMaster, Carre…”
MethodChu, C., Hsu, A.-L., Chou, K.-H., Bandettini, P., & Lin, C. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.11.066 · Cited by 319 · cited 3×
“…repeatedly reported in the GAD and MD literature (reviews and meta- analyses from Bora, Fornito, Pantelis, & Yucel, 2012; Bora, Harrison, Davey, Yucel, & Pantelis, 2012; Du et al., 2012; Hilbert et al., 2014; Kempton et al., 2011; Lai, 2013; Sacher et al., 2012) as recommended in Chu et al. (2012).”
BackgroundMethodEtkin, A., & Schatzberg, A. F. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10091290 · Cited by 311
Wolfers, T., Buitelaar, J. K., Beckmann, C. F., Franke, B., & Marquand, A. F. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.001 · Cited by 290
Bora, E., Harrison, B. J., Davey, C. G., Yücel, M., & Pantelis, C. (2012) · Psychological Medicine · doi:10.1017/s0033291711001668 · Cited by 276
Common and Distinct Amygdala-Function Perturbations in Depressed vs Anxious Adolescents
Beesdo, K., Lau, J. Y. F., Guyer, A. E., McClure-Tone, E. B., Monk, C. S., Nelson, E. E., Fromm, S. J., Goldwin, M. A., Wittchen, H.-U., Leibenluft, E., et al. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2008.545 · Cited by 250 · cited 2×
“Given that GAD and MD do not only show common but also separate neural correlates (Beesdo et al., 2009; Canu et al., 2015; Etkin & Schatzberg, 2011; Oathes, Patenaude, Schatzberg, & Etkin, 2015), machine learning might also be successfully applied to the problem of recognizing GAD patients and separating them from MD…”
MethodVoxelwise meta-analysis of gray matter reduction in major depressive disorder
Du, M.-Y., Wu, Q.-Z., Yue, Q., Li, J., Liao, Y., Kuang, W.-H., Huang, X.-Q., Chan, R. C. K., Mechelli, A., & Gong, Q.-Y. (2012) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2011.09.014 · Cited by 237 · cited 4×
“…repeatedly reported in the GAD and MD literature (reviews and meta- analyses from Bora, Fornito, Pantelis, & Yucel, 2012; Bora, Harrison, Davey, Yucel, & Pantelis, 2012; Du et al., 2012; Hilbert et al., 2014; Kempton et al., 2011; Lai, 2013; Sacher et al., 2012) as recommended in Chu et al. (2012).”
BackgroundMethodResultInfluentialPrognostic and diagnostic potential of the structural neuroanatomy of depression
Costafreda, S. G., Chu, C., Ashburner, J., & Fu, C. H. Y. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006353 · Cited by 232
Mantella, R. C., Butters, M. A., Amico, J. A., Mazumdar, S., Rollman, B. L., Begley, A. E., Reynolds, C. F., & Lenze, E. J. (2008) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2008.03.002 · Cited by 222
The cortisol awakening response and major depression: examining the evidence
Dedovic, K., & Ngiam, J. (2015) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s62289 · Cited by 191 · cited 1×
“Previous work in GAD and MD alone, however, suggested abnormalities related to cortisol for each of these disorders (for reviews see Dedovic & Ngiam, 2015; Hilbert, Lueken, & Beesdo- Baum, 2014; Staufenbiel, Penninx, Spijker, Elzinga, & van Rossum, 2013), therefore classification based on hormonal…”
BackgroundGray matter volume in major depressive disorder: A meta-analysis of voxel-based morphometry studies
Lai, C.-H. (2013) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2012.06.006 · Cited by 191
A dimensional approach to measuring anxiety for DSM‐5
Lebeau, R. T., Glenn, D. E., Hanover, L. N., Beesdo‐Baum, K., Wittchen, H., & Craske, M. G. (2012) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1369 · Cited by 172
Self-citationHUNT, C., ISSAKIDIS, C., & ANDREWS, G. (2002) · Psychological Medicine · doi:10.1017/s0033291702005512 · Cited by 171
Cost of anxiety disorders in Europe
Andlin‐Sobocki, P., & Wittchen, H. ‐. (2005) · European Journal of Neurology · doi:10.1111/j.1468-1331.2005.01196.x · Cited by 165
Vermani, M., Marcus, M., & Katzman, M. A. (2011) · The Primary Care Companion For CNS Disorders · doi:10.4088/pcc.10m01013 · Cited by 154 · cited 1×
“This is in line with the hypotheses derived from studies reporting that GAD is difficult to diagnose in primary care settings (Calleo et al., 2009; Munk- Jorgensen et al., 2006; Vermani et al., 2011; Wittchen et al., 2002).”
ResultLueken, U., Zierhut, K. C., Hahn, T., Straube, B., Kircher, T., Reif, A., Richter, J., Hamm, A., Wittchen, H.-U., & Domschke, K. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.04.005 · Cited by 133 · cited 1×
“A useful biomarker has to provide sufficient sensitivity and specificity to predict a given patient’s status on the individual level (Lueken et al., 2016; Savitz, Rauch, & Drevets, 2013).”
BackgroundSelf-citationAnxiety disorders and salivary cortisol levels in older adults: a population-based study
Hek, K., Direk, N., Newson, R. S., Hofman, A., Hoogendijk, W. J. G., Mulder, C. L., & Tiemeier, H. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2012.06.006 · Cited by 116
Hinkelmann, K., Moritz, S., Botzenhardt, J., Muhtz, C., Wiedemann, K., Kellner, M., & Otte, C. (2012) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2011.08.012 · Cited by 103 · cited 3×
“Previous studies reported differences between GAD or MDD compared to healthy controls for cortisol (Bhagwagar et al., 2005; Hek et al., 2013; Hinkelmann et al., 2012; Mantella et al., 2008; Phillips et al., 2011; Steudte et al., 2011; Ulrike, Reinhold, & Dirk, 2013; Vreeburg et al., 2009; Wei et…”
BackgroundResultLim, L., Marquand, A., Cubillo, A. A., Smith, A. B., Chantiluke, K., Simmons, A., Mehta, M., & Rubia, K. (2013) · PLoS ONE · doi:10.1371/journal.pone.0063660 · Cited by 101 · cited 1×
“…to investigate the potential use of these biomarkers for separating different disorders based on their neural correlates (Grotegerd et al., 2013; Lim et al., 2013; Lueken, Hilbert, Wittchen, Reif, & Hahn, 2015; MacMaster, Carrey, Langevin, Jaworska, & Crawford, 2014; Ota et al., 2013;…”
BackgroundMunk-Jørgensen, P., Allgulander, C., Dahl, A. A., Foldager, L., Holm, M., Rasmussen, I., Virta, A., Huuhtanen, M.-T., & Wittchen, H.-U. (2006) · Psychiatric Services · doi:10.1176/ps.2006.57.12.1738 · Cited by 96
Canu, E., Kostić, M., Agosta, F., Munjiza, A., Ferraro, P. M., Pesic, D., Copetti, M., Peljto, A., Tosevski, D. L., & Filippi, M. (2015) · Journal of Neurology · doi:10.1007/s00415-015-7701-z · Cited by 82 · cited 2×
“Given that GAD and MD do not only show common but also separate neural correlates (Beesdo et al., 2009; Canu et al., 2015; Etkin & Schatzberg, 2011; Oathes, Patenaude, Schatzberg, & Etkin, 2015), machine learning might also be successfully applied to the problem of recognizing GAD patients and separating them from MD…”
MethodHerr, N. R., Williams, J. W., Benjamin, S., & McDuffie, J. (2014) · JAMA · doi:10.1001/jama.2014.5950 · Cited by 74
Cited by
Multimodal machine learning in precision health: A scoping review
Kline, A., Wang, H., Li, Y., Dennis, S., Hutch, M., Xu, Z., Wang, F., Cheng, F., & Luo, Y. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00712-8 · Cited by 528
Machine learning in major depression: from classification to treatment outcome prediction
Gao, S., Calhoun, V. D., & Sui, J. (2018) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.13048 · Cited by 370
A Review of Machine Learning and Deep Learning Approaches on Mental Health Diagnosis
Iyortsuun, N. K., Kim, S.-H., Jhon, M., Yang, H.-J., & Pant, S. (2023) · Healthcare · doi:10.3390/healthcare11030285 · Cited by 276
A review of machine learning prediction methods for anxiety disorders
Pintelas, E. G., Kotsilieris, T., Livieris, I. E., & Pintelas, P. (2018) · Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion · doi:10.1145/3218585.3218587 · Cited by 61
Toward Robust Anxiety Biomarkers: A Machine Learning Approach in a Large-Scale Sample
Boeke, E. A., Holmes, A. J., & Phelps, E. A. (2020) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2019.05.018 · Cited by 50
Metadata
- Authors
- Hilbert, K., Lueken, U., Muehlhan, M., & Beesdo‐Baum, K.
- Venue
- Brain and Behavior
- Publisher
- Wiley
- Published
- 2017-02-12
- Volume
- 7
- Issue
- 3
- Pages
- e00633-e00633
- ISSN
- 2157-9032 (ISSN-L)
- 2162-3279
- OpenAlex
- W2587570926
- Cited by
- 87
- References
- 38
- FWCI
- 6.79
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.