Structural neuroimaging biomarkers for obsessive-compulsive disorder in the ENIGMA-OCD consortium: medication matters
Open accessPublished version of a preprint
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
No diagnostic biomarkers are available for obsessive-compulsive disorder (OCD). Here, we aimed to identify magnetic resonance imaging (MRI) biomarkers for OCD, using 46 data sets with 2304 OCD patients and 2068 healthy controls from the ENIGMA consortium. We performed machine learning analysis of regional measures of cortical thickness, surface area and subcortical volume and tested classification performance using cross-validation. Classification performance for OCD vs. controls using the complete sample with different classifiers and cross-validation strategies was poor. When models were validated on data from other sites, model performance did not exceed chance-level. In contrast, fair classification performance was achieved when patients were grouped according to their medication status. These results indicate that medication use is associated with substantial differences in brain anatomy that are widely distributed, and indicate that clinical heterogeneity contributes to the poor performance of structural MRI as a disease marker.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
The epidemiology of obsessive-compulsive disorder in the National Comorbidity Survey Replication
Ruscio, A. M., Stein, D. J., Chiu, W. T., & Kessler, R. C. (2010) · Molecular Psychiatry · doi:10.1038/mp.2008.94 · Cited by 2,771
Sheehan, D. V., Sheehan, K. H., Shytle, R. D., Janavs, J., Bannon, Y., Rogers, J. E., Milo, K. M., Stock, S. L., & Wilkinson, B. (2010) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.09m05305whi · Cited by 1,730
Gene-Wide Analysis Detects Two New Susceptibility Genes for Alzheimer's Disease
Escott-Price, V., Bellenguez, C., Wang, L.-S., Choi, S.-H., Harold, D., Jones, L., Holmans, P., Gerrish, A., Vedernikov, A., Richards, A., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094661 · Cited by 1,398
Self-citationSILVERMAN, W. K., SAAVEDRA, L. M., & PINA, A. A. (2001) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200108000-00016 · Cited by 1,190
Automatic classification of MR scans in Alzheimer’s disease.
Kloppel, S., Stonnington, C. M., Chu, C., Draganski, B., Scahill, R. I., Rohrer, J. D., Fox, N. C., Jack, C. R., Ashburner, J., & Frackowiak, R. S. J. (2008) · Brain · doi:10.1093/brain/awm319 · Cited by 1,170
Building better biomarkers: brain models in translational neuroimaging
Woo, C.-W., Chang, L. J., Lindquist, M. A., & Wager, T. D. (2017) · Nature Neuroscience · doi:10.1038/nn.4478 · Cited by 1,056
Abramowitz, J. S., Taylor, S., & McKay, D. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60240-3 · Cited by 1,002
Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls
Arbabshirani, M. R., Plis, S., Sui, J., & Calhoun, V. D. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.079 · Cited by 912
Research works printed but not linked: 27
- Menzies, L. et al. Integrating evidence from neuroimaging and neuropsychological studies of obsessive-compulsive disorder: the orbitofronto-striatal model revisited. Neurosci. Biobehav. Rev. 32, 525–549 (2008). · DOI · Paper page
- Kong, X. Z. et al. Mapping cortical and subcortical asymmetry in obsessive-compulsive disorder: findings from the ENIGMA Consortium. Biol. Psychiatry 1–13 https://doi.org/10.1016/j.biopsych.2019.04.022. (2019). · DOI · Paper page
- Orrù, G., Pettersson-Yeo, W., Marquand, A. F., Sartori, G. & Mechelli, A. Using Support Vector Machine to identify imaging biomarkers of neurological and psychiatric disease: a critical review. Neurosci. Biobehav. Rev. 36, 1140–1152 (2012). · DOI · Paper page
- Bruin, W., Denys, D. & van Wingen, G. Diagnostic neuroimaging markers of obsessive-compulsive disorder: Initial evidence from structural and functional MRI studies. Prog. Neuro-Psychopharmacology Biol. Psychiatry 0–1 https://doi.org/10.1016/j.pnpbp.2018.08.005. (2018). · DOI · Paper page
- Nunes, A. Using structural MRI to identify bipolar disorders–13 site machine learning study in 3020 individuals from the ENIGMA Bipolar Disorders Working Group. Mol. Psychiatry https://doi.org/10.1038/s41380-018-0228-9. (2018). · DOI · Paper page
- Nieuwenhuis, M. et al. Classification of schizophrenia patients and healthy controls from structural MRI scans in two large independent samples. Neuroimage 61, 606–612 (2012). · DOI · Paper page
- Franke, K., Ziegler, G., Klöppel, S. & Gaser, C. Estimating the age of healthy subjects from T1-weighted MRI scans using kernel methods: exploring the influence of various parameters. Neuroimage 50, 883–892 (2010). · DOI · Paper page
- Schnack, H. G. & Kahn, R. S. Detecting neuroimaging biomarkers for psychiatric disorders: Sample size matters. Front. Psychiatry 7, 50 (2016). · DOI · Paper page
- Kaufman, J. et al. Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity data. J. Am. Acad. Child Adolesc. Psychiatry 36, 980–988 (1997). · DOI · Paper page
- Sheehan, D. V. et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. in. J. Clin. Psychiatry 59, 22–33 (1998).
- Desikan, R. S. et al. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 31, 968–980 (2006). · DOI · Paper page
- Hastie, T., Tibshirani, R. & Friedman, J. The Elements of Statistical Learning (2nd edn.) (Elements, 2009). · DOI · Paper page
- Rasmussen, C. E. & Williams, C. K. I. Gaussian processes for machine learning. Int. J. Neural Syst. 14, 69–106 (2004). · DOI · Paper page
- Chang, C. & Lin, C. LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 1–39 (2013). · DOI · Paper page
- Chen, T. & Guestrin, C. XGBoost: a scalable tree boosting system. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining vols 13-17-785–794 (ACM Press, 2016). · DOI · Paper page
- Mason, S. J. & Graham, N. E. Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves. Q. J. R. Meteorol. Soc. 128, 2145–2166 (2002). · DOI · Paper page
- Strobl, C., Boulesteix, A. L., Zeileis, A. & Hothorn, T. Bias in random forest variable importance measures: illustrations, sources and a solution. BMC Bioinformatics 8, 25 (2007). · DOI · Paper page
- Thomas, R. M., Bruin, W., Zhutovsky, P. & van Wingen, G. Dealing with missing data, small sample sizes, and heterogeneity in machine learning studies of brain disorders. In Machine Learning 249–266 (Elsevier, 2020). · DOI
- Czéh, B. et al. Chronic social stress inhibits cell proliferation in the adult medial prefrontal cortex: hemispheric asymmetry and reversal by fluoxetine treatment. Neuropsychopharmacology https://doi.org/10.1038/sj.npp.1301275. (2007). · DOI · Paper page
- Soumier, A. et al. Mechanisms contributing to the phase-dependent regulation of neurogenesis by the novel antidepressant, agomelatine, in the adult rat hippocampus. Neuropsychopharmacology https://doi.org/10.1038/npp.2009.72. (2009). · DOI · Paper page
- Homberg, J. R., Schubert, D. & Gaspar, P. New perspectives on the neurodevelopmental effects of SSRIs. Trends Pharmacol. Sci. 31, 60–65 (2010). · DOI · Paper page
- Linn, K. A., Gaonkar, B., Doshi, J., Davatzikos, C. & Shinohara, R. T. Multivariate pattern analysis and confounding in neuroimaging. Int. J. Biostat. 12, 31 (2016). · DOI · Paper page
- Rao, A., Monteiro, J. M. & Mourao-Miranda, J. Predictive modelling using neuroimaging data in the presence of confounds. Neuroimage 150, 23–49 (2017). · DOI · Paper page
- Schoemaker, D. et al. Hippocampus and amygdala volumes from magnetic resonance images in children: assessing accuracy of FreeSurfer and FSL against manual segmentation. Neuroimage https://doi.org/10.1016/j.neuroimage.2016.01.038 (2016). · DOI · Paper page
- Govindarajan, K. A., Freeman, L., Cai, C., Rahbar, M. H. & Narayana, P. A. Effect of intrinsic and extrinsic factors on global and regional cortical thickness. PLoS ONE 9, 1–15 (2014). · DOI
- Mataix-Cols, D. & van den Heuvel, O. A. Common and distinct neural correlates of obsessive-compulsive and related disorders. Psychiatr. Clin. North Am. 29, 391–410 (2006). · DOI
- Anholt, G. E. et al. Age of onset in obsessive-compulsive disorder: admixture analysis with a large sample. Psychol. Med. https://doi.org/10.1017/S0033291713000470. (2014). · DOI · Paper page
Cited by
Thompson, P. M., Jahanshad, N., Ching, C. R. K., Salminen, L. E., Thomopoulos, S. I., Bright, J., Baune, B. T., Bertolín, S., Bralten, J., Bruin, W. B., et al. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0705-1 · Cited by 638
Self-citationObsessive-compulsive disorder: Etiology, neuropathology, and cognitive dysfunction
Jalal, B., Chamberlain, S. R., & Sahakian, B. J. (2023) · Brain and Behavior · doi:10.1002/brb3.3000 · Cited by 111
“…in greater volume of the left putamen in OCD patients (now comparable to healthy controls) unlike CBT-treated patients (Hoexter et al., 2012; for a review see, Atmaca, 2013; for a meta-analysis from the ENIGMAOCD consortium showing that SRIs alter brain volumes in OCD, see Bruin et al., 2020).”
ResultBruin, W. B., Abe, Y., Alonso, P., Anticevic, A., Backhausen, L. L., Balachander, S., Bargallo, N., Batistuzzo, M. C., Benedetti, F., Bertolin Triquell, S., et al. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02077-0 · Cited by 81
Self-citationChen, Z., Liu, X., Yang, Q., Wang, Y.-J., Miao, K., Gong, Z., Yu, Y., Leonov, A., Liu, C., Feng, Z., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.1671 · Cited by 43
Chen, Z., Hu, B., Liu, X., Becker, B., Eickhoff, S. B., Miao, K., Gu, X., Tang, Y., Dai, X., Li, C., et al. (2023) · BMC Medicine · doi:10.1186/s12916-023-02941-4 · Cited by 35
Metadata
- Authors
- Bruin, W. B., Taylor, L., Thomas, R. M., Shock, J. P., Zhutovsky, P., Abe, Y., Alonso, P., Ameis, S. H., Anticevic, A., Arnold, P. D., Assogna, F., Benedetti, F., Beucke, J. C., Boedhoe, P. S. W., Bollettini, I., Bose, A., Brem, S., Brennan, B. P., Buitelaar, J. K., Calvo, R., Cheng, Y., Cho, K. I. K., Dallaspezia, S., Denys, D., Ely, B. A., Feusner, J. D., Fitzgerald, K. D., Fouche, J.-P., Fridgeirsson, E. A., Gruner, P., Gürsel, D. A., Hauser, T. U., Hirano, Y., Hoexter, M. Q., Hu, H., Huyser, C., Ivanov, I., James, A., Jaspers-Fayer, F., Kathmann, N., Kaufmann, C., Koch, K., Kuno, M., Kvale, G., Kwon, J. S., Liu, Y., Lochner, C., Lázaro, L., Marques, P., Marsh, R., Martínez-Zalacaín, I., Mataix-Cols, D., Menchón, J. M., Minuzzi, L., Moreira, P. S., Morer, A., Morgado, P., Nakagawa, A., Nakamae, T., Nakao, T., Narayanaswamy, J. C., Nurmi, E. L., O’Neill, J., Pariente, J. C., Perriello, C., Piacentini, J., Piras, F., Piras, F., Reddy, Y. C. J., Rus-Oswald, O. G., Sakai, Y., Sato, J. R., Schmaal, L., Shimizu, E., Simpson, H. B., Soreni, N., Soriano-Mas, C., Spalletta, G., Stern, E. R., Stevens, M. C., Stewart, S. E., Szeszko, P. R., Tolin, D. F., Venkatasubramanian, G., Wang, Z., Yun, J.-Y., van Rooij, D., ENIGMA-OCD Working Group, Banaj, N., Bargalló, N., Batistuzzo, M. C., Brandeis, D., Busatto, G. F., Calvo, A., Ciullo, V., Drechsler, R., Esteves, M., Falini, A., Fang, Y., Figee, M., Fontaine, M., Gueguen, M., Hamatani, S., Hanna, G. L., Hansen, B., Ikari, K., Lázaro, L., Magalhães, R., Masuda, Y., Matsumoto, K., Miguel, E. C., Morer, A., Pittenger, C., Poletti, S., Sakai, Y., Sousa, N., Takahashi, J., Thorsen, A. L., Tsuchiyagaito, A., Vecchio, D., Veltman, D. J., Walitza, S., Watanabe, A., Xu, X., Xu, J., Yamada, K., Yoshida, T., Zarei, M., Zhao, Q., Zhou, C., de Vries, F. E., de Wit, S. J., van Rooij, D., van Wingen, G. A., van den Heuvel, O. A., van der Werf, Y. D., Thompson, P. M., van den Heuvel, O. A., Stein, D. J., & van Wingen, G. A.
- Venue
- Translational Psychiatry
- Published
- 2020-10-08
- Volume
- 10
- Issue
- 1
- Pages
- 342-342
- ISSN
- 2158-3188 (ISSN-L)
- OpenAlex
- W3092023810
- Cited by
- 78
- References
- 25
- FWCI
- 4.09
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- MEXT | Japan Society for the Promotion of Science (18K15523, 16K04344, 19K03309, 26461762, 16K19778, 18K07608)
- Ministry of Economy and Competitiveness | Instituto de Salud Carlos III (PI14/00419, PI040829, FI17/00294, CPII16/00048, PI13/01958, PI16/00889)
- Alberta Innovates
- Ontario Brain Institute
- Hartmann Müller-Stiftung für Medizinische Forschung (1460)
- U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (K23-MH09239, R01 MH107419, K23MH082176, K23 MH115206, R21MH101441, R21MH093889, R01 MH081864)
- National Science Foundation of China | National Natural Science Foundation of China-Yunnan Joint Fund (81560233)
- Dana Foundation
- International OCD Foundation
- Brain and Behavior Research Foundation (27023)
- Jacobs Foundation (2017-1261-04)
- Fundação de Amparo à Pesquisa do Estado de São Paulo (2011/21357-9)
- U.S. Department of Health & Human Services | NIH | National Institute on Drug Abuse (R21/DA046029, R21/DA045218)
- Michael Smith Foundation for Health Research
- Bundesministerium für Bildung und Forschung (BMBF-01GW0724)
- Deutsche Forschungsgemeinschaft (KO 3744/7-1)
- Helse Vest (911754, 911880)
- National Research Foundation
- Fundació la Marató de TV3 (01/2010, 091710)
- Wellcome Trust
- South London and Maudsley NHS Foundation Trust (064846)
- Ministry of Education, Culture, Sports, Science and Technology (22591262, 25461732, 16K10253)
- Ministero della Salute (RC13-14-15-16-17-18A)
- Department of Health | National Health and Medical Research Council (1140764)
- Provincial Health Services Authority
- DBT India Alliance (500236/Z/11/Z)
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (916.86.036)
- Hersenstichting (2010(1)-50)
- ZonMw (917.15.318)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Structural neuroimaging biomarkers for obsessive-compulsive disorder in the ENIGMA-OCD consortium: medication matters. https://app.cochat.ai/papers/10.1038/s41398-020-01013-y
- The paper
- Bruin, W. B., Taylor, L., Thomas, R. M., Shock, J. P., Zhutovsky, P., Abe, Y., Alonso, P., Ameis, S. H., Anticevic, A., Arnold, P. D., Assogna, F., Benedetti, F., Beucke, J. C., Boedhoe, P. S. W., Bollettini, I., Bose, A., Brem, S., Brennan, B. P., Buitelaar, J. K., . . . van Wingen, G. A. (2020). Structural neuroimaging biomarkers for obsessive-compulsive disorder in the ENIGMA-OCD consortium: medication matters. Translational Psychiatry. https://doi.org/10.1038/s41398-020-01013-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.