CoChat

A machine-learning framework for robust and reliable prediction of short- and long-term treatment response in initially antipsychotic-naïve schizophrenia patients based on multimodal neuropsychiatric data

Open access
Ambrosen, Karen S., Skjerbæk, Martin W., Foldager, Jonathan, Axelsen, Martin C., Bak, Nikolaj, Arvastson, Lars, Christensen, Søren R., Johansen, Louise B., Raghava, Jayachandra M., Oranje, Bob, Rostrup, Egill, Nielsen, Mette Ø., Osler, Merete, Fagerlund, Birgitte, Pantelis, Christos, Kinon, Bruce J., Glenthøj, Birte Y., Hansen, Lars K., Ebdrup, Bjørn H. · 2020 · Translational Psychiatry
Cited by 54

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Abstract

The reproducibility of machine-learning analyses in computational psychiatry is a growing concern. In a multimodal neuropsychiatric dataset of antipsychotic-naïve, first-episode schizophrenia patients, we discuss a workflow aimed at reducing bias and overfitting by invoking simulated data in the design process and analysis in two independent machine-learning approaches, one based on a single algorithm and the other incorporating an ensemble of algorithms. We aimed to (1) classify patients from controls to establish the framework, (2) predict short- and long-term treatment response, and (3) validate the methodological framework. We included 138 antipsychotic-naïve, first-episode schizophrenia patients with data on psychopathology, cognition, electrophysiology, and structural magnetic resonance imaging (MRI). Perinatal data and long-term outcome measures were obtained from Danish registers. Short-term treatment response was defined as change in Positive And Negative Syndrome Score (PANSS) after the initial antipsychotic treatment period. Baseline diagnostic classification algorithms also included data from 151 matched controls. Both approaches significantly classified patients from healthy controls with a balanced accuracy of 63.8% and 64.2%, respectively. Post-hoc analyses showed that the classification primarily was driven by the cognitive data. Neither approach predicted short- nor long-term treatment response. Validation of the framework showed that choice of algorithm and parameter settings in the real data was successfully guided by results from the simulated data. In conclusion, this novel approach holds promise as an important step to minimize bias and obtain reliable results with modest sample sizes when independent replication samples are not available.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41398-020-00962-8

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 47

  1. Beck, K. et al. Prevalence of treatment-resistant psychoses in the community: a naturalistic study. J. Psychopharmacol. 33, 1248–1253 (2019). · DOI
  2. Howes, O. D. et al. Treatment-resistant schizophrenia: Treatment Response and Resistance in psychosis (TRRIP) Working Group Consensus Guidelines on Diagnosis and Terminology. AJP 174, 216–229 (2016). · DOI · Paper page
  3. van Erp, T. G. M. et al. Subcortical brain volume abnormalities in 2028 individuals with schizophrenia and 2540 healthy controls via the ENIGMA consortium. Mol. Psychiatry 21, 547–553 (2016). · DOI · Paper page
  4. Owens, E., Bachman, P., Glahn, D. C. & Bearden, C. E. Electrophysiological endophenotypes for schizophrenia. Harv. Rev. Psychiatry 24, 129–147 (2016). · DOI · Paper page
  5. Randau, M. et al. Attenuated mismatch negativity in patients with first-episode antipsychotic-naive schizophrenia using a source-resolved method. NeuroImage: Clin. 22, 101760 (2019). · DOI
  6. Fatouros-Bergman, H., Cervenka, S., Flyckt, L., Edman, G. & Farde, L. Meta-analysis of cognitive performance in drug-naïve patients with schizophrenia. Schizophr. Res. 158, 156–162 (2014). · DOI · Paper page
  7. Olabi, B. et al. Are there progressive brain changes in schizophrenia? A meta-analysis of structural magnetic resonance imaging studies. Biol. Psychiatry 70, 88–96 (2011). · DOI · Paper page
  8. Leung, M. et al. Gray matter in first-episode schizophrenia before and after antipsychotic drug treatment. Anatomical likelihood estimation meta-analyses with sample size weighting. Schizophr. Bull. 37, 199–211 (2011). · DOI · Paper page
  9. Janssen, R. J., Mourão-Miranda, J. & Schnack, H. G. Making individual prognoses in psychiatry using neuroimaging and machine learning. Biol. Psychiatry.: Cogn. Neurosci. Neuroimaging 3, 798–808 (2018).
  10. Vieira, S. et al. Using machine learning and structural neuroimaging to detect first episode psychosis: reconsidering the evidence. Schizophr. Bull. https://doi.org/10.1093/schbul/sby189 (2019). · DOI · Paper page
  11. Winterburn, J. L. et al. Can we accurately classify schizophrenia patients from healthy controls using magnetic resonance imaging and machine learning? A multi-method and multi-dataset study. Schizophr. Res. https://doi.org/10.1016/j.schres.2017.11.038 (2017). · DOI · Paper page
  12. Cearns, M., Hahn, T. & Baune, B. T. Recommendations and future directions for supervised machine learning in psychiatry. Transl. Psychiatry 9, 1–12 (2019). · DOI · Paper page
  13. Doan, N. T. et al. Distinct multivariate brain morphological patterns and their added predictive value with cognitive and polygenic risk scores in mental disorders. NeuroImage: Clin. 15, 719–731 (2017). · DOI · Paper page
  14. Ebdrup, B. H. et al. Accuracy of diagnostic classification algorithms using cognitive-, electrophysiological-, and neuroanatomical data in antipsychotic-naïve schizophrenia patients. Psychol. Med. https://doi.org/10.1017/S0033291718003781 (2018). · DOI · Paper page
  15. Bak, N. et al. Two subgroups of antipsychotic-naive, first-episode schizophrenia patients identified with a Gaussian mixture model on cognition and electrophysiology. Transl. Psychiatry 7, e1087 (2017). · DOI
  16. Kelleher, J. D., Namee, B. M. & D’Arcy, A. Fundamentals of Machine Learning for Predictive Data Analytics: Algorithms, Worked Examples, and Case Studies (The MIT Press, 2015).
  17. Nørbak-Emig, H. et al. Extrastriatal dopamine D 2/3 receptors and cortical grey matter volumes in antipsychotic-naïve schizophrenia patients before and after initial antipsychotic treatment. World J. Biol. Psychiatry 18, 539–549 (2017). · DOI
  18. Jessen, K. et al. Patterns of cortical structures and cognition in antipsychotic-naïve patients with first-episode schizophrenia: a partial least squares correlation analysis. Biol. Psychiatry.: Cogn. Neurosci. Neuroimaging 4, 444–453 (2019).
  19. Kay, S. R., Fiszbein, A. & Opler, L. A. The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr. Bull. 13, 261–276 (1987). · DOI · Paper page
  20. Nelson, H. E. & O’Connell, A. Dementia: the estimation of premorbid intelligence levels using the New Adult Reading Test. Cortex 14, 234–244 (1978). · DOI · Paper page
  21. Buschke, H. Selective reminding for analysis of memory and learning. J. Verbal Learn. Verbal Behav. 12, 543–550 (1973). · DOI · Paper page
  22. Reitan, R. & Wolfson, D. The Halstead-Reitan Neuropsychological Test Battery: Theory and Clinical Interpretation. Neuropsychology Press; 2nd edition (1993).
  23. Baddeley, A., Emslie, H. & Nimmo-Smith, I. The Speed and Capacity of Language-Processing Test (SCOLP)—Reference Materials (Pearson Assessment, 1992).
  24. Jessen, K. et al. Cortical structures and their clinical correlates in antipsychotic-naïve schizophrenia patients before and after 6 weeks of dopamine D2/3 receptor antagonist treatment. Psychol. Med. 49, 754–763 (2019). · DOI
  25. Reuter, M., Rosas, H. D. & Fischl, B. Highly accurate inverse consistent registration: a robust approach. NeuroImage 53, 1181–1196 (2010). · DOI · Paper page
  26. Reuter, M. & Fischl, B. Avoiding asymmetry-induced bias in longitudinal image processing. NeuroImage 57, 19–21 (2011). · DOI · Paper page
  27. Desikan, R. S. et al. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. NeuroImage 31, 968–980 (2006). · DOI · Paper page
  28. Jenkinson, M., Beckmann, C. F., Behrens, T. E. J., Woolrich, M. W. & Smith, S. M. FSL. NeuroImage 62, 782–790 (2012). · DOI · Paper page
  29. Jensen, K. S., Oranje, B., Wienberg, M. & Glenthøj, B. Y. The effects of increased serotonergic activity on human sensory gating and its neural generators. Psychopharmacology 196, 631–641 (2008). · DOI
  30. Oranje, B., Jensen, K., Wienberg, M. & Glenthøj, B. Y. Divergent effects of increased serotonergic activity on psychophysiological parameters of human attention. Int. J. Neuropsychopharmacol. 11, 453–463 (2008). · DOI · Paper page
  31. Oranje, B. & Glenthøj, B. Y. Clonidine normalizes sensorimotor gating deficits in patients with schizophrenia on stable medication. Schizophrenia Bull. 39, 684–691 (2013). · DOI
  32. Düring, S., Glenthøj, B. Y., Andersen, G. S. & Oranje, B. Effects of dopamine D2/D3 blockade on human sensory and sensorimotor gating in initially antipsychotic-naive, first-episode schizophrenia patients. Neuropsychopharmacology 39, 3000–3008 (2014). · DOI
  33. Düring, S., Glenthøj, B. Y. & Oranje, B. Effects of blocking D2/D3 receptors on mismatch negativity and P3a amplitude of initially antipsychotic naïve, first episode schizophrenia patients. Int. J. Neuropsychopharmacol. 19, 3 pyv109, https://doi.org/10.1093/ijnp/pyv109 (2015). · DOI
  34. Tipping, M. E. & Bishop, C. M. Mixtures of probabilistic principal component analyzers. Neural Comput. 11, 443–482 (1999). · DOI · Paper page
  35. Hansen, L. K. et al. Generalizable patterns in neuroimaging: how many principal components? NeuroImage 9, 534–544 (1999). · DOI
  36. Everitt, B. S. An Introduction to Latent Variable Models (Springer Science & Business Media, 2013).
  37. Mouchlianitis, E., McCutcheon, R. & Howes, O. D. Brain-imaging studies of treatment-resistant schizophrenia: a systematic review. Lancet Psychiatry 3, 451–463 (2016). · DOI · Paper page
  38. Feurer, M. et al. in Advances in Neural Information Processing Systems Vol. 28 (eds Cortes, C. et al.) 2962–2970 (Curran Associates, Inc., 2015).
  39. Keefe, R. S. E., Eesley, C. E. & Poe, M. P. Defining a cognitive function decrement in schizophrenia. Biol. Psychiatry 57, 688–691 (2005). · DOI · Paper page
  40. Woodberry, K. A. & Giuliano, A. J.,. & Seidman, L. J. Premorbid IQ in schizophrenia: a meta-analytic review. Am. J. Psychiatry 165, 579–587 (2008). · DOI · Paper page
  41. Ipsen, N. B. & Hansen, L. K. Phase transition in PCA with missing data: Reduced signal-to-noise ratio, not sample size! In proceedings of machine learning research. Int. Machine Lean. Society (IMLS) 97, 5248–5260 (2019).
  42. Nordentoft, M. et al. From research to practice: how OPUS treatment was accepted and implemented throughout Denmark. Early Interv. Psychiatry 9, 156–162 (2015). · DOI · Paper page
  43. Pantelis, C. et al. Neurobiological markers of illness onset in psychosis and schizophrenia: the search for a moving target. Neuropsychol. Rev. 19, 385 (2009). · DOI
  44. Doucet, G. E., Moser, D. A., Luber, M. J., Leibu, E. & Frangou, S. Baseline brain structural and functional predictors of clinical outcome in the early course of schizophrenia. Mol. Psychiatry https://doi.org/10.1038/s41380-018-0269-0 (2018). · DOI
  45. Bak, N. & Hansen, L. K. Data driven estimation of imputation error—a strategy for imputation with a reject option. PLoS ONE 11, e0164464 (2016). · DOI
  46. Oldfield, R. C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97–113 (1971). · DOI · Paper page
  47. Crespo-Facorro, B. et al. Caudate nucleus volume and its clinical and cognitive correlations in first episode schizophrenia. Schizophr. Res. 91, 87–96 (2007). · DOI

Cited by

See all 54

Metadata

Authors
Ambrosen, K. S., Skjerbæk, M. W., Foldager, J., Axelsen, M. C., Bak, N., Arvastson, L., Christensen, S. R., Johansen, L. B., Raghava, J. M., Oranje, B., Rostrup, E., Nielsen, M. Ø., Osler, M., Fagerlund, B., Pantelis, C., Kinon, B. J., Glenthøj, B. Y., Hansen, L. K., & Ebdrup, B. H.
Venue
Translational Psychiatry
Published
2020-08-10
Volume
10
Issue
1
Pages
276-276
ISSN
2158-3188 (ISSN-L)
OpenAlex
W3047665890
Cited by
54
References
9
FWCI
3.99
Type
journal article
Language
en
Open access
gold
Licence
Funders
  • Lundbeckfonden (R155-2013-16337, R25-A2701, R246-2016-3237)
  • H. Lundbeck A/S
  • Department of Health | National Health and Medical Research Council (1105825)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A machine-learning framework for robust and reliable prediction of short- and long-term treatment response in initially antipsychotic-naïve schizophrenia patients based on multimodal neuropsychiatric data. https://app.cochat.ai/papers/10.1038/s41398-020-00962-8
The paper
Ambrosen, K. S., Skjerbæk, M. W., Foldager, J., Axelsen, M. C., Bak, N., Arvastson, L., Christensen, S. R., Johansen, L. B., Raghava, J. M., Oranje, B., Rostrup, E., Nielsen, M. Ø., Osler, M., Fagerlund, B., Pantelis, C., Kinon, B. J., Glenthøj, B. Y., Hansen, L. K., & Ebdrup, B. H. (2020). A machine-learning framework for robust and reliable prediction of short- and long-term treatment response in initially antipsychotic-naïve schizophrenia patients based on multimodal neuropsychiatric data. Translational Psychiatry. https://doi.org/10.1038/s41398-020-00962-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.