The DOI matches its Crossref record; 42 of the 45 references it cites were found in a registry or an index.
Mapping the Heterogeneous Phenotype of Schizophrenia and Bipolar Disorder Using Normative Models
Open accessAbstract
Importance: Schizophrenia and bipolar disorder are severe and complex brain disorders characterized by substantial clinical and biological heterogeneity. However, case-control studies often ignore such heterogeneity through their focus on the average patient, which may be the core reason for a lack of robust biomarkers indicative of an individual's treatment response and outcome. Objectives: To investigate the degree to which case-control analyses disguise interindividual differences in brain structure among patients with schizophrenia and bipolar disorder and to map the brain alterations linked to these disorders at the level of individual patients. Design, Setting, and Participants: This study used cross-sectional, T1-weighted magnetic resonance imaging data from participants recruited for the Thematically Organized Psychosis study from October 27, 2004, to October 17, 2012. Data were reanalyzed in 2017 and 2018. Patients were recruited from inpatient and outpatient clinics in the Oslo area of Norway, and healthy individuals from the same catchment area were drawn from the national population registry. Main Outcomes and Measures: Interindividual differences in brain structure among patients with schizophrenia and bipolar disorder. Voxel-based morphometry maps were computed, which were used for normative modeling to map the range of interindividual differences in brain structure. Results: This study included 218 patients with schizophrenia spectrum disorders (mean [SD] age, 30 [9.3] years; 126 [57.8%] male), of whom 163 had schizophrenia (mean [SD] age, 31 [8.7] years; 105 [64.4%] male) and 190 had bipolar disorder (mean [SD] age, 34 [11.3] years; 79 [41.6%] male), and 256 healthy individuals (mean [SD] age, 34 [9.5] years; 140 [54.7%] male). At the level of the individual, deviations from the normative model were frequent in both disorders but highly heterogeneous. Overlap of more than 2% among patients was observed in only a few loci, primarily in frontal, temporal, and cerebellar regions. The proportion of alterations was associated with diagnosis and cognitive and clinical characteristics within clinical groups. Patients with schizophrenia, on average, had significantly reduced gray matter in frontal regions, cerebellum, and temporal cortex. In patients with bipolar disorder, mean deviations were primarily present in cerebellar regions. Conclusions and Relevance: This study found that group-level differences disguised biological heterogeneity and interindividual differences among patients with the same diagnosis. This finding suggests that the idea of the average patient is a noninformative construct in psychiatry that falls apart when mapping abnormalities at the level of the individual patient. This study presents a workable route toward precision medicine in psychiatry.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To characterize heterogeneity of schizophrenia and bipolar disorder nested within age and sex, investigators applied normative modeling to 474 participants from the Thematically Organized Psychosis study (61).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [61]
In the citing paper
“The in- vestigators created normative models where age and sex predicted structural magnetic resonance imaging measures and then examined patient variation by diagnosis.”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [61]
In the citing paper
“They found that patients with the same or no diagnosis varied dramatically under the normative model, suggesting that bipolar/schizo- phrenia brain structural heterogeneity is nested within typical heterogeneity.”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [61]
In the citing paper
“Newer hybrid models, such as normative modeling (19,59–61) or the functional random forest (FRF) (18,62), may overcome these limitations and enable new inferences from psychopathology studies.”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [61]
In the citing paper
“Several studies incorporated normative models to address comorbidity and heterogeneity in clinical and nonclinical co- horts (19,60,61).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [61]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
Complex brain networks: graph theoretical analysis of structural and functional systems
Bullmore, E., & Sporns, O. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2575 · Cited by 11,820
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Biological insights from 108 schizophrenia-associated genetic loci
Schizophrenia Working Group of the Psychiatric Genomics Consortium (2014) · Nature · doi:10.1038/nature13595 · Cited by 7,577
Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., Sanislow, C., & Wang, P. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09091379 · Cited by 7,067
Network structure of cerebral cortex shapes functional connectivity on multiple time scales
Honey, C. J., Kötter, R., Breakspear, M. J., & Sporns, O. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0701519104 · Cited by 1,727
for the ENIGMA Schizophrenia Working Group, van Erp, T. G. M., Hibar, D. P., Rasmussen, J. M., Glahn, D. C., Pearlson, G. D., Andreassen, O. A., Agartz, I., Westlye, L. T., Haukvik, U. K., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2015.63 · Cited by 1,140
Building better biomarkers: brain models in translational neuroimaging
Woo, C.-W., Chang, L. J., Lindquist, M. A., & Wager, T. D. (2017) · Nature Neuroscience · doi:10.1038/nn.4478 · Cited by 1,056
Kapur, S., Phillips, A. G., & Insel, T. R. (2012) · Molecular Psychiatry · doi:10.1038/mp.2012.105 · Cited by 980
Cross-validation failure: Small sample sizes lead to large error bars
Varoquaux, G. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.06.061 · Cited by 897
for the ENIGMA Bipolar Disorder Working Group, Hibar, D. P., Westlye, L. T., Doan, N. T., Jahanshad, N., Cheung, J. T. P., Ching, C. R. K., Versace, A., Bilderbeck, A. C., Uhlmann, A., et al. (2017) · Molecular Psychiatry · doi:10.1038/mp.2017.73 · Cited by 798
Identification of Distinct Psychosis Biotypes Using Brain-Based Biomarkers
Clementz, B. A., Sweeney, J. A., Hamm, J. P., Ivleva, E. I., Ethridge, L. E., Pearlson, G. D., Keshavan, M. S., & Tamminga, C. A. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.14091200 · Cited by 768
Understanding heterogeneity in clinical cohorts using normative models: Beyond case-control studies
Marquand, A. F., Rezek, I., Buitelaar, J., & Beckmann, C. F. (2016) · Biological Psychiatry · doi:10.1016/j.biopsych.2015.12.023 · Cited by 683
Self-citationA polygenic theory of schizophrenia.
Gottesman, I. I., & Shields, J. (1967) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.58.1.199 · Cited by 636
Koutsouleris, N., Davatzikos, C., Borgwardt, S., Gaser, C., Bottlender, R., Frodl, T., Falkai, P., Riecher-Rossler, A., Moller, H.-J., Reiser, M., et al. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt142 · Cited by 448
Studying individual differences in human adolescent brain development
Foulkes, L., & Blakemore, S.-J. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0078-4 · Cited by 413
Accelerated Brain Aging in Schizophrenia: A Longitudinal Pattern Recognition Study
Schnack, H. G., van Haren, N. E. M., Nieuwenhuis, M., Pol, H. E. H., Cahn, W., & Kahn, R. S. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.15070922 · Cited by 376
Fried, E. I. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00309 · Cited by 367
Candidate Gene Identification Approach: Progress and Challenges
Zhu, M., & Zhao, S. (2007) · International Journal of Biological Sciences · doi:10.7150/ijbs.3.420 · Cited by 360
From maps to mechanisms through neuroimaging of schizophrenia
Meyer‐Lindenberg, A. (2010) · Nature · doi:10.1038/nature09569 · Cited by 325
Simonsen, C., Sundet, K. S., Vaskinn, A., Birkenaes, A. B., Engh, J. A., Færden, A., Jónsdóttir, H., Ringen, P. A., Opjordsmoen, S., Melle, I., et al. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp034 · Cited by 323
Linked independent component analysis for multimodal data fusion
Groves, A. R., Beckmann, C. F., Smith, S. M., & Woolrich, M. W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.073 · Cited by 319
Self-citationThe search for imaging biomarkers in psychiatric disorders
Abi-Dargham, A., & Horga, G. (2016) · Nature Medicine · doi:10.1038/nm.4190 · Cited by 311
Novel genetic loci associated with hippocampal volume
Hibar, D. P., Adams, H. H. H., Jahanshad, N., Chauhan, G., Stein, J. L., Hofer, E., Renteria, M. E., Bis, J. C., Arias-Vasquez, A., Ikram, M. K., et al. (2017) · Nature Communications · doi:10.1038/ncomms13624 · Cited by 299
Self-citationWolfers, T., Buitelaar, J. K., Beckmann, C. F., Franke, B., & Marquand, A. F. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.001 · Cited by 290
Biomarkers for personalized oncology: recent advances and future challenges
Kalia, M. (2014) · Metabolism · doi:10.1016/j.metabol.2014.10.027 · Cited by 276
Marquand, A. F., Wolfers, T., Mennes, M., Buitelaar, J. K., & Beckmann, C. F. (2016) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.04.002 · Cited by 267
Winkler, A. M., Webster, M., Vidaurre, D., Nichols, T. E., & Smith, S. M. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.05.092 · Cited by 247
Jauhar, S., Nour, M. M., Veronese, M., Rogdaki, M., Bonoldi, I., Azis, M., Turkheimer, F., McGuire, P., Young, A. H., & Howes, O. D. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.2943 · Cited by 233
KaSP, Moberget, T., Doan, N. T., Alnæs, D., Kaufmann, T., Córdova‐Palomera, A., Lagerberg, T. V., Diedrichsen, J., Schwarz, E., Zink, M., et al. (2017) · Molecular Psychiatry · doi:10.1038/mp.2017.106 · Cited by 228
BrainAGE score indicates accelerated brain aging in schizophrenia, but not bipolar disorder
Nenadić, I., Dietzek, M., Langbein, K., Sauer, H., & Christian Gaser, B. (2017) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2017.05.006 · Cited by 203
Stratified medicine for mental disorders
Schumann, G., Binder, E. B., Holte, A., de Kloet, E. R., Oedegaard, K. J., Robbins, T. W., Walker-Tilley, T. R., Bitter, I., Brown, V. J., Buitelaar, J., et al. (2014) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2013.09.010 · Cited by 186
Self-citationIvleva, E. I., Clementz, B. A., Dutcher, A. M., Arnold, S. J. M., Jeon‐Slaughter, H., Aslan, S., Witte, B. P., Poudyal, G., Lu, H., Meda, S. A., et al. (2016) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.08.030 · Cited by 146
Hancock, D. B., Guo, Y., Reginsson, G. W., Gaddis, N., Lutz, S. M., Sherva, R., Loukola, A., Minică, C. C., Markunas, C. A., Han, Y., et al. (2017) · Molecular Psychiatry · doi:10.1038/mp.2017.193 · Cited by 139
Biologic Heterogeneity and Psychiatric Research
Buchsbaum, M. S. (1979) · Archives of General Psychiatry · doi:10.1001/archpsyc.1979.01780110017001 · Cited by 137
Doan, N. T., Kaufmann, T., Bettella, F., Jørgensen, K. N., Brandt, C. L., Moberget, T., Alnæs, D., Douaud, G., Duff, E. P., Djurovic, S., et al. (2017) · NeuroImage Clinical · doi:10.1016/j.nicl.2017.06.014 · Cited by 97
Andreazza, A. C., & Young, L. T. (2013) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145713000096 · Cited by 84
Brain structural changes in schizoaffective disorder compared to schizophrenia and bipolar disorder
Amann, B. L., Canales-Rodríguez, E. J., Madre, M., Raduà, J., Monté, G. C., Alonso-Lana, S., Landín-Romero, R., Moreno‐Alcázar, A., Bonnín, C. D. M., Sarró, S., et al. (2015) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12440 · Cited by 75
Is bipolar I disorder heterogeneous?
Angst, J., Gerber-Werder, R., Zuberb�hler, H.-U., & Gamma, A. (2004) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-004-0501-6 · Cited by 50
Refinement by integration: aggregated effects of multimodal imaging markers on adult ADHD
Wolfers, T., Llera, A., Onnink, A. M. H., Dammers, J. T., Hoogman, M., Zwiers, M. P., Buitelaar, J. K., Franke, B., Marquand, A. F., & Beckmann, C. F. (2017) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.160240 · Cited by 46
Weinberger, D. R., & Goldberg, T. E. (2014) · World Psychiatry · doi:10.1002/wps.20096 · Cited by 42
Flagged first, then by citations
3 of the 45 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Weinberger, 2014, RDoCs redux., World Psychiatry, 13, 36, 10.1002/wps.v13.1 · DOI
- First, 1997, Structured Clinical Interview for DSM-IV Axis I Disorders, Clinician Version (SCID-CV)
Cited by
Sorted by citations
Common brain disorders are associated with heritable patterns of apparent aging of the brain
Kaufmann, T., van der Meer, D., Doan, N. T., Schwarz, E., Lund, M. J., Agartz, I., Alnæs, D., Barch, D. M., Baur‐Streubel, R., Bertolino, A., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0471-7 · Cited by 575
Conceptualizing mental disorders as deviations from normative functioning
Marquand, A. F., Kia, S. M., Zabihi, M., Wolfers, T., Buitelaar, J. K., & Beckmann, C. F. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0441-1 · Cited by 433
Self-citationCommon Dysfunction of Large-Scale Neurocognitive Networks Across Psychiatric Disorders
Sha, Z., Wager, T. D., Mechelli, A., & He, Y. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.11.011 · Cited by 367
Han, L. K. M., Dinga, R., Hahn, T., Ching, C. R. K., Eyler, L. T., Aftanas, L. I., Aghajani, M., Aleman, A., Baune, B. T., Berger, K., et al. (2020) · Molecular Psychiatry · doi:10.1038/s41380-020-0754-0 · Cited by 351
Koshiyama, D., Fukunaga, M., Okada, N., Morita, K., Nemoto, K., Usui, K., Yamamori, H., Yasuda, Y., Fujimoto, M., Kudo, N., et al. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0553-7 · Cited by 283
Metadata
- Authors
- Wolfers, T., Doan, N. T., Kaufmann, T., Alnæs, D., Moberget, T., Agartz, I., Buitelaar, J. K., Ueland, T., Melle, I., Franke, B., Andreassen, O. A., Beckmann, C. F., Westlye, L. T., & Marquand, A. F.
- Affiliations
- Radboud University Nijmegen (NL)
- Oslo University Hospital (NO)
- Radboud University Medical Center (NL)
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
- Corresponding author
- Wolfers, Thomas
- ORCID
- Venue
- JAMA Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 2018-11-01
- Volume
- 75
- Issue
- 11
- Pages
- 1146
- ISSN
- 2168-622X (ISSN-L)
- PMC
- PMC6248110
- OpenAlex
- W2896481393
- Cited by
- 508
- References
- 45
- Citations by year
- 2026: 77 · 2025: 92 · 2024: 65 · 2023: 62 · 2022: 62 · 2021: 60 · 2020: 47 · 2019: 35 · 2018: 7
- FWCI
- 29.31
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- JAMA Psychiatry (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- Wellcome Trust (098369/Z/12/Z)
- National Institute of Biomedical Imaging and Bioengineering (U54EB020403)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Health Sciences › Medicine › Psychiatry and Mental health › Bipolar Disorder and Treatment
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Keywords
- schizophrenia, bipolar disorder, gray matter volume, brain structure, schizophrenia spectrum disorders, cerebellum, frontal cortex, temporal cortex, treatment response biomarkers, psychosis spectrum disorders, neuroimaging biomarkers
- MeSH terms
- Adult, Aging, Bipolar Disorder, Brain Mapping, Cross-Sectional Studies, Female, Humans, Male, Phenotype, Schizophrenia, Case-Control Studies, Young Adult, Neuroimaging, White Matter, Gray Matter
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
