Supervised machine learning for diagnostic classification from large-scale neuroimaging datasets
Open accessThe DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
There are growing concerns about the generalizability of machine learning classifiers in neuroimaging. In order to evaluate this aspect across relatively large heterogeneous populations, we investigated four disorders: Autism spectrum disorder (N = 988), Attention deficit hyperactivity disorder (N = 930), Post-traumatic stress disorder (N = 87) and Alzheimer’s disease (N = 132). We applied 18 different machine learning classifiers (based on diverse principles) wherein the training/validation and the hold-out test data belonged to samples with the same diagnosis but differing in either the age range or the acquisition site. Our results indicate that overfitting can be a huge problem in heterogeneous datasets, especially with fewer samples, leading to inflated measures of accuracy that fail to generalize well to the general clinical population. Further, different classifiers tended to perform well on different datasets. In order to address this, we propose a consensus-classifier by combining the predictive power of all 18 classifiers. The consensus-classifier was less sensitive to unmatched training/validation and holdout test data. Finally, we combined feature importance scores obtained from all classifiers to infer the discriminative ability of connectivity features. The functional connectivity patterns thus identified were robust to the classification algorithm used, age and acquisition site differences, and had diagnostic predictive ability in addition to univariate statistically significant group differences between the groups. A MATLAB toolbox called Machine Learning in NeuroImaging (MALINI), which implements all the 18 different classifiers along with the consensus classifier is available from Lanka et al. (2019) The toolbox can also be found at the following URL: https://github.com/pradlanka/malini.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How do you feel — now? The anterior insula and human awareness
(Bud) Craig, A. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2555 · Cited by 6,657 · cited 2×
“Insula, on the other hand, is associated with perception, cognition, emotion and self-awareness (Craig, 2009; Karnath, Baier, & Nägele, 2005; Devue, et al., 2007) and has been implicated in Alzheimer’s disease as well (Foundas, Leonard, Mahoney, Agee, & Heilman, 1997; Karas, et al.”
BackgroundBaio, J., Wiggins, L., Christensen, D. L., Maenner, M. J., Daniels, J., Warren, Z., Kurzius-Spencer, M., Zahorodny, W., Robinson, C., Rosenberg, et al. (2018) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss6706a1 · Cited by 6,078
Saliency, switching, attention and control: a network model of insula function
Menon, V., & Uddin, L. Q. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0262-0 · Cited by 5,592
BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics
Xia, M., Wang, J., & He, Y. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068910 · Cited by 4,106 · cited 1×
“The features or connectivity paths thus identified were then visualized in BrainNet Viewer (Xia et al. 2013).”
MethodMovement‐Related effects in fMRI time‐series
Friston, K. J., Williams, S., Howard, R., Frackowiak, R. S. J., & Turner, R. (1996) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910350312 · Cited by 3,774
DPARSF: a MATLAB toolbox for “pipeline” data analysis of resting-state fMRI
Yan (2010) · Frontiers in System Neuroscience · doi:10.3389/fnsys.2010.00013 · Cited by 3,475
Toward discovery science of human brain function
Biswal, B. B., Mennes, M., Zuo, X.-N., Gohel, S., Kelly, C., Smith, S. M., Beckmann, C. F., Adelstein, J. S., Buckner, R. L., Colcombe, S., et al. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0911855107 · Cited by 2,970
Di Martino, A., Yan, C.-G., Li, Q., Denio, E., Castellanos, F. X., Alaerts, K., Anderson, J. S., Assaf, M., Bookheimer, S. Y., Dapretto, M., et al. (2014) · Molecular Psychiatry · doi:10.1038/mp.2013.78 · Cited by 2,780
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Edgington, E., Edgington, E., & Onghena, P. (2007) · doi:10.1201/9781420011814 · Cited by 2,030
Cited by
Brain–phenotype models fail for individuals who defy sample stereotypes
Greene, A. S., Shen, X., Noble, S., Horien, C., Hahn, C. A., Arora, J., Tokoglu, F., Spann, M. N., Carrión, C. I., Barron, D. S., et al. (2022) · Nature · doi:10.1038/s41586-022-05118-w · Cited by 167
Chen, Z., Liu, X., Yang, Q., Wang, Y.-J., Miao, K., Gong, Z., Yu, Y., Leonov, A., Liu, C., Feng, Z., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.1671 · Cited by 43
Chen, Z., Hu, B., Liu, X., Becker, B., Eickhoff, S. B., Miao, K., Gu, X., Tang, Y., Dai, X., Li, C., et al. (2023) · BMC Medicine · doi:10.1186/s12916-023-02941-4 · Cited by 35
Davis, M. A., Lim, N., Jordan, J., Yee, J., Gichoya, J. W., & Lee, R. (2023) · American Journal of Roentgenology · doi:10.2214/ajr.22.28802 · Cited by 19
Stephenson, C., Philipp-Muller, A., Moghimi, E., Nashed, J. Y., Cook, D. J., Shirazi, A., Milev, R., & Alavi, N. (2025) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-024-01852-6 · Cited by 10
Metadata
- Authors
- Lanka, P., Rangaprakash, D., Dretsch, M. N., Katz, J. S., Denney, T. S., & Deshpande, G.
- Venue
- Brain Imaging and Behavior
- Published
- 2019-11-05
- Volume
- 14
- Issue
- 6
- Pages
- 2378-2416
- ISSN
- 1931-7557 (ISSN-L)
- 1931-7565
- OpenAlex
- W2989261235
- Cited by
- 79
- References
- 59
- FWCI
- 4.87
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Supervised machine learning for diagnostic classification from large-scale neuroimaging datasets. https://app.cochat.ai/papers/10.1007/s11682-019-00191-8
- The paper
- Lanka, P., Rangaprakash, D., Dretsch, M. N., Katz, J. S., Denney, T. S., & Deshpande, G. (2020). Supervised machine learning for diagnostic classification from large-scale neuroimaging datasets. Brain Imaging and Behavior. https://doi.org/10.1007/s11682-019-00191-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.