The DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
Does feature selection improve classification accuracy? Impact of sample size and feature selection on classification using anatomical magnetic resonance images
Abstract
There are growing numbers of studies using machine learning approaches to characterize patterns of anatomical difference discernible from neuroimaging data. The high-dimensionality of image data often raises a concern that feature selection is needed to obtain optimal accuracy. Among previous studies, mostly using fixed sample sizes, some show greater predictive accuracies with feature selection, whereas others do not. In this study, we compared four common feature selection methods. 1) Pre-selected region of interests (ROIs) that are based on prior knowledge. 2) Univariate t-test filtering. 3) Recursive feature elimination (RFE), and 4) t-test filtering constrained by ROIs. The predictive accuracies achieved from different sample sizes, with and without feature selection, were compared statistically. To demonstrate the effect, we used grey matter segmented from the T1-weighted anatomical scans collected by the Alzheimer's disease Neuroimaging Initiative (ADNI) as the input features to a linear support vector machine classifier. The objective was to characterize the patterns of difference between Alzheimer's disease (AD) patients and cognitively normal subjects, and also to characterize the difference between mild cognitive impairment (MCI) patients and normal subjects. In addition, we also compared the classification accuracies between MCI patients who converted to AD and MCI patients who did not convert within the period of 12 months. Predictive accuracies from two data-driven feature selection methods (t-test filtering and RFE) were no better than those achieved using whole brain data. We showed that we could achieve the most accurate characterizations by using prior knowledge of where to expect neurodegeneration (hippocampus and parahippocampal gyrus). Therefore, feature selection does improve the classification accuracies, but it depends on the method adopted. In general, larger sample sizes yielded higher accuracies with less advantage obtained by using knowledge from the existing literature.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Hence, the neural network method critically depends on relatively larger training and test datasets compared to image processing methods [52-54].”
From Automated Defect Detection and Decision-Support in Gas Turbine Blade Inspection (2021) · cites this paper as [52]
In the citing paper
“However, they require significant amounts of data to accurately perform a classification, especially with increasing number of classes [52-54].”
From Automated Defect Detection and Decision-Support in Gas Turbine Blade Inspection (2021) · cites this paper as [52]
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Self-citationThe Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,123
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
Pattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,545
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 8,354
Flagged first, then by citations
1 of the 50 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Pelaez-Coca, 2011, Discrimination of AD and normal subjects from MRI: anatomical versus statistical regions, Neurosci. Lett., 487, 113, 10.1016/j.neulet.2010.10.007 · DOI
- Tipping, 2001, Sparse Bayesian learning and the relevance vector machine, J. Mach. Learn. Res., 1, 211
Cited by
Sorted by citations
Items 301–319 of 319
Moutoussis, M., Garzón, B., Neufeld, S., Bach, D. R., Rigoli, F., Guitart‐Masip, M., & Dolan, R. J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.20.259697
Zamani, J., Sadr, A., & Javadi, A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.17605/osf.io/be94g
Forouzannezhad, P. (2020) · FIU - Digital Commons (Florida International University) · doi:10.25148/etd.fidc009203
Pre‐Trained CNN Models in Early Alzheimer's Prediction Using Post‐Processed MRI
Gunda, K., & Pradeepini, G. (2022) · Wiley eBooks · doi:10.1002/9781119792376.ch3
Trends in Heart-Rate Variability Signal Analysis
Ishaque, S., Khan, N., & Krishnan, S. (2023) · doi:10.32920/22734353
A Comparison of Feature Selection Techniques for First-day Mortality Prediction in the ICU
Epifano, J. R., Silvestri, A., Yu, A., Ramachandran, R. P., Tripathi, A. G., & Rasool, G. (2023) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas46773.2023.10182228
Nakra, R., Vansomphone, A., & Kimes, R. (2023) · Journal of Emerging Investigators · doi:10.59720/23-013
Diploid Genetic Algorithm-Based Pipeline for the Conversion Prediction of Mild Cognitive Impairment
Bhasin, H., Kumar, A., & Deshwal, V. (2024) · IEEE Region 10 Symposium (TENSYMP) · doi:10.1109/tensymp61132.2024.10752147
Hamim, M., Enaanai, A., Jadli, A., Moutachaouik, H., & Moudden, I. E. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-77040-1_4
Zhang, T. (2025) · Journal of Computational Methods in Sciences and Engineering · doi:10.1177/14727978251364448
Abeywardhana, D. L., DANGALLE, C. D., Nugaliyadde, A., Mallawarachchi, Y., & Thotagamuwa, A. (2025) · Research Square · doi:10.21203/rs.3.rs-7034544/v1
Zhang, Y., Chen, B., Zhuang, Z., Chen, W., Lyu, J., Chen, S., & Zhou, M. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3459-3_18
Thomas, C. M., Nair, A., & Somasundaram, K. (2025) · Annals of Operations Research · doi:10.1007/s10479-025-06953-6
Multi-scale and multimodal imaging biomarkers for the early detection of Alzheimer’s disease
Hett, K. (2019) · theses.fr (ABES) · doi:10.70675/0d4a3118z347az4e13z812cz9ad7566ef5ba
Translating viral genetic data to PRRSV-2 cross-neutralization using machine learning
Pamornchainavakul, N., Huang, J., Paploski, I. A. D., Makau, D. N., Ferreira, C. P., Krishna, V. D., Schroeder, D. C., Cheeran, M. C. ‐., & VanderWaal, K. L. (2026) · Frontiers in Immunology · doi:10.3389/fimmu.2026.1875393
Menezes, J., Barbosa, M. I. A., & Rodrigues, P. M. (2026) · Sensors · doi:10.3390/s26175489
Metadata
- Authors
- Chu, C., Hsu, A.-L., Chou, K.-H., Bandettini, P., & Lin, C.
- Affiliations
- National Institutes of Health (US)
- National Yang Ming University (TW)
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2012-03
- Volume
- 60
- Issue
- 1
- Pages
- 59-70
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2019583087
- Cited by
- 319
- References
- 50
- Citations by year
- 2026: 3 · 2025: 14 · 2024: 14 · 2023: 24 · 2022: 22 · 2021: 38 · 2020: 33 · 2019: 25 · 2018: 19 · 2017: 32 · 2016: 25 · 2015: 20 · 2014: 25 · 2013: 16 · 2012: 9
- FWCI
- 11.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- NeuroImage (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust
- National Science Council (100-2627-B-010-004-, NSC 100-2628-E-010-002-MY3)
- National Institutes of Health
- National Health Research Institutes (NHRI-EX100-9813EC)
- National Institute of Mental Health
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- feature selection, sample size, anatomical MRI, Alzheimer's disease, mild cognitive impairment, grey matter, region of interest selection, recursive feature elimination, hippocampus, parahippocampal gyrus, neurodegeneration, linear support vector machine, classification accuracy, ADNI
- MeSH terms
- Aged, Alzheimer Disease, Female, Humans, Magnetic Resonance Imaging, Male, Reproducibility of Results, Sample Size, Neuroimaging, Cognitive Dysfunction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review