The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
A variable selection method based on mutual information and variance inflation factor
Abstract
Feature selection plays a vital role in the quantitative analysis of high-dimensional data to reduce dimensionality. Recently, the variable selection method based on mutual information (MI) has attracted more and more attention in the field of feature selection, where the relevance between the candidate variable and the response is maximized and the redundancy of the selected variables is minimized. However, multicollinearity often is a serious problem in linear models. Collinearity can cause unstable parameter estimation, unreliable models, and weak predictive ability. In order to address this problem, the variance inflation factor (VIF) was introduced for feature selection. Therefore, a variable selection method based on MI combined with VIF was proposed in this paper, called Mutual Information-Variance Inflation Factor (MI-VIF). By calculating the MI between the independent variable and the response variable, the variable with greater MI was selected to maximize the correlation between the independent variable and the response variable. By calculating the VIF between the independent variables, the multicollinearity test was performed. The variables that cause the multicollinearity of the model were eliminated to minimize the collinearity between the independent variables. The proposed method was tested based on two high-dimensional spectral datasets. The regression models (PLSR, MLR) were established based on feature selection through MI-VIF and MI-based methods (MIFS, MMIFS) to compare the prediction accuracy of the models. The results showed that under two datasets, the MI-VIF showed a good prediction performance. Based on the tea dataset, the established MI-VIF-MLR model achieved accuracy with Rp2 of 0.8612 and RMSEP of 0.4096, the MI-VIF-PLSR model achieved accuracy with Rp2 of 0.8614 and RMSEP of 0.4092. Based on the diesel fuels dataset, the established MI-VIF-MLR model achieved accuracy with Rp2 of 0.9707 and RMSEP of 0.6568, the MI-VIF-PLSR model achieved accuracy with Rp2 of 0.9431 and RMSEP of 0.9675. In addition, the MI-VIF was compared with the Successive projections algorithm (SPA), which is a method to reduce the collinearity between variables in the wavelength selection of the near-infrared spectrum. It was found that MI-VIF also had a good predictive effect compared to SPA. It proves that the MI-VIF is an effective variable selection method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Statistical pattern recognition: a review
Jain, A. K., Duin, P. W., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,767
Using mutual information for selecting features in supervised neural net learning
Battiti, R. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.298224 · Cited by 2,148
The successive projections algorithm for variable selection in spectroscopic multicomponent analysis
Araújo, M. C. U., Saldanha, T. C. B., Galvão, R. K. H., Yoneyama, T., Chame, H. C., & Visani, V. (2001) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(01)00119-8 · Cited by 1,320
Normalized Mutual Information Feature Selection
Estevez, P. A., Tesmer, M., Perez, C. A., & Zurada, J. M. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005601 · Cited by 1,288
A review of feature selection methods based on mutual information
Vergara, J. R., & Estévez, P. A. (2014) · Neural Computing and Applications · doi:10.1007/s00521-013-1368-0 · Cited by 1,255
Equitability, mutual information, and the maximal information coefficient
Kinney, J. B., & Atwal, G. S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1309933111 · Cited by 667
Input feature selection by mutual information based on Parzen window
Kwak, N., & Choi, C.-H. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1114861 · Cited by 641
Mutual information-based feature selection for intrusion detection systems
Amiri, F., Rezaei Yousefi, M., Lucas, C., Shakery, A., & Yazdani, N. (2011) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2011.01.002 · Cited by 471
Wang, Z., Li, M., & Li, J. (2015) · Information Sciences · doi:10.1016/j.ins.2015.02.031 · Cited by 110
Metadata
- Authors
- Cheng, J., Sun, J., Yao, K., Xu, M., & Cao, Y.
- Venue
- Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy
- Publisher
- Elsevier BV
- Published
- 2022-03
- Volume
- 268
- Pages
- 120652
- ISSN
- 1386-1425 (ISSN-L)
- OpenAlex
- W3216119358
- Cited by
- 319
- References
- 15
- FWCI
- 13.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A variable selection method based on mutual information and variance inflation factor. https://app.cochat.ai/papers/10.1016/j.saa.2021.120652
- The paper
- Cheng, J., Sun, J., Yao, K., Xu, M., & Cao, Y. (2022). A variable selection method based on mutual information and variance inflation factor. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy. https://doi.org/10.1016/j.saa.2021.120652
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.