The DOI matches its Crossref record; 69 of the 70 references it cites were found in a registry or an index.
Mitigating the Multicollinearity Problem and Its Machine Learning Approach: A Review
Open accessAbstract
Technologies have driven big data collection across many fields, such as genomics and business intelligence. This results in a significant increase in variables and data points (observations) collected and stored. Although this presents opportunities to better model the relationship between predictors and the response variables, this also causes serious problems during data analysis, one of which is the multicollinearity problem. The two main approaches used to mitigate multicollinearity are variable selection methods and modified estimator methods. However, variable selection methods may negate efforts to collect more data as new data may eventually be dropped from modeling, while recent studies suggest that optimization approaches via machine learning handle data with multicollinearity better than statistical estimators. Therefore, this study details the chronological developments to mitigate the effects of multicollinearity and up-to-date recommendations to better mitigate multicollinearity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In high-dimensional datasets, redundancy and multicollinearity among input features are frequently observed [52].”
From A Machine Learning-Based Quality Control Algorithm for Heavy Rainfall Using Multi-Source Data (2025) · cites this paper as [52]
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,818
PLS-regression: a basic tool of chemometrics
Wold, S., Sjöström, M., & Eriksson, L. (2001) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(01)00155-1 · Cited by 10,084
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Sure Independence Screening for Ultrahigh Dimensional Feature Space
Fan, J., & Lv, J. (2008) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2008.00674.x · Cited by 2,643
Deep learning for sentiment analysis: A survey
Zhang, L., Wang, S., & Liu, B. (2018) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1253 · Cited by 2,182
Performance of some variable selection methods when multicollinearity is present
Chong, I.-G., & Jun, C. (2005) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2004.12.011 · Cited by 2,059
Vrieze, S. I. (2012) · Psychological Methods · doi:10.1037/a0027127 · Cited by 1,948
Weisberg, S. (2005) · Wiley series in probability and statistics · doi:10.1002/0471704091 · Cited by 1,454
Collinearity, Power, and Interpretation of Multiple Regression Analysis
Mason, C. H., & Perreault, W. D. (1991) · Journal of Marketing Research · doi:10.1177/002224379102800302 · Cited by 1,026
Alın, A. (2010) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.84 · Cited by 993
CNNpred: CNN-based stock market prediction using a diverse set of variables
Hoseinzade, E., & Haratizadeh, S. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.029 · Cited by 689
A new class of blased estimate in linear regression
Kejian, L. (1993) · Communication in Statistics- Theory and Methods · doi:10.1080/03610929308831027 · Cited by 663
Kim, T., & Kim, H. Y. (2019) · PLoS ONE · doi:10.1371/journal.pone.0212320 · Cited by 357
I. Problems and Designs of Cross-Validation 1
Mosier, C. I. (1951) · Educational and Psychological Measurement · doi:10.1177/001316445101100101 · Cited by 315
Using Liu-Type Estimator to Combat Collinearity
Liu, K. (2003) · Communication in Statistics- Theory and Methods · doi:10.1081/sta-120019959 · Cited by 313
Diagnosing and Dealing with Multicollinearity
Schroeder, M. A., Lander, J., & Levine‐Silverman, S. (1990) · Western Journal of Nursing Research · doi:10.1177/019394599001200204 · Cited by 303
Selection of the Best Subset in Regression Analysis
Hocking, R. R., & Leslie, R. N. (1967) · Technometrics · doi:10.1080/00401706.1967.10490502 · Cited by 299
Selection of Variables for Fitting Equations to Data
Gorman, J. W., & Toman, R. J. (1966) · Technometrics · doi:10.1080/00401706.1966.10490322 · Cited by 282
Chen, C., Tsai, Y., Chang, F., & Lin, W. (2020) · Expert Systems · doi:10.1111/exsy.12553 · Cited by 217
A New Ridge-Type Estimator for the Linear Regression Model: Simulations and Applications
Kibria, B. M. G., & Lukman, A. F. (2020) · Scientifica · doi:10.1155/2020/9758378 · Cited by 204
Comparison of statistical and machine learning methods in modelling of data with multicollinearity
Garg, A., & Tai, K. (2013) · International Journal of Modelling Identification and Control · doi:10.1504/ijmic.2013.053535 · Cited by 154
Maitra, S., & Yan, J. (2008) · Cited by 154
Applications of Ridge Analysis Toregression Problems
Horel, A. E. (1962) · Chemical engineering progress · Cited by 150
A Genetic Algorithm-Based, Hybrid Machine Learning Approach to Model Selection
Bies, R. R., Muldoon, M. F., Pollock, B. G., Manuck, S. B., Smith, G. S., & Sale, M. E. (2006) · Journal of Pharmacokinetics and Pharmacodynamics · doi:10.1007/s10928-006-9004-6 · Cited by 132
Katrutsa, A., & Strijov, V. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.01.048 · Cited by 131
Regularized online sequential learning algorithm for single-hidden layer feedforward neural networks
Huynh, H. T., & Won, Y. (2011) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.07.016 · Cited by 118
A new maximum relevance-minimum multicollinearity (MRmMC) method for feature selection and ranking
Senawi, A., Wei, H., & Billings, S. A. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.01.026 · Cited by 109
Tamura, R., Kobayashi, K., Takano, Y., Miyashiro, R., Nakata, K., & Matsui, T. (2018) · Journal of Global Optimization · doi:10.1007/s10898-018-0713-3 · Cited by 102
Lafi, S. Q., & Kaneene, J. B. (1992) · Preventive Veterinary Medicine · doi:10.1016/0167-5877(92)90041-d · Cited by 96
On multiple regression analysis
Hamaker, H. C. (1962) · Statistica Neerlandica · doi:10.1111/j.1467-9574.1962.tb01184.x · Cited by 86
Assaf, A. G., Tsionas, E. G., & Tasiopoulos, A. E. (2018) · Tourism Management · doi:10.1016/j.tourman.2018.09.008 · Cited by 83
İnan, D., & Erdoğan, B. E. (2013) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918.2012.667480 · Cited by 78
Ridge Regression for Solving the Multicollinearity Problem: Review of Methods and Models
Duzan, H. M. B., & Shariff, N. S. B. M. (2015) · Journal of Applied Sciences · doi:10.3923/jas.2015.392.404 · Cited by 77
An incremental extreme learning machine for online sequential learning problems
Guo, L., Hao, J., & Liu, M. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.03.055 · Cited by 73
Multicollinearity Effect in Regression Analysis: A Feed Forward Artificial Neural Network Approach
Obite, C. P., Olewuezi, N. P., Ugwuanyim, G. U., & Bartholomew, D. C. (2020) · Asian Journal of Probability and Statistics · doi:10.9734/ajpas/2020/v6i130151 · Cited by 68
An Efficient Traffic Classification Scheme Using Embedded Feature Selection and LightGBM
Hua, Y. (2020) · Information Communication Technologies Conference (ICTC) · doi:10.1109/ictc49638.2020.9123302 · Cited by 64
Online sequential extreme learning machine in nonstationary environments
Ye, Y., Squartini, S., & Piazza, F. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.12.064 · Cited by 58
Generalized Cross-Validation for Simultaneous Optimization of Tuning Parameters in Ridge Regression
Roozbeh, M., Arashi, ., & Hamzah, N. A. (2020) · Iranian Journal of Science and Technology Transactions A Science · doi:10.1007/s40995-020-00851-1 · Cited by 56
Systems Modelling using Genetic Programming
Willis, M. J., Hiden, H., Hinchliffe, M., McKay, B., & Barton, G. W. (1997) · Computers & Chemical Engineering · doi:10.1016/s0098-1354(97)00206-8 · Cited by 54
A new modified Jackknifed estimator for the Poisson regression model
Türkan, S., & Özel, G. (2015) · Journal of Applied Statistics · doi:10.1080/02664763.2015.1125861 · Cited by 54
TOSELM: Timeliness Online Sequential Extreme Learning Machine
Gu, Y., Liu, J., Chen, Y., Jiang, X., & Yu, H. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.02.047 · Cited by 52
Self-citationA Hybrid Feature Selection Optimization Model for High Dimension Data Classification
Qaraad, M., Amjad, S., Manhrawy, I. I. M., Fathi, H., Hassan, B. A., & Elkafrawy, P. (2021) · IEEE Access · doi:10.1109/access.2021.3065341 · Cited by 51
Garg, A., & Tai, K. (2012) · DR-NTU (Nanyang Technological University) · Cited by 50
BEST SUBSET SELECTION FOR ELIMINATING MULTICOLLINEARITY
Tamura, R., Kobayashi, K., Takano, Y., Miyashiro, R., Nakata, K., & Matsui, T. (2017) · Journal of the Operations Research Society of Japan · doi:10.15807/jorsj.60.321 · Cited by 44
A two-parameter estimator in the negative binomial regression model
Huang, J., & Yang, H. (2012) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2012.696648 · Cited by 43
Singh, S. G., & Kumar, S. V. (2021) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-020-05213-y · Cited by 41
Nobrega, J. P., & Oliveira, A. L. I. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.01.070 · Cited by 37
A Recursive Least-Squares with a Time-Varying Regularization Parameter
Mahadi, M., Ballal, T., Moinuddin, M., & Al-Saggaf, U. M. (2022) · Applied Sciences · doi:10.3390/app12042077 · Cited by 24
Multicollinearity in regression: Review and examples
Askin, R. G. (1982) · Journal of Forecasting · doi:10.1002/for.3980010307 · Cited by 22
A MORE GENERAL CRITERION FOR SUBSET SELECTION IN MULTIPLE LINEAR REGRESSION
Kashid, D. N., & Kulkarni, S. R. (2002) · Communication in Statistics- Theory and Methods · doi:10.1081/sta-120003653 · Cited by 22
Residual Control Chart for Binary Response with Multicollinearity Covariates by Neural Network Model
Kim, J., Wang, N., Liu, Y., & Park, K. (2020) · Symmetry · doi:10.3390/sym12030381 · Cited by 20
Stock Price Movement Prediction Based on a Deep Factorization Machine and the Attention Mechanism
Zhang, X., Liu, S., & Zheng, X. (2021) · Mathematics · doi:10.3390/math9080800 · Cited by 20
Partial ridge regression under multicollinearity
Chandrasekhar, C. K., Bagyalakshmi, H., Srinivasan, M. R., & Gallo, M. (2016) · Journal of Applied Statistics · doi:10.1080/02664763.2016.1181726 · Cited by 18
High‐dimensional variable screening under multicollinearity
Zhao, N., Xu, Q., Tang, M., Jiang, B., Chen, Z., & Wang, H. (2020) · Stat · doi:10.1002/sta4.272 · Cited by 18
Outlier Detection Based Feature Selection Exploiting Bio-Inspired Optimization Algorithms
Larabi-Marie-Sainte, S. (2021) · Applied Sciences · doi:10.3390/app11156769 · Cited by 16
Roozbeh, M., Babaie–Kafaki, S., & Aminifard, Z. (2022) · Optimization methods & software · doi:10.1080/10556788.2021.2022144 · Cited by 15
Variable selection under multicollinearity using modified log penalty
Nguyen, V. C., & Ng, C. T. (2019) · Journal of Applied Statistics · doi:10.1080/02664763.2019.1637829 · Cited by 14
Stress test procedure for feature selection algorithms
Katrutsa, A., & Strijov, V. (2015) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2015.01.018 · Cited by 13
A High-Dimensional Counterpart for the Ridge Estimator in Multicollinear Situations
Arashi, ., Norouzirad, M., Roozbeh, M., & Khan, N. M. (2021) · Mathematics · doi:10.3390/math9233057 · Cited by 11
Biased estimators in Poisson regression model in the presence of multicollinearity: A subject review
Algamal, Z. Y. (2018) · AL-Qadisiyah Journal For Administrative and Economic sciences · Cited by 10
A Comparative Study on Regression Methods in the presence of Multicollinearity
Toka, O. (2016) · DergiPark (Istanbul University) · Cited by 9
A nonlinear mixed–integer programming approach for variable selection in linear regression model
Roozbeh, M., Babaie–Kafaki, S., & Aminifard, Z. (2021) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918.2021.1990323 · Cited by 9
Symbolic regression in multicollinearity problems
Castillo, F. A., & Villa, C. M. (2005) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1068009.1068377 · Cited by 3
Multicollinearity problem of CPM communication signals and its suppression method with PLS algorithm
Li, C., Wang, H., Wang, J., Tai, Y., & Yang, F. (2018) · ACM International Conference on Underwater Networks & Systems (WUWNet) · doi:10.1145/3291940.3291980 · Cited by 3
Flagged first, then by citations
1 of the 70 references couldn’t be matched to a known paper.
Research works printed but not linked: 11
- Bollinger, 1992, Using bollinger bands, Stock. Commod., 10, 47
- Iba, H., and Sasaki, T. (1999, January 6–9). Using genetic programming to predict financial data. Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406), Washington, DC, USA.
- Neter, J., Kutner, M.H., Nachtsheim, C.J., and Wasserman, W. (1996). Applied Linear Statistical Models, WCB McGraw-Hill.
- Belsley, D.A., Kuh, E., and Welsch, R.E. (2005). Regression Diagnostics: Identifying Influential Data and Sources of Collinearity, John Wiley & Sons.
- Ralston, A., and Wilf, H.S. (1960). Mathematical Methods for Digital Computers, Wiley.
- Montgomery, D.C., Peck, E.A., and Vining, G.G. (2021). Introduction to Linear Regression Analysis, John Wiley & Sons.
- Misra, 2020, Improving the classification accuracy using recursive feature elimination with cross-validation, Int. J. Emerg. Technol., 11, 659
- Wold, 1982, Soft modeling: The basic design and some extensions, Syst. Under Indirect Obs., 2, 343
- Singh, 1986, An almost unbiased ridge estimator, Sankhyā Indian J. Stat. Ser. B, 48, 342
- Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv.
- Kim, R., So, C.H., Jeong, M., Lee, S., Kim, J., and Kang, J. (2019). Hats: A hierarchical graph attention network for stock movement prediction. arXiv.
Cited by
Sorted by citations
Rahman, A., Debnath, T., Kundu, D., Khan, M. S. I., Aishi, A. A., Sazzad, S., Sayduzzaman, M., & Band, S. S. (2024) · AIMS Public Health · doi:10.3934/publichealth.2024004 · Cited by 260
How Interpretable Machine Learning Can Benefit Process Understanding in the Geosciences
Jiang, S., Sweet, L., Blougouras, G., Brenning, A., Li, W., Reichstein, M., Denzler, J., Shangguan, W., Yu, G., Huang, F., et al. (2024) · Earth s Future · doi:10.1029/2024ef004540 · Cited by 209
A comparative analysis of multivariate approaches for data analysis in management sciences
Ahmed, R. R., Štreimikienė, D., Štreimikis, J., & Šikšnelytė-Butkienė, I. (2024) · E+M Ekonomie a Management · doi:10.15240/tul/001/2024-5-001 · Cited by 123
Extubation in neurocritical care patients: the ENIO international prospective study
Cinotti, R., Mijangos, J., Pelosi, P. P., Hænggi, M., Gurjar, M., Schultz, M. J., Kaye, C. T., Godoy, D. A., Alvarez, P., Ioakeimidou, A., et al. (2022) · Intensive Care Medicine · doi:10.1007/s00134-022-06825-8 · Cited by 121
Ganie, S. M., Pramanik, P. K. D., & Zhao, Z. (2025) · Scientific Reports · doi:10.1038/s41598-025-97547-6 · Cited by 115
Metadata
- Authors
- Chan, J. Y.-L., Leow, S. M. H., Bea, K. T., Cheng, W. K., Phoong, S. W., Hong, Z.-W., & Chen, Y.-L.
- Affiliations
- Universiti Tunku Abdul Rahman (MY)
- University of Malaya (MY)
- Feng Chia University (TW)
- National Taipei University of Technology (TW)
- Corresponding author
- Chan, Jireh Yi-Le
- Chen, Yen-Lin
- Venue
- Mathematics
- Publisher
- MDPI AG
- Published
- 2022-04-12
- Volume
- 10
- Issue
- 8
- Pages
- 1283
- ISSN
- 2227-7390 (ISSN-L)
- OpenAlex
- W4223552619
- Cited by
- 617
- References
- 70
- Citations by year
- 2026: 165 · 2025: 216 · 2024: 156 · 2023: 64 · 2022: 16
- FWCI
- 83.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Mathematics (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministry of Science and Technology of Taiwan (109-2628-E-027-004–MY3, MOST-110-2218-E-027-004)
- Ministry of Higher Education (FRGS/1/2019/STG06/UTAR/03/1)
- Ministry of Education of Taiwan (Official Document No. 1100156712)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Keywords
- multicollinearity, feature selection, modified estimators, big data, high-dimensional data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
