The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Variable selection – A review and recommendations for the practicing statistician
Open accessAbstract
Statistical models support medical research by facilitating individualized outcome prognostication conditional on independent variables or by estimating effects of risk factors adjusted for covariates. Theory of statistical models is well‐established if the set of independent variables to consider is fixed and small. Hence, we can assume that effect estimates are unbiased and the usual methods for confidence interval estimation are valid. In routine work, however, it is not known a priori which covariates should be included in a model, and often we are confronted with the number of candidate variables in the range 10–30. This number is often too large to be considered in a statistical model. We provide an overview of various available variable selection methods that are based on significance or information criteria, penalized likelihood, the change‐in‐estimate criterion, background knowledge, or combinations thereof. These methods were usually developed in the context of a linear regression model and then transferred to more generalized linear models or models for censored survival data. Variable selection, in particular if used in explanatory modeling where effect estimates are of central interest, can compromise stability of a final model, unbiasedness of regression coefficients, and validity of p‐values or confidence intervals. Therefore, we give pragmatic recommendations for the practicing statistician on application of variable selection methods in general (low‐dimensional) modeling problems and on performing stability investigations and inference. We also propose some quantities based on resampling the entire variable selection process to be routinely reported by software packages offering automated variable selection algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Regression Models and Life-Tables
Cox, D. R. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00899.x · Cited by 39,793
Regression Models and Life-Tables
Cox, D. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_37 · Cited by 26,297
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
Cited by
Calculating the sample size required for developing a clinical prediction model
Riley, R. D., Ensor, J., Snell, K. I. E., Harrell, F. E., Martin, G. P., Reitsma, J. B., Moons, K. G. M., Collins, G., & van Smeden, M. (2020) · BMJ · doi:10.1136/bmj.m441 · Cited by 2,917
Tennant, P. W. G., Murray, E. J., Arnold, K. F., Berrie, L., Fox, M. P., Gadd, S. C., Harrison, W. J., Keeble, C., Ranker, L. R., Textor, J., et al. (2021) · International Journal of Epidemiology · doi:10.1093/ije/dyaa213 · Cited by 1,052
Tyralis, H., Papacharalampous, G., & Langousis, A. (2019) · Water · doi:10.3390/w11050910 · Cited by 771
Stability of clinical prediction models developed using statistical or machine learning methods
Riley, R. D., & Collins, G. S. (2023) · Biometrical Journal · doi:10.1002/bimj.202200302 · Cited by 211
Smith, M., Manduchi, B., Burke, É., Carroll, R., McCallion, P., & McCarron, M. (2020) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2019.103557 · Cited by 141
Challenges in the Development of Soft Sensors for Bioprocesses: A Critical Review
Brunner, V., Siegl, M., Geier, D., & Becker, T. (2021) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2021.722202 · Cited by 100
Mental Health During the First Weeks of the COVID-19 Pandemic in the United States
Killgore, W. D. S., Cloonan, S. A., Taylor, E. C., & Dailey, N. S. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.561898 · Cited by 83
Prevalence, risk factors, and type of sleep apnea in patients with paroxysmal atrial fibrillation
Traaen, G. M., Øverland, B., Aakerøy, L., Hunt, T. E., Bendz, C., Sande, L., Aakhus, S., Zaré, H., Steinshamn, S., Anfinsen, O. G., et al. (2020) · IJC Heart & Vasculature · doi:10.1016/j.ijcha.2019.100447 · Cited by 71
Amass, T., Van Scoy, L. J., Hua, M., Ambler, M., Armstrong, P., Baldwin, M. R., Bernacki, R., Burhani, M. D., Chiurco, J., Cooper, Z., et al. (2022) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2022.1118 · Cited by 61
Machine Learning in Policy Evaluation: New Tools for Causal Inference
Kreif, N., & DiazOrdaz, K. (2019) · Oxford Research Encyclopedia of Economics and Finance · doi:10.1093/acrefore/9780190625979.013.256 · Cited by 57
Simione, L., Raffone, A., & Mirolli, M. (2021) · Mindfulness · doi:10.1007/s12671-021-01607-7 · Cited by 52
Basic Framework and Main Methods of Uncertainty Quantification
Zhang, J., Yin, J., & Wang, R. (2020) · Mathematical Problems in Engineering · doi:10.1155/2020/6068203 · Cited by 52
Suh, J., Yoo, S., Park, J., Cho, S. Y., Cho, M. C., Son, H., & Jeong, H. (2020) · BJU International · doi:10.1111/bju.15122 · Cited by 45
Khatri, R. B., Durham, J., Karkee, R., & Assefa, Y. (2022) · Reproductive Health · doi:10.1186/s12978-022-01465-z · Cited by 36
Vollmuth, C., Fiessler, C., Montellano, F. A., Kollikowski, A. M., Essig, F., Oeckl, P., Barba, L., Steinacker, P., Schulz, C., Ungethüm, K., et al. (2024) · European Stroke Journal · doi:10.1177/23969873241234436 · Cited by 38
Hadasch, S., Laidig, F., Macholdt, J., Bönecke, E., & Piepho, H. P. (2020) · Field Crops Research · doi:10.1016/j.fcr.2020.107792 · Cited by 33
Hoare, E., Werneck, A. O., Stubbs, B., Firth, J., Collins, S., Corder, K., & van Sluijs, E. M. F. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.11381 · Cited by 30
Vluggen, S., Candel, M., Hoving, C., Schaper, N. C., & de Vries, H. (2021) · Journal of Medical Internet Research · doi:10.2196/18524 · Cited by 26
Khatri, R. B., Karkee, R., Durham, J., & Assefa, Y. (2021) · Globalization and Health · doi:10.1186/s12992-021-00791-4 · Cited by 20
Premenstrual symptoms as a marker of ovarian hormone sensitivity in eating disorders
Hardin, S. L., Thornton, L. M., Munn‐Chernoff, M. A., & Baker, J. H. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23213 · Cited by 22
Variable time delay estimation in continuous industrial processes
Cattaldo, M., Ferrer, A., & Måge, I. (2024) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2024.105082 · Cited by 18
Forks over knives: Predictive inconsistency in criminal justice algorithmic risk assessment tools
Greene, T., Shmueli, G., Fell, J., Lin, C.-F., & Liu, H.-W. (2022) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12966 · Cited by 15
Petropoulou, M., Rücker, G., Weibel, S., Kranke, P., & Schwarzer, G. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-01959-9 · Cited by 12
Rehman, H., Initiative, F. T. A. D. N., Ang, T. F. A., Tao, Q., Espenilla, A. L., Au, R., Farrer, L. A., Zhang, X., & Qiu, W. Q. (2024) · Journal of Alzheimer's Disease · doi:10.3233/jad-230837 · Cited by 7
Metadata
- Authors
- Heinze, G., Wallisch, C., & Dunkler, D.
- Venue
- Biometrical Journal
- Publisher
- Wiley
- Published
- 2018-01-02
- Volume
- 60
- Issue
- 3
- Pages
- 431-449
- ISSN
- 0323-3847 (ISSN-L)
- 1521-4036
- OpenAlex
- W2782176193
- Cited by
- 1,639
- References
- 69
- FWCI
- 97.35
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.