The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Variable importance in regression models
Abstract
Regression analysis is one of the most‐used statistical methods. Often part of the research question is the identification of the most important regressors or an importance ranking of the regressors. Most regression models are not specifically suited for answering the variable importance question, so that many different proposals have been made. This article reviews in detail the various variable importance metrics for the linear model, particularly emphasizing variance decomposition metrics. All linear model metrics are illustrated by an example analysis. For nonlinear parametric models, several principles from linear models have been adapted, and machine‐learning methods have their own set of variable importance methods. These are also briefly covered. Although there are many variable importance metrics, there is still no convincing theoretical basis for them, and they all have a heuristic touch. Nevertheless, some metrics are considered useful for a crude assessment in the absence of a good subject matter theory.WIREs Comput Stat 2015, 7:137–152. doi: 10.1002/wics.1346 This article is categorized under:Statistical and Graphical Methods of Data Analysis > Multivariate Analysis
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Shapley, L. S. (1988) · The Shapley Value · doi:10.1017/cbo9780511528446.003 · Cited by 4,954
Unbiased Recursive Partitioning: A Conditional Inference Framework
Hothorn, T., Hornik, K., & Zeileis, A. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x133933 · Cited by 4,021
(1982) · Cited by 3,737
Conditional variable importance for random forests
Strobl, C., Boulesteix, A.-L., Kneib, T., Augustin, T., & Zeileis, A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-307 · Cited by 3,254
Relative Importance for Linear Regression in R : The Package relaimpo
Grömping, U. (2006) · Journal of Statistical Software · doi:10.18637/jss.v017.i01 · Cited by 2,615
Self-citationGevrey, M., Dimopoulos, I., & Lek, S. (2003) · Ecological Modelling · doi:10.1016/s0304-3800(02)00257-0 · Cited by 1,248
Budescu, D. V. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.542 · Cited by 1,193
Chevan, A., & Sutherland, M. (1991) · The American Statistician · doi:10.1080/00031305.1991.10475776 · Cited by 1,163
A Heuristic Method for Estimating the Relative Weight of Predictor Variables in Multiple Regression
Johnson, J. W. (2000) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3501_1 · Cited by 1,135
Multiple regression in psychological research and practice.
Darlington, R. B. (1968) · Psychological Bulletin · doi:10.1037/h0025471 · Cited by 1,132
Variable Importance Assessment in Regression: Linear Regression versus Random Forest
Grömping, U. (2009) · The American Statistician · doi:10.1198/tast.2009.08199 · Cited by 1,103
Self-citationThe dominance analysis approach for comparing predictors in multiple regression.
Azen, R., & Budescu, D. V. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.129 · Cited by 1,086
Introduction to Bivariate and Multivariate Analysis.
Sen, P. K., Lindeman, R. H., Merenda, P. F., & Gold, R. Z. (1981) · Journal of the American Statistical Association · doi:10.2307/2287559 · Cited by 1,055
History and Use of Relative Importance Indices in Organizational Research
Johnson, J. W., & Lebreton, J. M. (2004) · Organizational Research Methods · doi:10.1177/1094428104266510 · Cited by 940
Mac Nally, R. (2000) · Biodiversity & Conservation · doi:10.1023/a:1008985925162 · Cited by 938
A Lego System for Conditional Inference
Hothorn, T., Hornik, K., van de Wiel, M. A., & Zeileis, A. (2006) · The American Statistician · doi:10.1198/000313006x118430 · Cited by 892
The paramorphic representation of clinical judgment.
Hoffman, P. J. (1960) · Psychological Bulletin · doi:10.1037/h0047807 · Cited by 698
Analysis of regression in game theory approach
Lipovetsky, S., & Conklin, M. (2001) · Applied Stochastic Models in Business and Industry · doi:10.1002/asmb.446 · Cited by 650
Estimators of Relative Importance in Linear Regression Based on Variance Decomposition
Grömping, U. (2007) · The American Statistician · doi:10.1198/000313007x188252 · Cited by 612
Self-citationInterpreting and Using Regression
Achen, C. (1982) · Sage eBooks · doi:10.4135/9781412984560 · Cited by 595
Mac Nally, R. (2002) · Biodiversity & Conservation · doi:10.1023/a:1016250716679 · Cited by 554
Classification and Regression Trees
(2022) · The R Book · doi:10.1002/9781119634461.ch20 · Cited by 499
Hierarchical Partitioning Public-domain Software
Nally, R. M., & Walsh, C. J. (2004) · Biodiversity & Conservation · doi:10.1023/b:bioc.0000009515.11717.0b · Cited by 405
Understanding the Results of Multiple Linear Regression: Beyond Standardized Regression Coefficients
Nimon, K. F., & Oswald, F. L. (2013) · Organizational Research Methods · doi:10.1177/1094428113493929 · Cited by 349
Ray‐Mukherjee, J., Nimon, K., Mukherjee, S., Morris, D. W., Slotow, R., & Hamer, M. (2014) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12166 · Cited by 303
The Shapley Value: Essays in Honor of Lloyd S. Shapley.
Cubitt, R., & Roth, A. E. (1991) · The Economic Journal · doi:10.2307/2233574 · Cited by 248
Relative Importance by Averaging over Orderings
Kruskal, W. (1987) · The American Statistician · doi:10.1080/00031305.1987.10475432 · Cited by 237
Silber, J. H., Rosenbaum, P. R., & Ross, R. N. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476483 · Cited by 185
A Monte Carlo Comparison of Relative Importance Methodologies
Lebreton, J. M., Ployhart, R. E., & Ladd, R. T. (2004) · Organizational Research Methods · doi:10.1177/1094428104266017 · Cited by 184
Sequential and average attributable fractions as aids in the selection of preventive strategies
Eide, G. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00161-i · Cited by 178
Statistical Inference for Variable Importance
van der Laan, M. J. (2006) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1008 · Cited by 165
On Variable Importance in Linear Regression
Thomas, D. R., Hughes, E., & Zumbo, B. D. (1998) · Social Indicators Research · doi:10.1023/a:1006954016433 · Cited by 157
High-Dimensional Regression and Variable Selection Using CAR Scores
Zuber, V., & Strimmer, K. (2011) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1730 · Cited by 134
Beyond Global Measures of Relative Importance: Some Insights from Dominance Analysis
Budescu, D. V., & Azen, R. (2004) · Organizational Research Methods · doi:10.1177/1094428104267049 · Cited by 130
Bi, J. (2012) · Journal of Sensory Studies · doi:10.1111/j.1745-459x.2012.00370.x · Cited by 123
Concepts of Relative Importance in Recent Scientific Literature
Kruskal, W., & Majors, R. (1989) · The American Statistician · doi:10.1080/00031305.1989.10475596 · Cited by 115
Using Autonomous Software Agents to Create the Next Generation of Decision Support Systems*
Hess, T. J., Rees, L. P., & Rakes, T. R. (2000) · Decision Sciences · doi:10.1111/j.1540-5915.2000.tb00922.x · Cited by 100
High-Dimensional Regression and Variable Selection Using CAR ScoresPreprint
Zuber, V., & Strimmer, K. (2016) · Cited by 99
Silber, J. H., Rosenbaum, P. R., & Ross, R. N. (1995) · Journal of the American Statistical Association · doi:10.2307/2291124 · Cited by 81
A Geometric Approach to Compare Variables in a Regression Model
Bring, J. (1996) · The American Statistician · doi:10.1080/00031305.1996.10473543 · Cited by 73
The Minimal Transformation to Orthonormality
Johnson, R. M. (1966) · Psychometrika · doi:10.1007/bf02289457 · Cited by 67
Estimating a Survival Distribution with Current Status Data and High-dimensional Covariates
van der Vaart, A., & van der Laan, M. J. (2006) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1014 · Cited by 48
Information-Theoretic Measures of Fit for Univariate and Multivariate Linear Regressions
Theil, H., & Chung, C. (1992) · Advanced studies in theoretical and applied econometrics · doi:10.1007/978-94-011-2408-9_22 · Cited by 43
Bi, J., & CHUNG, J. (2011) · Journal of Sensory Studies · doi:10.1111/j.1745-459x.2011.00340.x · Cited by 39
On Johnson's (2000) Relative Weights Method for Assessing Variable Importance: A Reanalysis
Thomas, D. R., Zumbo, B. D., Kwan, E., & Schweitzer, L. (2014) · Multivariate Behavioral Research · doi:10.1080/00273171.2014.905766 · Cited by 36
Measures of predictor variable importance in multiple regression: An additional suggestion
Fabbris, L. (1980) · Quality & Quantity · doi:10.1007/bf00145808 · Cited by 26
Information importance of predictors: Concept, measures, Bayesian inference, and applications
Retzer, J. J., Soofi, E. S., & Soyer, R. (2008) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2008.03.010 · Cited by 18
A Multiplicative Variant of the Shapley Value for Factorizing the Risk of Disease
Land, M., & Gefeller, O. (2000) · Theory and decision library. Series C, Game theory, mathematical programming and operations research · doi:10.1007/978-1-4615-4627-6_11 · Cited by 12
Do not adjust coefficients in Shapley value regression
Grömping, U., & Landau, S. (2009) · Applied Stochastic Models in Business and Industry · doi:10.1002/asmb.773 · Cited by 11
Self-citation(1987) · The American Statistician · doi:10.1080/00031305.1987.10475511 · Cited by 8
Wang, X., Duverger, P., & Bansal, H. S. (2013) · International Journal of Pure and Apllied Mathematics · doi:10.12732/ijpam.v88i3.1 · Cited by 6
A cooperative value in a multiplicative model
Ortmann, K. M. (2012) · Central European Journal of Operations Research · doi:10.1007/s10100-012-0247-6 · Cited by 6
RPackagemultiPIM: A Causal Inference Approach to Variable Importance Analysis
Ritter, S., Jewell, N. P., & Hubbard, A. (2014) · Journal of Statistical Software · doi:10.18637/jss.v057.i08 · Cited by 5
Cited by
Lai, J., Zou, Y., Zhang, J., & Peres‐Neto, P. R. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13800 · Cited by 1,264
Tyralis, H., Papacharalampous, G., & Langousis, A. (2019) · Water · doi:10.3390/w11050910 · Cited by 771
Patterns in soil microbial diversity across Europe
Labouyrie, M., Ballabio, C., Romero, F., Panagos, P., Jones, A., Schmid, M. W., Mikryukov, V., Dulya, O., Tedersoo, L., Bahram, M., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37937-4 · Cited by 340
Mizumoto, A. (2023) · Language Learning · doi:10.1111/lang.12518 · Cited by 176
Metadata
- Authors
- Grömping, U.
- Venue
- WIREs Computational Statistics
- Publisher
- Wiley
- Published
- 2015-02-06
- Volume
- 7
- Issue
- 2
- Pages
- 137-152
- ISSN
- 1939-0068 (ISSN-L)
- 1939-5108
- OpenAlex
- W2133649842
- Cited by
- 304
- References
- 57
- FWCI
- 9.64
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.