The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Model Selection in Linear Mixed Models
Open accessAbstract
Linear mixed effects models are highly flexible in handling a broad range of data types and are therefore widely used in applications. A key part in the analysis of data is model selection, which often aims to choose a parsimonious model with other desirable properties from a possibly very large set of candidate statistical models. Over the last 5–10 years the literature on model selection in linear mixed models has grown extremely rapidly. The problem is much more complicated than in linear regression because selection on the covariance structure is not straightforward due to computational issues and boundary problems arising from positive semidefinite constraints on covariance matrices. To obtain a better understanding of the available methods, their properties and the relationships between them, we review a large body of literature on linear mixed model selection. We arrange, implement, discuss and compare model selection methods based on four major approaches: information criteria such as AIC or BIC, shrinkage methods based on penalized loss functions such as LASSO, the Fence procedure and Bayesian techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
The adaptive lasso and its oracle properties
Zou, H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000735 · Cited by 7,470
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,459
Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
GREEN, P. J. (1995) · Biometrika · doi:10.1093/biomet/82.4.711 · Cited by 5,930
Bozdogan, H. (1987) · Psychometrika · doi:10.1007/bf02294361 · Cited by 4,468
Recovery of inter-block information when block sizes are unequal
PATTERSON, H. D., & THOMPSON, R. (1971) · Biometrika · doi:10.1093/biomet/58.3.545 · Cited by 4,058
Regression Shrinkage and Selection via The Lasso: A Retrospective
Tibshirani, R. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.00771.x · Cited by 3,589
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_38 · Cited by 3,028
The Determination of the Order of an Autoregression
Hannan, E. J., & Quinn, B. G. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01072.x · Cited by 2,992
Further analysis of the data by Akaike's information criterion and the finite corrections
Sugiura, N. (1978) · Communications in Statistics - Theory and Methods · doi:10.1080/03610927808827599 · Cited by 2,144
Ruppert, D., Wand, M. P., & Carroll, R. J. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511755453 · Cited by 2,124
Marginal Likelihood from the Gibbs Output
Chib, S. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476635 · Cited by 1,905
Pathwise coordinate optimization
Friedman, J., Hastie, T., Höfling, H., & Tibshirani, R. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas131 · Cited by 1,895
Statistics for High-Dimensional Data: Methods, Theory and Applications
Bühlmann, P., & van de Geer, S. (2011) · Springer Series in Statistics · doi:10.1007/978-3-642-20192-9 · Cited by 1,680
The Group Lasso for Logistic Regression
Meier, L., Van De Geer, S., & Bühlmann, P. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00627.x · Cited by 1,674
Statistics for High-Dimensional Data: Methods, Theory and Applications
Bhlmann, P., & van de Geer, S. (2011) · Cited by 1,527
Pattern Recognition and Neural Networks
Fulkerson, B. (1997) · Technometrics · doi:10.1080/00401706.1997.10485099 · Cited by 1,371
An asymptotic equivalence of choice of model by cross validation and Akaike's criterion
Stone, M. (1977) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1977.tb01603.x · Cited by 1,286
Estimates of Income for Small Places: An Application of James-Stein Procedures to Census Data
Fay, R. E., & Herriot, R. A. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10482505 · Cited by 1,259
Fan, J., & Lv, J. (2009) · PubMed · doi:10.48550/arxiv.0910.1122 · Cited by 1,037
Mixed-Effects Models in S and S-PLUS
(2000) · Statistics and Computing · doi:10.1007/b98882 · Cited by 930
One-step sparse estimates in nonconcave penalized likelihood modelsPreprint
Zou, H., & Li, R. (2008) · Cited by 919
One-step sparse estimates in nonconcave penalized likelihood models
Zou, H., & Li, R. (2008) · The Annals of Statistics · doi:10.1214/009053607000000802 · Cited by 683
Murata, N., Yoshizawa, S., & Amari, S. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.329683 · Cited by 645
Conditional Akaike information for mixed-effects models
Vaida, F., & Blanchard, S. (2005) · Biometrika · doi:10.1093/biomet/92.2.351 · Cited by 585
Ryan, T. P. (2004) · Journal of Quality Technology · doi:10.1080/00224065.2004.11980270 · Cited by 581
Model Selection and Model Averaging
Ginestet, C. E. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2009.00614_5.x · Cited by 553
On Measuring and Correcting the Effects of Data Mining and Model Selection
Ye, J. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10474094 · Cited by 518
Linear and Generalized Linear Mixed Models and Their Applications
(2007) · Springer Series in Statistics · doi:10.1007/978-0-387-47946-0 · Cited by 477
Moody, J. E. (1991) · Cited by 437
Field, C. A., & Welsh, A. H. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00593.x · Cited by 426
Self-citationInformation and Complexity in Statistical Modeling
Rissanen, J. (2007) · Information Science and Statistics · doi:10.1007/978-0-387-68812-1 · Cited by 355
Markov Chain Monte Carlo Methods for Computing Bayes Factors: A Comparative Review
Han, C., & Carlin, B. P. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753208780 · Cited by 275
On the behaviour of marginal and conditional AIC in linear mixed models
Greven, S., & Kneib, T. (2010) · Biometrika · doi:10.1093/biomet/asq042 · Cited by 253
Random Effects Selection in Linear Mixed Models
Chen, Z., & Dunson, D. B. (2003) · Biometrics · doi:10.1111/j.0006-341x.2003.00089.x · Cited by 244
Joint Variable Selection for Fixed and Random Effects in Linear Mixed‐Effects Models
Bondell, H. D., Krishna, A., & Ghosh, S. K. (2010) · Biometrics · doi:10.1111/j.1541-0420.2010.01391.x · Cited by 223
Estimation for High‐Dimensional Linear Mixed‐Effects Models Using ℓ1‐Penalization
SCHELLDORFER, J., Bühlmann, P., & van de Geer, S. (2011) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2011.00740.x · Cited by 208
Model Selection For Geostatistical Models
Hoeting, J. A., Davis, R. A., Merton, A. A., & Thompson, S. E. (2006) · Ecological Applications · doi:10.1890/04-0576 · Cited by 204
Estimates of Income for Small Places: An Application of James-Stein Procedures to Census Data
III, R. E. F., & Herriot, R. A. (1979) · Journal of the American Statistical Association · doi:10.2307/2286322 · Cited by 187
Evaluation of some random effects methodology applicable to bird ringing data
Burnham, K. P., & White, G. C. (2002) · Journal of Applied Statistics · doi:10.1080/02664760120108755 · Cited by 186
Covariance Estimation: The GLM and Regularization Perspectives
Pourahmadi, M. (2011) · Statistical Science · doi:10.1214/11-sts358 · Cited by 176
Fang, Y. (2021) · Journal of Data Science · doi:10.6339/jds.201101_09(1).0002 · Cited by 173
Variable selection in linear mixed effects models
Fan, Y., & Li, R. (2012) · The Annals of Statistics · doi:10.1214/12-aos1028 · Cited by 171
Fixed and Random Effects Selection in Mixed Effects Models
Ibrahim, J. G., Hongtu Zhu, B., García, R. I. L., & Guo, R. (2010) · Biometrics · doi:10.1111/j.1541-0420.2010.01463.x · Cited by 158
Model selection in linear mixed effect models
Peng, H., & Lu, Y. (2012) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2012.02.005 · Cited by 156
Bayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
Counting degrees of freedom in hierarchical and other richly-parameterised models
Hodges, J. S. (2001) · Biometrika · doi:10.1093/biomet/88.2.367 · Cited by 148
Local Polynomial Mixed-Effects Models for Longitudinal Data
Wu, H., & Zhang, J. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618672 · Cited by 146
Estimation for High-Dimensional Linear Mixed-Effects Models Using ℓ1-PenalizationPreprint
van de Geer, S. (2010) · Cited by 146
Covariance Estimation: The GLM and Regularization Perspectives
Pourahmadi, M. (2011) · Cited by 145
Bayesian information criterion for longitudinal and clustered data
Jones, R. H. (2011) · Statistics in Medicine · doi:10.1002/sim.4323 · Cited by 140
The Schwarz criterion and related methods for normal linear models
Ankerst, D. P. (1998) · Biometrika · doi:10.1093/biomet/85.1.13 · Cited by 128
A note on conditional AIC for linear mixed-effects models
Liang, H., Wu, H., & Zou, G. (2008) · Biometrika · doi:10.1093/biomet/asn023 · Cited by 125
Outlier Robust Model Selection in Linear Regression
Müller, S., & Welsh, A. H. (2005) · Journal of the American Statistical Association · doi:10.1198/016214505000000529 · Cited by 116
Self-citationFence methods for mixed model selectionPreprint
Jiang, J., Rao, J. S., & Gu, Z. (2006) · Cited by 99
Bayes Factors and Approximations for Variance Component Models
Ankerst, D. P., Wakefield, J., & Kass, R. E. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473877 · Cited by 95
Fence methods for mixed model selection
Jiang, J., Rao, J. S., Gu, Z., & Nguyen, T. (2008) · The Annals of Statistics · doi:10.1214/07-aos517 · Cited by 73
Generalized Linear Mixed Models
McCulloch, C. E. (2003) · NSF-CBMS regional conference series in probability and statistics · doi:10.1214/cbms/1462106059 · Cited by 68
Information and Complexity in Statistical Modeling
Rissanen, J. (2006) · IEEE Information Theory Workshop (ITW) · doi:10.1109/itw.2006.1633845 · Cited by 63
Selecting mixed-effects models based on a generalized information criterion
Pu, W., & Niu, X. (2005) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2005.05.009 · Cited by 61
Identifying QTLs and Epistasis in Structured Plant Populations Using Adaptive Mixed LASSO
Wang, D., Eskridge, K. M., & Crossa, J. L. (2010) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1007/s13253-010-0046-2 · Cited by 59
Variable Selection for Semiparametric Mixed Models in Longitudinal Studies
Ni, X., Zhang, D., & Zhang, H. H. (2009) · Biometrics · doi:10.1111/j.1541-0420.2009.01240.x · Cited by 58
Testing Random Effects in the Linear Mixed Model Using Approximate Bayes Factors
Saville, B. R., & Herring, A. H. (2008) · Biometrics · doi:10.1111/j.1541-0420.2008.01107.x · Cited by 38
Bayesian model comparison and model averaging for small-area estimation
Aitkin, M., Liu, C. C., & Chadwick, T. (2009) · The Annals of Applied Statistics · doi:10.1214/08-aoas205 · Cited by 22
Iterative estimating equations: Linear convergence and asymptotic properties
Jiang, J., Luan, Y., & Wang, Y. (2007) · The Annals of Statistics · doi:10.1214/009053607000000208 · Cited by 21
BAYESIAN MODEL COMPARISON AND MODEL AVERAGING FOR SMALL-AREA ESTIMATION 1Preprint
Aitkin, M. A., Liu, C. C., & Chadwick, T. J. (2006) · Cited by 19
Information methods for model selection in linear mixed effects models with application to HCV data
Dimova, R. B., Markatou, M., & Talal, A. H. (2011) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.10.031 · Cited by 14
Saville, B. R., Herring, A. H., & Kaufman, J. S. (2011) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2011.00685.x · Cited by 6
Invisible fence methods and the identification of differentially expressed gene sets
Jiang, J., Nguyen, T. D., & Rao, J. S. (2011) · Statistics and Its Interface · doi:10.4310/sii.2011.v4.n3.a14 · Cited by 6
Cited by
Rao, J. N. K. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess0731 · Cited by 2,049
One-stage dose–response meta-analysis for aggregated data
Crippa, A., Discacciati, A., Bottai, M., Spiegelman, D., & Orsini, N. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280218773122 · Cited by 365
Linear and generalized linear mixed models
Bolker, B. M. (2015) · Ecological Statistics · doi:10.1093/acprof:oso/9780199672547.003.0014 · Cited by 339
A global analysis of traits predicting species sensitivity to habitat fragmentation
Keinath, D. A., Doak, D. F., Hodges, K. E., Prugh, L. R., Fagan, W., Sekercioglu, C. H., Buchart, S. H. M., & Kauffman, M. (2017) · Global Ecology and Biogeography · doi:10.1111/geb.12509 · Cited by 291
van Eeuwijk, F. A., Bustos‐Korts, D. V., & Malosetti, M. (2016) · Crop Science · doi:10.2135/cropsci2015.06.0375 · Cited by 286
Metadata
- Authors
- Müller, S., Scealy, J. L., & Welsh, A. H.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2013-05-01
- Volume
- 28
- Issue
- 2
- Pages
- 135-167
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W1985497040
- Cited by
- 324
- References
- 78
- FWCI
- 24.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.