The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation
Abstract
A traditional approach to statistical inference is to identify the true or best model first with little or no consideration of the specific goal of inference in the model identification stage. Can the pursuit of the true model also lead to optimal regression estimation? In model selection, it is well known that BIC is consistent in selecting the true model, and AIC is minimax-rate optimal for estimating the regression function. A recent promising direction is adaptive model selection, in which, in contrast to AIC and BIC, the penalty term is data-dependent. Some theoretical and empirical results have been obtained in support of adaptive model selection, but it is still not clear if it can really share the strengths of AIC and BIC. Model combining or averaging has attracted increasing attention as a means to overcome the model selection uncertainty. Can Bayesian model averaging be optimal for estimating the regression function in a minimax sense? We show that the answers to these questions are basically in the negative: for any model selection criterion to be consistent, it must behave suboptimally for estimating the regression function in terms of minimax rate of covergence; and Bayesian model averaging cannot be minimax-rate optimal for regression estimation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Modeling by shortest data description
Rissanen, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90005-5 · Cited by 6,011
Mallows, C. L. (1995) · Technometrics · doi:10.1080/00401706.1995.10484370 · Cited by 2,083
Minimax estimation via wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691081 · Cited by 1,005
MODEL SELECTION AND INFERENCE: FACTS AND FICTION
Leeb, H., & Pötscher, B. M. (2005) · Econometric Theory · doi:10.1017/s0266466605050036 · Cited by 701
Information-theoretic determination of minimax rates of convergence
Yang, Y., & Barron, A. (1999) · The Annals of Statistics · doi:10.1214/aos/1017939142 · Cited by 555
Self-citationThe Risk Inflation Criterion for Multiple Regression
Foster, D. P., & George, E. I. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325766 · Cited by 541
Calibration and empirical Bayes variable selection
George, E. (2000) · Biometrika · doi:10.1093/biomet/87.4.731 · Cited by 520
Li, K.-C. (1987) · The Annals of Statistics · doi:10.1214/aos/1176350486 · Cited by 514
Birgé, L., & Massart, P. (2001) · Journal of the European Mathematical Society · doi:10.1007/s100970100031 · Cited by 479
Convergence of Estimates Under Dimensionality Restrictions
LeCam, L. (1973) · The Annals of Statistics · doi:10.1214/aos/1193342380 · Cited by 422
Asymptotic Properties of Criteria for Selection of Variables in Multiple Regression
Nishii, R. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346522 · Cited by 335
Shen, X., & Ye, J. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479356 · Cited by 196
Prediction via Orthogonalized Model Mixing
Clyde, M., Desimone, H., & Parmigiani, G. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476989 · Cited by 145
REGRESSION WITH MULTIPLE CANDIDATE MODELS: SELECTING OR MIXING?Preprint
Yang, Y. (1999) · Iowa State University Digital Repository (Iowa State University) · Cited by 120
Self-citationLocal Versus Global Models for Classification Problems: Fitting Models Where it Matters
Hand, D. J., & Vinciotti, V. (2003) · The American Statistician · doi:10.1198/0003130031423 · Cited by 103
MODEL SELECTION FOR NONPARAMETRIC REGRESSIONPreprint
Yang, Y. (1997) · Iowa State University Digital Repository (Iowa State University) · Cited by 67
Self-citationAsymptotic Optimality of the $C_p$-Test for the Orthogonal Series Estimation of Regression
Polyak, B. T., & Tsybakov, A. B. (1991) · Theory of Probability and Its Applications · doi:10.1137/1135037 · Cited by 37
Asymptotically optimal function estimation by minimum complexity criteria
Barron, A. R., Yang, Y., & Yu, B. (2002) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.1994.394933 · Cited by 25
Self-citation
Cited by
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522
Multimodel inference in ecology and evolution: challenges and solutions
GRUEBER, C. E., NAKAGAWA, S., LAWS, R. J., & JAMIESON, I. G. (2011) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2010.02210.x · Cited by 2,263
Vrieze, S. I. (2012) · Psychological Methods · doi:10.1037/a0027127 · Cited by 1,948
Model selection for ecologists: the worldviews of AIC and BIC
Aho, K., Derryberry, D., & Peterson, T. (2014) · Ecology · doi:10.1890/13-1452.1 · Cited by 1,165
“This view is supported mathematically by Yang (2005) who showed that while BIC is consistent in optimal model selection, it cannot be optimal for regression function estimation in the sense of multi-model inference, and that while AIC represents minimax-rate optimal rules for estimating the…”
MethodOn the “degrees of freedom” of the lasso
Zou, H., Hastie, T., & Tibshirani, R. (2007) · The Annals of Statistics · doi:10.1214/009053607000000127 · Cited by 947
Metadata
- Authors
- Yang, Y.
- Venue
- Biometrika
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-12-01
- Volume
- 92
- Issue
- 4
- Pages
- 937-950
- ISSN
- 0006-3444 (ISSN-L)
- 1464-3510
- OpenAlex
- W2013805643
- Cited by
- 605
- References
- 20
- FWCI
- 10.92
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.