The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Gaussian model selection
Open accessAbstract
Our purpose in this paper is to provide a general approach to model selection via penalization for Gaussian regression and to develop our point of view about this subject. The advantage and importance of model selection come from the fact that it provides a suitable approach to many different types of problems, starting from model selection per se (among a family of parametric models, which one is more suitable for the data at hand), which includes for instance variable selection in regression models, to nonparametric estimation, for which it provides a very powerful tool that allows adaptation under quite general circumstances. Our approach to model selection also provides a natural connection between the parametric and nonparametric points of view and copes naturally with the fact that a model is not necessarily true. The method is based on the penalization of a least squares criterion which can be viewed as a generalization of Mallows' C_p . A large part of our efforts will be put on choosing properly the list of models and the penalty function for various estimation problems like classical variable selection or adaptive estimation for various types of l_p -bodies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Ideal spatial adaptation by wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.425 · Cited by 8,760
Regression and time series model selection in small samples
HURVICH, C. M., & TSAI, C.-L. (1989) · Biometrika · doi:10.1093/biomet/76.2.297 · Cited by 6,586
Hahn, G. J., Draper, N., & Smith, H. (1982) · Technometrics · doi:10.2307/1267833 · Cited by 5,773
Spline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
Adapting to Unknown Smoothness via Wavelet Shrinkage
Donoho, D. L., & Johnstone, I. M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476626 · Cited by 4,630
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_38 · Cited by 3,028
DeVore, R. A., & Lorentz, G. G. (1993) · Grundlehren der mathematischen Wissenschaften · doi:10.1007/978-3-662-02888-9 · Cited by 2,352
INADMISSIBILITY OF THE USUAL ESTIMATOR FOR THE MEAN OF A MULTIVARIATE NORMAL DISTRIBUTION
Stein, C. (1956) · Contribution to the Theory of Statistics · doi:10.1525/9780520313880-018 · Cited by 1,841
Minimax estimation via wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691081 · Cited by 1,005
Empirical Choice of Histograms and Kernel Density Estimators
Rudemo, M. (1982) · Cited by 719
Risk bounds for model selection via penalization
Barron, A., Birgé, L., & Massart, P. (1999) · Probability Theory and Related Fields · doi:10.1007/s004400050210 · Cited by 657
Self-citationAn optimal selection of regression variables
SHIBATA, R. (1981) · Biometrika · doi:10.1093/biomet/68.1.45 · Cited by 562
Li, K.-C. (1987) · The Annals of Statistics · doi:10.1214/aos/1176350486 · Cited by 514
Minimum complexity density estimation
Barron, A. R., & Cover, T. M. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.86996 · Cited by 497
On a Problem of Adaptive Estimation in Gaussian White Noise
Lepski, O. (1991) · Theory of Probability and Its Applications · doi:10.1137/1135065 · Cited by 495
Asymptotics in statistics : some basic concepts
Cam, L. M. L., & Yang, G. L. (1990) · Springer eBooks · Cited by 444
The Sizes of Compact Subsets of Hilbert Space and Continuity of Gaussian Processes
Dudley, R. M. (2010) · Selected Works of R.M. Dudley · doi:10.1007/978-1-4419-5821-1_11 · Cited by 438
The sizes of compact subsets of Hilbert space and continuity of Gaussian processes
Dudley, R. M. (1967) · Journal of Functional Analysis · doi:10.1016/0022-1236(67)90017-1 · Cited by 423
Snee, R. D. (1972) · Technometrics · doi:10.1080/00401706.1972.10488933 · Cited by 363
From Model Selection to Adaptive Estimation
Birgé, L., & Massart, P. (1997) · Festschrift for Lucien Le Cam · doi:10.1007/978-1-4612-1880-7_4 · Cited by 344
Self-citationAsymptotic Properties of Criteria for Selection of Variables in Multiple Regression
Nishii, R. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346522 · Cited by 335
Isoperimetry and Gaussian analysis
Ledoux, M. (1996) · Lecture Notes in Mathematics · doi:10.1007/bfb0095676 · Cited by 328
Minimum Contrast Estimators on Sieves: Exponential Bounds and Rates of Convergence
Birgé, L., Massart, P., & Birgé, L. (1998) · Bernoulli · doi:10.2307/3318720 · Cited by 326
Self-citationAsymptotically Minimax Adaptive Estimation. I: Upper Bounds. Optimally Adaptive Estimates
Lepski, O. (1992) · Theory of Probability and Its Applications · doi:10.1137/1136085 · Cited by 255
Ideal Denoising in an orthonormal basis chosen from a library of bases
Donoho, D. L., Johnstone, I. M., & X, E. (. B. (1994) · Cited by 244
Asymptotics in Statistics–Some Basic Concepts
Sriram, T. N. (2002) · Journal of the American Statistical Association · doi:10.1198/jasa.2002.s451 · Cited by 160
Model selection in nonparametric regression
Wegkamp, M. H. (2003) · The Annals of Statistics · doi:10.1214/aos/1046294464 · Cited by 123
Model selection for regression on a fixed design
Baraud, Y. (2000) · Probability Theory and Related Fields · doi:10.1007/pl00008731 · Cited by 107
Mixing strategies for density estimation
Yang, Y. (2000) · The Annals of Statistics · doi:10.1214/aos/1016120365 · Cited by 104
Neo-Classical Minimax Problems, Thresholding and Adaptive Function Estimation
Donoho, D. L., & Johnstone, I. M. (1996) · Bernoulli · doi:10.2307/3318568 · Cited by 66
Wavelet compression and nonlinearn-widths
DeVore, R., Kyriazis, G. C., Leviatan, D., & Tikhomirov, V. М. (1993) · Advances in Computational Mathematics · doi:10.1007/bf02071385 · Cited by 64
An Adaptive Compression Algorithm in Besov Spaces
Birgé, L., & Massart, P. (2000) · Constructive Approximation · doi:10.1007/s003659910001 · Cited by 61
Self-citationAsymptotic Optimality of the $C_p$-Test for the Orthogonal Series Estimation of Regression
Polyak, B. T., & Tsybakov, A. B. (1991) · Theory of Probability and Its Applications · doi:10.1137/1135037 · Cited by 37
Cited by
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522
Selective review of offline change point detection methods
Truong, C., Oudre, L., & Vayatis, N. (2020) · Signal Processing · doi:10.1016/j.sigpro.2019.107299 · Cited by 1,338
Adaptive estimation of a quadratic functional by model selection
Laurent, B., & Massart, P. (2000) · The Annals of Statistics · doi:10.1214/aos/1015957395 · Cited by 995
Self-citationConcentration Inequalities and Model Selection
(2007) · Lecture Notes in Mathematics · doi:10.1007/978-3-540-48503-2 · Cited by 744
Self-citation
Metadata
- Authors
- Birgé, L., & Massart, P.
- Venue
- Journal of the European Mathematical Society
- Published
- 2001-09-30
- Volume
- 3
- Issue
- 3
- Pages
- 203-268
- ISSN
- 1435-9855 (ISSN-L)
- 1435-9863
- OpenAlex
- W1995771589
- Cited by
- 479
- References
- 36
- FWCI
- 12.69
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.