The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Frequentist Model Average Estimators
Open accessAbstract
The traditional use of model selection methods in practice is to proceed as if the final selected model had been chosen in advance, without acknowledging the additional uncertainty introduced by model selection. This often means underreporting of variability and too optimistic confidence intervals. We build a general large-sample likelihood apparatus in which limiting distributions and risk properties of estimators post-selection as well as of model average estimators are precisely described, also explicitly taking modeling bias into account. This allows a drastic reduction in complexity, as competing model averaging schemes may be developed, discussed, and compared inside a statistical prototype experiment where only a few crucial quantities matter. In particular, we offer a frequentist view on Bayesian model averaging methods and give a link to generalized ridge estimators. Our work also leads to new model selection criteria. The methods are illustrated with real data applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
Regression and time series model selection in small samples
HURVICH, C. M., & TSAI, C.-L. (1989) · Biometrika · doi:10.1093/biomet/76.2.297 · Cited by 6,586
Approximation Theorems of Mathematical Statistics
Serfling, R. J. (1980) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316481 · Cited by 5,851
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340 · cited 1×
“See the engaging discussion of Breiman (2001) and section 1 of Claeskens and Hjort (2003) for further comments.”
BackgroundZiegel, E. R., Lehmann, E. L., & Casella, G. (1999) · Technometrics · doi:10.2307/1270597 · Cited by 4,203
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118 · cited 2×
“First, there are dif culties associated with the often ad hoc way in which the prior probabilities for a (sometimes long) list of models is set up; see the discussion to Hoeting et al. (1999).”
BackgroundModel Selection: An Integral Part of Inference
Buckland, S. T., Burnham, K. P., & Augustin, N. H. (1997) · Biometrics · doi:10.2307/2533961 · Cited by 1,717 · cited 3×
“Buckland et al. (1997) make a general model averaging suggestion that amounts to taking weights c∗(S |data) proportional to exp(`S − |S|), where `S is the maximised log-likelihood at model S.”
BackgroundMethodInfluentialAssessment and Propagation of Model Uncertainty
Draper, D. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02015.x · Cited by 1,599
Cited by
Generalized additive models for location, scale and shape.
Rigby, R. A., & Stasinopoulos, D. M. (2005) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2005.00510.x · Cited by 3,228
“Averaging between selected models can reduce this underestimation; Hjort and Claeskens (2003).”
BackgroundPattern Recognition and Machine Learning
Burr, T. (2008) · Journal of the American Statistical Association · doi:10.1198/jasa.2008.s236 · Cited by 1,102
Hansen, B. E. (2007) · Econometrica · doi:10.1111/j.1468-0262.2007.00785.x · Cited by 837
Ellison, A. M. (2004) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00603.x · Cited by 786
MODEL SELECTION AND INFERENCE: FACTS AND FICTION
Leeb, H., & Pötscher, B. M. (2005) · Econometric Theory · doi:10.1017/s0266466605050036 · Cited by 701
Valid post-selection inference
Berk, R., Brown, L., Buja, A., Zhang, K., & Zhao, L. (2013) · The Annals of Statistics · doi:10.1214/12-aos1077 · Cited by 599
Cross validation for model selection: A review with examples from ecology
Yates, L. A., Aandahl, Z., Richards, S. A., & Brook, B. W. (2023) · Ecological Monographs · doi:10.1002/ecm.1557 · Cited by 459
Global Validation of Linear Model Assumptions
Peña, E. A., & Slate, E. H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000000637 · Cited by 446
Dormann, C. F., Calabrese, J. M., Guillera‐Arroita, G., Matechou, E., Bahn, V., Bartoń, K., Beale, C. M., Ciuti, S., Elith, J., Gerstner, K., et al. (2018) · Ecological Monographs · doi:10.1002/ecm.1309 · Cited by 400
MODEL WEIGHTS AND THE FOUNDATIONS OF MULTIMODEL INFERENCE
Link, W. A., & Barker, R. J. (2006) · Ecology · doi:10.1890/0012-9658(2006)87[2626:mwatfo]2.0.co;2 · Cited by 398
The Focused Information Criterion
Claeskens, G., & Hjort, N. L. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000000819 · Cited by 380
Self-citationAIC, BIC and Recent Advances in Model Selection
Chakrabarti, A., & Ghosh, J. K. (2011) · Philosophy of Statistics · doi:10.1016/b978-0-444-51862-0.50018-6 · Cited by 362
A comparison of two model averaging techniques with an application to growth empirics
Magnus, J. R., Powell, O., & Prüfer, P. (2010) · Journal of Econometrics · doi:10.1016/j.jeconom.2009.07.004 · Cited by 355
Estimation and Accuracy After Model Selection
Efron, B. (2014) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.823775 · Cited by 354
Model Averaging and Its Use in Economics
Steel, M. F. J. (2020) · Journal of Economic Literature · doi:10.1257/jel.20191385 · Cited by 321
“In the context of normal linear regression, Hoeting et al. (1996) propose a Bayesian method for simultaneous variable selection and outlier identification, using variable inflation to model outliers.”
BackgroundMethodInfluentialModel averaging prediction by K-fold cross-validation
Zhang, X., & Liu, C.-A. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2022.04.007 · Cited by 310
Horta, A., Malone, B., Stockmann, U., Minasny, B., Bishop, T. F. A., McBratney, A. B., Pallasser, R., & Pozza, L. (2015) · Geoderma · doi:10.1016/j.geoderma.2014.11.024 · Cited by 306
Least-squares forecast averaging
Hansen, B. E. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2008.08.022 · Cited by 270
On model selection and model misspecification in causal inference.
Vansteelandt, S., Bekaert, M., & Claeskens, G. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280210387717 · Cited by 172
Effects of weather and climate on the dynamics of animal population time series
Knape, J., & de Valpine, P. (2011) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2010.1333 · Cited by 107
Basic Framework and Main Methods of Uncertainty Quantification
Zhang, J., Yin, J., & Wang, R. (2020) · Mathematical Problems in Engineering · doi:10.1155/2020/6068203 · Cited by 52
Metadata
- Authors
- Hjort, N. L., & Claeskens, G.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2003-12
- Volume
- 98
- Issue
- 464
- Pages
- 879-899
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2078502317
- Cited by
- 688
- References
- 28
- FWCI
- 13.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.