The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
The Focused Information Criterion
Abstract
A variety of model selection criteria have been developed, of general and specific types. Most of these aim at selecting a single model with good overall properties, for example, formulated via average prediction quality or shortest estimated overall distance to the true model. The Akaike, the Bayesian, and the deviance information criteria, along with many suitable variations, are examples of such methods. These methods are not concerned, however, with the actual use of the selected model, which varies with context and application. The present article takes the view that the model selector should instead focus on the parameter singled out for interest; in particular, a model that gives good precision for one estimand may be worse when used for inference for another estimand. We develop a method that, for a given focus parameter, estimates the precision of any submodel-based estimator. The framework is that of large-sample likelihood inference. Using an unbiased estimate of limiting risk, we propose a focused information criterion for model selection. We investigate and discuss properties of the method, establish some connections to Akaike's information criterion, and illustrate its use in a variety of situations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Cross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881
Linear Statistical Inference and its Applications: Second Editon
Rao, C. R. (1973) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316436 · Cited by 10,489
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Bayesian model selection in social research
Raftery, A. E. (1995) · Sociological Methodology · doi:10.2307/271063 · Cited by 6,823
Regression and time series model selection in small samples
HURVICH, C. M., & TSAI, C.-L. (1989) · Biometrika · doi:10.1093/biomet/76.2.297 · Cited by 6,586
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,459
Spatial Interaction and the Statistical Analysis of Lattice Systems
Besag, J. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00999.x · Cited by 6,067
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118
Nonlinear Regression Analysis and Its Applications
Bates, D. M., & Watts, D. G. (1988) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316757 · Cited by 3,979
(1994) · Reviews in Fish Biology and Fisheries · doi:10.1007/bf00044132 · Cited by 3,282
Detection of Influential Observation in Linear Regression
Cook, R. D. (2000) · Technometrics · doi:10.2307/1271434 · Cited by 2,269
Sliced Inverse Regression for Dimension Reduction
Li, K.-C. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475035 · Cited by 2,144
Mallows, C. L. (1995) · Technometrics · doi:10.1080/00401706.1995.10484370 · Cited by 2,083
Fundamentals of Enzyme Kinetics
(1979) · Elsevier eBooks · doi:10.1016/c2013-0-04130-8 · Cited by 2,059
Mallows, C. L. (1973) · Technometrics · doi:10.2307/1267380 · Cited by 1,975
Stochastic Complexity in Statistical Inquiry
Rissanen, J. (1998) · WORLD SCIENTIFIC eBooks · doi:10.1142/0822 · Cited by 1,539
Parameter Orthogonality and Approximate Conditional Inference
Cox, D. R., & Reid, N. (1987) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1987.tb01422.x · Cited by 1,366
Statistical modeling: The two cultures
Breiman, L. (2001) · Cited by 1,314
A General Definition of Residuals
Cox, D. R., & Snell, E. J. (1968) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1968.tb00724.x · Cited by 1,311
An asymptotic equivalence of choice of model by cross validation and Akaike's criterion
Stone, M. (1977) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1977.tb01603.x · Cited by 1,286
A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
Kass, R. E., & Wasserman, L. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476592 · Cited by 1,253
Statistical Predictor Identification
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_11 · Cited by 1,213
Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476894 · Cited by 1,205
Model uncertainty, data mining and statistical inference
Chatfield, C. (1995) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983440 · Cited by 1,103 · cited 3×
“Issues of model selection in so-called data mining were addressed by Chat eld (1995) and Ye (1998). Model selectors are not only used for mere model selection; regularly they are the core of formal lack-of- t tests; see, for example, the AIC-based order selection tests of Eubank and Hart (1992) and Aerts, Claeskens,…”
MethodMallows, C. L. (1995) · Technometrics · doi:10.2307/1269729 · Cited by 1,080
Benchmark priors for Bayesian model averaging
Fernández, C., Ley, E., & Steel, M. F. J. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(00)00076-2 · Cited by 1,030
Model uncertainty in cross‐country growth regressions
Fernández, C., Ley, E., & Steel, M. F. J. (2001) · Journal of Applied Econometrics · doi:10.1002/jae.623 · Cited by 891
Linhart, H., & Zucchini, W. (1986) · Cited by 869
Selection of the order of an autoregressive model by Akaike's information criterion
SHIBATA, R. (1976) · Biometrika · doi:10.1093/biomet/63.1.117 · Cited by 789
AN ASYMPTOTIC THEORY FOR LINEAR MODEL SELECTION
Shao, J. (1997) · Cited by 737
Mean Square Error of Prediction as a Criterion for Selecting Variables
Allen, D. M. (1971) · Technometrics · doi:10.1080/00401706.1971.10488811 · Cited by 691
Frequentist Model Average Estimators
Hjort, N. L., & Claeskens, G. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000000828 · Cited by 688
Self-citationCross-Validatory Choice and Assessment of Statistical Predictions (With Discussion)
Stone, M. (1976) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1976.tb01573.x · Cited by 686
Murata, N., Yoshizawa, S., & Amari, S. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.329683 · Cited by 645
An optimal selection of regression variables
SHIBATA, R. (1981) · Biometrika · doi:10.1093/biomet/68.1.45 · Cited by 562
Calibration and empirical Bayes variable selection
George, E. (2000) · Biometrika · doi:10.1093/biomet/87.4.731 · Cited by 520
On Measuring and Correcting the Effects of Data Mining and Model Selection
Ye, J. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10474094 · Cited by 518
Regression and Time Series Model Selection
McQuarrie, A. D. R., & Tsai, C.-L. (1998) · WORLD SCIENTIFIC eBooks · doi:10.1142/3573 · Cited by 513
Barndorff-Nielsen, O. E., & Cox, D. R. (2017) · Routledge eBooks · doi:10.1201/9780203750940 · Cited by 491
Birgé, L., & Massart, P. (2001) · Journal of the European Mathematical Society · doi:10.1007/s100970100031 · Cited by 479
Principles of Biochemistry (2nd edn)
Harris, D. A. (1993) · Trends in Biochemical Sciences · doi:10.1016/0968-0004(93)90073-v · Cited by 403
Box, M. J. (1971) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1971.tb00871.x · Cited by 362
Could Fisher, Jeffreys and Neyman Have Agreed on Testing?
Berger, J. O. (2003) · Statistical Science · doi:10.1214/ss/1056397485 · Cited by 346
Asymptotic Properties of Criteria for Selection of Variables in Multiple Regression
Nishii, R. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346522 · Cited by 335
Efficiency of pseudolikelihood estimation for simple Gaussian fields
BESAG, J. (1977) · Biometrika · doi:10.1093/biomet/64.3.616 · Cited by 321
Partial least squares regression and statistical models
Helland, I. S. (1990) · Scandinavian Journal of Statistics · Cited by 311
APPROXIMATE CONFIDENCE INTERVALS
BARTLETT, M. S. (1953) · Biometrika · doi:10.1093/biomet/40.1-2.12 · Cited by 306
Model Selection for Extended Quasi-Likelihood Models in Small Samples
Hurvich, C. M., & Tsai, C.-L. (1995) · Biometrics · doi:10.2307/2533006 · Cited by 305
Breiman, L. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475276 · Cited by 282
A New Perspective on Priors for Generalized Linear Models
Bedrick, E. J., Christensen, R., & Johnson, W. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476713 · Cited by 271
Variable selection and Bayesian model averaging in case‐control studies
Viallefont, V., Raftery, A. E., & Richardson, S. (2001) · Statistics in Medicine · doi:10.1002/sim.976 · Cited by 266
RAFTERY, A. E. (1999) · Sociological Methods & Research · doi:10.1177/0049124199027003005 · Cited by 249
McCullagh, P. (2002) · The Annals of Statistics · doi:10.1214/aos/1035844977 · Cited by 248
Effects of Model Selection on Inference
Pötscher, B. M. (1991) · Econometric Theory · doi:10.1017/s0266466600004382 · Cited by 229
A Simple Method for the Adjustment of Profile Likelihoods
McCullagh, P., & Tibshirani, R. (1990) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1990.tb01790.x · Cited by 227
Data-Driven Version of Neyman's Smooth Test of Fit
Ledwina, T. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476834 · Cited by 214
Scaling fisheries: the science of measuring the effects of fishing, 1855-1955
(1995) · Choice Reviews Online · doi:10.5860/choice.32-5082 · Cited by 208
Shen, X., & Ye, J. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479356 · Cited by 196
On Predictive Least Squares Principles
Wei, C. Z. (1992) · The Annals of Statistics · doi:10.1214/aos/1176348511 · Cited by 194
Flexible Empirical Bayes Estimation for Wavelets
Clyde, M., & George, E. I. (2000) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00257 · Cited by 181
On the usefulness of overparameterized ecological models
Reichert, P., & Omlin, M. (1997) · Ecological Modelling · doi:10.1016/s0304-3800(96)00043-9 · Cited by 170
Goodness-of-fit processes for logistic regression: simulation results
Hosmer, D. W., & Hjort, N. L. (2002) · Statistics in Medicine · doi:10.1002/sim.1200 · Cited by 164
Self-citationBayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
The Covariance Inflation Criterion for Adaptive Model Selection
Tibshirani, R. J., & Knight, K. (1999) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/1467-9868.00191 · Cited by 135
A Powerful Portmanteau Test of Lack of Fit for Time Series
Peña, D., & Rodríguez, J. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502760047122 · Cited by 129
Minimax Multiple Shrinkage Estimation
George, E. I. (1986) · The Annals of Statistics · doi:10.1214/aos/1176349849 · Cited by 115
Testing the Fit of a Parametric Function
Aerts, M., Claeskens, G., & Hart, J. D. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10474192 · Cited by 83
Self-citationGeneralization of likelihood ratio tests under nonstandard conditions
Vu, H. T. V., & Zhou, S. (1997) · The Annals of Statistics · doi:10.1214/aos/1031833677 · Cited by 74
Bayesian Variable and Transformation Selection in Linear Regression
Hoeting, J. A., Raftery, A. E., & Madigan, D. (2002) · Journal of Computational and Graphical Statistics · doi:10.1198/106186002501 · Cited by 72
Inference after variable selection in linear regression models
Zhang, P. (1992) · Biometrika · doi:10.1093/biomet/79.4.741 · Cited by 67
Efficiently Simulating the Coverage Properties of Interval Estimates
Rubin, D. B., & Nathaniel Schenker, A. (1986) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347266 · Cited by 63
A Transformation/Weighting Model for Estimating Michaelis-Menten Parameters,
Carroll, R. J., Cressie, N., & Ruppert, D. (1987) · doi:10.21236/ada186476 · Cited by 60
Goodness of Fit via Non‐parametric Likelihood Ratios
Claeskens, G., & Hjort, N. L. (2004) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2004.00403.x · Cited by 53
Self-citationStatistics in the 21st Century
(2001) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420035391 · Cited by 51
Accounting for Model Uncertainty in Prediction of Chlorophyll a in Lake Okeechobee
Lamon, E. C., & Clyde, M. A. (2000) · Journal of Agricultural Biological and Environmental Statistics · doi:10.2307/1400456 · Cited by 36
Statistical Issues in Fisheries' Stock Assessments*
Gavaris, S., & Ianelli, J. N. (2002) · Scandinavian Journal of Statistics · doi:10.1111/1467-9469.00282 · Cited by 32
An Essay on Statistical Decision Theory
Brown, L. D. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474329 · Cited by 28
Semiparametric and Additive Model Selection Using an Improved Akaike Information Criterion
Simonoff, J. S., & Tsai, C. (1999) · Journal of Computational and Graphical Statistics · doi:10.2307/1390918 · Cited by 25
Cited by
Generalized additive models for location, scale and shape.
Rigby, R. A., & Stasinopoulos, D. M. (2005) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2005.00510.x · Cited by 3,228
Multimodel inference in ecology and evolution: challenges and solutions
GRUEBER, C. E., NAKAGAWA, S., LAWS, R. J., & JAMIESON, I. G. (2011) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2010.02210.x · Cited by 2,263
Houle, D., Govindaraju, D. R., & Omholt, S. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2897 · Cited by 1,279
Hansen, B. E. (2007) · Econometrica · doi:10.1111/j.1468-0262.2007.00785.x · Cited by 837
Ellison, A. M. (2004) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00603.x · Cited by 786
Metadata
- Authors
- Claeskens, G., & Hjort, N. L.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2003-12
- Volume
- 98
- Issue
- 464
- Pages
- 900-916
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2067838071
- Cited by
- 380
- References
- 83
- FWCI
- 7.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.