Multimodel Inference: Understanding AIC and BIC in Model Selection
The DOI matches its Crossref record, with a small difference in title or year; 59 of the 59 references it cites were found in a registry or an index.
Abstract
The model selection literature has been generally poor at reflecting the deep foundations of the Akaike information criterion (AIC) and at making appropriate comparisons to the Bayesian information criterion (BIC). There is a clear philosophy, a sound criterion based in information theory, and a rigorous statistical foundation for AIC. AIC can be justified as Bayesian using a “savvy” prior on models that is a function of sample size and the number of model parameters. Furthermore, BIC can be derived as a non-Bayesian result. Therefore, arguments about using AIC versus BIC for model selection cannot be from a Bayes versus frequentist perspective. The philosophical context of what is assumed about reality, approximating models, and the intent of model-based inference should determine whether AIC or BIC is used. Various facets of such multimodel inference are presented here, particularly methods of model averaging.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The weight of evidence was calculated, which denotes the probability that a model is the most plausible of the set.”
From Academic Achievement Trajectories of Homeless and Highly Mobile Students: Resilience in the Context of Chronic and Acute Risk (2013) · cites this paper as Burnham & Anderson, 2004
In the citing paper
“The average AIC is 0.5 less than the average AIC for the classic Ebbinghaus functions, which—though it indicates a better fit—may not be considered a meaningful difference; a difference of 2 is considered 'meaningful' [49].”
From Replication and Analysis of Ebbinghaus’ Forgetting Curve (2015) · cites this paper as [49]
In the citing paper
“Because AIC effectively offers a relative estimate of the information lost, the model with the lowest score gives the best representation of the data and is thus considered most likely.”
From Rapid intra-adrenal feedback regulation of glucocorticoid synthesis (2015) · cites this paper as [28]
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033 · cited 1×
“UNDERSTANDING BIC Schwarz (1978) derived the Bayesian information criterion as BIC 2ln( ) log( ) .œ _ K n As usually used one computes BIC for each model and selects the model with the smallest criterion value.”
MethodModel selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Self-citationGelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Cross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881 · cited 1×
“The MLE ( ) converges, as gets large, to the that minimizes K-L information loss for model)̂ )y n o g. Large sample expected AIC converges to E(AIC) 2 2 ( , ( )) .œ † ± C I f g K )o”
BackgroundBayesian model selection in social research
Raftery, A. E. (1995) · Sociological Methodology · doi:10.2307/271063 · Cited by 6,823 · cited 2×
“=1 (Raftery 1995).”
BackgroundRegression and time series model selection in small samples
HURVICH, C. M., & TSAI, C.-L. (1989) · Biometrika · doi:10.1093/biomet/76.2.297 · Cited by 6,586
Research works printed but not linked: 7
- Akaike, Hirotugu, 1973, Second International Symposium on Information Theory, 267
- Akaike, Hirotugu, 1994, Engineering and Scientific Applications: Vol. 3. Proceedings of the First US/Japan Conference on the Frontiers of Statistical Modeling: An Informational Approach, 27
- Boltzmann, Ludwig, 1877, Wiener Berichte, 76, 373
- Breiman, Leo, 2001, Statistical Science, 26, 199
- Hoeting, Jennifer A., 1999, ” Statistical Science, 14, 382
- Key, Jane T., 1999, Bayesian Statistics 6, 343
- Takeuchi, Kei, 1976, Suri-Kagaku (Mathematic Sciences), 153, 12
Cited by
Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R: A Workbook
Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021) · Classroom Companion: Business · doi:10.1007/978-3-030-80519-7 · Cited by 10,343
Burnham, K. P., Anderson, D. R., & Huyvaert, K. P. (2011) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-010-1029-6 · Cited by 4,104
Self-citationThe effect of human mobility and control measures on the COVID-19 epidemic in China
Kraemer, M. U. G., Yang, C.-H., Gutierrez, B., Wu, C.-H., Klein, B., Pigott, D. M., Open COVID-19 Data Working Group, du Plessis, L., Faria, N. R., Li, R., et al. (2020) · Science · doi:10.1126/science.abb4218 · Cited by 2,950
Strobl, C., Malley, J., & Tutz, G. (2009) · Psychological Methods · doi:10.1037/a0016973 · Cited by 2,583
“For a detailed discussion of approaches that account for the complexity of parametric models, see Burnham and Anderson (2002) or Burnham and Anderson (2004).”
Symonds, M. R. E., & Moussalli, A. (2011) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-010-1037-6 · Cited by 2,543
Metadata
- Authors
- Burnham, K. P., & Anderson, D. R.
- Affiliations
- United States Geological Survey (US)
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 2004-11
- Volume
- 33
- Issue
- 2
- Pages
- 261-304
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2158196600
- Semantic Scholar
- 9bea108c81919453a5774bfdc3586a4e03e52338
- Cited by
- 11,648
- References
- 58
- Citations by year
- 2026: 825 · 2025: 929 · 2024: 944 · 2023: 884 · 2022: 906 · 2021: 1070 · 2020: 935 · 2019: 803 · 2018: 662 · 2017: 606 · 2016: 567 · 2015: 490 · 2014: 474 · 2013: 416 · 2012: 283
- FWCI
- 49.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Sociological Methods & Research (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- multi-model inference, model selection, Akaike information criterion, Bayesian information criterion, model averaging, information theory, prior distributions, model-based inference, philosophy of statistics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multimodel Inference: Understanding AIC and BIC in Model Selection. https://app.cochat.ai/papers/10.1177/0049124104268644
- The paper
- Burnham, K. P., & Anderson, D. R. (2004). Multimodel Inference: Understanding AIC and BIC in Model Selection. Sociological Methods & Research. https://doi.org/10.1177/0049124104268644
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.