Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
In this paper, we develop a classical approach to model selection. Using the Kullback-Leibler Information Criterion to measure the closeness of a model to the truth, we propose simple likelihood-ratio based statistics for testing the null hypothesis that the competing models are equally close to the true data generating process against the alternative hypothesis that one model is closer. The tests are directional and are derived successively for the cases where the competing models are non-nested, overlapping, or nested and whether both, one, or neither is misspecified. As a prerequisite, we fully characterize the asymptotic distribution of the likelihood ratio statistic under the most general conditions. We show that it is a weighted sum of chi-square distribution or a normal distribution depending on whether the distributions in the competing models closest to the truth are observationally identical. We also propose a test of this latter condition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A comparison of the two models using Vuong's distinguishability test showed that the eight factor model was a significantly better fit to the data than the single factor model (LR = 47,277.2, p < 0.001) (30).”
From Assessing the sustainability capacity of evidence-based programs in community and health settings (2022) · cites this paper as [30]
In the citing paper
“Nonetheless, as I and many others have argued [1,32-40], sequence similarity is strictly an empirical observation; homology, on the other hand, is a hypothesis intended to explain the similarity.”
From On universal common ancestry, sequence similarity, and phylogenetic structure: the sins of P-values and the virtues of Bayesian evidence (2011) · cites this paper as [40]
In the citing paper
“The Likelihood Ratio Test suggests that a 2-class solution fit better than a 1-class solution (p < .001), a 3-class solution fit better than a 2-class solution (p = .020), and a 4-class solution fit better than a 3-class solution (p = .025); however, a 5-class solution did not fit significantly better than a 4-class solution (p = .413).”
From Mindfulness and emotional outcomes: Identifying subgroups of college students using latent profile analysis (2015) · cites this paper as Vuong, 1989
In the citing paper
“Given the results of the Likelihood Ratio Test, we settled on the 4-class solution.”
From Mindfulness and emotional outcomes: Identifying subgroups of college students using latent profile analysis (2015) · cites this paper as Vuong, 1989
In the citing paper
“We find that we can reject the null hypothesis that the two models are equally close to the actual model in favor of zero-inflation, which is a superior model (p<0.01) [52].”
From Incorporating Anthropogenic Influences into Fire Probability Models: Effects of Human Activity and Climate Change on Fire Activity in California (2016) · cites this paper as [52]
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses
Wilks, S. S. (1938) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177732360 · Cited by 3,493
Wald, A. (1943) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1943-0012401-3 · Cited by 2,511
Several Tests for Model Specification in the Presence of Alternative Hypotheses
Davidson, R., & MacKinnon, J. G. (1981) · Econometrica · doi:10.2307/1911522 · Cited by 1,747
Linear Statistical Inference and its Applications.
Sprent, P., & Rao, C. R. (1974) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2345151 · Cited by 1,747
Asymptotic Properties of Non-Linear Least Squares Estimators
Jennrich, R. I. (1969) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697731 · Cited by 1,327
ON THE USE AND INTERPRETATION OF CERTAIN TEST CRITERIA FOR PURPOSES OF STATISTICAL INFERENCE
NEYMAN, J., & PEARSON, E. S. (1928) · Biometrika · doi:10.1093/biomet/20a.3-4.263 · Cited by 1,070
Further Results on Tests of Separate Families of Hypotheses
Cox, D. R. (1962) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1962.tb00468.x · Cited by 1,026
The Theory and Practice of Econometrics
Frydman, R., Judge, G. G., Griffith, W. E., Hill, R. C., & Lee, T.-C. (1985) · Journal of Business & Economic Statistics · doi:10.2307/1391738 · Cited by 842
Generalized Inverse of Matrices and Its Applications
Mayne, A. J., Rao, C. R., & Mitra, S. K. (1972) · Operational Research Quarterly (1970-1977) · doi:10.2307/3007981 · Cited by 817
On the General Problem of Model Selection
Pesaran, M. H. (1974) · The Review of Economic Studies · doi:10.2307/2296710 · Cited by 453
Nonlinear Regression with Dependent Observations
White, H., & Domowitz, I. (1984) · Econometrica · doi:10.2307/1911465 · Cited by 452
Information Criteria for Discriminating Among Alternative Regression Models
Sawa, T. (1978) · Econometrica · doi:10.2307/1913828 · Cited by 391
Wald, A. (1943) · Transactions of the American Mathematical Society · doi:10.2307/1990256 · Cited by 386
Testing Non-Nested Nonlinear Regression Models
Pesaran, M. H., & Deaton, A. S. (1978) · Econometrica · doi:10.2307/1914240 · Cited by 379
A Method for Discriminating between Models
Atkinson, A. C. (1970) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1970.tb00845.x · Cited by 370
Probability Theory and Elements of Measure Theory.
Orey, S., & Bauer, H. (1983) · Journal of the American Statistical Association · doi:10.2307/2288240 · Cited by 277
Robust properties of likelihood ratio tests
KENT, J. T. (1982) · Biometrika · doi:10.1093/biomet/69.1.19 · Cited by 252
Model specification tests against non-nested alternatives
MacKinnon, J. G. (1983) · Econometric Reviews · doi:10.1080/07311768308800031 · Cited by 164
On unification of the asymptotic theory of nonlinear econometric models
Burguete, J. F., Gallant, A. R., & Souza, G. D. S. E. (1982) · Econometric Reviews · doi:10.1080/07311768208800012 · Cited by 157
The encompassing principle and its application to non-nested hypotheses
Mizon, G. E., & Richard, J. (1986) · ePrints Soton (University of Southampton) · Cited by 124
The Performance of the Likelihood Ratio Test When the Model is Incorrect
Foutz, R. V., & Srivastava, R. C. (1977) · The Annals of Statistics · doi:10.1214/aos/1176344003 · Cited by 92
Global and Partial Non-Nested Hypotheses and Asymptotic Local Power
Pesaran, M. H. (1987) · Econometric Theory · doi:10.1017/s0266466600004138 · Cited by 92
A Test for Discriminating Between Models
Atkinson, A. C. (1969) · Biometrika · doi:10.1093/biomet/56.2.337 · Cited by 53
A Test for Discriminating Between Models
Atkinson, A. C. (1969) · Biometrika · doi:10.2307/2334426 · Cited by 6
Selecting the Best Linear Regression Model: A Classical ApproachPreprint
Vuong, Q., & Lien, D. L. D. (1986) · RePEc: Research Papers in Economics · Cited by 3
Self-citationRegularity Conditions for Cox’s Test of Non-nested Hypotheses
White, H. (1998) · Edward Elgar Publishing eBooks · doi:10.4337/9781035334926.00021 · Cited by 1
Cited by
Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701575396 · Cited by 11,415
Power-Law Distributions in Empirical Data
Clauset, A., Shalizi, C. R., & Newman, M. E. J. (2009) · SIAM Review · doi:10.1137/070710111 · Cited by 8,019
Power-law distributions in empirical data
Clauset, A. J., Shalizi, C. R., & Newman, M. E. J. (2018) · Figshare · doi:10.1184/r1/6586835.v1 · Cited by 6,504
performance: An R Package for Assessment, Comparison and Testing of Statistical Models
Lüdecke, D., Ben-Shachar, M., Patil, I., Waggoner, P., & Makowski, D. (2021) · Journal of Open Source Software · doi:10.21105/joss.03139 · Cited by 5,836
Diebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
Metadata
- Authors
- Vuong, Q. H.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Vuong, Quang H.
- Venue
- Econometrica
- Publisher
- JSTOR
- Published
- 1989-03
- Volume
- 57
- Issue
- 2
- Pages
- 307
- ISSN
- 0012-9682 (ISSN-L)
- OpenAlex
- W1830719945
- Cited by
- 5,929
- References
- 29
- Citations by year
- 2026: 178 · 2025: 197 · 2024: 185 · 2023: 213 · 2022: 264 · 2021: 331 · 2020: 289 · 2019: 325 · 2018: 345 · 2017: 287 · 2016: 296 · 2015: 343 · 2014: 357 · 2013: 328 · 2012: 283
- FWCI
- 15.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Econometrica (publishedVersion)
- CaltechAUTHORS (California Institute of Technology) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- likelihood ratio test, model selection, Kullback-Leibler information criterion, model misspecification, asymptotic distribution, chi-square distribution, normal distribution, directional tests, nested models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.