The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Comparing Density Forecasts via Weighted Likelihood Ratio Tests
Abstract
We propose a test for comparing the out-of-sample accuracy of competing density forecasts of a variable. The test is valid under general conditions: The data can be heterogeneous and the forecasts can be based on (nested or nonnested) parametric models or produced by semiparametric, nonparametric, or Bayesian estimation techniques. The evaluation is based on scoring rules, which are loss functions defined over the density forecast and the realizations of the variable. We restrict attention to the logarithmic scoring rule and propose an out-of-sample “weighted likelihood ratio” test that compares weighted averages of the scores for the competing forecasts. The user-defined weights are a way to focus attention on different regions of the distribution of the variable. For a uniform weight function, the test can be interpreted as an extension of Vuong's likelihood ratio test to time series data and to an out-of-sample testing framework. We apply the tests to evaluate density forecasts of U.S. inflation produced by linear and Markov-switching Phillips curve models estimated by either maximum likelihood or Bayesian methods. We conclude that a Markov-switching Phillips curve estimated by maximum likelihood produces the best density forecasts of inflation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Newey, W. K., & West, K. D. (1987) · Econometrica · doi:10.2307/1913610 · Cited by 16,936
A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix
Newey, W., & West, K. (1986) · National Bureau of Economic Research · doi:10.3386/t0055 · Cited by 12,278
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Conditional Heteroskedasticity in Asset Returns: A New Approach
Nelson, D. B. (1991) · Econometrica · doi:10.2307/2938260 · Cited by 10,236
The Behavior of Stock-Market Prices
Fama, E. F. (1965) · The Journal of Business · doi:10.1086/294743 · Cited by 8,664
Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses
Vuong, Q. H. (1989) · Econometrica · doi:10.2307/1912557 · Cited by 5,929
Diebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
The variation of certain speculative prices
Mandelbrot, B. B. (1997) · Fractals and Scaling in Finance · doi:10.1007/978-1-4757-2763-0_14 · Cited by 4,468
Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation
Andrews, D. W. K. (1991) · Econometrica · doi:10.2307/2938229 · Cited by 4,030
Politis, D. N., & Romano, J. P. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476870 · Cited by 2,649
A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return
Bollerslev, T. (1987) · The Review of Economics and Statistics · doi:10.2307/1925546 · Cited by 2,565
The Jackknife and the Bootstrap for General Stationary Observations
Kunsch, H. R. (1989) · The Annals of Statistics · doi:10.1214/aos/1176347265 · Cited by 2,374
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business and Economic Statistics · doi:10.2307/1392185 · Cited by 2,340
MODELLING ASYMMETRIC EXCHANGE RATE DEPENDENCE*
Patton, A. J. (2006) · International Economic Review · doi:10.1111/j.1468-2354.2006.00387.x · Cited by 2,112
Shao, J., & Tu, D. (1995) · Springer Series in Statistics · doi:10.1007/978-1-4612-0795-5 · Cited by 1,985
A Reality Check for Data Snooping
White, H. (2000) · Econometrica · doi:10.1111/1468-0262.00152 · Cited by 1,851
Tests of Conditional Predictive Ability
Giacomini, R., & White, H. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00718.x · Cited by 1,646
Self-citationWere There Regime Switches in U.S. Monetary Policy?
Sims, C. A., & Zha, T. (2006) · American Economic Review · doi:10.1257/000282806776157678 · Cited by 1,590
Autoregressive Conditional Density Estimation
Hansen, B. E. (1994) · International Economic Review · doi:10.2307/2527081 · Cited by 1,575
Evaluating Density Forecasts with Applications to Financial Risk Management
Diebold, F. X., Gunther, T. A., & Tay, A. S. (1998) · International Economic Review · doi:10.2307/2527342 · Cited by 1,452
Asymptotic Inference about Predictive Ability
West, K. D. (1996) · Econometrica · doi:10.2307/2171956 · Cited by 1,401
Duffie, D., & Pan, J. (1997) · The Journal of Derivatives · doi:10.3905/jod.1997.407971 · Cited by 1,296
Stock, J. H., & Watson, M. W. (1999) · Journal of Monetary Economics · doi:10.1016/s0304-3932(99)00027-6 · Cited by 1,260
State-Space Models with Regime-Switching: Classical and Gibbs Sampling Approaches with Applications
Fruhwirth-Schnatter, S., Kim, C.-J., & Nelson, C. R. (2000) · Journal of the American Statistical Association · doi:10.2307/2669796 · Cited by 1,153
Testing Density Forecasts, With Applications to Risk Management
Berkowitz, J. (2001) · Journal of Business & Economic Statistics · doi:10.1198/07350010152596718 · Cited by 859
8 Forecast evaluation and combination
Diebold, F. X., & Lopez, J. A. (1996) · Handbook of Statistics · doi:10.1016/s0169-7161(96)14010-4 · Cited by 519
Moving blocks jackknife and bootstrap capture weak dependence
Liu, R. (1992) · Medical Entomology and Zoology · Cited by 498
Nonlinear Regression with Dependent Observations
White, H., & Domowitz, I. (1984) · Econometrica · doi:10.2307/1911465 · Cited by 452
Model selection tests for nonlinear dynamic models
Rivers, D., & Vuong, Q. (2002) · The Econometrics Journal · doi:10.1111/1368-423x.t01-1-00071 · Cited by 359
Optimal Prediction Under Asymmetric Loss
Christoffersen, P. F., & Diebold, F. X. (1997) · Econometric Theory · doi:10.1017/s0266466600006277 · Cited by 342
Tay, A. S., & Wallis, K. F. (2000) · Journal of Forecasting · doi:10.1002/1099-131x(200007)19:4<235::aid-for772>3.0.co;2-l · Cited by 318
Hong, Y., & Li, H. (2005) · Review of Financial Studies · doi:10.1093/rfs/hhh006 · Cited by 311
Testing Parametric Conditional Distributions of Dynamic Models
Bai, J. (2003) · Review of Economics and Statistics · doi:10.1162/003465303322369704 · Cited by 252
Evaluating the predictive accuracy of volatility models
Lopez, J. A. (2001) · Journal of Forecasting · doi:10.1002/1099-131x(200103)20:2<87::aid-for782>3.0.co;2-7 · Cited by 224
A comparison of financial duration models via density forecasts
Bauwens, L., Giot, P., Grammig, J., & Veredas, D. (2004) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2003.09.014 · Cited by 212
Robust out-of-sample inference
McCracken, M. W. (2000) · Journal of Econometrics · doi:10.1016/s0304-4076(00)00022-1 · Cited by 211
The Quantification of Judgment: Some Methodological Suggestions
Winkler, R. L. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10500920 · Cited by 202
Prices, Wages and the U.S. NAIRU in the 1990s
Staiger, D., Stock, J., & Watson, M. (2001) · National Bureau of Economic Research · doi:10.3386/w8320 · Cited by 195
Further results on forecasting and model selection under asymmetric loss
Christoffersen, P. F., & Diebold, F. X. (1996) · Journal of Applied Econometrics · doi:10.1002/(sici)1099-1255(199609)11:5<561::aid-jae406>3.0.co;2-s · Cited by 170
Clements, M. P., & Smith, J. P. (2000) · Journal of Forecasting · Cited by 153
Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters
Diebold, F. X., Tay, A. S., & Wallis, K. F. (1999) · Oxford University Press eBooks · doi:10.1093/oso/9780198296836.003.0003 · Cited by 150
Clements, M. P., & Smith, J. P. (2000) · Journal of Forecasting · doi:10.1002/1099-131x(200007)19:4<375::aid-for779>3.0.co;2-u · Cited by 147
Predictive density and conditional confidence interval accuracy tests
Corradi, V., & Swanson, N. R. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.07.026 · Cited by 117
Bootstrap conditional distribution tests in the presence of dynamic misspecification
Corradi, V., & Swanson, N. R. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.06.013 · Cited by 106
Predective Density and Conditional Confidence Interval Accuracy TestsPreprint
Corradi, V., & Swanson, N. R. (2004) · RePEc: Research Papers in Economics · Cited by 17
Cited by
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Prior Selection for Vector Autoregressions
Giannone, D., Lenza, M., & Primiceri, G. E. (2015) · Review of Economics and Statistics · doi:10.1162/rest_a_00483 · Cited by 710
Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules
Gneiting, T., & Ranjan, R. (2011) · Journal of Business & Economic Statistics · doi:10.1198/jbes.2010.08110 · Cited by 507
Dynamic Conditional Correlation: On Properties and Estimation
Aielli, G. P. (2013) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2013.771027 · Cited by 422
Comparing and evaluating Bayesian predictive distributions of asset returns
Geweke, J., & Amisano, G. (2010) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2009.10.007 · Cited by 376
Self-citation
Metadata
- Authors
- Amisano, G., & Giacomini, R.
- Venue
- Journal of Business & Economic Statistics
- Publisher
- Informa UK Limited
- Published
- 2007-04
- Volume
- 25
- Issue
- 2
- Pages
- 177-190
- ISSN
- 0735-0015 (ISSN-L)
- 1537-2707
- OpenAlex
- W2041492724
- Cited by
- 518
- References
- 46
- FWCI
- 30.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.