The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Tests of Conditional Predictive Ability
Open accessAbstract
We propose a framework for out-of-sample predictive ability testing and forecast selection designed for use in the realistic situation in which the forecasting model is possibly misspecified, due to unmodeled dynamics, unmodeled heterogeneity, incorrect functional form, or any combination of these. Relative to the existing literature (Diebold and Mariano (1995) and West (1996)), we introduce two main innovations: (i) We derive our tests in an environment where the finite sample properties of the estimators on which the forecasts may depend are preserved asymptotically. (ii) We accommodate conditional evaluation objectives (can we predict which forecast will be more accurate at a future date?), which nest unconditional objectives (which forecast was more accurate on average?), that have been the sole focus of previous literature. As a result of (i), our tests have several advantages: they capture the effect of estimation uncertainty on relative forecast performance, they can handle forecasts based on both nested and nonnested models, they allow the forecasts to be produced by general estimation methods, and they are easy to compute. Although both unconditional and conditional approaches are informative, conditioning can help fine-tune the forecast selection to current economic conditions. To this end, we propose a two-step decision rule that uses current information to select the best forecast for the future date of interest. We illustrate the usefulness of our approach by comparing forecasts from leading parameter-reduction methods for macroeconomic forecasting using a large number of predictors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Newey, W. K., & West, K. D. (1987) · Econometrica · doi:10.2307/1913610 · Cited by 16,936
Risk, Return, and Equilibrium: Empirical Tests
Fama, E. F., & MacBeth, J. D. (1973) · Journal of Political Economy · doi:10.1086/260061 · Cited by 14,258
A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix
Newey, W., & West, K. (1986) · National Bureau of Economic Research · doi:10.3386/t0055 · Cited by 12,278
Diebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
A sharper Bonferroni procedure for multiple tests of significance
HOCHBERG, Y. (1988) · Biometrika · doi:10.1093/biomet/75.4.800 · Cited by 4,829
Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation
Andrews, D. W. K. (1991) · Econometrica · doi:10.2307/2938229 · Cited by 4,030
Macroeconomic Forecasting Using Diffusion Indexes
Stock, J. H., & Watson, M. W. (2002) · Journal of Business & Economic Statistics · doi:10.1198/073500102317351921 · Cited by 2,547
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business and Economic Statistics · doi:10.2307/1392185 · Cited by 2,340
Testing the equality of prediction mean squared errors
Harvey, D., Leybourne, S., & Newbold, P. (1997) · International Journal of Forecasting · doi:10.1016/s0169-2070(96)00719-4 · Cited by 2,067
Cited by
Approximately normal tests for equal predictive accuracy in nested models
Clark, T. E., & West, K. D. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.05.023 · Cited by 2,489
(2011) · Econometrica · doi:10.3982/ecta5771 · Cited by 2,096
Volatility forecast comparison using imperfect volatility proxies
Patton, A. J. (2011) · Journal of Econometrics · doi:10.1016/j.jeconom.2010.03.034 · Cited by 1,264
A Test for Superior Predictive Ability
Hansen, P. R. (2005) · Journal of Business & Economic Statistics · doi:10.1198/073500105000000063 · Cited by 1,230
Large Bayesian vector auto regressions
Bańbura, M., Giannone, D., & Reichlin, L. (2010) · Journal of Applied Econometrics · doi:10.1002/jae.1137 · Cited by 1,151
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
An Empirical Comparison of Machine Learning Models for Time Series Forecasting
Ahmed, N. K., Atiya, A. F., Gayar, N. E., & El-Shishiny, H. (2010) · Econometric Reviews · doi:10.1080/07474938.2010.481556 · Cited by 789
Good Volatility, Bad Volatility: Signed Jumps and The Persistence of Volatility
Patton, A. J., & Sheppard, K. (2015) · Review of Economics and Statistics · doi:10.1162/rest_a_00503 · Cited by 769
Asymptotics for out of sample tests of Granger causality
McCracken, M. W. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.07.020 · Cited by 696
Financial Crises, Credit Booms, and External Imbalances: 140 Years of Lessons
Jordà, Ò., Schularick, M., & Taylor, A. M. (2011) · IMF Economic Review · doi:10.1057/imfer.2011.8 · Cited by 681
Rossi, B. (2013) · Journal of Economic Literature · doi:10.1257/jel.51.4.1063 · Cited by 649
Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes
Liu, L. Y., Patton, A. J., & Sheppard, K. (2015) · Journal of Econometrics · doi:10.1016/j.jeconom.2015.02.008 · Cited by 626
Lago, J., Marcjasz, G., De Schutter, B., & Weron, R. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116983 · Cited by 524
De Mol, C., Giannone, D., & Reichlin, L. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2008.08.011 · Cited by 518
Comparing Density Forecasts via Weighted Likelihood Ratio Tests
Amisano, G., & Giacomini, R. (2007) · Journal of Business & Economic Statistics · doi:10.1198/073500106000000332 · Cited by 518
Self-citationMachine learning advances for time series forecasting
Masini, R. P., Medeiros, M. C., & Mendes, E. F. (2023) · Journal of Economic Surveys · doi:10.1111/joes.12429 · Cited by 515
Diebold, F. X. (2015) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2014.983236 · Cited by 496
Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules
Gneiting, T., & Ranjan, R. (2011) · Journal of Business & Economic Statistics · doi:10.1198/jbes.2010.08110 · Cited by 507
Paye, B. S. (2012) · Journal of Financial Economics · doi:10.1016/j.jfineco.2012.06.005 · Cited by 484
Forecast comparisons in unstable environments
Giacomini, R., & Rossi, B. (2010) · Journal of Applied Econometrics · doi:10.1002/jae.1177 · Cited by 463
Self-citationPalgrave Handbook of Econometrics
(2009) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230244405 · Cited by 447
Realising the future: forecasting with high‐frequency‐based volatility (HEAVY) models
Shephard, N., & Sheppard, K. (2010) · Journal of Applied Econometrics · doi:10.1002/jae.1158 · Cited by 436
Faust, J., & Wright, J. H. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00001-3 · Cited by 423
Chen, X., & Fan, Y. (2006) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.07.027 · Cited by 402
Out-of-Sample Forecast Tests Robust to the Choice of Window Size
Rossi, B., & Inoue, A. (2012) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2012.693850 · Cited by 402
Small sample properties of forecasts from autoregressive models under structural breaks
Pesaran, M. H., & Timmermann, A. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.09.007 · Cited by 390
Consistent ranking of volatility models
Hansen, P. R., & Lunde, A. (2006) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.01.005 · Cited by 377
Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods
Medeiros, M. C., Vasconcelos, G. F. R., Veiga, Á., & Zilberman, E. (2021) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2019.1637745 · Cited by 376
Modelling Nonlinear Economic Time Series
Teräsvirta, T., Tjøstheim, D., & Granger, C. W. J. (2010) · doi:10.1093/acprof:oso/9780199587148.001.0001 · Cited by 352
Should Macroeconomic Forecasters Use Daily Financial Data and How?
Andreou, E., Ghysels, E., & Kourtellos, A. (2013) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2013.767199 · Cited by 331
Chapter 15 Volatility and Correlation Forecasting
Andersen, T. G., Bollerslev, T., Christoffersen, P. F., & Diebold, F. X. (2006) · Handbook of Economic Forecasting · doi:10.1016/s1574-0706(05)01015-3 · Cited by 330
Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach
Baumeister, C., & Kilian, L. (2015) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2014.949342 · Cited by 322
Copula Methods for Forecasting Multivariate Time Series
Patton, A. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-62731-5.00016-6 · Cited by 320
Clark, T. E., & Ravazzolo, F. (2015) · Journal of Applied Econometrics · doi:10.1002/jae.2379 · Cited by 317
Combining expert forecasts: Can anything beat the simple average?
Genre, V., Kenny, G., Meyler, A., & Timmermann, A. (2013) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2012.06.004 · Cited by 313
News—Good or Bad—and Its Impact on Volatility Predictions over Multiple Horizons
Chen, X., & Ghysels, E. (2011) · Review of Financial Studies · doi:10.1093/rfs/hhq071 · Cited by 290
Sparse Signals in the Cross‐Section of Returns
CHINCO, A., CLARK‐JOSEPH, A. D., & YE, M. (2019) · The Journal of Finance · doi:10.1111/jofi.12733 · Cited by 284
Nowcasting with Google Trends in an Emerging Market
Carrière‐Swallow, Y., & Labbé, F. (2013) · Journal of Forecasting · doi:10.1002/for.1252 · Cited by 284
Comparing forecast accuracy: A Monte Carlo investigation
Busetti, F., & Marcucci, J. (2013) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2012.04.011 · Cited by 283
Modeling and predicting the CBOE market volatility index
Fernandes, M., Medeiros, M. C., & Scharth, M. (2014) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2013.11.004 · Cited by 278
A Comprehensive 2022 Look at the Empirical Performance of Equity Premium Prediction
Goyal, A., Welch, I., & Zafirov, A. (2024) · The Review of Financial Studies · doi:10.1093/rfs/hhae044 · Cited by 277
A comprehensive look at financial volatility prediction by economic variables
Christiansen, C., Schmeling, M., & Schrimpf, A. (2012) · Journal of Applied Econometrics · doi:10.1002/jae.2298 · Cited by 272
Forecast evaluation for data scientists: common pitfalls and best practices
Hewamalage, H., Ackermann, K., & Bergmeir, C. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00894-5 · Cited by 263
Olivares, K. G., Challu, C., Marcjasz, G., Weron, R., & Dubrawski, A. (2023) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2022.03.001 · Cited by 262
Risk-Adjusted Forecasts of Oil Prices
Pagano, P., & Pisani, M. (2009) · The B.E. Journal of Macroeconomics · doi:10.2202/1935-1690.1626 · Cited by 256
West, K. D. (2006) · Handbook of Economic Forecasting · doi:10.1016/s1574-0706(05)01003-7 · Cited by 182
A Test for Superior Predictive Ability
Hansen, P. R. (2004) · doi:10.2139/ssrn.264569 · Cited by 99
Metadata
- Authors
- Giacomini, R., & White, H.
- Venue
- Econometrica
- Publisher
- The Econometric Society
- Published
- 2006-11
- Volume
- 74
- Issue
- 6
- Pages
- 1545-1578
- ISSN
- 0012-9682 (ISSN-L)
- 1468-0262
- OpenAlex
- W2135150595
- Cited by
- 1,646
- References
- 46
- FWCI
- 68.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.