The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Tests of Conditional Predictive Ability
Open accessAbstract
We propose a framework for out-of-sample predictive ability testing and forecast selection designed for use in the realistic situation in which the forecasting model is possibly misspecified, due to unmodeled dynamics, unmodeled heterogeneity, incorrect functional form, or any combination of these. Relative to the existing literature (Diebold and Mariano (1995) and West (1996)), we introduce two main innovations: (i) We derive our tests in an environment where the finite sample properties of the estimators on which the forecasts may depend are preserved asymptotically. (ii) We accommodate conditional evaluation objectives (can we predict which forecast will be more accurate at a future date?), which nest unconditional objectives (which forecast was more accurate on average?), that have been the sole focus of previous literature. As a result of (i), our tests have several advantages: they capture the effect of estimation uncertainty on relative forecast performance, they can handle forecasts based on both nested and nonnested models, they allow the forecasts to be produced by general estimation methods, and they are easy to compute. Although both unconditional and conditional approaches are informative, conditioning can help fine-tune the forecast selection to current economic conditions. To this end, we propose a two-step decision rule that uses current information to select the best forecast for the future date of interest. We illustrate the usefulness of our approach by comparing forecasts from leading parameter-reduction methods for macroeconomic forecasting using a large number of predictors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Newey, W. K., & West, K. D. (1987) · Econometrica · doi:10.2307/1913610 · Cited by 16,936
Risk, Return, and Equilibrium: Empirical Tests
Fama, E. F., & MacBeth, J. D. (1973) · Journal of Political Economy · doi:10.1086/260061 · Cited by 14,258
A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix
Newey, W., & West, K. (1986) · National Bureau of Economic Research · doi:10.3386/t0055 · Cited by 12,278
Diebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
A sharper Bonferroni procedure for multiple tests of significance
HOCHBERG, Y. (1988) · Biometrika · doi:10.1093/biomet/75.4.800 · Cited by 4,829
Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation
Andrews, D. W. K. (1991) · Econometrica · doi:10.2307/2938229 · Cited by 4,030
Macroeconomic Forecasting Using Diffusion Indexes
Stock, J. H., & Watson, M. W. (2002) · Journal of Business & Economic Statistics · doi:10.1198/073500102317351921 · Cited by 2,547
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business and Economic Statistics · doi:10.2307/1392185 · Cited by 2,340
Testing the equality of prediction mean squared errors
Harvey, D., Leybourne, S., & Newbold, P. (1997) · International Journal of Forecasting · doi:10.1016/s0169-2070(96)00719-4 · Cited by 2,067
A Reality Check for Data Snooping
White, H. (2000) · Econometrica · doi:10.1111/1468-0262.00152 · Cited by 1,851
Self-citationForecasting Economic Time Series
(2000) · The Economic Journal · doi:10.1111/1468-0297.00513 · Cited by 1,768
Asymptotic Inference about Predictive Ability
West, K. D. (1996) · Econometrica · doi:10.2307/2171956 · Cited by 1,401
Asymptotic Theory for Econometricians.
Robinson, P. M., & White, H. (1988) · Economica · doi:10.2307/2554258 · Cited by 1,305
Self-citationTests of equal forecast accuracy and encompassing for nested models
Clark, T. E., & McCracken, M. W. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00071-9 · Cited by 1,178
Forecasting With Bayesian Vector Autoregressions—Five Years of Experience
Litterman, R. B. (1986) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1986.10509491 · Cited by 1,137
Bayesian Methods for Dynamic Multivariate Models
Sims, C. A., & Zha, T. (1998) · International Economic Review · doi:10.2307/2527347 · Cited by 993
Forecasting Economic Time Series
Clements, M., & Hendry, D. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511599286 · Cited by 857
In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?
Inoue, A., & Kilian, L. (2005) · Econometric Reviews · doi:10.1081/etc-200040785 · Cited by 754
Estimation, Inference and Specification Analysis
White, H. (1994) · Cambridge University Press eBooks · doi:10.1017/ccol0521252806 · Cited by 738
Self-citationForecasting with Bayesian Vector Autoregressions: Five Years of Experience
Litterman, R. B. (1986) · Journal of Business & Economic Statistics · doi:10.2307/1391384 · Cited by 629
8 Forecast evaluation and combination
Diebold, F. X., & Lopez, J. A. (1996) · Handbook of Statistics · doi:10.1016/s0169-7161(96)14010-4 · Cited by 519
Estimation, Inference and Specification Analysis.
Smith, R. J., & White, H. (1996) · Economica · doi:10.2307/2555022 · Cited by 512
Self-citationData mining reconsidered: encompassing and the general‐to‐specific approach to specification search
Hoover, K. D., & Perez, S. J. (1999) · The Econometrics Journal · doi:10.1111/1368-423x.00025 · Cited by 486
(1991) · American Economic Review · Cited by 453
Nonlinear Regression with Dependent Observations
White, H., & Domowitz, I. (1984) · Econometrica · doi:10.2307/1911465 · Cited by 452
Self-citationA Consistent Conditional Moment Test of Functional Form
Bierens, H. J. (1990) · Econometrica · doi:10.2307/2938323 · Cited by 445
A Maximal Inequality and Dependent Strong Laws
McLeish, D. L. (1975) · The Annals of Probability · doi:10.1214/aop/1176996269 · Cited by 423
Tests of Equality Between Sets of Coefficients in Two Linear Regressions: An Expository Note
Fisher, F. M. (1970) · Econometrica · doi:10.2307/1913018 · Cited by 386
CONSISTENT SPECIFICATION TESTING WITH NUISANCE PARAMETERS PRESENT ONLY UNDER THE ALTERNATIVE
Stinchcombe, M. B., & White, H. (1998) · Econometric Theory · doi:10.1017/s0266466698143013 · Cited by 336
Self-citationA utility-based comparison of some models of exchange rate volatility
West, K. D., Edison, H. J., & Cho, D. (1993) · Journal of International Economics · doi:10.1016/0022-1996(93)90003-g · Cited by 333
Regression-Based Tests of Predictive Ability
West, K. D., & McCracken, M. W. (1998) · International Economic Review · doi:10.2307/2527340 · Cited by 285
Evaluation and Combination of Conditional Quantile Forecasts
Giacomini, R., & Komunjer, I. (2005) · Journal of Business & Economic Statistics · doi:10.1198/073500105000000018 · Cited by 278
Self-citationUsing out-of-sample mean squared prediction errors to test the Martingale difference hypothesisPreprint
Clark, T. E., & West, K. D. (2004) · RePEc: Research Papers in Economics · Cited by 254
Some Invariance Principles and Central Limit Theorems for Dependent Heterogeneous Processes
Wooldridge, J. M., & White, H. (1988) · Econometric Theory · doi:10.1017/s0266466600012032 · Cited by 253
Self-citationGonedes, N. J. (1973) · The Journal of Financial and Quantitative Analysis · doi:10.2307/2329643 · Cited by 243
Higher-Order Improvements of a Computationally Attractive k-Step Bootstrap for Extremum Estimators
Andrews, D. W. K. (2002) · Econometrica · doi:10.1111/1468-0262.00271 · Cited by 230
Robust out-of-sample inference
McCracken, M. W. (2000) · Journal of Econometrics · doi:10.1016/s0304-4076(00)00022-1 · Cited by 211
Progressive Modeling of Macroeconomic Time Series The LSE Methodology
Mizon, G. E. (1995) · Macroeconometrics · doi:10.1007/978-94-011-0669-6_4 · Cited by 162
OUT-OF-SAMPLE TESTS FOR GRANGER CAUSALITY
Chao, J. C., Corradi, V., & Swanson, N. R. (2001) · Macroeconomic Dynamics · doi:10.1017/s1365100501023070 · Cited by 97
Predictive ability with cointegrated variables
Corradi, V., Swanson, N. R., & Claudia Olivetti, Z. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00086-0 · Cited by 84
An Out of Sample Test for Granger CausalityPreprint
Chao, J. C., Corradi, V., & Swanson, N. R. (2000) · RePEc: Research Papers in Economics · Cited by 82
Posterior, predictive, and utility-based approaches to testing the arbitrage pricing theory
McCulloch, R., & Rossi, P. E. (1990) · Journal of Financial Economics · doi:10.1016/0304-405x(90)90046-3 · Cited by 73
Model Instability and Choice of Observation WindowPreprint
Pesaran, M. H., & Timmermann, A. (1999) · RePEc: Research Papers in Economics · Cited by 34
Comparing Density Forecasts Via Weighted Likelihood Ratio Tests: Asymptotic and Bootstrap MethodsPreprint
Giacomini, R. (2002) · SSRN Electronic Journal · doi:10.2139/ssrn.340680 · Cited by 34
Self-citationUsing Out-of-Sample Mean Squared Prediction Errors to Test the Martingale Difference
Clark, T. E., & West, K. D. (2005) · National Bureau of Economic Research · doi:10.3386/t0305 · Cited by 17
Cited by
Approximately normal tests for equal predictive accuracy in nested models
Clark, T. E., & West, K. D. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.05.023 · Cited by 2,489
(2011) · Econometrica · doi:10.3982/ecta5771 · Cited by 2,096
Volatility forecast comparison using imperfect volatility proxies
Patton, A. J. (2011) · Journal of Econometrics · doi:10.1016/j.jeconom.2010.03.034 · Cited by 1,264
A Test for Superior Predictive Ability
Hansen, P. R. (2005) · Journal of Business & Economic Statistics · doi:10.1198/073500105000000063 · Cited by 1,230
Large Bayesian vector auto regressions
Bańbura, M., Giannone, D., & Reichlin, L. (2010) · Journal of Applied Econometrics · doi:10.1002/jae.1137 · Cited by 1,151
Metadata
- Authors
- Giacomini, R., & White, H.
- Venue
- Econometrica
- Publisher
- The Econometric Society
- Published
- 2006-11
- Volume
- 74
- Issue
- 6
- Pages
- 1545-1578
- ISSN
- 0012-9682 (ISSN-L)
- 1468-0262
- OpenAlex
- W2135150595
- Cited by
- 1,646
- References
- 46
- FWCI
- 68.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.