The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Out-of-Sample Forecast Tests Robust to the Choice of Window Size
Open accessAbstract
This article proposes new methodologies for evaluating economic models’ out-of-sample forecasting performance that are robust to the choice of the estimation window size. The methodologies involve evaluating the predictive ability of forecasting models over a wide range of window sizes. The study shows that the tests proposed in the literature may lack the power to detect predictive ability and might be subject to data snooping across different window sizes if used repeatedly. An empirical application shows the usefulness of the methodologies for evaluating exchange rate models’ forecasting ability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Newey, W. K., & West, K. D. (1987) · Econometrica · doi:10.2307/1913610 · Cited by 16,936
Convergence of Probability Measures
Billingsley, P. (1999) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316962 · Cited by 13,910
A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix
Newey, W., & West, K. (1986) · National Bureau of Economic Research · doi:10.3386/t0055 · Cited by 12,278
Diebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1995.10524599 · Cited by 5,130
Tests for parameter instability and structural change with unknown change point.
Andrews, D. W. K. (1993) · Econometrica · doi:10.2307/2951764 · Cited by 4,334 · cited 2×
“The uniform convergence of variance estimators follows from the uniform convergence of second moments of summands in the numerator and the uniform convergence of rolling and recursive estimators, as in the literature on structural change (see Andrews 1993, for example).”
Empirical exchange rate models of the seventies
Meese, R. A., & Rogoff, K. (1983) · Journal of International Economics · doi:10.1016/0022-1996(83)90017-x · Cited by 4,107
Approximately normal tests for equal predictive accuracy in nested models
Clark, T. E., & West, K. D. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.05.023 · Cited by 2,489
Testing the equality of prediction mean squared errors
Harvey, D., Leybourne, S., & Newbold, P. (1997) · International Journal of Forecasting · doi:10.1016/s0169-2070(96)00719-4 · Cited by 2,067
Tests of Conditional Predictive Ability
Giacomini, R., & White, H. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00718.x · Cited by 1,646
Asymptotic Inference about Predictive Ability
West, K. D. (1996) · Econometrica · doi:10.2307/2171956 · Cited by 1,401
Tests of equal forecast accuracy and encompassing for nested models
Clark, T. E., & McCracken, M. W. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00071-9 · Cited by 1,178
Davidson, J. E. H. (1994) · Oxford University Press eBooks · doi:10.1093/0198774036.001.0001 · Cited by 1,157
Forecasting Economic Time Series
Taylor, S. J. (1979) · Journal of the Operational Research Society · doi:10.1057/jors.1979.126 · Cited by 1,004
Tests for Forecast Encompassing
Harvey, D. I., Leybourne, S. J., & Newbold, P. (1998) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1998.10524759 · Cited by 775
Empirical exchange rate models of the nineties: Are any fit to survive?
Cheung, Y.-W., Chinn, M. D., & Pascual, A. G. (2005) · Journal of International Money and Finance · doi:10.1016/j.jimonfin.2005.08.002 · Cited by 714
International Financial Adjustment
Gourinchas, P., & Rey, H. (2007) · Journal of Political Economy · doi:10.1086/521966 · Cited by 636
Econometric Evaluation of Linear Macro-Economic Models
Chong, Y. Y., & Hendry, D. F. (1986) · The Review of Economic Studies · doi:10.2307/2297611 · Cited by 601
Evaluation of Economic Forecasts
(2016) · Routledge eBooks · doi:10.4324/9781315480695-16 · Cited by 537
8 Forecast evaluation and combination
Diebold, F. X., & Lopez, J. A. (1996) · Handbook of Statistics · doi:10.1016/s0169-7161(96)14010-4 · Cited by 519
Selection of estimation window in the presence of breaks
Pesaran, M. H., & Timmermann, A. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.03.010 · Cited by 468
Forecast comparisons in unstable environments
Giacomini, R., & Rossi, B. (2010) · Journal of Applied Econometrics · doi:10.1002/jae.1177 · Cited by 463
Self-citationInternational Financial Adjustment
Gourinchas, P.-O., & Rey, H. (2005) · National Bureau of Economic Research · doi:10.3386/w11155 · Cited by 439
Out-of-sample exchange rate predictability with Taylor rule fundamentals
Molodtsova, T., & Papell, D. H. (2009) · Journal of International Economics · doi:10.1016/j.jinteco.2008.11.001 · Cited by 434
Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis
Clark, T. E., & West, K. D. (2006) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.07.014 · Cited by 403
On the limitations of comparing mean square forecast errors
Clements, M. P., & Hendry, D. F. (1993) · Journal of Forecasting · doi:10.1002/for.3980120802 · Cited by 392
Convergence to Stochastic Integrals for Dependent Heterogeneous Processes
Hansen, B. E. (1992) · Econometric Theory · doi:10.1017/s0266466600013189 · Cited by 341
Forecasting Time Series Subject to Multiple Structural Breaks
HASHEM PESARAN, M., PETTENUZZO, D., & TIMMERMANN, A. (2006) · Review of Economic Studies · doi:10.1111/j.1467-937x.2006.00408.x · Cited by 340
Exchange Rates and International Macroeconomics
Frenkel, J. A. (1983) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226262536.001.0001 · Cited by 311
Regression-Based Tests of Predictive Ability
West, K. D., & McCracken, M. W. (1998) · International Economic Review · doi:10.2307/2527340 · Cited by 285
Using out-of-sample mean squared prediction errors to test the Martingale difference hypothesisPreprint
Clark, T. E., & West, K. D. (2004) · RePEc: Research Papers in Economics · Cited by 254
Some Invariance Principles and Central Limit Theorems for Dependent Heterogeneous Processes
Wooldridge, J. M., & White, H. (1988) · Econometric Theory · doi:10.1017/s0266466600012032 · Cited by 253
Evaluating Direct Multistep Forecasts
Clark, T. E., & McCracken, M. W. (2005) · Econometric Reviews · doi:10.1080/07474930500405683 · Cited by 239
Robust out-of-sample inference
McCracken, M. W. (2000) · Journal of Econometrics · doi:10.1016/s0304-4076(00)00022-1 · Cited by 211
IMPROVING FORECAST ACCURACY BY COMBINING RECURSIVE AND ROLLING FORECASTS*
Clark, T. E., & McCracken, M. W. (2009) · International Economic Review · doi:10.1111/j.1468-2354.2009.00533.x · Cited by 194
Choice of Sample Split in Out-of-Sample Forecast EvaluationPreprint
Hansen, P. R., & Timmermann, A. (2012) · RePEc: Research Papers in Economics · Cited by 189
ARE EXCHANGE RATES REALLY RANDOM WALKS? SOME EVIDENCE ROBUST TO PARAMETER INSTABILITY
Rossi, B. (2005) · Macroeconomic Dynamics · doi:10.1017/s1365100506050085 · Cited by 184
Self-citationDavidson, J. E. H. (2021) · doi:10.1093/oso/9780192844507.001.0001 · Cited by 138
The power of tests of predictive ability in the presence of structural breaks
Clark, T. E., & McCracken, M. W. (2004) · Journal of Econometrics · doi:10.1016/j.jeconom.2003.12.011 · Cited by 118
OUT-OF-SAMPLE TESTS FOR GRANGER CAUSALITY
Chao, J. C., Corradi, V., & Swanson, N. R. (2001) · Macroeconomic Dynamics · doi:10.1017/s1365100501023070 · Cited by 97
An Out of Sample Test for Granger CausalityPreprint
Chao, J. C., Corradi, V., & Swanson, N. R. (2000) · RePEc: Research Papers in Economics · Cited by 82
Pesaran, M. H., & Timmermann, A. (2005) · Econometric Theory · doi:10.1017/s0266466605050139 · Cited by 72
Understanding models’ forecasting performance
Rossi, B., & Sekhposyan, T. (2011) · Journal of Econometrics · doi:10.1016/j.jeconom.2011.02.020 · Cited by 63
Self-citationAdvances in Forecast Evaluation
McCracken, M. W., & Clark, T. E. (2011) · doi:10.20955/wp.2011.025 · Cited by 63
Reality Checks and Nested Forecast Model ComparisonsPreprint
Clark, T. E., & McCracken, M. W. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1687219 · Cited by 17
Cited by
Investor Sentiment Aligned: A Powerful Predictor of Stock Returns
Huang, D., Jiang, F., Tu, J., & Zhou, G. (2015) · Review of Financial Studies · doi:10.1093/rfs/hhu080 · Cited by 1,123
Manager sentiment and stock returns
Jiang, F., Lee, J., Martin, X., & Zhou, G. (2019) · Journal of Financial Economics · doi:10.1016/j.jfineco.2018.10.001 · Cited by 724
Rossi, B. (2013) · Journal of Economic Literature · doi:10.1257/jel.51.4.1063 · Cited by 649
Self-citationRapach, D., & Zhou, G. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00006-2 · Cited by 613
Market expectations in the cross-section of present values
KELLY, B., & PRUITT, S. (2013) · The Journal of Finance · doi:10.1111/jofi.12060 · Cited by 584
Metadata
- Authors
- Rossi, B., & Inoue, A.
- Venue
- Journal of Business & Economic Statistics
- Publisher
- Informa UK Limited
- Published
- 2012-07
- Volume
- 30
- Issue
- 3
- Pages
- 432-453
- ISSN
- 0735-0015 (ISSN-L)
- 1537-2707
- OpenAlex
- W2097139473
- Cited by
- 402
- References
- 45
- FWCI
- 21.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.