The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Forecast comparisons in unstable environments
Abstract
We propose new methods for comparing the out‐of‐sample forecasting performance of two competing models in the presence of possible instabilities. The main idea is to develop a measure of the relative local forecasting performance for the two models, and to investigate its stability over time by means of statistical tests. We propose two tests (the Fluctuation test and the One‐Time Reversal test) that analyze the evolution of the models' relative performance over historical samples. In contrast to previous approaches to forecast comparison, which are based on measures of global performance, we focus on the entire time path of the models' relative performance, which may contain useful information that is lost when looking for the model that forecasts best on average. We apply our tests to the analysis of the time variation in the out‐of‐sample forecasting performance of monetary models of exchange rate determination relative to the random walk. Copyright © 2010 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Newey, W. K., & West, K. D. (1987) · Econometrica · doi:10.2307/1913610 · Cited by 16,936
A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix
Newey, W., & West, K. (1986) · National Bureau of Economic Research · doi:10.3386/t0055 · Cited by 12,278
Discretion versus policy rules in practice
Taylor, J. B. (1993) · Carnegie-Rochester Conference Series on Public Policy · doi:10.1016/0167-2231(93)90009-l · Cited by 9,065
Estimating and Testing Linear Models with Multiple Structural Changes
Bai, J., & Perron, P. (1998) · Econometrica · doi:10.2307/2998540 · Cited by 6,112
Diebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
Techniques for Testing the Constancy of Regression Relationships Over Time
Brown, R. L., Durbin, J., & Evans, J. M. (1975) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1975.tb01532.x · Cited by 5,128
Tests for parameter instability and structural change with unknown change point.
Andrews, D. W. K. (1993) · Econometrica · doi:10.2307/2951764 · Cited by 4,334
Empirical exchange rate models of the seventies
Meese, R. A., & Rogoff, K. (1983) · Journal of International Economics · doi:10.1016/0022-1996(83)90017-x · Cited by 4,107
Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation
Andrews, D. W. K. (1991) · Econometrica · doi:10.2307/2938229 · Cited by 4,030
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business and Economic Statistics · doi:10.2307/1392185 · Cited by 2,340
Tests of Conditional Predictive Ability
Giacomini, R., & White, H. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00718.x · Cited by 1,646
Self-citationAsymptotic Inference about Predictive Ability
West, K. D. (1996) · Econometrica · doi:10.2307/2171956 · Cited by 1,401
Tests of equal forecast accuracy and encompassing for nested models
Clark, T. E., & McCracken, M. W. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00071-9 · Cited by 1,178
Forecasting Output and Inflation: The Role of Asset Prices
Stock, J. H., & Watson, M. W. (2003) · Journal of Economic Literature · doi:10.1257/002205103322436197 · Cited by 1,076
Stochastic Complexity and Modeling
Rissanen, J. (1986) · The Annals of Statistics · doi:10.1214/aos/1176350051 · Cited by 922
Forecasting Output and Inflation: The Role of Asset Prices
Stock, J. H., & Watson, M. W. (2003) · Journal of Economic Literature · doi:10.1257/jel.41.3.788 · Cited by 862
Estimation of a Change Point in Multiple Regression Models
Bai, J. (1997) · Review of Economics and Statistics · doi:10.1162/003465397557132 · Cited by 829
Why is it so difficult to beat the random walk forecast of exchange rates?
Kilian, L., & Taylor, M. P. (2003) · Journal of International Economics · doi:10.1016/s0022-1996(02)00060-0 · Cited by 783
Nikolopoulos, K. (2004) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2003.11.008 · Cited by 724
The Cusum Test with Ols Residuals
Ploberger, W., & Kramer, W. (1992) · Econometrica · doi:10.2307/2951597 · Cited by 601
Out-of-sample exchange rate predictability with Taylor rule fundamentals
Molodtsova, T., & Papell, D. H. (2009) · Journal of International Economics · doi:10.1016/j.jinteco.2008.11.001 · Cited by 434
Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis
Clark, T. E., & West, K. D. (2006) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.07.014 · Cited by 403
Exchange rates and international macroeconomics
Frenkel, J. A. (1984) · Journal of Macroeconomics · doi:10.1016/0164-0704(84)90058-2 · Cited by 383
Using out-of-sample mean squared prediction errors to test the Martingale difference hypothesisPreprint
Clark, T. E., & West, K. D. (2004) · RePEc: Research Papers in Economics · Cited by 254
Timmermann, A. (2008) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2007.07.008 · Cited by 234
Robust out-of-sample inference
McCracken, M. W. (2000) · Journal of Econometrics · doi:10.1016/s0304-4076(00)00022-1 · Cited by 211
MOSUM tests for parameter constancy
CHU, C.-S. J., HORNIK, K., & KAUN, C.-M. (1995) · Biometrika · doi:10.1093/biomet/82.3.603 · Cited by 197
On Predictive Least Squares Principles
Wei, C. Z. (1992) · The Annals of Statistics · doi:10.1214/aos/1176348511 · Cited by 194
On the selection of forecasting models
Inoue, A., & Kilian, L. (2006) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.03.003 · Cited by 166
OPTIMAL TESTS FOR NESTED MODEL SELECTION WITH UNDERLYING PARAMETER INSTABILITY
Rossi, B. (2005) · Econometric Theory · doi:10.1017/s0266466605050486 · Cited by 154
Self-citationARE EXCHANGE RATES REALLY RANDOM WALKS? SOME EVIDENCE ROBUST TO PARAMETER INSTABILITY
Rossi, B. (2005) · Macroeconomic Dynamics · doi:10.1017/s1365100506050085 · Cited by 144
Self-citationTESTING LONG‐HORIZON PREDICTIVE ABILITY WITH HIGH PERSISTENCE, AND THE MEESE–ROGOFF PUZZLE*
Rossi, B. (2005) · International Economic Review · doi:10.1111/j.0020-6598.2005.00310.x · Cited by 113
Self-citationOPTIMAL FORECAST COMBINATION UNDER REGIME SWITCHING*
Elliott, G., & Timmermann, A. (2005) · International Economic Review · doi:10.1111/j.1468-2354.2005.00361.x · Cited by 91
Cited by
Rossi, B. (2013) · Journal of Economic Literature · doi:10.1257/jel.51.4.1063 · Cited by 649
Self-citationRapach, D., & Zhou, G. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00006-2 · Cited by 613
Diebold, F. X. (2015) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2014.983236 · Cited by 496
Faust, J., & Wright, J. H. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00001-3 · Cited by 423
Out-of-Sample Forecast Tests Robust to the Choice of Window Size
Rossi, B., & Inoue, A. (2012) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2012.693850 · Cited by 402
Self-citation
Metadata
- Authors
- Giacomini, R., & Rossi, B.
- Venue
- Journal of Applied Econometrics
- Publisher
- Wiley
- Published
- 2010-05-04
- Volume
- 25
- Issue
- 4
- Pages
- 595-620
- ISSN
- 0883-7252 (ISSN-L)
- 1099-1255
- OpenAlex
- W2035611161
- Cited by
- 463
- References
- 33
- FWCI
- 26.16
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.