The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?
Open accessAbstract
It is widely known that significant in-sample evidence of predictability does not guarantee significant out-of-sample predictability. This is often interpreted as an indication that in-sample evidence is likely to be spurious and should be discounted. In this paper we question this conventional wisdom. Our analysis shows that neither data mining nor parameter instability is a plausible explanation of the observed tendency of in-sample tests to reject the no predictability null more often than out-of-sample tests. We provide an alternative explanation based on the higher power of in-sample tests of predictability. We conclude that results of in-sample tests of predictability will typically be more credible than results of out-of-sample tests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Empirical exchange rate models of the seventies
Meese, R. A., & Rogoff, K. (1983) · Journal of International Economics · doi:10.1016/0022-1996(83)90017-x · Cited by 4,107
The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors
Campbell, J. Y., & Shiller, R. J. (1988) · Review of Financial Studies · doi:10.1093/rfs/1.3.195 · Cited by 3,774
Dividend yields and expected stock returns
Fama, E. F., & French, K. R. (1988) · Journal of Financial Economics · doi:10.1016/0304-405x(88)90020-7 · Cited by 3,556
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business and Economic Statistics · doi:10.2307/1392185 · Cited by 2,340
A Reality Check for Data Snooping
White, H. (2000) · Econometrica · doi:10.1111/1468-0262.00152 · Cited by 1,851
Asymptotic Inference about Predictive Ability
West, K. D. (1996) · Econometrica · doi:10.2307/2171956 · Cited by 1,401
Stock, J. H., & Watson, M. W. (1999) · Journal of Monetary Economics · doi:10.1016/s0304-3932(99)00027-6 · Cited by 1,260
Tests of equal forecast accuracy and encompassing for nested models
Clark, T. E., & McCracken, M. W. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00071-9 · Cited by 1,178
Forecasting Output and Inflation: The Role of Asset Prices
Stock, J. H., & Watson, M. W. (2003) · Journal of Economic Literature · doi:10.1257/002205103322436197 · Cited by 1,076
Was It Real? The Exchange Rate‐Interest Differential Relation over the Modern Floating‐Rate Period
MEESE, R., & ROGOFP, K. (1988) · The Journal of Finance · doi:10.1111/j.1540-6261.1988.tb02613.x · Cited by 824
Why is it so difficult to beat the random walk forecast of exchange rates?
Kilian, L., & Taylor, M. P. (2003) · Journal of International Economics · doi:10.1016/s0022-1996(02)00060-0 · Cited by 783
Self-citationTests for Forecast Encompassing
Harvey, D. I., Leybourne, S. J., & Newbold, P. (1998) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1998.10524759 · Cited by 775
Stock prices, earnings, and expected dividends
Campbell, J. Y., Shiller, R. J., Campbell, J. Y., & Shiller, R. J. (1988) · Cited by 567
Advertising and Aggregate Consumption: An Analysis of Causality
Ashley, R., Granger, C. W. J., & Schmalensee, R. (1980) · Econometrica · doi:10.2307/1912176 · Cited by 548
Exchange rates and monetary fundamentals: what do we learn from long-horizon regressions?
Kilian, L. (1999) · Journal of Applied Econometrics · doi:10.1002/(sici)1099-1255(199909/10)14:5<491::aid-jae527>3.0.co;2-d · Cited by 429
Self-citationBanking on currency forecasts: How predictable is change in money?
Chinn, M. D., & Meese, R. A. (1995) · Journal of International Economics · doi:10.1016/0022-1996(94)01334-o · Cited by 372
Convergence to Stochastic Integrals for Dependent Heterogeneous Processes
Hansen, B. E. (1992) · Econometric Theory · doi:10.1017/s0266466600013189 · Cited by 341
Dangers of data mining: The case of calendar effects in stock returns
Sullivan, R., Timmermann, A., & White, H. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00077-x · Cited by 282
The out-of-sample success of term structure models as exchange rate predictors: a step beyond
Clarida, R. H., Sarno, L., Taylor, M. P., & Valente, G. (2003) · Journal of International Economics · doi:10.1016/s0022-1996(02)00059-4 · Cited by 255
The Statistical Analysis of Time Series
Anderson, T. W. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9781118186428 · Cited by 199
Long-Horizon Exchange Rate Predictability?
Berkowitz, J., & Giorgianni, L. (2001) · Review of Economics and Statistics · doi:10.1162/003465301750160054 · Cited by 197
Clarida, R. H., & Taylor, M. P. (1997) · Review of Economics and Statistics · doi:10.1162/003465397556827 · Cited by 163
Denton, F. T. (1985) · The Review of Economics and Statistics · doi:10.2307/1928442 · Cited by 131
A consistent test for nonlinear out of sample predictive accuracy
Corradi, V., & Swanson, N. R. (2002) · Journal of Econometrics · doi:10.1016/s0304-4076(02)00099-4 · Cited by 121
Real exchange-rate prediction over long horizons
Mark, N. C., & Choi, D.-Y. (1997) · Journal of International Economics · doi:10.1016/s0022-1996(96)01445-6 · Cited by 108
Can out‐of‐sample forecast comparisons help prevent overfitting?
Clark, T. E. (2004) · Journal of Forecasting · doi:10.1002/for.904 · Cited by 105
OUT-OF-SAMPLE TESTS FOR GRANGER CAUSALITY
Chao, J. C., Corradi, V., & Swanson, N. R. (2001) · Macroeconomic Dynamics · doi:10.1017/s1365100501023070 · Cited by 97
Predictive ability with cointegrated variables
Corradi, V., Swanson, N. R., & Claudia Olivetti, Z. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00086-0 · Cited by 84
Testing the Predictive Power of Dividend Yields
Goetzmann, W. N., & Jorion, P. (1993) · The Journal of Finance · doi:10.2307/2328917 · Cited by 60
Tests for Forecasts Encompassing When Forecasts Depend on Estimated Regression Parameters
West, K. D. (2001) · Journal of Business and Economic Statistics · doi:10.1198/07350010152472580 · Cited by 58
Cited by
A comprehensive look at the empirical performance of equity premium prediction
Welch, I., & Goyal, A. (2008) · Review of Financial Studies · doi:10.1093/rfs/hhm014 · Cited by 3,987
Predicting excess stock returns out of sample: Can anything beat the historical average?
Campbell, J. Y., & Thompson, S. B. (2008) · Review of Financial Studies · doi:10.1093/rfs/hhm055 · Cited by 2,919
“While it is not clear how much weight should be placed on out-of-sample statistics in judging the predictability of stock returns [ Inoue and Kilian (2004) ], in this paper we take up Goyal and Welch’s challenge and ask whether standard variables could have been used in real time to forecast 20th and early 21st centur…”
BackgroundApproximately normal tests for equal predictive accuracy in nested models
Clark, T. E., & West, K. D. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.05.023 · Cited by 2,489
Tests of Conditional Predictive Ability
Giacomini, R., & White, H. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00718.x · Cited by 1,646
A Test for Superior Predictive Ability
Hansen, P. R. (2005) · Journal of Business & Economic Statistics · doi:10.1198/073500105000000063 · Cited by 1,230
Metadata
- Authors
- Inoue, A., & Kilian, L.
- Venue
- Econometric Reviews
- Publisher
- Informa UK Limited
- Published
- 2005-01-02
- Volume
- 23
- Issue
- 4
- Pages
- 371-402
- ISSN
- 0747-4938 (ISSN-L)
- 1532-4168
- OpenAlex
- W3124211260
- Cited by
- 754
- References
- 30
- FWCI
- 59.64
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.