The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?
Open accessAbstract
It is widely known that significant in-sample evidence of predictability does not guarantee significant out-of-sample predictability. This is often interpreted as an indication that in-sample evidence is likely to be spurious and should be discounted. In this paper we question this conventional wisdom. Our analysis shows that neither data mining nor parameter instability is a plausible explanation of the observed tendency of in-sample tests to reject the no predictability null more often than out-of-sample tests. We provide an alternative explanation based on the higher power of in-sample tests of predictability. We conclude that results of in-sample tests of predictability will typically be more credible than results of out-of-sample tests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Empirical exchange rate models of the seventies
Meese, R. A., & Rogoff, K. (1983) · Journal of International Economics · doi:10.1016/0022-1996(83)90017-x · Cited by 4,107
The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors
Campbell, J. Y., & Shiller, R. J. (1988) · Review of Financial Studies · doi:10.1093/rfs/1.3.195 · Cited by 3,774
Dividend yields and expected stock returns
Fama, E. F., & French, K. R. (1988) · Journal of Financial Economics · doi:10.1016/0304-405x(88)90020-7 · Cited by 3,556
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business and Economic Statistics · doi:10.2307/1392185 · Cited by 2,340
A Reality Check for Data Snooping
White, H. (2000) · Econometrica · doi:10.1111/1468-0262.00152 · Cited by 1,851
Asymptotic Inference about Predictive Ability
West, K. D. (1996) · Econometrica · doi:10.2307/2171956 · Cited by 1,401
Stock, J. H., & Watson, M. W. (1999) · Journal of Monetary Economics · doi:10.1016/s0304-3932(99)00027-6 · Cited by 1,260
Tests of equal forecast accuracy and encompassing for nested models
Clark, T. E., & McCracken, M. W. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00071-9 · Cited by 1,178
Forecasting Output and Inflation: The Role of Asset Prices
Stock, J. H., & Watson, M. W. (2003) · Journal of Economic Literature · doi:10.1257/002205103322436197 · Cited by 1,076
Was It Real? The Exchange Rate‐Interest Differential Relation over the Modern Floating‐Rate Period
MEESE, R., & ROGOFP, K. (1988) · The Journal of Finance · doi:10.1111/j.1540-6261.1988.tb02613.x · Cited by 824
Cited by
A comprehensive look at the empirical performance of equity premium prediction
Welch, I., & Goyal, A. (2008) · Review of Financial Studies · doi:10.1093/rfs/hhm014 · Cited by 3,987
Predicting excess stock returns out of sample: Can anything beat the historical average?
Campbell, J. Y., & Thompson, S. B. (2008) · Review of Financial Studies · doi:10.1093/rfs/hhm055 · Cited by 2,919
“While it is not clear how much weight should be placed on out-of-sample statistics in judging the predictability of stock returns [ Inoue and Kilian (2004) ], in this paper we take up Goyal and Welch’s challenge and ask whether standard variables could have been used in real time to forecast 20th and early 21st centur…”
BackgroundApproximately normal tests for equal predictive accuracy in nested models
Clark, T. E., & West, K. D. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.05.023 · Cited by 2,489
Tests of Conditional Predictive Ability
Giacomini, R., & White, H. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00718.x · Cited by 1,646
A Test for Superior Predictive Ability
Hansen, P. R. (2005) · Journal of Business & Economic Statistics · doi:10.1198/073500105000000063 · Cited by 1,230
Investor Sentiment Aligned: A Powerful Predictor of Stock Returns
Huang, D., Jiang, F., Tu, J., & Zhou, G. (2015) · Review of Financial Studies · doi:10.1093/rfs/hhu080 · Cited by 1,123
Forecasting Output and Inflation: The Role of Asset Prices
Stock, J. H., & Watson, M. W. (2003) · Journal of Economic Literature · doi:10.1257/002205103322436197 · Cited by 1,076
Forecasting the equity risk premium: the role of technical indicators
Neely, C. J., Rapach, D. E., Tu, J., & Zhou, G. (2014) · Management Science · doi:10.1287/mnsc.2013.1838 · Cited by 1,003
What do we learn from the price of crude oil futures?
Alquist, R., & Kilian, L. (2010) · Journal of Applied Econometrics · doi:10.1002/jae.1159 · Cited by 744
Self-citationManager sentiment and stock returns
Jiang, F., Lee, J., Martin, X., & Zhou, G. (2019) · Journal of Financial Economics · doi:10.1016/j.jfineco.2018.10.001 · Cited by 724
Empirical exchange rate models of the nineties: Are any fit to survive?
Cheung, Y.-W., Chinn, M. D., & Pascual, A. G. (2005) · Journal of International Money and Finance · doi:10.1016/j.jimonfin.2005.08.002 · Cited by 714
Asymptotics for out of sample tests of Granger causality
McCracken, M. W. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.07.020 · Cited by 696
International Stock Return Predictability: What Is the Role of the United States?
RAPACH, D. E., STRAUSS, J. K., & ZHOU, G. (2013) · The Journal of Finance · doi:10.1111/jofi.12041 · Cited by 678
Rapach, D., & Zhou, G. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00006-2 · Cited by 613
Short interest and aggregate stock returns
Rapach, D. E., Ringgenberg, M. C., & Zhou, G. (2016) · Journal of Financial Economics · doi:10.1016/j.jfineco.2016.03.004 · Cited by 571
Forecasting stock market returns: The sum of the parts is more than the whole
Ferreira, M. A., & Santa-Clara, P. (2011) · Journal of Financial Economics · doi:10.1016/j.jfineco.2011.02.003 · Cited by 515
Diebold, F. X. (2015) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2014.983236 · Cited by 496
Time-Varying Risk Premiums and the Output Gap
Cooper, I., & Priestley, R. (2009) · Review of Financial Studies · doi:10.1093/rfs/hhn087 · Cited by 501
Instability of return prediction models
Paye, B. S., & Timmermann, A. (2006) · Journal of Empirical Finance · doi:10.1016/j.jempfin.2005.11.001 · Cited by 475
Selection of estimation window in the presence of breaks
Pesaran, M. H., & Timmermann, A. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.03.010 · Cited by 468
Out-of-sample exchange rate predictability with Taylor rule fundamentals
Molodtsova, T., & Papell, D. H. (2009) · Journal of International Economics · doi:10.1016/j.jinteco.2008.11.001 · Cited by 434
Expected returns and expected dividend growth
Lettau, M., & Ludvigson, S. C. (2005) · Journal of Financial Economics · doi:10.1016/j.jfineco.2004.05.008 · Cited by 433
Faust, J., & Wright, J. H. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00001-3 · Cited by 423
Measuring and Modeling Variation in the Risk-Return Trade-off
Lettau, M., & Ludvigson, S. C. (2010) · Handbook of Financial Econometrics: Tools and Techniques · doi:10.1016/b978-0-444-50897-3.50014-6 · Cited by 409
Kilian, L., & Vega, C. (2011) · Review of Economics and Statistics · doi:10.1162/rest_a_00086 · Cited by 403
Self-citationUsing out-of-sample mean squared prediction errors to test the martingale difference hypothesis
Clark, T. E., & West, K. D. (2006) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.07.014 · Cited by 403
Investor attention, psychological anchors, and stock return predictability
Li, J., & Yu, J. (2012) · Journal of Financial Economics · doi:10.1016/j.jfineco.2011.04.003 · Cited by 378
Macro variables and international stock return predictability
Rapach, D. E., Wohar, M. E., & Rangvid, J. (2005) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2004.05.004 · Cited by 351
Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach
Baumeister, C., & Kilian, L. (2015) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2014.949342 · Cited by 322
Self-citationAlquist, R., Kilian, L., & Vigfusson, R. J. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00008-6 · Cited by 307
Self-citationNONLINEARITIES IN THE OIL PRICE–OUTPUT RELATIONSHIP
Kilian, L., & Vigfusson, R. J. (2011) · Macroeconomic Dynamics · doi:10.1017/s1365100511000186 · Cited by 275
Self-citationA comprehensive look at financial volatility prediction by economic variables
Christiansen, C., Schmeling, M., & Schrimpf, A. (2012) · Journal of Applied Econometrics · doi:10.1002/jae.2298 · Cited by 272
Expected Returns in Treasury Bonds
Cieslak, A., & Povala, P. (2015) · Review of Financial Studies · doi:10.1093/rfs/hhv032 · Cited by 266
In-sample vs. out-of-sample tests of stock return predictability in the context of data mining
Rapach, D. E., & Wohar, M. E. (2006) · Journal of Empirical Finance · doi:10.1016/j.jempfin.2005.08.001 · Cited by 257
Does risk aversion drive financial crises? Testing the predictive power of empirical indicators
Coudert, V., & Gex, M. (2008) · Journal of Empirical Finance · doi:10.1016/j.jempfin.2007.06.001 · Cited by 217
West, K. D. (2006) · Handbook of Economic Forecasting · doi:10.1016/s1574-0706(05)01003-7 · Cited by 182
A Test for Superior Predictive Ability
Hansen, P. R. (2004) · doi:10.2139/ssrn.264569 · Cited by 99
Quantum computing and supervised machine learning
Oneto, L., Ridella, S., & Anguita, D. (2017) · Quantum Inspired Computational Intelligence · doi:10.1016/b978-0-12-804409-4.00002-4 · Cited by 11
Metadata
- Authors
- Inoue, A., & Kilian, L.
- Venue
- Econometric Reviews
- Publisher
- Informa UK Limited
- Published
- 2005-01-02
- Volume
- 23
- Issue
- 4
- Pages
- 371-402
- ISSN
- 0747-4938 (ISSN-L)
- 1532-4168
- OpenAlex
- W3124211260
- Cited by
- 754
- References
- 30
- FWCI
- 59.64
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.