The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Comparing Predictive Accuracy
Open accessAbstract
We propose and evaluate explicit tests of the null hypothesis of no difference in the accuracy of two competing forecasts. In contrast to previously developed tests, a wide variety of accuracy measures can be used (in particular, the loss function need not be quadratic and need not even be symmetric), and forecast errors can be non-Gaussian, nonzero mean, serially correlated, and contemporaneously correlated. Asymptotic and exact finite-sample tests are proposed, evaluated, and illustrated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Newey, W. K., & West, K. D. (1987) · Econometrica · doi:10.2307/1913610 · Cited by 16,936
A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix
Newey, W., & West, K. (1986) · National Bureau of Economic Research · doi:10.3386/t0055 · Cited by 12,278
A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle
Hamilton, J. D. (1989) · Econometrica · doi:10.2307/1912559 · Cited by 9,646
The Advanced Theory of Statistics.
Clarke, G. M., Kendall, M., & Stuart, A. (1978) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344782 · Cited by 6,658
Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses
Vuong, Q. H. (1989) · Econometrica · doi:10.2307/1912557 · Cited by 5,929
Time Series: Theory and Methods
Ziegel, E. R., Brockwell, P., & Davis, R. (1992) · Technometrics · doi:10.2307/1270070 · Cited by 5,012
Spectral Analysis and Time Series
Preston, D. B. (1983) · Technometrics · doi:10.1080/00401706.1983.10487866 · Cited by 5,011
Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation
Andrews, D. W. K. (1991) · Econometrica · doi:10.2307/2938229 · Cited by 4,030
Nonparametrics: Statistical Methods Based on Ranks
Mergenthaler, M. J., & Lehmann, E. L. (1979) · Technometrics · doi:10.2307/1268531 · Cited by 3,329
Introduction to Mathematical Statistics.
AA, Hogg, R. V., & Craig, A. T. (1996) · Journal of the American Statistical Association · doi:10.2307/2291439 · Cited by 2,888
Cited by
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
A comprehensive look at the empirical performance of equity premium prediction
Welch, I., & Goyal, A. (2008) · Review of Financial Studies · doi:10.1093/rfs/hhm014 · Cited by 3,987
Answering the Skeptics: Yes, Standard Volatility Models do Provide Accurate Forecasts
Andersen, T. G., & Bollerslev, T. (1998) · International Economic Review · doi:10.2307/2527343 · Cited by 3,375
Deep learning with long short-term memory networks for financial market predictions
Fischer, T., & Krauss, C. (2018) · European Journal of Operational Research · doi:10.1016/j.ejor.2017.11.054 · Cited by 2,785
Christoffersen, P. F. (1998) · International Economic Review · doi:10.2307/2527341 · Cited by 2,669
Empirical Asset Pricing via Machine Learning
Gu, S., Kelly, B., & Xiu, D. (2020) · The Review of Financial Studies · doi:10.1093/rfs/hhaa009 · Cited by 2,545
Approximately normal tests for equal predictive accuracy in nested models
Clark, T. E., & West, K. D. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.05.023 · Cited by 2,489
Consumption, Aggregate Wealth, and Expected Stock Returns
Lettau, M., & Ludvigson, S. (2001) · The Journal of Finance · doi:10.1111/0022-1082.00347 · Cited by 2,180
(2011) · Econometrica · doi:10.3982/ecta5771 · Cited by 2,096
Testing the equality of prediction mean squared errors
Harvey, D., Leybourne, S., & Newbold, P. (1997) · International Journal of Forecasting · doi:10.1016/s0169-2070(96)00719-4 · Cited by 2,067
A Reality Check for Data Snooping
White, H. (2000) · Econometrica · doi:10.1111/1468-0262.00152 · Cited by 1,851
Probabilistic Forecasts, Calibration and Sharpness
Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00587.x · Cited by 1,783
A forecast comparison of volatility models: does anything beat a GARCH(1,1)?
Hansen, P. R., & Lunde, A. (2005) · Journal of Applied Econometrics · doi:10.1002/jae.800 · Cited by 1,773
Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy
Rapach, D. E., Strauss, J. K., & Zhou, G. (2010) · Review of Financial Studies · doi:10.1093/rfs/hhp063 · Cited by 1,679
Tests of Conditional Predictive Ability
Giacomini, R., & White, H. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00718.x · Cited by 1,646
25 years of time series forecasting
De Gooijer, J. G., & Hyndman, R. J. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.01.001 · Cited by 1,587
Evaluating Density Forecasts with Applications to Financial Risk Management
Diebold, F. X., Gunther, T. A., & Tay, A. S. (1998) · International Economic Review · doi:10.2307/2527342 · Cited by 1,452
Self-citationForecasting Volatility in Financial Markets: A Review
Poon, S., & Granger, C. W. J. (2003) · Journal of Economic Literature · doi:10.1257/002205103765762743 · Cited by 1,315
A Test for Superior Predictive Ability
Hansen, P. R. (2005) · Journal of Business & Economic Statistics · doi:10.1198/073500105000000063 · Cited by 1,230
RETRACTED: Cryptocurrencies as a financial asset: A systematic analysis
Corbet, S., Lucey, B., Urquhart, A., & Yarovaya, L. (2019) · International Review of Financial Analysis · doi:10.1016/j.irfa.2018.09.003 · Cited by 1,172
RetractedMaking and Evaluating Point Forecasts
Gneiting, T. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.r10138 · Cited by 1,154
Investor Sentiment Aligned: A Powerful Predictor of Stock Returns
Huang, D., Jiang, F., Tu, J., & Zhou, G. (2015) · Review of Financial Studies · doi:10.1093/rfs/hhu080 · Cited by 1,123
Forecasting Output and Inflation: The Role of Asset Prices
Stock, J. H., & Watson, M. W. (2003) · Journal of Economic Literature · doi:10.1257/002205103322436197 · Cited by 1,076
Learning from Inflation Experiences *
Malmendier, U., & Nagel, S. (2016) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv037 · Cited by 1,063
Data-snooping, technical trading rule performance and the Bootstrap
Sullivan, R., Timmermann, A., & White, H. (1999) · The Journal of Finance · doi:10.1111/0022-1082.00163 · Cited by 1,028
Forecasting the equity risk premium: the role of technical indicators
Neely, C. J., Rapach, D. E., Tu, J., & Zhou, G. (2014) · Management Science · doi:10.1287/mnsc.2013.1838 · Cited by 1,003
Cooper, M. J., Gutierrez, R. C., & Hameed, A. (2004) · The Journal of Finance · doi:10.1111/j.1540-6261.2004.00665.x · Cited by 992
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Testing Density Forecasts, With Applications to Risk Management
Berkowitz, J. (2001) · Journal of Business & Economic Statistics · doi:10.1198/07350010152596718 · Cited by 859
The VIX, the variance premium and stock market volatility
Bekaert, G., & Hoerova, M. (2014) · Journal of Econometrics · doi:10.1016/j.jeconom.2014.05.008 · Cited by 809
What does the yield curve tell us about GDP growth?
Ang, A., Piazzesi, M., & Wei, M. (2006) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.01.032 · Cited by 800
Why is it so difficult to beat the random walk forecast of exchange rates?
Kilian, L., & Taylor, M. P. (2003) · Journal of International Economics · doi:10.1016/s0022-1996(02)00060-0 · Cited by 783
Kim, H. Y., & Won, C. H. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.002 · Cited by 781
Tests for Forecast Encompassing
Harvey, D. I., Leybourne, S. J., & Newbold, P. (1998) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1998.10524759 · Cited by 775
Good Volatility, Bad Volatility: Signed Jumps and The Persistence of Volatility
Patton, A. J., & Sheppard, K. (2015) · Review of Economics and Statistics · doi:10.1162/rest_a_00503 · Cited by 769
A real-time data set for macroeconomists
Croushore, D., & Stark, T. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00072-0 · Cited by 765
Predicting the Equity Premium with Dividend Ratios
Goyal, A., & Welch, I. (2003) · Management Science · doi:10.1287/mnsc.49.5.639.15149 · Cited by 764
What do we learn from the price of crude oil futures?
Alquist, R., & Kilian, L. (2010) · Journal of Applied Econometrics · doi:10.1002/jae.1159 · Cited by 744
Manager sentiment and stock returns
Jiang, F., Lee, J., Martin, X., & Zhou, G. (2019) · Journal of Financial Economics · doi:10.1016/j.jfineco.2018.10.001 · Cited by 724
Applications of deep learning in stock market prediction: Recent progress
Jiang, W. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115537 · Cited by 714
Empirical exchange rate models of the nineties: Are any fit to survive?
Cheung, Y.-W., Chinn, M. D., & Pascual, A. G. (2005) · Journal of International Money and Finance · doi:10.1016/j.jimonfin.2005.08.002 · Cited by 714
A new index of financial conditions
Koop, G., & Korobilis, D. (2014) · European Economic Review · doi:10.1016/j.euroecorev.2014.07.002 · Cited by 707
Asymptotics for out of sample tests of Granger causality
McCracken, M. W. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.07.020 · Cited by 696
Rosenberg, J. (2002) · Journal of Financial Economics · doi:10.1016/s0304-405x(02)00128-9 · Cited by 685
Financial Crises, Credit Booms, and External Imbalances: 140 Years of Lessons
Jordà, Ò., Schularick, M., & Taylor, A. M. (2011) · IMF Economic Review · doi:10.1057/imfer.2011.8 · Cited by 681
International Stock Return Predictability: What Is the Role of the United States?
RAPACH, D. E., STRAUSS, J. K., & ZHOU, G. (2013) · The Journal of Finance · doi:10.1111/jofi.12041 · Cited by 678
Lago, J., De Ridder, F., & De Schutter, B. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.02.069 · Cited by 642
Wang, L., Zeng, Y., & Chen, T. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.08.018 · Cited by 631
Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes
Liu, L. Y., Patton, A. J., & Sheppard, K. (2015) · Journal of Econometrics · doi:10.1016/j.jeconom.2015.02.008 · Cited by 626
Rapach, D., & Zhou, G. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00006-2 · Cited by 613
Metaheuristic design of feedforward neural networks: A review of two decades of research
Ojha, V. K., Abraham, A., & Snášel, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.013 · Cited by 606
Machine learning in the Chinese stock market
Leippold, M., Wang, Q., & Zhou, W. (2022) · Journal of Financial Economics · doi:10.1016/j.jfineco.2021.08.017 · Cited by 584
Baltagi, B. H. (2008) · Journal of Forecasting · doi:10.1002/for.1047 · Cited by 574
Credit market shocks and economic fluctuations: Evidence from corporate bond and stock markets
Gilchrist, S., Yankov, V., & Zakrajšek, E. (2009) · Journal of Monetary Economics · doi:10.1016/j.jmoneco.2009.03.017 · Cited by 574
Short interest and aggregate stock returns
Rapach, D. E., Ringgenberg, M. C., & Zhou, G. (2016) · Journal of Financial Economics · doi:10.1016/j.jfineco.2016.03.004 · Cited by 571
Forecasting private consumption: survey-based indicators vs. Google trends
Vosen, S., & Schmidt, T. (2011) · Journal of Forecasting · doi:10.1002/for.1213 · Cited by 560
Systemic risk and the macroeconomy: An empirical evaluation
Giglio, S., Kelly, B., & Pruitt, S. (2016) · Journal of Financial Economics · doi:10.1016/j.jfineco.2016.01.010 · Cited by 555
Koopman, S. J., Jungbacker, B., & Hol, E. (2005) · Journal of Empirical Finance · doi:10.1016/j.jempfin.2004.04.009 · Cited by 549
Yang, D., Kleissl, J., Gueymard, C. A., Pedro, H. T. C., & Coimbra, C. F. M. (2018) · Solar Energy · doi:10.1016/j.solener.2017.11.023 · Cited by 548
Is there a turning point in the relationship between income and energy use and/or carbon emissions?
Richmond, A. K., & Kaufmann, R. K. (2006) · Ecological Economics · doi:10.1016/j.ecolecon.2005.01.011 · Cited by 538
Financial time series forecasting using independent component analysis and support vector regression
Lu, C.-J., Lee, T.-S., & Chiu, C.-C. (2009) · Decision Support Systems · doi:10.1016/j.dss.2009.02.001 · Cited by 537
Lago, J., Marcjasz, G., De Schutter, B., & Weron, R. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116983 · Cited by 524
8 Forecast evaluation and combination
Diebold, F. X., & Lopez, J. A. (1996) · Handbook of Statistics · doi:10.1016/s0169-7161(96)14010-4 · Cited by 519
Self-citationComparing Density Forecasts via Weighted Likelihood Ratio Tests
Amisano, G., & Giacomini, R. (2007) · Journal of Business & Economic Statistics · doi:10.1198/073500106000000332 · Cited by 518
Metrics for evaluating performance of prognostic techniques
Saxena, A., Celaya, J., Balaban, E., Goebel, K., Saha, B., Saha, S., & Schwabacher, M. (2008) · 2008 International Conference on Prognostics and Health Management · doi:10.1109/phm.2008.4711436 · Cited by 518
Efficient market hypothesis and forecasting
Timmermann, A., & Granger, C. W. J. (2004) · International Journal of Forecasting · doi:10.1016/s0169-2070(03)00012-8 · Cited by 517
Machine learning advances for time series forecasting
Masini, R. P., Medeiros, M. C., & Mendes, E. F. (2023) · Journal of Economic Surveys · doi:10.1111/joes.12429 · Cited by 515
Forecasting stock market returns: The sum of the parts is more than the whole
Ferreira, M. A., & Santa-Clara, P. (2011) · Journal of Financial Economics · doi:10.1016/j.jfineco.2011.02.003 · Cited by 515
Diebold, F. X. (2015) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2014.983236 · Cited by 496
Self-citationSchlenker, W., Hanemann, W. M., & Fisher, A. C. (2006) · Review of Economics and Statistics · doi:10.1162/rest.2006.88.1.113 · Cited by 510
Neural Networks for Postprocessing Ensemble Weather Forecasts
Rasp, S., & Lerch, S. (2018) · Monthly Weather Review · doi:10.1175/mwr-d-18-0187.1 · Cited by 509
Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules
Gneiting, T., & Ranjan, R. (2011) · Journal of Business & Economic Statistics · doi:10.1198/jbes.2010.08110 · Cited by 507
Kleijnen, J. P. C., & Sargent, R. G. (2000) · European Journal of Operational Research · doi:10.1016/s0377-2217(98)00392-0 · Cited by 491
Paye, B. S. (2012) · Journal of Financial Economics · doi:10.1016/j.jfineco.2012.06.005 · Cited by 484
Forecasting Output and Inflation: The Role of Asset Prices
Stock, J., & Watson, M. (2001) · National Bureau of Economic Research · doi:10.3386/w8180 · Cited by 478
Modeling and forecasting petroleum futures volatility
Sadorsky, P. (2006) · Energy Economics · doi:10.1016/j.eneco.2006.04.005 · Cited by 478
Forecast comparisons in unstable environments
Giacomini, R., & Rossi, B. (2010) · Journal of Applied Econometrics · doi:10.1002/jae.1177 · Cited by 463
Oil price fluctuations and U.S. dollar exchange rates
Lizardo, R. A., & Mollick, A. V. (2010) · Energy Economics · doi:10.1016/j.eneco.2009.10.005 · Cited by 457
Wind Power Forecasts Using Gaussian Processes and Numerical Weather Prediction
Chen, N., Qian, Z., Nabney, I. T., & Meng, X. (2014) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2013.2282366 · Cited by 449
Seto, K. C., & Kaufmann, R. K. (2003) · Land Economics · doi:10.2307/3147108 · Cited by 448
Realising the future: forecasting with high‐frequency‐based volatility (HEAVY) models
Shephard, N., & Sheppard, K. (2010) · Journal of Applied Econometrics · doi:10.1002/jae.1158 · Cited by 436
Machine learning in energy economics and finance: A review
Ghoddusi, H., Creamer, G. G., & Rafizadeh, N. (2019) · Energy Economics · doi:10.1016/j.eneco.2019.05.006 · Cited by 436
Out-of-sample exchange rate predictability with Taylor rule fundamentals
Molodtsova, T., & Papell, D. H. (2009) · Journal of International Economics · doi:10.1016/j.jinteco.2008.11.001 · Cited by 434
Dumitrescu, E., Hué, S., Hurlin, C., & Tokpavi, S. (2022) · European Journal of Operational Research · doi:10.1016/j.ejor.2021.06.053 · Cited by 430
Exchange rates and monetary fundamentals: what do we learn from long-horizon regressions?
Kilian, L. (1999) · Journal of Applied Econometrics · doi:10.1002/(sici)1099-1255(199909/10)14:5<491::aid-jae527>3.0.co;2-d · Cited by 429
Dynamic Conditional Correlation: On Properties and Estimation
Aielli, G. P. (2013) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2013.771027 · Cited by 422
Stock Market Liquidity and the Business Cycle
NÆS, R., SKJELTORP, J. A., & ØDEGAARD, B. A. (2011) · The Journal of Finance · doi:10.1111/j.1540-6261.2010.01628.x · Cited by 417
The three-pass regression filter: A new approach to forecasting using many predictors
Kelly, B., & Pruitt, S. (2015) · Journal of Econometrics · doi:10.1016/j.jeconom.2015.02.011 · Cited by 415
Bond Risk Premiums with Machine Learning
Bianchi, D., Büchner, M., & Tamoni, A. (2021) · The Review of Financial Studies · doi:10.1093/rfs/hhaa062 · Cited by 409
Nominal exchange rates and monetary fundamentals
Mark, N. C., & Sul, D. (2001) · Journal of International Economics · doi:10.1016/s0022-1996(00)00052-0 · Cited by 402
Out-of-Sample Forecast Tests Robust to the Choice of Window Size
Rossi, B., & Inoue, A. (2012) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2012.693850 · Cited by 402
Economic and statistical measures of forecast accuracy
Granger, C. W. J., & Pesaran, M. H. (2000) · Journal of Forecasting · doi:10.1002/1099-131x(200012)19:7<537::aid-for769>3.0.co;2-g · Cited by 399
Oliveira, N., Cortez, P., & Areal, N. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.036 · Cited by 398
A joint econometric model of macroeconomic and term-structure dynamics
Hördahl, P., Tristani, O., & Vestin, D. (2006) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.01.012 · Cited by 381
A deep learning ensemble approach for crude oil price forecasting
Zhao, Y., Li, J., & Yu, L. (2017) · Energy Economics · doi:10.1016/j.eneco.2017.05.023 · Cited by 380
Forecasting tourist arrivals with machine learning and internet search index
Sun, S., Wei, Y., Tsui, K.-L., & Wang, S. (2019) · Tourism Management · doi:10.1016/j.tourman.2018.07.010 · Cited by 379
Empirical Asset Pricing via Machine Learning
Gu, S., Kelly, B., & Xiu, D. (2018) · National Bureau of Economic Research · doi:10.3386/w25398 · Cited by 378
Consistent ranking of volatility models
Hansen, P. R., & Lunde, A. (2006) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.01.005 · Cited by 377
The Declining Equity Premium: What Role Does Macroeconomic Risk Play?
Lettau, M., Ludvigson, S. C., & Wachter, J. A. (2008) · Review of Financial Studies · doi:10.1093/rfs/hhm020 · Cited by 375
Forecasting crude oil market volatility: Further evidence using GARCH-class models
Wei, Y., Wang, Y., & Huang, D. (2010) · Energy Economics · doi:10.1016/j.eneco.2010.07.009 · Cited by 374
Metadata
- Authors
- Diebold, F., & Mariano, R.
- Venue
- National Bureau of Economic Research
- Publisher
- National Bureau of Economic Research
- Published
- 1994-11
- OpenAlex
- W3125696988
- Cited by
- 5,185
- References
- 41
- Type
- report
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.