The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules
Abstract
We propose a method for comparing density forecasts that is based on weighted versions of the continuous ranked probability score. The weighting emphasizes regions of interest, such as the tails or the center of a variable’s range, while retaining propriety, as opposed to a recently developed weighted likelihood ratio test, which can be hedged. Threshold- and quantile-based decompositions of the continuous ranked probability score can be illustrated graphically and provide insight into the strengths and deficiencies of a forecasting method. We illustrate the use of the test and graphical tools in case studies on the Bank of England’s density forecasts of quarterly inflation rates in the United Kingdom, and probabilistic predictions of wind resources in the Pacific Northwest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Generalized autoregressive conditional heteroskedasticity
Bollerslev, T. (1986) · Journal of Econometrics · doi:10.1016/0304-4076(86)90063-1 · Cited by 22,254
Engle, R. F. (1982) · Econometrica · doi:10.2307/1912773 · Cited by 20,795
Koenker, R., & Bassett, G. (1978) · Econometrica · doi:10.2307/1913643 · Cited by 13,316
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Self-citationDiebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
This Time Is Different: Eight Centuries of Financial Folly
REINHART, C. M., & ROGOFF, K. S. (2009) · Princeton University Press eBooks · doi:10.2307/j.ctvcm4gqx · Cited by 2,357
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business and Economic Statistics · doi:10.2307/1392185 · Cited by 2,340
Probabilistic Forecasts, Calibration and Sharpness
Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00587.x · Cited by 1,783
Self-citationTests of Conditional Predictive Ability
Giacomini, R., & White, H. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00718.x · Cited by 1,646
Robust Tests for Heteroscedasticity Based on Regression Quantiles
Koenker, R., & Bassett, G. (1982) · Econometrica · doi:10.2307/1912528 · Cited by 1,629
Evaluating Density Forecasts with Applications to Financial Risk Management
Diebold, F. X., Gunther, T. A., & Tay, A. S. (1998) · International Economic Review · doi:10.2307/2527342 · Cited by 1,452
Dawid, A. P. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981683 · Cited by 1,085 · cited 2×
“To realize their full potential, forecasts ought to be probabilistic in nature, taking the form of probability distributions over future quantities or events (Dawid 1984).”
BackgroundScoring Rules for Continuous Probability Distributions
Matheson, J. E., & Winkler, R. L. (1976) · Management Science · doi:10.1287/mnsc.22.10.1087 · Cited by 957
Trading Wind Generation From Short-Term Probabilistic Forecasts of Wind Power
Pinson, P., Chevallier, C., & Kariniotakis, G. N. (2007) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2007.901117 · Cited by 571
Comparing Density Forecasts via Weighted Likelihood Ratio Tests
Amisano, G., & Giacomini, R. (2007) · Journal of Business & Economic Statistics · doi:10.1198/073500106000000332 · Cited by 518
Time Series Models to Simulate and Forecast Wind Speed and Wind Power
Brown, B. G., Katz, R. W., & Murphy, A. H. (1984) · Journal of Climate and Applied Meteorology · doi:10.1175/1520-0450(1984)023<1184:tsmtsa>2.0.co;2 · Cited by 488
Verification tools for probabilistic forecasts of continuous hydrological variables
Laio, F., & Tamea, S. (2007) · Hydrology and Earth System Sciences · doi:10.5194/hess-11-1267-2007 · Cited by 358
Scoring the Leading Indicators
Diebold, F. X., & Rudebusch, G. D. (1989) · The Journal of Business · doi:10.1086/296467 · Cited by 350
Axiomatic Characterization of the Quadratic Scoring Rule
Selten, R. (1998) · Experimental Economics · doi:10.1007/bf01426214 · Cited by 337
Prediction with a Generalized Cost of Error Function
Granger, C. W. J. (1969) · Journal of the Operational Research Society · doi:10.1057/jors.1969.52 · Cited by 324
Evaluation and Combination of Conditional Quantile Forecasts
Giacomini, R., & Komunjer, I. (2005) · Journal of Business & Economic Statistics · doi:10.1198/073500105000000018 · Cited by 278
Gneiting, T., Larson, K., Westrick, K., Genton, M. G., & Aldrich, E. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000456 · Cited by 246
Self-citationElliott, G., & Timmermann, A. (2008) · Journal of Economic Literature · doi:10.1257/jel.46.1.3 · Cited by 228
Scoring rules and the evaluation of probabilities
Winkler, R. L., Muñoz, J., Cervera, J. L., Bernardo, J. M., Blattenberger, G., Kadane, J. B., Lindley, D. V., Murphy, A. H., Oliver, R. M., & Ríos-Insua, D. (1996) · Test · doi:10.1007/bf02562681 · Cited by 227
Mitchell, J., & Hall, S. G. (2005) · Oxford Bulletin of Economics and Statistics · doi:10.1111/j.1468-0084.2005.00149.x · Cited by 208
Time-Varying Combinations of Predictive Densities Using Nonlinear Filtering
Billio, M., Casarin, R., Ravazzolo, F., & van Dijk, H. K. (2012) · Journal of Econometrics · doi:10.1016/j.jeconom.2013.04.009 · Cited by 179
Chi-squared tests of interval and density forecasts, and the Bank of England’s fan charts
Wallis, K. F. (2002) · International Journal of Forecasting · doi:10.1016/s0169-2070(02)00009-2 · Cited by 177
Further results on forecasting and model selection under asymmetric loss
Christoffersen, P. F., & Diebold, F. X. (1996) · Journal of Applied Econometrics · doi:10.1002/(sici)1099-1255(199609)11:5<561::aid-jae406>3.0.co;2-s · Cited by 170
Comparing density forecast models
Bao, Y., Lee, T., & Saltoğlu, B. (2007) · Journal of Forecasting · doi:10.1002/for.1023 · Cited by 170
Editorial: Probabilistic Forecasting
Gneiting, T. (2008) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2007.00522.x · Cited by 137
Self-citationEvaluating the Bank of England Density Forecasts of Inflation
Clements, M. P. (2004) · The Economic Journal · doi:10.1111/j.1468-0297.2004.00246.x · Cited by 128
Predictive density and conditional confidence interval accuracy tests
Corradi, V., & Swanson, N. R. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2005.07.026 · Cited by 117
How to Assess Prognostic Models for Survival Data: A Case Study in Oncology
Schumacher, M. C., Graf, E., & Gerds, T. A. (2003) · Methods of Information in Medicine · doi:10.1055/s-0038-1634384 · Cited by 56
Research works printed but not linked: 4
- Corradi V., 2006, C. W. J. Granger, G. Elliott, and A. Timmermann, Amsterdam: North-Holland, pp., 197
- Selten R., 1998, Experimental Economics, 1, 43, 10.1023/A:1009957816843 · doi:10.1023/a:1009957816843 · Paper page
- 10.1002/1099-131X(200007)19:4<231::AID-FOR771>3.0.CO;2-# · doi:10.1002/1099-131x(200007)19:4<231::aid-for771>3.0.co;2-#
- 10.1177/002795010418900107 · DOI
Cited by
Gneiting, T., & Katzfuss, M. (2014) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-062713-085831 · Cited by 888
Self-citationZiegel, J. F. (2016) · Mathematical Finance · doi:10.1111/mafi.12080 · Cited by 353
Copula Methods for Forecasting Multivariate Time Series
Patton, A. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-62731-5.00016-6 · Cited by 320
Clark, T. E., & Ravazzolo, F. (2015) · Journal of Applied Econometrics · doi:10.1002/jae.2379 · Cited by 317
Evaluating epidemic forecasts in an interval format
Bracher, J., Ray, E. L., Gneiting, T., & Reich, N. G. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008618 · Cited by 285
Self-citation
Metadata
- Authors
- Gneiting, T., & Ranjan, R.
- Venue
- Journal of Business & Economic Statistics
- Publisher
- Informa UK Limited
- Published
- 2011-07
- Volume
- 29
- Issue
- 3
- Pages
- 411-422
- ISSN
- 0735-0015 (ISSN-L)
- 1537-2707
- OpenAlex
- W2065089656
- Cited by
- 507
- References
- 33
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.