The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Evaluation of probabilistic prediction systems for a scalar variable
Abstract
A systematic study is performed of a number of scores that can be used for objective validation of probabilistic prediction of scalar variables: Rank Histograms, Discrete and Continuous Ranked Probability Scores (DRPS and CRPS, respectively). The reliability‐resolution‐uncertainty decomposition, defined by Murphy for the DRPS, and extended here to the CRPS, is studied in detail. The decomposition is applied to the results of the Ensemble Prediction Systems of the European Centre for Medium‐range Weather Forecasts and the National Centers for Environmental Prediction. Comparison is made with the decomposition of the CRPS defined by Hersbach. The possibility of determining an accurate reliability‐resolution decomposition of the RPSs is severely limited by the unavoidably (relatively) small number of available realizations of the prediction system. The Hersbach decomposition may be an appropriate compromise between the competing needs for accuracy and practical computability. Copyright © 2005 Royal Meteorological Society.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ECMWF Ensemble Prediction System: Methodology and validation
Molteni, F., Buizza, R., Palmer, T. N., & Petroliagis, T. (1996) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712252905 · Cited by 1,616
Decomposition of the Continuous Ranked Probability Score for Ensemble Prediction Systems
Hersbach, H. (2000) · Weather and Forecasting · doi:10.1175/1520-0434(2000)015<0559:dotcrp>2.0.co;2 · Cited by 1,531
Ensemble Forecasting at NCEP and the Breeding Method
Toth, Z., & Kalnay, E. (1997) · Monthly Weather Review · doi:10.1175/1520-0493(1997)125<3297:efanat>2.0.co;2 · Cited by 1,063
Interpretation of Rank Histograms for Verifying Ensemble Forecasts
Hamill, T. M. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<0550:iorhfv>2.0.co;2 · Cited by 892
A Comparison of the ECMWF, MSC, and NCEP Global Ensemble Prediction Systems
Buizza, R., Houtekamer, P. L., Pellerin, G., Toth, Z., Zhu, Y., & Wei, M. (2005) · Monthly Weather Review · doi:10.1175/mwr2905.1 · Cited by 630
A Scoring System for Probability Forecasts of Ranked Categories
Epstein, E. S. (1969) · Journal of Applied Meteorology · doi:10.1175/1520-0450(1969)008<0985:assfpf>2.0.co;2 · Cited by 563
A Method for Producing and Evaluating Probabilistic Forecasts from Ensemble Model Integrations
Anderson, J. L. (1996) · Journal of Climate · doi:10.1175/1520-0442(1996)009<1518:amfpae>2.0.co;2 · Cited by 487
A Note on the Ranked Probability Score
Murphy, A. H. (1971) · Journal of applied meteorology · doi:10.1175/1520-0450(1971)010<0155:anotrp>2.0.co;2 · Cited by 186
Scalar and Vector Partitions of the Probability Score: Part I. Two-State Situation
Murphy, A. H. (1972) · Journal of applied meteorology · doi:10.1175/1520-0450(1972)011<0273:savpot>2.0.co;2 · Cited by 122
On the “Ranked Probability Score”
Murphy, A. H. (1969) · Journal of applied meteorology · doi:10.1175/1520-0450(1969)008<0988:otps>2.0.co;2 · Cited by 94
Cited by
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Probabilistic Forecasts, Calibration and Sharpness
Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00587.x · Cited by 1,783
Leutbecher, M., & Palmer, T. N. (2008) · Journal of Computational Physics · doi:10.1016/j.jcp.2007.02.014 · Cited by 886
Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation
Houtekamer, P. L., & Zhang, F. (2016) · Monthly Weather Review · doi:10.1175/mwr-d-15-0440.1 · Cited by 674
Predictive Model Assessment for Count Data
Czado, C., Gneiting, T., & Held, L. (2009) · Biometrics · doi:10.1111/j.1541-0420.2009.01191.x · Cited by 464
Metadata
- Authors
- Candille, G., & Talagrand, O.
- Venue
- Quarterly Journal of the Royal Meteorological Society
- Publisher
- Wiley
- Published
- 2005-07
- Volume
- 131
- Issue
- 609
- Pages
- 2131-2150
- ISSN
- 0035-9009 (ISSN-L)
- 1477-870X
- OpenAlex
- W2124395162
- Cited by
- 295
- References
- 17
- FWCI
- 7.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of probabilistic prediction systems for a scalar variable. https://app.cochat.ai/papers/10.1256/qj.04.71
- The paper
- Candille, G., & Talagrand, O. (2005). Evaluation of probabilistic prediction systems for a scalar variable. Quarterly Journal of the Royal Meteorological Society. https://doi.org/10.1256/qj.04.71
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.