Estimation of Seasonal Precipitation Tercile-Based Categorical Probabilities from Ensembles
Open accessAbstract
Ensemble simulations and forecasts provide probabilistic information about the inherently uncertain climate system. Counting the number of ensemble members in a category is a simple nonparametric method of using an ensemble to assign categorical probabilities. Parametric methods of assigning quantile-based categorical probabilities include distribution fitting and generalized linear regression. Here the accuracy of counting and parametric estimates of tercile category probabilities is compared. The methods are first compared in an idealized setting where analytical results show how ensemble size and level of predictability control the accuracy of both methods. The authors also show how categorical probability estimate errors degrade the rank probability skill score. The analytical results provide a good description of the behavior of the methods applied to seasonal precipitation from a 53-yr, 79-member ensemble of general circulation model simulations. Parametric estimates of seasonal precipitation tercile category probabilities are generally more accurate than the counting estimate. In addition to determining the relative accuracies of the different methods, the analysis quantifies the relative importance of the ensemble mean and variance in determining tercile probabilities. Ensemble variance is shown to be a weak factor in determining seasonal precipitation probabilities, meaning that differences between the tercile probabilities and the equal-odds probabilities are due mainly to shifts of the forecast mean away from its climatological value.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The result that ensemble-mean variations dominate is consistent with conclusions from other recent studies of other forecast variables.
“This finding is consistent with the conclusions of other recent studies of other forecast variables (Kharin and Zwiers 2003;Hamill et al. 2004;Tippett et al. 2007;Tang et al. 2007).”
From Skill of Multimodel ENSO Probability Forecasts (2008) · cites this paper as Tippett et al. 2007
Regressing ensemble-mean values against uncalibrated model probabilities can lower the sampling variance that arises from a finite ensemble.
“Such a regression can serve to reduce the sampling variance of the counting probability estimate because of finite ensemble size (Tippett et al. 2007).”
From Skill of Multimodel ENSO Probability Forecasts (2008) · cites this paper as Tippett et al. 2007
For a perfectly reliable forecast system, RPSS depends on ensemble size N according to the relationship given in the paper.
“Generalizing the results of Richardson (2001) and Tippett et al. (2007), the RPSS of a perfectly reliable forecast system depends on ensemble size N according to (see appendix B for details):”
From Skill of Multimodel ENSO Probability Forecasts (2008) · cites this paper as Tippett et al. (2007)
The dependence of RPSS on ensemble size is known for a perfectly reliable model.
“The dependence of RPSS on ensemble size is known for a perfectly reliable model (Tippett et al. 2007).”
From Skill of Multimodel ENSO Probability Forecasts (2008) · cites this paper as Tippett et al. 2007
Tippett et al. (2007) generalized the Brier score result to RPS for reliable tercile-category probability forecasts.
“Tippett et al. (2007) generalized this result to RPS of reliable forecasts of tercile category probabilities.”
From Skill of Multimodel ENSO Probability Forecasts (2008) · cites this paper as Tippett et al. (2007)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Richardson, D. S. (2001) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712757715 · Cited by 212 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- --, and M. K. Tippett, 2007: Predictability, information theory, and stochastic models. Rev. Geophys., in press.
- Tippett, M. K., R. Kleeman, and Y. Tang, 2004: Measuring the potential utility of seasonal climate predictions. Geophys. Res. Lett., 31, L22201, doi:10.1029/2004GL021575. · DOI
Cited by
Sorted by citations
The Discrete Brier and Ranked Probability Skill Scores
Weigel, A. P., Liniger, M. A., & Appenzeller, C. (2007) · Monthly Weather Review · doi:10.1175/mwr3280.1 · Cited by 254 · see citing works
Seasonal ensemble forecasts: Are recalibrated single models better than multimodels?
Weigel, A. P., Liniger, M. A., & Appenzeller, C. (2009) · Monthly Weather Review · doi:10.1175/2008mwr2773.1 · Cited by 66 · see citing works
Skill of Multimodel ENSO Probability Forecasts
Tippett, M. K., & Barnston, A. G. (2008) · Monthly Weather Review · doi:10.1175/2008mwr2431.1 · Cited by 64 · see citing works
Self-citation
- Authors
- Tippett, M. K., Barnston, A. G., & Robertson, A. W.
- Affiliations
- Columbia University (US)
- Venue
- Journal of Climate
- Publisher
- American Meteorological Society
- Published
- 2007-05-15
- Volume
- 20
- Issue
- 10
- Pages
- 2210-2228
- ISSN
- 0894-8755 (ISSN-L)
- 1520-0442
- OpenAlex
- W2003594670
- Cited by
- 69
- References
- 1
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 1 · 2023: 7 · 2022: 8 · 2021: 3 · 2020: 1 · 2019: 4 · 2018: 3 · 2017: 4 · 2016: 3 · 2015: 2 · 2014: 4 · 2013: 3 · 2012: 2
- FWCI
- 3.63
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Climate (publishedVersion)
- Columbia Academic Commons (Columbia University)
- Funders
- National Oceanic and Atmospheric Administration (NA07GP0213)
- Goddard Space Flight Center
- Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Physical Sciences › Environmental Science › Water Science and Technology › Hydrology and Watershed Management Studies
- Keywords
- seasonal rainfall, ensemble forecasting, ensemble size, predictability, ensemble variance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review