A new equitable score suitable for verifying precipitation in numerical weather prediction
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
A new equitable score is developed for monitoring precipitation forecasts and for guiding forecast system development. To accommodate the difficult distribution of precipitation, the score measures the error in ‘probability space’ through use of the climatological cumulative distribution function. For sufficiently skilful forecasting systems, the new score is less sensitive to sampling uncertainty than other established scores. It is therefore called here the ‘Stable Equitable Error in Probability Space’ (SEEPS). Weather is partitioned into three categories: ‘dry’, ‘light precipitation’ and ‘heavy precipitation’. SEEPS adapts to the climate of the region in question so that it assesses the salient aspects of the local weather, encouraging ‘refinement’ and discouraging ‘hedging’. To permit continuous monitoring of a system with resolution increasing in time, forecasts are verified against point observations. With some careful choices, observation error and lack of representativeness of model grid‐box averages are found to have relatively little impact. SEEPS can identify key forecasting errors including the overprediction of drizzle, failure to predict heavy large‐scale precipitation and incorrectly locating convective cells. Area averages are calculated taking into account the observation density. A gain of ∼2 days, at lead times of 3–9 days, over the last 14 years is found in extratropical scores of forecasts made at the European Centre for Medium‐Range Weather Forecasts (ECMWF). This gain is due to system improvements, not the increased amount of data assimilated. SEEPS may also be applicable for verifying other quantities that suffer from difficult spatio‐temporal distributions. Copyright © 2010 Royal Meteorological Society
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Forecast verification: Current status and future directions
Casati, B., Wilson, L. J., Stephenson, D. B., Nurmi, P., Ghelli, A., Pocernich, M., Damrath, U., Ebert, E. E., Brown, B. G., & Mason, S. (2008) · Meteorological Applications · doi:10.1002/met.52 · Cited by 306 · cited 1×
“Verification against these data, which are not assimilated at ECMWF, should provide an independent evaluation of performance and a valuable ‘anchor’ to the system (Casati et al., 2008).”
Cited by
The quiet revolution of numerical weather prediction
Bauer, P., Thorpe, A., & Brunet, G. (2015) · Nature · doi:10.1038/nature14956 · Cited by 2,729
Learning skillful medium-range global weather forecasting
Lam, R., Sanchez-Gonzalez, A., Willson, M., Wirnsberger, P., Fortunato, M., Alet, F., Ravuri, S., Ewalds, T., Eaton-Rosen, Z., Hu, W., et al. (2023) · Science · doi:10.1126/science.adi2336 · Cited by 1,466
The Met Office Unified Model Global Atmosphere 7.0/7.1 and JULES Global Land 7.0 configurations
Walters, D., Baran, A. J., Boutle, I., Brooks, M., Earnshaw, P., Edwards, J., Furtado, K., Hill, P., Lock, A., Manners, J., et al. (2019) · Geoscientific Model Development · doi:10.5194/gmd-12-1909-2019 · Cited by 1,129
An evaluation of ERA5 precipitation for climate monitoring
Lavers, D. A., Simmons, A., Vamborg, F., & Rodwell, M. J. (2022) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.4351 · Cited by 488
“We also apply the stable equitable error in probability space (SEEPS) score (Rodwell et al., 2010, 2011; Haiden et al., 2012).”
MethodInfluentialSelf-citationThe Met Office Unified Model Global Atmosphere 6.0/6.1 and JULES Global Land 6.0/6.1 configurations
Walters, D., Boutle, I., Brooks, M., Melvin, T., Stratton, R., Vosper, S., Wells, H., Williams, K., Wood, N., Allen, T., et al. (2017) · Geoscientific Model Development · doi:10.5194/gmd-10-1487-2017 · Cited by 488
Metadata
- Authors
- Rodwell, M. J., Richardson, D. S., Hewson, T. D., & Haiden, T.
- Venue
- Quarterly Journal of the Royal Meteorological Society
- Publisher
- Wiley
- Published
- 2010-07
- Volume
- 136
- Issue
- 650
- Pages
- 1344-1363
- ISSN
- 0035-9009 (ISSN-L)
- 1477-870X
- OpenAlex
- W2059998120
- Cited by
- 95
- References
- 1
- FWCI
- 2.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A new equitable score suitable for verifying precipitation in numerical weather prediction. https://app.cochat.ai/papers/10.1002/qj.656
- The paper
- Rodwell, M. J., Richardson, D. S., Hewson, T. D., & Haiden, T. (2010). A new equitable score suitable for verifying precipitation in numerical weather prediction. Quarterly Journal of the Royal Meteorological Society. https://doi.org/10.1002/qj.656
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.