Statistical Postprocessing for Weather Forecasts: Review, Challenges, and Avenues in a Big Data World
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Statistical postprocessing techniques are nowadays key components of the forecasting suites in many national meteorological services (NMS), with, for most of them, the objective of correcting the impact of different types of errors on the forecasts. The final aim is to provide optimal, automated, seamless forecasts for end users. Many techniques are now flourishing in the statistical, meteorological, climatological, hydrological, and engineering communities. The methods range in complexity from simple bias corrections to very sophisticated distribution-adjusting techniques that incorporate correlations among the prognostic variables. The paper is an attempt to summarize the main activities going on in this area from theoretical developments to operational applications, with a focus on the current challenges and potential avenues in the field. Among these challenges is the shift in NMS toward running ensemble numerical weather prediction (NWP) systems at the kilometer scale that produce very large datasets and require high-density high-quality observations, the necessity to preserve space–time correlation of high-dimensional corrected fields, the need to reduce the impact of model changes affecting the parameters of the corrections, the necessity for techniques to merge different types of forecasts and ensembles with different behaviors, and finally the ability to transfer research on statistical postprocessing to operations. Potential new avenues are also discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · cited 2×
“t al. (2019). Taillardat et al. (2016) propose a post processing model using quantile regression forests, a quantile regression method where predictive quantiles are computed based on random forests (Breiman, 2001; Meinshausen, 2006). Random forest methods have been used in a variety of postprocessing applications (Ga…”
MethodStrictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Generalized additive models for location, scale and shape.
Rigby, R. A., & Stasinopoulos, D. M. (2005) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2005.00510.x · Cited by 3,228 · cited 2×
“(2019) use generalized additive models where the parameters of a forecast distribution from a wide range of distributional families with parameterizations corresponding to location, scale, and shape are flexibly modeled as additive functions of the predictors (Rigby and Stasinopoulos 2005).”
BackgroundThe quiet revolution of numerical weather prediction
Bauer, P., Thorpe, A., & Brunet, G. (2015) · Nature · doi:10.1038/nature14956 · Cited by 2,729 · cited 1×
“In conjunction, the quality of the forecasts has been constantly improving with current forecasts deemed useful even beyond 15 days (Buizza and Leutbecher 2015; Bauer et al. 2015; Van Straaten et al. 2020).”
BackgroundUsing Bayesian model averaging to calibrate forecast ensembles.
Raftery, A. E., Gneiting, T., Balabdaoui, F., & Polakowski, M. (2005) · Monthly Weather Review · doi:10.1175/mwr2906.1 · Cited by 1,915 · cited 1×
“Distribution-based postprocessing approaches specify a parametric model for the forecast distribution by selecting a suitable family of probability distributions depending on the variable of interest (Gneiting et al. 2005; Raftery et al. 2005).”
MethodProbabilistic Forecasts, Calibration and Sharpness
Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00587.x · Cited by 1,783
Gneiting, T., Raftery, A. E., Westveld, A. H., & Goldman, T. (2005) · Monthly Weather Review · doi:10.1175/mwr2904.1 · Cited by 1,142
Bottou, L., & Vapnik, V. (1992) · Neural Computation · doi:10.1162/neco.1992.4.6.888 · Cited by 542 · cited 2×
“sting of similar past forecast cases may allow the use of simpler models that are better adapted to the current conditions, and are closely related to local modeling methods in statistics (see, e.g., Bottou and Vapnik, 1992; Loader, 1999). Other nonparametric post- processing methods use various direct transformations…”
MethodAtmospheric predictability experiments with a large numerical model
Lorenz, E. N. (1982) · Tellus A: Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v34i6.10836 · Cited by 450 · cited 1×
“Model structural errors include a missing or poor representation of subgrid dynamical and physical processes and inaccuracies associated with the numerical scheme (Lorenz 1982; Nicolis et al. 2009).”
BackgroundDoblas-Reyes, F. J., Hagedorn, R., & Palmer, T. N. (2005) · Tellus A: Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v57i3.14658 · Cited by 340
Introduction to the special issue on “25 years of ensemble forecasting”
Buizza, R. (2019) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3370 · Cited by 102
Cited by
Forecast combinations: An over 50-year review
Wang, X., Hyndman, R. J., Li, F., & Kang, Y. (2023) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2022.11.005 · Cited by 280
Materia, S., García, L. P., van Straaten, C., O, S., Mamalakis, A., Cavicchia, L., Coumou, D., de Luca, P., Kretschmer, M., & Donat, M. (2024) · WIREs Climate Change · doi:10.1002/wcc.914 · Cited by 130
“Current ML techniques can learn non-linear relations (Haupt et al., 2021; Schulz & Lerch, 2022; Vannitsem et al., 2021) and thus apply corrections depending on the weather conditions in which an extreme is occurring.”
Improving the prediction of the Madden–Julian Oscillation of the ECMWF model by post-processing
Silini, R., Lerch, S., Mastrantonas, N., Kantz, H., Barreiro, M., & Masoller, C. (2022) · Earth System Dynamics · doi:10.5194/esd-13-1157-2022 · Cited by 12
Self-citation
Metadata
- Authors
- Vannitsem, S., Bremnes, J. B., Demaeyer, J., Evans, G. R., Flowerdew, J., Hemri, S., Lerch, S., Roberts, N., Theis, S., Atencia, A., Ben Bouallègue, Z., Bhend, J., Dabernig, M., De Cruz, L., Hieta, L., Mestre, O., Moret, L., Plenković, I. O., Schmeits, M., Taillardat, M., Van den Bergh, J., Van Schaeybroeck, B., Whan, K., & Ylhaisi, J.
- Venue
- Bulletin of the American Meteorological Society
- Publisher
- American Meteorological Society
- Published
- 2021-03
- Volume
- 102
- Issue
- 3
- Pages
- E681-E699
- ISSN
- 0003-0007 (ISSN-L)
- 1520-0477
- OpenAlex
- W3016791436
- Cited by
- 206
- References
- 11
- FWCI
- 6.74
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.