Neural Networks for Postprocessing Ensemble Weather Forecasts
Open accessThe DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
Ensemble weather predictions require statistical postprocessing of systematic errors to obtain reliable and accurate probabilistic forecasts. Traditionally, this is accomplished with distributional regression models in which the parameters of a predictive distribution are estimated from a training period. We propose a flexible alternative based on neural networks that can incorporate nonlinear relationships between arbitrary predictor variables and forecast distribution parameters that are automatically learned in a data-driven way rather than requiring prespecified link functions. In a case study of 2-m temperature forecasts at surface stations in Germany, the neural network approach significantly outperforms benchmark postprocessing methods while being computationally more affordable. Key components to this improvement are the use of auxiliary predictor variables and station-specific information with the help of embeddings. Furthermore, the trained neural network can be used to gain insight into the importance of meteorological variables, thereby challenging the notion of neural networks as uninterpretable black boxes. Our approach can easily be extended to other statistical postprocessing and forecasting problems. We anticipate that recent advances in deep learning combined with the ever-increasing amounts of model and observation data will transform the postprocessing of numerical weather forecasts in the coming decade.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
(2016) · Cited by 11,679
Statistical Methods in the Atmospheric Sciences
Ramsey, P. H. (1996) · Technometrics · doi:10.1080/00401706.1996.10484553 · Cited by 7,601
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Diebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1995.10524599 · Cited by 5,130
The quiet revolution of numerical weather prediction
Bauer, P., Thorpe, A., & Brunet, G. (2015) · Nature · doi:10.1038/nature14956 · Cited by 2,729
ggmap: Spatial Visualization with ggplot2
Kahle, D., & Wickham, H. (2013) · The R Journal · doi:10.32614/rj-2013-014 · Cited by 2,119
Using Bayesian model averaging to calibrate forecast ensembles.
Raftery, A. E., Gneiting, T., Balabdaoui, F., & Polakowski, M. (2005) · Monthly Weather Review · doi:10.1175/mwr2906.1 · Cited by 1,915 · cited 1×
“The two most prominent approaches for probabilistic forecasts, Bayesian model averaging (BMA; Raftery et al., 2005) and non-homogeneous regression, also referred to as ensemble model output statistics (EMOS; Gneiting et al., 2005), rely on parametric forecast distributions.”
BackgroundAthey, S., Tibshirani, J., & Wager, S. (2019) · The Annals of Statistics · doi:10.1214/18-aos1709 · Cited by 1,870
Probabilistic Forecasts, Calibration and Sharpness
Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00587.x · Cited by 1,783
Meinshausen, N. (2006) · Cited by 1,521
Deep learning for computational biology
Angermueller, C., Pärnamaa, T., Parts, L., & Stegle, O. (2016) · Molecular Systems Biology · doi:10.15252/msb.20156651 · Cited by 1,473 · cited 1×
“Over the past decade many fields, most notably computer vision and natural language processing (LeCun et al., 2015), but also biology, physics and chemistry (Angermueller et al., 2016; Goh et al., 2017) have been transformed by neural networks.”
BackgroundGneiting, T., Raftery, A. E., Westveld, A. H., & Goldman, T. (2005) · Monthly Weather Review · doi:10.1175/mwr2904.1 · Cited by 1,142
Deep learning to represent subgrid processes in climate models
Rasp, S., Pritchard, M. S., & Gentine, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1810286115 · Cited by 1,044
Self-citationKeras: The Python Deep Learning library
Chollet, F. (2018) · Astrophysics Source Code Library · Cited by 1,002
Good, I. J. (1952) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1952.tb00104.x · Cited by 976
Scoring Rules for Continuous Probability Distributions
Matheson, J. E., & Winkler, R. L. (1976) · Management Science · doi:10.1287/mnsc.22.10.1087 · Cited by 957
Wilks, D. S. (2016) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-15-00267.1 · Cited by 895
Interpretation of Rank Histograms for Verifying Ensemble Forecasts
Hamill, T. M. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<0550:iorhfv>2.0.co;2 · Cited by 892
Deep learning for computational chemistry
Goh, G. B., Hodas, N. O., & Vishnu, A. (2017) · Journal of Computational Chemistry · doi:10.1002/jcc.24764 · Cited by 809
Neural Networks and Deep Learning
(2016) · Computer Age Statistical Inference · doi:10.1017/cbo9781316576533.019 · Cited by 509
The THORPEX Interactive Grand Global Ensemble
Bougeault, P., Toth, Z., Bishop, C., Brown, B., Burridge, D., Chen, D. H., Ebert, B., Fuentes, M., Hamill, T. M., Mylne, K., et al. (2010) · Bulletin of the American Meteorological Society · doi:10.1175/2010bams2853.1 · Cited by 499
Could Machine Learning Break the Convection Parameterization Deadlock?
Gentine, P., Pritchard, M., Rasp, S., Reinaudi, G., & Yacalis, G. (2018) · Geophysical Research Letters · doi:10.1029/2018gl078202 · Cited by 497 · cited 1×
“For comparative model assessment, proper scoring rules allow simultaneous evaluation of calibration and sharpness (Gneiting and Raftery, 2007).”
BackgroundSelf-citationUsing Artificial Intelligence to Improve Real-Time Decision-Making for High-Impact Weather
McGovern, A., Elmore, K. L., Gagne, D. J., Haupt, S. E., Karstens, C. D., Lagerquist, R., Smith, T., & Williams, J. K. (2017) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-16-0123.1 · Cited by 443
Neural Networks and Deep Learning: A Textbook
Aggarwal, C. C. (2018) · doi:10.1007/978-3-319-94463-0 · Cited by 417
Taylor, J. W. (2000) · Journal of Forecasting · doi:10.1002/1099-131x(200007)19:4<299::aid-for775>3.0.co;2-v · Cited by 386
Statistical Methods in the Atmospheric Sciences
Levine, R. A., & Wilks, D. S. (2000) · Journal of the American Statistical Association · doi:10.2307/2669579 · Cited by 321
Wang, F., Mi, Z., Su, S., & Zhao, H. (2012) · Energies · doi:10.3390/en5051355 · Cited by 317
Entity Embeddings of Categorical Variables
Guo, C., & Berkhahn, F. (2016) · arXiv · doi:10.48550/arxiv.1604.06737 · Cited by 308
Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets
Liu, Y., Racah, E., Prabhat, Correa, J., Khosrowshahi, A., Lavers, D. A., Kunkel, K. E., Wehner, M. F., & Collins, W. D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01156 · Cited by 292
Thorarinsdottir, T. L., & Gneiting, T. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2009.00616.x · Cited by 262
Uncertainty Quantification in Complex Simulation Models Using Ensemble Copula Coupling
Schefzik, R., Thorarinsdottir, T. L., & Gneiting, T. (2013) · Statistical Science · doi:10.1214/13-sts443 · Cited by 257
Calibrated Ensemble Forecasts Using Quantile Regression Forests and Ensemble Model Output Statistics
Taillardat, M., Mestre, O., Zamo, M., & Naveau, P. (2016) · Monthly Weather Review · doi:10.1175/mwr-d-15-0260.1 · Cited by 245
Scheuerer, M., & Hamill, T. M. (2015) · Monthly Weather Review · doi:10.1175/mwr-d-15-0061.1 · Cited by 238
Wilks, D. S. (2011) · International Geophysics · doi:10.1016/b978-0-12-385022-5.00001-4 · Cited by 233
Evaluating Probabilistic Forecasts with scoringRules
Jordan, A., Krüger, F., & Lerch, S. (2019) · Journal of Statistical Software · doi:10.18637/jss.v090.i12 · Cited by 227
Self-citationHybrid intra-hour DNI forecasts with sky image processing enhanced by stochastic learning
Chu, Y., Pedro, H. T. C., & Coimbra, C. F. M. (2013) · Solar Energy · doi:10.1016/j.solener.2013.10.020 · Cited by 180
Gagne, D. J., McGovern, A., Haupt, S. E., Sobash, R. A., Williams, J. K., & Xue, M. (2017) · Weather and Forecasting · doi:10.1175/waf-d-17-0010.1 · Cited by 169
Probabilistic quantitative precipitation forecasting using Ensemble Model Output Statistics
Scheuerer, M. (2014) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.2183 · Cited by 165
D’Isanto, A., & Polsterer, K. L. (2018) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201731326 · Cited by 165
Baran, S., & Lerch, S. (2015) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.2521 · Cited by 150
Self-citationComparison of non-homogeneous regression models for probabilistic wind speed forecasting
Lerch, S., & Thorarinsdottir, T. L. (2013) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v65i0.21206 · Cited by 139
Self-citationMachine Learning for Real-Time Prediction of Damaging Straight-Line Convective Wind
Lagerquist, R., McGovern, A., & Smith, T. (2017) · Weather and Forecasting · doi:10.1175/waf-d-17-0038.1 · Cited by 120
Trends in the predictive performance of raw ensemble weather forecasts
Hemri, S., Scheuerer, M., Pappenberger, F., Bogner, K., & Haiden, T. (2014) · Geophysical Research Letters · doi:10.1002/2014gl062472 · Cited by 114
Nonhomogeneous Boosting for Predictor Selection in Ensemble Postprocessing
Messner, J. W., Mayr, G. J., & Zeileis, A. (2016) · Monthly Weather Review · doi:10.1175/mwr-d-16-0088.1 · Cited by 112
Probabilistic wind speed forecasting on a grid based on ensemble model output statistics
Scheuerer, M., & Möller, D. (2015) · The Annals of Applied Statistics · doi:10.1214/15-aoas843 · Cited by 103
Forest-Based and Semiparametric Methods for the Postprocessing of Rainfall Ensemble Forecasting
Taillardat, M., Fougères, A., Naveau, P., & Mestre, O. (2019) · Weather and Forecasting · doi:10.1175/waf-d-18-0149.1 · Cited by 102
Heteroscedastic Censored and Truncated Regression with crch
Messner, J. W., Georg, J. M., & Zeileis, A. (2016) · The R Journal · doi:10.32614/rj-2016-012 · Cited by 102
Gagne, D. J., McGovern, A., & Xue, M. (2014) · Weather and Forecasting · doi:10.1175/waf-d-13-00108.1 · Cited by 96
Distributional regression forests for probabilistic precipitation forecasting in complex terrain
Schlosser, L., Hothorn, T., Stauffer, R., & Zeileis, A. (2019) · The Annals of Applied Statistics · doi:10.1214/19-aoas1247 · Cited by 95
Mixture EMOS model for calibrating ensemble forecasts of wind speed
Baran, S., & Lerch, S. (2016) · Environmetrics · doi:10.1002/env.2380 · Cited by 84
Self-citationCombining predictive distributions for the statistical post-processing of ensemble forecasts
Baran, S., & Lerch, S. (2018) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2018.01.005 · Cited by 81
Self-citationExtending Extended Logistic Regression: Extended versus Separate versus Ordered versus Censored
Messner, J. W., Mayr, G. J., Wilks, D. S., & Zeileis, A. (2014) · Monthly Weather Review · doi:10.1175/mwr-d-13-00355.1 · Cited by 79
Similarity-Based Semilocal Estimation of Post-Processing Models
Lerch, S., & Baran, S. (2016) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/rssc.12153 · Cited by 66
Self-citationDistribution to Distribution Regression
Oliva, J. B., Póczos, B., & Schneider, J. (2018) · Figshare · doi:10.1184/r1/6475571 · Cited by 53
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2005) · doi:10.21236/ada454828 · Cited by 50
Discrete Postprocessing of Total Cloud Cover Ensemble Forecasts
Hemri, S., Haiden, T., & Pappenberger, F. (2016) · Monthly Weather Review · doi:10.1175/mwr-d-15-0426.1 · Cited by 33
Probabilistic Forecasting and Comparative Model Assessment Based on Markov Chain Monte Carlo OutputPreprint
Krüger, F., Lerch, S., Thorarinsdottir, T. L., & Gneiting, T. (2016) · arXiv (Cornell University) · Cited by 24
Self-citationSkewed logistic distribution for statistical temperature post-processing in mountainous areas
Gebetsberger, M., Stauffer, R., Mayr, G. J., & Zeileis, A. (2019) · Advances in statistical climatology, meteorology and oceanography · doi:10.5194/ascmo-5-87-2019 · Cited by 17
Distribution Regression Network.
Kou, C. K. L., Lee, H. K., & Ng, T. K. (2018) · Cited by 1
Cited by
Deep Learning for Spatio-Temporal Data Mining: A Survey
Wang, S., Cao, J., & Yu, P. S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3025580 · Cited by 822
A review of machine learning applications in wildfire science and management
Jain, P., Coogan, S. C. P., Subramanian, S. G., Crowley, M., Taylor, S., & Flannigan, M. D. (2020) · Environmental Reviews · doi:10.1139/er-2020-0019 · Cited by 765
WeatherBench: A Benchmark Data Set for Data‐Driven Weather Forecasting
Rasp, S., Dueben, P. D., Scher, S., Weyn, J. A., Mouatadid, S., & Thuerey, N. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002203 · Cited by 663
Self-citationCan deep learning beat numerical weather prediction?
Schultz, M. G., Betancourt, C., Gong, B., Kleinert, F., Langguth, M., Leufen, L. H., Mozaffari, A., & Stadtler, S. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0097 · Cited by 562
Neural general circulation models for weather and climate
Kochkov, D., Yuval, J., Langmore, I., Norgaard, P., Smith, J., Mooers, G., Klöwer, M., Lottes, J., Rasp, S., Düben, P., et al. (2024) · Nature · doi:10.1038/s41586-024-07744-y · Cited by 454
“Our stochastic loss is based on the CRPS 28,48,49 .”
MethodSelf-citation
Metadata
- Authors
- Rasp, S., & Lerch, S.
- Venue
- Monthly Weather Review
- Publisher
- American Meteorological Society
- Published
- 2018-11
- Volume
- 146
- Issue
- 11
- Pages
- 3885-3900
- ISSN
- 0027-0644 (ISSN-L)
- 1520-0493
- OpenAlex
- W2803408063
- Cited by
- 509
- References
- 69
- FWCI
- 19.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.