The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Data‐Driven Medium‐Range Weather Prediction With a Resnet Pretrained on Climate Simulations: A New Model for WeatherBench
Open accessAbstract
Numerical weather prediction has traditionally been based on the models that discretize the dynamical and physical equations of the atmosphere. Recently, however, the rise of deep learning has created increased interest in purely data‐driven medium‐range weather forecasting with first studies exploring the feasibility of such an approach. To accelerate progress in this area, the WeatherBench benchmark challenge was defined. Here, we train a deep residual convolutional neural network (Resnet) to predict geopotential, temperature and precipitation at 5.625° resolution up to 5 days ahead. To avoid overfitting and improve forecast skill, we pretrain the model using historical climate model output before fine‐tuning on reanalysis data. The resulting forecasts outperform previous submissions to WeatherBench and are comparable in skill to a physical baseline at similar resolution. We also analyze how the neural network creates its predictions and find that, for the case studies analyzed, the model has learned physically reasonable correlations. Finally, we perform scaling experiments to estimate the potential skill of data‐driven approaches at higher resolutions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz‐Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., et al. (2020) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3803 · Cited by 31,882
Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J., & Taylor, K. E. (2016) · Geoscientific Model Development · doi:10.5194/gmd-9-1937-2016 · Cited by 11,981
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
The quiet revolution of numerical weather prediction
Bauer, P., Thorpe, A., & Brunet, G. (2015) · Nature · doi:10.1038/nature14956 · Cited by 2,729
The Art and Science of Climate Model Tuning
Hourdin, F., Mauritsen, T., Gettelman, A., Golaz, J.-C., Balaji, V., Duan, Q., Folini, D., Ji, D., Klocke, D., Qian, Y., et al. (2017) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-15-00135.1 · Cited by 611
Deep double descent: where bigger models and more data hurt*
Nakkiran, P., Kaplun, G., Bansal, Y., Yang, T., Barak, B., & Sutskever, I. (2021) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/ac3a74 · Cited by 565
Cited by
Learning skillful medium-range global weather forecasting
Lam, R., Sanchez-Gonzalez, A., Willson, M., Wirnsberger, P., Fortunato, M., Alet, F., Ravuri, S., Ewalds, T., Eaton-Rosen, Z., Hu, W., et al. (2023) · Science · doi:10.1126/science.adi2336 · Cited by 1,466
FuXi: a cascade machine learning forecasting system for 15-day global weather forecast
Chen, L., Zhong, X., Zhang, F., Cheng, Y., Xu, Y., Qi, Y., & Li, H. (2023) · npj Climate and Atmospheric Science · doi:10.1038/s41612-023-00512-1 · Cited by 367
Towards neural Earth system modelling by integrating artificial intelligence in Earth system science
Irrgang, C., Boers, N., Sonnewald, M., Barnes, E. A., Kadow, C., Staneva, J., & Saynisch-Wagner, J. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00374-3 · Cited by 308
Forecast combinations: An over 50-year review
Wang, X., Hyndman, R. J., Li, F., & Kang, Y. (2023) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2022.11.005 · Cited by 280
Kurth, T., Subramanian, S., Harrington, P., Pathak, J., Mardani, M., Hall, D., Miele, A., Kashinath, K., & Anandkumar, A. (2023) · Proceedings of the Platform for Advanced Scientific Computing Conference · doi:10.1145/3592979.3593412 · Cited by 268
Machine Learning Methods in Weather and Climate Applications: A Survey
Chen, L., Han, B., Wang, X., Zhao, J., Yang, W., & Yang, Z. (2023) · doi:10.20944/preprints202309.1764.v2 · Cited by 246
WeatherBench 2: A Benchmark for the Next Generation of Data‐Driven Global Weather Models
Rasp, S., Hoyer, S., Merose, A., Langmore, I., Battaglia, P., Russell, T., Sanchez‐Gonzalez, A., Yang, V., Carver, R., Agrawal, S., et al. (2024) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2023ms004019 · Cited by 245
Self-citationSub‐Seasonal Forecasting With a Large Ensemble of Deep‐Learning Weather Prediction Models
Weyn, J. A., Durran, D. R., Caruana, R., & Cresswell‐Clay, N. (2021) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2021ms002502 · Cited by 227
Materia, S., García, L. P., van Straaten, C., O, S., Mamalakis, A., Cavicchia, L., Coumou, D., de Luca, P., Kretschmer, M., & Donat, M. (2024) · WIREs Climate Change · doi:10.1002/wcc.914 · Cited by 130
“Applications of such transfer learning implementations include IOD, sea ice, and precipitation seasonal forecasts (Andersson et al., 2021; Gibson et al., 2021; Ling et al., 2022), medium-range weather forecasts (Rasp & Thuerey, 2021), or reconstruction of climate observations (Kadow et al., 2020).”
A machine learning model that outperforms conventional global subseasonal forecast models
Chen, L., Zhong, X., Li, H., Wu, J., Lu, B., Chen, D., Xie, S.-P., Wu, L., Chao, Q., Lin, C., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-50714-1 · Cited by 105
“Recent developments in explainable machine learning (XML) 40 – 45 methods have facilitated this interpretation.”
BackgroundMachine learning for the physics of climate
Bracco, A., Brajard, J., Dijkstra, H. A., Hassanzadeh, P., Lessig, C., & Monteleoni, C. (2024) · Nature Reviews Physics · doi:10.1038/s42254-024-00776-3 · Cited by 79
Dueben, P. D., Schultz, M. G., Chantry, M., Gagne, D. J., Hall, D. M., & McGovern, A. (2022) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-21-0002.1 · Cited by 64
SwinVRNN: A Data‐Driven Ensemble Forecasting Model via Learned Distribution Perturbation
Hu, Y., Chen, L., Wang, Z., & Li, H. (2023) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2022ms003211 · Cited by 63
Weirich-Benet, E., Pyrina, M., Jiménez-Esteve, B., Fraenkel, E., Cohen, J., & Domeisen, D. I. V. (2023) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-22-0038.1 · Cited by 33
Arcomano, T., Szunyogh, I., Wikner, A., Hunt, B. R., & Ott, E. (2023) · Geophysical Research Letters · doi:10.1029/2022gl102649 · Cited by 28
Metadata
- Authors
- Rasp, S., & Thuerey, N.
- Venue
- Journal of Advances in Modeling Earth Systems
- Publisher
- American Geophysical Union (AGU)
- Published
- 2021-02
- Volume
- 13
- Issue
- 2
- ISSN
- 1942-2466 (ISSN-L)
- OpenAlex
- W3099145603
- Cited by
- 167
- References
- 7
- FWCI
- 8.28
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.