The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
WeatherBench 2: A Benchmark for the Next Generation of Data‐Driven Global Weather Models
Open accessAbstract
WeatherBench 2 is an update to the global, medium‐range (1–14 days) weather forecasting benchmark proposed by (Rasp et al., 2020, https://doi.org/10.1029/2020ms002203 ), designed with the aim to accelerate progress in data‐driven weather modeling. WeatherBench 2 consists of an open‐source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and state‐of‐the‐art models: https://sites.research.google/weatherbench . This paper describes the design principles of the evaluation framework and presents results for current state‐of‐the‐art physical and data‐driven weather models. The metrics are based on established practices for evaluating weather forecasts at leading operational weather centers. We define a set of headline scores to provide an overview of model performance. In addition, we also discuss caveats in the current evaluation setup and challenges for the future of data‐driven weather forecasting.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Our evaluation set-up focuses on quantifying accuracy and physical consistency, following WeatherBench212. We regrid all forecasts to a 1.5° grid using conservative regridding, and average over all 732 forecasts made at noon and midnight UTC in the year 2020, which was held-out from training data for all machine-learning models.”
From Neural general circulation models for weather and climate (2024) · cites this paper as [12]
In the citing paper
“We use ECMWF’s ensemble (ENS) model as a reference baseline as it achieves the best performance across the majority of lead times12.”
From Neural general circulation models for weather and climate (2024) · cites this paper as [12]
In the citing paper
“Furthermore, previous work has shown that the performance of MLWP models that are trained on reanalysis can be further improved by fine-tuning using operational data, such as HRES analysis inputs and targets30.”
From Probabilistic weather forecasting with machine learning (2025) · cites this paper as [30]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz‐Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., et al. (2020) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3803 · Cited by 31,882
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
Atmospheric Modeling, Data Assimilation and Predictability
Kalnay, E. (2002) · doi:10.1017/cbo9780511802270 · Cited by 3,391 · cited 1×
“Current NWP models are based on discretizations of the governing equations describing fluid flow and thermodynamics (Kalnay, 2002).”
BackgroundThe quiet revolution of numerical weather prediction
Bauer, P., Thorpe, A., & Brunet, G. (2015) · Nature · doi:10.1038/nature14956 · Cited by 2,729
Accurate medium-range global weather forecasting with 3D neural networks
Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., & Tian, Q. (2023) · Nature · doi:10.1038/s41586-023-06185-3 · Cited by 1,670
Pathak, J., Subramanian, S., Harrington, P., Raja, S., Chattopadhyay, A., Mardani, M., Kurth, T., Hall, D., Li, Z., Azizzadenesheli, K., et al. (2022) · arXiv · doi:10.48550/arxiv.2202.11214 · Cited by 1,547
Research works printed but not linked: 7
- Ben‐Bouallegue Z. Clare M. C. A. Magnusson L. Gascon E. Maier‐Gerber M. Janousek M. et al. (2023).The rise of data‐driven weather forecasting(arXiv:2307.10128 [physics]).https://doi.org/10.48550/arXiv.2307.10128 · DOI
- 10.48448/zn7f‐fc64 · DOI
- Kochkov D. Yuval J. Langmore I. Norgaard P. Smith J. Mooers G. et al. (2023).Neural general circulation models(arXiv:2311.07222 [physics]).https://doi.org/10.48550/arXiv.2311.07222 · DOI
- 10.1175/1520‐0469(1963)020〈0130:DNF〉2.0.CO;2 · DOI
- Palmer T. N., 1993, Ensemble prediction. Proc. ECMWF seminar on validation of models over Europe
- 10.1175/1520‐0477(1993)074〈2317:EFANTG〉2.0.CO;2 · DOI
- (WMO), W. M. O, 2019, Manual on the global data‐processing and forecasting system (WMO‐No. 485): Annex IV to the WMO technical regulations
Cited by
Sorted by citations
Items 201–247 of 247
Sampling Parallelism for Fast and Efficient Bayesian Learning
Özdemir, A. K., Heyen, L. H., Weyrauch, A., Streit, A., Götz, M., & Debus, C. (2026) · Platform for Advanced Scientific Computing Conference (PASC) · doi:10.1145/3815572.3815745
Mechanistic Interpretability Tool for AI Weather Models
Tempest, K. I., Beylich, M., & Craig, G. C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29915-4_10 · Cited by 2
Pu, J., Mu, M., Feng, J., & Li, H. (2026) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.70257 · Cited by 1
Less Tokens, Better Forecasts: Sparse Residual Routing for Efficient Weather Prediction
Wang, J., Zhang, Y., Zhao, L., Xiao, X., Hamm, J., & Wang, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37359-5_6 · Cited by 1
A chemistry-informed deep learning network for mitigating the stratospheric OH data gap
Yin, W., Zhou, C., Feng, W., Dhomse, S. S., Pope, R. J., Millan, L. F., & Chipperfield, M. P. (2026) · Science Advances · doi:10.1126/sciadv.aee2319
Short‐Term Hourly Weather Forecasting Using PredRNN With Image Preprocessing
Tran, H., Li, H., Tran, V. N., Nguyen, V. T., Le, M., Dang, T. D., Xuan, H., Pham, H. T., Bui–Thanh, T., & Leung, L.-Y. R. (2026) · Journal of Geophysical Research Machine Learning and Computation · doi:10.1029/2026jh001291
Cui, X., Zhang, G., & Liu, C. (2026) · Ocean Modelling · doi:10.1016/j.ocemod.2026.102803
OceanForecastBench: A Benchmark Data Set for Data‐Driven Global Ocean Forecasting
Han, Y., Jia, H., Wang, X., Wang, H., Wu, W., Zheng, J., & Xiao, P. (2026) · Journal of Geophysical Research Machine Learning and Computation · doi:10.1029/2025jh000838 · Cited by 5
Twenty‐one questions shaping the future of plant phenology research in the 21st century
Templ, B., Kauffert, J., Oteros, J., Lehner, S., Luedeling, E., Prat, E., der Meersch, V. V., Vrieling, A., de Vries, J., Izquierdo‐Verdiguier, E., et al. (2026) · Functional Ecology · doi:10.1111/1365-2435.70403
Subseasonal Prediction of the Wintertime North Pacific Blocking in AI‐Based Weather Models
Hwang, J., Deng, Y., Yook, S., & You, Z. (2026) · Journal of Geophysical Research Atmospheres · doi:10.1029/2026jd046695
Exploring Marine Atmospheric Ducts: Current Sensing and Emerging Trends
Zhang, J., Li, Y.-J., Ji, H., Peng, H.-Y., Guo, X., & Yu-sheng, Z. (2026) · Remote Sensing · doi:10.3390/rs18152576
Super-resolving coarse-resolution weather forecasts with flow matching
Delefosse, A., Charantonis, A., & Béréziat, D. (2026) · Environmental Data Science · doi:10.1017/eds.2026.10046 · Cited by 1
Bailie, T., Mukkavilli, S. K., Vetrova, V. V., & Koh, Y. S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818890
Learning Vertical Coordinates via Automatic Differentiation of a Dynamical Core
Whittaker, T., Taylor, S., Cardoso‐Bihlo, E. D. S., Luca, A. D., & Bihlo, A. (2026) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2025ms005711 · Cited by 5
Shu, R., Gou, R., Xiang, Y., & Huang, X. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818893 · Cited by 1
REPA: Random-Order Embedding Predictive Autoregression for Sparse Vector Field Reconstruction
Oral, B., & Koyuncu, E. (2026) · Proceedings - International Conference on Image Processing · doi:10.1109/icip61757.2026.11630507
Latos, B., Nguyen, H., Wheeler, M. C., Li, C., de Burgh-Day, C., Hassim, M. E. E., Sahany, S., & Moise, A. (2026) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.70293 · Cited by 1
Wu, Y., Liao, Q., Tian, T., & Sheng, Z. (2026) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2026.3724650
Bridging the weather and climate divide with artificial intelligence
Camps‐Valls, G., Carrassi, A., Viríssimo, F. D. M., Debeire, K., Fernández‐Torres, M., Hess, P., Heuer, H., Mankovich, N., Montero, D., Bonet, E. R., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-75787-y
Chu, Y., Yan, Y., Zhu, Y., Li, Y., Zhang, Z., Zou, R., Cai, J., & Wu, E. Q. (2026) · Atmosphere · doi:10.3390/atmos17090816
Effectiveness of machine learning and deep learning techniques for multi-horizon weather forecasting
Sami, A., Bilal, M., Habib, U., & Cheema, A. A. (2026) · Meteorology and Atmospheric Physics · doi:10.1007/s00703-026-01183-2
Li, J., Xie, Z., Jia, S., Li, H., Luo, C., Xie, N., Yao, B., Wang, W., & Xie, X. X. X. (2026) · Applied Optics · doi:10.1364/ao.606778
ClimaView: An AI-Driven System for Real-Time Weather Monitoring and Forecasting
Rajasekaran, S. K., Hussain, M. F., Haque, I., & Alam, M. I. (2026) · ITM Web of Conferences · doi:10.1051/itmconf/20269003012
TF-STNet: A Time–Frequency Dual-Branch Spatiotemporal Network for NWP-to-Station Bias Correction
Wang, Z., Chen, S., Yang, Y., Wang, B., Xu, B., & Geng, Y. (2026) · Entropy · doi:10.3390/e28091004
Zhou, S., Hé, C., Zheng, D., & Lin, D. (2026) · Remote Sensing · doi:10.3390/rs18183134
Liu, Y., Chai, M., Runjie, X., Li, H., Du, R., & He, B. (2026) · Land · doi:10.3390/land15091726
Machine-learning assisted climate modeling
Nie, Y., & Han, Y. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-15748-6.00101-5
Foundation models in Earth system science: Advances, challenges, and future paths
Su, F., Cao, Y., Li, X., Wang, H., Fan, R., Huang, S., He, W., Chen, Z., Zhang, P., Zhao, L., et al. (2026) · The Innovation Reviews · doi:10.59717/j.tirv.2026.100014
Yang, H., Wang, Y., Chen, M., Zhong, Q., & Wang, F. (2026) · Atmosphere · doi:10.3390/atmos17100955
Bariya, H., & Degadwala, S. (2026) · International Journal of Scientific Research in Artificial Intelligence and Machine Learning · doi:10.32628/ijsraiml2624111
Holmberg, E., & Olivetti, L. (2026) · Natural hazards and earth system sciences · doi:10.5194/nhess-26-4825-2026
Sun, Y. Q., Hassanzadeh, P., Shaw, T. A., Pahlavan, H. A., & Marchakitus, A. (2026) · Science Advances · doi:10.1126/sciadv.ady9406 · Cited by 16
From Drops to Grid: Noise-Aware Spatio-Temporal Neural Process for Rainfall Estimation
Sarabia, R. P., Cordulus, J. N., Birk, M., & Assent, I. (2026) · doi:10.1109/cvprf71909.2026.00254
CANet: Global Weather Forecast Network with Climatology-Aware Prior Constraints
Yan, F., Zhang, Y., Wang, Q., Song, C., Li, T., Geng, K., Chen, H., & Jiang, F. (2026) · International Conference on High Performance Compilation, Computing and Communications (HP3C) · doi:10.1145/3833907.3833927
PMFormer: Physics-guided Multi-scale Transformer for Global Weather Forecasting
Geng, K., Chen, H., Liu, X., Wu, J., Song, C., Zhu, H., Mi, Y., Zhang, T., & Jiang, F. (2026) · International Conference on High Performance Compilation, Computing and Communications (HP3C) · doi:10.1145/3833907.3833922
Malozyomov, B. V., Martyushev, N. V., Valuev, D. V., Николаевна, С. С., Ефременков, Е. А., Demin, A. Y., & Pogrebnoy, A. V. (2026) · Mathematics · doi:10.3390/math14203711
Marion, B., de Vicente, A., Mahn, M., Lüthi, A., Luithlen, L., & Mitelut, C. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.07.757249
From Hours to Daily Extremes: Evaluating ERA5 and ERA5-Land Biases Across Morocco’s Diverse ClimatesPreprint
Alaoui, B., Bari, D., & Khouakhi, A. (2026) · Research Square · doi:10.21203/rs.3.rs-11116863/v1
Liu, J., Li, R., Sun, T., & Guangheng, N. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.23492702
Reanalysis: Multidecade-long records of observations-based earth system climate
Bosilovich, M. G., Breen, K. H., Collow, A., Darmenov, A., Gandoin, R., Robertson, F. R., & Wild, M. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-15748-6.00141-6
Application of Artificial Intelligence in Subseasonal to Seasonal Prediction: Progress and Prospects
Lü, B., Liu, X., Wang, C., Zhou, C., Hsu, P.-C., 巢清尘, Dou, Z., Hu, J., Zhao, Y., Zhao, C., et al. (2026) · 气象学报：英文版 · doi:10.1007/s13351-026-5337-9
FDMNet: Frequency-Aware Dual-Branch Modeling for Wind-Vector Prediction
Yang, H., Yan, Y., Li, S., & Chen, M. (2026) · Atmosphere · doi:10.3390/atmos17111047
Machine Learning Weather Prediction: Models, Verification and Limits
Raji, N. (2026) · International Journal of Information Technology Research Studies (IJITRS) · doi:10.63090/ijitrs/3139.3209.0040
WeatherBridge and the limits of global weather interpolation at held-out query timesPreprint
Sukhorukov, D., Zakharov, A., Maximov, Y., Makarov, I., & Oseledets, I. (2026) · Research Square · doi:10.21203/rs.3.rs-11183024/v1
Li, S., Wen, C., Zhang, W., Liu, S., 张达永, Zang, M., & Liu, Z. (2026) · Sustainability · doi:10.3390/su182111055
Recursive self-improvement of AI research agents
Srikanth, D., Zhao, B., Xu, D., Wu, Y., & Jiang, Z. (2026) · arXiv · doi:10.48550/arxiv.2609.26457
Metadata
- Authors
- Rasp, S., Hoyer, S., Merose, A., Langmore, I., Battaglia, P., Russell, T., Sanchez‐Gonzalez, A., Yang, V., Carver, R., Agrawal, S., Chantry, M., Ben Bouallegue, Z., Dueben, P., Bromberg, C., Sisk, J., Barrington, L., Bell, A., & Sha, F.
- Affiliations
- Google (United States) (US)
- Google DeepMind (United Kingdom) (GB)
- Google DeepMind London UK
- Google Research Mountain View CA USA
- European Centre for Medium-Range Weather Forecasts (GB)
- European Centre for Medium‐Range Weather Forecasts Reading UK
- Corresponding author
- Rasp, Stephan
- ORCID
- Venue
- Journal of Advances in Modeling Earth Systems
- Publisher
- American Geophysical Union (AGU)
- Published
- 2024-06
- Volume
- 16
- Issue
- 6
- ISSN
- 1942-2466 (ISSN-L)
- OpenAlex
- W4399779937
- Cited by
- 245
- References
- 54
- Citations by year
- 2026: 111 · 2025: 95 · 2024: 39
- FWCI
- 44.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Advances in Modeling Earth Systems (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Physical Sciences › Environmental Science › Environmental Engineering › Hydrological Forecasting Using AI
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Keywords
- medium-range weather forecasting, forecast evaluation metrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
