CoChat
Sign Up
PreprintCited by 156Meteorological Phenomena and SimulationsHydrological Forecasting Using AITraffic Prediction and Management Techniques

GraphCast: Learning skillful medium-range global weather forecasting

Open access
Lam, Remi, Sanchez-Gonzalez, Alvaro, Willson, Matthew, Wirnsberger, Peter, Fortunato, Meire, Alet, Ferran, Ravuri, Suman, Ewalds, Timo +10 more·2022·arXiv
DOI 10.48550/arxiv.2212.12794arXiv 2212.12794
Open this paper in CoChat — free accountOpen PDF

Abstract

Global medium-range weather forecasting is critical to decision-making across many social and economic domains. Traditional numerical weather prediction uses increased compute resources to improve forecast accuracy, but cannot directly use historical weather data to improve the underlying model. We introduce a machine learning-based method called "GraphCast", which can be trained directly from reanalysis data. It predicts hundreds of weather variables, over 10 days at 0.25 degree resolution globally, in under one minute. We show that GraphCast significantly outperforms the most accurate operational deterministic systems on 90% of 1380 verification targets, and its forecasts support better severe event prediction, including tropical cyclones, atmospheric rivers, and extreme temperatures. GraphCast is a key advance in accurate and efficient weather forecasting, and helps realize the promise of machine learning for modeling complex dynamical systems.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2212.12794

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Generative models have only very recently been explored for climate predictions of extremes, while for weather extremes these techniques have been employed in several applications.

    “Generative models, including Variational Auto Encoders (VAEs; Kingma & Welling, 2019), Generative Adversarial Networks (GANs; Goodfellow, 2016), Normalizing Flows models (Papamakarios et al., 2019), and Diffusion Models (Yang, Lee, et al., 2022), have only very rec explored for climate predictions of extremes (Spuler et al., 2024), while for weather extremes these techniques have been employed in”

    From Artificial intelligence for climate prediction of extremes: State of the art, challenges, and future perspectives (2024) · cites this paper as Lam et al., 2022

    The Introduction cites precipitation nowcasting as a weather-forecasting application, and the References (p. 13) identify one cited study as using deep generative models. But GraphCast’s Conclusions (p. 10) say its own forecasts are deterministic. The paper does not establish that generative models have been used in several weather-extreme applications or address how recently they were explored for climate extremes. (LLM, conf=0.79)

    Experimental — accuracy not yet measured

  • Progress in AI-based forecasting on weather timescales, that is, less than 10 days, has been remarkable in the last few years.

    “Progress in AI-based forecasting on weather timescales, that is, less than 10 days, has been remarkable in the last few years.”

    From Artificial intelligence for climate prediction of extremes: State of the art, challenges, and future perspectives (2024) · cites this paper as Lam et al., 2022

  • Forecasting institutes worldwide and Big Tech companies have gained skills comparable to state-of-the-art dynamical predictions, even for unprecedented extreme events.

    “In parallel with the rapid rise of AI, forecasting institutes worldwide and Big Tech companies have seized upon the opportunity to improve weather forecasts, gaining skills comparable to that of state-of-the-art dynamical predictions (Bi et al., 2023;Keisler, 2022;Lam et al., 2022;Pathak et al., 2022), even for unprecedented extreme events (Pasche et al., 2024).”

    From Artificial intelligence for climate prediction of extremes: State of the art, challenges, and future perspectives (2024) · cites this paper as Lam et al., 2022

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Still being checked.

Research works printed but not linked: 35

  1. [1][1] Ferran Alet, Adarsh Keshav Jeewajee, Maria Bauza Villalonga, Alberto Rodriguez, Tomas Lozano- Perez, and Leslie Kaelbling. Graph element networks: adaptive, structured computation and memory. In International Conference on Machine Learning, pages 212–222. PMLR, 2019.
  2. [2][2] Kelsey R Allen, Yulia Rubanova, Tatiana Lopez-Guevara, William Whitney, Alvaro Sanchez- Gonzalez, Peter Battaglia, and Tobias Pfaff. Learning rigid dynamics with face interaction graph networks. arXiv preprint arXiv:2212.03574, 2022. · arXiv
  3. [3][3] Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton. Layer normalization. arXiv, 2016.
  4. [5][5] Peter Battaglia, Razvan Pascanu, Matthew Lai, Danilo Jimenez Rezende, et al. Interaction networks for learning about objects, relations and physics. Advances in neural information processing systems, 29, 2016.
  5. [6][6] Peter W Battaglia, Jessica B Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinicius Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, et al. Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:1806.01261, 2018. · arXiv
  6. [7][7] Kaifeng Bi, Lingxi Xie, Hengheng Zhang, Xin Chen, Xiaotao Gu, and Qi Tian. Pangu-Weather: A 3D high-resolution model for fast and accurate global weather forecast. arXiv preprint arXiv:2211.02556, 2022. · arXiv
  7. [8][8] Philippe Bougeault, Zoltan Toth, Craig Bishop, Barbara Brown, David Burridge, De Hui Chen, Beth Ebert, Manuel Fuentes, Thomas M Hamill, Ken Mylne, et al. The THORPEX interactive grand global ensemble. Bulletin of the American Meteorological Society, 91(8):1059–1072, 2010.
  8. [10][10] WE Chapman, AC Subramanian, L Delle Monache, SP Xie, and FM Ralph. Improving atmospheric river forecasts with machine learning. Geophysical Research Letters, 46(17-18):10627–10635, 2019.
  9. [11][11] Tianqi Chen, Bing Xu, Chiyuan Zhang, and Carlos Guestrin. Training deep nets with sublinear memory cost. arXiv preprint arXiv:1604.06174, 2016. · arXiv
  10. [12][12] Balaji Devaraju. Understanding filtering on the sphere: Experiences from filtering GRACE data. PhD thesis, University of Stuttgart, 2015. 99 http://github.com/deepmind http://github.com/deepmind http://github.com/google/jax http://github.com/google/jax GraphCast: Learning skillful medium-range global weather forecasting
  11. [13][13] J R Driscoll and D M Healy. Computing fourier transforms and convolutions on the 2-sphere. Adv. Appl. Math., 15(2):202–250, June 1994.
  12. [15][15] Meire Fortunato, Tobias Pfaff, Peter Wirnsberger, Alexander Pritzel, and Peter Battaglia. Multi- scale meshgraphnets. arXiv preprint arXiv:2210.00612, 2022. · arXiv
  13. [16][16] Alan J Geer. Significance of changes in medium-range forecast scores. Tellus A: Dynamic Meteorology and Oceanography, 68(1):30229, 2016.
  14. [24][24] Hans Hersbach, Bill Bell, Paul Berrisford, Shoji Hirahara, András Horányi, Joaquín Muñoz- Sabater, Julien Nicolas, Carole Peubey, Raluca Radu, Dinand Schepers, et al. The ERA5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999–2049, 2020.
  15. [25][25] S. Hoyer and J. Hamman. xarray: N-D labeled arrays and datasets in Python. Journal of Open Research Software, 5(1), 2017.
  16. [26][26] Ryan Keisler. Forecasting global weather with graph neural networks. arXiv preprint arXiv:2202.07575, 2022. · arXiv
  17. [27][27] Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014. · arXiv
  18. [28][28] Kenneth R Knapp, Howard J Diamond, James P Kossin, Michael C Kruk, Carl J Schreck, et al. International best track archive for climate stewardship (IBTrACS) project, version 4. https: //doi.org/10.25921/82ty-9e16, 2018. 100 https://www.ecmwf.int/node/16647 https://www.ecmwf.int/node/16647 http://github.com/deepmind/jraph https://www.ecmwf.int/node/18746 https://www.ecmwf.int/node/18746 https://www.ecmwf.int/node/19879 https://www.ecmwf.int/node/20142 https://www.ecmwf.int/node/20142 https://www.ecmwf.int/node/20469 https://www.ecmwf.int/node/19277 https://www.ecmwf.int/node/19277 http://github.com/deepmind/dm-haiku https://doi.org/10.25921/82ty-9e16 https://doi.org/10.25921/82ty-9e16 GraphCast: Learning skillful medium-range global weather forecasting · DOI
  19. [29][29] Kenneth R Knapp, Michael C Kruk, David H Levinson, Howard J Diamond, and Charles J Neumann. The international best track archive for climate stewardship (IBTrACS) unifying tropical cyclone data. Bulletin of the American Meteorological Society, 91(3):363–376, 2010.
  20. [30][30] Michael C Kruk, Kenneth R Knapp, and David H Levinson. A technique for combining global tropical cyclone best track data. Journal of Atmospheric and Oceanic Technology, 27(4):680–692, 2010.
  21. [31][31] David H Levinson, Howard J Diamond, Kenneth R Knapp, Michael C Kruk, and Ethan J Gibney. Toward a homogenous global tropical cyclone best-track dataset. Bulletin of the American Meteorological Society, 91(3):377–380, 2010.
  22. [32][32] Ignacio Lopez-Gomez, Amy McGovern, Shreya Agrawal, and Jason Hickey. Global extreme heat forecasting using neural weather models. Artificial Intelligence for the Earth Systems, pages 1–41, 2022.
  23. [33][33] Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017. · arXiv
  24. [37][37] Benjamin J Moore, Paul J Neiman, F Martin Ralph, and Faye E Barthold. Physical processes associated with heavy flooding rainfall in Nashville, Tennessee, and vicinity during 1–2 May 2010: The role of an atmospheric river and mesoscale convective systems. Monthly Weather Review, 140(2):358–378, 2012.
  25. [38][38] Paul J Neiman, F Martin Ralph, Gary A Wick, Jessica D Lundquist, and Michael D Dettinger. Meteorological characteristics and overland precipitation impacts of atmospheric rivers affecting the West Coast of North America based on eight years of ssm/i satellite observations. Journal of Hydrometeorology, 9(1):22–47, 2008.
  26. [39][39] Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter Battaglia. Learning mesh- based simulation with graph networks. In International Conference on Learning Representations, 2021.
  27. [40][40] Prajit Ramachandran, Barret Zoph, and Quoc V Le. Searching for activation functions. arXiv preprint arXiv:1710.05941, 2017. · arXiv
  28. [41][41] Stephan Rasp, Peter D Dueben, Sebastian Scher, Jonathan A Weyn, Soukayna Mouatadid, and Nils Thuerey. WeatherBench: a benchmark data set for data-driven weather forecasting. Journal of Advances in Modeling Earth Systems, 12(11):e2020MS002203, 2020.
  29. [42][42] Takaya Saito and Marc Rehmsmeier. The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PloS one, 10(3):e0118432, 2015. 101 https://confluence.ecmwf.int/display/FCST/202208+-+Heatwave+-+UK https://confluence.ecmwf.int/display/FCST/202208+-+Heatwave+-+UK https://www.ecmwf.int/node/17262 https://www.ecmwf.int/node/17262 GraphCast: Learning skillful medium-range global weather forecasting
  30. [43][43] Alvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying, Jure Leskovec, and Peter Battaglia. Learning to simulate complex physics with graph networks. In International Conference on Machine Learning, pages 8459–8468. PMLR, 2020.
  31. [44][44] B. D. Santer, R. Sausen, T. M. L. Wigley, J. S. Boyle, K. AchutaRao, C. Doutriaux, J. E. Hansen, G. A. Meehl, E. Roeckner, R. Ruedy, G. Schmidt, and K. E. Taylor. Behavior of tropopause height and atmospheric temperature in models, reanalyses, and observations: Decadal changes. Journal of Geophysical Research: Atmospheres, 108(D1):ACL 1–1–ACL 1–22, 2003.
  32. [45][45] Richard Swinbank, Masayuki Kyouda, Piers Buchanan, Lizzie Froude, Thomas M Hamill, Tim D Hewson, Julia H Keller, Mio Matsueda, John Methven, Florian Pappenberger, et al. The TIGGE project and its achievements. Bulletin of the American Meteorological Society, 97(1):49–67, 2016.
  33. [46][46] Richard Swinbank, Masayuki Kyouda, Piers Buchanan, Lizzie Froude, Thomas M. Hamill, Tim D. Hewson, Julia H. Keller, Mio Matsueda, John Methven, Florian Pappenberger, Michael Scheuerer, Helen A. Titley, Laurence Wilson, and Munehiko Yamaguchi. The TIGGE project and its achievements. Bulletin of the American Meteorological Society, 97(1):49 – 67, 2016.
  34. [48][48] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  35. [49][49] Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. Graph attention networks. arXiv preprint arXiv:1710.10903, 2017. 102 Datasets ERA5 HRES Tropical cyclone datasets Notation and problem statement Time notation General forecasting problem statement Modeling ECMWF weather data GraphCast model Generating a forecast Architecture overview GraphCast's graph Encoder Processor Decoder Normalization and network parameterization Training details Training split Training objective Training on autoregressive objective Optimization Curriculum training schedule Reducing memory footprint Training time Software and hardware stack Verification methods Training, validation, and test splits Comparing GraphCast to HRES Choice of ground truth datasets Ensuring equal lookahead in assimilation windows Alignment of initialization and validity times-of-day Evaluation period Evaluation metrics Statistical methodology Significance tests for difference in means Forecast alignment Confidence intervals for RMSEs Confidence intervals for RMSE skill scores Comparison with previous machine learning baselines Additional forecast verification results Detailed results for additional variables RMSE and ACC Detailed significance test results for RMSE comparisons Effect of data recency on GraphCast Disaggregated results RMSE by region RMSE skill score by latitude and pressure level Biases by latitude and longitude RMSE skill score by latitude and longitude RMSE skill score by surface elevation GraphCast ablations Multi-mesh ablation Effect of autoregressive training Optimal blurring Effect on the comparison of skill between GraphCast and HRES Filtering methodology Transfer functions of the optimal filters Relationship between autoregressive training horizon and blurring Spectral analysis Spectral decomposition of mean squared error RMSE as a function of horizontal resolution Spectra of predictions and targets Additional severe event forecasting results Tropical cyclone track forecasting Evaluation protocol Statistical methodology Results Tracker details Atmospheric rivers Extreme heat and cold Forecast visualizations · arXiv

Cited by

Sorted by citations

Related

Authors
Lam, R., Sanchez-Gonzalez, A., Willson, M., Wirnsberger, P., Fortunato, M., Alet, F., Ravuri, S., Ewalds, T., Eaton-Rosen, Z., Hu, W., Merose, A., Hoyer, S., Holland, G., Vinyals, O., Stott, J., Pritzel, A., Mohamed, S., & Battaglia, P.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2212.12794
arXiv
2212.12794
OpenAlex
W4312226181
Cited by
154
References
0
Citations by year
2026: 4 · 2025: 42 · 2024: 55 · 2023: 53
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
  • Physical Sciences › Environmental Science › Environmental Engineering › Hydrological Forecasting Using AI
  • Physical Sciences › Engineering › Building and Construction › Traffic Prediction and Management Techniques
Keywords
medium-range weather forecasting, GraphCast, graph neural networks, reanalysis data, deterministic forecasting, tropical cyclone forecasting, atmospheric rivers, severe weather

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review