Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
PreprintCited by 2

The DOI matches its DataCite record; 2 of the 2 references it cites were found in a registry or an index.

Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast

Bi, Kaifeng, Xie, Lingxi, Zhang, Hengheng, Chen, Xin, Gu, Xiaotao, Tian, Qi·2022·arXiv
DOI 10.48550/arxiv.2211.02556arXiv 2211.02556
Open this paper in CoChat — free account

Abstract

In this paper, we present Pangu-Weather, a deep learning based system for fast and accurate global weather forecast. For this purpose, we establish a data-driven environment by downloading $43$ years of hourly global weather data from the 5th generation of ECMWF reanalysis (ERA5) data and train a few deep neural networks with about $256$ million parameters in total. The spatial resolution of forecast is $0.25^\circ\times0.25^\circ$, comparable to the ECMWF Integrated Forecast Systems (IFS). More importantly, for the first time, an AI-based method outperforms state-of-the-art numerical weather prediction (NWP) methods in terms of accuracy (latitude-weighted RMSE and ACC) of all factors (e.g., geopotential, specific humidity, wind speed, temperature, etc.) and in all time ranges (from one hour to one week). There are two key strategies to improve the prediction accuracy: (i) designing a 3D Earth Specific Transformer (3DEST) architecture that formulates the height (pressure level) information into cubic data, and (ii) applying a hierarchical temporal aggregation algorithm to alleviate cumulative forecast errors. In deterministic forecast, Pangu-Weather shows great advantages for short to medium-range forecast (i.e., forecast time ranges from one hour to one week). Pangu-Weather supports a wide range of downstream forecast scenarios, including extreme weather forecast (e.g., tropical cyclone tracking) and large-member ensemble forecast in real-time. Pangu-Weather not only ends the debate on whether AI-based methods can surpass conventional NWP methods, but also reveals novel directions for improving deep learning weather forecast systems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2211.02556

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 2 references

Research works printed but not linked: 50

  1. P. Bauer, A. Thorpe, and G. Brunet, "The quiet revolution of numerical weather prediction," Nature, vol. 525, no. 7567, pp. 47- 55, 2015.
  2. F. Molteni, R. Buizza, T. N. Palmer, and T. Petroliagis, "The ecmwf ensemble prediction system: Methodology and validation," Quarterly journal of the royal meteorological society, vol. 122, no. 529, pp. 73-119, 1996.
  3. H. Ritchie, C. Temperton, A. Simmons, M. Hortal, T. Davies, D. Dent, and M. Hamrud, "Implementation of the semi-lagrangian method in a high-resolution version of the ecmwf forecast model," Monthly Weather Review, vol. 123, no. 2, pp. 489-514, 1995.
  4. T. Palmer, G. Shutts, R. Hagedorn, F. Doblas-Reyes, T. Jung, and M. Leutbecher, "Representing model uncertainty in weather and climate prediction," Annual Review of Earth and Planetary Sciences, vol. 33, no. 1, pp. 163-193, 2005.
  5. M. R. Allen, J. Kettleborough, and D. Stainforth, "Model error in weather and climate forecasting," in ECMWF Predictability of Weather and Climate Seminar. European Centre for Medium Range Weather Forecasts, Reading, UK, 2002, pp. 279-304.
  6. M. G. Schultz, C. Betancourt, B. Gong, F. Kleinert, M. Langguth, L. H. Leufen, A. Mozaffari, and S. Stadtler, "Can deep learning beat numerical weather prediction?" Philosophical Transactions of the Royal Society A, vol. 379, no. 2194, p. 20200097, 2021.
  7. S. Scher and G. Messori, "Weather and climate forecasting with neural networks: using general circulation models (gcms) with different complexity as a study ground," Geoscientific Model De- velopment, vol. 12, no. 7, pp. 2797-2809, 2019.
  8. S. Rasp, P. D. Dueben, S. Scher, J. A. Weyn, S. Mouatadid, and N. Thuerey, "Weatherbench: a benchmark data set for data-driven weather forecasting," Journal of Advances in Modeling Earth Systems, vol. 12, no. 11, p. e2020MS002203, 2020.
  9. J. A. Weyn, D. R. Durran, and R. Caruana, "Can machines learn to predict weather? using deep learning to predict gridded 500- hpa geopotential height from historical weather data," Journal of Advances in Modeling Earth Systems, vol. 11, no. 8, pp. 2680-2693, 2019.
  10. J. A. Weyn, D. R. Durran, R. Caruana, and N. Cresswell-Clay, "Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction models," Journal of Advances in Modeling Earth Systems, vol. 13, no. 7, p. e2021MS002502, 2021.
  11. R. Keisler, "Forecasting global weather with graph neural net- works," arXiv preprint arXiv:2202.07575, 2022. · arXiv
  12. J. Pathak, S. Subramanian, P. Harrington, S. Raja, A. Chattopad- hyay, M. Mardani, T. Kurth, D. Hall, Z. Li, K. Azizzadenesheli et al., "Fourcastnet: A global data-driven high-resolution weather model using adaptive fourier neural operators," arXiv preprint arXiv:2202.11214, 2022. · arXiv
  13. Y. Hu, L. Chen, Z. Wang, and H. Li, "Swinvrnn: A data-driven en- semble forecasting model via learned distribution perturbation," arXiv preprint arXiv:2205.13158, 2022. · arXiv
  14. P. Bougeault, Z. Toth, C. Bishop, B. Brown, D. Burridge, D. H. Chen, B. Ebert, M. Fuentes, T. M. Hamill, K. Mylne et al., "The thorpex interactive grand global ensemble," Bulletin of the Ameri- can Meteorological Society, vol. 91, no. 8, pp. 1059-1072, 2010.
  15. K. He, H. Fan, Y. Wu, S. Xie, and R. Girshick, "Momentum contrast for unsupervised visual representation learning," in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 9729-9738.
  16. H. Bao, L. Dong, and F. Wei, "Beit: Bert pre-training of image transformers," arXiv preprint arXiv:2106.08254, 2021. · arXiv
  17. T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhari- wal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al., "Lan- guage models are few-shot learners," Advances in neural informa- tion processing systems, vol. 33, pp. 1877-1901, 2020.
  18. A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agar- wal, G. Sastry, A. Askell, P. Mishkin, J. Clark et al., "Learning transferable visual models from natural language supervision," in International Conference on Machine Learning. PMLR, 2021, pp. 8748-8763.
  19. A. K. Betts, D. Z. Chan, and R. L. Desjardins, "Near-surface biases in era5 over the canadian prairies," Frontiers in Environmental Science, vol. 7, p. 129, 2019.
  20. Q. Jiang, W. Li, Z. Fan, X. He, W. Sun, S. Chen, J. Wen, J. Gao, and J. Wang, "Evaluation of the era5 reanalysis precipitation dataset over chinese mainland," Journal of hydrology, vol. 595, p. 125660, 2021.
  21. H. Hersbach, B. Bell, P. Berrisford, S. Hirahara, A. Horányi, J. Mu ñoz-Sabater, J. Nicolas, C. Peubey, R. Radu, D. Schepers et al., "The era5 global reanalysis," Quarterly Journal of the Royal Meteorological Society, vol. 146, no. 730, pp. 1999-2049, 2020.
  22. P. Lynch, "The origins of computer weather prediction and climate modeling," Journal of computational physics, vol. 227, no. 7, pp. 3431-3444, 2008.
  23. E. Kalnay, Atmospheric modeling, data assimilation and predictability. Cambridge university press, 2003.
  24. D. J. Stensrud, Parameterization schemes: keys to understanding nu- merical weather prediction models. Cambridge University Press, 2009.
  25. D. Randall, M. Khairoutdinov, A. Arakawa, and W. Grabowski, "Breaking the cloud parameterization deadlock," Bulletin of the American Meteorological Society, vol. 84, no. 11, pp. 1547-1564, 2003.
  26. R. Pincus, H. W. Barker, and J.-J. Morcrette, "A fast, flexible, ap- proximate technique for computing radiative transfer in inhomo- geneous cloud fields," Journal of Geophysical Research: Atmospheres, vol. 108, no. D13, 2003.
  27. A. Arakawa, "The cumulus parameterization problem: Past, present, and future," Journal of climate, vol. 17, no. 13, pp. 2493- 2525, 2004.
  28. A. Betts, "Non-precipitating cumulus convection and its param- eterization," Quarterly Journal of the Royal Meteorological Society, vol. 99, no. 419, pp. 178-196, 1973.
  29. H.-L. Kuo, "Further studies of the parameterization of the in- fluence of cumulus convection on large-scale flow," Journal of Atmospheric Sciences, vol. 31, no. 5, pp. 1232-1240, 1974.
  30. T. Nakaegawa, "High-performance computing in meteorology un- der a context of an era of graphical processing units," Computers, vol. 11, no. 7, p. 114, 2022.
  31. H. Olafsson and J.-W. Bao, Uncertainties in Numerical Weather Prediction. Elsevier, 2020.
  32. I. M. Navon, "Data assimilation for numerical weather prediction: a review," Data assimilation for atmospheric, oceanic and hydrologic applications, pp. 21-65, 2009.
  33. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, no. 7553, pp. 436-444, 2015.
  34. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classifi- cation with deep convolutional neural networks," in Advances in Neural Information Processing Systems, 2012.
  35. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, "Attention is all you need," Advances in neural information processing systems, vol. 30, 2017.
  36. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly et al., "An image is worth 16x16 words: Transformers for image recognition at scale," arXiv preprint arXiv:2010.11929, 2020. · arXiv
  37. Z. Liu, Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo, "Swin transformer: Hierarchical vision transformer using shifted windows," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 10 012-10 022.
  38. X. Shi, Z. Chen, H. Wang, D.-Y. Yeung, W.-K. Wong, and W.-c. Woo, "Convolutional lstm network: A machine learning approach for precipitation nowcasting," Advances in neural information processing systems, vol. 28, 2015.
  39. X. Shi, Z. Gao, L. Lausen, H. Wang, D.-Y. Yeung, W.-k. Wong, and W.-c. Woo, "Deep learning for precipitation nowcasting: A benchmark and a new model," Advances in neural information processing systems, vol. 30, 2017.
  40. S. Agrawal, L. Barrington, C. Bromberg, J. Burge, C. Gazen, and J. Hickey, "Machine learning for precipitation nowcasting from radar images," arXiv preprint arXiv:1912.12132, 2019. · arXiv
  41. S. Ravuri, K. Lenc, M. Willson, D. Kangin, R. Lam, P. Mirowski, M. Fitzsimons, M. Athanassiadou, S. Kashem, S. Madge et al., "Skilful precipitation nowcasting using deep generative models of radar," Nature, vol. 597, no. 7878, pp. 672-677, 2021.
  42. V. Lebedev, V. Ivashkin, I. Rudenko, A. Ganshin, A. Molchanov, S. Ovcharenko, R. Grokhovetskiy, I. Bushmarinov, and D. Solo- mentsev, "Precipitation nowcasting with satellite imagery," in Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, 2019, pp. 2680-2688.
  43. C. K. Sønderby, L. Espeholt, J. Heek, M. Dehghani, A. Oliver, T. Salimans, S. Agrawal, J. Hickey, and N. Kalchbrenner, "Met- net: A neural weather model for precipitation forecasting," arXiv preprint arXiv:2003.12140, 2020. · arXiv
  44. H. Hersbach, B. Bell, P. Berrisford, G. Biavati, A. Horányi, J. Mu ñoz Sabater, J. Nicolas, C. Peubey, R. Radu, I. Rozum et al., "Era5 hourly data on pressure levels from 1979 to present," Copernicus climate change service (c3s) climate data store (cds), vol. 10, 2018.
  45. --, "Era5 hourly data on single levels from 1979 to present," Copernicus Climate Change Service (C3S) Climate Data Store (CDS), vol. 10, 2018.
  46. B. Fildier, W. D. Collins, and C. Muller, "Distortions of the rain distribution with warming, with and without self-aggregation," Journal of Advances in Modeling Earth Systems, vol. 13, no. 2, p. e2020MS002256, 2021.
  47. S. Bourdin, S. Fromang, W. Dulac, J. Cattiaux, and F. Chauvin, "Intercomparison of four tropical cyclones detection algorithms on era5," EGUsphere, pp. 1-43, 2022.
  48. P. Malakar, A. Kesarkar, J. Bhate, V. Singh, and A. Deshamukhya, "Comparison of reanalysis data sets to comprehend the evolution of tropical cyclones over north indian ocean," Earth and Space Science, vol. 7, no. 2, p. e2019EA000978, 2020.
  49. K. R. Knapp, M. C. Kruk, D. H. Levinson, H. J. Diamond, and C. J. Neumann, "The international best track archive for climate stewardship (ibtracs) unifying tropical cyclone data," Bulletin of the American Meteorological Society, vol. 91, no. 3, pp. 363-376, 2010.
  50. E. P. Diaconescu and R. Laprise, "Singular vectors in atmospheric sciences: A review," Earth-science reviews, vol. 113, no. 3-4, pp. 161- 175, 2012.

Cited by

See all 2

Metadata

Authors
Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., & Tian, Q.
Venue
arXiv
Publisher
arXiv
Published
2022
DOI
10.48550/arxiv.2211.02556
arXiv
2211.02556
References
2
Type
Preprint
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast. https://app.cochat.ai/papers/10.48550/arxiv.2211.02556
The paper
Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., & Tian, Q. (2022). Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast. arXiv. https://doi.org/10.48550/arxiv.2211.02556

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.