CoChat
Sign Up
PreprintCited by 396Meteorological Phenomena and SimulationsHydrological Forecasting Using AITraffic Prediction and Management Techniques

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Lead

Open access
Chen, Kang, Han, Tao, Gong, Junchao, Bai, Lei, Ling, Fenghua, Luo, Jing-Jia, Chen, Xi, Ma, Leiming, Zhang, Tianning, Su, Rui, Ci, Yuanzheng, Li, Bin, Yang, Xiaokang, Ouyang, Wanli·2023·arXiv
DOI 10.48550/arxiv.2304.02948arXiv 2304.02948

Preprint — published as 10.1038/s43247-025-02502-y

Open this paper in CoChat — free accountOpen PDF

Abstract

We present FengWu, an advanced data-driven global medium-range weather forecast system based on Artificial Intelligence (AI). Different from existing data-driven weather forecast methods, FengWu solves the medium-range forecast problem from a multi-modal and multi-task perspective. Specifically, a deep learning architecture equipped with model-specific encoder-decoders and cross-modal fusion Transformer is elaborately designed, which is learned under the supervision of an uncertainty loss to balance the optimization of different predictors in a region-adaptive manner. Besides this, a replay buffer mechanism is introduced to improve medium-range forecast performance. With 39-year data training based on the ERA5 reanalysis, FengWu is able to accurately reproduce the atmospheric dynamics and predict the future land and atmosphere states at 37 vertical levels on a 0.25° latitude-longitude resolution. Hindcasts of 6-hourly weather in 2018 based on ERA5 demonstrate that FengWu performs better than GraphCast in predicting 80\% of the 880 reported predictands, e.g., reducing the root mean square error (RMSE) of 10-day lead global z500 prediction from 733 to 651 $m^{2}/s^2$. In addition, the inference cost of each iteration is merely 600ms on NVIDIA Tesla A100 hardware. The results suggest that FengWu can significantly improve the forecast skill and extend the skillful global medium-range weather forecast out to 10.75 days lead (with ACC of z500 > 0.6) for the first time.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2304.02948

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Recent advances in MLWP provide greater accuracy and efficiency than NWP for non-probabilistic forecasts.

    “Recent advances in machine learning (ML)-based weather prediction (MLWP) have been shown to provide greater accuracy and efficiency than NWP for non-probabilistic forecasts2,3,13–18.”

    From Probabilistic weather forecasting with machine learning (2025) · cites this paper as [16]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 20

  1. Li Di. Meteorology in China, pages 1662-1664. Springer Netherlands, Dordrecht, 2008. ISBN 978-1-4020-4425-0. doi:10.1007/978-1-4020-4425-0_8787. URL https://doi.org/10.1007/978-1-4020-4425-0_8787. · DOI
  2. Stefan Rahmstorf and Dim Coumou. Increase of extreme events in a warming world. Proceedings of the National Academy of Sciences, 108(44):17905-17909, 2011.
  3. Liba Taub. Ancient meteorology. Routledge, 2004.
  4. Lennart Bengtsson. Medium-range forecasting at the ecmwf. In Advances in Geophysics, volume 28, pages 3-54. Elsevier, 1985.
  5. Tilmann Gneiting and Adrian E Raftery. Weather forecasting with ensemble methods. Science, 310(5746):248-249, 2005.
  6. Clifford F Mass and Ying-Hwa Kuo. Regional real-time numerical weather prediction: Current status and future potential. Bulletin of the American Meteorological Society, 79(2):253-264, 1998.
  7. Bert Bolin. Numerical forecasting with the barotropic model 1. Tellus, 7(1):27-49, 1955.
  8. Peter Lynch. The origins of computer weather prediction and climate modeling. Journal of computational physics, 227 (7):3431-3444, 2008.
  9. Peter Bauer, Alan Thorpe, and Gilbert Brunet. The quiet revolution of numerical weather prediction. Nature, 525 (7567):47-55, 2015.
  10. Stephan Rasp, Peter D Dueben, Sebastian Scher, Jonathan A Weyn, Soukayna Mouatadid, and Nils Thuerey. Weather- bench: a benchmark data set for data-driven weather forecasting. Journal of Advances in Modeling Earth Systems, 12(11):e2020MS002203, 2020.
  11. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770-778, 2016.
  12. Yuan Hu, Lei Chen, Zhibin Wang, and Hao Li. Swinvrnn: A data-driven ensemble forecasting model via learned distribution perturbation. Journal of Advances in Modeling Earth Systems, 15(2):e2022MS003211, 2023.
  13. Jaideep Pathak, Shashank Subramanian, Peter Harrington, Sanjeev Raja, Ashesh Chattopadhyay, Morteza Mardani, Thorsten Kurth, David Hall, Zongyi Li, Kamyar Azizzadenesheli, et al. Fourcastnet: A global data-driven high- resolution weather model using adaptive fourier neural operators. arXiv preprint arXiv:2202.11214, 2022. · arXiv
  14. Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020. · arXiv
  15. John Guibas, Morteza Mardani, Zongyi Li, Andrew Tao, Anima Anandkumar, and Bryan Catanzaro. Adaptive fourier neural operators: Efficient token mixers for transformers. arXiv preprint arXiv:2111.13587, 2021. · arXiv
  16. Kaifeng Bi, Lingxi Xie, Hengheng Zhang, Xin Chen, Xiaotao Gu, and Qi Tian. Pangu-weather: A 3d high-resolution model for fast and accurate global weather forecast. arXiv preprint arXiv:2211.02556, 2022. · arXiv
  17. Tom Schaul, John Quan, Ioannis Antonoglou, and David Silver. Prioritized experience replay. arXiv preprint arXiv:1511.05952, 2015. · arXiv
  18. Hans Hersbach, Bill Bell, Paul Berrisford, Shoji Hirahara, András Horányi, Joaquín Muñoz-Sabater, Julien Nicolas, Carole Peubey, Raluca Radu, Dinand Schepers, et al. The era5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999-2049, 2020.
  19. Norman P. Jouppi, George Kurian, Sheng Li, Peter Ma, Rahul Nagarajan, Lifeng Nai, Nishant Patil, Suvinay Subra- manian, Andy Swing, Brian Towles, Cliff Young, Xiang Zhou, Zongwei Zhou, and David Patterson. Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for embeddings. arXiv preprint arXiv:2304.01433, 2023. · arXiv
  20. Jack Choquette, Wishwesh Gandhi, Olivier Giroux, Nick Stam, and Ronny Krashinsky. Nvidia a100 tensor core gpu: Performance and innovation. IEEE Micro, 41(2):29-35, 2021.

Cited by

Sorted by citations

Metadata

Authors
Chen, K., Han, T., Gong, J., Bai, L., Ling, F., Luo, J.-J., Chen, X., Ma, L., Zhang, T., Su, R., Ci, Y., Li, B., Yang, X., & Ouyang, W.
Affiliations
  • University of Science and Technology of China (CN)
  • Shanghai Artificial Intelligence Laboratory (CN)
  • Shanghai Jiao Tong University (CN)
  • Nanjing University of Information Science and Technology (CN)
  • Chinese Academy of Sciences (CN)
  • Shanghai Meteorological Bureau (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2304.02948
arXiv
2304.02948
OpenAlex
W4362706666
Cited by
396
References
1
Citations by year
2026: 100 · 2025: 140 · 2024: 121 · 2023: 35
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Funders
  • Fudan University
  • Chinese University of Hong Kong
  • University of Science and Technology of China
  • European Centre for Medium-Range Weather Forecasts
  • National Key Research and Development Program of China (2020YFA0608000)
Topics
  • Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
  • Physical Sciences › Environmental Science › Environmental Engineering › Hydrological Forecasting Using AI
  • Social Sciences › Transportation › Traffic Prediction and Management Techniques
Keywords
multi-task learning, replay buffer, ERA5 reanalysis, atmospheric dynamics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review