The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Advance and prospectus of seasonal prediction: assessment of the APCC/CliPAS 14-model ensemble retrospective seasonal prediction (1980–2004)
Open accessAbstract
We assessed current status of multi-model ensemble (MME) deterministic and probabilistic seasonal prediction based on 25-year (1980–2004) retrospective forecasts performed by 14 climate model systems (7 one-tier and 7 two-tier systems) that participate in the Climate Prediction and its Application to Society (CliPAS) project sponsored by the Asian-Pacific Economic Cooperation Climate Center (APCC). We also evaluated seven DEMETER models’ MME for the period of 1981–2001 for comparison. Based on the assessment, future direction for improvement of seasonal prediction is discussed. We found that two measures of probabilistic forecast skill, the Brier Skill Score (BSS) and Area under the Relative Operating Characteristic curve (AROC), display similar spatial patterns as those represented by temporal correlation coefficient (TCC) score of deterministic MME forecast. A TCC score of 0.6 corresponds approximately to a BSS of 0.1 and an AROC of 0.7 and beyond these critical threshold values, they are almost linearly correlated. The MME method is demonstrated to be a valuable approach for reducing errors and quantifying forecast uncertainty due to model formulation. The MME prediction skill is substantially better than the averaged skill of all individual models. For instance, the TCC score of CliPAS one-tier MME forecast of Niño 3.4 index at a 6-month lead initiated from 1 May is 0.77, which is significantly higher than the corresponding averaged skill of seven individual coupled models (0.63). The MME made by using 14 coupled models from both DEMETER and CliPAS shows an even higher TCC score of 0.87. Effectiveness of MME depends on the averaged skill of individual models and their mutual independency. For probabilistic forecast the CliPAS MME gains considerable skill from increased forecast reliability as the number of model being used increases; the forecast resolution also increases for 2 m temperature but slightly decreases for precipitation. Equatorial Sea Surface Temperature (SST) anomalies are primary sources of atmospheric climate variability worldwide. The MME 1-month lead hindcast can predict, with high fidelity, the spatial–temporal structures of the first two leading empirical orthogonal modes of the equatorial SST anomalies for both boreal summer (JJA) and winter (DJF), which account for about 80–90% of the total variance. The major bias is a westward shift of SST anomaly between the dateline and 120°E, which may potentially degrade global teleconnection associated with it. The TCC score for SST predictions over the equatorial eastern Indian Ocean reaches about 0.68 with a 6-month lead forecast. However, the TCC score for Indian Ocean Dipole (IOD) index drops below 0.40 at a 3-month lead for both the May and November initial conditions due to the prediction barriers across July, and January, respectively. The MME prediction skills are well correlated with the amplitude of Niño 3.4 SST variation. The forecasts for 2 m air temperature are better in El Niño years than in La Niña years. The precipitation and circulation are predicted better in ENSO-decaying JJA than in ENSO-developing JJA. There is virtually no skill in ENSO-neutral years. Continuing improvement of the one-tier climate model’s slow coupled dynamics in reproducing realistic amplitude, spatial patterns, and temporal evolution of ENSO cycle is a key for long-lead seasonal forecast. Forecast of monsoon precipitation remains a major challenge. The seasonal rainfall predictions over land and during local summer have little skill, especially over tropical Africa. The differences in forecast skills over land areas between the CliPAS and DEMETER MMEs indicate potentials for further improvement of prediction over land. There is an urgent need to assess impacts of land surface initialization on the skill of seasonal and monthly forecast using a multi-model framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1966) · Medical Entomology and Zoology · Cited by 10,293
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Statistical Methods in the Atmospheric Sciences
Ramsey, P. H. (1996) · Technometrics · doi:10.1080/00401706.1996.10484553 · Cited by 7,601
A dipole mode in the tropical Indian Ocean
Saji, N. H., Goswami, B. N., Vinayachandran, P. N., & Yamagata, T. (1999) · Nature · doi:10.1038/43854 · Cited by 5,510
Self-citationXie, P., & Arkin, P. A. (1997) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(1997)078<2539:gpayma>2.0.co;2 · Cited by 4,307
ATMOSPHERIC TELECONNECTIONS FROM THE EQUATORIAL PACIFIC1
BJERKNES, J. (1969) · Monthly Weather Review · doi:10.1175/1520-0493(1969)097<0163:atftep>2.3.co;2 · Cited by 3,551
Pacific–East Asian Teleconnection: How Does ENSO Affect East Asian Climate?
Wang, B., Wu, R., & Fu, X. (2000) · Journal of Climate · doi:10.1175/1520-0442(2000)013<1517:peathd>2.0.co;2 · Cited by 2,916
Self-citationCoupled ocean–atmosphere dynamics in the Indian Ocean during 1997–98
Webster, P. J., Moore, A. M., Loschnigg, J. P., & Leben, R. R. (1999) · Nature · doi:10.1038/43848 · Cited by 2,144
GFDL's CM2 Global Coupled Climate Models. Part I: Formulation and Simulation Characteristics
Delworth, T. L., Broccoli, A. J., Rosati, A., Stouffer, R. J., Balaji, V., Beesley, J. A., Cooke, W. F., Dixon, K. W., Dunne, J., Dunne, K. A., et al. (2006) · Journal of Climate · doi:10.1175/jcli3629.1 · Cited by 1,690
Self-citationRoeckner, E., Arpe, K., Bengtsson, L. O., Christoph, M., Claussen, M. A., Dümenil, L., Esch, M., Giorgetta, M. A., Schlese, U., & Schulzweida, U. (1996) · CentAUR (University of Reading) · doi:10.17617/2.1781494 · Cited by 1,382
Possible impacts of Indian Ocean Dipole mode events on global climate
Saji, N., & Yamagata, T. (2003) · Climate Research · doi:10.3354/cr025151 · Cited by 1,157
Self-citationThe NCEP Climate Forecast System
Saha, S., Nadiga, S., Thiaw, C., Wang, J., Wang, W., Zhang, Q., Van den Dool, H. M., Pan, H.-L., Moorthi, S., Behringer, D., et al. (2006) · Journal of Climate · doi:10.1175/jcli3812.1 · Cited by 1,120
Stochastic representation of model uncertainties in the ECMWF ensemble prediction system
Buizza, R., Milleer, M., & Palmer, T. N. (1999) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712556006 · Cited by 1,103
Wang, B., Wu, R., & Lau, K.-M. (2001) · Journal of Climate · doi:10.1175/1520-0442(2001)014<4073:ivotas>2.0.co;2 · Cited by 1,060
Self-citationImproved Extended Reconstruction of SST (1854–1997)
Smith, T. M., & Reynolds, R. W. (2004) · Journal of Climate · doi:10.1175/1520-0442(2004)017<2466:ieros>2.0.co;2 · Cited by 1,031
Palmer, T. N., Alessandri, A., Andersen, U., Cantelaube, P., Davey, M., Délécluse, P., Déqué, M., Díez, E., Doblas-Reyes, F. J., Feddersen, H., et al. (2004) · Bulletin of the American Meteorological Society · doi:10.1175/bams-85-6-853 · Cited by 959 · cited 20×
“We also evaluated seven DEMETER models’ MME for the period of 1981–2001 for comparison.”
BackgroundMethodInfluentialThe New GFDL Global Atmosphere and Land Model AM2–LM2: Evaluation with Prescribed SST Simulations
(2004) · Journal of Climate · doi:10.1175/jcli-3223.1 · Cited by 854
Improved Weather and Seasonal Climate Forecasts from Multimodel Superensemble
Krishnamurti, T. N., Kishtawal, C. M., LaRow, T. E., Bachiochi, D. R., Zhang, Z., Williford, C. E., Gadgil, S., & Surendran, S. (1999) · Science · doi:10.1126/science.285.5433.1548 · Cited by 816
Self-citationAtmosphere–Warm Ocean Interaction and Its Impacts on Asian–Australian Monsoon Variation*
Wang, B., Wu, R., & Li, T. (2003) · Journal of Climate · doi:10.1175/1520-0442(2003)16<1195:aoiaii>2.0.co;2 · Cited by 764
Self-citationExperimental forecasts of El Niño
Cane, M. A., Zebiak, S. E., & Dolan, S. C. (1986) · Nature · doi:10.1038/321827a0 · Cited by 716
The rationale behind the success of multi-model ensembles in seasonal forecasting - I. Basic concept
Hagedorn, R., Doblas-Reyes, F. J., & Palmer, T. N. (2005) · Tellus A: Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v57i3.14657 · Cited by 710
Fundamental challenge in simulation and prediction of summer monsoon rainfall
Wang, B., Ding, Q., Fu, X., Kang, I., Jin, K., Shukla, J., & Doblas‐Reyes, F. (2005) · Geophysical Research Letters · doi:10.1029/2005gl022734 · Cited by 655
Self-citationMultimodel Ensemble Forecasts for Weather and Seasonal Climate
Krishnamurti, T. N., Kishtawal, C. M., Zhang, Z., LaRow, T., Bachiochi, D., Williford, E., Gadgil, S., & Surendran, S. (2000) · Journal of Climate · doi:10.1175/1520-0442(2000)013<4196:meffwa>2.0.co;2 · Cited by 627
Self-citationThe Seasonal Cycle over the Tropical Pacific in Coupled Ocean–Atmosphere General Circulation Models
Mechoso, C. R., Robertson, A. W., Barth, N., Davey, M. K., Delecluse, P., Gent, P. R., Ineson, S., Kirtman, B., Latif, M., Treut, H. L., et al. (1995) · Monthly Weather Review · doi:10.1175/1520-0493(1995)123<2825:tscott>2.0.co;2 · Cited by 560
Self-citationImpacts of recent El Niño Modoki on dry/wet conditions in the Pacific rim during boreal summer
Weng, H., Ashok, K., Behera, S. K., Rao, S. A., & Yamagata, T. (2007) · Climate Dynamics · doi:10.1007/s00382-007-0234-0 · Cited by 545
Self-citationCurrent status of ENSO prediction skill in coupled ocean–atmosphere models
Jin, E. K., Kinter, J. L., Wang, B., Park, C.-K., Kang, I.-S., Kirtman, B. P., Kug, J.-S., Kumar, A., Luo, J.-J., Schemm, J., et al. (2008) · Climate Dynamics · doi:10.1007/s00382-008-0397-3 · Cited by 491
Self-citationPredictability in the Midst of Chaos: A Scientific Basis for Climate Forecasting
Shukla, J. (1998) · Science · doi:10.1126/science.282.5389.728 · Cited by 488
Self-citationCharney, J. G., & Shukla, J. (1981) · Monsoon Dynamics · doi:10.1017/cbo9780511897580.009 · Cited by 482
Self-citationSkill and relative economic value of the ECMWF ensemble prediction system
Richardson, D. S. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656313 · Cited by 477
The MOGREPS short‐range ensemble prediction system
Bowler, N. E., Arribas, A., Mylne, K. R., Robertson, K. B., & Beare, S. E. (2008) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.234 · Cited by 468
A kinetic energy backscatter algorithm for use in ensemble prediction systems
Shutts, G. (2005) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/qj.04.106 · Cited by 457
STOIC: a study of coupled model climatology and variability in tropical ocean regions.
M., D., M., H., K., S., P., B., F., B., D., C., R., C., C., C., U., C., P., D., et al. (2002) · Climate Dynamics · doi:10.1007/s00382-001-0188-6 · Cited by 351
Doblas-Reyes, F. J., Hagedorn, R., & Palmer, T. N. (2005) · Tellus A: Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v57i3.14658 · Cited by 340
Ensemble Simulations of Asian–Australian Monsoon Variability by 11 AGCMs*
Wang, B., Kang, I.-S., & Lee, J.-Y. (2004) · Journal of Climate · doi:10.1175/1520-0442(2004)017<0803:esoamv>2.0.co;2 · Cited by 329
Self-citationThe unusual summer of 1994 in East Asia: IOD teleconnections
Guan, Z., & Yamagata, T. (2003) · Geophysical Research Letters · doi:10.1029/2002gl016831 · Cited by 327
Self-citationSeasonal Climate Predictability in a Coupled OAGCM Using a Different Approach for Ensemble Forecasts
Luo, J.-J., Masson, S., Behera, S., Shingu, S., & Yamagata, T. (2005) · Journal of Climate · doi:10.1175/jcli3526.1 · Cited by 295
Self-citationNCEP Dynamical Seasonal Forecast System 2000
Kanamitsu, M., Kumar, A., Juang, H.-M. H., Schemm, J.-K., Wang, W., Yang, F., Hong, S.-Y., Peng, P., Chen, W., Moorthi, S., et al. (2002) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(2002)083<1019:ndsfs>2.3.co;2 · Cited by 282
Self-citationENSIP: the El Niño simulation intercomparison project
Latif, M., Sperber, K., Arblaster, J., Braconnot, P., Chen, D., Colman, A., Cubasch, U., Cooper, C., Delecluse, P., Dewitt, D., et al. (2001) · Climate Dynamics · doi:10.1007/s003820100174 · Cited by 279
Self-citationA review of ENSO prediction studies
Latif, M., Barnett, T. P., Cane, M. A., Flügel, M., Graham, N. E., von Storch, H., Xu, J. S., & Zebiak, S. E. (1994) · Climate Dynamics · doi:10.1007/bf00208250 · Cited by 266
The Economic Value Of Ensemble-Based Weather Forecasts
Zhu, Y., Toth, Z., Wobus, R., Richardson, D., & Mylne, K. (2002) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(2002)083<0073:tevoeb>2.3.co;2 · Cited by 247
Advancing dynamical prediction of Indian monsoon rainfall
Krishna Kumar, K., Hoerling, M., & Rajagopalan, B. (2005) · Geophysical Research Letters · doi:10.1029/2004gl021979 · Cited by 235
Experimental Forecasts of the Indian Ocean Dipole Using a Coupled OAGCM
Luo, J.-J., Masson, S., Behera, S., & Yamagata, T. (2007) · Journal of Climate · doi:10.1175/jcli4132.1 · Cited by 209
Self-citationRoles of Indian and Pacific Ocean air–sea coupling in tropical atmospheric variability
Wu, R., & Kirtman, B. P. (2005) · Climate Dynamics · doi:10.1007/s00382-005-0003-x · Cited by 196
Self-citationMultimodel Ensembling in Seasonal Climate Forecasting at IRI
Barnston, A. G., Mason, S. J., Goddard, L., DeWitt, D. G., & Zebiak, S. E. (2003) · Bulletin of the American Meteorological Society · doi:10.1175/bams-84-12-1783 · Cited by 190
A probability and decision‐model analysis of PROVOST seasonal multi‐model ensemble integrations
Palmer, T. N., Branković, Č., & Richardson, D. S. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656703 · Cited by 189
The Impact of Ocean Initial Conditions on ENSO Forecasting with a Coupled Model
Rosati, A., Miyakoda, K., & Gudgel, R. (1997) · Monthly Weather Review · doi:10.1175/1520-0493(1997)125<0754:tiooic>2.0.co;2 · Cited by 170
Kang, I., Lee, J., & Park, C.-K. (2004) · Journal of Climate · Cited by 169
Self-citationGuilyardi, É., Gualdi, S., Slingo, J., Navarra, A., Delécluse, P., Cole, J., Madec, G., Roberts, M. J., Latif, M., & Terray, L. (2004) · Journal of Climate · doi:10.1175/jcli-3260.1 · Cited by 157
How are seasonal prediction skills related to models’ performance on mean state and annual cycle?
Lee, J., Wang, B., Kang, I., Shukla, J., Kumar, A., Kug, J., Schemm, J., Luo, J., Yamagata, T., Fu, X., et al. (2010) · Climate Dynamics · doi:10.1007/s00382-010-0857-4 · Cited by 155
Self-citationMulti-model spread and probabilistic seasonal forecasts in PROVOST
Doblas-Reyes, F. J., Déqué, M., & Piedelièvre, J.-P. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656705 · Cited by 153
Wang, B., Lee, J., Kang, I.-S., Shukla, J., Kug, J., Kumar, A., Schemm, J. E., Luo, J., Yamagata, T., & Park, C.-K. (2007) · Climate Dynamics · doi:10.1007/s00382-007-0310-5 · Cited by 145
Self-citationA probability and decision-model analysis of PROVOST seasonal multi-model ensemble integrations
Palmer, T. N., Branković, Č., & Richardson, D. S. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/smsqj.56702 · Cited by 133
An experimental coupled forecast system at the National Meteorological Center - Some early results
Ji, M., Kumar, A., & Leetmaa, A. (1994) · Tellus A Dynamic Meteorology and Oceanography · doi:10.1034/j.1600-0870.1994.t01-3-00006.x · Cited by 105
Self-citationA multi-model superensemble algorithm for seasonal climate prediction using DEMETER forecasts
Yun, W.-T., Stefanova, L., Mitra, A. K., Kumar, T. S. V. V., Dewar, W. K., & Krishnamurti, T. N. (2005) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v57i3.14699 · Cited by 98
Self-citationSeasonal climate predictability with Tier-one and Tier-two prediction systems
Kug, J., Kang, I., & Choi, D. (2007) · Climate Dynamics · doi:10.1007/s00382-007-0264-7 · Cited by 89
Self-citationKug, J., Kang, I., Lee, J., & Jhun, J. (2004) · Geophysical Research Letters · doi:10.1029/2003gl019209 · Cited by 87
Self-citationIndian Ocean Variability and Its Association with ENSO in a Global Coupled Model
Zhong, A., Hendon, H. H., & Alves, O. (2005) · Journal of Climate · doi:10.1175/jcli3493.1 · Cited by 77
Self-citationRetrospective ENSO Forecasts: Sensitivity to Atmospheric Model and Ocean Resolution
Schneider, E. K., Kirtman, B. P., DeWitt, D. G., Rosati, A. J., Ji, L., & Tribbia, J. J. (2003) · Monthly Weather Review · Cited by 56
Self-citationMJO in the NCAR CAM2 with the Tiedtke Convective Scheme*
Liu, P., Wang, B., Sperber, K. R., Li, T., & Meehl, G. A. (2005) · Journal of Climate · doi:10.1175/jcli3458.1 · Cited by 54
Self-citationTheoretical examination of a multi‐model composite for seasonal prediction
Yoo, J. H., & Kang, I. (2005) · Geophysical Research Letters · doi:10.1029/2005gl023513 · Cited by 43
Self-citationAnderson, D. L. T., Stockdale, T., Balmaseda, M., Ferranti, L., Vitart, F., Doblas-Reyes, R., Hagedorn, R., Jung, T. J., Vidard, A., & Palmer, T. N. (2002) · Helmholtz-Zentrum für Polar-und Meeresforschung (Alfred-Wegener-Institut) · Cited by 38
Global Sea Surface Temperature Prediction Using a Multimodel Ensemble
Kug, J., Lee, J., & Kang, I. (2007) · Monthly Weather Review · doi:10.1175/mwr3458.1 · Cited by 38
Self-citationVintzileos, A., Delécluse, P., & Sadourny, R. (1999) · Climate Dynamics · doi:10.1007/s003820050267 · Cited by 17
(2000) · doi:10.1175/1520-0477(2000)081<2593:dsp>2.3.co;2
Beljaars (1997) · doi:10.1175/1520-0442(1997)010
Cited by
Indo-western Pacific ocean capacitor and coherent climate anomalies in post-ENSO summer: A review
Xie, S.-P., Kosaka, Y., Du, Y., Hu, K., Chowdary, J. S., & Huang, G. (2016) · Advances in Atmospheric Sciences · doi:10.1007/s00376-015-5192-6 · Cited by 771
Wang, B., Xiang, B., & Lee, J.-Y. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1214626110 · Cited by 658
Self-citationLee, J.-Y., Wang, B., Wheeler, M. C., Fu, X., Waliser, D. E., & Kang, I.-S. (2013) · Climate Dynamics · doi:10.1007/s00382-012-1544-4 · Cited by 534
Self-citationSeasonal climate predictability and forecasting: status and prospects
Doblas‐Reyes, F. J., García‐Serrano, J., Lienert, F., Biescas, A. P., & Rodrigues, L. R. L. (2013) · WIREs Climate Change · doi:10.1002/wcc.217 · Cited by 478
Drought over East Asia: A Review
Zhang, L., & Zhou, T. (2015) · Journal of Climate · doi:10.1175/jcli-d-14-00259.1 · Cited by 384
Self-citation
Metadata
- Authors
- Wang, B., Lee, J.-Y., Kang, I.-S., Shukla, J., Park, C.-K., Kumar, A., Schemm, J., Cocke, S., Kug, J.-S., Luo, J.-J., Zhou, T., Wang, B., Fu, X., Yun, W.-T., Alves, O., Jin, E. K., Kinter, J., Kirtman, B., Krishnamurti, T., Lau, N. C., Lau, W., Liu, P., Pegion, P., Rosati, T., Schubert, S., Stern, W., Suarez, M., & Yamagata, T.
- Venue
- Climate Dynamics
- Published
- 2008-09-16
- Volume
- 33
- Issue
- 1
- Pages
- 93-117
- ISSN
- 0930-7575 (ISSN-L)
- 1432-0894
- OpenAlex
- W2136647178
- Cited by
- 409
- References
- 65
- FWCI
- 14.69
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.