The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
On the reliability of seasonal climate forecasts
Open accessAbstract
Seasonal climate forecasts are being used increasingly across a range of application sectors. A recent UK governmental report asked: how good are seasonal forecasts on a scale of 1–5 (where 5 is very good), and how good can we expect them to be in 30 years time? Seasonal forecasts are made from ensembles of integrations of numerical models of climate. We argue that ‘goodness’ should be assessed first and foremost in terms of the probabilistic reliability of these ensemble-based forecasts; reliable inputs are essential for any forecast-based decision-making. We propose that a ‘5’ should be reserved for systems that are not only reliable overall, but where, in particular, small ensemble spread is a reliable indicator of low ensemble forecast error. We study the reliability of regional temperature and precipitation forecasts of the current operational seasonal forecast system of the European Centre for Medium-Range Weather Forecasts, universally regarded as one of the world-leading operational institutes producing seasonal climate forecasts. A wide range of ‘goodness’ rankings, depending on region and variable (with summer forecasts of rainfall over Northern Europe performing exceptionally poorly) is found. Finally, we discuss the prospects of reaching ‘5’ across all regions and variables in 30 years time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ERA‐Interim reanalysis: configuration and performance of the data assimilation system
Dee, D. P., Uppala, S. M., Simmons, A. J., Berrisford, P., Poli, P., Kobayashi, S., Andrae, U., Balmaseda, M. A., Balsamo, G., Bauer, P., et al. (2011) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.828 · Cited by 24,480
Deterministic Nonperiodic Flow
Lorenz, E. N. (1963) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(1963)020<0130:dnf>2.0.co;2 · Cited by 19,398
Statistical Methods in the Atmospheric Sciences
Ramsey, P. H. (1996) · Technometrics · doi:10.1080/00401706.1996.10484553 · Cited by 7,601
Adler, R. F., Huffman, G. J., Chang, A., Ferraro, R., Xie, P.-P., Janowiak, J., Rudolf, B., Schneider, U., Curtis, S., Bolvin, D., et al. (2003) · Journal of Hydrometeorology · doi:10.1175/1525-7541(2003)004<1147:tvgpcp>2.0.co;2 · Cited by 3,808
The NCEP Climate Forecast System Version 2
Saha, S., Moorthi, S., Wu, X., Wang, J., Nadiga, S., Tripp, P., Behringer, D., Hou, Y.-T., Chuang, H.-Y., Iredell, M., et al. (2014) · Journal of Climate · doi:10.1175/jcli-d-12-00823.1 · Cited by 3,354
Forecast Verification: A Practitioner's Guide in Atmospheric Science
(2011) · Wiley eBooks · doi:10.1002/9781119960003 · Cited by 1,267
Stochastic representation of model uncertainties in the ECMWF ensemble prediction system
Buizza, R., Milleer, M., & Palmer, T. N. (1999) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712556006 · Cited by 1,103
Self-citationStatistical Methods in the Atmospheric Sciences
(2011) · International Geophysics · doi:10.1016/c2010-0-65519-2 · Cited by 1,063
Adler, R., Sapiano, M., Huffman, G., Wang, J.-J., Gu, G., Bolvin, D., Chiu, L., Schneider, U., Becker, A., Nelkin, E., et al. (2018) · Atmosphere · doi:10.3390/atmos9040138 · Cited by 982
Experimental forecasts of El Niño
Cane, M. A., Zebiak, S. E., & Dolan, S. C. (1986) · Nature · doi:10.1038/321827a0 · Cited by 716
Current status of ENSO prediction skill in coupled ocean–atmosphere models
Jin, E. K., Kinter, J. L., Wang, B., Park, C.-K., Kang, I.-S., Kirtman, B. P., Kug, J.-S., Kumar, A., Luo, J.-J., Schemm, J., et al. (2008) · Climate Dynamics · doi:10.1007/s00382-008-0397-3 · Cited by 491
Palmer, T. N. (2001) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712757202 · Cited by 466
Self-citationThe prospects for seasonal forecasting—A review paper
Palmer, T. N., & Anderson, D. L. T. (1994) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712051802 · Cited by 369
Self-citationGiorgi, F., & Francisco, R. (2000) · Climate Dynamics · doi:10.1007/pl00013733 · Cited by 314
Toward Seamless Prediction: Calibration of Climate Change Projections Using Seasonal Forecasts
Palmer, T. N., Doblas-Reyes, F. J., Weisheimer, A., & Rodwell, M. J. (2008) · Bulletin of the American Meteorological Society · doi:10.1175/bams-89-4-459 · Cited by 294
Self-citationGlobal seasonal rainfall forecasts using a coupled ocean–atmosphere model
Stockdale, T. N., Anderson, D. L. T., Alves, J. O. S., & Balmaseda, M. A. (1998) · Nature · doi:10.1038/32861 · Cited by 285
Weisheimer, A., Doblas‐Reyes, F. J., Palmer, T. N., Alessandri, A., Arribas, A., Déqué, M., Keenlyside, N., MacVean, M., Navarra, A., & Rogel, P. (2009) · Geophysical Research Letters · doi:10.1029/2009gl040896 · Cited by 285
Self-citationKim, H.-M., Webster, P. J., & Curry, J. A. (2012) · Climate Dynamics · doi:10.1007/s00382-012-1364-6 · Cited by 241
Jung, T., Miller, M. J., Palmer, T. N., Towers, P., Wedi, N., Achuthavarier, D., Adams, J. M., Altshuler, E. L., Cash, B. A., Kinter, J. L., et al. (2012) · Journal of Climate · doi:10.1175/jcli-d-11-00265.1 · Cited by 241
Self-citationThe GloSea4 Ensemble Prediction System for Seasonal Forecasting
Arribas, A., Glover, M., Maidens, A., Peterson, K., Gordon, M., MacLachlan, C., Graham, R., Fereday, D., Camp, J., Scaife, A. A., et al. (2011) · Monthly Weather Review · doi:10.1175/2010mwr3615.1 · Cited by 203
Cagnazzo, C., & Manzini, E. (2009) · Journal of Climate · doi:10.1175/2008jcli2549.1 · Cited by 195
Palmer, T. N. (2012) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.1923 · Cited by 195
Self-citationImpact of the QBO on surface winter climate
Marshall, A. G., & Scaife, A. A. (2009) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2009jd011737 · Cited by 185
ECMWF seasonal forecast system 3 and its prediction of sea surface temperature
Stockdale, T. N., Anderson, D. L. T., Balmaseda, M. A., Doblas-Reyes, F., Ferranti, L., Mogensen, K., Palmer, T. N., Molteni, F., & Vitart, F. (2011) · Climate Dynamics · doi:10.1007/s00382-010-0947-3 · Cited by 163
Self-citationOn Using “Climatology” as a Reference Strategy in the Brier and Ranked Probability Skill Scores
Mason, S. J. (2004) · Monthly Weather Review · doi:10.1175/1520-0493(2004)132<1891:oucaar>2.0.co;2 · Cited by 146
Simulating regime structures in weather and climate prediction models
Dawson, A. R., Palmer, T. N., & Corti, S. (2012) · Geophysical Research Letters · doi:10.1029/2012gl053284 · Cited by 144
Self-citationOn the predictability of the extreme summer 2003 over Europe
Weisheimer, A., Doblas-Reyes, F. J., Jung, T., & Palmer, T. N. (2011) · Geophysical Research Letters · doi:10.1029/2010gl046455 · Cited by 119
Self-citationWeisheimer, A., Corti, S., Palmer, T. N., & Vitart, F. (2014) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2013.0290 · Cited by 114
Self-citationAn Earth-System Prediction Initiative for the Twenty-First Century
Shapiro, M. A., Shukla, J., Brunet, G., Nobre, C. A., Béland, M., Dole, R. M., Trenberth, K. E., Anthes, R. A., Asrar, G., Barrie, L. A., et al. (2010) · Bulletin of the American Meteorological Society · doi:10.1175/2010bams2944.1 · Cited by 99
Self-citationAssessment of representations of model uncertainty in monthly and seasonal forecast ensembles
Weisheimer, A., Palmer, T. N., & Doblas-Reyes, F. J. (2011) · Geophysical Research Letters · doi:10.1029/2011gl048123 · Cited by 95
Self-citationThe new ECMWF seasonal forecast system (System 4)
Molteni, F., Stockdale, T., Balmaseda, M., Balsamo, G., Buizza, R., Ferranti, L., Magnusson, L., Mogensen, K. S., Palmer, T., & Vitart, F. (2011) · European Centre for Medium-Range Weather Forecasts · doi:10.21957/4nery093i · Cited by 57
Self-citationThe extreme forecast index at the seasonal scale
Dutra, E., Diamantakis, M., Tsonevsky, I., Zsótér, E., Wetterhall, F., Stockdale, T., Richardson, D. S., & Pappenberger, F. (2013) · Atmospheric Science Letters · doi:10.1002/asl2.448 · Cited by 22
Verification of forecasts expressed in terms of probability
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078%3c0001:vofeit%3e2.0.co;2
A New Vector Partition of the Probability Score
(1973) · doi:10.1175/1520-0450(1973)012<0595:anvpot>2.0.co;2
VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078<0001:vofeit>2.0.co;2
Cited by
Miralles, D. G., Gentine, P., Seneviratne, S. I., & Teuling, A. J. (2019) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13912 · Cited by 1,080
SEAS5: the new ECMWF seasonal forecast system
Johnson, S. J., Stockdale, T. N., Ferranti, L., Balmaseda, M. A., Molteni, F., Magnusson, L., Tietsche, S., Decremer, D., Weisheimer, A., Balsamo, G., et al. (2019) · Geoscientific Model Development · doi:10.5194/gmd-12-1087-2019 · Cited by 771
Self-citationThe influence of Arctic amplification on mid-latitude summer circulation
Coumou, D., Di Capua, G., Vavrus, S., Wang, L., & Wang, S. (2018) · Nature Communications · doi:10.1038/s41467-018-05256-8 · Cited by 598
Geographical landslide early warning systems
Guzzetti, F., Gariano, S. L., Peruccacci, S., Brunetti, M. T., Marchesini, I., Rossi, M., & Melillo, M. (2020) · Earth-Science Reviews · doi:10.1016/j.earscirev.2019.102973 · Cited by 596
A signal-to-noise paradox in climate science
Scaife, A. A., & Smith, D. (2018) · npj Climate and Atmospheric Science · doi:10.1038/s41612-018-0038-4 · Cited by 411
Metadata
- Authors
- Weisheimer, A., & Palmer, T. N.
- Venue
- Journal of The Royal Society Interface
- Publisher
- The Royal Society
- Published
- 2014-07-06
- Volume
- 11
- Issue
- 96
- Pages
- 20131162
- ISSN
- 1742-5662 (ISSN-L)
- 1742-5689
- OpenAlex
- W2063103349
- Cited by
- 342
- References
- 35
- FWCI
- 16.28
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.