Development of a European Multimodel Ensemble System for Seasonal-to-Interannual Prediction (DEMETER).
Open accessAbstract
A multi-model ensemble-based system for seasonal-to-interannual prediction has been developed in a joint European project known as DEMETER (Development of a European Multimodel Ensemble Prediction System for Seasonal to Interannual Prediction). The DEMETER system comprises seven global atmosphere–ocean coupled models, each running from an ensemble of initial conditions. Comprehensive hindcast evaluation demonstrates the enhanced reliability and skill of the multimodel ensemble over a more conventional single-model ensemble approach. In addition, innovative examples of the application of seasonal ensemble forecasts in malaria and crop yield prediction are discussed. The strategy followed in DEMETER deals with important problems such as communication across disciplines, downscaling of climate simulations, and use of probabilistic forecast information in the applications sector, illustrating the economic value of seasonal-to-interannual prediction for society as a whole.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Earlier work has shown that forecasts combining several models usually outperform forecasts from one model.
“Numerous studies have demonstrated that multimodel forecasts are generally more skillful than single-model forecasts (Krishnamurti et al. 1999;Kharin and Zwiers 2002;Palmer et al. 2004;van Oldenborgh et al. 2005;Kug et al. 2007).”
From Skill of Multimodel ENSO Probability Forecasts (2008) · cites this paper as Palmer et al. 2004
Equally weighted multimodel combination on average improves the reliability of climate projections.
“The least surprising conclusion to be drawn is probably that equally weighted multimodel combination on average improves the reliability of climate projectionsa conclusion that is fully consistent with what is known from many verification studies in weather and seasonal forecasting (e.g., Hagedorn et al. 2005;Palmer et al. 2004;Weigel et al. 2008b).”
From Risks of Model Weighting in Multimodel Climate Projections (2010) · cites this paper as Palmer et al. 2004
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058 · see citing works
Statistical Methods in the Atmospheric Sciences
Ramsey, P. H., & Wilks, D. S. (1996) · Technometrics · doi:10.2307/1271312 · Cited by 7,681 · see citing works
Gordon, C., Cooper, C., Senior, C. A., Banks, H. T., Gregory, J. M., Johns, T. C., Mitchell, J. F. B., & Wood, R. (2000) · Climate Dynamics · doi:10.1007/s003820050010 · Cited by 2,576 · see citing works
The impact of new physical parametrizations in the Hadley Centre climate model: HadAM3
Pope, V. D., Gallani, M. L., Rowntree, P. R., & Stratton, R. A. (2000) · Climate Dynamics · doi:10.1007/s003820050009 · Cited by 1,542 · see citing works
Downscaling general circulation model output: a review of methods and limitations
Wilby, R. L., & Wigley, T. M. L. (1997) · Progress in Physical Geography Earth and Environment · doi:10.1177/030913339702100403 · Cited by 1,518 · see citing works
Roeckner, E., Arpe, K., Bengtsson, L. O., Christoph, M., Claussen, M. A., Dümenil, L., Esch, M., Giorgetta, M. A., Schlese, U., & Schulzweida, U. (1996) · CentAUR (University of Reading) · doi:10.17617/2.1781494 · Cited by 1,382 · see citing works
Stochastic simulation of daily precipitation, temperature, and solar radiation
Richardson, C. W. (1981) · Water Resources Research · doi:10.1029/wr017i001p00182 · Cited by 1,299 · see citing works
The Tropical Ocean‐Global Atmosphere observing system: A decade of progress
McPhaden, M., Busalacchi, A., Cheney, R., Donguy, J., Gage, K., Halpern, D., Ji, M., Julian, P. R., Meyers, G., Mitchum, G., et al. (1998) · Journal of Geophysical Research Atmospheres · doi:10.1029/97jc02906 · Cited by 1,140 · see citing works
Introduction to special section: Regional Climate Modeling Revisited
Giorgi, F., & Mearns, L. O. (1999) · Journal of Geophysical Research Atmospheres · doi:10.1029/98jd02072 · Cited by 1,051 · see citing works
The Max-Planck-Institute global ocean/sea ice model with orthogonal curvilinear coordinates
Marsland, S., Helmuth Haak, G., Jungclaus, J. H., et al. (2002) · Ocean Modelling · doi:10.1016/s1463-5003(02)00015-x · Cited by 913 · see citing works
OPA 8.1 Ocean General Circulation Model reference manual
Madec, G., Delécluse, P., Imbard, M., & Lévy, C. (1998) · HAL · Cited by 684 · see citing works
Potential Uses and Limitations of Crop Models
Boote, K. J., Jones, J. W., & Pickering, N. B. (1996) · Agronomy Journal · doi:10.2134/agronj1996.00021962008800050005x · Cited by 608 · see citing works
Contribution of agrometeorology to the simulation of crop production and its applications
Hoogenboom, G. (2000) · Agricultural and Forest Meteorology · doi:10.1016/s0168-1923(00)00108-8 · Cited by 570 · see citing works
Predictability in the Midst of Chaos: A Scientific Basis for Climate Forecasting
Shukla, J. (1998) · Science · doi:10.1126/science.282.5389.728 · Cited by 499 · see citing works
Skill and relative economic value of the ECMWF ensemble prediction system
Richardson, D. S. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656313 · Cited by 491 · see citing works
Palmer, T. N. (2001) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712757202 · Cited by 469 · see citing works
Self-citationCurrent approaches to seasonal to interannual climate predictions
Goddard, L., Mason, S., Zebiak, S., Ropelewski, C., Basher, R., & Cane, M. (2001) · International Journal of Climatology · doi:10.1002/joc.636 · Cited by 394 · see citing works
The intolerable burden of malaria: a new look at the numbers
Jg, B., Egan, A. F., & Keusch, G. T. (2001) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2001.64.iv · Cited by 357 · see citing works
Making Climate Forecasts Matter
National Research Council (1999) · National Academies Press eBooks · doi:10.17226/6370 · Cited by 285 · see citing works
Global seasonal rainfall forecasts using a coupled ocean–atmosphere model
Stockdale, T., Anderson, D. L. T., Alves, J. O. S., & Balmaseda, M. (1998) · Nature · doi:10.1038/32861 · Cited by 285 · see citing works
The economic value of ensemble forecasts as a tool for risk assessment: From days to decades
Palmer, T. N. (2002) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/0035900021643593 · Cited by 277 · see citing works
Self-citationRevision of convection, radiation and cloud schemes in the ECMWF Integrated Forecasting System
Gregory, D., Morcrette, J., Jakob, C., Beljaars, A. C. M., & Stockdale, T. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656607 · Cited by 244 · see citing works
A probability and decision‐model analysis of PROVOST seasonal multi‐model ensemble integrations
Palmer, T., Branković, Č., & Richardson, D. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656703 · Cited by 231 · see citing works
Self-citationEntekhabi, D., Asrar, G., Betts, A. K., Beven, K. J., Bras, R. L., Duffy, C. J., Dunne, T., Koster, R. D., Lettenmaier, D. P., McLaughlin, D. B., et al. (1999) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(1999)080 · Cited by 230 · see citing works
RECENT CHANGES IN FROST DAYS AND THE FROST-FREE SEASON IN THE UNITED STATES
Easterling, D. R. (2002) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477-83.9.1327 · Cited by 216 · see citing works
Predicting malaria seasons in Kenya using multitemporal meteorological satellite sensor data
Hay, S. I., Snow, R. W., & Rogers, D. J. (1998) · Transactions of the Royal Society of Tropical Medicine and Hygiene · doi:10.1016/s0035-9203(98)90936-1 · Cited by 200 · see citing works
Rummukainen, M., Räisänen, J., Bringfelt, B., et al. (2001) · Climate Dynamics · doi:10.1007/s003820000109 · Cited by 167 · see citing works
Multi‐model spread and probabilistic seasonal forecasts in PROVOST
Doblas-Reyes, F. J., Déqué, M., & Piedelièvre, J.-P. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656705 · Cited by 150 · see citing works
Self-citationClimate: The Influence of Aerosols
Charlson, R. J., & Pilat, M. J. (1969) · Journal of applied meteorology · doi:10.1175/1520-0450(1969)008 · Cited by 145 · see citing works
A synthesis of regional climate change simulations—A Scandinavian perspective
Christensen, J. H., Räisänen, J., Iversen, T., et al. (2001) · Geophysical Research Letters · doi:10.1029/2000gl012196 · Cited by 119 · see citing works
Coarse-grained stochastic models for tropical convection and climate
Khouider, B., Majda, A. J., & Katsoulakis, M. A. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1634951100 · Cited by 117 · see citing works
An analysis of multimodel ensemble predictions for seasonal climate anomalies
Peng, P., Kumar, A., van den Dool, H., et al. (2002) · Journal of Geophysical Research Atmospheres · doi:10.1029/2002jd002712 · Cited by 114 · see citing works
Multi-model seasonal hindcasts over the Euro-Atlantic: skill scores and dynamic features
Pavan, V., & Doblas-Reyes, F. J. (2000) · Climate Dynamics · doi:10.1007/s003820000063 · Cited by 109 · see citing works
Self-citationVerification of intense precipitation forecasts from single models and ensemble prediction systems
Atger, F. (2001) · Nonlinear processes in geophysics · doi:10.5194/npg-8-401-2001 · Cited by 101 · see citing works
Seasonal skill and predictability of ECMWF PROVOST ensembles
Branković, Č., & Palmer, T. N. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656704 · Cited by 100 · see citing works
Self-citationMulti-model spread and probabilistic seasonal forecasts in PROVOST
Doblas-Reyes, F. J., Déqué, M., & Piedelièvre, J.-P. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/smsqj.56704 · Cited by 85 · see citing works
Self-citationAn assessment of seasonal predictability using atmospheric general circulation models
Graham, R., Evans, A., Mylne, K., et al. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656712 · Cited by 84 · see citing works
Self-citationStraus, D. M., & Shukla, J. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656716 · Cited by 75 · see citing works
Climate change and agriculture in Europe: assessment of impacts and adaptations.
Harrison, P. A., Butterfield, R., & Downing, T. (1995) · Cited by 63 · see citing works
AEGIS/WIN: A Computer Program for the Application of Crop Simulation Models Across Geographic Areas
Engel, T. P., Hoogenboom, G., Jones, J. W., et al. (1997) · Agronomy Journal · doi:10.2134/agronj1997.00021962008900060012x · Cited by 59 · see citing works
Skill and relative economic value of the ECMWF ensemble prediction system
Richardson, D. S. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/smsqj.56312 · Cited by 57 · see citing works
Is the Coriolis Force Really Responsible for the Inertial Oscillation?
Durran, D. R. (1993) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(1993)074 · Cited by 56 · see citing works
An assessment of seasonal predictability using atmospheric general circulation models
GRAHAM, R., EVANS, A., MYLNE, K., et al. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/smsqj.56711 · Cited by 53 · see citing works
Self-citationStraus, D. M., & Shukla, J. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/smsqj.56715 · Cited by 47 · see citing works
Current approaches to seasonal to interannual climate predictions
Goddard, L., Mason, S. J., Zebiak, S. E., et al. (2001) · International Journal of Climatology · doi:10.1002/joc.636.abs · Cited by 44 · see citing works
Revision of convection, radiation and cloud schemes in the ECMWF Integrated Forecasting System
Gregory, D., MORCRETTE, J., Jakob, C., et al. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/smsqj.56607 · Cited by 43 · see citing works
Weather, climate, and hydrologic forecasting for the US Southwest: a survey
Hartmann, H., Bales, R. C., & Sorooshian, S. (2002) · Climate Research · doi:10.3354/cr021239 · Cited by 41 · see citing works
Forecasting disease risk with seasonal climate predictions
Thomson, M. C., Palmer, T. N., Morse, A. P., et al. (2000) · The Lancet · doi:10.1016/s0140-6736(05)74616-x · Cited by 30 · see citing works
Self-citationUsing Crop Models for Sustainability and Environmental Quality Assessment
Singh, U., & Thornton, P. K. (1992) · Outlook on Agriculture · doi:10.1177/003072709202100310 · Cited by 28 · see citing works
Seasonal predictability of tropical rainfall: probabilistic formulation and validation
Déqué, M. (2001) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v53i4.12223 · Cited by 26 · see citing works
Self-citationDownscaling general circulation model output: A reappraisal of methods and limitations
Wilby, W., & Wigley, L. (2000) · Cited by 16 · see citing works
THE WEATHER RISK MANAGEMENT INDUSTRY'S CLIMATE FORECAST AND DATA NEEDS
Murnane, R. J., Crowe, M., Eustis, A., et al. (2002) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477-83.8.1193 · Cited by 14 · see citing works
Seasonal predictability of tropical rainfall: probabilistic formulation and validation
Déqué, M. (2001) · Tellus A Dynamic Meteorology and Oceanography · doi:10.1111/j.1600-0870.2001.00500.x · Cited by 14 · see citing works
Self-citationCrop growth monitoring and yield forecasting at regional and national scale
van der Wal, T. (1995) · Cited by 13 · see citing works
Latif, M. (1999) · doi:10.1175/1520-0442(1999)012
Self-citation
Flagged first, then by citations
Research works printed but not linked: 8
- Alves, O., G. Wang, A. Zhong, N. Smith, G. Warren, A. Marshall, F. Tzeitkin, and A. Schiller, 2002: POAMA: Bureau of Meteorology operational coupled model seasonal forecast system. Proc. ECMWF Workshop on the Role of the Upper Ocean in Medium and Extended Range Forecasting, Read- ing, United Kingdom, ECMWF, 22-32.
- Délécluse, P., and G. Madec, 1999: Ocean modeling and the role of the ocean in the climate system. Modeling the Earth's Climate and Its Variability, W. R. Holland, S. Joussaume, and F. David, Eds., Elsevier Science, 237-313.
- Fernández, J., J. del Hoyo, A. Mestre, and C. Peral, 2001: Local probabilistic forecast of precipitation by the use of an analogical approach. Proc. Fifth European Conf. on Applications of Meteorology (ECAM 2001), Budapest, Hungary, European Meteorological Soci- ety, 28-29.
- Hoshen, M. B., E. Worrall, S. J. Connor, A. P. Morse, and M. C. Thomson, 2004: Weather based modelling of the epidemiology of malaria. GEOMED, in press.
- Livezey, R. E., 1999: Field intercomparison. Analysis of Climate Variability: Applications of Statistical Tech- niques, H. von Storch and A. Navarra, Eds., Springer, 176-177.
- Marletto, V., L. Criscuolo, and M. R. M. Van Soetendael, 2001: Implementation of WOFOST in the framework of the CRITERIA geographical tool. Proc. Second Int. Symp. on Modeling Cropping Systems, Florence, Italy, European Society for Agronomy, 219-220.
- McCarthy, J. J., O. F. Canziani, N. A. Leary, D. J. Dokken, and K. S. White, Eds., 2001: Climate Change 2001: Impacts, Adaptation & Vulnerability, Contribution of Working Group II to the Third Assessment Report of the Intergovernmental Panel on Climate Change (IPCC). Cambridge University Press, 1000 pp. [Avail- able online at http://www.grida.no/climate/ipcc_tar/ wg2/359.htm.
- Terres, J.-M., 1999: The Crop Growth Monitoring Sys- tem implemented by JRC/ARIS unit for the informa- tion needs of the EC DG VI-Agriculture. Proc. Int. Symp. on Modeling Cropping Systems, Cataluña, Spain, European Society for Agronomy, Division Agroclimatology and Agronomic Modeling, EX 18746/C ORA/PRO 60194R, 261-264.
Cited by
Sorted by citations
Weather Forecasting with Ensemble Methods
Gneiting, T., & Raftery, A. E. (2005) · Science · doi:10.1126/science.1115255 · Cited by 636 · see citing works
Malaria early warnings based on seasonal climate forecasts from multi-model ensembles
Thomson, M. C., Doblas-Reyes, F. J., Mason, S. J., Hagedorn, R., Connor, S. J., Phindela, T., Morse, A. P., & Palmer, T. N. (2006) · Nature · doi:10.1038/nature04503 · Cited by 470 · see citing works
Self-citationRisks of Model Weighting in Multimodel Climate Projections
Weigel, A. P., Knutti, R., Liniger, M. A., & Appenzeller, C. (2010) · Journal of Climate · doi:10.1175/2010jcli3594.1 · Cited by 386 · see citing works
The Discrete Brier and Ranked Probability Skill Scores
Weigel, A. P., Liniger, M. A., & Appenzeller, C. (2007) · Monthly Weather Review · doi:10.1175/mwr3280.1 · Cited by 254 · see citing works
Ensemble size: How suboptimal is less than infinity?
Leutbecher, M. (2019) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3387 · Cited by 126 · see citing works
Stephenson, D. B., Coelho, C. A. S., Doblas-Reyes, F. J., & Balmaseda, M. (2005) · Tellus A: Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v57i3.14664 · Cited by 111 · see citing works
Self-citationEvolution of model systematic errors in the tropical Atlantic basin from coupled climate hindcasts.
Huang, B., Hu, Z.-Z., & Jha, B. (2007) · Climate Dynamics · doi:10.1007/s00382-006-0223-8 · Cited by 95 · see citing works
Guber, A. K., Pachepsky, Y. A., van Genuchten, M. T., Rawls, W. J., Simunek, J., Jacques, D., Nicholson, T. J., & Cady, R. E. (2006) · Vadose Zone Journal · doi:10.2136/vzj2005.0111 · Cited by 91 · see citing works
Seasonal ensemble forecasts: Are recalibrated single models better than multimodels?
Weigel, A. P., Liniger, M. A., & Appenzeller, C. (2009) · Monthly Weather Review · doi:10.1175/2008mwr2773.1 · Cited by 66 · see citing works
Skill of Multimodel ENSO Probability Forecasts
Tippett, M. K., & Barnston, A. G. (2008) · Monthly Weather Review · doi:10.1175/2008mwr2431.1 · Cited by 64 · see citing works
Soil moisture memory and West African monsoon predictability: Artefact or reality?
Douville, H., Conil, S., Tyteca, S., & Voldoire, A. (2007) · Climate Dynamics · doi:10.1007/s00382-006-0207-8 · Cited by 60 · see citing works
Weigel, A. P., Liniger, M. A., & Appenzeller, C. (2007) · Monthly Weather Review · doi:10.1175/mwr3428.1 · Cited by 35 · see citing works
- Authors
- Palmer, T. N., Alessandri, A., Andersen, U., Cantelaube, P., Davey, M., Délécluse, P., Déqué, M., Díez, E., Doblas-Reyes, F. J., Feddersen, H., Graham, R., Gualdi, S., Guérémy, J.-F., Hagedorn, R., Hoshen, M., Keenlyside, N., Latif, M., Lazar, A., Maisonnave, E., Marletto, V., Morse, A. P., Orfila, B., Rogel, P., Terres, J.-M., & Thomson, M. C.
- Affiliations
- European Centre for Medium-Range Weather Forecasts (GB)
- Danish Meteorological Institute (DK)
- European Commission (BE)
- Met Office (GB)
- Météo-France (FR)
- Istituto Nazionale di Geofisica e Vulcanologia (IT)
- University of Liverpool (GB)
- Agenzia Regionale Prevenzione e Ambiente della Regione Emilia-Romagna (IT)
- Max Planck Institute for Meteorology (DE)
- Corresponding author
- Palmer, T. N.
- ORCID
- Venue
- Bulletin of the American Meteorological Society
- Publisher
- American Meteorological Society
- Published
- 2004-06-01
- Volume
- 85
- Issue
- 6
- Pages
- 853-872
- ISSN
- 0003-0007 (ISSN-L)
- 1520-0477
- OpenAlex
- W1999733221
- Cited by
- 959
- References
- 58
- Citations by year
- 2026: 8 · 2025: 22 · 2024: 26 · 2023: 30 · 2022: 24 · 2021: 23 · 2020: 45 · 2019: 33 · 2018: 51 · 2017: 47 · 2016: 47 · 2015: 41 · 2014: 61 · 2013: 54 · 2012: 53
- FWCI
- 59.23
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Bulletin of the American Meteorological Society (publishedVersion)
- Helmholtz Centre for Ocean Research Kiel (GEOMAR) (acceptedVersion)
- HAL (submittedVersion, other-oa)
- Arcimis (State Meteorological Agency) (submittedVersion, cc-by-nc-nd)
- HAL (submittedVersion)
- European Centre for Medium-Range Weather Forecasts
- Funders
- European Commission
- Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
- Keywords
- seasonal-to-interannual prediction, multi-model ensemble, DEMETER project, coupled ocean-atmosphere model, malaria forecasting, crop yield prediction, climate downscaling, probabilistic forecasting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review