Multi‐objective calibration of forecast ensembles using Bayesian model averaging
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Bayesian Model Averaging (BMA) has recently been proposed as a method for statistical postprocessing of forecast ensembles from numerical weather prediction models. The BMA predictive probability density function (PDF) of any weather quantity of interest is a weighted average of PDFs centered on the bias‐corrected forecasts from a set of different models. However, current applications of BMA calibrate the forecast specific PDFs by optimizing a single measure of predictive skill. Here we propose a multi‐criteria formulation for postprocessing of forecast ensembles. Our multi‐criteria framework implements different diagnostic measures to reflect different but complementary metrics of forecast skill, and uses a numerical algorithm to solve for the Pareto set of parameters that have consistently good performance across multiple performance metrics. Two illustrative case studies using 48‐hour ensemble data of surface temperature and sea level pressure, and multi‐model seasonal forecasts of temperature, show that a multi‐criteria formulation provides a more appealing basis for selecting the appropriate BMA model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using Bayesian model averaging to calibrate forecast ensembles.
Raftery, A. E., Gneiting, T., Balabdaoui, F., & Polakowski, M. (2005) · Monthly Weather Review · doi:10.1175/mwr2906.1 · Cited by 1,915 · cited 13×
“If we denote space and time with subscripts s and t respectively, so that fkst is the kth forecast in the ensemble for place s and time t, the associated variance can be computed as [Raftery et al., 2005]: Var Dstjf1st; . . . ; fKst½ ¼ XK k¼1 wk ak þ bkfkstð Þ XK l¼1 wl al þ blflstð Þ !”
BackgroundMethodInfluentialGood, I. J. (1952) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1952.tb00104.x · Cited by 976
Palmer, T. N., Alessandri, A., Andersen, U., Cantelaube, P., Davey, M., Délécluse, P., Déqué, M., Díez, E., Doblas-Reyes, F. J., Feddersen, H., et al. (2004) · Bulletin of the American Meteorological Society · doi:10.1175/bams-85-6-853 · Cited by 959 · cited 3×
“This data was taken from the DEMETER project (Development of a European Multi-model Ensemble system for seasonal to inTERannual prediction) and consists of a seven member multi-model ensemble generated by seven state-ofthe-art global coupled ocean-atmosphere models [Palmer et al., 2004].”
MethodInfluential
Cited by
Vrugt, J. A., ter Braak, C. J. F., Clark, M. P., Hyman, J. M., & Robinson, B. A. (2008) · Water Resources Research · doi:10.1029/2007wr006720 · Cited by 891
Self-citationVrugt, J. A., & Robinson, B. A. (2007) · Water Resources Research · doi:10.1029/2005wr004838 · Cited by 334
Self-citationWöhling, T., & Vrugt, J. A. (2008) · Water Resources Research · doi:10.1029/2008wr007154 · Cited by 86
“The use of multiple different computational nodes within a distributed computing environment would significantly reduce the time needed for calibration [Vrugt et al., 2006b].”
BackgroundMethodInfluentialSelf-citationCan We Predict Politics? Toward What End?: Table 1.
Ward, M. D. (2016) · Journal of Global Security Studies · doi:10.1093/jogss/ogv002 · Cited by 33
“of Ensemble Bayesian Modeling Averaging, which weights each theme in proportion to its ability to make accurate predictions in a test set of data set aside for this calibration test (Raftery et al. 2005; Vrugt et al. 2006; Vrugt, Diks, and Clark 2008; Fraley et al. 2010; Fraley, Raftery, and Gneiting 2010; Sloughter,…”
Background
Metadata
- Authors
- Vrugt, J. A., Clark, M. P., Diks, C. G. H., Duan, Q., & Robinson, B. A.
- Venue
- Geophysical Research Letters
- Publisher
- American Geophysical Union (AGU)
- Published
- 2006-10
- Volume
- 33
- Issue
- 19
- ISSN
- 0094-8276 (ISSN-L)
- 1944-8007
- OpenAlex
- W2156402684
- Cited by
- 74
- References
- 3
- FWCI
- 2.61
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multi‐objective calibration of forecast ensembles using Bayesian model averaging. https://app.cochat.ai/papers/10.1029/2006gl027126
- The paper
- Vrugt, J. A., Clark, M. P., Diks, C. G. H., Duan, Q., & Robinson, B. A. (2006). Multi‐objective calibration of forecast ensembles using Bayesian model averaging. Geophysical Research Letters. https://doi.org/10.1029/2006gl027126
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.