The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
Uncertainty Quantification in Complex Simulation Models Using Ensemble Copula Coupling
Open accessAbstract
Critical decisions frequently rely on high-dimensional output from complex computer simulation models that show intricate cross-variable, spatial and temporal dependence structures, with weather and climate predictions being key examples. There is a strongly increasing recognition of the need for uncertainty quantification in such settings, for which we propose and review a general multi-stage procedure called ensemble copula coupling (ECC), proceeding as follows: 1. Generate a raw ensemble, consisting of multiple runs of the computer model that differ in the inputs or model parameters in suitable ways. 2. Apply statistical postprocessing techniques, such as Bayesian model averaging or nonhomogeneous regression, to correct for systematic errors in the raw ensemble, to obtain calibrated and sharp predictive distributions for each univariate output variable individually. 3. Draw a sample from each postprocessed predictive distribution. 4. Rearrange the sampled values in the rank order structure of the raw ensemble to obtain the ECC postprocessed ensemble. The use of ensembles and statistical postprocessing have become routine in weather forecasting over the past decade. We show that seemingly unrelated, recent advances can be interpreted, fused and consolidated within the framework of ECC, the common thread being the adoption of the empirical copula of the raw ensemble. Depending on the use of Quantiles, Random draws or Transformations at the sampling stage, we distinguish the ECC-Q, ECC-R and ECC-T variants, respectively. We also describe relations to the Schaake shuffle and extant copula-based techniques. In a case study, the ECC approach is applied to predictions of temperature, pressure, precipitation and wind over Germany, based on the 50-member European Centre for Medium-Range Weather Forecasts (ECMWF) ensemble.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Self-citationFonctions de répartition à N dimensions et leurs marges
Sklar, M. (1959) · HAL · Cited by 4,671
Multivariate Models and Dependence Concepts.
Ringrose, T., & Joe, H. (1998) · Biometrics · doi:10.2307/2533875 · Cited by 3,403
Atmospheric Modeling, Data Assimilation and Predictability
Kalnay, E. (2002) · doi:10.1017/cbo9780511802270 · Cited by 3,391 · cited 1×
“Medium-range weather fore-casts, with lead times up to two weeks, are obtained by numerically solving the partial differential equations that describe the physics of the atmosphere, with initial conditions provided by estimates of the current state of the atmosphere (Kalnay, 2003).”
MethodGeostatistics: Modeling Spatial Uncertainty
Stein, M. L., Chiles, J.-P., & Delfiner, P. (2000) · Journal of the American Statistical Association · doi:10.2307/2669569 · Cited by 2,880
Multivariate Models and Multivariate Dependence Concepts
Joe, H. (1997) · C&H/CRC Monographs on Statistics & Applied Probability · doi:10.1201/b13150 · Cited by 2,849
Stein, M. L. (1999) · Springer Series in Statistics · doi:10.1007/978-1-4612-1494-6 · Cited by 2,348
Quantitative Risk Management: Concepts, Techniques, and Tools
McNeil, A. J., Frey, R., & Paul Embrechts, A. (2005) · Cited by 2,201
Pair-copula constructions of multiple dependence
Aas, K., Czado, C., Frigessi, A., & Bakken, H. (2009) · Insurance: Mathematics and Economics · doi:10.1016/j.insmatheco.2007.02.001 · Cited by 2,039
Quantitative Risk Management: Concepts, Techniques, and Tools
Anderson‐Cook, C. M. (2006) · Journal of the American Statistical Association · doi:10.1198/jasa.2006.s156 · Cited by 2,012
Weak Convergence and Empirical Processes: With Applications to Statistics
Wellner, J. A. (1996) · Medical Entomology and Zoology · Cited by 1,969
Interpolation of Spatial Data: Some Theory for Kriging
Rathbun, S. L., & Stein, M. L. (2000) · Journal of the American Statistical Association · doi:10.2307/2669494 · Cited by 1,916
Using Bayesian model averaging to calibrate forecast ensembles.
Raftery, A. E., Gneiting, T., Balabdaoui, F., & Polakowski, M. (2005) · Monthly Weather Review · doi:10.1175/mwr2906.1 · Cited by 1,915
Self-citationProbabilistic Forecasts, Calibration and Sharpness
Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00587.x · Cited by 1,783
Self-citationEverything You Always Wanted to Know about Copula Modeling but Were Afraid to Ask
Genest, C., & Favre, A.-C. (2007) · Journal of Hydrologic Engineering · doi:10.1061/(asce)1084-0699(2007)12:4(347 · Cited by 1,618
The ECMWF Ensemble Prediction System: Methodology and validation
Molteni, F., Buizza, R., Palmer, T. N., & Petroliagis, T. (1996) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712252905 · Cited by 1,616
Statistics for Spatio‐Temporal Data
Subba Rao, T. (2012) · Journal of Time Series Analysis · doi:10.1111/j.1467-9892.2011.00765.x · Cited by 1,560
Statistics for Spatio-Temporal Data
Cressie, N., & Wikle, C. K. (2011) · Research Online (University of Wollongong) · Cited by 1,318
Making and Evaluating Point Forecasts
Gneiting, T. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.r10138 · Cited by 1,154
Self-citationGneiting, T., Raftery, A. E., Westveld, A. H., & Goldman, T. (2005) · Monthly Weather Review · doi:10.1175/mwr2904.1 · Cited by 1,142
Self-citationEnsemble flood forecasting: A review
Cloke, H. L., & Pappenberger, F. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.06.005 · Cited by 1,139
Geostatistics: Modeling Spatial Uncertainty
Chilès, J., & Delfiner, P. (2012) · Wiley Series in Probability and Statistics · doi:10.1002/9781118136188 · Cited by 1,113
Dawid, A. P. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981683 · Cited by 1,085
The t Copula and Related Copulas
Demarta, S., & McNeil, A. J. (2007) · International Statistical Review · doi:10.1111/j.1751-5823.2005.tb00254.x · Cited by 958
Interpretation of Rank Histograms for Verifying Ensemble Forecasts
Hamill, T. M. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<0550:iorhfv>2.0.co;2 · Cited by 892
Leutbecher, M., & Palmer, T. N. (2008) · Journal of Computational Physics · doi:10.1016/j.jcp.2007.02.014 · Cited by 886
Interpolation of Spatial Data: Some Theory for Kriging
Woodard, R. (2000) · Technometrics · doi:10.1080/00401706.2000.10485731 · Cited by 779
Weather Forecasting with Ensemble Methods
Gneiting, T., & Raftery, A. E. (2005) · Science · doi:10.1126/science.1115255 · Cited by 636
Self-citationLa fonction de dépendance empirique et ses propriétés. Un test non paramétrique d'indépendance
Deheuvels, P. (1979) · Bulletin de la Classe des sciences · doi:10.3406/barb.1979.58521 · Cited by 630
Multivariate Archimedean copulas, d-monotone functions and ℓ1-norm symmetric distributionsPreprint
McNeil, A. J. (2009) · Cited by 597
Statistical Modeling of Spatial Extremes
Davison, A. C., Padoan, S. A., & Ribatet, M. (2012) · Statistical Science · doi:10.1214/11-sts376 · Cited by 578
From probabilistic forecasts to statistical scenarios of short‐term wind power production
Pinson, P., Madsen, H., Nielsen, H. A., Papaefthymiou, G., & Klöckl, B. (2009) · Wind Energy · doi:10.1002/we.284 · Cited by 537
Multivariate Archimedean copulas, d-monotone functions and ℓ1-norm symmetric distributions
McNeil, A. J., & Nešlehová, J. (2009) · The Annals of Statistics · doi:10.1214/07-aos556 · Cited by 510
Predictive Model Assessment for Count Data
Czado, C., Gneiting, T., & Held, L. (2009) · Biometrics · doi:10.1111/j.1541-0420.2009.01191.x · Cited by 464
Self-citationRaftery, A. E., Kárný, M., & Ettler, P. (2010) · Technometrics · doi:10.1198/tech.2009.08104 · Cited by 452
Verification of Eta–RSM Short-Range Ensemble Forecasts
Hamill, T. M., & Colucci, S. J. (1997) · Monthly Weather Review · doi:10.1175/1520-0493(1997)125<1312:voersr>2.0.co;2 · Cited by 428
Probabilistic Quantitative Precipitation Forecasting Using Bayesian Model Averaging
Sloughter, J. M. L., Raftery, A. E., Gneiting, T., & Fraley, C. (2007) · Monthly Weather Review · doi:10.1175/mwr3441.1 · Cited by 422
Self-citationWind Energy: Forecasting Challenges for Its Operational Management
Pinson, P. (2013) · Statistical Science · doi:10.1214/13-sts445 · Cited by 377
Schölzel, C., & Friederichs, P. (2008) · Nonlinear Processes in Geophysics · doi:10.5194/npg-15-761-2008 · Cited by 303
The economic value of ensemble forecasts as a tool for risk assessment: From days to decades
Palmer, T. N. (2002) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/0035900021643593 · Cited by 276
Gneiting, T., Stanberry, L. I., Grimit, E. P., Held, L., & Johnson, N. A. (2008) · TEST · doi:10.1007/s11749-008-0114-x · Cited by 265
Self-citationProbabilistic Wind Speed Forecasting Using Ensembles and Bayesian Model Averaging
Sloughter, J. M., Gneiting, T., & Raftery, A. E. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08615 · Cited by 263
Self-citationThorarinsdottir, T. L., & Gneiting, T. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2009.00616.x · Cited by 262
Self-citationOn the distributional transform, Sklar’s theorem, and the empirical copula process
Rüschendorf, L. (2009) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2009.05.030 · Cited by 259
Geostatistics: Modeling Spatial Uncertainty
Li, Z. (2001) · Computers & Geosciences · doi:10.1016/s0098-3004(00)00063-7 · Cited by 258
Comparison of Ensemble-MOS Methods Using GFS Reforecasts
Wilks, D. S., & Hamill, T. M. (2007) · Monthly Weather Review · doi:10.1175/mwr3402.1 · Cited by 258
Reforecasts: An Important Dataset for Improving Weather Predictions
Hamill, T. M., Whitaker, J. S., & Mullen, S. L. (2006) · Bulletin of the American Meteorological Society · doi:10.1175/bams-87-1-33 · Cited by 246
Aspects of Effective Mesoscale, Short-Range Ensemble Forecasting
Eckel, F. A., & Mass, C. F. (2005) · Weather and Forecasting · doi:10.1175/waf843.1 · Cited by 235
Probabilistic Forecast Calibration Using ECMWF and GFS Ensemble Reforecasts. Part II: Precipitation
Hamill, T. M., Hagedorn, R., & Whitaker, J. S. (2008) · Monthly Weather Review · doi:10.1175/2007mwr2411.1 · Cited by 227
Asymptotic Distributions of Multivariate Rank Order Statistics
Rüschendorf, L. (1976) · The Annals of Statistics · doi:10.1214/aos/1176343588 · Cited by 217
Probabilistic Wind Vector Forecasting Using Ensembles and Bayesian Model Averaging
McLean Sloughter, J., Gneiting, T., & Raftery, A. E. (2013) · Monthly Weather Review · doi:10.1175/mwr-d-12-00002.1 · Cited by 210
Self-citationExtending logistic regression to provide full‐probability‐distribution MOS forecasts
Wilks, D. S. (2009) · Meteorological Applications · doi:10.1002/met.134 · Cited by 194
Hagedorn, R., Hamill, T. M., & Whitaker, J. S. (2008) · Monthly Weather Review · doi:10.1175/2007mwr2410.1 · Cited by 185
Fraley, C., Raftery, A. E., & Gneiting, T. (2009) · Monthly Weather Review · doi:10.1175/2009mwr3046.1 · Cited by 168
Self-citationProbabilistic quantitative precipitation forecasting using Ensemble Model Output Statistics
Scheuerer, M. (2014) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.2183 · Cited by 165
Probabilistic Forecasts of Precipitation in Terms of Quantiles Using NWP Model Output
Bremnes, J. B. (2004) · Monthly Weather Review · doi:10.1175/1520-0493(2004)132<0338:pfopit>2.0.co;2 · Cited by 158
Kneib, T. (2013) · Statistical Modelling · doi:10.1177/1471082x13494159 · Cited by 158
From ensemble forecasts to predictive distribution functions
BRCKER, J., & SMITH, L. A. (2008) · Tellus A Dynamic Meteorology and Oceanography · doi:10.1111/j.1600-0870.2008.00333.x · Cited by 154
Multivariate probabilistic forecasting using ensemble Bayesian model averaging and copulas
Möller, A., Lenkoski, A., & Thorarinsdottir, T. L. (2012) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.2009 · Cited by 152
Self-citationNon-Crossing Non-Parametric Estimates of Quantile Curves
Dette, H., & Volgushev, S. (2008) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2008.00651.x · Cited by 148
Evaluating raw ensembles with the continuous ranked probability score
Bröcker, J. (2012) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.1891 · Cited by 140
Comparing TIGGE multimodel forecasts with reforecast‐calibrated ECMWF ensemble forecasts
Hagedorn, R., Buizza, R., Hamill, T. M., Leutbecher, M., & Palmer, T. N. (2012) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.1895 · Cited by 139
Editorial: Probabilistic Forecasting
Gneiting, T. (2008) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2007.00522.x · Cited by 137
Self-citationCombining Spatial Statistical and Ensemble Information in Probabilistic Weather Forecasts
Berrocal, V. J., Raftery, A. E., & Gneiting, T. (2007) · Monthly Weather Review · doi:10.1175/mwr3341.1 · Cited by 110
Self-citationBias Correction and Bayesian Model Averaging for Ensemble Forecasts of Surface Wind Direction
Bao, L., Gneiting, T., Grimit, E. P., Guttorp, P. M., & Raftery, A. E. (2009) · Monthly Weather Review · doi:10.1175/2009mwr3138.1 · Cited by 103
Self-citationEnsemble Model Output Statistics for Wind Vectors
Schuhen, N., Thorarinsdottir, T. L., & Gneiting, T. (2012) · Monthly Weather Review · doi:10.1175/mwr-d-12-00028.1 · Cited by 101
Self-citationProbabilistic aspects of meteorological and ozone regional ensemble forecasts
Monache, L. D., Hacker, J. P., Zhou, Y., Deng, X., & Stull, R. B. (2006) · Journal of Geophysical Research Atmospheres · doi:10.1029/2005jd006917 · Cited by 95
Probabilistic Weather Forecasting for Winter Road Maintenance
Berrocal, V. J., Raftery, A. E., Gneiting, T., & Steed, R. C. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap07184 · Cited by 94
Self-citationGel, Y. R., Raftery, A. E., & Gneiting, T. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000872 · Cited by 93
Self-citationSmoothing forecast ensembles with fitted probability distributions
Wilks, D. S. (2002) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/qj.01.215 · Cited by 81
Probabilistic quantitative precipitation field forecasting using a two-stage spatial model
Berrocal, V. J., Raftery, A. E., & Gneiting, T. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas203 · Cited by 80
Self-citationPROBABILISTIC QUANTITATIVE PRECIPITATION FIELD FORECASTING USING A TWO-STAGE SPATIAL MODEL 1Preprint
Berrocal, V. J., Raftery, A. E., & Gneiting, T. (2008) · Cited by 80
Self-citationStrictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2005) · Defense Technical Information Center (DTIC) · doi:10.21236/ada454828 · Cited by 78
Self-citationAdaptive calibration of(u,v)‐wind ensemble forecasts
Pinson, P. (2012) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.1873 · Cited by 76
MOS Uncertainty Estimates in an Ensemble Framework
Glahn, B., Peroutka, M. R., Wiedenfeld, J. R., Wagner, J., Zylstra, G., Schuknecht, B., & Jackson, B. A. (2008) · Monthly Weather Review · doi:10.1175/2008mwr2569.1 · Cited by 72
Kleiber, W., Raftery, A. E., & Gneiting, T. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.ap10433 · Cited by 65
Self-citationKleiber, W., Raftery, A. E., Baars, J., Gneiting, T., Mass, C. F., & Grimit, E. P. (2011) · Monthly Weather Review · doi:10.1175/2010mwr3511.1 · Cited by 58
Self-citationProbabilistic wind gust forecasting using nonhomogeneous Gaussian regression
Thorarinsdottir, T., & Johnson, M. S. (2012) · Monthly Weather Review · doi:10.1175/mwr-d-11-00075.1 · Cited by 51
Self-citationProbabilistic Weather Forecasting in R
Fraley, C., Raftery, A. E., Gneiting, T., Sloughter, M., & Berrocal, V. J. (2011) · The R Journal · doi:10.32614/rj-2011-009 · Cited by 49
Self-citationBouallègue, Z. B. (2012) · Weather and Forecasting · doi:10.1175/waf-d-12-00062.1 · Cited by 45
Probabilistic Quantitative Precipitation Forecasting Using Bayesian Model Averaging
Sloughter, J. M., Raftery, A. E., & Gneiting, T. (2006) · Defense Technical Information Center (DTIC) · doi:10.21236/ada454809 · Cited by 43
Self-citationFORECASTS AND VERIFICATIONS IN WESTERN AUSTRALIA
COOKE, E. (1906) · Monthly Weather Review · Cited by 35
Schaake, J. C., Pailleux, J., Thielen, J., Arritt, R. W., Hamill, T., Luo, L., Martin, É., McCollor, D., & Pappenberger, F. (2010) · Atmospheric Science Letters · doi:10.1002/asl.267 · Cited by 34
Probabilistic assessment of regional climate change in Southwest Germany by ensemble dressing
Schölzel, C., & Hense, A. (2010) · Climate Dynamics · doi:10.1007/s00382-010-0815-1 · Cited by 33
A Bayesian Hierarchical Approach to Ensemble Weather Forecasting
Narzo, A. F. D., & Cocchi, D. (2010) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/j.1467-9876.2009.00700.x · Cited by 29
Cited by
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Self-citationGneiting, T., & Katzfuss, M. (2014) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-062713-085831 · Cited by 888
Self-citationNeural Networks for Postprocessing Ensemble Weather Forecasts
Rasp, S., & Lerch, S. (2018) · Monthly Weather Review · doi:10.1175/mwr-d-18-0187.1 · Cited by 509
The Science of NOAA's Operational Hydrologic Ensemble Forecast Service
Demargne, J., Wu, L., Regonda, S. K., Brown, J. D., Lee, H., He, M., Seo, D.-J., Hartman, R., Herr, H. D., Fresch, M., et al. (2014) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-12-00081.1 · Cited by 324
Stochastic representations of model uncertainties at ECMWF: state of the art and future vision
Leutbecher, M., Lock, S., Ollinaho, P., Lang, S. T. K., Balsamo, G., Bechtold, P., Bonavita, M., Christensen, H. M., Diamantakis, M., Dutra, E., et al. (2017) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3094 · Cited by 257
Metadata
- Authors
- Schefzik, R., Thorarinsdottir, T. L., & Gneiting, T.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2013-11-01
- Volume
- 28
- Issue
- 4
- Pages
- 616-640
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W2055208896
- Cited by
- 257
- References
- 85
- FWCI
- 10.17
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.