Probabilistic inference for future climate using an ensemble of climate model evaluations.
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
This paper describes an approach to computing probabilistic assessments of future climate, using a climate model. It clarifies the nature of probability in this context, and illustrates the kinds of judgements that must be made in order for such a prediction to be consistent with the probability calculus. The climate model is seen as a tool for making probabilistic statements about climate itself, necessarily involving an assessment of the model’s imperfections. A climate event, such as a 2^C increase in global mean temperature, is identified with a region of ‘climate-space’, and the ensemble of model evaluations is used within a numerical integration designed to estimate the probability assigned to that region.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In fact, in a climate change context there is no such thing as ''the'' uncertainty (Rougier 2007)”
From Risks of Model Weighting in Multimodel Climate Projections (2010) · cites this paper as Rougier 2007
Citations
Cites
Cressie, N. (1992) · Terra Nova · doi:10.1111/j.1365-3121.1992.tb00605.x · Cited by 8,823
Monte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222 · cited 1×
“However, measurements and measurement errors typically share characteristics, and consideration should be given to constructing Σe hierarchically by type of instrument, by instrument ID, and by proximity in space and time; the shared structure would involve non-zero off-diagonal components.”
BackgroundBayesian Inference in Statistical Analysis.
Kadane, J. B., Box, G. E. P., & Tiao, G. C. (1975) · Journal of the American Statistical Association · doi:10.2307/2285412 · Cited by 3,824
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,660
Probability and Random Processes
(2004) · Elsevier eBooks · doi:10.1016/b978-0-12-172651-5.x5000-3 · Cited by 2,535
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (1999) · Springer Texts in Statistics · doi:10.1007/978-1-4757-3071-5 · Cited by 2,278
Bernardo, J. M., & Smith, A. F. M. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316870 · Cited by 2,178
Probability and Random Processes.
Grimmett, G. R., & Stirzaker, D. R. (2001) · doi:10.1093/oso/9780198572237.001.0001 · Cited by 1,850
Bayesian Inference in Statistical Analysis
Hill, B. M. (1974) · Technometrics · doi:10.1080/00401706.1974.10489222 · Cited by 1,833
Quantification of modelling uncertainties in a large ensemble of climate change simulations.
Murphy, J. M., Sexton, D. M. H., Barnett, D. N., Jones, G. S., Webb, M. J., Collins, M., & Stainforth, D. A. (2004) · Nature · doi:10.1038/nature02771 · Cited by 1,655 · cited 3×
“To take one example, how many of the authors in Murphy et al. (2004) really judge that, for their model, all values for the ‘best’ entrainment rate coefficient between 0.60 and 9.00 are equally-probable even though the standard setting is 3?”
BackgroundInfluentialPukelsheim, F. (1994) · The American Statistician · doi:10.2307/2684253 · Cited by 1,242
Pukelsheim, F. (1994) · The American Statistician · doi:10.1080/00031305.1994.10476030 · Cited by 1,211 · cited 2×
“For his particular model the climate scientist might judge that a value such as √ Σεii = 2 ◦C would be appropriate, perhaps representing his view that Pr ( |ε∗i | ≤ 6◦C ) ≥ 95%, by a statistical rule of thumb for unimodal distributions known as the 3-Sigma Rule (Pukelsheim, 1994).”
BackgroundMethodBayesian Statistics without Tears: A Sampling–Resampling Perspective
Smith, A. F. M., & Gelfand, A. E. (1992) · The American Statistician · doi:10.1080/00031305.1992.10475856 · Cited by 1,003 · cited 2×
“ensemble should be guided by the principles of numerical integration, for which there is a large literature (see, e.g., Robert and Casella 1999; Evans and Swartz 2000).”
MethodStatistical Methods for Eliciting Probability Distributions
Garthwaite, P. H., Kadane, J. B., & O'Hagan, A. (2005) · Journal of the American Statistical Association · doi:10.1198/016214505000000105 · Cited by 801 · cited 2×
“Therefore even if its detailed prescriptions seem to climate scientists to be inappropriate (although there is no evidence from current practice that they should be), the general approach should serve as a template for all model-based probabilistic inference for climate.”
BackgroundJournal of Statistical Planning and Inference, the
(2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1316 · Cited by 720
Combining Field Data and Computer Simulations for Calibration and Prediction
Higdon, D., Kennedy, M., Cavendish, J. C., Cafeo, J. A., & Ryne, R. D. (2004) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827503426693 · Cited by 623 · cited 2×
“…simplest framework that takes explicit account of the model’s imperfections; this is also the de facto standard in the statistical treatment of model-based inference for complex systems (see, e.g., Craig et al., 2001; Kennedy and O’Hagan, 2001; Higdon et al., 2005; Goldstein and Rougier, 2006a).”
BackgroundMethodApproximating Integrals via Monte Carlo and Deterministic Methods
Evans, M., & Swartz, T. (2000) · doi:10.1093/oso/9780198502784.001.0001 · Cited by 457
Bayesian Forecasting for Complex Systems Using Computer Simulators
Craig, P. S., Goldstein, M., Rougier, J. C., & Seheult, A. H. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753168370 · Cited by 240 · cited 2×
“…simplest framework that takes explicit account of the model’s imperfections; this is also the de facto standard in the statistical treatment of model-based inference for complex systems (see, e.g., Craig et al., 2001; Kennedy and O’Hagan, 2001; Higdon et al., 2005; Goldstein and Rougier, 2006a).”
BackgroundMethodSelf-citationSahu, P. K. (2013) · Research Methodology: A Guide for Researchers In Agricultural Science, Social Science and Other Related Fields · doi:10.1007/978-81-322-1020-7_12 · Cited by 169
Reified Bayesian modelling and inference for physical systems
Goldstein, M., & Rougier, J. (2009) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2008.07.019 · Cited by 160 · cited 5×
“In fact there appear to be foundational difficulties that prevent us from expressing such a relationship in terms of operationally-defined quantities pertinent to the model itself (Goldstein and Rougier, 2005, 2006b).”
BackgroundMethodInfluentialSelf-citationProbabilistic Formulations for Transferring Inferences from Mathematical Models to Physical Systems
Goldstein, M., & Rougier, J. (2004) · SIAM Journal on Scientific Computing · doi:10.1137/s106482750342670x · Cited by 108 · cited 3×
“In a statistically more sophisticated treatment, Goldstein and Rougier (2005, 2006b) consider a generalisation of (3) and (S1′) which may be thought of as a way to choose Q(·) in the above expression, but which is really a more flexible framework for specifying judgements about the relationship…”
BackgroundSelf-citationBayes Linear Calibrated Prediction for Complex Systems
Goldstein, M., & Rougier, J. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000203 · Cited by 84 · cited 6×
“In fact there appear to be foundational difficulties that prevent us from expressing such a relationship in terms of operationally-defined quantities pertinent to the model itself (Goldstein and Rougier, 2005, 2006b).”
BackgroundMethodInfluentialSelf-citationOperational Subjective Statistical Methods
Katti, S. K. (1998) · Technometrics · doi:10.1080/00401706.1998.10485203 · Cited by 72 · cited 1×
“Inference based on a subjective interpretation of probability is termed Bayesian Statistics; see, e.g., O’Hagan and Forster (2004), Bernardo and Smith (1994), or Lad (1996) .”
BackgroundCraig, P. S., Goldstein, M., Seheult, A. H., & Smith, J. A. (1998) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.1111/1467-9884.00115 · Cited by 59 · cited 2×
“Craig et al. (1998) describe computer-based tools for this purpose.”
BackgroundOperational Subjective Statistical Methods
Katti, S. K., & Lad, F. (1998) · Technometrics · doi:10.2307/1270655 · Cited by 30
Research works printed but not linked: 2
- Nakićenović NJ, editor (2000) IPCC Special Report on Emmissions Scenarios. Cambridge UK: Cambridge University Press
- O’Hagan A, Forster J (2004) Bayesian Inference. Volume 2b of Kendall’s Advanced Theory of Statistics. London: Edward Arnold, 2nd edition
Cited by
The use of the multi-model ensemble in probabilistic climate projections
Tebaldi, C., & Knutti, R. (2007) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2076 · Cited by 1,862
“While a probabilistic picture of climate model uncertainty is evolving (as demonstrated by many papers in this issue), emission scenarios so far do not have likelihoods attached to them (Schneider 2001).”
BackgroundThe Art and Science of Climate Model Tuning
Hourdin, F., Mauritsen, T., Gettelman, A., Golaz, J.-C., Balaji, V., Duan, Q., Folini, D., Ji, D., Klocke, D., Qian, Y., et al. (2017) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-15-00135.1 · Cited by 611
“Applications of these methods to climate models include Rougier (2007), Jackson et al. (2008), Edwards et al. (2011), and Williamson et al. (2013).”
MethodUse of multi-model ensembles from global climate models for assessment of climate change impacts
Semenov, M., & Stratonovitch, P. (2010) · Climate Research · doi:10.3354/cr00836 · Cited by 578
“It has been pointed out by Rougier (2007) that making a probabilistic prediction about future climate requires explicit specification of a probability distribution for climate itself.”
BackgroundLearning about physical parameters: the importance of model discrepancy
Brynjarsdóttir, J., & OʼHagan, A. (2014) · Inverse Problems · doi:10.1088/0266-5611/30/11/114007 · Cited by 530
“…engineering (Apley et al 2006, Bayarri 2009), health sciences (Strongk et al 2012), nuclear reactors (Unal et al 2011), experimental physics (Lee et al 2008), astrophysics (Habib et al 2007), and climate modeling (Murphy et al 2007, Stainforth et al 2007, Rougier 2007, Sansó and Forest 2009).”
BackgroundRisks of Model Weighting in Multimodel Climate Projections
Weigel, A. P., Knutti, R., Liniger, M. A., & Appenzeller, C. (2010) · Journal of Climate · doi:10.1175/2010jcli3594.1 · Cited by 386
“In fact, in a climate change context there is no such thing as ‘‘the’’ uncertainty (Rougier 2007), and consequently it is very difficult to give a reproducible, unique, and objective estimate of expected future model performance.”
BackgroundMethodInfluential
Metadata
- Authors
- Rougier, J.
- Affiliations
- Durham University (GB)
- Corresponding author
- Rougier, Jonathan
- ORCID
- Rougier, Jonathan
- Venue
- Climatic Change
- Published
- 2007-01-19
- Volume
- 81
- Issue
- 3-4
- Pages
- 247-264
- ISSN
- 0165-0009 (ISSN-L)
- 1573-1480
- OpenAlex
- W1981579808
- Cited by
- 218
- References
- 24
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 5 · 2023: 15 · 2022: 7 · 2021: 18 · 2020: 3 · 2019: 7 · 2018: 8 · 2017: 9 · 2016: 7 · 2015: 12 · 2014: 16 · 2013: 16 · 2012: 15
- FWCI
- 14.26
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by
- www.springer.com/tdm (tdm)
- Locations
- Climatic Change (publishedVersion)
- Durham Research Online (Durham University) (acceptedVersion)
- Durham Research Online (Durham University) (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion)
- Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Climate Change Policy and Economics
- Keywords
- climate model ensembles, probability calculus, climate space, global mean temperature increase, climate prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.