Spatial Analysis to Quantify Numerical Model Bias and Dependence: How Many Climate Models Are There?
The DOI matches its Crossref record, with a small difference in title or year; 39 of the 39 references it cites were found in a registry or an index.
Abstract
A limited number of complex numerical models that simulate the Earth's atmosphere, ocean, and land processes are the primary tool to study how climate may change over the next century due to anthropogenic emissions of greenhouse gases. A standard assumption is that these climate models are random samples from a distribution of possible models centered around the true climate. This implies that agreement with observations and the predictive skill of climate models will improve as more models are added to an average of the models. In this article we present a statistical methodology to quantify whether climate models are indeed unbiased and whether and where model biases are correlated across models. We consider the simulated mean state and the simulated trend over the period 1970–1999 for Northern Hemisphere summer and winter temperature. The key to the statistical analysis is a spatial model for the bias of each climate model and the use of kernel smoothing to estimate the correlations of biases across different climate models. The spatial model is particularly important to determine statistical significance of the estimated correlations under the hypothesis of independent climate models. Our results suggest that most of the climate model bias patterns are indeed correlated. In particular, climate models developed by the same institution have highly correlated biases. Also, somewhat surprisingly, we find evidence that the model skills for simulating the mean climate and simulating the warming trends are not strongly related.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“many studies have found only a weak relation between present-day model performance and future projections (Ra ¨isa ¨nen 2007; Whetton et al. 2007;Jun et al. 2008;Knutti et al. 2010;Scherrer 2010)”
From Risks of Model Weighting in Multimodel Climate Projections (2010) · cites this paper as Jun et al. 2008
In the citing paper
“The main reason is probably that different models share similar structural assumptions and in particular share the same unknown unknowns in terms of our physical process understanding, which can lead to correlated errors (e.g., Jun et al. 2008).”
From Risks of Model Weighting in Multimodel Climate Projections (2010) · cites this paper as Jun et al. 2008
In the citing paper
“Whetton et al. (2007), Jun et al. (2008), Knutti et al. (2010), and other studies, for example, show that the correlations between presentday model performance (in terms of such alternative variables) and future changes are in fact weak”
From Risks of Model Weighting in Multimodel Climate Projections (2010) · cites this paper as Jun et al. (2008)
Citations
Cites
Climate Change 2001: The Scientific Basis
Cooper, R. N., Houghton, J. T., McCarthy, J. J., & Metz, B. (2002) · Foreign Affairs · doi:10.2307/20033020 · Cited by 12,889
Philosophical transactions of the Royal Society of London. B
Press, H. (1886) · Cited by 10,080
Griggs, D. J., & Noguer, M. (2002) · Weather · doi:10.1256/004316502320517344 · Cited by 5,754
Special report on emissions scenarios
Nakićenović, N., Alcamo, J. M., Davis, G. F., de Vries, B. J. M., Fenhann, J. V., Gaffin, S. R., Gregory, K., Griibler, A., Jung, T. Y., Kram, T., et al. (2000) · eScholarship (California Digital Library) · Cited by 3,423
Hierarchical Modeling and Analysis for Spatial Data
Banerjee, S., Carlin, B. P., & Gelfand, A. E. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/b17115 · Cited by 2,500
Stein, M. L. (1999) · Springer Series in Statistics · doi:10.1007/978-1-4612-1494-6 · Cited by 2,348
Interpolation of Spatial Data: Some Theory for Kriging
Rathbun, S. L., & Stein, M. L. (2000) · Journal of the American Statistical Association · doi:10.2307/2669494 · Cited by 1,916
The use of the multi-model ensemble in probabilistic climate projections
Tebaldi, C., & Knutti, R. (2007) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2076 · Cited by 1,862 · cited 1×
“Tebaldi and Knutti (2007) have provided a more thorough review, and Smith et al. (2007) have provided more references.”
BackgroundSelf-citationSurface air temperature and its changes over the past 150 years
Jones, P. D., New, M., Parker, D. E., Martin, S., & Rigor, I. G. (1999) · Reviews of Geophysics · doi:10.1029/1999rg900002 · Cited by 1,486
Uncertainty in predictions of the climate response to rising levels of greenhouse gases
Stainforth, D. A., Aina, T., Christensen, C., Collins, M., Faull, N., Frame, D. J., Kettleborough, J. A., Knight, S., Martin, A., Murphy, J. M., et al. (2005) · Nature · doi:10.1038/nature03301 · Cited by 1,166
Research works printed but not linked: 8
- Geophysical Research Letters, 29, 31
- Modeled Daily Sulfate Levels CMAQ, Atmospheric Environment, 38, 4427
- Models Coupled Climate, Climate Dynamics, 17, 83
- Climate Twentieth-Century, Climate, 17, 3721
- Planning Statistical, Inference, 137, 2277
- Greenhouse Gases Rising Levels, Nature, 433, 403
- Society, Ser. A, 365, 2053
- Seasonal Forecasts Multimodel Supersensemble, Climate, 16, 3834
Cited by
Challenges in combining projections from multiple climate models.
Knutti, R., Furrer, R., Tebaldi, C., Cermak, J., & Meehl, G. A. (2010) · Journal of Climate · doi:10.1175/2009jcli3361.1 · Cited by 1,270
“For the present-day state, sophisticated statistical methods also suggest that the equivalent number of independent models in CMIP3 is much smaller than the total number of models (Jun et al. 2008a,b).”
MethodResultSelf-citationThe end of model democracy?: An editorial comment
Knutti, R. (2010) · Climatic Change · doi:10.1007/s10584-010-9800-2 · Cited by 499
Self-citationMatérn Cross-Covariance Functions for Multivariate Random Fields
Gneiting, T., Kleiber, W., & Schlather, M. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2010.tm09420 · Cited by 388
Lutz, A. F., ter Maat, H. W., Biemans, H., Shrestha, A. B., Wester, P., & Immerzeel, W. W. (2016) · International Journal of Climatology · doi:10.1002/joc.4608 · Cited by 381
Risks of Model Weighting in Multimodel Climate Projections
Weigel, A. P., Knutti, R., Liniger, M. A., & Appenzeller, C. (2010) · Journal of Climate · doi:10.1175/2010jcli3594.1 · Cited by 386
Self-citation
Metadata
- Authors
- Jun, M., Knutti, R., & Nychka, D. W.
- Affiliations
- NSF National Center for Atmospheric Research (US)
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2008-09
- Volume
- 103
- Issue
- 483
- Pages
- 934-947
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W1509521877
- Cited by
- 214
- References
- 38
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 7 · 2023: 9 · 2022: 14 · 2021: 7 · 2020: 22 · 2019: 9 · 2018: 6 · 2017: 6 · 2016: 10 · 2015: 13 · 2014: 23 · 2013: 15 · 2012: 17
- FWCI
- 14.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Keywords
- climate model bias, climate model ensembles, model independence, kernel smoothing, Northern Hemisphere temperature, seasonal temperature trends, model skill, anthropogenic climate change, greenhouse gas emissions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Spatial Analysis to Quantify Numerical Model Bias and Dependence: How Many Climate Models Are There? https://app.cochat.ai/papers/10.1198/016214507000001265
- The paper
- Jun, M., Knutti, R., & Nychka, D. W. (2008). Spatial Analysis to Quantify Numerical Model Bias and Dependence: How Many Climate Models Are There? Journal of the American Statistical Association. https://doi.org/10.1198/016214507000001265
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.