The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Reduced space optimal analysis for historical data sets: 136 years of Atlantic sea surface temperatures
Abstract
A computationally efficient method for analyzing meteorological and oceanographic historical data sets has been developed. The method combines data reduction and least squares optimal estimation. The data reduction involves computing empirical orthogonal functions (EOFs) of the data based on their recent, high‐quality portion and using a leading EOF subset as a basis for the analyzed solution and for fitting a first‐order linear model of time transitions. We then formulate optimal estimation problems in terms of the EOF projection of the analyzed field to obtain reduced space analogues of the optimal smoother, the Kalman filter, and optimal interpolation techniques. All reduced space algorithms are far cheaper computationally than their full grid prototypes, while their solutions are not necessarily inferior since the sparsity and error in available data often make estimation of small‐scale features meaningless. Where covariance patterns can be estimated from the available data, the analysis methods fill gaps, correct sampling errors, and produce spatially and temporally coherent analyzed data sets. As with classical least squares estimation, the reduced space versions also provide theoretical error estimates for analyzed values. The methods are demonstrated on Atlantic monthly sea surface temperature (SST) anomalies for 1856–1991 from the United Kingdom Meteorological Office historical sea surface temperature data set (version MOHSST5). Choice of a reduced space dimension of 30 is shown to be adequate. The analyses are tested by withholding a significant part of the data and prove to be robust and in agreement with their own error estimates; they are also consistent with a partially independent optimal interpolation (OI) analysis by Reynolds and Smith [1994] produced in the National Centers for Environmental Prediction (NCEP)(known as the NCEP OI analysis). A simple statistical model is used to depict the month‐to‐month SST evolution in the optimal smoother algorithm. Results are somewhat superior to both the Kalman filter, which relies less on the model, and the optimal interpolation, which does not use it at all. The method generalizes a few recent works on using a reduced space for data set analyses. Difficulties of methods which simply fit EOF patterns to observed data are pointed out, and the more complete analysis procedures developed here are suggested as a remedy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Linear Statistical Inference and its Applications: Second Editon
Rao, C. R. (1973) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316436 · Cited by 10,489
Gantmacher, F. R. (1984) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 8,520
GELB, A. (1974) · CERN Document Server (European Organization for Nuclear Research) · Cited by 6,405
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Linear Statistical Inference and Its Applications.
Robertson, C. A., & Rao, C. R. (1975) · Biometrics · doi:10.2307/2529568 · Cited by 3,598
Sampling Errors in the Estimation of Empirical Orthogonal Functions
North, G. R., Bell, T. L., Cahalan, R. F., & Moeng, F. J. (1982) · Monthly Weather Review · doi:10.1175/1520-0493(1982)110<0699:seiteo>2.0.co;2 · Cited by 3,400
Maximum likelihood estimates of linear dynamic systems
RAUCH, H. E., TUNG, F., & STRIEBEL, C. T. (1965) · AIAA Journal · doi:10.2514/3.3166 · Cited by 1,943
Principal Component Analysis in Meteorology and Oceanography
Preisendorfer, R. W., & Mobley, C. D. (1988) · Cited by 1,785
Analysis methods for numerical weather prediction
Lorenc, A. C. (1986) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49711247414 · Cited by 1,510
The Theory of Matrices in Numerical Analysis.
Haynsworth, E. V., & Householder, A. S. (1966) · The American Mathematical Monthly · doi:10.2307/2314680 · Cited by 1,363
A Comprehensive Ocean-Atmosphere Data Set
Woodruff, S. D., Slutz, R. J., Jenne, R. L., & Steurer, P. M. (1987) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(1987)068<1239:acoads>2.0.co;2 · Cited by 1,078
Objective Analysis of Meteorological Fields
Gandin, L. S. (1963) · Medical Entomology and Zoology · Cited by 826
Least-squares estimation: from Gauss to Kalman
Sorenson, H. W. (1970) · IEEE Spectrum · doi:10.1109/mspec.1970.5213471 · Cited by 746
Reconstruction of Historical Sea Surface Temperatures Using Empirical Orthogonal Functions
Smith, T. M., Reynolds, R. W., Livezey, R. E., & Stokes, D. C. (1996) · Journal of Climate · doi:10.1175/1520-0442(1996)009<1403:rohsst>2.0.co;2 · Cited by 639
SOME BASIC FORMALISMS IN NUMERICAL VARIATIONAL ANALYSIS
SASAKI, Y. (1970) · Monthly Weather Review · doi:10.1175/1520-0493(1970)098<0875:sbfinv>2.3.co;2 · Cited by 562
Talagrand, O. (1997) · Journal of the Meteorological Society of Japan. Ser. II · doi:10.2151/jmsj1965.75.1b_191 · Cited by 480
Interdecadal changes of surface temperature since the late nineteenth century
Parker, D. E., Jones, P. D., Folland, C. K., & Bevan, A. (1994) · Journal of Geophysical Research: Atmospheres · doi:10.1029/94jd00548 · Cited by 421
On-line Estimation of Error Covariance Parameters for Atmospheric Data Assimilation
Dee, D. P. (1995) · Monthly Weather Review · doi:10.1175/1520-0493(1995)123<1128:oleoec>2.0.co;2 · Cited by 350
Correction of instrumental biases in historical sea surface temperature data
Folland, C. K., & Parker, D. E. (1995) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712152206 · Cited by 309
Worldwide marine temperature fluctuations 1856–1981
Folland, C. K., Parker, D. E., & Kates, F. E. (1984) · Nature · doi:10.1038/310670a0 · Cited by 299
Random Processes in Automatic Control.
Parzen, E., W., W. A., Laning, J. H., & Battin, R. H. (1957) · Journal of the American Statistical Association · doi:10.2307/2280915 · Cited by 294
Mapping tropical Pacific sea level: Data assimilation via a reduced state space Kalman filter
Cane, M. A., Kaplan, A., Miller, R. N., Tang, B., Hackert, E., & Busalacchi, A. J. (1996) · Journal of Geophysical Research Atmospheres · doi:10.1029/96jc01684 · Cited by 188
Self-citationApplications of Estimation Theory to Numerical Weather Prediction
Ghil, M., Cohn, S., Tavantzis, J., Bube, K., & Isaacson, E. (1981) · Applied Mathematical Sciences · doi:10.1007/978-1-4612-5970-1_5 · Cited by 186
Predictability of a Coupled Ocean–Atmosphere Model
Blumenthal, M. B. (1991) · Journal of Climate · Cited by 171
Self-citationOn the prediction of ENSO: a study with a low-order Markov model
Xue, Y., Cane, M. A., Zebiak, S. E., & Blumenthal, M. B. (1994) · Tellus A Dynamic Meteorology and Oceanography · doi:10.1034/j.1600-0870.1994.00013.x · Cited by 160
Self-citationApproximate Data Assimilation Schemes for Stable and Unstable Dynamics
Cohn, S. E., & Todling, R. (1996) · Journal of the Meteorological Society of Japan Ser II · doi:10.2151/jmsj1965.74.1_63 · Cited by 114
Robustness of Low-Frequency Circulation Patterns Derived from EOF and Rotated EOF Analyses
Cheng, X., Nitsche, G., & Wallace, J. M. (1995) · Journal of Climate · Cited by 100
Backhaus, K., Erichson, B., Gensler, S., Weiber, R., & Weiber, T. (2023) · Springer eBooks · doi:10.1007/978-3-658-40411-6 · Cited by 100
Wahba, G., Johnson, D. R., Gao, F., & Gong, J. (1995) · Monthly Weather Review · doi:10.1175/1520-0493(1995)123<3358:atonwp>2.0.co;2 · Cited by 96
Objective Analysis of Pseudostress over the Indian Ocean Using a Direct-Minimization Approach
Legler, D. M., Navon, I. M., & O’Brien, J. J. (1989) · Monthly Weather Review · Cited by 94
Monitoring Global Monthly Mean Surface Temperatures
Trenberth, K. E., Christy, J. R., & Hurrell, J. W. (1992) · Journal of Climate · doi:10.1175/1520-0442(1992)005<1405:mgmmst>2.0.co;2 · Cited by 87
Fukumori, I. (1995) · Journal of Geophysical Research Atmospheres · doi:10.1029/95jc02083 · Cited by 64
Miller, R. N. (1990) · Journal of Geophysical Research Atmospheres · doi:10.1029/jc095ic07p11461 · Cited by 40
Blumenthal, M. B., & Cane, M. A. (1989) · Journal of Physical Oceanography · Cited by 30
Self-citationPrice, C. (1994) · doi:10.1175/1520-0442(1994)007
Cited by
Rayner, N. A., Parker, D. E., Horton, E. B., Folland, C. K., Alexander, L. V., Rowell, D. P., Kent, E. C., & Kaplan, A. (2003) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2002jd002670 · Cited by 10,991
Self-citationAn Ensemble Adjustment Kalman Filter for Data Assimilation
Anderson, J. L. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<2884:aeakff>2.0.co;2 · Cited by 1,749
Analyses of global sea surface temperature 1856–1991
Kaplan, A., Cane, M. A., Kushnir, Y., Clement, A. C., Blumenthal, M. B., & Rajagopalan, B. (1998) · Journal of Geophysical Research: Oceans · doi:10.1029/97jc01736 · Cited by 1,576
Self-citationMann, M. E., Zhang, Z., Hughes, M. K., Bradley, R. S., Miller, S. K., Rutherford, S., & Ni, F. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0805721105 · Cited by 1,234
Jones, P. D., & Mann, M. E. (2004) · Reviews of Geophysics · doi:10.1029/2003rg000143 · Cited by 1,096
Metadata
- Authors
- Kaplan, A., Kushnir, Y., Cane, M. A., & Blumenthal, M. B.
- Venue
- Journal of Geophysical Research: Oceans
- Publisher
- American Geophysical Union (AGU)
- Published
- 1997-12-15
- Volume
- 102
- Issue
- C13
- Pages
- 27835-27860
- ISSN
- 0148-0227 (ISSN-L)
- OpenAlex
- W2008693787
- Cited by
- 271
- References
- 36
- FWCI
- 7.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.