The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Reduced space optimal analysis for historical data sets: 136 years of Atlantic sea surface temperatures
Abstract
A computationally efficient method for analyzing meteorological and oceanographic historical data sets has been developed. The method combines data reduction and least squares optimal estimation. The data reduction involves computing empirical orthogonal functions (EOFs) of the data based on their recent, high‐quality portion and using a leading EOF subset as a basis for the analyzed solution and for fitting a first‐order linear model of time transitions. We then formulate optimal estimation problems in terms of the EOF projection of the analyzed field to obtain reduced space analogues of the optimal smoother, the Kalman filter, and optimal interpolation techniques. All reduced space algorithms are far cheaper computationally than their full grid prototypes, while their solutions are not necessarily inferior since the sparsity and error in available data often make estimation of small‐scale features meaningless. Where covariance patterns can be estimated from the available data, the analysis methods fill gaps, correct sampling errors, and produce spatially and temporally coherent analyzed data sets. As with classical least squares estimation, the reduced space versions also provide theoretical error estimates for analyzed values. The methods are demonstrated on Atlantic monthly sea surface temperature (SST) anomalies for 1856–1991 from the United Kingdom Meteorological Office historical sea surface temperature data set (version MOHSST5). Choice of a reduced space dimension of 30 is shown to be adequate. The analyses are tested by withholding a significant part of the data and prove to be robust and in agreement with their own error estimates; they are also consistent with a partially independent optimal interpolation (OI) analysis by Reynolds and Smith [1994] produced in the National Centers for Environmental Prediction (NCEP)(known as the NCEP OI analysis). A simple statistical model is used to depict the month‐to‐month SST evolution in the optimal smoother algorithm. Results are somewhat superior to both the Kalman filter, which relies less on the model, and the optimal interpolation, which does not use it at all. The method generalizes a few recent works on using a reduced space for data set analyses. Difficulties of methods which simply fit EOF patterns to observed data are pointed out, and the more complete analysis procedures developed here are suggested as a remedy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Linear Statistical Inference and its Applications: Second Editon
Rao, C. R. (1973) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316436 · Cited by 10,489
Gantmacher, F. R. (1984) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 8,520
GELB, A. (1974) · CERN Document Server (European Organization for Nuclear Research) · Cited by 6,405
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Linear Statistical Inference and Its Applications.
Robertson, C. A., & Rao, C. R. (1975) · Biometrics · doi:10.2307/2529568 · Cited by 3,598
Sampling Errors in the Estimation of Empirical Orthogonal Functions
North, G. R., Bell, T. L., Cahalan, R. F., & Moeng, F. J. (1982) · Monthly Weather Review · doi:10.1175/1520-0493(1982)110<0699:seiteo>2.0.co;2 · Cited by 3,400
Maximum likelihood estimates of linear dynamic systems
RAUCH, H. E., TUNG, F., & STRIEBEL, C. T. (1965) · AIAA Journal · doi:10.2514/3.3166 · Cited by 1,943
Principal Component Analysis in Meteorology and Oceanography
Preisendorfer, R. W., & Mobley, C. D. (1988) · Cited by 1,785
Analysis methods for numerical weather prediction
Lorenc, A. C. (1986) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49711247414 · Cited by 1,510
Cited by
Rayner, N. A., Parker, D. E., Horton, E. B., Folland, C. K., Alexander, L. V., Rowell, D. P., Kent, E. C., & Kaplan, A. (2003) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2002jd002670 · Cited by 10,991
Self-citationAn Ensemble Adjustment Kalman Filter for Data Assimilation
Anderson, J. L. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<2884:aeakff>2.0.co;2 · Cited by 1,749
Analyses of global sea surface temperature 1856–1991
Kaplan, A., Cane, M. A., Kushnir, Y., Clement, A. C., Blumenthal, M. B., & Rajagopalan, B. (1998) · Journal of Geophysical Research: Oceans · doi:10.1029/97jc01736 · Cited by 1,576
Self-citationMann, M. E., Zhang, Z., Hughes, M. K., Bradley, R. S., Miller, S. K., Rutherford, S., & Ni, F. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0805721105 · Cited by 1,234
Jones, P. D., & Mann, M. E. (2004) · Reviews of Geophysics · doi:10.1029/2003rg000143 · Cited by 1,096
A New Sea Surface Temperature and Sea Ice Boundary Dataset for the Community Atmosphere Model
Hurrell, J. W., Hack, J. J., Shea, D., Caron, J. M., & Rosinski, J. (2008) · Journal of Climate · doi:10.1175/2008jcli2292.1 · Cited by 1,072
An Updated Assessment of Near‐Surface Temperature Change From 1850: The HadCRUT5 Data Set
Morice, C. P., Kennedy, J. J., Rayner, N. A., Winn, J. P., Hogan, E., Killick, R. E., Dunn, R. J. H., Osborn, T. J., Jones, P. D., & Simpson, I. R. (2021) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2019jd032361 · Cited by 951
Observed climate variability and change
Folland, C. K., Karl, T. R., & Jim Salinger, M. (2002) · Weather · doi:10.1256/004316502320517353 · Cited by 920
Allan, R., & Ansell, T. (2006) · Journal of Climate · doi:10.1175/jcli3937.1 · Cited by 843
Schneider, T. (2001) · Journal of Climate · doi:10.1175/1520-0442(2001)014<0853:aoicde>2.0.co;2 · Cited by 759
Estimates of the Regional Distribution of Sea Level Rise over the 1950–2000 Period
Church, J. A., White, N. J., Coleman, R., Lambeck, K., & Mitrovica, J. X. (2004) · Journal of Climate · doi:10.1175/1520-0442(2004)017<2609:eotrdo>2.0.co;2 · Cited by 658
EOF Calculations and Data Filling from Incomplete Oceanographic Datasets*
Beckers, J. M., & Rixen, M. (2003) · Journal of Atmospheric and Oceanic Technology · doi:10.1175/1520-0426(2003)020<1839:ecadff>2.0.co;2 · Cited by 647
Historical Climatology In Europe – The State Of The Art
BráZdil, R., Pfister, C., Wanner, H., Storch, H. V., & Luterbacher, J. (2005) · Climatic Change · doi:10.1007/s10584-005-5924-1 · Cited by 624
Indian Monsoon–ENSO Relationship on Interdecadal Timescale
Krishnamurthy, V., & Goswami, B. N. (2000) · Journal of Climate · doi:10.1175/1520-0442(2000)013<0579:imeroi>2.0.co;2 · Cited by 502
ENSO, Pacific Decadal Variability, and U.S. Summertime Precipitation, Drought, and Stream Flow
Barlow, M., Nigam, S., & Berbery, E. H. (2001) · Journal of Climate · doi:10.1175/1520-0442(2001)014<2105:epdvau>2.0.co;2 · Cited by 444
Climate impacts on Indian agriculture
Krishna Kumar, K., Rupa Kumar, K., Ashrit, R. G., Deshpande, N. R., & Hansen, J. W. (2004) · International Journal of Climatology · doi:10.1002/joc.1081 · Cited by 438
The ocean's response to North Atlantic Oscillation variability
Visbeck, M., Chassignet, E. P., Curry, R. G., Delworth, T. L., Dickson, R. R., & Krahmann, G. (2003) · Geophysical Monograph Series · doi:10.1029/134gm06 · Cited by 375
Climate forcings in Goddard Institute for Space Studies SI2000 simulations
Hansen, J., Sato, M., Nazarenko, L., Ruedy, R., Lacis, A., Koch, D., Tegen, I., Hall, T., Shindell, D., Santer, B., et al. (2002) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2001jd001143 · Cited by 345
Half a century of satellite remote sensing of sea-surface temperature
Minnett, P. J., Alvera-Azcárate, A., Chin, T. M., Corlett, G. K., Gentemann, C. L., Karagali, I., Li, X., Marsouin, A., Marullo, S., Maturi, E., et al. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111366 · Cited by 342
Multi-time scale stream flow predictions: The support vector machines approach
Asefa, T., Kemblowski, M., McKee, M., & Khalil, A. (2006) · Journal of Hydrology · doi:10.1016/j.jhydrol.2005.06.001 · Cited by 294
Impact of the North Atlantic Oscillation on Middle Eastern Climate and Streamflow
Cullen, H. M., Kaplan, A., Arkin, P. A., & deMenocal, P. B. (2002) · Climatic Change · doi:10.1023/a:1020518305517 · Cited by 293
Self-citationA Diagnostic Study of the Role of Remote Forcing in Tropical Atlantic Variability
Czaja, A., van der Vaart, P., & Marshall, J. (2002) · Journal of Climate · doi:10.1175/1520-0442(2002)015<3280:adsotr>2.0.co;2 · Cited by 288
Vernet, M., Martinson, D., Iannuzzi, R., Stammerjohn, S., Kozlowski, W., Sines, K., Smith, R., & Garibotti, I. (2008) · Deep Sea Research Part II: Topical Studies in Oceanography · doi:10.1016/j.dsr2.2008.05.021 · Cited by 253
A Hybrid Coupled Model Study of Tropical Atlantic Variability
Chang, P., Ji, L., & Saravanan, R. (2001) · Journal of Climate · doi:10.1175/1520-0442(2001)013<0361:ahcmso>2.0.co;2 · Cited by 123
On the Atlantic–Pacific Niños connection: a multidecadal modulated mode.
Martín-Rey, M., Rodríguez-Fonseca, B., Polo, I., & Kucharski, F. (2014) · Climate Dynamics · doi:10.1007/s00382-014-2305-3 · Cited by 112
Lan, K.-W., Evans, K., & Lee, M.-A. (2013) · Climatic Change · doi:10.1007/s10584-012-0637-8 · Cited by 106
Metadata
- Authors
- Kaplan, A., Kushnir, Y., Cane, M. A., & Blumenthal, M. B.
- Venue
- Journal of Geophysical Research: Oceans
- Publisher
- American Geophysical Union (AGU)
- Published
- 1997-12-15
- Volume
- 102
- Issue
- C13
- Pages
- 27835-27860
- ISSN
- 0148-0227 (ISSN-L)
- OpenAlex
- W2008693787
- Cited by
- 271
- References
- 36
- FWCI
- 7.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.