A local ensemble Kalman filter for atmospheric data assimilation
Open accessThe DOI matches its OpenAlex record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
In this paper, we introduce a new, local formulation of the ensemble Kalman filter approach for atmospheric data assimilation. Our scheme is based on the hypothesis that, when the Earth’s surface is divided up into local regions of moderate size, vectors of the forecast uncertainties in such regions tend to lie in a subspace of much lower dimension than that of the full atmospheric state vector of such a region. Ensemble Kalman filters, in general, take the analysis resulting from the data assimilation to lie in the same subspace as the expected forecast error. Under our hypothesis the dimension of the subspace corresponding to local regions is low. This is used in our scheme to allow operations only on relatively low-dimensional matrices. The data assimilation analysis is performed locally in a manner allowing massively parallel computation to be exploited. The local analyses are then used to construct global states for advancement to the next forecast time. One advantage, which may take on more importance as ever-increasing amounts of remotely-sensed satellite data become available, is the favorable scaling of the computational cost of our method with increasing data size, as compared to other methods that assimilate data sequentially. The method, its potential advantages, properties, and implementation requirements are illustrated by numerical experiments on the Lorenz-96 model. It is found that accurate analysis can be achieved at a cost which is very modest compared to that of a full global ensemble Kalman filter.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
New Results in Linear Filtering and Prediction Theory
Kalman, R. E., & Bucy, R. S. (1961) · Journal of Basic Engineering · doi:10.1115/1.3658902 · Cited by 6,387
Evensen, G. (1994) · Journal of Geophysical Research: Oceans · doi:10.1029/94jc00572 · Cited by 5,371
Ott, E., & Wiesenfeld, K. (1994) · Physics Today · doi:10.1063/1.2808369 · Cited by 3,448
Self-citationAtmospheric Modeling, Data Assimilation and Predictability
Kalnay, E. (2002) · doi:10.1017/cbo9780511802270 · Cited by 3,391
Self-citationOptimal Control of Systems Governed by Partial Differential Equations.
Russell, D. L., Lions, J. L., & Mitter, S. K. (1972) · The American Mathematical Monthly · doi:10.2307/2318095 · Cited by 2,922
Data Assimilation Using an Ensemble Kalman Filter Technique
Houtekamer, P. L., & Mitchell, H. L. (1998) · Monthly Weather Review · doi:10.1175/1520-0493(1998)126<0796:dauaek>2.0.co;2 · Cited by 1,864
Factorization Methods for Discrete Sequential Estimation
(1977) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6052-7 · Cited by 1,847
An Ensemble Adjustment Kalman Filter for Data Assimilation
Anderson, J. L. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<2884:aeakff>2.0.co;2 · Cited by 1,749
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3907 · Cited by 1,676
The ECMWF Ensemble Prediction System: Methodology and validation
Molteni, F., Buizza, R., Palmer, T. N., & Petroliagis, T. (1996) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712252905 · Cited by 1,616
Ensemble Data Assimilation without Perturbed Observations
Whitaker, J. S., & Hamill, T. M. (2002) · Monthly Weather Review · doi:10.1175/1520-0493(2002)130<1913:edawpo>2.0.co;2 · Cited by 1,563
Analysis methods for numerical weather prediction
Lorenc, A. C. (1986) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49711247414 · Cited by 1,510
A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation
Houtekamer, P. L., & Mitchell, H. L. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<0123:asekff>2.0.co;2 · Cited by 1,492
Adaptive Sampling with the Ensemble Transform Kalman Filter. Part I: Theoretical Aspects
Bishop, C. H., Etherton, B. J., & Majumdar, S. J. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<0420:aswtet>2.0.co;2 · Cited by 1,348
Ensemble Forecasting at NMC: The Generation of Perturbations
Toth, Z., & Kalnay, E. (1993) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(1993)074<2317:efantg>2.0.co;2 · Cited by 1,222
Self-citationDistance-Dependent Filtering of Background Error Covariance Estimates in an Ensemble Kalman Filter
Hamill, T. M., Whitaker, J. S., & Snyder, C. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<2776:ddfobe>2.0.co;2 · Cited by 1,112
Ensemble Forecasting at NCEP and the Breeding Method
Toth, Z., & Kalnay, E. (1997) · Monthly Weather Review · doi:10.1175/1520-0493(1997)125<3297:efanat>2.0.co;2 · Cited by 1,063
Self-citationAnderson, J. L., & Anderson, S. L. (1999) · Monthly Weather Review · doi:10.1175/1520-0493(1999)127<2741:amciot>2.0.co;2 · Cited by 1,042
Rabier, F., Järvinen, H., Klinker, E., Mahfouf, J. ‐., & Simmons, A. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656415 · Cited by 925
Tippett, M. K., Anderson, J. L., Bishop, C. H., Hamill, T. M., & Whitaker, J. S. (2003) · Monthly Weather Review · doi:10.1175/1520-0493(2003)131<1485:esrf>2.0.co;2 · Cited by 796
Chaotic behavior of multidimensional difference equations
Kaplan, J. L., & Yorke, J. A. (1979) · Lecture Notes in Mathematics · doi:10.1007/bfb0064319 · Cited by 711
Self-citationOptimal Sites for Supplementary Weather Observations: Simulation with a Small Model
Lorenz, E. N., & Emanuel, K. A. (1998) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(1998)055<0399:osfswo>2.0.co;2 · Cited by 641
A Hybrid Ensemble Kalman Filter–3D Variational Analysis Scheme
Hamill, T. M., & Snyder, C. (2000) · Monthly Weather Review · doi:10.1175/1520-0493(2000)128<2905:ahekfv>2.0.co;2 · Cited by 619
A singular evolutive extended Kalman filter for data assimilation in oceanography
Tuan Pham, D., Verron, J., & Christine Roubaud, M. (1998) · Journal of Marine Systems · doi:10.1016/s0924-7963(97)00109-7 · Cited by 544
A Comparison of Breeding and Ensemble Transform Kalman Filter Ensemble Forecast Schemes
Wang, X., & Bishop, C. H. (2003) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(2003)060<1140:acobae>2.0.co;2 · Cited by 389
Evensen, G., & van Leeuwen, P. J. (1996) · Monthly Weather Review · doi:10.1175/1520-0493(1996)124<0085:aogadf>2.0.co;2 · Cited by 335
Numerical Weather Map Analysis
Bergthórsson, P., & Döös, B. R. (1955) · Tellus A: Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v7i3.8902 · Cited by 226
Data Assimilation via Error Subspace Statistical Estimation.Part I: Theory and Schemes
Lermusiaux, P. F. J., & Robinson, A. R. (1999) · Monthly Weather Review · doi:10.1175/1520-0493(1999)127<1385:davess>2.0.co;2 · Cited by 203
Mapping tropical Pacific sea level: Data assimilation via a reduced state space Kalman filter
Cane, M. A., Kaplan, A., Miller, R. N., Tang, B., Hackert, E., & Busalacchi, A. J. (1996) · Journal of Geophysical Research Atmospheres · doi:10.1029/96jc01684 · Cited by 188
Applications of Estimation Theory to Numerical Weather Prediction
Ghil, M., Cohn, S., Tavantzis, J., Bube, K., & Isaacson, E. (1981) · Applied Mathematical Sciences · doi:10.1007/978-1-4612-5970-1_5 · Cited by 186
A Partitioned Kalman Filter and Smoother
Fukumori, I. (2002) · Monthly Weather Review · doi:10.1175/1520-0493(2002)130<1370:apkfas>2.0.co;2 · Cited by 184
Local Low Dimensionality of Atmospheric Dynamics
Patil, D. J., Hunt, B. R., Kalnay, E., Yorke, J. A., & Ott, E. (2001) · Physical Review Letters · doi:10.1103/physrevlett.86.5878 · Cited by 178
Self-citationKlinker, E., Rabier, F., Kelly, G., & Mahfouf, J. ‐. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656417 · Cited by 173
Keppenne, C. L., & Rienecker, M. M. (2002) · Monthly Weather Review · doi:10.1175/1520-0493(2002)130<2951:itoamp>2.0.co;2 · Cited by 126
A study of the dynamics of four-dimensional data assimilation
Talagrand, O. (1981) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v33i1.10693 · Cited by 85
Cited by
A Reanalysis of Ocean Climate Using Simple Ocean Data Assimilation (SODA)
Carton, J. A., & Giese, B. S. (2008) · Monthly Weather Review · doi:10.1175/2007mwr1978.1 · Cited by 1,818
Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter
Hunt, B. R., Kostelich, E. J., & Szunyogh, I. (2007) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2006.11.008 · Cited by 1,742
Self-citationData assimilation in the geosciences: An overview of methods, issues, and perspectives
Carrassi, A., Bocquet, M., Bertino, L., & Evensen, G. (2018) · WIREs Climate Change · doi:10.1002/wcc.535 · Cited by 867
The ensemble Kalman filter for combined state and parameter estimation
Evensen, G. (2009) · IEEE Control Systems · doi:10.1109/mcs.2009.932223 · Cited by 547
A review of operational methods of variational and ensemble‐variational data assimilation
Bannister, R. N. (2017) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.2982 · Cited by 506
Metadata
- Authors
- Ott, E., Hunt, B. R., Szunyogh, I., Zimin, A. V., Kostelich, E. J., Corazza, M., Kalnay, E., Patil, D. J., & Yorke, J. A.
- Venue
- Tellus A Dynamic Meteorology and Oceanography
- Publisher
- Wiley
- Published
- 2004-10-01
- Volume
- 56
- Issue
- 5
- Pages
- 415-428
- ISSN
- 0280-6495 (ISSN-L)
- OpenAlex
- W2951980816
- Cited by
- 344
- References
- 36
- FWCI
- 5.44
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.