4-D-Var or ensemble Kalman filter?
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
We consider the relative advantages of two advanced data assimilation systems, 4-D-Var and ensemble Kalman filter (EnKF), currently in use or under consideration for operational implementation.With the Lorenz model, we explore the impact of tuning assimilation parameters such as the assimilation window length and background error covariance in 4-D-Var, variance inflation in EnKF, and the effect of model errors and reduced observation coverage. For short assimilation windows EnKF gives more accurate analyses. Both systems reach similar levels of accuracy if long windows are used for 4-D-Var. For infrequent observations, when ensemble perturbations grow non-linearly and become non-Gaussian, 4-D-Var attains lower errors than EnKF. If the model is imperfect, the 4-D-Var with long windows requires weak constraint. Similar results are obtained with a quasi-geostrophic channel model. EnKF experiments made with the primitive equations SPEEDY model provide comparisons with 3-D-Var and guidance on model error and ‘observation localization’. Results obtained using operational models and both simulated and real observations indicate that currently EnKF is becoming competitive with 4-D-Var, and that the experience acquired with each of these methods can be used to improve the other. A table summarizes the pros and cons of the two methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deterministic Nonperiodic Flow
Lorenz, E. N. (1963) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(1963)020<0130:dnf>2.0.co;2 · Cited by 19,398
Evensen, G. (1994) · Journal of Geophysical Research: Oceans · doi:10.1029/94jc00572 · Cited by 5,371 · cited 1×
“1Evensen (1997) compared for this model a non-linear solution of the 4DVar cost function minimized over a very long assimilation period (many cycles) using a method of gradient descent with a weak constraint, with 1000-member ensembles of Kalman filter and Kalman smoother.”
MethodThe Ensemble Kalman Filter: theoretical formulation and practical implementation
Evensen, G. (2003) · Ocean Dynamics · doi:10.1007/s10236-003-0036-9 · Cited by 4,420
The NCEP–NCAR 50–Year Reanalysis: Monthly Means CD–ROM and Documentation
Kistler, R. E., Collins, W., Saha, S., White, G. H., Woollen, J. S., Kalnay, E., Chelliah, M., Ebisuzaki, W., Kanamitsu, M., Kousky, V. E., et al. (2001) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(2001)082<0247:tnnyrm>2.3.co;2 · Cited by 4,212
Self-citationAtmospheric Modeling, Data Assimilation and Predictability
Kalnay, E. (2002) · doi:10.1017/cbo9780511802270 · Cited by 3,391 · cited 3×
“Kalnay, 2003, p. 213). The simulated observations contain errors in accordance to R = 2I as in Miller et al. (1994). The corresponding observational error standard deviation ( √ 2), is an order of magnitude smaller than the natural variability, and all successful data assimilation experiments have RMS errors smaller t…”
BackgroundMethodInfluentialSelf-citationThe National Meteorological Center's Spectral Statistical-Interpolation Analysis System
Parrish, D. F., & Derber, J. C. (1992) · Monthly Weather Review · doi:10.1175/1520-0493(1992)120<1747:tnmcss>2.0.co;2 · Cited by 2,086
Construction of correlation functions in two and three dimensions
Gaspari, G., & Cohn, S. E. (1999) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712555417 · Cited by 1,965
Analysis Scheme in the Ensemble Kalman Filter
Burgers, G., Jan van Leeuwen, P., & Evensen, G. (1998) · Monthly Weather Review · doi:10.1175/1520-0493(1998)126<1719:asitek>2.0.co;2 · Cited by 1,869
Data Assimilation Using an Ensemble Kalman Filter Technique
Houtekamer, P. L., & Mitchell, H. L. (1998) · Monthly Weather Review · doi:10.1175/1520-0493(1998)126<0796:dauaek>2.0.co;2 · Cited by 1,864
An Ensemble Adjustment Kalman Filter for Data Assimilation
Anderson, J. L. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<2884:aeakff>2.0.co;2 · Cited by 1,749
Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter
Hunt, B. R., Kostelich, E. J., & Szunyogh, I. (2007) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2006.11.008 · Cited by 1,742
Ensemble Data Assimilation without Perturbed Observations
Whitaker, J. S., & Hamill, T. M. (2002) · Monthly Weather Review · doi:10.1175/1520-0493(2002)130<1913:edawpo>2.0.co;2 · Cited by 1,563
A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation
Houtekamer, P. L., & Mitchell, H. L. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<0123:asekff>2.0.co;2 · Cited by 1,492
Adaptive Sampling with the Ensemble Transform Kalman Filter. Part I: Theoretical Aspects
Bishop, C. H., Etherton, B. J., & Majumdar, S. J. (2001) · Monthly Weather Review · doi:10.1175/1520-0493(2001)129<0420:aswtet>2.0.co;2 · Cited by 1,348
Rabier, F., Järvinen, H., Klinker, E., Mahfouf, J. ‐., & Simmons, A. (2000) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712656415 · Cited by 925
Ide, K., Courtier, P., Ghil, M., & Lorenc, A. C. (1997) · Journal of the Meteorological Society of Japan. Ser. II · doi:10.2151/jmsj1965.75.1b_181 · Cited by 821
Tippett, M. K., Anderson, J. L., Bishop, C. H., Hamill, T. M., & Whitaker, J. S. (2003) · Monthly Weather Review · doi:10.1175/1520-0493(2003)131<1485:esrf>2.0.co;2 · Cited by 796
The potential of the ensemble Kalman filter for NWP—a comparison with 4D‐Var
Lorenc, A. C. (2003) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/qj.02.132 · Cited by 751
A local ensemble Kalman filter for atmospheric data assimilation
Ott, E., Hunt, B. R., Szunyogh, I., Zimin, A. V., Kostelich, E. J., Corazza, M., Kalnay, E., Patil, D. J., & Yorke, J. A. (2004) · Tellus A: Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v56i5.14462 · Cited by 751
Self-citationAtmospheric Data Assimilation with an Ensemble Kalman Filter: Results with Real Observations
Houtekamer, P. L., Mitchell, H. L., Pellerin, G., Buehner, M., Charron, M., Spacek, L., & Hansen, B. (2005) · Monthly Weather Review · doi:10.1175/mwr-2864.1 · Cited by 502
Ensemble Data Assimilation with the NCEP Global Forecast System
Whitaker, J. S., Hamill, T. M., Wei, X., Song, Y., & Toth, Z. (2008) · Monthly Weather Review · doi:10.1175/2007mwr2018.1 · Cited by 459
Data assimilation in the presence of forecast bias
Dee, D. P., & Da Silva, A. M. (1998) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712454512 · Cited by 438
Houtekamer, P. L., & Mitchell, H. L. (2005) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/qj.05.135 · Cited by 419
Molteni, F. (2003) · Climate Dynamics · doi:10.1007/s00382-002-0268-2 · Cited by 407
Advanced Data Assimilation in Strongly Nonlinear Dynamical Systems
Miller, R. N., Ghil, M., & Gauthiez, F. (1994) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(1994)051<1037:adaisn>2.0.co;2 · Cited by 393
A Comparison of Breeding and Ensemble Transform Kalman Filter Ensemble Forecast Schemes
Wang, X., & Bishop, C. H. (2003) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(2003)060<1140:acobae>2.0.co;2 · Cited by 389
Evensen, G., & van Leeuwen, P. J. (1996) · Monthly Weather Review · doi:10.1175/1520-0493(1996)124<0085:aogadf>2.0.co;2 · Cited by 335
Local Ensemble Transform Kalman Filtering with an AGCM at a T159/L48 Resolution
Miyoshi, T., & Yamane, S. (2007) · Monthly Weather Review · doi:10.1175/2007mwr1873.1 · Cited by 334
Self-citationMaximum Likelihood Ensemble Filter: Theoretical Aspects
Zupanski, M. (2005) · Monthly Weather Review · doi:10.1175/mwr2946.1 · Cited by 321
Assessing the Effects of Data Selection with the DAO Physical-Space Statistical Analysis System*
Cohn, S. E., da Silva, A., Guo, J., Sienkiewicz, M., & Lamich, D. (1998) · Monthly Weather Review · doi:10.1175/1520-0493(1998)126<2913:ateods>2.0.co;2 · Cited by 272
Four-dimensional ensemble Kalman filtering
Hunt, B. R., Kalnay, E., Kostelich, E. J., Ott, E., Patil, D. J., SAUER, T. D., Szunyogh, I., Yorke, J. A., & Zimin, A. V. (2004) · Tellus A Dynamic Meteorology and Oceanography · doi:10.1111/j.1600-0870.2004.00066.x · Cited by 253
Self-citationAdvanced Data Assimilation for Strongly Nonlinear Dynamics
Evensen, G. (1997) · Monthly Weather Review · doi:10.1175/1520-0493(1997)125<1342:adafsn>2.0.co;2 · Cited by 237
On extending the limits of variational assimilation in nonlinear chaotic systems
Pires, C., Vautard, R., & Talagrand, O. (1996) · Tellus A Dynamic Meteorology and Oceanography · doi:10.1034/j.1600-0870.1996.00006.x · Cited by 206
Optimal Prediction of Forecast Error Covariances through Singular Vectors
Ehrendorfer, M., & Tribbia, J. J. (1997) · Journal of the Atmospheric Sciences · Cited by 175
Lawson, W. G., & Hansen, J. A. (2004) · Monthly Weather Review · doi:10.1175/1520-0493(2004)132<1966:iosadf>2.0.co;2 · Cited by 144
Fertig, E. J., Harlim, J., & Hunt, B. R. (2006) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v59i1.14849 · Cited by 137
Estimating and Correcting Global Weather Model Error
Danforth, C., Kalnay, E., & Miyoshi, T. (2007) · Monthly Weather Review · doi:10.1175/mwr3289.1 · Cited by 131
Self-citationKeppenne, C. L., & Rienecker, M. M. (2002) · Monthly Weather Review · doi:10.1175/1520-0493(2002)130<2951:itoamp>2.0.co;2 · Cited by 126
A comparison of error subspace Kalman filters
Nerger, L., Hiller, W., & Schröter, J. (2005) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v57i5.14732 · Cited by 121
Local ensemble Kalman filtering in the presence of model bias
Baek, S.-J., Hunt, B. R., Kalnay, E., Ott, E., & Szunyogh, I. (2006) · Tellus A Dynamic Meteorology and Oceanography · doi:10.1111/j.1600-0870.2006.00178.x · Cited by 112
Self-citationFisher, M., Leutbecher, M., & Kelly, G. A. (2005) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/qj.04.142 · Cited by 112
Data Assimilation in the Presence of Forecast Bias: The GEOS Moisture Analysis
Dee, D. P., & Todling, R. (2000) · Monthly Weather Review · doi:10.1175/1520-0493(2000)128<3268:daitpo>2.0.co;2 · Cited by 110
Szunyogh, I., Kostelich, E. J., Gyarmati, G., Patil, D. J., Hunt, B. R., Kalnay, E., Ott, E., & Yorke, J. A. (2005) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v57i4.14721 · Cited by 106
Self-citationIdealized Adaptive Observation Strategies for Improving Numerical Weather Prediction
Morss, R. E., Emanuel, K. A., & Snyder, C. (2001) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(2001)058<0210:iaosfi>2.0.co;2 · Cited by 101
Yang, S., Baker, D. R., Li, H., Cordes, K., Huff, M., Nagpal, G., Okereke, E., Villafañe, J., Kalnay, E., & Duane, G. S. (2006) · Journal of the Atmospheric Sciences · doi:10.1175/jas3739.1 · Cited by 89
Self-citationUse of the breeding technique to estimate the structure of the analysis "errors of the day"
Corazza, M., Corazza, M., Kalnay, E., Patil, D. J., Yang, S., Morss, R. E., Cai, M., Szunyogh, I., Hunt, B. R., & Yorke, J. A. (2003) · HAL · Cited by 82
Self-citationENSEMBLE KALMAN FILTER EXPERIMENTS WITH A PRIMITIVE-EQUATION GLOBAL MODEL
Miyoshi, T. (2005) · University Libraries (University of Maryland) · Cited by 79
Self-citationKeppenne, C. L., Rienecker, M. M., Kurkowski, N. P., & Adamec, D. (2005) · Nonlinear processes in geophysics · doi:10.5194/npg-12-491-2005 · Cited by 65
Assimilating non-local observations with a local ensemble Kalman filter
Fertig, E. J., Hunt, B. R., Ott, E., & Szunyogh, I. (2007) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v59i5.15160 · Cited by 64
Assessing a local ensemble Kalman filter: Perfect model experiments with the NCEP global model
Szunyogh, I., Kostelich, E. J., Gyarmati, G., Patil, D. J., Hunt, B. R., Kalnay, E., Ott, E., & James, A. P. (2004) · Cited by 40
Self-citationOn the impact of humidity observations in numerical weather prediction
Bengtsson, L. O., & Hodges, K. I. (2005) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v57i5.14734 · Cited by 35
Ott, E., Hunt, B. R., Szunyogh, I., Corazza, M., Kalnay, E., Patil, D. J., Yorke, J. A., Zimin, A. V., & Kostelich, E. J. (2002) · arXiv (Cornell University) · Cited by 27
Self-citation
Cited by
Digital twin: values, challenges and enablers from a modeling perspective
Rasheed, A., San, O., & Kvamsdal, T. (2020) · IEEE Access · doi:10.1109/access.2020.2970143 · Cited by 1,952
Inverse problems: A Bayesian perspective
Stuart, A. M. (2010) · Acta Numerica · doi:10.1017/s0962492910000061 · Cited by 1,791
Data assimilation in the geosciences: An overview of methods, issues, and perspectives
Carrassi, A., Bocquet, M., Bertino, L., & Evensen, G. (2018) · WIREs Climate Change · doi:10.1002/wcc.535 · Cited by 867
The Data Assimilation Research Testbed: A Community Facility
Anderson, J., Hoar, T., Raeder, K., Liu, H., Collins, N., Torn, R., & Avellano, A. (2009) · Bulletin of the American Meteorological Society · doi:10.1175/2009bams2618.1 · Cited by 716
The ensemble Kalman filter for combined state and parameter estimation
Evensen, G. (2009) · IEEE Control Systems · doi:10.1109/mcs.2009.932223 · Cited by 547
Metadata
- Authors
- Kalnay, E., Li, H., Miyoshi, T., Yang, S.-C., & Ballabrera-Poy, J.
- Venue
- Tellus A: Dynamic Meteorology and Oceanography
- Publisher
- Stockholm University Press
- Published
- 2007-01-01
- Volume
- 59
- Issue
- 5
- Pages
- 758
- ISSN
- 0280-6495 (ISSN-L)
- 1600-0870
- OpenAlex
- W2162870936
- Cited by
- 278
- References
- 52
- FWCI
- 11.55
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.