The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics
Open accessAbstract
State estimation of dynamical systems in real-time is a fundamental task in signal processing. For systems that are well-represented by a fully known linear Gaussian state space (SS) model, the celebrated Kalman filter (KF) is a low complexity optimal solution. However, both linearity of the underlying SS model and accurate knowledge of it are often not encountered in practice. Here, we present KalmanNet, a real-time state estimator that learns from data to carry out Kalman filtering under non-linear dynamics with partial information. By incorporating the structural SS model with a dedicated recurrent neural network module in the flow of the KF, we retain data efficiency and interpretability of the classic algorithm while implicitly learning complex dynamics from data. We demonstrate numerically that KalmanNet overcomes non-linearities and model mismatch, outperforming classic filtering methods operating with both mismatched and accurate domain knowledge.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Haykin, S. (1986) · Cited by 12,603
A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking
Arulampalam, M. S., Maskell, S., Gordon, N., & Clapp, T. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/78.978374 · Cited by 11,502
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Novel approach to nonlinear/non-Gaussian Bayesian state estimation
Gordon, N. J., Salmond, D. J., & Smith, A. F. M. (1993) · IEE Proceedings F Radar and Signal Processing · doi:10.1049/ip-f-2.1993.0015 · Cited by 7,550
Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software
Bar‐Shalom, Y., Li, X. ‐., & Kirubarajan, T. (2002) · doi:10.1002/0471221279 · Cited by 6,782
New Results in Linear Filtering and Prediction Theory
Kalman, R. E., & Bucy, R. S. (1961) · Journal of Basic Engineering · doi:10.1115/1.3658902 · Cited by 6,387
New extension of the Kalman filter to nonlinear systems
Julier, S. J., & Uhlmann, J. K. (1997) · SPIE Proceedings · doi:10.1117/12.280797 · Cited by 5,331
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
Extrapolation, Interpolation, and Smoothing of Stationary Time Series: With Engineering Applications
Wiener, N. (1949) · The MIT Press eBooks · doi:10.7551/mitpress/2946.001.0001 · Cited by 4,826
The unscented Kalman filter for nonlinear estimation
Wan, E. A., & Van Der Merwe, R. (2002) · Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373) · doi:10.1109/asspcc.2000.882463 · Cited by 4,001
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1285773 · Cited by 3,811
Arasaratnam, I., & Haykin, S. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2009.2019800 · Cited by 3,380
Time Series Analysis by State Space Methods: Second Edition
Durbin, J., & Koopman, S. J. (2012) · doi:10.1093/acprof:oso/9780199641178.001.0001 · Cited by 3,301
Stochastic Backpropagation and Approximate Inference in Deep Generative Models
Rezende, D. J., Mohamed, S., & Wierstra, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.4082 · Cited by 2,405
Sequential Monte Carlo Methods for Dynamic Systems
Liu, J. S., & Chen, R. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473765 · Cited by 2,191
Gate-variants of Gated Recurrent Unit (GRU) neural networks
Dey, R., & Salem, F. M. (2017) · 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.2017.8053243 · Cited by 2,186
Estimation with Applications to Tracking and Navigation: Theory, Algorithms, and Software
Bar‐Shalom, Y., Kirubarajan, T., & Li, X. R. (2001) · Cited by 2,175
Particle Markov Chain Monte Carlo Methods
Andrieu, C., Doucet, A., & Holenstein, R. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2009.00736.x · Cited by 1,971
Maximum likelihood estimates of linear dynamic systems
RAUCH, H. E., TUNG, F., & STRIEBEL, C. T. (1965) · AIAA Journal · doi:10.2514/3.3166 · Cited by 1,943
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. (2017) · Figshare · doi:10.6084/m9.figshare.5203696 · Cited by 1,919
AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM
Shumway, R. H., & Stoffer, D. S. (1982) · Journal of Time Series Analysis · doi:10.1111/j.1467-9892.1982.tb00349.x · Cited by 1,470
Deep State Space Models for Time Series Forecasting
Rangapuram, S. S., Seeger, M., Gasthaus, J. A., Stella, L., Wang, Y., & Januschowski, T. (2018) · neural information processing systems · Cited by 1,097
Discrete-Time Nonlinear Filtering Algorithms Using Gauss–Hermite Quadrature
Arasaratnam, I., Haykin, S., & Elliott, R. J. (2007) · Proceedings of the IEEE · doi:10.1109/jproc.2007.894705 · Cited by 622
Industrial Applications of the Kalman Filter: A Review
Auger, F., Hilairet, M., Guerrero, J. M., Monmasson, E., Orlowska-Kowalska, T., & Katsura, S. (2013) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2012.2236994 · Cited by 590
University of Michigan North Campus long-term vision and lidar dataset
Carlevaris-Bianco, N., Ushani, A. K., & Eustice, R. M. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915614638 · Cited by 576
Robust Kalman filtering for uncertain discrete-time systems
Xie, L., Soh, Y. C., & de Souza, C. E. (1994) · IEEE Transactions on Automatic Control · doi:10.1109/9.293203 · Cited by 570
Parameter estimation for linear dynamical systems
Ghahramani, Z., & Hinton, G. E. (1996) · Cambridge University Engineering Department Publications Database · Cited by 556
Training recurrent neural networks
Hinton, G. E., & Sutskever, I. (2013) · Cited by 383
Shlezinger, N., Whang, J., Eldar, Y. C., & Dimakis, A. G. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3247480 · Cited by 368
Self-citationStructured Inference Networks for Nonlinear State Space Models
Krishnan, R., Shalit, U., & Sontag, D. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10779 · Cited by 346
Markov Chain Monte Carlo and Variational Inference: Bridging the Gap
Salimans, T., Kingma, D. P., & Welling, M. (2014) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1410.6460 · Cited by 343
SMC2: An Efficient Algorithm for Sequential Analysis of State Space Models
Chopin, N., Jacob, P. E., & Papaspiliopoulos, O. (2013) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2012.01046.x · Cited by 338
Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data
Karl, M., Soelch, M., Bayer, J., & van der Smagt, P. (2016) · arXiv · doi:10.48550/arxiv.1605.06432 · Cited by 232
Particle Learning and Smoothing
Carvalho, C. M., Johannes, M. S., Lopes, H. F., & Polson, N. G. (2010) · Statistical Science · doi:10.1214/10-sts325 · Cited by 230
A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning
Fraccaro, M., Kamronn, S., Paquet, U., & Winther, O. (2017) · arXiv · doi:10.48550/arxiv.1710.05741 · Cited by 229
Nonlinear filtering: Interacting particle resolution
Moral, P. D. (1997) · Comptes Rendus de l Académie des Sciences - Series I - Mathematics · doi:10.1016/s0764-4442(97)84778-7 · Cited by 224
Krishnan, R. G., Shalit, U., & Sontag, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05121 · Cited by 206
Particle Filters: A Hands-On Tutorial
Elfring, J., Torta, E., & van de Molengraft, R. (2021) · Sensors · doi:10.3390/s21020438 · Cited by 203
Model-Based Deep Learning: On the Intersection of Deep Learning and Optimization
Shlezinger, N., Eldar, Y. C., & Boyd, S. P. (2022) · IEEE Access · doi:10.1109/access.2022.3218802 · Cited by 185
Self-citationLong Short-Term Memory Kalman Filters: Recurrent Neural Estimators for Pose Regularization
Coskun, H., Achilles, F., DiPietro, R., Navab, N., & Tombari, F. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.589 · Cited by 175
ViterbiNet: A Deep Learning Based Viterbi Algorithm for Symbol Detection
Shlezinger, N., Farsad, N., Eldar, Y. C., & Goldsmith, A. J. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2972352 · Cited by 172
Self-citationBackprop KF: Learning Discriminative Deterministic State EstimatorsPreprint
Haarnoja, T., Ajay, A., Levine, S., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07148 · Cited by 167
DeepSIC: Deep Soft Interference Cancellation for Multiuser MIMO Detection
Shlezinger, N., Fu, R., & Eldar, Y. C. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3032663 · Cited by 163
Self-citationRecurrent Kalman Networks: Factorized Inference in High-Dimensional Deep Feature Spaces
Becker, P., Pandya, H., Gebhardt, G. H. W., Zhao, C., Taylor, C. J., & Neumann, G. M. (2019) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.48550/arxiv.1905.07357 · Cited by 159
Robust Kalman Filtering Under Model Perturbations
Zorzi, M. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2601879 · Cited by 147
Cooperative parallel particle filters for online model selection and applications to urban mobility
Martino, L., Read, J., Elvira, V., et al. (2016) · Digital Signal Processing · doi:10.1016/j.dsp.2016.09.011 · Cited by 147
Black box variational inference for state space modelsPreprint
Archer, E., Park, I. M., Buesing, L., Cunningham, J. P., & Paninski, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.07367 · Cited by 147
Discriminative Training of Kalman Filters
Abbeel, P., Coates, A., Montemerlo, M., Ng, A., & Thrun, S. (2005) · doi:10.15607/rss.2005.i.038 · Cited by 129
KFNet: Learning Temporal Camera Relocalization Using Kalman Filtering
Zhou, L., Luo, Z., Shen, T., Zhang, J., Zhen, M., Yao, Y., Fang, T., & Quan, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00497 · Cited by 119
Variational Sequential Monte Carlo
Naesseth, C. A., Linderman, S. W., Ranganath, R., & Blei, D. M. (2018) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 99
Variational Sequential Monte CarloPreprint
Naesseth, C. A., Linderman, S. W., Ranganath, R., & Blei, D. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.11140 · Cited by 71
Kalmannet: Data-Driven Kalman Filtering
Revach, G., Shlezinger, N., van Sloun, R. J. G., & Eldar, Y. C. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413750 · Cited by 68
Self-citationExpectation maximization as message passing
Dauwels, J., Korl, S., & Loeliger, H. (2005) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2005.1523402 · Cited by 60
On the robustness of the Bayes and Wiener estimators under model uncertainty
Zorzi, M. (2017) · Automatica · doi:10.1016/j.automatica.2017.06.005 · Cited by 56
Combining Generative and Discriminative Models for Hybrid InferencePreprint
Satorras, V. G., Akata, Z., & Welling, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02547 · Cited by 48
State Space LSTM Models with Particle MCMC InferencePreprint
Zheng, X., Zaheer, M., Ahmed, A. A., Wang, Y., Xing, E. P., & Smola, A. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11179 · Cited by 46
Stable Robust Extended Kalman Filter
Mu, H., Kuok, S., & Yuen, K. (2016) · Journal of Aerospace Engineering · doi:10.1061/(asce)as.1943-5525.0000665 · Cited by 45
Fitting a Kalman Smoother to Data
Barratt, S. T., & Boyd, S. (2020) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc45564.2020.9147485 · Cited by 42
Shlezinger, N., & Eldar, Y. C. (2023) · doi:10.1561/9781638282655 · Cited by 41
Self-citationExpectation Maximization as Message Passing - Part I: Principles and Gaussian MessagesPreprint
Dauwels, J., Eckford, A. W., Korl, S., & Loeliger, H. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0910.2832 · Cited by 38
Latent LSTM Allocation: Joint clustering and non-linear dynamic modeling of sequence data
Zaheer, M., Ahmed, A. A., & Smola, A. J. (2017) · International Conference on Machine Learning · Cited by 33
A Hybrid Approach for Speaker Tracking Based on TDOA and Data-Driven Models
Laufer-Goldshtein, B., Talmon, R., & Gannot, S. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2790707 · Cited by 33
EKFNet: Learning System Noise Statistics from Measurement Data
Xu, L., & Niu, R. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9415083 · Cited by 33
Learned Factor Graphs for Inference From Stationary Time Sequences
Shlezinger, N., Farsad, N., Eldar, Y. C., & Goldsmith, A. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3139506 · Cited by 30
Self-citationUncertainty in Data-Driven Kalman Filtering for Partially Known State-Space Models
Klein, I., Revach, G., Shlezinger, N., Mehr, J. E., van Sloun, R. J. G., & Eldar, Y. C. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746732 · Cited by 30
Self-citationRTSNet: Deep Learning Aided Kalman Smoothing
Ni, X., Revach, G., Shlezinger, N., van Sloun, R. J. G., & Eldar, Y. C. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746487 · Cited by 22
Self-citationInference from Stationary Time Sequences via Learned Factor Graphs.Preprint
Shlezinger, N., Farsad, N., Eldar, Y. C., et al. (2020) · arXiv (Cornell University) · Cited by 7
Self-citation
Cited by
Shlezinger, N., Whang, J., Eldar, Y. C., & Dimakis, A. G. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3247480 · Cited by 368
Self-citationCheng, S., Quilodrán-Casas, C., Ouala, S., Farchi, A., Liu, C., Tandeo, P., Fablet, R., Lucor, D., Iooss, B., Brajard, J., et al. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123537 · Cited by 303
A comparative review on multi-modal sensors fusion based on deep learning
Tang, Q., Liang, J., & Zhu, F. (2023) · Signal Processing · doi:10.1016/j.sigpro.2023.109165 · Cited by 280
Enhanced Deep Learning-Aided Kalman Filter Based on KalmanNet for Robust Nonlinear State Estimation
Fu, T., Mao, G., Wang, Z., & Wang, K. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3672319 · Cited by 6
Focus Your Attention (with Adaptive IIR Filters)
Lutati, S., Zimerman, I., & Wolf, L. (2023) · arXiv · doi:10.48550/arxiv.2305.14952
Metadata
- Authors
- Revach, G., Shlezinger, N., Ni, X., Escoriza, A. L., van Sloun, R. J. G., & Eldar, Y. C.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2022
- Volume
- 70
- Pages
- 1532-1547
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W3183282730
- Cited by
- 599
- References
- 76
- FWCI
- 34.25
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.