Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Open accessAbstract
As spacecraft send back increasing amounts of telemetry data, improved anomaly detection systems are needed to lessen the monitoring burden placed on operations engineers and reduce operational risk. Current spacecraft monitoring systems only target a subset of anomaly types and often require costly expert knowledge to develop and maintain due to challenges involving scale and complexity. We demonstrate the effectiveness of Long Short-Term Memory (LSTMs) networks, a type of Recurrent Neural Network (RNN), in overcoming these issues using expert-labeled telemetry anomaly data from the Soil Moisture Active Passive (SMAP) satellite and the Mars Science Laboratory (MSL) rover, Curiosity. We also propose a complementary unsupervised and nonparametric anomaly thresholding approach developed during a pilot implementation of an anomaly detection system for SMAP, and offer false positive mitigation strategies along with other key improvements and lessons learned during development.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
For large data sets, the training kernel matrix of SVM grows quadratically with data set size, making SVM training very slow.
“However, for large data sets the training kernel matrix grows in quadratic form with the size of the data set, thus making the training of SVM on large data sets a very slow process [135].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [135]
For Case 2, SVM performed better than ANN because of SVM's generalization capability, optimal solution and discriminative power, especially when the number of input data is small.
“However, for Case 2 SVM performed better that ANN because of SVM's extraordinary generalization capability, along with its optimal solution and discriminative power; especially when the number of input data is small [135].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [135]
SVM has significant weaknesses including algorithmic complexity affecting training time on large data sets, development of optimal classifiers for multi-class problems, and performance on unbalanced data sets.
“Generally, SVM has some significant weaknesses, among which are: algorithmic complexity that affects the training time of the classifier in large data sets, development of optimal classifiers for multi-class problems and the performance of SVMs in unbalanced data sets [135].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [135]
TVGeAN was evaluated against four widely cited MTS benchmarks: C-MPASS, SMD, MSL, and SMAP for supervised and unsupervised learning tasks.
“Present a comprehensive evaluation of the TVGeAN model using four widely cited MTS benchmarks for supervised and unsupervised learning tasks: C-MPASS [35], SMD [36], MSL, and SMAP [37].”
From TVGeAN: Tensor Visibility Graph-Enhanced Attention Network for Versatile Multivariant Time Series Learning Tasks (2024) · cites this paper as [37]
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804 · see citing works
A Review on Outlier/Anomaly Detection in Time Series Data
Blázquez-García, A., Conde, A., Mori, U., & Lozano, J. A. (2022) · ACM Computing Surveys · doi:10.1145/3444690 · Cited by 1,102 · see citing works
USAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094 · see citing works
Li, Z., Zhao, Y., Han, J., Su, Y., Jiao, R., Wen, X., & Pei, D. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467075 · Cited by 464 · see citing works
DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detection
Yang, Y., Zhang, C., Zhou, T., Wen, Q., & Sun, L. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599295 · Cited by 387 · see citing works
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Zhang, K., Wen, Q., Zhang, C., Cai, R., Jin, M., Liu, Y., Zhang, J. Y., Liang, Y., Pang, G., Song, D., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387317 · Cited by 295 · see citing works
Wang, F., Jiang, Y., Zhang, R., Wei, A., Xie, J., & Pang, X. (2025) · Sensors · doi:10.3390/s25010190 · Cited by 119 · see citing works
Applications and Challenges of Artificial Intelligence in Space Missions
Oche, P. A., Ewa, G. A., & Ibekwe, N. (2024) · IEEE Access · doi:10.1109/access.2021.3132500 · Cited by 68 · see citing works
“This implies that a lack of labeled anomalies necessitates the use of unsupervised or semi-supervised approaches [134].”
BackgroundA Systematic Analysis of Enhancing Cyber Security Using Deep Learning for Cyber Physical Systems
Gaba, S., Budhiraja, I., Kumar, V., Martha, S., Khurmi, J., Singh, A., Singh, K. K., Askar, S. S., & Abouhawwash, M. (2024) · IEEE Access · doi:10.1109/access.2023.3349022 · Cited by 62 · see citing works
Huang, T., Chen, P., & Li, R. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3511984 · Cited by 61 · see citing works
Navigating the metric maze: a taxonomy of evaluation metrics for anomaly detection in time series
Sørbø, S., & Ruocco, M. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00988-8 · Cited by 58 · see citing works
“There are several ways of choosing a threshold, some fully automatic, like the non-parametric dynamic thresholding introduced in the work of [25], others as simple as just choosing”
InfluentialAdaptive performance anomaly detection for online service systems via pattern sketching
Chen, Z., Liu, J., Su, Y., Zhang, H., Ling, X., Yang, Y., & Lyu, M. R. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510085 · Cited by 52 · see citing works
ADT: Time series anomaly detection for cyber-physical systems via deep reinforcement learning
Yang, X., Howley, E., & Schukat, M. (2024) · Computers & Security · doi:10.1016/j.cose.2024.103825 · Cited by 47 · see citing works
Anomaly Detection in a Large-Scale Cloud Platform
Islam, M. S., Pourmajidi, W., Zhang, L., Steinbacher, J., Erwin, T., & Miranskyy, A. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip52600.2021.00024 · Cited by 54 · see citing works
Personalized relapse prediction in patients with major depressive disorder using digital biomarkers
Vairavan, S., Rashidisabet, H., Li, Q. S., Ness, S., Morrison, R. L., Soares, C. N., Uher, R., Frey, B. N., Lam, R. W., Kennedy, S. H., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-44592-8 · Cited by 14 · see citing works
Auto-Validate by-History: Auto-Program Data Quality Constraints to Validate Recurring Data Pipelines
Tu, D., He, Y., Cui, W., Ge, S., Zhang, H., Han, S., Zhang, D., & Chaudhuri, S. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599776 · Cited by 14 · see citing works
Agent based dynamic thresholding for adaptive anomaly detection using reinforcement learning
Yang, X., Howley, E., & Schukat, M. (2025) · Neural Computing and Applications · doi:10.1007/s00521-024-10536-0 · Cited by 11 · see citing works
Anomaly Detection based on Robust Spatial-temporal Modeling for Industrial Control Systems
Li, S., Liu, J., Pan, Z., Lv, S., Si, S., & Sun, L. (2022) · 2022 IEEE 19th International Conference on Mobile Ad Hoc and Smart Systems (MASS) · doi:10.1109/mass56207.2022.00058 · Cited by 6 · see citing works
Baz, M. (2024) · Mathematics · doi:10.3390/math12213320 · Cited by 1 · see citing works
- Authors
- Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T.
- Affiliations
- California Institute of Technology (US)
- Venue
- Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
- Publisher
- ACM
- Published
- 2018-07-19
- Pages
- 387-395
- OpenAlex
- W2786827964
- Cited by
- 1,771
- References
- 2
- Citations by year
- 2026: 315 · 2025: 388 · 2024: 343 · 2023: 297 · 2022: 192 · 2021: 135 · 2020: 63 · 2019: 37 · 2018: 1
- FWCI
- 24.08
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- telemetry data, long short-term memory networks, recurrent neural networks, unsupervised anomaly detection, spacecraft monitoring
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review