The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
A survey of online failure prediction methods
Abstract
With the ever-growing complexity and dynamicity of computer systems, proactive fault management is an effective approach to enhancing availability. Online failure prediction is the key to such techniques. In contrast to classical reliability methods, online failure prediction is based on runtime monitoring and a variety of models and methods that use the current state of a system and, frequently, the past experience as well. This survey describes these methods. To capture the wide spectrum of approaches concerning this area, a taxonomy has been developed, whose different approaches are explained and major concepts are described in detail.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Lecture Notes in Computer Science 1205
(1999) · Industrial Robot: An International Journal · doi:10.1108/ir.1999.04926fae.001 · Cited by 38,662
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
(1992) · Cited by 23,431
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Estimates of the Regression Coefficient Based on Kendall's Tau
Sen, P. K. (1968) · Journal of the American Statistical Association · doi:10.1080/01621459.1968.10480934 · Cited by 14,517
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Practical Statistics for Medical Research.
Walter, S. D., & Altman, D. G. (1992) · Biometrics · doi:10.2307/2532320 · Cited by 11,668
Robust Locally Weighted Regression and Smoothing Scatterplots
Cleveland, W. S. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10481038 · Cited by 11,594
Needleman, S. B., & Wunsch, C. D. (1970) · Journal of Molecular Biology · doi:10.1016/0022-2836(70)90057-4 · Cited by 11,288
Practical Statistics for Medical Research
Altman, D. G. (1990) · doi:10.1201/9780429258589 · Cited by 10,668
Identification of common molecular subsequences
Smith, T. F., & Waterman, M. S. (1981) · Journal of Molecular Biology · doi:10.1016/0022-2836(81)90087-5 · Cited by 9,940
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Analysis of a complex of statistical variables into principal components.
Hotelling, H. (1933) · Journal of Educational Psychology · doi:10.1037/h0071325 · Cited by 9,633
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
Basic concepts and taxonomy of dependable and secure computing
Avizienis, A., Laprie, J.-C., Randell, B., & Landwehr, C. (2004) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2004.2 · Cited by 5,223
Cohen, W. W. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50023-2 · Cited by 3,787
Proceedings. 1985 IEEE International Conference on Robotics and Automation
(1985) · doi:10.1109/robot.1985 · Cited by 3,673
Biological sequence analysis probabilistic models of proteins and nucleic acids
Durbin, R. M., Eddy, S. R., Krogh, A., & Mitchison, G. (1998) · Cited by 3,565
Detection of Abrupt Changes: Theory and Application
Riedel, K. S. (1994) · Technometrics · doi:10.1080/00401706.1994.10485821 · Cited by 3,518
Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids
Durbin, R., Eddy, S. R., Krogh, A., & Mitchison, G. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511790492 · Cited by 3,246
Mining sequential patterns: Generalizations and performance improvements
Srikant, R., & Agrawal, R. (1996) · Lecture Notes in Computer Science · doi:10.1007/bfb0014140 · Cited by 2,711
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology
Chao, Y. R., & Zipf, G. K. (1950) · Language · doi:10.2307/409735 · Cited by 2,193
Software Reliability: Measurement, Prediction, Application
Musa, D., Iannino, A., & Okumoto, K. (1987) · Cited by 1,675
Learning Logical Definitions from Relations
Quinlan, J. R. (1990) · Machine Learning · doi:10.1023/a:1022699322624 · Cited by 1,644
Handbook of software reliability engineering
Lyu, M. R.-T. (1996) · McGraw-Hill, Inc. eBooks · Cited by 1,592
What's In A Name? Malay Seals As Onomastic Sources
Library, T. B., & Gallop, A. T. (2018) · Malay Literature · doi:10.37052/ml.31(1)no1 · Cited by 1,483
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology.
Hollingshead, A. B., & Zipf, G. K. (1949) · American Sociological Review · doi:10.2307/2086695 · Cited by 1,355
Jelinski, Z., & Moranda, P. B. (1972) · Elsevier eBooks · doi:10.1016/b978-0-12-266950-7.50028-1 · Cited by 1,070
Pinpoint: problem determination in large, dynamic Internet services
Chen, M. Y., Kiciman, E., Fratkin, E., Fox, A., & Brewer, E. (2003) · Proceedings International Conference on Dependable Systems and Networks · doi:10.1109/dsn.2002.1029005 · Cited by 835
Statistical Prediction Analysis
Aitchison, J., & Dunsmore, I. R. (1975) · Cambridge University Press eBooks · doi:10.1017/cbo9780511569647 · Cited by 829
Vesely, W. E., Goldberg, F. F., Roberts, N. H., & Haasl, D. F. (1987) · Defense Technical Information Center (DTIC) · Cited by 775
b'Roberts, N. H. '., b'Vesely, W. E. '., b'Haasl, D. F. '., & b'Goldberg, F. F. '. (1981) · Cited by 674
Parnas, D. L. (1994) · doi:10.5555/257734.257788 · Cited by 655
Software reliability measurement
Musa, J. D. (1979) · Journal of Systems and Software · doi:10.1016/0164-1212(79)90023-2 · Cited by 569
Efficient data mining for path traversal patterns
Chen, M.-S., Park, J. S., & Yu, P. S. (1998) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.683753 · Cited by 540
Rough sets: probabilistic versus deterministic approach
Pawlak, Z., Wong, S. K. M., & Ziarko, W. (1988) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(88)80032-4 · Cited by 469
Microreboot -- A Technique for Cheap Recovery
Candea, G., Kawamoto, S., Fujiki, Y., Friedman, G., & Fox, A. (2004) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0406005 · Cited by 380
Recovery Oriented Computing (ROC): Motivation, Definition, Techniques, and Case Studies
Patterson, D. A., Brown, A. B., Broadwell, P. M., Candea, G., Chen, M. Y., Cutler, J., Enriquez, P., Fox, A., Merzbacher, M., Oppenheimer, D., et al. (2002) · Cited by 367
Reliable Computer Systems: Design and Evaluation, Third Edition
Siewiorek, D. P., & Swarz, R. S. (1998) · A K Peters/CRC Press eBooks · doi:10.1201/9781439863961 · Cited by 307
Proactive management of software aging
Castelli, V., Harper, R. E., Heidelberger, P., Hunter, S. W., Trivedi, K. S., Vaidyanathan, K., & Zeggert, W. P. (2001) · IBM Journal of Research and Development · doi:10.1147/rd.452.0311 · Cited by 303
Path-based faliure and evolution management
Chen, M. Y., Accardi, A., Kıcıman, E., Lloyd, J., Patterson, D., Fox, A., & Brewer, E. (2004) · Networked Systems Design and Implementation · Cited by 302
Detection of abrupt changes. Theory and application
Rudas, I. J. (1994) · Control Engineering Practice · doi:10.1016/0967-0661(94)90196-1 · Cited by 290
Fuzzy wavelet networks for function learning
Ho, D. W. C., Zhang, P.-A., & Xu, J.-H. (2001) · IEEE Transactions on Fuzzy Systems · doi:10.1109/91.917126 · Cited by 274
Critical event prediction for proactive management in large-scale computer clusters
Sahoo, R. K., Oliner, A. J., Rish, I., Gupta, M., Moreira, J. E., Ma, S., Vilalta, R., & Sivasubramaniam, A. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956799 · Cited by 264
BlueGene/L Failure Analysis and Prediction Models
Liang, Y., Zhang, Y., Sivasubramaniam, A., Jette, M., & Sahoo, R. (2006) · International Conference on Dependable Systems and Networks (DSN'06) · doi:10.1109/dsn.2006.18 · Cited by 259
The fundamentals of software aging
Grottke, M., Matias, R., & Trivedi, K. S. (2008) · 2008 IEEE International Conference on Software Reliability Engineering Workshops (ISSRE Wksp) · doi:10.1109/issrew.2008.5355512 · Cited by 242
Decision trees for real-time transient stability prediction
Rovnyak, S., Kretsinger, S., Thorp, J., & Brown, D. (1994) · IEEE Transactions on Power Systems · doi:10.1109/59.336122 · Cited by 232
Dependable computing: From concepts to design diversity
Avižienis, A., & Laprie, J.-C. (1986) · Proceedings of the IEEE · doi:10.1109/proc.1986.13527 · Cited by 227
Improved disk-drive failure warnings
Hughes, G. F., Murray, J. F., Kreutz-Delgado, K., & Elkan, C. (2002) · IEEE Transactions on Reliability · doi:10.1109/tr.2002.802886 · Cited by 216
Proceedings of the 5th symposium on Operating systems design and implementation
Culler, D., & Druschel, P. (2002) · Operating Systems Design and Implementation · Cited by 216
Aluja, T. B. (2006) · RACO (Revistes Catalanes amb Accés Obert) (Consorci de Serveis Universitaris de Catalunya) · Cited by 198
Bayesian Approaches to Failure Prediction for Disk Drives
Hamerly, G., & Elkan, C. (2001) · Cited by 196
Error log analysis: statistical modeling and heuristic trend analysis
Lin, T.-T. Y., & Siewiorek, D. P. (1990) · IEEE Transactions on Reliability · doi:10.1109/24.58720 · Cited by 184
Detecting Application-Level Failures in Component-Based Internet Services
Kiciman, E., & Fox, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2005.853411 · Cited by 181
Predicting rare events in temporal domains
Vilalta, R., & Ma, S. (2003) · Proceedings · doi:10.1109/icdm.2002.1183991 · Cited by 160
The history of reliability prediction
Denson, W. K. (1998) · IEEE Transactions on Reliability · doi:10.1109/24.740547 · Cited by 150
Software reliability modeling survey
Farr, W. H. (1996) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · Cited by 141
Using Hidden Semi-Markov Models for Effective Online Failure Prediction
Salfner, F., & Malek, M. (2007) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds.2007.35 · Cited by 135
Self-citationPredictive application-performance modeling in a computational grid environment
Kapadia, N. H., Fortes, J. A. B., & Brodley, C. E. (2003) · ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) · doi:10.1109/hpdc.1999.805281 · Cited by 128
Self-star Properties in Complex Information Systems
(2005) · Lecture notes in computer science · doi:10.1007/b136551 · Cited by 118
Predictive algorithms in the management of computer systems
Vilalta, R., Apte, C., Hellerstein, J. L., Ma, S., & Weiss, S. M. (2002) · IBM Systems Journal · doi:10.1147/sj.413.0461 · Cited by 110
JAGR: an autonomous self-recovering application server
Candea, G., Kıcıman, E., Zhang, S. Y., Keyani, P., & Fox, A. (2003) · Autonomic Computing Workshop · doi:10.1109/acw.2003.1210217 · Cited by 92
Raghavan, V. V., Grosky, W. I., Wu, Z., & Gudivada, V. N. (2004) · Chapman & Hall/CRC computer and information science series · doi:10.1201/9780203507223.pt2 · Cited by 89
Embracing Failure: A Case for Recovery-Oriented Computing (ROC)
Brown, A. B., & Patterson, D. A. (2001) · Cited by 87
Software failure prediction based on a Markov Bayesian network model
Bai, C., Hu, Q., Xie, M., & Ng, S. H. (2004) · Journal of Systems and Software · doi:10.1016/j.jss.2004.02.028 · Cited by 86
(1977) · doi:10.1145/390019.808315 · Cited by 84
Bodík, P., Jordan, M. I., Patterson, D. A., Friedman, G., Biewald, L., Levine, H., Candea, G., Patel, K., Tolle, G., Hui, J., et al. (2005) · International Conference on Autonomic Computing · doi:10.1109/icac.2005.18 · Cited by 81
A Best Practice Guide to Resource Forecasting for Computing Systems
Hoffmann, G. A., Trivedi, K. S., & Malek, M. (2007) · IEEE Transactions on Reliability · doi:10.1109/tr.2007.909764 · Cited by 79
Self-citationDependability measurement and modeling of a multicomputer system
Tang, D., & Iyer, R. K. (1993) · IEEE Transactions on Computers · doi:10.1109/12.192214 · Cited by 70
An approach to predictive detection for service management
Hellerstein, J. L., Zhang, F., & Shahabuddin, P. (2003) · doi:10.1109/inm.1999.770691 · Cited by 70
Timeweaver: a genetic algorithm for identifying predictive patterns in sequences of events
Weiss, G. M. (1999) · Cited by 63
Testing the Normality of Several Independent Samples Using the Anderson-Darling Statistic
Pettitt, A. N. (1977) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347023 · Cited by 58
Predicting failures of computer systems: a case study for a telecommunication system
Salfner, F., Schieschke, M., & Malek, M. (2006) · doi:10.5555/1898699.1898899 · Cited by 57
Self-citationAutonomous recovery in componentized Internet applications
Candea, G., Kıcıman, E., Kawamoto, S., & Fox, A. (2006) · Cluster Computing · doi:10.1007/s10586-006-7562-4 · Cited by 55
Bayes predictive analysis of a fundamental software reliability model
Csenki, A. (1990) · IEEE Transactions on Reliability · doi:10.1109/24.55879 · Cited by 49
Event-based Failure Prediction: An Extended Hidden Markov Model Approach.
Salfner, F. (2008) · Cited by 48
Self-citationCall Availability Prediction in a Telecommunication System: A Data Driven Empirical Approach
Hoffmann, G. A., & Malek, M. (2006) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds.2006.12 · Cited by 45
Self-citationDaidone, A., Giandomenico, F. D., Bondavalli, A., & Chiaradonna, S. (2006) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds.2006.24 · Cited by 45
Internet service performance failure detection
Ward, A. R., Glynn, P. W., & Richardson, K. J. (1998) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/306225.306237 · Cited by 43
Comprehensive log .les for autonomic systems
Salfne, F., Tschirpke, S., & Malek, M. (2004) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps.2004.1303243 · Cited by 40
Self-citationTechniques for prediction analysis and recalibration
Brocklehurst, S., & Bev Littlewood, A. (1996) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · Cited by 32
A real time neural net estimator of fatigue life
Troudet, T., & Merrill, W. (1990) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1990.137695 · Cited by 32
A Best Practice Guide to Resources Forecasting for the Apache Webserver
Hoffmann, G., Trivedi, K. S., & Malek, M. (2006) · Pacific Rim International Symposium on Dependable Computing · doi:10.1109/prdc.2006.5 · Cited by 29
Self-citation(1977) · doi:10.1145/390017.808315 · Cited by 27
Modeling Event-driven Time Series with Generalized Hidden Semi-Markov ModelsPreprint
Salfner, F. (2006) · doi:10.18452/2470 · Cited by 15
Self-citation
Cited by
Addressing failures in exascale computing
Snir, M., Wisniewski, R. W., Abraham, J. A., Adve, S. V., Bagchi, S., Balaji, P., Belak, J., Bose, P., Cappello, F., Carlson, B., et al. (2014) · The International Journal of High Performance Computing Applications · doi:10.1177/1094342014522573 · Cited by 373
Outcome-Oriented Predictive Process Monitoring: Review and Benchmark
Teinemaa, I., Dumas, M., Rosa, M. L., & Maggi, F. M. (2019) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3301300 · Cited by 351
Predictive Monitoring of Business Processes: A Survey
Marquez-Chamorro, A. E., Resinas, M., & Ruiz-Cortes, A. (2018) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2017.2772256 · Cited by 279
Event Prediction in the Big Data Era: A Systematic Survey
Zhao, L. (2022) · ACM Computing Surveys · doi:10.1145/3450287 · Cited by 135
A survey of AIOps methods for failure management
Notaro, P., Cardoso, J., & Gerndt, M. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3483424 · Cited by 142
Metadata
- Authors
- Salfner, F., Lenk, M., & Malek, M.
- Venue
- ACM Computing Surveys
- Published
- 2010-03
- Volume
- 42
- Issue
- 3
- Pages
- 1-42
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2164463086
- Cited by
- 560
- References
- 88
- FWCI
- 56.94
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.