The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Log clustering based problem identification for online service systems
Abstract
Logs play an important role in the maintenance of large-scale online service systems. When an online service fails, engineers need to examine recorded logs to gain insights into the failure and identify the potential problems. Traditionally, engineers perform simple keyword search (such as "error" and "exception") of logs that may be associated with the failures. Such an approach is often time consuming and error prone. Through our collaboration with Microsoft service product teams, we propose LogCluster, an approach that clusters the logs to ease log-based problem identification. LogCluster also utilizes a knowledge base to check if the log sequences occurred before. Engineers only need to examine a small number of previously unseen, representative log sequences extracted from the clusters to identify a problem, thus significantly reducing the number of logs that should be examined, meanwhile improving the identification accuracy. Through experiments on two Hadoop-based applications and two large-scale Microsoft online service systems, we show that our approach is effective and outperforms the state-of-the-art work proposed by Shang et al. in ICSE 2013. We have successfully applied LogCluster to the maintenance of many actual Microsoft online service systems. In this paper, we also share our success stories and lessons learned.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Dryad: distributed data-parallel programs from sequential building blocks
Isard, M., Budiu, M., Yu, Y., Birrell, A., & Fetterly, D. (2007) · Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007 · doi:10.1145/1272996.1273005 · Cited by 2,432
Distributed Systems: Principles and Paradigms
Tanenbaum, A. S., & van Steen, M. R. (2001) · Cited by 2,189
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332 · cited 3×
“To facilitate analysis, a common practice is to parse the log messages into constant strings and parameters [6, 11, 12, 24] and form abstract log messages.”
BackgroundMethodMinimum Spanning Trees and Single Linkage Cluster Analysis
Gower, J. C., & Ross, G. J. S. (1969) · Applied Statistics · doi:10.2307/2346439 · Cited by 1,223
Proceedings of the 2017 USENIX Annual Technical Conference (USENIX ATC ’17)
Quoc, D. L., Beck, M. S., Bhatotia, P., Chen, R., Fetzer, C. W., & Strufe, T. (2017) · Cited by 611
Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis
Fu, Q., Lou, J.-G., Wang, Y., & Li, J. (2009) · 2009 Ninth IEEE International Conference on Data Mining · doi:10.1109/icdm.2009.60 · Cited by 542
Self-citationMining invariants from console logs for system problem detection
Lou, J., Fu, Q., Yang, S., Xu, Y., & Li, J. (2010) · Cited by 302
Self-citationFinding failures by cluster analysis of execution profiles
Dickinson, W. T., De, L., & Fodgurski, A. (2001) · doi:10.5555/381473.381509 · Cited by 252
Where do developers log? an empirical study on logging practices in industry
Fu, Q., Zhu, J., Hu, W., Lou, J.-G., Ding, R., Lin, Q., Zhang, D., & Xie, T. (2014) · Companion Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2591062.2591175 · Cited by 230
Self-citationLearning to Log: Helping Developers Make Informed Logging Decisions
Zhu, J., He, P., Fu, Q., Zhang, H., Lyu, M. R., & Zhang, D. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.60 · Cited by 212
Self-citationClassification of software behaviors for failure detection: a discriminative pattern mining approach
Lo, D., Cheng, H., Han, J., Khoo, S.-C., & Sun, C. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557083 · Cited by 180
Automated known problem diagnosis with event traces
Yuan, C., Lao, N., Wen, J.-R., Li, J., Zhang, Z., Wang, Y.-M., & Ma, W. (2006) · European Conference on Computer Systems · doi:10.1145/1217935.1217972 · Cited by 158
Characterizing Logging Practices in Open-Source Software
Yuan, D., Park, S., & Zhou, Y. (2012) · Cited by 148
Abstracting Execution Logs to Execution Events for Enterprise Applications (Short Paper)
Jiang, Z. M., Hassan, A. E., Flora, P. K., & Hamann, G. (2008) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2008.50 · Cited by 146
CrashLocator: locating crashing faults based on crash stacks
Wu, R., Zhang, H., Cheung, S.-C., & Kim, S. (2014) · International Symposium on Software Testing and Analysis · doi:10.1145/2610384.2610386 · Cited by 143
Self-citation2013 35th International Conference on Software Engineering (ICSE)
(2013) · doi:10.1109/icse16749.2013 · Cited by 135
Improving Software Diagnosability via Log Enhancement
Yuan, D., Zheng, J., Park, S., Zhou, Y., & Savage, S. (2012) · ACM Transactions on Computer Systems · doi:10.1145/2110356.2110360 · Cited by 124
Log 2 : a cost-aware logging mechanism for performance diagnosis
Ding, R. F., Zhou, H., Lou, J., Zhang, H., Lin, Q., Fu, Q., Zhang, D., & Xie, T. (2015) · Figshare · Cited by 117
Self-citationStudying the relationship between logging characteristics and the code quality of platform software
Shang, W., Nagappan, M., & Hassan, A. E. (2013) · Empirical Software Engineering · doi:10.1007/s10664-013-9274-8 · Cited by 86
Understanding Log Lines Using Development Knowledge
Shang, W., Nagappan, M., Hassan, A. E., & Jiang, Z. M. (2014) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2014.24 · Cited by 58
Mining unstructured log files for recurrent fault diagnosis
Reidemeister, T., Jiang, M., & Ward, P. A. S. (2011) · IFIP/IEEE International Symposium on Integrated Network Management (IM) · doi:10.1109/inm.2011.5990536 · Cited by 42
Experience mining Google’s production console logs
Xu, W., & Huang, L. (n.d.) · Cited by 40
Mining Historical Issue Repositories to Heal Large-Scale Online Service Systems
Ding, R. F., Fu, Q., Lou, J., Lin, Q., Zhang, D., & Xie, T. (2014) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2014.39 · Cited by 31
Self-citationAbstracting Execution Logs to Execution Events for Enterprise Applications
Jiang, Z. M., Hassan, A. E., Flora, P. K., & Hamann, G. (2008) · Cited by 18
Cited by
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835
Robust log-based anomaly detection on unstable log data
Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338931 · Cited by 761
Self-citationLogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs
Meng, W., Liu, Y., Zhu, Y., Zhang, S., Pei, D., Liu, Y., Chen, Y., Zhang, R., Tao, S., Sun, P., et al. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/658 · Cited by 708
Experience Report: System Log Analysis for Anomaly Detection
He, S., Zhu, J., He, P., & Lyu, M. R. (2016) · 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2016.21 · Cited by 593
Tools and benchmarks for automated log parsing
Zhu, J., He, S., Liu, J., He, P., Xie, Q., Zheng, Z., & Lyu, M. R. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00021 · Cited by 574
Metadata
- Authors
- Lin, Q., Zhang, H., Lou, J.-G., Zhang, Y., & Chen, X.
- Venue
- Proceedings of the 38th International Conference on Software Engineering Companion
- Publisher
- ACM
- Published
- 2016-05-14
- Pages
- 102-111
- OpenAlex
- W2401686019
- Cited by
- 427
- References
- 25
- FWCI
- 16.90
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.