CoChat

Abstracting log lines to log event types for mining software system logs

Nagappan, Meiyappan, Vouk, Mladen A. · 2010 · 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010)

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Abstract

Log files contain valuable information about the execution of a system. This information is often used for debugging, operational profiling, finding anomalies, detecting security threats, measuring performance etc. The log files are usually too big for extracting this valuable information manually, even though manual perusal is still one of the more widely used techniques. Recently a variety of data mining and machine learning algorithms are being used to analyze the information in the log files. A major road block for the efficient use of these algorithms is the inherent variability present in every log line of a log file. Each log line is a combination of a static message type field and a variable parameter field. Even though both these fields are required, the analyses algorithm often requires that these be separated out, in order to find correlations in the repeating log event types. This disentangling of the message and parameter fields to find the event types is called abstraction of log lines. Each log line is abstracted to a unique ID or event type and the dynamic parameter value is extracted to give an insight on the current state of the system. In this paper we present a technique based on a clustering technique used in the Simple Log file Clustering Tool for log file abstraction. This solution is especially useful when we don't have access to the source code of the application or when the lines in the log file do not conform to a rigid structure. We evaluated our implementation on log files from the Virtual Computing Lab, a cloud computer management system at North Carolina State University, and abstracted it to 727 unique event types.

Overview

Integrity signals

Registry

Crossref · 10.1109/msr.2010.5463281

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 8 references

Research works printed but not linked: 2

  1. 0, Virtual Computing Lab
  2. 0, Splunk

Cited by

See all 171

Metadata

Authors
Nagappan, M., & Vouk, M. A.
Affiliations
North Carolina State University (US)
Venue
2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010)
Publisher
IEEE
Published
2010-05
Pages
114-117
OpenAlex
W1994625872
Cited by
171
References
8
Citations by year
2026: 12 · 2025: 20 · 2024: 27 · 2023: 29 · 2022: 14 · 2021: 19 · 2020: 17 · 2019: 9 · 2018: 2 · 2016: 2 · 2015: 2 · 2014: 4 · 2013: 6 · 2012: 4
Type
conference abstract
Language
en
Open access
closed
Locations
International Conference on Mining Software Repositories (MSR) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
Keywords
log mining

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Abstracting log lines to log event types for mining software system logs. https://app.cochat.ai/papers/10.1109/msr.2010.5463281
The paper
Nagappan, M., & Vouk, M. A. (2010). Abstracting log lines to log event types for mining software system logs. 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010). https://doi.org/10.1109/msr.2010.5463281

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.