CoChat

LINEADAPTER: Parameter-Efficient Fine-Tuning for Log Anomaly Detection and Root Cause Analysis

Liu, Xinyuan, Bao, Wenhao, Zhang, Yumin, Li, Yinhao, Ranjan, Rajiv, Jha, Devki Nandan · 2025 · 2025 IEEE 31th International Conference on Parallel and Distributed Systems (ICPADS)

The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index; 6 of the 15 sources its claims cite were checked for support.

Abstract

The growing scale and complexity of distributed systems such as Hadoop produce massive volumes of complex log data, making automated anomaly detection and root cause analysis both essential and increasingly challenging. Traditional rule-based approaches, relying on static thresholds or manual heuristics, struggle to scale due to limited adaptability and high maintenance costs. Transformer-based language models have emerged as powerful tools for modelling log sequences by capturing contextual patterns. To enable efficient adaptation with fewer parameters, techniques such as In-Context Learning (ICL) and Low-Rank Adaptation (LoRA) have been proposed. However, applying these methods to log analysis with Small Language Models (SLMs) introduces several challenges, including high memory and computational overhead (in the case of ICL), limited fine-tuning capacity (with LoRA on smaller models), and poor generalisation across heterogeneous environments. To address these limitations, we propose Lineadapter, a parameter-efficient fine-tuning framework tailored for SLMs in log anomaly detection and root cause analysis. Lineadapter extends convolutional adapter principles to sequential data by integrating lightweight 1D convolutional layers within transformer blocks. This design enables SLMs to adapt effectively to log-specific patterns with minimal computational cost, while preserving the backbone model's representational power. We evaluate LINEADAPTER on multiple real-world system log datasets, comparing its performance with ICL, LoRA, and rule-based baselines. Results show that Lineadapter achieves higher F1-scores and better precision-recall trade-offs, particularly on medium-scale models, establishing it as a scalable, robust, and practical solution for log-based anomaly detection.

Overview

CoChat Summary

TL;DR

LINEADAPTER is a parameter-efficient fine-tuning framework for small language models that inserts a 1D convolutional bottleneck adapter after transformer feed-forward/MLP layers while keeping the backbone frozen, targeting log anomaly detection and root cause analysis. Across LogHub and Automate datasets, it improves F1 and precision-recall balance over rule-based and ICL baselines, with especially strong RCA semantic similarity for larger SLMs.

Key findings

  • The rule-based baseline achieves high precision above 0.96 across all datasets but low recall of 0.34–0.40, giving F1-scores of 0.51–0.56; neural approaches (ICL, LoRA, LineAdapter) achieve significantly higher F1-scores.
  • LineAdapter on Llama-3.2-1B reaches F1-scores of 0.852 on HDFS and 0.979 on BGL, while LoRA on Llama-3.2-1B shows low HDFS recall of 0.308; Bloom-3B with LoRA and LineAdapter approaches or exceeds F1 0.95.
  • On Automate RCA, a linear regression detector achieves accuracy 0.997, and LineAdapter fine-tuned models reach cosine similarity scores of 0.857 for BERT-base-uncased, 0.959 for LLaMA-3.2-1B, and 0.977 for Bloom-3B.
  • LineAdapter costs O(2dd′ + kd′) versus LoRA’s O(2Mdr), yielding roughly a 4× reduction in FLOPs and parameter count when M ≥ 4 and d′ is comparable to r.

Methods

  • Evaluates BERT-base-uncased, LLaMA 3.2-1B, and Bloom-3B on LogHub datasets HDFS, Hadoop, and BGL, plus the Automate RCA dataset, comparing rule-based detection, ICL, LoRA, and LineAdapter.
  • LogHub data are merged from original train/test partitions, binary-labeled, stratified-shuffled, with BGL and HDFS stratified 10% sampling and the third dataset retained fully; an 8:2 stratified split is used. Preprocessing removes prefixes before the first comma, replaces nonnumeric characters with spaces, collapses whitespace, deduplicates lines, and discards lines shorter than three tokens.
  • LineAdapter projects hidden states to a bottleneck d′ ≪ d, applies ReLU and a depthwise 1D convolution with kernel size k = 3, restores hidden size, and adds a residual update; it is inserted after FFN/MLP layers, with only adapters and task head trained while the backbone stays frozen. RCA is evaluated by cosine similarity between generated explanations and annotated ground-truth causes.

Limitations

  • Stated by the paper: all training and inference were executed on a single compute node, limiting scalability and not exploiting distributed computing environments; future work aims to integrate distributed fine-tuning.
  • Evident from the text: Table II reports ICL results only for Llama-3.2-1B and Bloom-3B, with BERT-base-uncased ICL entries marked “*”; evaluation covers three LogHub datasets plus Automate and three SLMs.
  • Evident from the text: RCA evaluation uses correlation-based cosine similarity because direct comparison of generative root-cause outputs against ground truth is considered unreliable due to stochasticity.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/icpads67057.2025.11322907

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

5 Valid · 2 Not valid · 4 Not checked · 51 Own results and interpretations

17 more claims

Create a free account to see all 62 claims and to verify the 5 references still open.

See all claims — free account
  • It may state two separate claims as one. 33
  • Probably not a substantial claim. 13
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 7 · the rest aren’t loaded

2 more findings

Create a free account to see every finding of this check.

See all findings — free account

Citations

Cites

Show all 34 references

Research works printed but not linked: 1

  1. [27] Meta, 'Meta llama 3.1,' 2024, Meta AI Blog . -

Cited by

See all 1

Metadata

Authors
Liu, X., Bao, W., Zhang, Y., Li, Y., Ranjan, R., & Jha, D. N.
Affiliations
Newcastle University (GB)
Venue
2025 IEEE 31th International Conference on Parallel and Distributed Systems (ICPADS)
Publisher
IEEE
Published
2025-12-14
Pages
1-8
OpenAlex
W7124170655
Cited by
0
References
23
FWCI
0.00
Type
conference paper
Language
en
Open access
closed
Locations
IEEE International Conference on Parallel and Distributed Systems (ICPADS) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
Keywords
log anomaly detection, root cause analysis, parameter-efficient fine-tuning, small language models, transformer language models, in-context learning, low-rank adaptation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: LINEADAPTER: Parameter-Efficient Fine-Tuning for Log Anomaly Detection and Root Cause Analysis. https://app.cochat.ai/papers/10.1109/icpads67057.2025.11322907
The paper
Liu, X., Bao, W., Zhang, Y., Li, Y., Ranjan, R., & Jha, D. N. (2025). LINEADAPTER: Parameter-Efficient Fine-Tuning for Log Anomaly Detection and Root Cause Analysis. 2025 IEEE 31th International Conference on Parallel and Distributed Systems (ICPADS). https://doi.org/10.1109/icpads67057.2025.11322907

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.