CoChat

From Correlation to Intervention: A Survey on Log-Based Causal Analysis for Security and AIOps

Zhu, Yichen, Li, Xiaojiao, Suo, Jiabao, Yin, Yu, Huang, Chengling · 2026 · 2026 International Conference on AI in Education Technology and Applications (AIETA)

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index; 19 of the 28 sources its claims cite were checked for support.

Abstract

In modern infrastructure dominated by cloudnative architectures and microservices, massive heterogeneous logs have become core assets for Artificial Intelligence for IT Operations (AIOps) and security analysis. However, traditional data mining methods are limited by their “correlation, not causation” nature. When dealing with Advanced Persistent Threats (APTs) and non-linear cascading failures, these methods face challenges such as high false alarm rates, lack of interpretability, and difficulty in supporting automated intervention. This paper systematically reconstructs the technical framework of log-based causal analysis for security and operations, advocating for a paradigm shift from passive “correlation discovery” to active “causal intervention”. We analyze four cutting-edge technical routes: explicit dependency mining based on provenance graphs, implicit structure discovery based on statistics, causal representation based on deep learning, and Large Language Model (LLM)-driven semantic fusion and agent architectures. This paper reveals the cognitive disputes, theoretical challenges, and technical difficulties existing models face when moving toward rigorous causal inference. Finally, we propose the future visions of “Causal-Native Logging” and “Neuro-symbolic Agents”.

Overview

CoChat Summary

TL;DR

This survey reconstructs the technical framework of log-based causal analysis for security and AIOps, arguing for a paradigm shift from passive "correlation discovery" to active "causal intervention." It reviews four technical routes—provenance-graph dependency mining, statistical causal discovery, deep representation learning, and LLM-driven semantic fusion—and proposes "Causal-Native Logging" and "Neuro-symbolic Agents" as future directions.

Key findings

  • The paper organizes the field into four routes: (1) explicit dependency mining via provenance graphs (BackTracker, SLEUTH, CAPTAIN, Kairos, NODLINK, HOLMES, OmegaLog, SPARSE); (2) statistical causal discovery (PC, FCI, RFCI, PC-Stable, PCMCI, GES/XGES, MMHC, H2PC, LiNGAM/DirectLiNGAM/LvLiNGAM/PNL, NOTEARS, SDCD); (3) deep representation learning (DeepLog, LogBERT, ATLAS, AIRTAG, TRACE, Log2Graph, Madeline, SHIL, MAGIC, Trace2vec, GRAIN); and (4) LLM semantic fusion (LogPPT, LogLLM, OMNISEC, LLM-LADE, TAMO, PROVSEEK, LogReasoner).
  • Each route carries a characteristic failure mode: provenance graphs suffer "dependency explosion" and a semantic gap; statistical methods face an "identifiability chasm" and sensitivity to distributional assumptions; deep learning struggles to move from correlation induction to counterfactual reasoning; LLM agents are vulnerable to "causal hallucinations" and lack auditable reasoning chains (Table I).
  • The paper identifies three shared problem classes: cognitive disputes (conflating correlation proxies with counterfactual causation; the assumption-strength vs. conclusion-certainty trade-off; misaligning task performance with intrinsic causal capability), theoretical challenges (identifiability from purely observational data, lack of auditability in black-box reasoning, absence of evaluation benchmarks for causal understanding), and technical difficulties (completeness vs. interpretability, an "efficiency-scale-quality" impossible triangle, and robustness degradation under concept drift).
  • Proposed future directions: "Causal-Native Logging" (injecting logical clocks such as Lamport timestamps, global tracking IDs, and causal parent pointers at event generation), a unified entity-event causal graph with multi-view mining across security and AIOps, and trustworthy neuro-symbolic agents combining neural perception with symbolic constraint engines.

Methods

  • Design: a narrative survey/review paper, not an empirical study. It synthesizes prior literature across four technical routes and organizes challenges into a taxonomy (Fig. 2).
  • Data or sample: no dataset or experimental sample; the "data" are cited works (43 references) spanning USENIX Security, IEEE S&P, NDSS, ACSAC, and journal venues.
  • Main analysis: qualitative comparison of the four routes along dimensions of core mechanism, primary input, main advantages, core challenges, and representative methods (Table I), followed by a structured discussion of open problems and future architecture proposals (Figs. 1 and 3).

Limitations

  • The paper states no explicit limitations section; it is a survey and does not report its own empirical constraints.
  • Evident from the text: the comparison in Table I is qualitative and no quantitative benchmark or evaluation is performed, so the relative performance of the surveyed methods is not assessed.
  • Evident from the text: the proposed future directions (Causal-Native Logging, unified causal graphs, neuro-symbolic agents) are visions without implementation or validation, and the paper itself notes that evaluation benchmarks for causal understanding capabilities are absent.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/aieta69357.2026.11508946

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

14 Valid · 10 Not valid · 7 Not checked · 26 Own results and interpretations

8 more claims

Create a free account to see all 57 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 28
  • Probably not a substantial claim. 32

Create a free account to see these claims.

Citations

Cites

Show all 42 references

Research works printed but not linked: 7

  1. 2025, M-trends 2025[R/OL]
  2. Gunawat, 2025, Applying Causal Inference AI Models to Root Cause Analysis (RCA) in DevOps[J], International Journal for Research Trends and Innovation, 10, 2456
  3. Alsaheel, 2021, {ATLAS}: A sequence-based learning approach for attack investigation[C], 3005
  4. Colombo, 2014, Order-independent constraint-based causal structure learning[J], J. Mach. Learn. Res., 15, 3741
  5. Chickering, 2002, Optimal structure identification with greedy search[J], Journal of machine learning research, 3, 507
  6. Shimizu, 2006, A linear non-Gaussian acyclic model for causal discovery[J], Journal of Machine Learning Research, 7
  7. Ding, 2023, {AIRTAG}: Towards automated attack investigation by unsupervised learning with log texts[C], 373

Metadata

Authors
Zhu, Y., Li, X., Suo, J., Yin, Y., & Huang, C.
Affiliations
Guangxi Normal University (CN)
Venue
2026 International Conference on AI in Education Technology and Applications (AIETA)
Publisher
IEEE
Published
2026-03-27
Pages
9-16
OpenAlex
W7160636270
Cited by
0
References
23
FWCI
0.00
Type
conference paper
Language
en
Open access
closed
Locations
International Conference on AI in Education Technology and Applications (AIETA) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
  • Physical Sciences › Computer Science › Information Systems › Digital and Cyber Forensics
Keywords
AIOps, cybersecurity, advanced persistent threats, causal inference, correlation versus causation, provenance graphs, cascading failures, large language models, semantic fusion, automated intervention, cloud-native infrastructure, microservices, false alarm reduction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: From Correlation to Intervention: A Survey on Log-Based Causal Analysis for Security and AIOps. https://app.cochat.ai/papers/10.1109/aieta69357.2026.11508946
The paper
Zhu, Y., Li, X., Suo, J., Yin, Y., & Huang, C. (2026). From Correlation to Intervention: A Survey on Log-Based Causal Analysis for Security and AIOps. 2026 International Conference on AI in Education Technology and Applications (AIETA). https://doi.org/10.1109/aieta69357.2026.11508946

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.