CoChat

AIOpsLab in Action: An Open Platform for AIOps Research

Open access
Ma, Minghua, Clark, Jackson, Zhang, Shenglin · 2025 · Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering

The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.

Abstract

The significant advances in AI have been driving a blooming landscape of research on developing AI agents for various kinds of cloud system operations, which is often referred to as AIOps. For example, AI-based fault detection, root cause analysis, and failure mitigation have been a hot topic in recent years with many research papers published at Software Engineering conferences like FSE, ICSE, ASE, and ISSTA. However, AIOps research today faces major practical challenges such as benchmarking, workload simulation, and reproducibility.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3696630.3728619

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 62 references

Research works printed but not linked: 7

  1. Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, and Saravan Rajmohan. 2025. AIOpsLab: A Holistic Framework to Evaluate AI Agents for Enabling Autonomous Clouds. MLSys (2025).
  2. Naman Jain, Manish Shetty, Tianjun Zhang, King Han, Koushik Sen, and Ion Stoica. 2024. R2E: Turning any Github Repository into a Programming Agent Environment. In Forty-first International Conference on Machine Learning (ICML'24).
  3. Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R Narasimhan. 2024. SWE-bench: Can Language Models Resolve Real-world Github Issues?. In The Twelfth International Conference on Learning Representations (ICLR'24).
  4. Haozhe Li, Minghua Ma, Yudong Liu, Pu Zhao, Shuo Li, Ze Li, Murali Chintalapati, Yingnong Dang, Chetan Bansal, Saravan Rajmohan, et al. 2024. Can We Trust Auto-Mitigation? Improving Cloud Failure Prediction with Uncertain Positive Learning. In 2024 IEEE 35th International Symposium on Software Reliability Engineering (ISSRE). IEEE, 499–510.
  5. Vikramank Y. Singh, Kapil Vaidya, Vinayshekhar Bannihatti Kumar, Sopan Khosla, Balakrishnan Narayanaswamy, Rashmi Gangadharaiah, and Tim Kraska. 2024. Panda: Performance Debugging for Databases using LLM Agents. In 14th Conference on Innovative Data Systems Research, CIDR 2024, Chaminade, HI, USA, January 14–17, 2024.
  6. Amith Singhee and Praveen Jayachandran. 2023. From Clouds to Hybrid Clouds. ACM India Minigraphs (2023).
  7. Qiao Zhang, Guo Yu, Chuanxiong Guo, Yingnong Dang, Nick Swanson, Xinsheng Yang, Randolph Yao,, Murali Chintalapati, Arvind Krishnamurthy, and Thomas Anderson. 2018. Deepview: Virtual Disk Failure Diagnosis and Pattern Detection for Azure. In Proceedings of the 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI'18).

Cited by

Still being checked.

Metadata

Authors
Ma, M., Clark, J., & Zhang, S.
Affiliations
  • Microsoft (United States) (US)
  • University of Illinois Urbana-Champaign (US)
  • Nankai University (CN)
Venue
Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering
Publisher
ACM
Published
2025-06-23
Pages
1223-1227
OpenAlex
W4412704103
Cited by
0
References
41
FWCI
0.00
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
  • Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
Keywords
AIOps, AI agents, fault detection, root cause analysis, failure mitigation, benchmarking, workload simulation, reproducibility, open platform, research infrastructure

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AIOpsLab in Action: An Open Platform for AIOps Research. https://app.cochat.ai/papers/10.1145/3696630.3728619
The paper
Ma, M., Clark, J., & Zhang, S. (2025). AIOpsLab in Action: An Open Platform for AIOps Research. Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering. https://doi.org/10.1145/3696630.3728619

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.