The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Acto: Automatic End-to-End Testing for Operation Correctness of Cloud System Management
Open accessAbstract
Cloud systems are increasingly being managed by operation programs termed operators, which automate tedious, human-based operations. Operators of modern management platforms like Kubernetes, Twine, and ECS implement declarative interfaces based on the state-reconciliation principle. An operation declares a desired system state and the operator automatically reconciles the system to that declared state.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“trusted systems leave traces that can be reviewed, act with care during uncertainty, and recover when things go off plan [72], [11], [105], [4].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [105]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Online evaluation becomes necessary once an agent proposes actions, because action quality depends on the behaviour of the system being changed [105], [41], [146].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [105]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Captures real-world dynamics and recovery readiness [11], [105]”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [105]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Once an agent proposes mitigations (restart, failover, throttling, config toggle), the system becomes a socio-technical control loop.The failure mode is no longer wrong answer but wrong change at the wrong time [4], [72], [105], [85].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [105]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Large-scale cluster management at Google with Borg
Verma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E., & Wilkes, J. (2015) · Proceedings of the Tenth European Conference on Computer Systems · doi:10.1145/2741948.2741964 · Cited by 1,468
Research works printed but not linked: 55
- cmd/cgo : allow cgo to pass strings or []bytes bigger than 1«30. https://go-review.googlesource.com/c/go/+/418557 , 2022 . cmd/cgo: allow cgo to pass strings or []bytes bigger than 1«30. https://go-review.googlesource.com/c/go/+/418557, 2022.
- 10.1109/HOTOS.2001.990058 · DOI
- Barroso , L. A. , Hölzle , U. , and Ranganathan , P . The Datacenter as a Computer: Designing Warehouse-Scale Machines, 3 ed . Morgan and Claypool Publishers , 2018 . Barroso, L. A., Hölzle, U., and Ranganathan, P. The Datacenter as a Computer: Designing Warehouse-Scale Machines, 3 ed. Morgan and Claypool Publishers, 2018.
- 10.1145/2786805.2786869 · DOI
- Bianchini , R. , Martin , R. P. , Nagaraja , K. , Nguyen , T. D. , and Oliveira , F . Human-Aware Computer System Design . In Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS-X) (June 2005 ). Bianchini, R., Martin, R. P., Nagaraja, K., Nguyen, T. D., and Oliveira, F. Human-Aware Computer System Design. In Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS-X) (June 2005).
- Brown , A. B. , and Patterson , D. A . Undo for Operators: Building an Undoable E-mail Store . In Proceedings of the 2003 USENIX Annual Technical Conference (ATC'03) ( June 2003 ). Brown, A. B., and Patterson, D. A. Undo for Operators: Building an Undoable E-mail Store. In Proceedings of the 2003 USENIX Annual Technical Conference (ATC'03) (June 2003).
- Burns , B. , Grant , B. , Oppenheimer , D. , Brewer , E. , and Wilkes , J. Borg , Omega, and Kubernetes. Communications of the ACM 59 , 5 ( May 2016 ), 50--57. Burns, B., Grant, B., Oppenheimer, D., Brewer, E., and Wilkes, J. Borg, Omega, and Kubernetes. Communications of the ACM 59, 5 (May 2016), 50--57.
- 10.1145/2408776.2408795 · DOI
- Cebula , M. , and Sherrod , B . 10 Weird Ways to Blow Up Your Kubernetes . In KubeCon North America (Nov. 2019 ). Cebula, M., and Sherrod, B. 10 Weird Ways to Blow Up Your Kubernetes. In KubeCon North America (Nov. 2019).
- Chekrygin , I. Keep the Space Shuttle Flying: Writing Robust Operators . In KubeCon Europe (May 2019 ). Chekrygin, I. Keep the Space Shuttle Flying: Writing Robust Operators. In KubeCon Europe (May 2019).
- 10.1145/3368089.3409727 · DOI
- Chen , Y. , Sun , X. , Nath , S. , Yang , Z. , and Xu , T . Push-Button Reliability Testing for Cloud-Backed Applications with Rainmaker . In Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI'23) ( Apr. 2023 ). Chen, Y., Sun, X., Nath, S., Yang, Z., and Xu, T. Push-Button Reliability Testing for Cloud-Backed Applications with Rainmaker. In Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI'23) (Apr. 2023).
- 10.1145/1294261.1294283 · DOI
- DeTreville , J. Making System Configuration More Declarative. In Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS-X) (June 2005 ). DeTreville, J. Making System Configuration More Declarative. In Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS-X) (June 2005).
- Dobies , J. , and Wood , J . Kubernetes Operators: Automating the Container Orchestration Platform . O'Reilly Media, Inc. , 2020 . Dobies, J., and Wood, J. Kubernetes Operators: Automating the Container Orchestration Platform. O'Reilly Media, Inc., 2020.
- 10.5555/3358807.3358809 · DOI
- Guilloux , S. Writing a Kubernetes Operator: the Hard Parts . In KubeCon North America (Nov. 2019 ). Guilloux, S. Writing a Kubernetes Operator: the Hard Parts. In KubeCon North America (Nov. 2019).
- 10.1145/2987550.2987583 · DOI
- 10.5555/3189759.3189761 · DOI
- Haase , S. How an Operator Becomes the Hero of the Edge . In OperatorCon (May 2019 ). Haase, S. How an Operator Becomes the Hero of the Edge. In OperatorCon (May 2019).
- Hall , C. AWS , Google , Microsoft , Red Hat's New Registry to Act as Clearing House for Kubernetes Operators. https://www.datacenterknowledge.com/open-source/aws-google-microsoft-red-hats-new-registry-act-clearing-house-kubernetes-operators , Mar. 2019 . Hall, C. AWS, Google, Microsoft, Red Hat's New Registry to Act as Clearing House for Kubernetes Operators. https://www.datacenterknowledge.com/open-source/aws-google-microsoft-red-hats-new-registry-act-clearing-house-kubernetes-operators, Mar. 2019.
- Hockin , T. Kubernetes: Edge vs. Level Triggered Logic. https://speakerdeck.com/thockin/edge-vs-level-triggered-logic , June 2017 . Hockin, T. Kubernetes: Edge vs. Level Triggered Logic. https://speakerdeck.com/thockin/edge-vs-level-triggered-logic, June 2017.
- 10.1145/3102980.3103005 · DOI
- Kumar , H. , and Šafránek , J. Storage on Kubernetes - Learning From Failures . In KubeCon North America (Nov. 2019 ). Kumar, H., and Šafránek, J. Storage on Kubernetes - Learning From Failures. In KubeCon North America (Nov. 2019).
- Lagresle , M. Moving to Kubernetes: the Bad and the Ugly . In ContainerDays (June 2019 ). Lagresle, M. Moving to Kubernetes: the Bad and the Ugly. In ContainerDays (June 2019).
- Li , Z. , Cheng , Q. , Hsieh , K. , Dang , Y. , Huang , P. , Singh , P. , Yang , X. , Lin , Q. , Wu , Y. , Levy , S. , and Chintalapati , M . Gandalf: An Intelligent, End-To-End Analytics Service for Safe Deployment in Large-Scale Cloud Infrastructure . In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI'20) ( Feb. 2020 ). Li, Z., Cheng, Q., Hsieh, K., Dang, Y., Huang, P., Singh, P., Yang, X., Lin, Q., Wu, Y., Levy, S., and Chintalapati, M. Gandalf: An Intelligent, End-To-End Analytics Service for Safe Deployment in Large-Scale Cloud Infrastructure. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI'20) (Feb. 2020).
- Lou , C. , Huang , P. , and Smith , S . Understanding, Detecting and Localizing Partial Failures in Large System Software . In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI'20) ( Feb. 2020 ). Lou, C., Huang, P., and Smith, S. Understanding, Detecting and Localizing Partial Failures in Large System Software. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI'20) (Feb. 2020).
- 10.1145/3447786.3456250 · DOI
- Madhu , C. Preventing Controller Sprawl From Taking Down Your Cluster . In KubeCon North America (Oct. 2022 ). Madhu, C. Preventing Controller Sprawl From Taking Down Your Cluster. In KubeCon North America (Oct. 2022).
- 10.1109/TSE.2019.2946563 · DOI
- 10.1145/3542929.3563483 · DOI
- Nagaraja , K. , Oliveira , F. , Bianchini , R. , Martin , R. P. , and Nguyen , T. D . Understanding and Dealing with Operator Mistakes in Internet Services . In Proceedings of the 6th USENIX Conference on Operating Systems Design and Implementation (OSDI'04) ( Dec. 2004 ). Nagaraja, K., Oliveira, F., Bianchini, R., Martin, R. P., and Nguyen, T. D. Understanding and Dealing with Operator Mistakes in Internet Services. In Proceedings of the 6th USENIX Conference on Operating Systems Design and Implementation (OSDI'04) (Dec. 2004).
- 10.1145/1755913.1755924 · DOI
- 10.5555/1251460.1251461 · DOI
- 10.1007/978-3-662-54494-5_3 · DOI
- 10.1145/3297858.3304063 · DOI
- Rajagopalan , S. , Williams , D. , Jamjoom , H. , and Warfield , A . Escape Capsule: Explicit State is Robust and Scalable . In Proceedings of the 16th Workshop on Hot Topics in Operating Systems (HotOS-XIV) (May 2013 ). Rajagopalan, S., Williams, D., Jamjoom, H., and Warfield, A. Escape Capsule: Explicit State is Robust and Scalable. In Proceedings of the 16th Workshop on Hot Topics in Operating Systems (HotOS-XIV) (May 2013).
- Ratis , P. Lessons Learned using the Operator Pattern to build a Kubernetes Platform . In USENIX SREcon (Oct. 2021 ). Ratis, P. Lessons Learned using the Operator Pattern to build a Kubernetes Platform. In USENIX SREcon (Oct. 2021).
- 10.1145/2465351.2465386 · DOI
- Sun , X. , Cheng , R. , Chen , J. , Ang , E. , Legunsen , O. , and Xu , T . Testing Configuration Changes in Context to Prevent Production Failures . In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) ( Nov. 2020 ). Sun, X., Cheng, R., Chen, J., Ang, E., Legunsen, O., and Xu, T. Testing Configuration Changes in Context to Prevent Production Failures. In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) (Nov. 2020).
- Sun , X. , Luo , W. , Gu , J. T. , Ganesan , A. , Alagappan , R. , Gasch , M. , Suresh , L. , and Xu , T . Automatic Reliability Testing for Cluster Management Controllers . In Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) ( July 2022 ). Sun, X., Luo, W., Gu, J. T., Ganesan, A., Alagappan, R., Gasch, M., Suresh, L., and Xu, T. Automatic Reliability Testing for Cluster Management Controllers. In Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) (July 2022).
- 10.1145/3458336.3465276 · DOI
- Suresh , L. , ao Loff , J. , Kalim , F. , Jyothi , S. A. , Narodytska , N. , Ryzhyk , L. , Gamage , S. , Oki , B. , Jain , P. , and Gasch , M . Building Scalable and Flexible Cluster Managers Using Declarative Programming . In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) ( Nov. 2020 ). Suresh, L., ao Loff, J., Kalim, F., Jyothi, S. A., Narodytska, N., Ryzhyk, L., Gamage, S., Oki, B., Jain, P., and Gasch, M. Building Scalable and Flexible Cluster Managers Using Declarative Programming. In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) (Nov. 2020).
- Tang , C. , Yu , K. , Veeraraghavan , K. , Kaldor , J. , Michelson , S. , Kooburat , T. , Anbudurai , A. , Clark , M. , Gogia , K. , Cheng , L. , Christensen , B. , Gartrell , A. , Khutornenko , M. , Kulkarni , S. , Pawlowski , M. , Pelkonen , T. , Rodrigues , A. , Tibrewal , R. , Venkatesan , V. , and Zhang , P . Twine: A Unified Cluster Management System for Shared Infrastructure . In Proceedings of the 14th USENIX Conference on Operating Systems Design and Implementation (OSDI'20) ( Nov. 2020 ). Tang, C., Yu, K., Veeraraghavan, K., Kaldor, J., Michelson, S., Kooburat, T., Anbudurai, A., Clark, M., Gogia, K., Cheng, L., Christensen, B., Gartrell, A., Khutornenko, M., Kulkarni, S., Pawlowski, M., Pelkonen, T., Rodrigues, A., Tibrewal, R., Venkatesan, V., and Zhang, P. Twine: A Unified Cluster Management System for Shared Infrastructure. In Proceedings of the 14th USENIX Conference on Operating Systems Design and Implementation (OSDI'20) (Nov. 2020).
- 10.1145/3552326.3587448 · DOI
- Templeton , G. , and Davidson , S . How a Couple of Characters (and GitOps) Brought Down Our Site . In KubeCon Europe (May 2022 ). Templeton, G., and Davidson, S. How a Couple of Characters (and GitOps) Brought Down Our Site. In KubeCon Europe (May 2022).
- 10.1145/3342195.3387517 · DOI
- 10.1145/3238147.3238200 · DOI
- Vasudevan , J. Azure Service Operators - A Kubernetes native way of Deploying Azure Resources. https://devblogs.microsoft.com/cse/2021/11/11/azure-service-operators-a-kubernetes-native-way-of-deploying-azure-resources/ , Nov. 2021 . Microsoft Developer Blogs . Vasudevan, J. Azure Service Operators - A Kubernetes native way of Deploying Azure Resources. https://devblogs.microsoft.com/cse/2021/11/11/azure-service-operators-a-kubernetes-native-way-of-deploying-azure-resources/, Nov. 2021. Microsoft Developer Blogs.
- 10.1109/ICSE48619.2023.00145 · DOI
- 10.5555/3026877.3026925 · DOI
- 10.1145/2517349.2522727 · DOI
- 10.1145/2791577 · DOI · Paper page
- 10.1145/2541940.2541983 · DOI
- 10.1145/3477132.3483577 · DOI
Cited by
Sorted by citations
Automatic Root Cause Analysis via Large Language Models for Cloud Incidents
Chen, Y., Xie, H., Ma, M., Kang, Y., Gao, X., Shi, L., Cao, Y., Gao, X., Fan, H., Wen, M., et al. (2024) · Proceedings of the Nineteenth European Conference on Computer Systems · doi:10.1145/3627703.3629553 · Cited by 190
Self-citationLarge language models for agentic NetOps and AIOps: Architectures, evaluation, and safety
Bilal, M., Crowcroft, J., Wang, R., Xu, X., & Dustdar, S. (2027) · Computer Science Review · doi:10.1016/j.cosrev.2026.101075 · Cited by 10
Metadata
- Authors
- Gu, J. T., Sun, X., Zhang, W., Jiang, Y., Wang, C., Vaziri, M., Legunsen, O., & Xu, T.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- IBM (United States) (US)
- Cornell University (US)
- ORCID
- Venue
- Proceedings of the 29th Symposium on Operating Systems Principles
- Publisher
- ACM
- Published
- 2023-10-23
- Pages
- 96-112
- OpenAlex
- W4387321514
- Cited by
- 22
- References
- 1
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 7
- FWCI
- 4.26
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM SIGOPS Symposium on Operating Systems Principles (SOSP) (publishedVersion)
- Funders
- National Science Foundation (CNS 2145295)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Keywords
- end-to-end testing, operators, Kubernetes, Twine, automatic operation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
