Systems Approaches to Tackling Configuration Errors: A Survey
The DOI matches its Crossref record; 115 of the 116 references it cites were found in a registry or an index.
Abstract
In recent years, configuration errors (i.e., misconfigurations) have become one of the dominant causes of system failures, resulting in many severe service outages and downtime. Unfortunately, it is notoriously difficult for system users (e.g., administrators and operators) to prevent, detect, and troubleshoot configuration errors due to the complexity of the configurations as well as the systems under configuration. As a result, the cost of resolving configuration errors is often tremendous from the aspects of both compensating the service disruptions and diagnosing, recovering from the failures. The prevalence, severity, and cost have made configuration errors one of the most thorny system problems that desire to be addressed. This survey article provides a holistic and structured overview of the systems approaches that tackle configuration errors. To understand the problem fundamentally, we first discuss the characteristics of configuration errors and the challenges of tackling such errors. Then, we discuss the state-of-the-art systems approaches that address different types of configuration errors in different scenarios. Our primary goal is to equip the stakeholder with a better understanding of configuration errors and the potential solutions for resolving configuration errors in the spectrum of system development and management. To inspire follow-up research, we further discuss the open problems with regard to system configuration. To the best of our knowledge, this is the first survey on the topic of tackling configuration errors.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is attractive in network operations because faults propagate along known relationships: topology, protocol dependencies, control plane interactions, service dependencies, and time event sequences [48], [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
In the citing paper
“This assumption about structured reasoning is crucial for improving practical efficiency [48], [49], [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
In the citing paper
“A complementary research approach employs causal inference, dependency models, and event-related structures to explain the causes of observed symptoms [48], [49], [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
In the citing paper
“Many network failures are not isolated events; they propagate through topology, protocol state, control-plane dependencies, service dependencies, and time-ordered event streams [48], [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
In the citing paper
“Later work further combines causal inference with protocol-layer and topology knowledge, reducing spurious causal edges and producing information that is more useful for troubleshooting [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The vision of autonomic computing
Kephart, J. O., & Chess, D. M. (2003) · Computer · doi:10.1109/mc.2003.1160055 · Cited by 6,572
Above the Clouds: A Berkeley View of Cloud Computing
Armbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R. H., Konwinski, A., Lee, G., Patterson, D. A., Rabkin, A., Stoica, I. G., et al. (2009) · UC Berkeley · Cited by 6,274
Reason, J. (1990) · doi:10.1017/cbo9781139062367 · Cited by 5,108
Normal Accidents: Living with High Risk Technologies
Grimes, A. J., & Perrow, C. (1985) · Academy of Management Review · doi:10.5465/amr.1985.4278477 · Cited by 4,963
Normal Accidents: Living with High Risk Technologies
Grimes, A. J., & Perrow, C. (1985) · The Academy of Management Review · doi:10.2307/257982 · Cited by 4,960
Heuristic evaluation of user interfaces
Nielsen, J., & Molich, R. (1990) · Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people - CHI '90 · doi:10.1145/97243.97281 · Cited by 3,533
Normal Accidents: Living with High-Risk Technologies
Cummings, L. L., & Perrow, C. (1984) · Administrative Science Quarterly · doi:10.2307/2392945 · Cited by 2,861
KLEE: unassisted and automatic generation of high-coverage tests for complex systems programs
Cadar, C., Dunbar, D., & Engler, D. (2008) · doi:10.5555/1855741.1855756 · Cited by 2,620
The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
Barroso, L. A., & Hölzle, U. (2009) · Synthesis lectures on computer architecture · doi:10.2200/s00193ed1v01y200905cac006 · Cited by 1,714
Brown, A. B., & Patterson, D. A. (2001) · Cited by 1,390
Research works printed but not linked: 45
- Aggarwal Bhavish, Proceedings of the 6th USENIX Symposium on Networked System Design and Implementation (NSDI’09)
- 10.5555/645371.651326 · doi:10.5555/645371.651326
- 10.5555/1026675.1026681 · doi:10.5555/1026675.1026681
- Anderson Paul, 2012, Proceedings of the 4th USENIX Workshop on the Theory and Practice of Provenance (TaPP’12)
- Anderson Paul, 2005, Proceedings of the 19th Large Installation System Administration Conference (LISA’05)
- Marc Andreessen. 2011. Why software is eating the world. The Wall Street Journal (August 2011). Marc Andreessen. 2011. Why software is eating the world. The Wall Street Journal (August 2011).
- Attariyan Mona, 2012, Proceedings of the 10th USENIX Conference on Operating Systems Design and Implementation (OSDI’12)
- 10.5555/1404014.1404037 · doi:10.5555/1404014.1404037
- 10.5555/1558977.1559000 · doi:10.5555/1558977.1559000
- Bianchini Ricardo, 2005, Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS X).
- Aaron, Proceedings of the 1st Workshop on Evaluating and Architecting System Dependability (EASY’01)
- Cadar Cristian, 2008, Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (OSDI’08)
- Chaudhuri Surajit, 2000, Proceedings of the 26th International Conference on Very Large Data Bases (VLDB’00)
- Delaet Thomas, 2010, Proceedings of the 24th Large Installation System Administration Conference (LISA’10)
- Desai Narayan, 2005, Proceedings of the 19th Large Installation System Administration Conference (LISA’05)
- DeTreville John, 2005, Proceedings of the USENIX 10th Workshop on Hot Topics in Operating Systems (HotOS-X).
- 10.5555/1361397.1361410 · doi:10.5555/1361397.1361410
- Enck William, 2007, Proceedings of 2007 USENIX Annual Technical Conference (USENIX ATC’07)
- Feamster Nick, 2005, Proceedings of the 2nd USENIX Symposium on Networked Systems Design and Implementation (NSDI’05)
- Hewson John A., Proceedings of the 26th Large Installation System Administration Conference (LISA’12)
- Jiang Weihang, 2009, Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST’09)
- Kiciman Emre, 2004, Proceedings of the 1st International Conference on Autonomic Computing (ICAC’04)
- 10.5555/795672.796947 · doi:10.5555/795672.796947
- Laprie Jean-Claude, 1995, Proceedings of the 25th IEEE International Symposium on Fault-Tolerant Computing (FTCS’95)
- LeFebvre William, 2004, Proceedings of the 18th USENIX Large Installation System Administration Conference (LISA’04)
- Mickens James, 2007, Proceedings of the 2nd USENIX Workshop on Tackling Computer Systems Problems with Machine Learning Techniques (SYSML’07)
- Miller Rich, 2012, Microsoft: Misconfigured Network Device Caused Azure Outage.
- Nagaraja Kiran, Proceedings of the 6th USENIX Conference on Operating Systems Design and Implementation (OSDI’04)
- Narain Sanjai, 2005, Proceedings of the 19th Large Installation System Administration Conference (LISA’05)
- Oliveira Fábio, Proceedings of 2006 USENIX Annual Technical Conference (USENIX ATC’06)
- LDAP, 2004, Re: BINDDN in ldap.conf.
- Oppenheimer David, Proceedings of the 4th USENIX Symposium on Internet Technologies and Systems (USITS’03)
- Song Yee Jiun, 2009, Proceedings of the Workshop on Theory and Practice of Byzantine Fault Tolerance (BFTW3).
- 10.5555/1855807.1855824 · doi:10.5555/1855807.1855824
- Thomas Keir, 2011, Thanks, Amazon: The Cloud Crash Reveals Your Importance.
- 10.5555/2208488.2208494 · doi:10.5555/2208488.2208494
- Velasquez Nicole F., 2008, Proceedings of the 22nd Large Installation System Administration Conference (LISA’08)
- Verbowski Chad, 2006, Proceedings of the 7th USENIX Conference on Operating Systems Design and Implementation (OSDI’06)
- Verbowski Chad, 2006, Proceedings of the 20th Large Installation System Administration Conference (LISA’06)
- Wang Helen J., 2004, Proceedings of the 6th USENIX Conference on Operating Systems Design and Implementation (OSDI’04)
- Wang Yi-Min, 2003, Proceedings of the 17th Large Installation Systems Administration Conference (LISA’03)
- Whitaker Andrew, Proceedings of the 6th USENIX Conference on Operating Systems Design and Implementation (OSDI’04)
- Yuan Ding, 2014, Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation (OSDI’14)
- 10.5555/2002181.2002209 · doi:10.5555/2002181.2002209
- Zhang Gong, 2011, Proceedings of the 25th USENIX Large Installation System Administration Conference (LISA’11)
Cited by
Xu, T., Jin, L., Fan, X., Zhou, Y., Pasupathy, S., & Talwadker, R. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786852 · Cited by 168
Self-citationHolistic configuration management at Facebook
Tang, C., Kooburat, T., Venkatachalam, P., Chander, A., Wen, Z., Narayanan, A., Dowell, P., & Karl, R. (2015) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/2815400.2815401 · Cited by 148
Investigating System Operators' Perspective on Security Misconfigurations
Dietrich, C., Krombholz, K., Borgolte, K., & Fiebig, T. (2018) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3243734.3243794 · Cited by 144
AI for DevSecOps: A Landscape and Future Opportunities
Fu, M. C., Pasuksmit, J., & Tantithamthavorn, C. K. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3712190 · Cited by 110
Datasize-Aware High Dimensional Configurations Auto-Tuning of In-Memory Cluster Computing
Yu, Z., Bei, Z., & Qian, X. (2018) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3173162.3173187 · Cited by 88
Detecting anomalies in microservices with execution trace comparison
Meng, L., Ji, F., Sun, Y., & Wang, T. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.040 · Cited by 70
Software Configuration Engineering in Practice Interviews, Survey, and Systematic Literature Review
Sayagh, M., Kerzazi, N., Adams, B., & Petrillo, F. D. S. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2867847 · Cited by 65
Towards Continuous Access Control Validation and Forensics
Xiang, C., Wu, Y., Shen, B., Shen, M., Huang, H., Xu, T., Zhou, Y., Moore, C., Jin, X., & Sheng, T. (2019) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3319535.3363191 · Cited by 61
Self-citationUnderstanding and discovering software configuration dependencies in cloud and datacenter systems
Chen, Q., Wang, T., Legunsen, O., Li, S., & Xu, T. (2020) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3368089.3409727 · Cited by 61
Self-citationHow good is your puppet? An empirically defined and validated quality model for puppet
van der Bent, E. C. H., Hage, J., Visser, J., & Gousios, G. (2018) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2018.8330206 · Cited by 57
Kuo, H.-C., Chen, J., Mohan, S., & Xu, T. (2020) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3379469 · Cited by 53
Self-citationVisualizing Distributed System Executions
Beschastnikh, I., Liu, P., Xing, A., Wang, P., Brun, Y., & Ernst, M. D. (2020) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3375633 · Cited by 51
Face It Yourselves: An LLM-Based Two-Stage Strategy to Localize Configuration Errors via Logs
Shan, S., Huo, Y., Su, Y., Li, Y., Li, D., & Zheng, Z. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3652106 · Cited by 59
Synthesizing configuration file specifications with association rule learning
Santolucito, M., Zhai, E., Dhodapkar, R. M., Shim, A., & Piskač, R. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3133888 · Cited by 50
Large Language Models as Configuration Validators
Lian, X., Chen, Y.-F., Cheng, R., Huang, J., Thakkar, P., Zhang, M.-J., & Xu, T.-Y. (2025) · International Conference on Software Engineering · doi:10.1109/icse55347.2025.00017 · Cited by 18
Self-citationDeveloper Mistakes in Writing Android Manifests: An Empirical Study of Configuration Errors
Jha, A. K., Lee, S.-H., & Lee, W. J. (2017) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2017.41 · Cited by 41
Static detection of silent misconfigurations with deep interaction analysis
Zhang, J., Piskač, R., Zhai, E., & Xu, T. (2021) · Proceedings of the ACM on Programming Languages · doi:10.1145/3485517 · Cited by 39
Self-citationTest-case prioritization for configuration testing
Cheng, R., Zhang, L., Marinov, D., & Xu, T. (2021) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3460319.3464810 · Cited by 38
Self-citationTool Choice Matters: JavaScript Quality Assurance Tools and Usage Outcomes in GitHub Projects
Kavaler, D., Trockman, A., Vasilescu, B., & Filkov, V. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00060 · Cited by 50
Exploring differences and commonalities between feature flags and configuration options
Meinicke, J., Wong, C.-P., Vasilescu, B., & Kästner, C. (2020) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3377813.3381366 · Cited by 36
Large Language Models Based Automatic Synthesis of Software SpecificationsPreprint
Mandal, S., Chethan, A., Janfaza, V., Mahmud, S., Anderson, T. A., Turek, J., Tithi, J. J., & Muzahid, A. (2023) · arXiv.org · doi:10.48550/arxiv.2304.09181 · Cited by 31
How Do System Administrators Resolve Access-Denied Issues in the Real World?
Xu, T., Naing, H. M., Le, L., & Zhou, Y. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025999 · Cited by 48
Self-citationUsable declarative configuration specification and validation for applications, systems, and cloud
Baset, S., Suneja, S., Bila, N., Tuncer, O., & Isci, C. (2017) · doi:10.1145/3154448.3154453 · Cited by 34
On Cross-Stack Configuration Errors
Sayagh, M., Kerzazi, N., & Adams, B. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2017.31 · Cited by 33
Exploring Hyperparameter Usage and Tuning in Machine Learning Research
Simon, S., Kolyada, N., Akiki, C., Potthast, M., Stein, B., & Siegmund, N. (2023) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain58948.2023.00016 · Cited by 44
An Evolutionary Study of Configuration Design and Implementation in Cloud Systems
Zhang, Y., He, H., Legunsen, O., Li, S., Dong, W., & Xu, T. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00029 · Cited by 43
Self-citationMining container image repositories for software configuration and beyond
Xu, T., & Marinov, D. (2018) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1145/3183399.3183403 · Cited by 46
Self-citationJabin, M. S. R., Wepa, D., & Hassoun, A. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1371761 · Cited by 31
Probabilistic Automated Language Learning for Configuration Files
Santolucito, M., Zhai, E., & Piskač, R. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-41540-6_5 · Cited by 29
Going through the Life Cycle of Faults in Clouds: Guidelines on Fault Handling
Li, X., Yu, G., Chen, P., Chen, H., & Chen, Z. (2022) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre55969.2022.00022 · Cited by 26
ConfVD: System Reactions Analysis and Evaluation Through Misconfiguration Injection
Li, S., Li, W., Liao, X., Peng, S., Zhou, S., Jia, Z., & Wang, T. (2018) · IEEE Transactions on Reliability · doi:10.1109/tr.2018.2865962 · Cited by 24
Automatically detecting risky scripts in infrastructure code
Dai, T., Karve, A. A., Koper, G., & Zeng, S. (2020) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3419111.3421303 · Cited by 24
Learning CI Configuration Correctness for Early Build Feedback
Santolucito, M., Zhang, J., Zhai, E., Cito, J., & Piskač, R. (2022) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner53432.2022.00118 · Cited by 31
Acto: automatic end-to-end testing for operation correctness of cloud system management
Gu, J. T., Sun, X., Zhang, W., Jiang, Y., Wang, C., Vaziri, M., Legunsen, O., & Xu, T. (2023) · Proceedings of the 29th Symposium on Operating Systems Principles · doi:10.1145/3600006.3613161 · Cited by 22
Self-citationDatasize-Aware High Dimensional Configurations Auto-Tuning of In-Memory Cluster Computing
Yu, Z., Bei, Z., & Qian, X. (2018) · ACM SIGPLAN Notices · doi:10.1145/3296957.3173187 · Cited by 21
Towards semantic versioning of open pre-trained language model releases on hugging face
Ajibode, A., Bangash, A. A., Cogo, F. R., Adams, B., & Hassan, A. E. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10631-3 · Cited by 24
ConfTest: Generating Comprehensive Misconfiguration for System Reaction Ability Evaluation
Li, W., Li, S., Liao, X., Xu, X., Zhou, S., & Jia, Z. (2017) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3084226.3084244 · Cited by 20
Fail through the Cracks: Cross-System Interaction Failures in Modern Cloud Systems
Tang, L., Bhandari, C., Zhang, Y., Karanika, A., Ji, S., Gupta, I., & Xu, T. (2023) · European Conference on Computer Systems · doi:10.1145/3552326.3587448 · Cited by 19
Self-citationECFuzz: Effective Configuration Fuzzing for Large-Scale Systems
Li, J., Li, S., Li, K., Luo, F., Yu, H., Li, S., & Li, X. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623315 · Cited by 19
A Survey of Cross-Layer Security for Resource-Constrained IoT Devices
Altaibek, M., Issainova, A., Aidynov, T., Kuttymbek, D., Abisheva, G., & Nurusheva, A. (2025) · Applied Sciences · doi:10.3390/app15179691 · Cited by 23
Configuration Testing: Testing Configuration Values as Code and with CodePreprint
Xu, T., & Legunsen, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12195 · Cited by 18
Self-citationLLM-Based Misconfiguration Detection for AWS Serverless Computing
Wen, J., Chen, Z., Zhu, Z., Sarro, F., Liu, Y., Ping, H., & Wang, S. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3745766 · Cited by 23
Not as easy as just update: Survey of System Administrators and Patching Behaviours
Jenkins, A. D. G., Liu, L., Wolters, M. K., & Vaniea, K. E. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642456 · Cited by 22
Kuo, H.-C., Chen, J., Mohan, S., & Xu, T. (2020) · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · doi:10.1145/3393691.3394215 · Cited by 16
Self-citationDo You Really Know How to Configure Your Software? Configuration Constraints in Source Code May Help
Liao, X., Zhou, S., Li, S., Jia, Z., Liu, X., & He, H. (2018) · IEEE Transactions on Reliability · doi:10.1109/tr.2018.2834419 · Cited by 16
Self-Adaptive Mechanisms for Misconfigurations in Small Uncrewed Aerial Systems
Purandare, S., Sinha, U., Islam, M. N. A., Cleland‐Huang, J., & Cohen, M. B. (2023) · International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS) · doi:10.1109/seams59076.2023.00030 · Cited by 22
Test Selection for Unified Regression Testing
Wang, S., Lian, X., Marinov, D., & Xu, T. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00145 · Cited by 19
Self-citationBessghaier, N., Ouni, A., Sayagh, M., Chouchen, M., & Mkaouer, M. W. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10654-w · Cited by 15
Haus, M., Ding, A. Y., & Ott, J. (2017) · doi:10.1145/3127502.3127510 · Cited by 14
Efficient Big-Data Access: Taxonomy and a Comprehensive Survey
Alazzawe, A., Pal, A., & Kant, K. (2020) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2020.3036813 · Cited by 16
“Anyone Else Seeing this Error?”: Community, System Administrators, and Patch Information
Jenkins, A. D. G., Kalligeros, P., Vaniea, K. E., & Wolters, M. K. (2020) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp48549.2020.00015 · Cited by 21
Automated implementation of windows-related security-configuration guides
Stöckle, P., Grobauer, B., & Pretschner, A. (2020) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3324884.3416540 · Cited by 13
The Impact of AI on Cybersecurity Defense Mechanisms: Future Trends and ChallengesPreprint
Gilbert, C., & Gilbert, M. A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5258783 · Cited by 17
Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety
Bilal, M., Crowcroft, J., Wang, R., Xu, X., & Dustdar, S. (2027) · Computer Science Review · doi:10.1016/j.cosrev.2026.101075 · Cited by 10
“Although these causes may appear simple, they are difficult to predict without systematic testing [108], [109], [34], [45], [65].”
The Same Only Different: On Information Modality for Configuration Performance Analysis
Liang, H., Huang, Y., & Chen, T. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00212 · Cited by 10
Integrated Model-Checking for the Design of Safe and Efficient Distributed Software Commissioning
Coullon, H., Jard, C., & Lime, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-34968-4_7 · Cited by 10
A Comprehensive Study of Bugs in Software Defined Networks
Bhardwaj, A., Zhou, Z., & Benson, T. (2021) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn48987.2021.00026 · Cited by 10
Rethinking software misconfigurations in the real world: an empirical study and literature analysis
Liu, Y., Zhou, Y., Zhang, H., Chang, Z., Xu, S., Jia, Y., Wang, W., Hu, J., & Liu, Z. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10892-6 · Cited by 9
Self-citation$μ$Puppet: A Declarative Subset of the Puppet Configuration Language
Fu, W., Perera, R., Anderson, P., & Cheney, J. (2016) · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · doi:10.4230/lipics.ecoop.2017.12 · Cited by 9
Challenges in Validating FLOSS Configuration
Raab, M., & Barany, G. (2017) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-57735-7_11 · Cited by 11
Ajdani, M. (2025) · International Journal of Information Security and Privacy · doi:10.4018/ijisp.383299 · Cited by 8
Towards GPU Memory Efficiency for Distributed Training at Scale
Cheng, R., Cai, C. X., Yilmaz, S., Mitra, R., Bag, M., Ghosh, M., & Xu, T. (2023) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3620678.3624661 · Cited by 12
Self-citationRethinking DNS Configuration Verification with a Distributed Architecture
Wang, Y., Yu, K., Wang, Z., Hu, K., Du, H., Xiang, Q., Fang, X., Li, G., Zhou, R., Kong, L., et al. (2024) · Asia-Pacific Workshop on Networking (APNet) · doi:10.1145/3663408.3663412 · Cited by 8
Somers, R. J., Walkinshaw, N., Hierons, R. M., Elliott, D., Iqbal, A., & Walkinshaw, E. (2025) · Software Testing Verification and Reliability · doi:10.1002/stvr.70000 · Cited by 8
Stöckle, P., Pruteanu, I., Grobauer, B., & Pretschner, A. (2022) · ACM Conference on Data and Application Security and Privacy (CODASPY) · doi:10.1145/3508398.3511525 · Cited by 8
SCIBORG: Secure Configurations for the IoT Based on optimization and Reasoning on Graphs
Soroush, H., Albanese, M., Mehrabadi, M. A., Iganibo, I., Mosko, M., Gao, J. H., Fritz, D. J., Rane, S. D., & Bier, E. A. (2020) · IEEE Conference on Communications and Network Security · doi:10.1109/cns48642.2020.9162256 · Cited by 8
What should your run-time configuration framework do to help developers?
Sayagh, M., Kerzazi, N., Petrillo, F. D. S., Bennani, K., & Adams, B. (2020) · Empirical Software Engineering · doi:10.1007/s10664-019-09790-x · Cited by 8
Towards Automated Configuration of Cloud Storage Gateways: A Data Driven Approach
Sondur, S., & Kant, K. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23502-4_14 · Cited by 7
Asking Security Practitioners: Did You Find the Vulnerable (Mis)Configuration?
May, R., Biermann, C., Krüger, J., & Leich, T. (2025) · International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS) · doi:10.1145/3715340.3715439 · Cited by 6
In-Depth Analysis of Kubernetes Manifest Verification Tools for Robust CNF Deployment
Diarra, B., Guillouard, K., Ouzzif, M., Merle, P., & Stefani, J. (2024) · Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN) · doi:10.1109/icin60470.2024.10494445 · Cited by 6
Dexter: faster troubleshooting of misconfiguration cases using system logs
Talwadker, R. (2017) · ACM International Systems and Storage Conference (SYSTOR) · doi:10.1145/3078468.3078484 · Cited by 6
Detecting Operator Errors in Cloud Maintenance Operations
Vetter, A. (2016) · IEEE International Conference on Cloud Computing Technology and Science · doi:10.1109/cloudcom.2016.0110 · Cited by 6
An Evolutionary Study of Configuration Design and Implementation in Cloud Systems
Zhang, Y., He, H., Legunsen, O., Li, S., Dong, W., & Xu, T. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion52605.2021.00075 · Cited by 11
Self-citationConfEx: A Framework for Automating Text-based Software Configuration Analysis in the CloudPreprint
Tuncer, O., Byrne, A., Bila, N., Duri, S. S., Isci, C., & Coskun, A. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.08656 · Cited by 6
Graf, B. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108736 · Cited by 6
CoMSA: A Modeling-Driven Sampling Approach for Configuration Performance Testing
Xia, Y., Ding, Z., & Shang, W. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00091 · Cited by 5
CfgNet: A Framework for Tracking Equality-Based Configuration Dependencies Across a Software Project
Simon, S., Ruckel, N., & Siegmund, N. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3274349 · Cited by 5
Usable Security Model for Industrial Control Systems - Authentication and Authorisation Workflow
Li, K., Rashid, A., & Roudaut, A. (2023) · European Symposium on Usable Security (EuroUSEC) · doi:10.1145/3617072.3617114 · Cited by 5
Determine Configuration Entry Correlations for Web Application Systems
Chen, W., Wu, H., Wei, J., Zhong, H., & Huang, T. (2016) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2016.95 · Cited by 5
Predicting Hadoop misconfigurations using machine learning
Robert, A., Gupta, A., Shenoy, V. S., Sitaram, D., & Kalambur, S. (2020) · Software Practice and Experience · doi:10.1002/spe.2790 · Cited by 5
Niehues, N., Hahner, S., & Heinrich, R. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112761 · Cited by 4
Research on Application Configuration Management Technology for Cloud Platform
Wan, R., Liang, Y., Wen, Z., & Zhao, L. (2022) · IEEE Joint International Information Technology and Artificial Intelligence Conference (ITAIC) · doi:10.1109/itaic54216.2022.9836624 · Cited by 4
Ctest4J: A Practical Configuration Testing Framework for Java
Wang, S., Lian, X., Li, Q., Marinov, D., & Xu, T. (2024) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3663529.3663799 · Cited by 4
Self-citationMay, R., & Adler, S. (2025) · International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS) · doi:10.1145/3715340.3715434 · Cited by 4
Co-diagnosing configuration failures in co-robotic systems
Taylor, A., Elbaum, S. G., & Detweiler, C. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759454 · Cited by 4
Haus, M., Ding, A. Y., Hui, P., & Ott, J. (2017) · ACM Workshop on Challenged Networks (CHANTS) · doi:10.1145/3124087.3124103 · Cited by 4
Unified Configuration Setting Access in Configuration Management Systems
Raab, M., Denner, B., Hahnenberg, S., & Cito, J. (2020) · International Conference on Program Comprehension · doi:10.1145/3387904.3389257 · Cited by 4
Performance Health Index for Complex Cyber Infrastructures
Sondur, S., & Kant, K. (2022) · ACM Transactions on Modeling and Performance Evaluation of Computing Systems · doi:10.1145/3538646 · Cited by 4
Ma, P., Ji, Z., Yao, P., Wang, S., & Ren, K. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623348 · Cited by 4
Tong, J., Li, Y., Hongyan, T., & Wu, Z. (2016) · IEEE International Congress on Big Data (BigData Congress) · doi:10.1109/bigdatacongress.2016.73 · Cited by 4
An Evaluation of Self-Adaptive Mechanisms for Misconfigurations in Small Uncrewed Aerial Systems
Purandare, S., Islam, M. N. A., Sinha, U., Cleland‐Huang, J., & Cohen, M. B. (2024) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3707643 · Cited by 3
An Architecture-Based Approach to Mitigate Confidentiality Violations Using Machine Learning
Niehues, N., Hahner, S., & Heinrich, R. (2025) · IEEE International Conference on Software Architecture (ICSA) · doi:10.1109/icsa65012.2025.00020 · Cited by 3
CL-MMAD: A Contrastive Learning Based Multimodal Software Runtime Anomaly Detection Method
Kong, S., Ai, J., & Lu, M. (2023) · Applied Sciences · doi:10.3390/app13063596 · Cited by 3
How Is Server Software Configured? Examining the Structure of Configuration Files
Święcicki, B., & Borzemski, L. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-67220-5_20 · Cited by 3
TFix: Automatic Timeout Bug Fixing in Production Server Systems
He, J., Dai, T., & Gu, X. (2019) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00067 · Cited by 3
Towards Automated Configuration Documentation
Ahmmed, J., Cohen, M. B., & Gazzillo, P. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695311 · Cited by 2
Blockchain-Powered Airlines: Enhancing Security, Transparency, and Efficiency in Aviation
Bonkra, A., Dhiman, P., Kaur, A., Kaur, G., & Sharma, S. (2025) · Information systems engineering and management · doi:10.1007/978-3-031-95341-5_6 · Cited by 2
Efficient Repair of Confidentiality Violations in Software Architectures
Niehues, N., Arp, B., & Heinrich, R. (2026) · IEEE International Conference on Software Architecture (ICSA) · doi:10.1109/icsa66085.2026.00013 · Cited by 2
A Survey on Tackling Software Configuration Faults
Le, W., Wang, Y., Yang, F., Wang, X., & Wang, S. (2021) · International Symposium on System and Software Reliability (ISSSR) · doi:10.1109/isssr53171.2021.00036 · Cited by 2
The Looming Labyrinth: Risks of Artificial Intelligence in Financial Sector
Singh, S., Rahman, A., & Johl, S. K. (2025) · Springer eBooks · doi:10.1007/978-981-96-6495-5_12 · Cited by 2
Metadata
- Authors
- Xu, T., & Zhou, Y.
- Affiliations
- University of California San Diego (US)
- Venue
- ACM Computing Surveys
- Published
- 2015-07-21
- Volume
- 47
- Issue
- 4
- Pages
- 1-41
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2261611353
- Cited by
- 139
- References
- 116
- Citations by year
- 2026: 13 · 2025: 29 · 2024: 14 · 2023: 12 · 2022: 6 · 2021: 12 · 2020: 17 · 2019: 8 · 2018: 8 · 2017: 12 · 2016: 6 · 2015: 2
- FWCI
- 10.70
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- configuration errors, misconfiguration, system failure, service outages, configuration management, fault detection, troubleshooting, system administration, system complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.