Systems Approaches to Tackling Configuration Errors: A Survey
The DOI matches its Crossref record; 115 of the 116 references it cites were found in a registry or an index.
Abstract
In recent years, configuration errors (i.e., misconfigurations) have become one of the dominant causes of system failures, resulting in many severe service outages and downtime. Unfortunately, it is notoriously difficult for system users (e.g., administrators and operators) to prevent, detect, and troubleshoot configuration errors due to the complexity of the configurations as well as the systems under configuration. As a result, the cost of resolving configuration errors is often tremendous from the aspects of both compensating the service disruptions and diagnosing, recovering from the failures. The prevalence, severity, and cost have made configuration errors one of the most thorny system problems that desire to be addressed. This survey article provides a holistic and structured overview of the systems approaches that tackle configuration errors. To understand the problem fundamentally, we first discuss the characteristics of configuration errors and the challenges of tackling such errors. Then, we discuss the state-of-the-art systems approaches that address different types of configuration errors in different scenarios. Our primary goal is to equip the stakeholder with a better understanding of configuration errors and the potential solutions for resolving configuration errors in the spectrum of system development and management. To inspire follow-up research, we further discuss the open problems with regard to system configuration. To the best of our knowledge, this is the first survey on the topic of tackling configuration errors.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is attractive in network operations because faults propagate along known relationships: topology, protocol dependencies, control plane interactions, service dependencies, and time event sequences [48], [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
In the citing paper
“This assumption about structured reasoning is crucial for improving practical efficiency [48], [49], [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
In the citing paper
“A complementary research approach employs causal inference, dependency models, and event-related structures to explain the causes of observed symptoms [48], [49], [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
In the citing paper
“Many network failures are not isolated events; they propagate through topology, protocol state, control-plane dependencies, service dependencies, and time-ordered event streams [48], [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
In the citing paper
“Later work further combines causal inference with protocol-layer and topology knowledge, reducing spurious causal edges and producing information that is more useful for troubleshooting [50].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [50]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The vision of autonomic computing
Kephart, J. O., & Chess, D. M. (2003) · Computer · doi:10.1109/mc.2003.1160055 · Cited by 6,572
Above the Clouds: A Berkeley View of Cloud Computing
Armbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R. H., Konwinski, A., Lee, G., Patterson, D. A., Rabkin, A., Stoica, I. G., et al. (2009) · UC Berkeley · Cited by 6,274
Reason, J. (1990) · doi:10.1017/cbo9781139062367 · Cited by 5,108
Normal Accidents: Living with High Risk Technologies
Grimes, A. J., & Perrow, C. (1985) · Academy of Management Review · doi:10.5465/amr.1985.4278477 · Cited by 4,963
Normal Accidents: Living with High Risk Technologies
Grimes, A. J., & Perrow, C. (1985) · The Academy of Management Review · doi:10.2307/257982 · Cited by 4,960
Heuristic evaluation of user interfaces
Nielsen, J., & Molich, R. (1990) · Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people - CHI '90 · doi:10.1145/97243.97281 · Cited by 3,533
Normal Accidents: Living with High-Risk Technologies
Cummings, L. L., & Perrow, C. (1984) · Administrative Science Quarterly · doi:10.2307/2392945 · Cited by 2,861
KLEE: unassisted and automatic generation of high-coverage tests for complex systems programs
Cadar, C., Dunbar, D., & Engler, D. (2008) · doi:10.5555/1855741.1855756 · Cited by 2,620
The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
Barroso, L. A., & Hölzle, U. (2009) · Synthesis lectures on computer architecture · doi:10.2200/s00193ed1v01y200905cac006 · Cited by 1,714
Brown, A. B., & Patterson, D. A. (2001) · Cited by 1,390
Managing energy and server resources in hosting centers
Chase, J. S., Anderson, D. C., Thakar, P. N., Vahdat, A. M., & Doyle, R. P. (2001) · Proceedings of the eighteenth ACM symposium on Operating systems principles · doi:10.1145/502034.502045 · Cited by 1,284
Heterogeneity and dynamicity of clouds at scale: Google trace analysis
Reiss, C., Tumanov, A., Ganger, G. R., Katz, R. H., & Kozuch, M. A. (2012) · Proceedings of the Third ACM Symposium on Cloud Computing · doi:10.1145/2391229.2391236 · Cited by 1,063
Improving a human-computer dialogue
Molich, R., & Nielsen, J. (1990) · Communications of the ACM · doi:10.1145/77481.77486 · Cited by 815
Why Do Computers Stop and What Can Be Done About It?
Gray, J. (2024) · doi:10.6084/m9.figshare.27043420 · Cited by 663
A few billion lines of code later: using static analysis to find bugs in the real world
Bessey, A., Block, K., Chelf, B., Chou, A., Fulton, B., Hallem, S., Henri-Gros, C., Kamsky, A., McPeak, S., & Engler, D. (2010) · Communications of the ACM · doi:10.1145/1646353.1646374 · Cited by 635
The state of the art in end-user software engineering
Ko, A. J., Abraham, R., Beckwith, L., Blackwell, A., Burnett, M., Erwig, M., Scaffidi, C., Lawrance, J., Lieberman, H., Myers, B., et al. (2011) · ACM Computing Surveys · doi:10.1145/1922649.1922658 · Cited by 633
Proceedings of the 2017 USENIX Annual Technical Conference (USENIX ATC ’17)
Quoc, D. L., Beck, M. S., Bhatotia, P., Chen, R., Fetzer, C. W., & Strufe, T. (2017) · Cited by 611
Why Do Internet Services Fail, and What Can Be Done About It?
Oppenheimer, D., Ganapathi, A., & Patterson, D. A. (2002) · Cited by 607
Understanding BGP misconfiguration
Mahajan, R., Wetherall, D., & Anderson, T. (2002) · Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications · doi:10.1145/633025.633027 · Cited by 533
Barroso, L. A., Clidaras, J., & Hölzle, U. (2013) · Synthesis lectures on computer architecture · doi:10.2200/s00516ed2v01y201306cac024 · Cited by 489
Design rules based on analyses of human error
Norman, D. A. (1983) · Communications of the ACM · doi:10.1145/2163.358092 · Cited by 460
The Stratosphere platform for big data analytics
Alexandrov, A., Bergmann, R., Ewen, S., Freytag, J.-C., Hueske, F., Heise, A., Kao, O., Leich, M., Leser, U., Markl, V., et al. (2014) · The VLDB Journal · doi:10.1007/s00778-014-0357-y · Cited by 432
0897915046/International Conference on Software Engineering
(1992) · doi:10.1145/143062 · Cited by 374
Profiling, what-if analysis, and cost-based optimization of MapReduce programs
Herodotou, H., & Babu, S. (2011) · Proceedings of the VLDB Endowment · doi:10.14778/3402707.3402746 · Cited by 368
Recovery Oriented Computing (ROC): Motivation, Definition, Techniques, and Case Studies
Patterson, D. A., Brown, A. B., Broadwell, P. M., Candea, G., Chen, M. Y., Cutler, J., Enriquez, P., Fox, A., Merzbacher, M., Oppenheimer, D., et al. (2002) · Cited by 367
Detecting BGP configuration faults with static analysis
Feamster, N., & Balakrishnan, H. (2005) · doi:10.5555/1251203.1251207 · Cited by 307
Tuning database configuration parameters with iTuned
Duan, S., Thummala, V., & Babu, S. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687627.1687767 · Cited by 267
An empirical study on configuration errors in commercial and open source systems
Yin, Z., Ma, X., Zheng, J., Zhou, Y., Bairavasundaram, L. N., & Pasupathy, S. (2011) · Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles · doi:10.1145/2043556.2043572 · Cited by 253
Self-citationFuzz Revisited: A Re-examination of the Reliability of UNIX Utilities and Services
Miller, B. P., Koski, D., Lee, C. P., Maganty, V., Murthy, R., Natarajan, A., & Steidl, J. (1995) · Cited by 249
Hippodrome: running circles around storage administration
Anderson, E. J., Hobbs, M., Keeton, K., Spence, S., Uysal, M., & Veitch, A. (2002) · Cited by 235
Field studies of computer system administrators: analysis of system management tools and practices
Barrett, R., Kandogan, E., Maglio, P. P., Haber, E. M., Takayama, L. A., & Prabaker, M. (2004) · Proceedings of the 2004 ACM conference on Computer supported cooperative work · doi:10.1145/1031607.1031672 · Cited by 228
Experimental study of Internet stability and backbone failures
Labovitz, C., Ahuja, A., & Jahanian, F. (2003) · Digest of Papers. Twenty-Ninth Annual International Symposium on Fault-Tolerant Computing (Cat. No.99CB36352) · doi:10.1109/ftcs.1999.781062 · Cited by 218
What Bugs Live in the Cloud? A Study of 3000+ Issues in Cloud Systems
Gunawi, H. S., Hao, M., Leesatapornwongsa, T., Patana-anake, T., Do, T., Adityatama, J., Eliazar, K. J., Laksono, A., Lukman, J. F., Martin, V., et al. (2014) · Proceedings of the ACM Symposium on Cloud Computing · doi:10.1145/2670979.2670986 · Cited by 205
Automatic misconfiguration troubleshooting with peerpressure
Wang, H. J., Platt, J. C., Chen, Y., Zhang, R., & Wang, Y. (2004) · Cited by 201
The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
Barroso, L. A., & Hölzle, U. (2009) · Synthesis Lectures on Computer Architecture · doi:10.1007/978-3-031-01722-3 · Cited by 197
X-ray: automating root-cause diagnosis of performance anomalies in production software
Attariyan, M., Chow, M., & Flinn, J. (2012) · doi:10.5555/2387880.2387910 · Cited by 184
Unraveling the complexity of network management
Benson, T., Akella, A., & Maltz, D. A. (2009) · Cited by 181
Do not blame users for misconfigurations
Xu, T., Zhang, J., Huang, P., Zheng, J., Sheng, T., Yuan, D., Zhou, Y., & Pasupathy, S. (2013) · Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles · doi:10.1145/2517349.2522727 · Cited by 175
Self-citationDesign principles for human-computer interfaces
Norman, D. A. (1983) · Proceedings of the SIGCHI conference on Human Factors in Computing Systems - CHI '83 · doi:10.1145/800045.801571 · Cited by 174
Dependable computing: concepts, limits, challenges
Laprie, J.-C. (1995) · Cited by 169
Xu, T., Jin, L., Fan, X., Zhou, Y., Pasupathy, S., & Talwadker, R. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786852 · Cited by 168
Self-citationA smart hill-climbing algorithm for application server configuration
Xi, B., Liu, Z., Raghavachari, M., Xia, C. H., & Zhang, L. (2004) · Proceedings of the 13th international conference on World Wide Web · doi:10.1145/988672.988711 · Cited by 163
Automated known problem diagnosis with event traces
Yuan, C., Lao, N., Wen, J.-R., Li, J., Zhang, Z., Wang, Y.-M., & Ma, W. (2006) · European Conference on Computer Systems · doi:10.1145/1217935.1217972 · Cited by 158
From L3 to seL4 what have we learnt in 20 years of L4 microkernels?
Elphinstone, K. J., & Heiser, G. A. (2013) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/2517349.2522720 · Cited by 156
Automating configuration troubleshooting with dynamic information flow analysis
Attariyan, M., & Flinn, J. (2010) · doi:10.5555/1924943.1924960 · Cited by 154
Improving software diagnosability via log enhancement
Yuan, D., Zheng, J., Park, S., Zhou, Y., & Savage, S. (2011) · Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems · doi:10.1145/1950365.1950369 · Cited by 154
Self-citationConfiguration debugging as search: finding the needle in the haystack
Whitaker, A. C., Cox, R. S., & Gribble, S. D. (2004) · Cited by 145
Yuan, D., Luo, Y., Zhuang, X., Rodrigues, G. R., Zhao, X., Zhang, Y., Jain, P. U., & Stumm, M. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685068 · Cited by 135
A recursive random search algorithm for large-scale network parameter configuration
Ye, T., & Kalyanaraman, S. (2003) · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · doi:10.1145/781027.781052 · Cited by 131
Mining configuration constraints: static analyses and empirical results
Nadi, S., Berger, T., Kästner, C., & Czarnecki, K. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2568225.2568283 · Cited by 127
Improving user-interface dependability through mitigation of human error
Maxion, R. A., & Reeder, R. W. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.04.009 · Cited by 123
Burgess, M. (1995) · Computing systems · Cited by 116
STRIDER: A Black-box, State-based Approach to Change and Configuration Management and Support
Wang, Y., Verbowski, C., Dunagan, J., Chen, Y., Wang, H. J., Yuan, C., & Zhang, Z. (2003) · Cited by 113
AutoBash: improving configuration management with operating system causality analysis
Su, Y.-Y., Attariyan, M., & Flinn, J. (2007) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/1294261.1294284 · Cited by 110
Understanding and dealing with operator mistakes in internet services
Nagaraja, K., Oliveira, F., Bianchini, R., Martin, R. P., & Nguyen, T. D. (2004) · Cited by 109
Static extraction of program configuration options
Rabkin, A., & Katz, R. H. (2011) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1985793.1985812 · Cited by 106
Undo for operators: building an undoable e-mail store
Brown, A. B., & Patterson, D. A. (2003) · Cited by 102
EnCore: exploiting system environment and correlation information for misconfiguration detection
Zhang, J., Renganarayana, L., Zhang, X., Ge, N., Bala, V., Xu, T., & Zhou, Y. (2014) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2541940.2541983 · Cited by 99
Self-citationThe SmartFrog configuration management framework
Goldsack, P., Guijarro, J., Loughran, S., Coles, A., Farrell, A., Lain, A., Murray, P., & Toft, P. (2009) · ACM SIGOPS Operating Systems Review · doi:10.1145/1496909.1496915 · Cited by 93
Rabkin, A., & Katz, R. H. (2012) · IEEE Software · doi:10.1109/ms.2012.73 · Cited by 93
ConfErr: A tool for assessing resilience to human configuration errors
Keller, L., Upadhyaya, P., & Candea, G. (2008) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2008.4630084 · Cited by 93
Configuration management at massive scale: system design and experience
Enck, W., Moyer, T., McDaniel, P. D., Sen, S. B., Sebos, P., Spoerel, S., Greenberg, A. G., Sung, Y.-W. E., Rao, S., & Aiello, W. A. (2009) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2009.090408 · Cited by 92
Rethinking Database System Architecture: Towards a Self-Tuning RISC-Style Database System
Chaudhuri, S., & Weikum, G. (2000) · Cited by 90
Precomputing possible configuration error diagnoses
Rabkin, A., & Katz, R. H. (2011) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2011.6100053 · Cited by 88
NetPrints: diagnosing home network misconfigurations using shared knowledge
Aggarwal, B., Bhagwan, R., Das, T., Eswaran, S., Padmanabhan, V. N., & Voelker, G. M. (2009) · Networked Systems Design and Implementation · Cited by 87
Detecting and resolving policy misconfigurations in access-control systems
Bauer, L., Garriss, S., & Reiter, M. K. (2011) · ACM Transactions on Information and System Security · doi:10.1145/1952982.1952984 · Cited by 85
Declarative Infrastructure Configuration Synthesis and Debugging
Narain, S., Levin, G. M., Malik, S., & Kaul, V. (2008) · Journal of Network and Systems Management · doi:10.1007/s10922-008-9108-y · Cited by 85
A survey of system configuration tools
Delaet, T., Joosen, W., & Vanbrabant, B. (2010) · Lirias (KU Leuven) · Cited by 83
Network configuration management via model finding
Narain, S. (2005) · Cited by 81
Automated Diagnosis of Software Configuration Errors
Zhang, S., & Ernst, M. D. (2013) · Cited by 80
Which configuration option should I change?
Zhang, S., & Ernst, M. D. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2568225.2568251 · Cited by 79
Design guidelines for system administration tools developed through ethnographic field studies
Haber, E. M., & Bailey, J. (2007) · Proceedings of the 2007 symposium on Computer human interaction for the management of information technology · doi:10.1145/1234772.1234774 · Cited by 73
Context-based online configuration-error detection
Yuan, D., Xie, Y., Panigrahy, R., Yang, J., Verbowski, C., & Kumar, A. (2011) · USENIX Annual Technical Conference · Cited by 72
Automatic configuration of internet services
Zheng, W., Bianchini, R., & Nguyen, T. D. (2007) · European Conference on Computer Systems · doi:10.1145/1272996.1273020 · Cited by 69
Why Programs Fail, Second Edition: A Guide to Systematic Debugging
Zeller, A. (2009) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 66
Generating range fixes for software configuration
Xiong, Y., Hubaux, A., She, S., & Czarnecki, K. (2012) · doi:10.5555/2337223.2337231 · Cited by 57
Discovering correctness constraints for self-management of system con .guration
Kıcıman, E., & Wang, Y. (2004) · International Conference on Autonomic Computing · doi:10.1109/icac.2004.1301344 · Cited by 53
Generic and automatic address configuration for data center networks
Chen, K., Guo, C., Wu, H., Yuan, J., Feng, Z., Chen, Y., Lu, S., & Wu, W. (2010) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/1851182.1851190 · Cited by 52
Flight data recorder: monitoring persistent-state interactions to improve systems management
Verbowski, C., Kıcıman, E., Kumar, A., Daniels, B., Lu, S., Lee, J., Wang, Y., & Roussev, R. (2006) · doi:10.5555/1298455.1298467 · Cited by 51
A user survey of configuration challenges in Linux and eCos
Hubaux, A., Xiong, Y., & Czarnecki, K. (2012) · International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS) · doi:10.1145/2110147.2110164 · Cited by 51
Zeller, A. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374515-6.00006-x · Cited by 51
ConfValley: a systematic configuration validation framework for cloud services
Huang, P., Bolosky, W. J., Singh, A. A., & Zhou, Y. (2015) · European Conference on Computer Systems · doi:10.1145/2741948.2741963 · Cited by 50
Self-citationTowards a High-Level Machine Configuration System
Anderson, P. (1994) · Cited by 47
Understanding and validating database system administration
Oliveira, F., Nagaraja, K., Bachwani, R., Bianchini, R., Martin, R. P., & Nguyen, T. D. (2006) · USENIX Annual Technical Conference · Cited by 44
Mining for misconfigured machines in grid systems
Palatin, N., Leizarowitz, A., Schuster, A., & Wolff, R. (2006) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1150402.1150488 · Cited by 41
Demystifying configuration challenges and trade-offs in network-based ISP services
Benson, T., Akella, A., & Shaikh, A. (2011) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/2018436.2018471 · Cited by 40
Using causality to diagnose configuration bugs
Attariyan, M., & Flinn, J. (2008) · Cited by 36
A declarative approach to automated configuration
Hewson, J. A., Anderson, P., & Gordon, A. D. (2012) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.5555/2432523.2432528 · Cited by 34
Snitch: interactive decision trees for troubleshooting misconfigurations
Mickens, J. W., Szummer, M., & Narayanan, D. (2007) · Cited by 33
Ramachandran, V., Gupta, M., Sethi, M., & Chowdhury, S. R. (2009) · International Conference on Autonomic Computing · doi:10.1145/1555228.1555269 · Cited by 25
A survey of system administrator mental models and situation awareness
Hrebec, D. G., & Stiber, M. (2001) · ACM SIGCPR Conference on Computer Personnel Research (SIGCPR) · doi:10.1145/371209.371231 · Cited by 24
Barricade: defending systems against operator mistakes
Oliveira, F., Tjang, A., Bianchini, R., Martin, R. P., & Nguyen, T. D. (2010) · European Conference on Computer Systems · doi:10.1145/1755913.1755924 · Cited by 23
Automatically generating predicates and solutions for configuration troubleshooting
Su, Y.-Y., & Flinn, J. (2009) · USENIX Annual Technical Conference · Cited by 21
Velasquez, N. F., Weisband, S. P., & Durcikova, A. (2008) · USENIX Large Installation Systems Administration Conference · Cited by 20
Enabling configuration-independent automation by non-expert users
Kushman, N., & Katabi, D. (2010) · Operating Systems Design and Implementation · doi:10.5555/1924943.1924959 · Cited by 19
Making System Configuration More Declarative
DeTreville, J. (2005) · Workshop on Hot Topics in Operating Systems · Cited by 15
Finding probably better system configurations quickly
Osogami, T., & Itoko, T. (2006) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/1140103.1140308 · Cited by 15
A case study in configuration management tool deployment
Desai, N., Bradshaw, R., Matott, S., Bittner, S., Coghlan, S., Evard, R., Lueninghoener, C., Leggett, T., Navarro, J.-P., Rackow, G., et al. (2005) · Cited by 14
Towards Availability and Maintainability Benchmarks: A Case Study of Software RAID Systems
Brown, A. B. (2001) · UC Berkeley · Cited by 12
Configuration tools: working together
Anderson, P., & Smith, E. (2005) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 12
Getting Started with Configuration Management.
Lueninghoener, C. (2011) · Cited by 12
Finding probably better system configurations quickly
Osogami, T., & Itoko, T. (2006) · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · doi:10.1145/1140277.1140308 · Cited by 11
Purely functional system configuration management
Dolstra, E., & Hemel, A. (2007) · Cited by 9
Toward provenance-based security for configuration languages
Anderson, P., & Cheney, J. (2012) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 8
Kendrick, S. (2012) · ;login:: the magazine of USENIX & SAGE · Cited by 8
LiveOps: systems management as a service
Verbowski, C., Lee, J., Xiao-gang, L., Roussev, R., & Wang, Y. (2006) · Cited by 6
Automating Configuration Troubleshooting with ConfAid.
Attariyan, M., & Flinn, J. (2011) · ;login:: the magazine of USENIX & SAGE · Cited by 6
Why do migrations fail and what can we do about it
Zhang, G., & Liu, L. (2011) · Cited by 5
Human-aware computer system design
Bianchini, R., Martin, R. P., Nagaraja, K., Nguyen, T. D., & Oliveira, F. (2005) · Cited by 5
Coar, K., Press, D., & Fielding, R. T. (1998) · John Wiley & Sons, Inc. eBooks · Cited by 4
Coar, K., Fielding, R. T., & Press, D. (1998) · Medical Entomology and Zoology · Cited by 4
Auto-configuration by File Construction: Configuration Management with newfig
LeFebvre, W., & Snyder, D. (2004) · Cited by 2
Fine-grained access-control for the Puppet configuration language
Vanbrabant, B., Peeraer, J., & Joosen, W. (2011) · Lirias · Cited by 2
Towards Availability and Maintainability Benchmarks: a Case Study of
Brown, A. B. (2001) · Cited by 1
Educating system administrators
Border, C., & Begnum, K. (2014) · ;login:: the magazine of USENIX & SAGE · Cited by 1
Research works printed but not linked: 45
- Aggarwal Bhavish, Proceedings of the 6th USENIX Symposium on Networked System Design and Implementation (NSDI’09)
- 10.5555/645371.651326 · doi:10.5555/645371.651326
- 10.5555/1026675.1026681 · doi:10.5555/1026675.1026681
- Anderson Paul, 2012, Proceedings of the 4th USENIX Workshop on the Theory and Practice of Provenance (TaPP’12)
- Anderson Paul, 2005, Proceedings of the 19th Large Installation System Administration Conference (LISA’05)
- Marc Andreessen. 2011. Why software is eating the world. The Wall Street Journal (August 2011). Marc Andreessen. 2011. Why software is eating the world. The Wall Street Journal (August 2011).
- Attariyan Mona, 2012, Proceedings of the 10th USENIX Conference on Operating Systems Design and Implementation (OSDI’12)
- 10.5555/1404014.1404037 · doi:10.5555/1404014.1404037
- 10.5555/1558977.1559000 · doi:10.5555/1558977.1559000
- Bianchini Ricardo, 2005, Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS X).
- Aaron, Proceedings of the 1st Workshop on Evaluating and Architecting System Dependability (EASY’01)
- Cadar Cristian, 2008, Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (OSDI’08)
- Chaudhuri Surajit, 2000, Proceedings of the 26th International Conference on Very Large Data Bases (VLDB’00)
- Delaet Thomas, 2010, Proceedings of the 24th Large Installation System Administration Conference (LISA’10)
- Desai Narayan, 2005, Proceedings of the 19th Large Installation System Administration Conference (LISA’05)
- DeTreville John, 2005, Proceedings of the USENIX 10th Workshop on Hot Topics in Operating Systems (HotOS-X).
- 10.5555/1361397.1361410 · doi:10.5555/1361397.1361410
- Enck William, 2007, Proceedings of 2007 USENIX Annual Technical Conference (USENIX ATC’07)
- Feamster Nick, 2005, Proceedings of the 2nd USENIX Symposium on Networked Systems Design and Implementation (NSDI’05)
- Hewson John A., Proceedings of the 26th Large Installation System Administration Conference (LISA’12)
- Jiang Weihang, 2009, Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST’09)
- Kiciman Emre, 2004, Proceedings of the 1st International Conference on Autonomic Computing (ICAC’04)
- 10.5555/795672.796947 · doi:10.5555/795672.796947
- Laprie Jean-Claude, 1995, Proceedings of the 25th IEEE International Symposium on Fault-Tolerant Computing (FTCS’95)
- LeFebvre William, 2004, Proceedings of the 18th USENIX Large Installation System Administration Conference (LISA’04)
- Mickens James, 2007, Proceedings of the 2nd USENIX Workshop on Tackling Computer Systems Problems with Machine Learning Techniques (SYSML’07)
- Miller Rich, 2012, Microsoft: Misconfigured Network Device Caused Azure Outage.
- Nagaraja Kiran, Proceedings of the 6th USENIX Conference on Operating Systems Design and Implementation (OSDI’04)
- Narain Sanjai, 2005, Proceedings of the 19th Large Installation System Administration Conference (LISA’05)
- Oliveira Fábio, Proceedings of 2006 USENIX Annual Technical Conference (USENIX ATC’06)
- LDAP, 2004, Re: BINDDN in ldap.conf.
- Oppenheimer David, Proceedings of the 4th USENIX Symposium on Internet Technologies and Systems (USITS’03)
- Song Yee Jiun, 2009, Proceedings of the Workshop on Theory and Practice of Byzantine Fault Tolerance (BFTW3).
- 10.5555/1855807.1855824 · doi:10.5555/1855807.1855824
- Thomas Keir, 2011, Thanks, Amazon: The Cloud Crash Reveals Your Importance.
- 10.5555/2208488.2208494 · doi:10.5555/2208488.2208494
- Velasquez Nicole F., 2008, Proceedings of the 22nd Large Installation System Administration Conference (LISA’08)
- Verbowski Chad, 2006, Proceedings of the 7th USENIX Conference on Operating Systems Design and Implementation (OSDI’06)
- Verbowski Chad, 2006, Proceedings of the 20th Large Installation System Administration Conference (LISA’06)
- Wang Helen J., 2004, Proceedings of the 6th USENIX Conference on Operating Systems Design and Implementation (OSDI’04)
- Wang Yi-Min, 2003, Proceedings of the 17th Large Installation Systems Administration Conference (LISA’03)
- Whitaker Andrew, Proceedings of the 6th USENIX Conference on Operating Systems Design and Implementation (OSDI’04)
- Yuan Ding, 2014, Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation (OSDI’14)
- 10.5555/2002181.2002209 · doi:10.5555/2002181.2002209
- Zhang Gong, 2011, Proceedings of the 25th USENIX Large Installation System Administration Conference (LISA’11)
Cited by
Xu, T., Jin, L., Fan, X., Zhou, Y., Pasupathy, S., & Talwadker, R. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786852 · Cited by 168
Self-citationHolistic configuration management at Facebook
Tang, C., Kooburat, T., Venkatachalam, P., Chander, A., Wen, Z., Narayanan, A., Dowell, P., & Karl, R. (2015) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/2815400.2815401 · Cited by 119
Investigating System Operators' Perspective on Security Misconfigurations
Dietrich, C., Krombholz, K., Borgolte, K., & Fiebig, T. (2018) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3243734.3243794 · Cited by 144
AI for DevSecOps: A Landscape and Future Opportunities
Fu, M. C., Pasuksmit, J., & Tantithamthavorn, C. K. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3712190 · Cited by 109
Datasize-Aware High Dimensional Configurations Auto-Tuning of In-Memory Cluster Computing
Yu, Z., Bei, Z., & Qian, X. (2018) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3173162.3173187 · Cited by 88
Metadata
- Authors
- Xu, T., & Zhou, Y.
- Affiliations
- University of California San Diego (US)
- Venue
- ACM Computing Surveys
- Published
- 2015-07-21
- Volume
- 47
- Issue
- 4
- Pages
- 1-41
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2261611353
- Cited by
- 139
- References
- 116
- Citations by year
- 2026: 13 · 2025: 29 · 2024: 14 · 2023: 12 · 2022: 6 · 2021: 12 · 2020: 17 · 2019: 8 · 2018: 8 · 2017: 12 · 2016: 6 · 2015: 2
- FWCI
- 10.70
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- configuration errors, misconfiguration, system failure, service outages, configuration management, fault detection, troubleshooting, system administration, system complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.