Adopting DevOps in the real world: A theory, a model, and a case study
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Abstract DevOps is a set of practices and cultural values that aims to reduce the barriers between development and operations teams. Due to its increasing interest and imprecise definitions, existing research works have tried to characterize DevOps. Nevertheless, little is known about the practitioners’ understandingabout successful paths for DevOps adoption. Therefore, our goal is to detail real scenarios of DevOps adoption, presenting a theory, a model, and a case study. We used classic Grounded Theory to build a theory about 15 scenarios of successful DevOps adoption in companies from different domains and countries. We proposed a model (i.e., a workflow for DevOps adoption) and evaluated it through a case study at a Brazilian Government institution. We used a focus group to collect the company perceptions about DevOps adoption. This paper increments the existing view of DevOps by detailing real scenarios and explaining the role of each category during DevOps adoption. We provide evidence that collaboration is the core DevOps concern, contrasting with an existing wisdom that automation and tooling can be enough to achieve DevOps. Altogether, our results contribute to: generating an adequate understanding of DevOps, from the practitioners’ perspective; and assisting other institutions in the path towards DevOps adoption.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Discovery of Grounded Theory: Strategies for Qualitative Research.
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,361
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449
Experimentation in Software Engineering
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., & Wesslén, A. (2012) · doi:10.1007/978-3-642-29044-2 · Cited by 4,460 · cited 1×
“Tables 1 and 2 summarize our research goals using a GQM (Goals/Questions/Metrics) template [14].”
MethodMorgan, D. L. (1996) · Annual Review of Sociology · doi:10.1146/annurev.soc.22.1.129 · Cited by 2,353
‘Discovering’ chronic illness: Using grounded theory
Charmaz, K. (1990) · Social Science & Medicine · doi:10.1016/0277-9536(90)90256-r · Cited by 1,648 · cited 1×
“First, GT is a consolidated method in other areas of research — notably medical sociology [17], nursing [18], education [19], and management [20].”
MethodExperimentation in software engineering
(2013) · Choice Reviews Online · doi:10.5860/choice.50-5018 · Cited by 1,517
Guide to Advanced Empirical Software Engineering
(2008) · Springer eBooks · doi:10.1007/978-1-84800-044-5 · Cited by 1,003 · cited 2×
“[29], focus groups typically have between three and twelve participants, are designed to obtain personal perceptions of members of one or more groups”
BackgroundMethodThe Sage handbook of grounded theory
(2008) · Choice Reviews Online · doi:10.5860/choice.45-6250 · Cited by 561
Grounded theory in software engineering research: a critical review and guidelines
Stol, K.-J., Ralph, P., & Fitzgerald, B. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884833 · Cited by 470
Proceedings of the 36th International Conference on Software Engineering
(2014) · doi:10.1145/2568225 · Cited by 467
Using Grounded Theory in Nursing
Barnsteiner, J. H. (2002) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2002.24041.x · Cited by 291 · cited 2×
“Second, GT is considered an adequate approach to answer research questions that aims to characterize scenarios under a personal perspective of those engaged in a discipline or activity [18], which is exactly the scenario here (i.”
BackgroundMethodThe impact of inadequate customer collaboration on self-organizing Agile teams
Hoda, R., Noble, J., & Marshall, S. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2010.10.009 · Cited by 257 · cited 1×
“In selective coding, we only considered the specific variables that are directly related to the core category, in order to enable the production of an harmonic theory [16, 26].”
Building Theories in Software Engineering
Sjøberg, D. I. K., Dybå, T., Anda, B. C. D., & Hannay, J. E. (2008) · Guide to Advanced Empirical Software Engineering · doi:10.1007/978-1-84800-044-5_12 · Cited by 244
Using grounded theory to study the experience of software development
Adolph, S., Hall, W., & Kruchten, P. (2011) · Empirical Software Engineering · doi:10.1007/s10664-010-9152-6 · Cited by 235 · cited 9×
“We carried out our research using an existing guideline about how to conduct a Grounded Theory [23] research.”
MethodInfluentialDeveloping a grounded theory to explain the practices of self-organizing Agile teams
Hoda, R., Noble, J., & Marshall, S. (2012) · Empirical Software Engineering · doi:10.1007/s10664-011-9161-0 · Cited by 228 · cited 1×
“The resulting theory, for instance, might be different in other contexts [34].”
BackgroundColeman, G., & O’Connor, R. (2007) · Information and Software Technology · doi:10.1016/j.infsof.2007.02.011 · Cited by 204
A qualitative study of DevOps usage in practice
Erich, F. M. A., Amrit, C., & Daneva, M. (2017) · Journal of Software: Evolution and Process · doi:10.1002/smr.1885 · Cited by 203 · cited 4×
“[10] focus on investigating the ways in which organizations implement DevOps.”
BackgroundResultInfluentialLwakatare, L. E., Kuvaja, P., & Oivo, M. (2015) · Lecture notes in business information processing · doi:10.1007/978-3-319-18612-2_19 · Cited by 177 · cited 5×
“DevOps is a set of practices and cultural values that has emerged in the software development industry [1, 2, 3, 4].”
BackgroundInfluentialRequirements Prioritization Challenges in Practice
Lehtola, L., Kauppinen, M., & Kujala, S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24659-6_36 · Cited by 171 · cited 1×
“[31], consequently, the focus group was conducted as follows: (1) the researcher-moderator served as focus group facilitator providing participants with the discussion topics; (2) at the beginning of each topic’ discussion, the questions were presented to participants who wrote their ideas and keywords in post-it note…”
BackgroundDevOps: A Definition and Perceived Adoption Impediments
Smeds, J., Nybom, K., & Porres, I. (2015) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-319-18612-2_14 · Cited by 158 · cited 4×
“[1] uses a literature review to produce one explanation about DevOps through a set of enablers and capabilities.”
BackgroundMethodInfluentialDevOps Adoption Benefits and Challenges in Practice: A Case Study
Riungu-Kalliosaari, L., Mäkinen, S., Lwakatare, L. E., Tiihonen, J., & Männistö, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49094-6_44 · Cited by 154 · cited 1×
“DevOps claimed benefits include increased organizational IT performance and productivity, cost reduction in software lifecycle, improvement in operational efficacy and efficiency, better quality of software products, and greater business alignment between development and operations teams [4, 7, 8].”
BackgroundBecoming Agile: A Grounded Theory of Agile Transitions in Practice
Hoda, R., & Noble, J. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.21 · Cited by 135 · cited 3×
“More recently, GT is also being increasingly employed to study software engineering research topics [21, 22, 23].”
BackgroundMethodHttermann, M. (2012) · Cited by 133
Grounded Theory and the Politics of Interpretation
Denzin, N. K. (2007) · The SAGE Handbook of Grounded Theory · doi:10.4135/9781848607941.n21 · Cited by 115 · cited 1×
“Since the publication of the original version of GT [15], several modifications and variations have been proposed to the method, coming to exist at least seven different versions [24].”
MethodCharacterizing DevOps by Hearing Multiple Voices
de França, B. B. N., Jeronimo, H., & Travassos, G. H. (2016) · Proceedings of the XXX Brazilian Symposium on Software Engineering · doi:10.1145/2973839.2973845 · Cited by 109 · cited 5×
“DevOps is a set of practices and cultural values that has emerged in the software development industry [1, 2, 3, 4].”
BackgroundMethodInfluentialReconciling perspectives: A grounded theory of how people manage the process of software development
Adolph, S., Kruchten, P., & Hall, W. (2012) · Journal of Systems and Software · doi:10.1016/j.jss.2012.01.059 · Cited by 103 · cited 3×
“a literature review in later stages of a research, in order to avoid external influences to conceive a theory [27].”
BackgroundMethodInfluentialThe Phoenix Project: A Novel About IT, DevOps, and Helping Your Business Win
Kim, G. H., Behr, K., & Spafford, G. (2013) · Cited by 97
Best Practices in Project Management Through a Grounded Theory Lens
Georgieva, S., & Allan, G. (2008) · The Electronic Journal of Business Research Methods · Cited by 74
Adolph, W. S. (2013) · cIRcle (University of British Columbia) · doi:10.14288/1.0073582 · Cited by 56
Agile Processes in Software Engineering and Extreme Programming
Lassenius, C., Dingsøyr, T., & Paasivaara, M. (2015) · Lecture notes in business information processing · doi:10.1007/978-3-319-18612-2 · Cited by 54
An experience report on the adoption of microservices in three Brazilian government institutions
Luz, W., Agilar, E., de Oliveira, M. C., de Melo, C. E. R., Pinto, G., & Bonifácio, R. (2018) · Brazilian Symposium on Software Engineering · doi:10.1145/3266237.3266262 · Cited by 51
Self-citationMikkonen, T., Amasaki, S., Felderer, M., Nguyen Duc, A., Jedlitschka, A., & Abrahamsson, P. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49094-6 · Cited by 47
Cooperation between information system development and operations: a literature review
Erich, F., Amrit, C., & Daneva, M. (2014) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/2652524.2652598 · Cited by 41 · cited 1×
“Existing research works have proposed a number of DevOps characterizations, for instance, as a set of concepts with related practices [1, 2, 3, 4, 9, 10].”
BackgroundUsing a grounded theory approach for exploring software product management challenges
Jantunen, S., & Gause, D. C. (2014) · Journal of Systems and Software · doi:10.1016/j.jss.2014.03.050 · Cited by 31
Proceedings of the XXXII Brazilian Symposium on Software Engineering
Kulesza, U., Brazil, S. 2. X. B. S. O. S. E. 2. V. E., & Association for Computing Machinery-Digital Library (2018) · doi:10.1145/3266237 · Cited by 24
Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering Companion
Binder, W., Italy, I. '. A. I. C. O. P. E. 2. L., Association for Computing Machinery-Digital Library, ACM Special Interest Group on Measurement and Evaluation, ACM Special Interest Group on Software Engineering, & SIGs, A. (2017) · doi:10.1145/3053600 · Cited by 23
Building a Collaborative Culture: A Grounded Theory of Well Succeeded DevOps Adoption in PracticePreprint
Luz, W., Pinto, G., & Bonifácio, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.05415 · Cited by 22 · cited 3×
“This paper is a continuation of a previous study [11].”
BackgroundResultInfluentialSelf-citationManagement Research and Grounded Theory
Kenealy, G. J. J. (2008) · The grounded theory review · Cited by 13
Cited by
Kumar, R., & Goyal, R. (2020) · Computers & Security · doi:10.1016/j.cose.2020.101967 · Cited by 97
Capabilities and Practices in DevOps: A Multivocal Literature Review
Amaro, R., Pereira, R., & da Silva, M. M. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3166626 · Cited by 43
Navigating the DevOps landscape
Zhang, X., Zhao, P., & Jaskolka, J. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112331 · Cited by 21
A Unified Framework for Automating Software Security Analysis in DevSecOps
Aljohani, M. A., & Alqahtani, S. S. (2023) · 2023 International Conference on Smart Computing and Application (ICSCA) · doi:10.1109/icsca57840.2023.10087568 · Cited by 17
“It extends DevOps' goal of encouraging collaboration between developers and operators by engaging security specialists from the beginning of the software development lifecycle [4].”
BackgroundPinto, G., De Souza, C., Rocha, T., Steinmacher, I., Souza, A., & Monteiro, E. (2024) · Proceedings of the IEEE/ACM 3rd International Conference on AI Engineering - Software Engineering for AI · doi:10.1145/3644815.3644949 · Cited by 17
Self-citation
Metadata
- Authors
- Luz, W. P., Pinto, G., & Bonifácio, R.
- Venue
- Journal of Systems and Software
- Publisher
- Elsevier BV
- Published
- 2019-11
- Volume
- 157
- Pages
- 110384
- ISSN
- 0164-1212 (ISSN-L)
- OpenAlex
- W2962826822
- Cited by
- 164
- References
- 39
- FWCI
- 22.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.