The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
A qualitative study of DevOps usage in practice
Open accessAbstract
Organizations are introducing agile and lean software development techniques in operations to increase the pace of their software development process and to improve the quality of their software. They use the term DevOps, a portmanteau of development and operations, as an umbrella term to describe their efforts. In this paper, we describe the ways in which organizations implement DevOps and the outcomes they experience. We first summarize the results of a systematic literature review that we performed to discover what researchers have written about DevOps. We then describe the results of an exploratory interview‐based study involving 6 organizations of various sizes that are active in various industries. As part of our findings, we observed that all organizations were positive about their experiences and only minor problems were encountered while adopting DevOps.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239
Recommended Steps for Thematic Synthesis in Software Engineering
Cruzes, D. S., & Dyba, T. (2011) · 2011 International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2011.36 · Cited by 960
Research works printed but not linked: 43
- 10.2753/MIS0742-1222260209 · DOI
- Fox A, 2014, Engineering software as a service: An agile approach using cloud computing
- DyckA PennersR LichterH.Towards Definitions for Release Engineering and Devops. In: Proceedings of the IEEE/ACM 3rd International Workshop on Release Engineering Florence:2015:3. · DOI
- Debois, 2011, Opening Statement, Cutter IT J, 24, 3
- Bass L, 2015, Devops: A software architect's perspective
- Loukides M, 2012, What is DevOps?
- ErichF AmritC DanevaM.Cooperation between information system development and operations: A literature review. In: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement; Torino2014:69. · DOI
- 10.1007/978-3-319-13835-0_21 · DOI
- Charmaz K, 2014, Constructing Grounded Theory (Introducing Qualitative Methods Series)
- 10.1086/219886 · DOI · Paper page
- Kvale S, 2008, Doing Interviews
- Yin RK, 2008, Case Study Research: Design and Methods (Applied Social Research Methods)
- Glaser BG, 1967, The Discovery of Grounded Theory: Strategies for Qualitative Research
- BangSK ChungS ChohY DupuisM.A grounded theory analysis of modern web applications: Knowledge skills and abilities for DevOps. In: Proceedings of the 2nd Annual Conference on Research in Information Technology;2013;Orlando FL:61‐62. · DOI
- HosonoS ShimomuraY.Application lifecycle kit for mass customization on PaaS platforms. In: Proceedings ‐ 2012 IEEE 8th World Congress on Services 2012;2012;Honolulu HI:397‐398. · DOI
- CukierD.DevOps patterns to scale web applications using cloud services. In: Proceedings of the 2013 Companion Publication for Conference on Systems Programming & Applications: Software for Humanity Proceedings ‐ SPLASH '13;2013;Indianapolis Indiana USA:143‐152. · DOI
- Ambler SW, 2011, Disciplined agile delivery and collaborative DevOps, Cutter IT J, 24, 18
- 10.1109/MS.2012.85 · DOI
- Phifer B, 2011, Next‐generation process integration: CMMI and ITIL do DevOps, Cutter IT J, 24, 28
- 10.1109/MIC.2013.25 · DOI · Paper page
- DeGrandis D, 2011, Devops: So you say you want a revolution?, Cutter IT J, 24, 34
- Fitzpatrick L, 2011, The business case for DevOps: A five‐year retrospective, Cutter IT J, 24, 19
- Humble J, 2011, Why enterprises must adopt DevOps to enable continuous delivery, Cutter IT J, 24, 6
- Walls M, 2013, Building a DevOps Culture
- 10.1145/2524713.2524721 · DOI
- Shamow E, 2011, DevOps at advance internet: How we got in the door, Cutter IT J, 24, 13
- AkereleO RamachandranM DixonM.System dynamics modelling of agile continuous delivery process. In: Proceedings of the 2013 Agile Conference Nashville;2013:60‐63. · doi:10.1109/agile.2013.28
- 10.1016/j.jss.2007.01.013 · doi:10.1016/j.jss.2007.01.013
- Mueller E, 2011, DevOps and the people who practice it: Winning their hearts and minds, Cutter IT J, 24, 6
- NeelyS StoltS.Continuous delivery? easy! just change everything (well maybe it is not that easy). In: Proceedings of the 2013 Agile Conference Nashville;2013:121‐128. · DOI · Paper page
- TessemB IdenJ.Cooperation between developers and operations in software engineering projects. In: Proceedings of the 2008 International Conference on Software Engineering Leipzig;2008:105‐108. · DOI
- Le‐Quoc A, 2011, Metrics‐driven DevOps, Cutter IT J, 24, 24
- StuckenbergS FieltE LoserT.The impact of software‐as‐a‐service on business models of leading software vendors: Experiences from three exploratory case studies. In: Proceedings of the 15th Pacific Asia Conference on Information Systems: Quality Research in Pacific Brisbane;2011:184.
- Schaefer A, 2012, Continuous integration and automation for DevOps, Transactions on Engineering Technologies, Vol.170 of the series Lecture Notes in Electrical Engineering, 345
- ShangW.Bridging the divide between software developers and operators using logs. In: Proceedings of the 2013 International Conference on Software Engineering Zuerich;2013:1583‐1586.
- GohilK AlapatiN JoglekarS.Towards behavior driven operations (BDOps). In: Proceedings of the 2011 International Conference on Advances in Recent Technologies in Communication and Computing;2011;Bangalore:262‐264. · DOI
- Keyworth B, 2011, Where is IT operations within DevOps?, Cutter IT J, 24, 12
- BassL JefferyR WadaH WeberI ZhuL.Eliciting operations requirements for applications. In: Proceedings of the 1st International Workshop on Release Engineering RELENG 2013;2013;San Francisco CA:5‐8. · doi:10.1109/releng.2013.6607688
- 10.1007/s12130-999-1026-0 · DOI · Paper page
- Miles MB, 1994, Qualitative Data Analysis
- LwakatareL KuvajaP OivoM.Dimensions of devops. In: Proceedings of the 2015 XP Conference Helsinki;2015:212–217. · DOI
- 10.1007/978-3-662-43839-8 · DOI · Paper page
- Steenis M, 2014, Radicale versnelling van het software voortbrengingsproces door middel van continuous delivery
Cited by
A Survey of DevOps Concepts and Challenges
Leite, L., Rocha, C., Kon, F., Milojicic, D., & Meirelles, P. (2020) · ACM Computing Surveys · doi:10.1145/3359981 · Cited by 484
Applying DevOps Practices of Continuous Automation for Machine Learning
Karamitsos, I., Thabit, S., & Apostolopoulos, C. (2020) · Information · doi:10.3390/info11070363 · Cited by 140
Toward successful DevSecOps in software development organizations: A decision-making framework
Akbar, M. A., Smolander, K., Mahmood, S., & Alsanad, A. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2022.106894 · Cited by 128
Capabilities and Practices in DevOps: A Multivocal Literature Review
Amaro, R., Pereira, R., & da Silva, M. M. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3166626 · Cited by 43
Building A Platform for Machine Learning Operations from Open Source Frameworks
Liu, Y., Ling, Z., Huo, B., Wang, B., Chen, T., & Mouine, E. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.04.161 · Cited by 32
Metadata
- Authors
- Erich, F. M. A., Amrit, C., & Daneva, M.
- Venue
- Journal of Software: Evolution and Process
- Publisher
- Wiley
- Published
- 2017-06
- Volume
- 29
- Issue
- 6
- ISSN
- 2047-7473 (ISSN-L)
- 2047-7481
- OpenAlex
- W2725103509
- Cited by
- 203
- References
- 2
- FWCI
- 25.98
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A qualitative study of DevOps usage in practice. https://app.cochat.ai/papers/10.1002/smr.1885
- The paper
- Erich, F. M. A., Amrit, C., & Daneva, M. (2017). A qualitative study of DevOps usage in practice. Journal of Software: Evolution and Process. https://doi.org/10.1002/smr.1885
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.