Continuous software engineering and beyond: trends and challenges
Open accessAbstract
Throughout its short history, software development has been characterized by harmful disconnects between important activities e.g., planning, development and implementation. The problem is further exacerbated by the episodic and infrequent performance of activities such as planning, testing, integration and releases. Several emerging phenomena reflect attempts to address these problems. For example, the Enterprise Agile concept has emerged as a recognition that the benefits of agile software development will be sub- optimal if not complemented by an agile approach in related organizational function such as finance and HR. Continuous integration is a practice which has emerged to eliminate discontinuities between development and deployment. In a similar vein, the recent emphasis on DevOps recognizes that the integration between software development and its operational deployment needs to be a continuous one. We argue a similar continuity is required between business strategy and development, BizDev being the term we coin for this. These disconnects are even more problematic given the need for reliability and resilience in the complex and data-intensive systems being developed today. Drawing on the lean concept of flow, we identify a number of continuous activities which are important for software development in today’s context. These activities include continuous planning, continuous integration, continuous deployment, continuous delivery, continuous verification, continuous testing, continuous compliance,continuous security, continuous use, continuous trust, continuous run-time monitoring, continuous improvement (both process and product), all underpinned by continuous innovation. We use the umbrella term, ``Continuous *'' (continuous star) to identify this family of continuous activities.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Through approaches such as DevOps the speed at which Software Development is released has increased, increasing the pressure for the inclusion of security and compliance requirements.
“Through approaches such as DevOps the speed at which Software Development is released has increased [7] increasing the pressure for the inclusion of security and compliance requirements [2].”
From DevSecOps practices and tools (2025) · cites this paper as [2]
Cites
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035 · see citing works
User Acceptance of Computer Technology: A Comparison of Two Theoretical Models
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989) · Management Science · doi:10.1287/mnsc.35.8.982 · Cited by 25,709 · see citing works
(2003) · Cited by 9,368 · see citing works
Understanding Information Systems Continuance: An Expectation-Confirmation Model1
Bhattacherjee, A. (2001) · MIS Quarterly · doi:10.2307/3250921 · Cited by 8,767 · see citing works
Trust and TAM in Online Shopping: An Integrated Model1
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · MIS Quarterly · doi:10.2307/30036519 · Cited by 8,635 · see citing works
Extreme Programming Explained: Embrace Change
Beck, K. L., & Andres, C. (2000) · Cited by 5,855 · see citing works
Refactoring: Improving the Design of Existing Code
Fowler, M. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45672-4_31 · Cited by 5,615 · see citing works
Toyota production system: beyond large-scale production
Ohno, T., & Rosen, C. B. (1998) · CERN Document Server (European Organization for Nuclear Research) · Cited by 4,544 · see citing works
Ries, E. (2011) · Cited by 3,379 · see citing works
Lean Thinking—Banish Waste and Create Wealth in your Corporation
Womack, J. P., & Jones, D. T. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600967 · Cited by 3,374 · see citing works
Open Innovation: The New Imperative for Creating and Profiting from Technology
(2004) · European Journal of Innovation Management · doi:10.1108/14601060410565074 · Cited by 2,854 · see citing works
Pavlou, P. A., & Fygenson, M. (2006) · MIS Quarterly · doi:10.2307/25148720 · Cited by 2,685 · see citing works
Lean Thinking—Banish Waste and Create Wealth in your Corporation
Womack, J. P., & Jones, D. T. (1997) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2600967 · Cited by 2,122 · see citing works
Lean Thinking-Banish Waste and Create Wealth in Your Corporation.
Rand, G. K., Womack, J. P., & Jones, D. T. (1997) · Journal of the Operational Research Society · doi:10.2307/3010314 · Cited by 1,842 · see citing works
Managing the Development of Large Software Systems (1970)
Royce, W. W. (2021) · The MIT Press eBooks · doi:10.7551/mitpress/12274.003.0035 · Cited by 1,790 · see citing works
Managing the development of large software systems: concepts and techniques
Royce, W. W. (1987) · International Conference on Software Engineering · doi:10.5555/41765.41801 · Cited by 1,175 · see citing works
Liker, J. Κ. (2003) · Cited by 1,134 · see citing works
An empirical examination of continuance intention of mobile payment services
Zhou, T. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.10.034 · Cited by 957 · see citing works
Get ready for agile methods, with care
BOEHM, B. W. (2002) · Computer · doi:10.1109/2.976920 · Cited by 912 · see citing works
Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation
Humble, J., & Farley, D. R. (2010) · Cited by 911 · see citing works
Perspectives on Free and Open Source Software
(2005) · The MIT Press eBooks · doi:10.7551/mitpress/5326.001.0001 · Cited by 662 · see citing works
The Toyota Product Development System: Integrating People, Process, and Technology
Morgan, J. M., & Liker, J. Κ. (2006) · Cited by 588 · see citing works
de Guinea, A. O., & Markus, M. L. (2009) · Journal of the Association for Information Systems · doi:10.5555/2481626.2481629 · Cited by 460 · see citing works
Managing Strategic Innovation and Change
Sastry, M. A., Tushman, M. L., & Anderson, P. C. (2012) · Cited by 432 · see citing works
Customising agile methods to software practices at Intel Shannon
Fitzgerald, B. F., Hartnett, G., & Conboy, K. (2006) · European Journal of Information Systems · doi:10.1057/palgrave.ejis.3000605 · Cited by 403 · see citing works
Self-citationThe Toyota Product Development System
Morgan, J., & Liker, J. Κ. (2018) · Productivity Press eBooks · doi:10.4324/9781482293746 · Cited by 385 · see citing works
Research Commentary—Digital Natives and Ubiquitous Information Systems
Vodanovich, S., Sundaram, D., & Myers, M. D. (2010) · Information Systems Research · doi:10.1287/isre.1100.0324 · Cited by 382 · see citing works
Scaling Software Agility: Best Practices for Large Enterprises
Leffingwell, D., & Kruchten, P. B. (2007) · Cited by 275 · see citing works
Olsson, H. H., Alahyari, H., & Bosch, J. (2012) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2012.54 · Cited by 244 · see citing works
Modeling continuous integration practice differences in industry software development
Ståhl, D., & Bosch, J. (2013) · Journal of Systems and Software · doi:10.1016/j.jss.2013.08.032 · Cited by 214 · see citing works
Toward a conceptual framework of agile methods
Conboy, K., & Fitzgerald, B. F. (2004) · doi:10.1145/1029997.1030005 · Cited by 214 · see citing works
Self-citationTest Case Prioritization for Continuous Regression Testing: An Industrial Case Study
Marijan, D., Gotlieb, A., & Sen, S. (2013) · Proceedings/Proceedings - Conference on Software Maintenance · doi:10.1109/icsm.2013.91 · Cited by 155 · see citing works
Reducing wasted development time via continuous testing
Saff, D., & Ernst, M. D. (2005) · doi:10.1109/issre.2003.1251050 · Cited by 142 · see citing works
Implementing Beyond Budgeting: Unlocking the Performance Potential
Bogsnes, B. (2008) · Cited by 134 · see citing works
Enabling Agile Testing through Continuous Integration
Stolberg, S. (2009) · Agile Conference · doi:10.1109/agile.2009.16 · Cited by 130 · see citing works
Continuous Delivery? Easy! Just Change Everything (Well, Maybe It Is Not That Easy)
Neely, S., & Stolt, S. (2013) · 2013 Agile Conference · doi:10.1109/agile.2013.17 · Cited by 124 · see citing works
Scaling agile methods to regulated environments: an industry case study
Fitzgerald, B. F., Stol, K.-J., O'Sullivan, R., & O’Brien, D. (2013) · University of Limerick Institutional Repository (University of Limerick) · doi:10.5555/2486788.2486906 · Cited by 124 · see citing works
Self-citationThe disappearing boundary between development-time and run-time
Baresi, L., & Ghezzi, C. (2010) · doi:10.1145/1882362.1882367 · Cited by 112 · see citing works
CPEF: A Continuous Planning and Execution Framework
Myers, K. L. (1999) · AI Magazine · doi:10.1609/aimag.v20i4.1480 · Cited by 109 · see citing works
From Continuous Improvement to Continuous Innovation
Cole, R. E. (2001) · Quality Management Journal · doi:10.1080/10686967.2001.11918977 · Cited by 103 · see citing works
Product Release Planning: Methods, Tools and Applications
Ruhe, G. (2010) · Thammasat University Digital Collections · Cited by 96 · see citing works
Casper: space exploration through continuous planning
Knight, S., Rabideau, G., Chien, S., Engelhardt, B. E., & Sherwood, R. (2001) · IEEE Intelligent Systems · doi:10.1109/5254.956084 · Cited by 95 · see citing works
Continuous Monitoring of Software Services: Design and Application of the Kieker Framework
van Hoorn, A., Röhr, M., Hasselbring, W., Waller, J., Ehlers, J., Frey, S., & Kieselhorst, D. (2009) · MACAU: Open Access Repository of Kiel University (University Library Kiel) · Cited by 77 · see citing works
The Role of Continuous Trust in Information Systems Continuance
Hoehle, H., Huff, S. L., & Goode, S. (2012) · Journal of Computer Information Systems · doi:10.1080/08874417.2012.11645571 · Cited by 75 · see citing works
Scaling Continuous Integration
Rogers, R. O. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24853-8_8 · Cited by 66 · see citing works
Ebert, C., Abrahamsson, P., & Oza, N. V. (2012) · IEEE Software · doi:10.1109/ms.2012.116 · Cited by 60 · see citing works
Automated Continuous Integration of Component-Based Software: An Industrial Experience
Kim, S., Park, S., Yun, J., & Lee, Y. (2008) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2008.64 · Cited by 43 · see citing works
11th International Conference on Software Engineering
(1989) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.1989.714386 · Cited by 40 · see citing works
A Framework for Enterprise Agility and the Enabling Role of Digital Options
Overby, E. M., Bharadwaj, A. S., & Sambamurthy, V. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-387-25590-7_19 · Cited by 37 · see citing works
Data debugging with continuous testing
Muşlu, K., Brun, Y., & Meliou, A. (2013) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2491411.2494580 · Cited by 36 · see citing works
Understanding and predicting electronic commerce adoption
PavlouPaul, A., & FygensonMendel (2006) · MIS Quarterly · doi:10.5555/2017284.2017292 · Cited by 31 · see citing works
Lehtola, L., Kauppinen, M., Vähäniitty, J., & Komssi, M. (2009) · Requirements Engineering · doi:10.1007/s00766-009-0078-8 · Cited by 29 · see citing works
Evidence-based decision making in lean software project management
Fitzgerald, B. F., Musiał, M., & Stol, K.-J. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2591062.2591190 · Cited by 21 · see citing works
Self-citationJärvinen, J., Hamann, D., & van Solingen, R. (1999) · IEEE International Software Metrics Symposium (METRICS) · doi:10.1109/metric.1999.809722 · Cited by 13 · see citing works
"Continuous verification" in mission critical software development
Chang, T.-F., Danylyzsn, A., Norimatsu, S., Rivera, J. C. R., Shepard, D., Lattanze, A. J., & Tomayko, J. E. (2002) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.1997.663184 · Cited by 10 · see citing works
Continuous Verification of Large Embedded Software Using SMT-Based Bounded Model Checking
Cordeiro, L. C., Fischer, B., & Marques-Silva, J. P. (2010) · IEEE International Conference and Workshops on Engineering of Computer-Based Systems (ECBS) · doi:10.1109/ecbs.2010.24 · Cited by 10 · see citing works
Applying Continuous Code Reviews in Airport Operations Software
Bernhart, M., Strobl, S., Mauczka, A., & Grechenig, T. (2012) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2012.61 · Cited by 8 · see citing works
Extreme Programming and Agile Processes in Software Engineering
Kölling, M., & Patterson, A. (2004) · Lecture notes in computer science · doi:10.1007/b98150 · Cited by 8 · see citing works
The ASPIRE approach to continuous software process improvement
Krasner, H. (2003) · doi:10.1109/icsi.1992.217302 · Cited by 6 · see citing works
Continuous SPA: Continuous Assessing and Monitoring Software Process
Chen, X., Sorenson, P. G., & Willson, J. (2007) · doi:10.1109/services.2007.25 · Cited by 5 · see citing works
(2010) · Auerbach Publications eBooks · doi:10.1201/ebk0849326202-p2 · Cited by 3 · see citing works
Flagged first, then by citations
3 of the 64 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Continuous software engineering: A roadmap and agenda
Fitzgerald, B. F., & Stol, K.-J. (2015) · Journal of Systems and Software · doi:10.1016/j.jss.2015.06.063 · Cited by 742 · see citing works
Self-citationMicroservices: A Systematic Mapping Study
Pahl, C., & Jamshidi, P. (2016) · International Conference on Cloud Computing and Services Science · doi:10.5220/0005785500001259 · Cited by 280 · see citing works
Continuous deployment of software intensive products and services: A systematic mapping study
Rodríguez, P., Haghighatkhah, A., Lwakatare, L. E., Teppola, S., Suomalainen, T., Eskeli, J., Karvonen, T., Kuvaja, P., Verner, J. M., & Oivo, M. (2016) · Journal of Systems and Software · doi:10.1016/j.jss.2015.12.015 · Cited by 240 · see citing works
What is DevOps?: A Systematic Mapping Study on Definitions and Practices
Jabbari, R., bin Ali, N., Petersen, K., & Tanveer, B. (2016) · Proceedings of the Scientific Workshop Proceedings of XP2016 · doi:10.1145/2962695.2962707 · Cited by 230 · see citing works
Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?Preprint
Mäkinen, S., Skogström, H., Laaksonen, E., & Mikkonen, T. (2021) · arXiv (Cornell University) · Cited by 169 · see citing works
MLOps - Definitions, Tools and Challenges
Symeonidis, G., Nerantzis, E., Kazakis, A., & Papakostas, G. A. (2022) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc54503.2022.9720902 · Cited by 143 · see citing works
Architectural Principles for Cloud Software
Pahl, C., Jamshidi, P., & Zimmermann, O. (2018) · ACM Transactions on Internet Technology · doi:10.1145/3104028 · Cited by 126 · see citing works
MLOps: A Taxonomy and a Methodology
Testi, M., Ballabio, M., Frontoni, E., Iannello, G., Moccia, S., Soda, P., & Vessio, G. (2022) · IEEE Access · doi:10.1109/access.2022.3181730 · Cited by 137 · see citing works
Towards DevOps in the Embedded Systems Domain: Why is It So Hard?
Lwakatare, L. E., Karvonen, T., Sauvola, T., Kuvaja, P., Olsson, H. H., Bosch, J., & Oivo, M. (2016) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2016.671 · Cited by 113 · see citing works
The Impacts of Test Automation on Software's Cost, Quality and Time to Market
Kumar, D., & Mishra, K. K. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.03.003 · Cited by 100 · see citing works
DevOps critical success factors — A systematic literature review
Azad, N., & Hyrynsalmi, S. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107150 · Cited by 109 · see citing works
Kumar, R., & Goyal, R. (2020) · Computers & Security · doi:10.1016/j.cose.2020.101967 · Cited by 97 · see citing works
Continuous practices and devops: beyond the buzz, what does it all mean?
Ståhl, D., Mårtensson, T., & Bosch, J. (2017) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2017.8114695 · Cited by 87 · see citing works
We’re doing it live: A multi-method empirical study on continuous experimentation
Schermann, G., Cito, J., Leitner, P., Zdun, U., & Gall, H. C. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2018.02.010 · Cited by 74 · see citing works
Behutiye, W., Karhapää, P., López, L., Illa, X. B., Martínez‐Fernández, S., Vollmer, A. M., Rodríguez, P., Franch, X., & Oivo, M. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2019.106225 · Cited by 73 · see citing works
Advances in Using Agile and Lean Processes for Software Development
Rodríguez, P., Mäntylä, M., Oivo, M., Lwakatare, L. E., Seppänen, P., & Kuvaja, P. (2018) · Advances in computers · doi:10.1016/bs.adcom.2018.03.014 · Cited by 70 · see citing works
Going with the flow: An activity theory analysis of flow techniques in software development
Dennehy, D., & Conboy, K. (2016) · Journal of Systems and Software · doi:10.1016/j.jss.2016.10.003 · Cited by 59 · see citing works
Towards a benefits dependency network for DevOps based on a systematic literature review
Jabbari, R., bin Ali, N., Petersen, K., & Tanveer, B. (2018) · Journal of Software Evolution and Process · doi:10.1002/smr.1957 · Cited by 57 · see citing works
Granlund, T., Stirbu, V., & Mikkonen, T. (2021) · SN Computer Science · doi:10.1007/s42979-021-00726-1 · Cited by 53 · see citing works
Towards a governance framework for chains of Scrum teams
Vlietland, J., & van der Vliet, H. J. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.08.008 · Cited by 53 · see citing works
MLOps Challenges in Multi-Organization Setup: Experiences from Two Real-World Cases
Granlund, T., Kopponen, A., Stirbu, V., Myllyaho, L., & Mikkonen, T. (2021) · 2021 IEEE/ACM 1st Workshop on AI Engineering - Software Engineering for AI (WAIN) · doi:10.1109/wain52551.2021.00019 · Cited by 48 · see citing works
Prates, L., & Pereira, R. (2025) · International Journal of Information Security · doi:10.1007/s10207-024-00914-z · Cited by 49 · see citing works
“Through approaches such as DevOps the speed at which Software Development is released has increased [7] increasing the pressure for the inclusion of security and compliance requirements [2].”
Technology management has a significant impact on digital transformation in the banking sector
Rodrigues, L. F., Oliveira, A., & Rodrigues, H. (2023) · International Review of Economics & Finance · doi:10.1016/j.iref.2023.07.040 · Cited by 60 · see citing works
Towards Architecting for Continuous Delivery
Chen, L. (2015) · Working IEEE/IFIP Conference on Software Architecture (WICSA) · doi:10.1109/wicsa.2015.23 · Cited by 45 · see citing works
Rad, M. H., Mojtahedi, M., & Ostwald, M. J. (2021) · Sustainability · doi:10.3390/su13168893 · Cited by 45 · see citing works
Krüger, J., Mahmood, W., & Berger, T. (2020) · International Software Product Line Conference (SPLC) · doi:10.1145/3382025.3414970 · Cited by 39 · see citing works
A decision model for programming language ecosystem selection: Seven industry case studies
Farshidi, S., Jansen, S., & Deldar, M. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106640 · Cited by 38 · see citing works
Continuous planning: an important aspect of agile and lean development
Suomalainen, T., Kuusela, R., & Tihinen, M. (2015) · International Journal of Agile Systems and Management · doi:10.1504/ijasm.2015.070607 · Cited by 37 · see citing works
in-toto: Providing farm-to-table guarantees for bits and bytes
Torres-Arias, S., Afzali, H., Kuppusamy, T. K., Curtmola, R., & Cappos, J. (2019) · USENIX Security Symposium · Cited by 37 · see citing works
Modeling DevOps Deployment Choices Using Process Architecture Design Dimensions
Babar, Z., Lapouchnian, A., & Yu, E. (2015) · Lecture notes in business information processing · doi:10.1007/978-3-319-25897-3_21 · Cited by 35 · see citing works
Mäkinen, S., Leppänen, M., Kilamo, T., Mattila, A.-L., Laukkanen, E., Pagels, M., & Männistö, T. (2016) · Information and Software Technology · doi:10.1016/j.infsof.2016.09.001 · Cited by 34 · see citing works
Model-Driven Development and Operation of Multi-Cloud Applications
Nitto, E. D., Matthews, P., Petcu, D., & Solberg, A. (2016) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-319-46031-4 · Cited by 34 · see citing works
DevOpRET: Continuous reliability testing in DevOps
Bertolino, A., Angelis, G. D., Guerriero, A., Miranda, B., Pietrantuono, R., & Russo, S. (2020) · Journal of Software Evolution and Process · doi:10.1002/smr.2298 · Cited by 32 · see citing works
Testing robot controllers using constraint programming and continuous integration
Mossige, M., Arnaud Gotlieb, B., & Meling, H. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.09.009 · Cited by 32 · see citing works
Continuously Managing NFRs: Opportunities and Challenges in Practice
Werner, C., Li, Z. S., Lowlind, D., Elazhary, O., Ernst, N., & Damian, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3066330 · Cited by 31 · see citing works
Towards privacy compliance: A design science study in a small organization
Li, Z. S., Werner, C., Ernst, N., & Damian, D. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2022.106868 · Cited by 30 · see citing works
Unraveling quantum computing system architectures: An extensive survey of cutting-edge paradigms
Zhao, X., Xu, X., Qi, L., Xia, X., Bilal, M., Gong, W., & Kou, H. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107380 · Cited by 29 · see citing works
Mining Questions Asked about Continuous Software Engineering
Zahedi, M., Rajapakse, R. N., & Babar, M. A. (2020) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3383219.3383224 · Cited by 29 · see citing works
Towards cost-benefit evaluation for continuous software engineering activities
Klotins, E., Gorschek, T., Sundelin, K., & Falk, E. A. (2022) · Empirical Software Engineering · doi:10.1007/s10664-022-10191-w · Cited by 29 · see citing works
Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?
Makinen, S., Skogstrom, H., Laaksonen, E., & Mikkonen, T. (2021) · 2021 IEEE/ACM 1st Workshop on AI Engineering - Software Engineering for AI (WAIN) · doi:10.1109/wain52551.2021.00024 · Cited by 28 · see citing works
Pahl, C., Jamshidi, P., & Weyns, D. (2017) · Journal of Software Evolution and Process · doi:10.1002/smr.1849 · Cited by 28 · see citing works
IT Governance Mechanisms for DevOps Teams - How Incumbent Companies Achieve Competitive Advantages
Wiedemann, A. (2018) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2018.617 · Cited by 26 · see citing works
The modular and feature toggle architectures of Google Chrome
Rahman, M. T., Rigby, P. C., & Shihab, E. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9639-0 · Cited by 25 · see citing works
The sustainability assessment framework toolkit: a decade of modeling experience
Lago, P., Condorí-Fernández, N., Fatima, I., Funke, M., & Malavolta, I. (2024) · Software & Systems Modeling · doi:10.1007/s10270-024-01230-9 · Cited by 28 · see citing works
DevOps Project Management Tools for Sprint Planning, Estimation and Execution Maturity
Angara, J., Prasad, S., & Gutta, S. (2020) · Cybernetics and Information Technologies · doi:10.2478/cait-2020-0018 · Cited by 24 · see citing works
Agile Processes in Software Engineering and Extreme Programming
Stettina, C. J., Garbajosa, J., & Kruchten, P. (2023) · Lecture notes in business information processing · doi:10.1007/978-3-031-33976-9 · Cited by 24 · see citing works
Aligning security objectives with agile software development
Rindell, K., Hyrynsalmi, S., & Leppänen, V. (2018) · International Conference on Agile Software Development · doi:10.1145/3234152.3234187 · Cited by 23 · see citing works
Towards Continuous Software Reliability Testing in DevOps
Pietrantuono, R., Bertolino, A., Angelis, G. D., Miranda, B., & Russo, S. (2019) · doi:10.1109/ast.2019.00009 · Cited by 22 · see citing works
Advancing Software Security and Reliability in Cloud Platforms through AI-based Anomaly Detection
Saleh, S. M., Sayem, I. M., Madhavji, N. H., & Steinbacher, J. (2024) · Cloud Computing Security Workshop · doi:10.1145/3689938.3694779 · Cited by 21 · see citing works
ID3P: Iterative Data-Driven Development of Persona Based on Quantitative Evaluation and Revision
Watanabe, Y., Washizaki, H., Honda, K., Noyori, Y., Fukazawa, Y., Morizuki, A., Shibata, H., Ogawa, K., Ishigaki, M., Shiizaki, S., et al. (2017) · International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) · doi:10.1109/chase.2017.9 · Cited by 21 · see citing works
A mixed method study of DevOps challenges
Tanzil, M., Sarker, M., Uddin, G., & Iqbal, A. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107244 · Cited by 23 · see citing works
A Systematic Literature Review on DevOps Capabilities and Areas
Teixeira, D., Pereira, R., Henriques, T. A., da Silva, M. M., & Faustino, J. (2020) · International Journal of Human Capital and Information Technology Professionals · doi:10.4018/ijhcitp.2020040101 · Cited by 22 · see citing works
How have views on Software Quality differed over time? Research and practice viewpoints
Ndukwe, I. G., Licorish, S. A., Tahir, A., & MacDonell, S. G. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111524 · Cited by 20 · see citing works
Implementation of a DevOps Pipeline for Serverless Applications
Ivanov, V., & Smolander, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03673-7_4 · Cited by 20 · see citing works
Ambidexterity in Agile software development: a conceptual paper
Lindskog, C., & Magnusson, M. (2021) · Journal of Organizational Effectiveness People and Performance · doi:10.1108/joepp-07-2019-0068 · Cited by 19 · see citing works
Aguayo, O., & Sepúlveda, S. (2022) · Applied Sciences · doi:10.3390/app122010240 · Cited by 19 · see citing works
Automated testing in the continuous delivery pipeline: A case study of an online company
Gmeiner, J., Ramler, R., & Haslinger, J. (2015) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw.2015.7107423 · Cited by 19 · see citing works
An Overview of Software Functionality Service: A Systematic Literature Review
Salleh, M. A., Bahari, M., & Zakaria, N. H. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.12.163 · Cited by 19 · see citing works
Security Challenges Review in Agile and DevOps Practices
Afaneh, S., Al-Mousa, M. R., Al-hamid, H. S., AL-Awasa, B. S., Alia, M. A., Almimi, H., & Alkhatib, A. A. (2023) · doi:10.1109/icit58056.2023.10226018 · Cited by 18 · see citing works
Continuous Integration and Visual GUI Testing: Benefits and Drawbacks in Industrial Practice
Alégroth, E., Karlsson, A., & Radway, A. (2018) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2018.00026 · Cited by 18 · see citing works
Sustaining Agile Beyond Adoption
Barroca, L., Gregory, P., Kuusinen, K., Sharp, H., & AlQaisi, R. (2018) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2018.00013 · Cited by 17 · see citing works
On the effects of continuous delivery on code quality: A case study in industry
Rubert, M., & Farias, K. (2021) · Computer Standards & Interfaces · doi:10.1016/j.csi.2021.103588 · Cited by 17 · see citing works
A Systematic Literature Review on DevOps Capabilities and Areas
Teixeira, D., Pereira, R., Henriques, T. A., da Silva, M. M., & Faustino, J. (2020) · International Journal of Human Capital and Information Technology Professionals · doi:10.4018/ijhcitp.2020070101 · Cited by 16 · see citing works
Forbrig, P. (2016) · International Conference on Subject-Oriented Business Process Management (S-BPM ONE) · doi:10.1145/2882879.2882895 · Cited by 16 · see citing works
A Multivocal Literature Review on the use of DevOps for e-Learning systems
Sánchez‐Gordón, M., & Colomo‐Palacios, R. (2018) · Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'21) · doi:10.1145/3284179.3284328 · Cited by 16 · see citing works
Benjamin, J., & Mathew, J. (2024) · Computing · doi:10.1007/s00607-024-01370-2 · Cited by 15 · see citing works
Variability middleware for multi-tenant SaaS applications
Landuyt, D. V., Walraven, S., & Joosen, W. (2015) · International Software Product Line Conference (SPLC) · doi:10.1145/2791060.2791080 · Cited by 15 · see citing works
Horn, N., Gampfer, F., & Buchkremer, R. (2021) · AI · doi:10.3390/ai2020011 · Cited by 15 · see citing works
Success Factors when Transitioning to Continuous Deployment in Software-Intensive Embedded Systems
Dakkak, A., Mattos, D. I., & Bosch, J. (2021) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa53835.2021.00025 · Cited by 15 · see citing works
Hitting the Target: Practices for Moving Toward Innovation Experiment Systems
Karvonen, T., Lwakatare, L. E., Sauvola, T., Bosch, J., Olsson, H. H., Kuvaja, P., & Oivo, M. (2015) · Lecture notes in business information processing · doi:10.1007/978-3-319-19593-3_10 · Cited by 14 · see citing works
A Review of Architectural Principles and Patterns for Distributed Mobile Information Systems
Pahl, C., Fronza, I., Ioini, N. E., & Barzegar, H. R. (2019) · International Conference on Web Information Systems and Technologies · doi:10.5220/0008555900002366 · Cited by 14 · see citing works
Continuous deployment in software-intensive system-of-systems
Dakkak, A., Bosch, J., Olsson, H. H., & Mattos, D. I. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107200 · Cited by 14 · see citing works
User stories to user reality: A DevOps approach for the cloud
Rahul, P., & Bajaj, R. (2016) · IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology · doi:10.1109/rteict.2016.7807905 · Cited by 14 · see citing works
A comparison of security assurance support of agile software development methods
Rindell, K., Hyrynsalmi, S., & Leppänen, V. (2015) · International Conference on Computer Systems and Technologies (CompSysTech) · doi:10.1145/2812428.2812431 · Cited by 14 · see citing works
Software Testing in the DevOps Context: A Systematic Mapping Study
Pando, B., & Dávila, A. (2022) · Programming and Computer Software · doi:10.1134/s0361768822080175 · Cited by 14 · see citing works
Implementing the Planning Process within DevOps Teams to Achieve Continuous Innovation
Wiedemann, A., Wiesche, M., Gewald, H., & Krcmar, H. (2019) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2019.841 · Cited by 13 · see citing works
Integrating security controls in DevSecOps: Challenges, solutions, and future research directions
Sinan, M., Shahin, M., & Gondal, I. (2025) · Journal of Software: Evolution and Process · doi:10.1002/smr.70029 · Cited by 13 · see citing works
Fuentes‐Quijada, G., Ruíz, F., & Caro, L. (2024) · Information Systems Frontiers · doi:10.1007/s10796-024-10473-2 · Cited by 12 · see citing works
Farshidi, S., Rezaee, K., Mazaheri, S., Rahimi, A. H., Dadashzadeh, A., Ziabakhsh, M., Eskandari, S., & Jansen, S. (2024) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-024-09398-x · Cited by 14 · see citing works
Security for Devops Deployment Processes: Defenses, Risks, Research Directions
Wilde, N., Eddy, B. P., Patel, K. N., Cooper, N., Gamboa, V. S., Mishra, B., & Shah, K. M. (2016) · International Journal of Software Engineering & Applications · doi:10.5121/ijsea.2016.7601 · Cited by 12 · see citing works
Bhanushali, A. (2023) · International Journal of Science and Research (IJSR) · doi:10.21275/sr231021114758 · Cited by 11 · see citing works
Teaching Agile Development with DevOps in a Software Engineering and Database Technologies Practicum
Mason, R. T., Masters, W. A., & Stark, A. (2017) · International Conference on Higher Education Advances (HEAd) · doi:10.4995/head17.2017.5607 · Cited by 11 · see citing works
Defining metrics for continuous delivery and deployment pipeline.
Lehtonen, T., Suonsyrjä, S., Kilamo, T., & Mikkonen, T. (2015) · Cited by 11 · see citing works
BizDevOps and the Role of S-BPM
Forbrig, P. (2018) · International Conference on Subject-Oriented Business Process Management (S-BPM ONE) · doi:10.1145/3178248.3178250 · Cited by 11 · see citing works
GDPR Compliance in the Context of Continuous IntegrationPreprint
Li, Z. S., Werner, C., Ernst, N., & Damian, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.06830 · Cited by 11 · see citing works
Skalka, J., & Drlík, M. (2023) · IEEE Access · doi:10.1109/access.2023.3317694 · Cited by 10 · see citing works
DevOps Meets Dynamic Orchestration
Bahadori, K., & Vardanega, T. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-06019-0_11 · Cited by 10 · see citing works
Best Practices Evidenced for Software Development Based on DevOps and Scrum: A Literature Review
Pardo, M. A. P., Ordóñez, H., Cobos, C., & Muñoz, M. (2025) · Applied Sciences · doi:10.3390/app15105421 · Cited by 9 · see citing works
Continuous software security through security prioritisation meetings
Tøndel, I. A., & Cruzes, D. S. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111477 · Cited by 9 · see citing works
SmAuto: A domain-specific-language for application development in smart environments
Panayiotou, K., Doumanidis, C., Tsardoulias, E., & Symeonidis, A. L. (2024) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2024.101931 · Cited by 9 · see citing works
Enhanced playback of automated service emulation models using entropy analysis
Versteeg, S., Du, M., Bird, J. J., Schneider, J.-G., Grundy, J., & Han, J. (2016) · doi:10.1145/2896941.2896950 · Cited by 9 · see citing works
Johng, H., Kalia, A. K., Xiao, J., Vuković, M., & Chung, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33702-5_12 · Cited by 9 · see citing works
Towards Understanding How Agile Teams Predict User Experience
Kuusinen, K., Väätäjä, H., Mikkonen, T., & Väänänen, K. (2016) · Human-computer interaction series · doi:10.1007/978-3-319-32165-3_7 · Cited by 9 · see citing works
MLOps-Enabled Security Strategies for Next-Generation Operational Technologies
Ahmad, T., Adnan, M., Rafi, S., Akbar, M. A., & Anwar, A. (2024) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3661167.3661283 · Cited by 8 · see citing works
Parra, P., da Silva, A., Polo, Ó. R., & Sánchez, S. (2017) · Acta Astronautica · doi:10.1016/j.actaastro.2017.11.037 · Cited by 8 · see citing works
The software engineering initiative of DLR
Haupt, C., Schlauch, T., & Meinel, M. (2018) · doi:10.1145/3194747.3194753 · Cited by 8 · see citing works
Continuous Security through Integration Testing in an Electronic Health Records System
Purkayastha, S., Goyal, S., Phillips, T., Wu, H., Haakenson, B., & Zou, X. (2020) · International Conference on Software Security and Assurance (ICSSA) · doi:10.1109/icssa51305.2020.00012 · Cited by 8 · see citing works
Towards AIOps enabled services in continuously evolving software‐intensive embedded systems
Dakkak, A., Bosch, J., & Olsson, H. H. (2023) · Journal of Software Evolution and Process · doi:10.1002/smr.2592 · Cited by 9 · see citing works
Towards Automated Continuous Security Compliance
Angermeir, F., Fischbach, J., Moyón, F., & Méndez, D. (2024) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/3674805.3690748 · Cited by 7 · see citing works
Requirements Specification as Executable Software Design - A Behavior Perspective.
Fleischmann, A., Schmidt, W., & Stary, C. (2015) · REFSQ Workshops · Cited by 7 · see citing works
- Authors
- Fitzgerald, B., & Stol, K.-J.
- Affiliations
- University of Limerick (IE)
- Venue
- Proceedings of the 1st International Workshop on Rapid Continuous Software Engineering
- Publisher
- ACM
- Published
- 2014-06-03
- Pages
- 1-9
- OpenAlex
- W2128412750
- Cited by
- 212
- References
- 64
- Citations by year
- 2026: 5 · 2025: 19 · 2024: 13 · 2023: 23 · 2022: 15 · 2021: 19 · 2020: 16 · 2019: 19 · 2018: 23 · 2017: 15 · 2016: 21 · 2015: 20 · 2014: 4
- FWCI
- 17.06
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- Arrow@dit (Dublin Institute of Technology) (acceptedVersion)
- University of Limerick Institutional Repository (University of Limerick) (acceptedVersion, cc-by-nc-sa)
- University of Limerick Institutional Repository (University of Limerick) (submittedVersion, cc-by-nc-sa)
- University of Limerick Institutional Repository (University of Limerick)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Software Engineering Methodologies
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- continuous software engineering, continuous integration, DevOps, continuous delivery, continuous deployment, continuous testing, continuous verification, continuous compliance, continuous improvement, continuous innovation, agile software development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
