The DOI matches its Crossref record; 60 of the 64 references it cites were found in a registry or an index.
Continuous software engineering and beyond: trends and challenges
Open accessAbstract
Throughout its short history, software development has been characterized by harmful disconnects between important activities e.g., planning, development and implementation. The problem is further exacerbated by the episodic and infrequent performance of activities such as planning, testing, integration and releases. Several emerging phenomena reflect attempts to address these problems. For example, the Enterprise Agile concept has emerged as a recognition that the benefits of agile software development will be sub- optimal if not complemented by an agile approach in related organizational function such as finance and HR. Continuous integration is a practice which has emerged to eliminate discontinuities between development and deployment. In a similar vein, the recent emphasis on DevOps recognizes that the integration between software development and its operational deployment needs to be a continuous one. We argue a similar continuity is required between business strategy and development, BizDev being the term we coin for this. These disconnects are even more problematic given the need for reliability and resilience in the complex and data-intensive systems being developed today. Drawing on the lean concept of flow, we identify a number of continuous activities which are important for software development in today’s context. These activities include continuous planning, continuous integration, continuous deployment, continuous delivery, continuous verification, continuous testing, continuous compliance,continuous security, continuous use, continuous trust, continuous run-time monitoring, continuous improvement (both process and product), all underpinned by continuous innovation. We use the umbrella term, ``Continuous *'' (continuous star) to identify this family of continuous activities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Through approaches such as DevOps the speed at which Software Development is released has increased [7] increasing the pressure for the inclusion of security and compliance requirements [2].”
From DevSecOps practices and tools (2025) · cites this paper as [2]
Citations
Cites
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035
User Acceptance of Computer Technology: A Comparison of Two Theoretical Models
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989) · Management Science · doi:10.1287/mnsc.35.8.982 · Cited by 25,709
(2003) · Cited by 9,368
Understanding Information Systems Continuance: An Expectation-Confirmation Model1
Bhattacherjee, A. (2001) · MIS Quarterly · doi:10.2307/3250921 · Cited by 8,767
Trust and TAM in Online Shopping: An Integrated Model1
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · MIS Quarterly · doi:10.2307/30036519 · Cited by 8,635
Extreme Programming Explained: Embrace Change
Beck, K. L., & Andres, C. (2000) · Cited by 5,855
Refactoring: Improving the Design of Existing Code
Fowler, M. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45672-4_31 · Cited by 5,615
Toyota production system: beyond large-scale production
Ohno, T., & Rosen, C. B. (1998) · CERN Document Server (European Organization for Nuclear Research) · Cited by 4,544
(2011) · Cited by 3,330
Open Innovation: The New Imperative for Creating and Profiting from Technology
(2004) · European Journal of Innovation Management · doi:10.1108/14601060410565074 · Cited by 2,875
Pavlou, P. A., & Fygenson, M. (2006) · MIS Quarterly · doi:10.2307/25148720 · Cited by 2,685
Lean Thinking—Banish Waste and Create Wealth in your Corporation
Womack, J. P., & Jones, D. T. (1997) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2600967 · Cited by 2,122
Lean Thinking-Banish Waste and Create Wealth in Your Corporation.
Rand, G. K., Womack, J. P., & Jones, D. T. (1997) · Journal of the Operational Research Society · doi:10.2307/3010314 · Cited by 1,842
Managing the Development of Large Software Systems (1970)
Royce, W. W. (2021) · The MIT Press eBooks · doi:10.7551/mitpress/12274.003.0035 · Cited by 1,790
Managing the development of large software systems: concepts and techniques
Royce, W. W. (1987) · International Conference on Software Engineering · doi:10.5555/41765.41801 · Cited by 1,175
Liker, J. Κ. (2003) · Cited by 1,134
An empirical examination of continuance intention of mobile payment services
Zhou, T. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.10.034 · Cited by 1,013
Get ready for agile methods, with care
BOEHM, B. W. (2002) · Computer · doi:10.1109/2.976920 · Cited by 912
Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation
Humble, J., & Farley, D. R. (2010) · Cited by 911
Perspectives on Free and Open Source Software
(2005) · The MIT Press eBooks · doi:10.7551/mitpress/5326.001.0001 · Cited by 662
The Toyota Product Development System: Integrating People, Process, and Technology
Morgan, J. M., & Liker, J. Κ. (2006) · Cited by 588
de Guinea, A. O., & Markus, M. L. (2009) · Journal of the Association for Information Systems · doi:10.5555/2481626.2481629 · Cited by 460
Managing Strategic Innovation and Change
Sastry, M. A., Tushman, M. L., & Anderson, P. C. (2012) · Cited by 432
Customising agile methods to software practices at Intel Shannon
Fitzgerald, B. F., Hartnett, G., & Conboy, K. (2006) · European Journal of Information Systems · doi:10.1057/palgrave.ejis.3000605 · Cited by 403
Self-citationThe Toyota Product Development System
Morgan, J., & Liker, J. Κ. (2018) · Productivity Press eBooks · doi:10.4324/9781482293746 · Cited by 385
Research Commentary—Digital Natives and Ubiquitous Information Systems
Vodanovich, S., Sundaram, D., & Myers, M. D. (2010) · Information Systems Research · doi:10.1287/isre.1100.0324 · Cited by 382
Scaling Software Agility: Best Practices for Large Enterprises
Leffingwell, D., & Kruchten, P. B. (2007) · Cited by 275
Olsson, H. H., Alahyari, H., & Bosch, J. (2012) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2012.54 · Cited by 244
Toward a conceptual framework of agile methods
Conboy, K., & Fitzgerald, B. F. (2004) · doi:10.1145/1029997.1030005 · Cited by 230
Self-citationModeling continuous integration practice differences in industry software development
Ståhl, D., & Bosch, J. (2013) · Journal of Systems and Software · doi:10.1016/j.jss.2013.08.032 · Cited by 214
Test Case Prioritization for Continuous Regression Testing: An Industrial Case Study
Marijan, D., Gotlieb, A., & Sen, S. (2013) · Proceedings/Proceedings - Conference on Software Maintenance · doi:10.1109/icsm.2013.91 · Cited by 155
Reducing wasted development time via continuous testing
Saff, D., & Ernst, M. D. (2005) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2003.1251050 · Cited by 146
Implementing Beyond Budgeting: Unlocking the Performance Potential
Bogsnes, B. (2008) · Cited by 134
Enabling Agile Testing through Continuous Integration
Stolberg, S. (2009) · Agile Conference · doi:10.1109/agile.2009.16 · Cited by 130
Continuous Delivery? Easy! Just Change Everything (Well, Maybe It Is Not That Easy)
Neely, S., & Stolt, S. (2013) · 2013 Agile Conference · doi:10.1109/agile.2013.17 · Cited by 124
Scaling agile methods to regulated environments: an industry case study
Fitzgerald, B. F., Stol, K.-J., O'Sullivan, R., & O’Brien, D. (2013) · University of Limerick Institutional Repository (University of Limerick) · doi:10.5555/2486788.2486906 · Cited by 124
Self-citationThe disappearing boundary between development-time and run-time
Baresi, L., & Ghezzi, C. (2010) · doi:10.1145/1882362.1882367 · Cited by 112
CPEF: A Continuous Planning and Execution Framework
Myers, K. L. (1999) · AI Magazine · doi:10.1609/aimag.v20i4.1480 · Cited by 109
From Continuous Improvement to Continuous Innovation
Cole, R. E. (2001) · Quality Management Journal · doi:10.1080/10686967.2001.11918977 · Cited by 103
Product Release Planning: Methods, Tools and Applications
Ruhe, G. (2010) · Thammasat University Digital Collections · Cited by 96
Casper: space exploration through continuous planning
Knight, S., Rabideau, G., Chien, S., Engelhardt, B. E., & Sherwood, R. (2001) · IEEE Intelligent Systems · doi:10.1109/5254.956084 · Cited by 95
Continuous Monitoring of Software Services: Design and Application of the Kieker Framework
van Hoorn, A., Röhr, M., Hasselbring, W., Waller, J., Ehlers, J., Frey, S., & Kieselhorst, D. (2009) · MACAU: Open Access Repository of Kiel University (University Library Kiel) · Cited by 77
The Role of Continuous Trust in Information Systems Continuance
Hoehle, H., Huff, S. L., & Goode, S. (2012) · Journal of Computer Information Systems · doi:10.1080/08874417.2012.11645571 · Cited by 75
Scaling Continuous Integration
Rogers, R. O. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24853-8_8 · Cited by 66
Ebert, C., Abrahamsson, P., & Oza, N. V. (2012) · IEEE Software · doi:10.1109/ms.2012.116 · Cited by 60
Automated Continuous Integration of Component-Based Software: An Industrial Experience
Kim, S., Park, S., Yun, J., & Lee, Y. (2008) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2008.64 · Cited by 43
A Framework for Enterprise Agility and the Enabling Role of Digital Options
Overby, E. M., Bharadwaj, A. S., & Sambamurthy, V. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-387-25590-7_19 · Cited by 40
11th International Conference on Software Engineering
(1989) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.1989.714386 · Cited by 40
Data debugging with continuous testing
Muşlu, K., Brun, Y., & Meliou, A. (2013) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2491411.2494580 · Cited by 36
Understanding and predicting electronic commerce adoption
PavlouPaul, A., & FygensonMendel (2006) · MIS Quarterly · doi:10.5555/2017284.2017292 · Cited by 31
Lehtola, L., Kauppinen, M., Vähäniitty, J., & Komssi, M. (2009) · Requirements Engineering · doi:10.1007/s00766-009-0078-8 · Cited by 29
Evidence-based decision making in lean software project management
Fitzgerald, B. F., Musiał, M., & Stol, K.-J. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2591062.2591190 · Cited by 21
Self-citationJärvinen, J., Hamann, D., & van Solingen, R. (1999) · IEEE International Software Metrics Symposium (METRICS) · doi:10.1109/metric.1999.809722 · Cited by 13
"Continuous verification" in mission critical software development
Chang, T.-F., Danylyzsn, A., Norimatsu, S., Rivera, J. C. R., Shepard, D., Lattanze, A. J., & Tomayko, J. E. (2002) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.1997.663184 · Cited by 10
Applying Continuous Code Reviews in Airport Operations Software
Bernhart, M., Strobl, S., Mauczka, A., & Grechenig, T. (2012) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2012.61 · Cited by 10
Continuous Verification of Large Embedded Software Using SMT-Based Bounded Model Checking
Cordeiro, L. C., Fischer, B., & Marques-Silva, J. P. (2010) · IEEE International Conference and Workshops on Engineering of Computer-Based Systems (ECBS) · doi:10.1109/ecbs.2010.24 · Cited by 10
Extreme Programming and Agile Processes in Software Engineering
Kölling, M., & Patterson, A. (2004) · Lecture notes in computer science · doi:10.1007/b98150 · Cited by 8
The ASPIRE approach to continuous software process improvement
Krasner, H. (2003) · International Conference on Systems Integration (ICSI) · doi:10.1109/icsi.1992.217302 · Cited by 6
Continuous SPA: Continuous Assessing and Monitoring Software Process
Chen, X., Sorenson, P. G., & Willson, J. (2007) · doi:10.1109/services.2007.25 · Cited by 5
(2010) · Auerbach Publications eBooks · doi:10.1201/ebk0849326202-p2 · Cited by 3
Research works printed but not linked: 15
- S. Ambler . When does(n’t) agile modeling make sense , 2001 . www.agilemodeling.com/essays/whenDoesAMWork.htm. S. Ambler. When does(n’t) agile modeling make sense, 2001. www.agilemodeling.com/essays/whenDoesAMWork.htm.
- CA Technologies . The innovation imperative: Why it needs to lead now , 2012 . www.ca.com/us/ /media/Files/Presentations/theinnovation-imperative-external-presentation-final.pdf. CA Technologies. The innovation imperative: Why it needs to lead now, 2012. www.ca.com/us/ /media/Files/Presentations/theinnovation-imperative-external-presentation-final.pdf.
- 10.5555/938437.938796 · DOI
- P. Debois . Devops days ghent , 2009 . http://www.devopsdays.org/events/2009-ghent/. P. Debois. Devops days ghent, 2009. http://www.devopsdays.org/events/2009-ghent/.
- T. Fitz . Continuous deployment at IMVU: Doing the impossible fifty times a day , 2009 . http://timothyfitz.com/2009/02/10/continuousdeployment-atimvu-doing-the-impossible-fifty-times-aday/. T. Fitz. Continuous deployment at IMVU: Doing the impossible fifty times a day, 2009. http://timothyfitz.com/2009/02/10/continuousdeployment-atimvu-doing-the-impossible-fifty-times-aday/.
- L. Gebauer , M. Sollner , and J. Leimeister . Towards understanding the formation of continuous it use . In 34th Int’l Conf. Information Systems , 2013 . L. Gebauer, M. Sollner, and J. Leimeister. Towards understanding the formation of continuous it use. In 34th Int’l Conf. Information Systems, 2013.
- J. Humble . Continuous delivery vs continuous deployment , 2010 . http://continuousdelivery.com/2010/08/continuousdelivery-vs-continuous-deployment/. J. Humble. Continuous delivery vs continuous deployment, 2010. http://continuousdelivery.com/2010/08/continuousdelivery-vs-continuous-deployment/.
- 10.5555/520792.823969 · DOI
- J. Krafcik . Triumph of the lean production system . 1988 . J. Krafcik. Triumph of the lean production system. 1988.
- F. Lacoste . Killing the gatekeeper . In Agile Conf. , 2009 . F. Lacoste. Killing the gatekeeper. In Agile Conf., 2009.
- M. McHugh , F. Mc Caffery , B. Fitzgerald , K. Stol , V. Casey , and G. Coady . Balancing agility and discipline in a medical device software organization . In 13th International SPICE Conference , 2013 . M. McHugh, F. Mc Caffery, B. Fitzgerald, K. Stol, V. Casey, and G. Coady. Balancing agility and discipline in a medical device software organization. In 13th International SPICE Conference, 2013.
- M. Merkow and L. Raghavan . An ecosystem for continuously secure application software. CrossTalk , March/April , 2011 . M. Merkow and L. Raghavan. An ecosystem for continuously secure application software. CrossTalk, March/April, 2011.
- D. G. Reinertsen . The Principles of Product Development Flow . Celeritas Publishing , 2009 . D. G. Reinertsen. The Principles of Product Development Flow. Celeritas Publishing, 2009.
- 10.5555/951952.952340 · DOI
- VersionOne. 7th annual state of agile survey: The state of agile development , 2012 . VersionOne. 7th annual state of agile survey: The state of agile development, 2012.
Cited by
Sorted by citations
Continuous software engineering: A roadmap and agenda
Fitzgerald, B. F., & Stol, K.-J. (2015) · Journal of Systems and Software · doi:10.1016/j.jss.2015.06.063 · Cited by 742
Self-citationMicroservices: A Systematic Mapping Study
Pahl, C., & Jamshidi, P. (2016) · International Conference on Cloud Computing and Services Science · doi:10.5220/0005785500001259 · Cited by 315
Continuous deployment of software intensive products and services: A systematic mapping study
Rodríguez, P., Haghighatkhah, A., Lwakatare, L. E., Teppola, S., Suomalainen, T., Eskeli, J., Karvonen, T., Kuvaja, P., Verner, J. M., & Oivo, M. (2016) · Journal of Systems and Software · doi:10.1016/j.jss.2015.12.015 · Cited by 240
What is DevOps?: A Systematic Mapping Study on Definitions and Practices
Jabbari, R., bin Ali, N., Petersen, K., & Tanveer, B. (2016) · Proceedings of the Scientific Workshop Proceedings of XP2016 · doi:10.1145/2962695.2962707 · Cited by 230
Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?Preprint
Mäkinen, S., Skogström, H., Laaksonen, E., & Mikkonen, T. (2021) · arXiv (Cornell University) · Cited by 169
Metadata
- Authors
- Fitzgerald, B., & Stol, K.-J.
- Affiliations
- University of Limerick (IE)
- Venue
- Proceedings of the 1st International Workshop on Rapid Continuous Software Engineering
- Publisher
- ACM
- Published
- 2014-06-03
- Pages
- 1-9
- OpenAlex
- W2128412750
- Cited by
- 212
- References
- 64
- Citations by year
- 2026: 5 · 2025: 19 · 2024: 13 · 2023: 23 · 2022: 15 · 2021: 19 · 2020: 16 · 2019: 19 · 2018: 23 · 2017: 15 · 2016: 21 · 2015: 20 · 2014: 4
- FWCI
- 17.06
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- Arrow@dit (Dublin Institute of Technology) (acceptedVersion)
- University of Limerick Institutional Repository (University of Limerick) (acceptedVersion, cc-by-nc-sa)
- University of Limerick Institutional Repository (University of Limerick) (submittedVersion, cc-by-nc-sa)
- University of Limerick Institutional Repository (University of Limerick)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- continuous software engineering, continuous integration, DevOps, continuous delivery, continuous deployment, continuous testing, continuous verification, continuous compliance, continuous improvement, continuous innovation, agile software development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
