Challenges and Solutions in Implementing Continuous Integration and Continuous Testing for Agile Quality Assurance
Open accessThe DOI matches its Crossref record; 83 of the 94 references it cites were found in a registry or an index; 7 of the 99 sources its claims cite were checked for support.
Abstract
As software development undergoes a transformation, it necessitates a corresponding adaptation on the part of quality specialists. The fundamental feature of agile approach is quality, which is assessed by both developers and customers in order to enhance the system's overall quality. This approach has the potential to enhance the quality of output, but at the expense of less involvement from the quality assurance team. The Agile methodology places emphasis on expediting the software development process while also reducing costs. Additionally, within the framework of Agile Quality Assurance (QA) and software development, Continuous Integration (CI) and Continuous Testing are key methodologies. The programmers ensure that changes to the code are regularly applied, examined, and verified throughout the whole development cycle. Within the Agile Quality Assurance (QA) paradigm, continuous integration and continuous testing are important approaches that offer routine code integration, automated testing, and quick feedback. They play a key role in the swift and iterative delivery of software of the highest calibre in Agile development setups. This study's major goal is to address the Problems and Solutions of Putting Continuous Integration and Continuous Testing intoPractise for Agile Quality Assurance.Agile techniques, agile software quality assurance, continuous integration practices of agile software development, difficulties, and solutions for these practises have all been covered in this review article.Additionally, the practises for continuous testing in agile quality assurance, difficulties, and solutions have been studied in the following part.
Overview
CoChat Summary
TL;DR
This review examines challenges and solutions in implementing continuous integration (CI) and continuous testing (CT) for agile quality assurance, with attention to DevOps and agile testing practices. It synthesizes literature on CI/CT, agile QA time horizons, and reported benefits such as reduced development time and improved software quality.
Key findings
- CI and CT are presented as key agile QA practices: CI involves frequent code integration, automated builds/tests, and quick feedback, while CT automates testing to provide continuous feedback and detect defects earlier.
- The paper identifies agile testing challenges and solutions, including testing activities in the agile lifecycle, distributed agile testing, regression testing, and test-case prioritization; proposed solutions include stakeholder engagement, a distributed-environment framework, regression test selection using user-story graphs, and linguistic/risk-based prioritization.
- Reported quantitative claims include: Saff’s estimate that continuous testing removes 92–98% of waste; an experiment showing continuous testing reduced overall development time by around 15%; DevOps use by several European banks yielded a 25% enhancement in online services; and Silva et al. found development–operations interaction lowered operational effort by 50% and DevOps reduced failures by 3%.
- QA coverage varies by time horizon: heartbeat has the most QA practices (e.g., unit testing, continuous integration, pair programming), iteration has fewer, and release-level QA processes are difficult to locate; the paper proposes an independent tester role for the iteration horizon and session-based exploratory testing for the heartbeat horizon.
Methods
- Design: a review article covering agile techniques, agile software quality assurance, CI practices, CT practices, and associated challenges and solutions.
- Data/sample: existing literature and prior studies on agile QA, CI, CT, DevOps, and software testing; no primary empirical sample is reported.
- Main analysis: thematic synthesis and comparison of agile QA practices using Itkonen et al.’s temporal pacing/time-horizon model and the Cycles of Control framework, with tables summarizing QA procedures, quality elements, and challenge–solution mappings.
Limitations
- Stated: the study focuses only on continuous integration and testing methods in agile software development; future work could explore other agile methods such as pair programming and combine affected quality criteria into a single quality framework.
- Stated: there is a lack of comprehensive guidance on integrating destructive and independent testing into agile development, a dearth of research on architecture’s impact on CT/CD in production settings, and a need for empirical evidence on TDD+CT synergy in industrial settings.
- Evident: as a review, it does not provide primary empirical data or a systematic review protocol, and several conclusions rely on secondary literature and reported claims rather than new experiments conducted by the author.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
7 Valid · 16 Not valid · 84 Not checked · 84 Own results and interpretations
In the paper
“As indicated in Table 1, there are much fewer quality assurance practises on the iteration time horizon of agile methodologies than there are on the heartbeat time horizon.”
- Also stated in: § b) Quality Assurance Iteration · plain
“There are far fewer QA procedures in agile methodologies on the iteration time horizon than there are on the heartbeat time horizon.”
What the sources say
- Not matchedcites [34]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § b) Quality Assurance Iteration · plain
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For instance, we were unable to locate any quality assurance procedures among the sample techniques shown in Table 1 that would be appropriate for the release time horizon.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our study demonstrated that using time horizons to describe the development process and the procedures used facilitates the identification of areas where testing processes may be improved.”
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Less defined than those on the heartbeat time horizon are the procedures on the iteration time horizon.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“According to Itkonen et al. (2005) [34], Table 1 shows that it is challenging to locate any quality assurance processes in agile approaches on the release time horizon.”
- Also stated in: § c) Quality Assurance Release · plain
“It is quite difficult to identify any quality assurance processes in agile methodologies on the release time horizon.”
What the sources say
- Not matchedcites [34]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § c) Quality Assurance Release · plain
28 more claims
Create a free account to see all 191 claims and every source verdict.
- Probably not a substantial claim. 148
- It may state two separate claims as one. 48
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ 9. Conclusion
“For the iteration time horizon, an independent tester position has been proposed, and for the heartbeat time horizon, session-based exploratory testing is being examined.”
§ 4.3 Agile Testing Improvements for QA
“There is potential for improvement in the quality assurance (QA) methods related to heartbeat. One such enhancement is the incorporation of an independent tester who collaborates with the developer to test each completed feature.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 9. Conclusion
“for the heartbeat time horizon, session-based exploratory testing is being examined.”
§ 4.3 Agile Testing Improvements for QA
“Sessionbased exploratory testing is an example of agile testing that takes place within an iteration time horizon [47].”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ International Journal of Science and Research (IJSR)
“Table 3: Quality before to and after using continuous integration”
§ 8.2 Solution
“Table 3: Challenges' Solution”
Citations
Cites
Manifesto for agile software development
Beck, K., Beedle, M., van Bennekum, A., Cockburn, A., Cunningham, W., Fowler, M., & Thomas, D. A. (2001) · Cited by 4,284
Guide to Advanced Empirical Software Engineering
(2008) · Springer eBooks · doi:10.1007/978-1-84800-044-5 · Cited by 1,003
Embracing change with extreme programming
Beck, K. (1999) · Computer · doi:10.1109/2.796139 · Cited by 979
Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation
Humble, J., & Farley, D. R. (2010) · Cited by 911
Garousi, V., Felderer, M., & Mäntylä, M. V. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2018.09.006 · Cited by 831
A Practical Guide to Feature-Driven Development
Palmer, S. R., & Felsing, M. (2002) · Medical Entomology and Zoology · Cited by 652
Devops: A Software Architect's Perspective
Bass, L., Weber, I. M., & Zhu, L. (2015) · CERN Document Server (European Organization for Nuclear Research) · Cited by 561
Continuous Integration: Improving Software Quality and Reducing Risk
Duvall, P., Matyas, S., & Glover, A. (2007) · Cited by 510
A Survey of DevOps Concepts and Challenges
Leite, L., Rocha, C., Kon, F., Milojicic, D., & Meirelles, P. (2020) · ACM Computing Surveys · doi:10.1145/3359981 · Cited by 484
Jeffries, R., Anderson, A., & Hendrickson, C. (2000) · CERN Document Server (European Organization for Nuclear Research) · Cited by 426
Using risk to balance agile and plan- driven methods
Boehm, B., & Turner, R. (2003) · Computer · doi:10.1109/mc.2003.1204376 · Cited by 412
Time pacing: competing in markets that won't stand still.
Eisenhardt, K. M., & Brown, S. L. (1998) · PubMed · Cited by 394
Agile Testing: A Practical Guide for Testers and Agile Teams
Crispin, L., & Gregory, J. (2008) · Cited by 342
On the journey to continuous deployment: Technical and social challenges along the way
Claps, G. G., Svensson, R. B., & Aurum, A. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.07.009 · Cited by 235
Continuous software engineering and beyond: trends and challenges
Fitzgerald, B., & Stol, K.-J. (2014) · Proceedings of the 1st International Workshop on Rapid Continuous Software Engineering · doi:10.1145/2593812.2593813 · Cited by 212
DevOps in practice: A multiple case study of five companies
Lwakatare, L. E., Kilamo, T., Karvonen, T., Sauvola, T., Heikkilä, V., Itkonen, J., Kuvaja, P., Mikkonen, T., Oivo, M., & Lassenius, C. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2019.06.010 · Cited by 195
(2003) · Cited by 174
DevOps Capabilities, Practices, and Challenges: Insights from a Case Study
Senapathi, M., Buchan, J., & Osman, H. (2018) · Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018 · doi:10.1145/3210459.3210465 · Cited by 172
Towards Definitions for Release Engineering and DevOps
Dyck, A., Penners, R., & Lichter, H. (2015) · 2015 IEEE/ACM 3rd International Workshop on Release Engineering · doi:10.1109/releng.2015.10 · Cited by 154
Reducing wasted development time via continuous testing
Saff, D., & Ernst, M. D. (2005) · 14th International Symposium on Software Reliability Engineering, 2003. ISSRE 2003. · doi:10.1109/issre.2003.1251050 · Cited by 141
An experimental evaluation of continuous testing during development
Saff, D., & Ernst, M. D. (2004) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/1007512.1007523 · Cited by 140
From Monolithic to Microservices: An Experience Report from the Banking Domain
Bucchiarone, A., Dragoni, N., Dustdar, S., Larsen, S. T., & Mazzara, M. (2018) · IEEE Software · doi:10.1109/ms.2018.2141026 · Cited by 136
Continuous Delivery: Overcoming adoption challenges
Chen, L. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2017.02.013 · Cited by 134
Adopting DevOps practices in quality assurance
Roche, J. (2013) · Communications of the ACM · doi:10.1145/2524713.2524721 · Cited by 133
Understanding DevOps & bridging the gap from continuous integration to continuous delivery
Virmani, M. (2015) · Fifth International Conference on the Innovative Computing Technology (INTECH 2015) · doi:10.1109/intech.2015.7173368 · Cited by 132
Problems, causes and solutions when adopting continuous delivery—A systematic literature review
Laukkanen, E., Itkonen, J., & Lassenius, C. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2016.10.001 · Cited by 131
Continuous Delivery? Easy! Just Change Everything (Well, Maybe It Is Not That Easy)
Neely, S., & Stolt, S. (2013) · 2013 Agile Conference · doi:10.1109/agile.2013.17 · Cited by 124
Scherp, A. (2001) · Cited by 120
The Role of the Tester's Knowledge in Exploratory Software Testing
Itkonen, J., Mäntylä, M., & Lassenius, C. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.55 · Cited by 119
On rapid releases and software testing: a case study and a semi-systematic literature review
Mäntylä, M., Adams, B., Khomh, F., Engström, E., & Petersen, K. (2014) · Empirical Software Engineering · doi:10.1007/s10664-014-9338-4 · Cited by 118
Hackett, G. (1981) · The Personnel and Guidance Journal · doi:10.1002/j.2164-4918.1981.tb00626.x · Cited by 116
A Hundred Days of Continuous Integration
Miller, A. (2008) · Agile 2008 Conference · doi:10.1109/agile.2008.8 · Cited by 112
Towards DevOps in the Embedded Systems Domain: Why is It So Hard?
Lwakatare, L. E., Karvonen, T., Sauvola, T., Kuvaja, P., Olsson, H. H., Bosch, J., & Oivo, M. (2016) · 2016 49th Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2016.671 · Cited by 107
Arachchi, S. A. I. B. S., & Perera, I. (2018) · 2018 Moratuwa Engineering Research Conference (MERCon) · doi:10.1109/mercon.2018.8421965 · Cited by 97
Software Architecture: Past, Present, Future
Hasselbring, W. (2018) · Springer eBooks · doi:10.1007/978-3-319-73897-0_10 · Cited by 87
Software Testing: The State of the Practice
Kassab, M., DeFranco, J. F., & Laplante, P. A. (2017) · IEEE Software · doi:10.1109/ms.2017.3571582 · Cited by 59
Management challenges for DevOps adoption within UK SMEs
Jones, S., Noppen, J., & Lettice, F. (2016) · Proceedings of the 2nd International Workshop on Quality-Aware DevOps · doi:10.1145/2945408.2945410 · Cited by 52
Communication Challenges and Strategies in Distributed DevOps
Diel, E., Marczak, S., & Cruzes, D. S. (2016) · 2016 IEEE 11th International Conference on Global Software Engineering (ICGSE) · doi:10.1109/icgse.2016.28 · Cited by 51
Continuous Architecting with Microservices and DevOps: A Systematic Mapping Study
Taibi, D., Lenarduzzi, V., & Pahl, C. (2019) · Communications in Computer and Information Science · doi:10.1007/978-3-030-29193-8_7 · Cited by 51
Towards Architecting for Continuous Delivery
Chen, L. (2015) · 2015 12th Working IEEE/IFIP Conference on Software Architecture · doi:10.1109/wicsa.2015.23 · Cited by 45
On the Impact of Mixing Responsibilities Between Devs and Ops
Nybom, K., Smeds, J., & Porres, I. (2016) · Lecture notes in business information processing · doi:10.1007/978-3-319-33515-5_11 · Cited by 41
Adoption Issues in DevOps from the Perspective of Continuous Delivery Pipeline
Toh, M. Z., Sahibuddin, S., & Mahrin, M. N. (2019) · Proceedings of the 2019 8th International Conference on Software and Computer Applications · doi:10.1145/3316615.3316619 · Cited by 41
Object oriented software testing: a hierarchical approach
Siegel, S. (1996) · CERN Document Server (European Organization for Nuclear Research) · Cited by 37
Refactoring-aware versioning in Eclipse
Ekman, T., & Asklund, U. (2004) · Electronic Notes in Theoretical Computer Science · doi:10.1016/j.entcs.2004.02.048 · Cited by 37
An Empirical Evaluation of Regression Testing Based on Fix-Cache Recommendations
Engström, E., Runeson, P., & Wikstrand, G. (2010) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2010.40 · Cited by 37
Exploiting devops practices for dependable and secure continuous delivery pipelines
Düllmann, T. F., Paule, C., & van Hoorn, A. (2018) · doi:10.1145/3194760.3194763 · Cited by 35
ARE YOU READY FOR DEVOPS? REQUIRED SKILL SET FOR DEVOPS TEAMS
Wiedemann, A., & Wiesche, M. (2018) · Journal of the Association for Information Systems · Cited by 31
Defining Agile Software Quality Assurance
Mnkandla, E., & Dwolatzky, B. (2006) · International Conference on Software Engineering Advances · doi:10.1109/icsea.2006.261292 · Cited by 31
Mixed Data-Parallel Scheduling for Distributed Continuous Integration
Beaumont, O., Bonichon, N., Courtès, L., et al. (2012) · doi:10.1109/ipdpsw.2012.7 · Cited by 29
Kelly, M. (2012) · Auerbach Publications eBooks · doi:10.1201/b11258-8 · Cited by 29
Understanding DevOps & bridging the gap from continuous integration to continuous delivery
Yarlagadda, R. T. (2018) · Journal of Emerging Technologies and Innovative Research · Cited by 29
A systematic literature review of the improved agile software development
Satria, D., Sensuse, D. I., & Noprisson, H. (2017) · International Conference on Information Technology Systems and Innovation · doi:10.1109/icitsi.2017.8267925 · Cited by 28
More Agile Testing: Learning Journeys for the Whole Team
Gregory, J., & Crispin, L. (2014) · Cited by 22
Bottom-up Adoption of Continuous Delivery in a Stage-Gate Managed Software Organization
Laukkanen, E., Lehtinen, T. O. A., Itkonen, J., Paasivaara, M., & Lassenius, C. (2016) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/2961111.2962608 · Cited by 22
Enabling Reusability in Agile Software Development
Singh, S., & Chana, I. (2012) · International Journal of Computer Applications · doi:10.5120/7834-1132 · Cited by 21
An experimental evaluation of continuous testing during development
Saff, D., & Ernst, M. D. (2004) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/1013886.1007523 · Cited by 20
Managing Quality Assurance Challenges of DevOps through Analytics
Ibrahim, M. M. A., Syed-Mohamad, S. M., & Husin, M. H. (2019) · International Conference on Software and Computer Applications (ICSCA) · doi:10.1145/3316615.3316670 · Cited by 19
Mascheroni, M. A., & Irrazábal, E. (2018) · Computación y Sistemas · doi:10.13053/cys-22-3-2794 · Cited by 18
Modular Architectures Make You Agile in the Long Run
Sturtevant, D. (2017) · IEEE Software · doi:10.1109/ms.2017.4541034 · Cited by 16
Testing in a DevOps Era: Perceptions of Testers in Norwegian Organisations
Cruzes, D. S., Kristin, M., & Marczak, S. D. S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-24305-0_33 · Cited by 16
SQA-Mashup: A mashup framework for continuous integration
Brandtner, M., Giger, E., & Gall, H. C. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.10.004 · Cited by 15
Enabling DevOps Collaboration and Continuous Delivery Using Diverse Application Environments
Wettinger, J., Andrikopoulos, V., & Leymann, F. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-26148-5_23 · Cited by 15
Security Support in Continuous Deployment Pipeline
Ullah, F., Raft, A. J., Shahin, M., Zahedi, M., & Babar, M. A. (2017) · International Conference on Evaluation of Novel Approaches to Software Engineering · doi:10.5220/0006318200570068 · Cited by 15
Changing Scenario of Testing Paradigms using DevOps – A Comparative Study with Classical Models
Mullaguru, S. N. (2015) · Global Journal of Computer Science and Technology · Cited by 15
A regression test selection technique by optimizing user stories in an Agile environment
Arora, A., & Chauhan, N. (2014) · IEEE International Advance Computing Conference · doi:10.1109/iadcc.2014.6779540 · Cited by 14
Generalizing Agile Software Development Life Cycle
Bhalerao, S., Puntambekar, D., & Ingle, M. (2009) · Cited by 13
(2018) · Journal of the Association for Information Systems · Cited by 13
Test Automation Process Improvement in a DevOps Team: Experience Report
Wang, Y., Pyhajarvi, M., & Mantyla, M. V. (2020) · 2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw50294.2020.00057 · Cited by 12
Xu, B. (2009) · International Conference on Management and Service Science (MASS) · doi:10.1109/icmss.2009.5302042 · Cited by 11
The Factors Driving Testing in DevOps Setting- A Systematic Literature Survey
Angara, J., Prasad, S., & Gutta, S. (2017) · Indian Journal of Science and Technology · doi:10.17485/ijst/2016/v9i48/103784 · Cited by 11
Continuous Integration, Deployment and Testing in DevOps Environment
Amaradri, A. S., & Nutalapati, S. B. (2016) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 9
Software Quality and Life Cycles.
Jaakkola, H., & Thalheim, B. (2005) · Cited by 8
A Framework For Software Quality Assurance Using Agile Methodology
Sagheer, M., Zafar, T., & Sirshar, M. (2015) · International journal of scientific and technology research · Cited by 8
Improve Software Quality Through Practicing Devops AutomationPreprint
Mohammad, S. M. (2018) · SSRN Electronic Journal · Cited by 7
Continuous Testing: with Ruby, Rails, and JavaScript
Rady, B., & Coffin, R. B. (2011) · Medical Entomology and Zoology · Cited by 6
An Approach for Regression Test Case Selection Using Object Dependency Graph
Larprattanakul, A., & Suwannasart, T. (2013) · International Conference on Intelligent Networking and Collaborative Systems (INCoS) · doi:10.1109/incos.2013.115 · Cited by 6
Lai, S.-T., & Leu, F. (2016) · International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS) · doi:10.1109/imis.2016.113 · Cited by 5
Pacing Software Product Development: A Framework and Practical Implementation Guidelines
Rautiainen, K., Lassenius, C., Itkonen, J., et al. (2004) · Cited by 5
Iqbal, J., Omar, M. B., & Yasin, A. B. (2018) · Universiti Utara Malaysia Institutional Repository (Universiti Utara Malaysia) · Cited by 3
Hasan, S. M., Islam, M. S., Ashaduzzaman, M., et al. (2019) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit48885.2019.9038214 · Cited by 3
Fractional nonconformance based conformity testing
Zhou, X., Govindaraju, K., & Jones, G. (2019) · Computers & Industrial Engineering · doi:10.1016/j.cie.2019.06.013 · Cited by 1
Quality Assurance Practices in Agile MethodologyPreprint
Wakili, A. A., Alhassan, L. N., & Kamagata, A. H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.05134 · Cited by 1
Test Automation Process Improvement in a DevOpsTeam: Experience Report
Wang, Y., Pyhäjärvi, M., & Mäntylä, M. V. (2020) · arXiv · doi:10.48550/arxiv.2004.06381
Cited by
Bose, S. R., Sirajudheen, M. A. S., Kirupanandan, G., Arunagiri, S., Regin, R., & Rajest, S. S. (2023) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-0502-7.ch017 · Cited by 29
Implementing and Using CI/CD: Addressing Key Challenges Faced by Software Developers
Shanmukhi, B. S. (2024) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem37128 · Cited by 1
Dias, I., Wickramarachchi, R., & Jayasinghe, S. (2025) · International Research Conference on Smart Computing and Systems Engineering (SCSE) · doi:10.1109/scse65633.2025.11031019 · Cited by 1
“At the same time, challenges like skill gaps, communication issues, and increased costs add to the complexity of CI/CD integration in Agile environments [20], [21].”
Jemima, P. P., Gokul, R., Ashwin, R., & Matheswaran, S. (2023) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-0502-7.ch018
MÜƏSSİSƏLƏRDƏ AGİLE TRANSFORMASİYASININ TƏTBİQİ ÇƏTİNLİKLƏRİ VƏ HƏLL YOLLARI
İbrahimov, S., Məmmədzadə, H., & Əkbərov, S. (2024) · SCIENTIFIC WORK · doi:10.36719/2663-4619/102/239-244
Metadata
- Authors
- Bhanushali, A.
- Affiliations
- West Virginia University (US)
- Corresponding author
- Bhanushali, Amit
- Venue
- International Journal of Science and Research (IJSR)
- Published
- 2023-10-05
- Volume
- 12
- Issue
- 10
- Pages
- 1626-1644
- ISSN
- 2319-7064 (ISSN-L)
- OpenAlex
- W4388193285
- Cited by
- 11
- References
- 94
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 3 · 2023: 2
- FWCI
- 2.58
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by-sa
- Locations
- International Journal of Science and Research (IJSR) (publishedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Keywords
- continuous integration, continuous testing, test automation, software quality, agile software development, implementation barriers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

![Figure 2 Timeline of Cycles of Control [37]](https://figures.cochat.ai/paper-figures/47f84ee3ddc845fb8c1c34a48aa7a1df/challenges-and-solutions-in-implementing-continuous-integration-and-continuous-figure-2.png)
