Effects of Test-Driven Development: A Comparative Analysis of Empirical Studies
Open accessIntegrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The main concern in implementing TDD in big data projects was how TDD would be incorporated with the lack of suitable tools in complex systems with the sheer volume of data.
“The main concern was how TDD would be incorporated with the lack of suitable tools in complex systems with the sheer volume of the data being considered [17].”
From Test Driven Development and Its Impact on Program Design and Software Quality: A Systematic Literature Review (2023) · cites this paper as [17]
TDD's effectiveness depends on factors like team size, project complexity, and organizational context, requiring careful planning.
“TDD's effectiveness depends on factors like team size, project complexity, and organizational context, requiring careful planning [17, 22].”
From Test Driven Development and Its Impact on Program Design and Software Quality: A Systematic Literature Review (2023) · cites this paper as [17]
Cites
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
Creswell, J. W. (1994) · Cited by 35,227 · see citing works
(2009) · Cited by 21,330 · see citing works
McCabe, T. J. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.233837 · Cited by 6,059 · see citing works
A metrics suite for object oriented design
Chidamber, S. R., & Kemerer, C. F. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.295895 · Cited by 5,698 · see citing works
Guidelines for conducting and reporting case study research in software engineering
Runeson, P., & Höst, M. (2009) · Empirical Software Engineering · doi:10.1007/s10664-008-9102-8 · Cited by 3,862 · see citing works
Writing Integrative Literature Reviews: Guidelines and Examples
Torraco, R. J. (2005) · Human Resource Development Review · doi:10.1177/1534484305278283 · Cited by 3,534 · see citing works
Software Metrics: A Rigorous and Practical Approach
Fenton, N., & Pfleeger, S. L. (2013) · Cited by 2,517 · see citing works
Test-Driven Development by Example
Beck, K. L. (2002) · Cited by 1,457 · see citing works
Software testing and analysis: process, principles, and techniques
Pezzè, M., & Young, M. (2008) · Choice Reviews Online · doi:10.5860/choice.46-0935 · Cited by 342 · see citing works
Hardgrave, B. C., & Armstrong, D. J. (2005) · Communications of the ACM · doi:10.1145/1096000.1096028 · Cited by 218 · see citing works
Test-driven development as a defect-reduction practice
Williams, L. A., Maximilien, E. M., & Vouk, M. A. (2005) · doi:10.1109/issre.2003.1251029 · Cited by 183 · see citing works
Assessing Test-Driven Development at IBM
Maximilien, E. M. (2003) · Cited by 178 · see citing works
An initial investigation of test driven development in industry
George, B., & Williams, L. A. (2003) · ACM Symposium on Applied Computing · doi:10.1145/952532.952753 · Cited by 154 · see citing works
Nagappan, N., Maximilien, E. M., Bhat, T., & Williams, L. A. (2008) · Empirical Software Engineering · doi:10.1007/s10664-008-9062-z · Cited by 151 · see citing works
Evaluating the efficacy of test-driven development
Bhat, T., & Nagappan, N. (2006) · doi:10.1145/1159733.1159787 · Cited by 142 · see citing works
Assessing test-driven development at IBM
Maximilien, E. M., & Williams, L. A. (2003) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1109/icse.2003.1201238 · Cited by 138 · see citing works
The Effects of Test-Driven Development on External Quality and Productivity: A Meta-Analysis
Rafique, Y., & Mišić, V. B. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.28 · Cited by 121 · see citing works
Does Test-Driven Development Really Improve Software Design Quality?
Janzen, D. S., & Saiedian, H. (2008) · IEEE Software · doi:10.1109/ms.2008.34 · Cited by 113 · see citing works
A survey of evidence for test-driven development in academia
Desai, C., Janzen, D. S., & Savage, K. (2008) · ACM SIGCSE Bulletin · doi:10.1145/1383602.1383644 · Cited by 85 · see citing works
Evaluating advantages of test driven development
Canfora, G., Cimitile, A., García, F. O., Piattini, M. G., & Visaggio, C. A. (2006) · International Symposium on Empirical Software Engineering · doi:10.1145/1159733.1159788 · Cited by 83 · see citing works
On the Influence of Test-Driven Development on Software Design
Janzen, D. S., & Saiedian, H. (2006) · Proceedings · doi:10.1109/cseet.2006.25 · Cited by 81 · see citing works
Madeyski, L. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2009.08.007 · Cited by 74 · see citing works
Guest Editors' Introduction: TDD--The Art of Fearless Programming
Jeffries, R., & Melnik, G. (2007) · IEEE Software · doi:10.1109/ms.2007.75 · Cited by 70 · see citing works
Comparing Size Measures for Predicting Web Application Development Effort: A Case Study
Martino, S. D., Ferrucci, F., Gravino, C., & Mendes, E. (2007) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2007.20 · Cited by 68 · see citing works
A prototype empirical evaluation of test driven development
Geras, A., Smith, M. R., & Miller, J. (2004) · doi:10.1109/metrics.2004.2 · Cited by 65 · see citing works
Empirical investigation towards the effectiveness of Test First programming
Huang, L., & Holcombe, M. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.03.007 · Cited by 59 · see citing works
Implications of integrating test-driven development into CS1/CS2 curricula
Desai, C., Janzen, D. S., & Clements, J. (2009) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1508865.1508921 · Cited by 56 · see citing works
Impact of test-driven development on productivity, code and tests: A controlled experiment
Pančur, M., & Ciglarič, M. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2011.02.002 · Cited by 51 · see citing works
The effect of experience on the test-driven development process
Müller, M., & Höfer, A. (2007) · Empirical Software Engineering · doi:10.1007/s10664-007-9048-2 · Cited by 51 · see citing works
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Travassos, G. H., Maldonado, J. C., & Wohlin, C. (2006) · Cited by 49 · see citing works
The Impact of Test-Driven Development on Software Development Productivity — An Empirical Study
Madeyski, L., & Szała, Ł. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75381-0_18 · Cited by 46 · cited 4× · see citing works
“Madeyski and Szała 2010 [21] Industry/Academia x x”
BackgroundInfluentialAn Experimental Evaluation of the Effectiveness and Efficiency of the Test Driven Development
Gupta, A., & Jalote, P. (2007) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2007.41 · Cited by 46 · see citing works
Evaluating Test-Driven Development in an Industry-Sponsored Capstone Project
Vũ, J. H., Fröjd, N., Shenkel-Therolf, C., & Janzen, D. S. (2009) · International Conference on Information Technology: New Generations · doi:10.1109/itng.2009.11 · Cited by 43 · see citing works
(2011) · Cited by 40 · see citing works
Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development
Wilkerson, J. W., Nunamaker, J. F., & Mercer, R. (2011) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.46 · Cited by 38 · see citing works
A prototype empirical evaluation of test driven development
Geras, A., Smith, M. R., & Miller, J. (2004) · doi:10.1109/metric.2004.1357925 · Cited by 36 · see citing works
Dynamic and static views of software evolution
Cook, S., He, J., & Harrison, R. (2002) · doi:10.1109/icsm.2001.972776 · Cited by 31 · see citing works
The effectiveness of test-driven development: an industrial case study
Dogša, T., & Batic, D. (2011) · Software Quality Journal · doi:10.1007/s11219-011-9130-2 · Cited by 25 · see citing works
Driving Software Quality and Structuring Work Through Test-Driven Development
Mäkinen, S. (2012) · Työväentutkimus Vuosikirja · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
1 of the 40 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Issues in Reproducible Simulation Research
Fitzpatrick, B. G. (2018) · Bulletin of Mathematical Biology · doi:10.1007/s11538-018-0496-1 · Cited by 32 · see citing works
A family of experiments on test-driven development
Santos, A., Vegas, S., Dieste, O., Uyaguari, F., Tosun, A., Fucci, D., Turhan, B., Scanniello, G., Romano, S., Karac, I., et al. (2021) · Empirical Software Engineering · doi:10.1007/s10664-020-09895-8 · Cited by 30 · see citing works
Hybrid model for evaluation of quality aware DevOps
Batra, P., & Jatain, A. (2021) · International Journal of Applied Science and Engineering · doi:10.6703/ijase.202106_18(2).013 · Cited by 10 · see citing works
Efectividad del Test-Driven Development: Un Experimento Replicado
Dieste, Ó., Fonseca, E. R., Raura, G., & Rodríguez, P. (2015) · Revista Latinoamericana de Ingenieria de Software · doi:10.18294/relais.2015.141-147 · Cited by 6 · see citing works
da Silva, J. P., Pimentel, P. H. G., Pimentel, L. G., & Silveira, I. F. (2021) · Latin American Conference on Learning Technologies (LACLO) · doi:10.1109/laclo54177.2021.00041 · Cited by 4 · see citing works
Santos, A., Järvinen, J., Partanen, J. O., Oivo, M., & Juristo, N. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03673-7_17 · Cited by 4 · see citing works
Reliability of systematic literature reviews on test-driven development
Uyaguari, F., Acuña, S. T., Castro, J. W., Dieste, Ó., & Juristo, N. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107762 · Cited by 3 · see citing works
Agha, D., Sohail, R., Meghji, A. F., Qaboolio, R., & Bhatti, S. (2023) · VAWKUM Transactions on Computer Sciences · doi:10.21015/vtcs.v11i1.1494 · Cited by 3 · see citing works
Seth, F. P., Taipale, O., & Smolander, K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-13835-0_14 · Cited by 2 · see citing works
Test-Driven Development: uma revisão sistemática
Benato, G. B., & Vilela, P. R. S. (2021) · Revista Brasileira de Computação Aplicada · doi:10.5335/rbca.v13i1.11154 · Cited by 2 · see citing works
Automatic Verification of High-Level Executable Models Running on FPGAs
McColl, M., McColl, C., & Hexel, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-45332-8_11 · Cited by 2 · see citing works
Rizqullah, M., & Albassam, E. (2026) · IEEE Access · doi:10.1109/access.2026.3662817 · Cited by 1 · see citing works
Nanthaamornphong, A., & Bressan, S. (2019) · Tehnički glasnik · doi:10.31803/tg-20191104214708 · Cited by 1 · see citing works
Software Quality Enhancement Using Hybrid Model of DevOps
Batra, P., & Jatain, A. (2021) · Algorithms for intelligent systems · doi:10.1007/978-981-16-2248-9_28 · Cited by 1 · see citing works
Improving Development Practices through Experimentation: An Industrial TDD Case
Santos, A., Spisak, J., Oivo, M., & Juristo, N. (2018) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2018.00061
Selected Topics on Business Informatics: Editorial Introduction to Issue 31 of CSIMQ
Marcinkowski, B. (2022) · Complex Systems Informatics and Modeling Quarterly · doi:10.7250/csimq.2022-31.00
Parsa, S. A., & Altaee, S. A. H. (2026) · Iraqi journal of data science. · doi:10.51173/ijds.v3i1.63
- Authors
- Mäkinen, S., & Münch, J.
- Affiliations
- University of Helsinki (FI)
- ORCID
- Münch, Jürgen
- Venue
- Lecture Notes in Business Information Processing
- Publisher
- Springer International Publishing
- Published
- 2014
- Pages
- 155-169
- ISSN
- 1865-1348 (ISSN-L)
- 1865-1356
- OpenAlex
- W2146602212
- Cited by
- 18
- References
- 40
- Citations by year
- 2026: 2 · 2025: 1 · 2023: 2 · 2022: 1 · 2021: 5 · 2019: 1 · 2018: 3 · 2017: 1 · 2015: 1 · 2014: 1
- FWCI
- 0.85
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- Lecture notes in business information processing (publishedVersion)
- Työväentutkimus Vuosikirja (submittedVersion, other-oa)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- test-driven development, software quality, defect reduction, maintainability, software complexity, development time
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
