The DOI matches its Crossref record; 9 of the 11 references it cites were found in a registry or an index.
Are Reviews an Alternative to Pair Programming?
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One of the primary advantages of pair programming is its positive impact on code quality. Collaboration in real-time allows for immediate error detection and correction, leading to fewer defects and improved overall code structure (Müller, 2004).”
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Gentleman R: R: A language for data analysis and graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,747
A discipline for software engineering
(1995) · Control Engineering Practice · doi:10.1016/0967-0661(95)90062-4 · Cited by 1,018
Strengthening the case for pair programming
Williams, L. A., Kessler, R. R., Cunningham, W., & Jeffries, R. (2000) · IEEE Software · doi:10.1109/52.854064 · Cited by 779
Gilb, T., Graham, D., & Finzi, S. (1993) · Cited by 515
The costs and benefits of pair programming
Cockburn, A., & Williams, L. A. (2001) · Cited by 425
The case for collaborative programming
Nosek, J. T. (1998) · Communications of the ACM · doi:10.1145/272287.272333 · Cited by 375
The effects of pair-programming on performance in an introductory programming course
McDowell, C., Werner, L., Bullock, H. E., & Fernald, J. L. (2002) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/563340.563353 · Cited by 353
The effects of "pair-pressure" and "pair-learning" on software engineering education
Williams, L. A., & Kessler, R. R. (2005) · IEEE International Conference on Software Engineering Education and Training (CSEE&T) · doi:10.1109/csee.2000.827023 · Cited by 112
Research works printed but not linked: 1
- Müller, M., and Padberg, F. 2002. Extreme programming from an engineering economics point of view. In International Workshop on Economics-Driven Software Engineering Research (EDSER). Orlando, Florida, USA, May.
Cited by
Salleh, N., Mendes, E., & Grundy, J. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.59 · Cited by 367
Evaluating Pair Programming with Respect to System Complexity and Programmer Expertise
Arisholm, E., Gallis, H., Dybå, T., & Sjøberg, D. I. K. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.17 · Cited by 277
A multiple case study on the impact of pair programming on product quality
Hulkko, H., & Abrahamsson, P. (2005) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1062455.1062545 · Cited by 155
Measuring and modeling programming experience
Siegmund, J., Kästner, C., Liebig, J., Apel, S., & Hanenberg, S. (2013) · Empirical Software Engineering · doi:10.1007/s10664-013-9286-4 · Cited by 147
Pair programming productivity: Novice–novice vs. expert–expert
Lui, K. M., & Chan, K. C. C. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.04.010 · Cited by 133
An experimental investigation of personality types impact on pair effectiveness in pair programming
Sfetsos, P., Stamelos, I. G., Angelis, L., & Deligiannis, I. (2008) · Empirical Software Engineering · doi:10.1007/s10664-008-9093-5 · Cited by 118
Measuring programming experience
Feigenspan, J., Kästner, C., Liebig, J., Apel, S., & Hanenberg, S. (2012) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2012.6240511 · Cited by 106
Fan, G., Liu, D., Zhang, R., & Pan, L. (2025) · International Journal of STEM Education · doi:10.1186/s40594-025-00537-3 · Cited by 109
“Collaboration in real-time allows for immediate error detection and correction, leading to fewer defects and improved overall code structure (Müller, 2004).”
Two controlled experiments concerning the comparison of pair programming to peer review
Müller, M. (2005) · Journal of Systems and Software · doi:10.1016/j.jss.2004.12.019 · Cited by 82
Self-citationEffects of pair programming at the development team level: an experiment
Vanhanen, J., & Lassenius, C. (2005) · International Symposium on Empirical Software Engineering · doi:10.1109/isese.2005.1541842 · Cited by 70
Pair Programming and Software Defects--A Large, Industrial Case Study
di Bella, E., Fronza, I., Phaphoom, N., Sillitti, A., Succi, G., & Vlasenko, J. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.68 · Cited by 66
Survey of Software Inspection Research
Kollanus, S., & Koskinen, J. (2009) · The Open Software Engineering Journal · doi:10.2174/1874107x00903010015 · Cited by 65
Sillitti, A., Succi, G., & Vlasenko, J. (2012) · doi:10.5555/2337223.2337366 · Cited by 55
The Effect of Pairs in Program Design Tasks
Lui, K. M., Chan, K. C. C., & Nosek, J. T. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.70755 · Cited by 48
Madeyski, L. (2006) · Lecture notes in computer science · doi:10.1007/11767718_24 · Cited by 44
Sillitti, A., Succi, G., & Vlasenko, J. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227110 · Cited by 43
Madeyski, L. (2005) · Cited by 42
Liu, J., & Li, S. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241240460 · Cited by 55
A preliminary study on the impact of a pair design phase on pair programming and solo programming
Müller, M. (2006) · Information and Software Technology · doi:10.1016/j.infsof.2005.09.008 · Cited by 37
Self-citationAn empirical study about the feelgood factor in pair programming
Müller, M. M., Padberg, F., & Karlsruhe, U. (2004) · Cited by 37
Self-citationOn the Effects of Pair Programming on Thoroughness and Fault-Finding Effectiveness of Unit Tests
Madeyski, L. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73460-4_20 · Cited by 33
An empirical study about the feelgood factor in pair programming
Müller, M., & Padberg, F. (2004) · IEEE International Software Metrics Symposium (METRICS) · doi:10.1109/metric.2004.1357899 · Cited by 25
Self-citationImpact of pair programming on thoroughness and fault detection effectiveness of unit test suites
Madeyski, L. (2008) · Software Process Improvement and Practice · doi:10.1002/spip.382 · Cited by 24
Simulation in Software Engineering with System Dynamics: A Case Study
Wu, M., & Yan, H. (2009) · Journal of Software · doi:10.4304/jsw.4.10.1127-1135 · Cited by 23
Towards a Common Instrument for Measuring Prior Programming Knowledge
Duran, R., Rybicki, J.-M., Hellas, A., & Suoranta, S. (2019) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3304221.3319755 · Cited by 28
Daun, M., Brings, J., Obe, P. A., & Stenkova, V. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-09972-6 · Cited by 25
Do programmer pairs make different mistakes than solo programmers?
Müller, M. (2006) · Journal of Systems and Software · doi:10.1016/j.jss.2006.10.032 · Cited by 20
Self-citationAn Overview of Quality Assurance Practices in Agile Methodologies
Timperi, O. P. (2004) · Cited by 18
Schmidt, C., Spohrer, K., Kude, T., & Heinzl, A. (2012) · MADOC (University of Mannheim) · Cited by 16
Spohrer, K., Kude, T., Schmidt, C., & Heinzl, A. (2013) · MADOC (University of Mannheim) · Cited by 15
Investigating the impact of peer code review and pair programming on test-driven development
Swamidurai, R., Dennis, B., & Kannan, U. (2014) · IEEE SoutheastCon · doi:10.1109/secon.2014.6950664 · Cited by 11
Is External Code Quality Correlated with Programming Experience or Feelgood Factor?
Madeyski, L. (2006) · Lecture notes in computer science · doi:10.1007/11774129_7 · Cited by 11
An Empirical Study on Design Quality Improvement from Best-Practice Inspection and Pair Programming
Winkler, D., & Biffl, S. (2006) · Lecture notes in computer science · doi:10.1007/11767718_27 · Cited by 10
THE TRUE COST OF PAIR PROGRAMMING: DEVELOPMENT OF A COMPREHENSIVE MODEL AND TEST
Sun, W. N. (2009) · Journal of the Association for Information Systems · Cited by 9
Collaborative-Adversarial Pair Programming
Swamidurai, R., & Umphress, D. A. (2012) · ISRN Software Engineering · doi:10.5402/2012/516184 · Cited by 9
Peer-Based Quality Assurance in Information Systems Development: A Transactive Memory Perspective
Spohrer, K., Kude, T., Heinzl, A., & Schmidt, C. (2013) · Cited by 7
Software process fusion by combining pair and solo programming
Lui, K. M., & Chan, K. C. (2008) · IET Software · doi:10.1049/iet-sen:20070035 · Cited by 7
An Empirical Evaluation of Iterative Maintenance Life Cycle Using XP
Choudhari, J., & Suman, U. (2015) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/2735399.2735406 · Cited by 7
Pair Programming and Software Defects – An Industrial Case Study
Phaphoom, N., Sillitti, A., & Succi, G. (2011) · Lecture notes in business information processing · doi:10.1007/978-3-642-20677-1_15 · Cited by 6
Capable Leader and Skilled and Motivated Team Practices to Introduce eXtreme Programming
Madeyski, L., & Biela, W. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85279-7_8 · Cited by 5
Köhler, D., Klieme, E., Kreuseler, M., Cheng, F., & Meinel, C. (2021) · International Conference on Cryptography, Security and Privacy (CSP) · doi:10.1109/csp51677.2021.9357504 · Cited by 5
Fronza, I., Hellas, A., Ihantola, P., & Mikkonen, T. (2019) · Lecture notes in business information processing · doi:10.1007/978-3-030-35510-4_8 · Cited by 4
Effectiveness of Software Development Process Using Programmer Ranker Algorithm in Pair Programming
Giri, M., Soni, S., & India, D. (2013) · Cited by 3
Pietinen, S., Tenhunen, V., & Tukiainen, M. (2008) · Communications in computer and information science · doi:10.1007/978-3-540-85936-9_5 · Cited by 3
Should we use programmer pairs or single developers for the next project?
Müller, M. (2004) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000001236 · Cited by 3
Self-citationInoue, T. (2013) · The Journal of Information and Systems in Education · doi:10.12937/ejsise.12.39 · Cited by 2
Qamar, N., & Malik, A. A. (2019) · Pakistan journal of engineering and applied sciences · doi:10.67635/pjeas.2019.25.1.802 · Cited by 2
Conceptual model for pair design and pair testing based on the characteristics of pair programming
Thomaschewski, J., Escalona, M. J., Schön, E.-M., & Missler, T. A. (2019) · International Journal of Agile Systems and Management · doi:10.1504/ijasm.2019.10022801 · Cited by 1
Sugiyama, Y., Morisaki, S., Toyama, A., & Katahira, K. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3566537 · Cited by 1
Influencing Factors Analysis and Evaluation for Undergraduate Programming Ability
Wang, J., Wang, Y., & Wang, X. (2021) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c55045.2021.00047 · Cited by 1
Ist XP etwas f ¨ ur mich ? Empirische Studien zur Einsch¨ atzung von XP
Padberg, F., & Tichy, W. F. (2005) · Cited by 1
External Code Quality Model and Cross-Validation of the Model
Madeyski, L., & Huzar, Z. (2007)
Quality definitions and measurements in software engineering experiments on pair programming
Orucevic, M. (2009) · NORA - Norwegian Open Research Archives
Rezension des Papers "Recovery, Redemption and Extreme Programming" von Peter Schuh
IT-Alignment, V. (2009)
Do Programmer Pairs make different Mistakes than Solo Programmers?
Müller, M. (2006) · Electronic workshops in computing · doi:10.14236/ewic/ease2006.8
Self-citationSpohrer, K. (2015) · Progress in IS · doi:10.1007/978-3-319-25163-9_5
Spohrer, K. (2015) · Progress in IS · doi:10.1007/978-3-319-25163-9_1
Spohrer, K. (2015) · Progress in IS · doi:10.1007/978-3-319-25163-9_3
Spohrer, K. (2015) · Progress in IS · doi:10.1007/978-3-319-25163-9_2
Spohrer, K. (2015) · Progress in IS · doi:10.1007/978-3-319-25163-9_4
Spohrer, K. (2015) · Progress in IS · doi:10.1007/978-3-319-25163-9_6
Metadata
- Authors
- Müller, M. M.
- Affiliations
- Karlsruhe Institute of Technology (DE)
- Corresponding author
- Müller, Matthias M.
- ORCID
- Müller, Matthias M.
- Venue
- Empirical Software Engineering
- Published
- 2004-12
- Volume
- 9
- Issue
- 4
- Pages
- 335-351
- ISSN
- 1382-3256 (ISSN-L)
- 1573-7616
- OpenAlex
- W2018982342
- Cited by
- 61
- References
- 11
- Citations by year
- 2025: 2 · 2024: 1 · 2021: 3 · 2019: 4 · 2015: 7 · 2014: 1 · 2013: 5 · 2012: 6
- FWCI
- 17.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Empirical Software Engineering (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- code review, pair programming, Extreme Programming, software development costs, code quality, software development process
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
