The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
An empirical study of the impact of modern code review practices on software quality
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Harrell (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7 · Cited by 6,878
McCabe, T. J. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.233837 · Cited by 6,059
Regression modelling strategies for improved prognostic prediction
Harrell, F. E., Lee, K. L., Califf, R. M., Pryor, D. B., & Rosati, R. A. (1984) · Statistics in Medicine · doi:10.1002/sim.4780030207 · Cited by 1,798
Chambers, J., Hastie, T., & Pregibon, D. (1990) · Compstat · doi:10.1007/978-3-642-50096-1_48 · Cited by 1,742
Two case studies of open source software development: Apache and Mozilla
Mockus, A., Fielding, R. T., & Herbsleb, J. D. (2002) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/567793.567795 · Cited by 1,685
Design and code inspections to reduce errors in program development
Fagan, M. E. (1976) · IBM Systems Journal · doi:10.1147/sj.153.0182 · Cited by 1,492
Mining metrics to predict component failures
Nagappan, N., Ball, T., & Zeller, A. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134349 · Cited by 782
Use of relative code churn measures to predict system defect density
Nagappan, N., & Ball, T. (2005) · Proceedings of the 27th international conference on Software engineering - ICSE '05 · doi:10.1145/1062455.1062514 · Cited by 775 · cited 5×
“a lot of change are likely defect-prone (Nagappan and Ball 2005; 2007).”
BackgroundMethodInfluentialPredicting fault incidence using software change history
Graves, T. L., Karr, A. F., Marron, J. S., & Siy, H. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.859533 · Cited by 753
A large-scale empirical study of just-in-time quality assurance
Kamei, Y., Shihab, E., Adams, B., Hassan, A. E., Mockus, A., Sinha, A., & Ubayashi, N. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.70 · Cited by 715
Self-citationPredicting faults using the complexity of code changes
Hassan, A. E. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070510 · Cited by 708
Self-citationClassifying Software Changes: Clean or Buggy?
Kim, S., Whitehead, & Zhang, Y. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.70773 · Cited by 672
Expectations, outcomes, and challenges of modern code review
Bacchelli, A., & Bird, C. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606617 · Cited by 650
How Biased is the Apparent Error Rate of a Prediction Rule?
Efron, B. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478291 · Cited by 587
Design and Code Inspections to Reduce Errors in Program Development
Fagan, M. E. (2001) · Pioneers and Their Contributions to Software Engineering · doi:10.1007/978-3-642-48354-7_13 · Cited by 561
Regression models for prognostic prediction: advantages, problems, and suggested solutions.
Fe, H., Kl, L., Matchar, D. B., & Ta, R. (1985) · PubMed · Cited by 559
Identifying reasons for software changes using historic databases
Mockus, & Votta (2000) · Proceedings 2000 International Conference on Software Maintenance · doi:10.1109/icsm.2000.883028 · Cited by 472
(2013) · doi:10.5555/2486788.2486882 · Cited by 437
Predicting risk of software changes
Mockus, A., & Weiss, D. M. (2002) · Bell Labs Technical Journal · doi:10.1002/bltj.2229 · Cited by 429
McIntosh, S., Kamei, Y., Adams, B., & Hassan, A. E. (2014) · Proceedings of the 11th Working Conference on Mining Software Repositories · doi:10.1145/2597073.2597076 · Cited by 348
Self-citationDon't touch my code!: examining the effects of ownership on software quality
Bird, C., Nagappan, N., Murphy, B., Gall, H., & Devanbu, P. (2011) · Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering · doi:10.1145/2025113.2025119 · Cited by 340
Convergent contemporary software peer review practices
Rigby, P. C., & Bird, C. (2013) · Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2491411.2491444 · Cited by 311
(2014) · doi:10.1145/2597073.2597082 · Cited by 252
How, and why, process metrics are better
Rahman, F., & Devanbu, P. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606589 · Cited by 248
Open source software peer review practices: a case study of the apache server
Rigby, P. C., German, D. M., & Storey, M.-A. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368162 · Cited by 237
Revisiting common bug prediction findings using effort-aware models
Kamei, Y., Matsumoto, S., Monden, A., Matsumoto, K.-I., Adams, B., & Hassan, A. E. (2010) · 2010 IEEE International Conference on Software Maintenance · doi:10.1109/icsm.2010.5609530 · Cited by 207
Self-citationWhat Types of Defects Are Really Discovered in Code Reviews?
Mantyla, M. V., & Lassenius, C. (2009) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.71 · Cited by 204
Ownership, experience and defects: a fine-grained study of authorship
Rahman, F., & Devanbu, P. (2011) · Proceedings of the 33rd International Conference on Software Engineering · doi:10.1145/1985793.1985860 · Cited by 203
Use of relative code churn measures to predict system defect density
Nagappan, N., & Ball, T. (2005) · Proceedings. 27th International Conference on Software Engineering, 2005. ICSE 2005. · doi:10.1109/icse.2005.1553571 · Cited by 201
Understanding broadcast based peer review on open source software projects
Rigby, P. C., & Storey, M.-A. (2011) · Proceedings of the 33rd International Conference on Software Engineering · doi:10.1145/1985793.1985867 · Cited by 194
How, and Why, Process Metrics are better
Rahman, F., & Dévanbu, P. (2013) · Cited by 184
Using Software Dependencies and Churn Metrics to Predict Field Failures: An Empirical Case Study
Nagappan, N., & Ball, T. (2007) · First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007) · doi:10.1109/esem.2007.13 · Cited by 176
An Investigation into the Functional Form of the Size-Defect Relationship for Software Modules
Koru, A. G., Zhang, D., Emam, K. E., & Liu, H. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.90 · Cited by 174
(2007) · First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007) · doi:10.1109/esem.2007.87 · Cited by 170
The Impact of Design and Code Reviews on Software Quality: An Empirical Study Based on PSP Data
Kemerer, C. F., & Paulk, M. C. (2009) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2009.27 · Cited by 167
Understanding the sources of variation in software inspections
Porter, A., Siy, H. P., Mockus, A., & Votta, L. G. (1998) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/268411.268421 · Cited by 143
Will my patch make it? And how fast? Case study on the Linux kernel
Jiang, Y., Adams, B., & Germán, D. M. (2013) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2013.6624016 · Cited by 140
Self-citationPeer Review on Open-Source Software Projects: Parameters, Statistical Models, and Theory
Rigby, P. C., Germán, D. M., Cowen, L. L. E., & Storey, M. (2014) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2594458 · Cited by 118
An analysis of developer metrics for fault prediction
Matsumoto, S., Kamei, Y., Monden, A., Matsumoto, K., & Nakamura, M. (2010) · doi:10.1145/1868328.1868356 · Cited by 115
Self-citationThe influence of non-technical factors on code review
Baysal, O., Kononenko, O., Holmes, R., & Godfrey, M. W. (2013) · Working Conference on Reverse Engineering (WCRE) · doi:10.1109/wcre.2013.6671287 · Cited by 96
High-impact defects: a study of breakage and surprise defects
Shihab, E., Mockus, A., Kamei, Y., Adams, B., & Hassan, A. E. (2011) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2025113.2025155 · Cited by 96
Self-citationTowards a simplification of the bug report form in eclipse
Herraiz, I., Germán, D. M., Gonzalez-Barahona, J. M., & Robles, G. (2008) · doi:10.1145/1370750.1370786 · Cited by 66
Menzies, T., Stefano, J. S. D., Chapman, M., & McGill, K. (2004) · IEEE Software Engineering Workshop (SEW) · doi:10.1109/sew.2002.1199449 · Cited by 62
Harrell, F. E. (2001) · Springer series in statistics · doi:10.1007/978-1-4757-3462-1_1 · Cited by 51
Management of community contributions: A case study on the Android and Linux software ecosystems
Bettenburg, N., Hassan, A. E., Adams, B., & Germán, D. M. (2013) · Empirical Software Engineering · doi:10.1007/s10664-013-9284-6 · Cited by 38
Self-citation
Cited by
The Impact of Automated Parameter Optimization on Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2794977 · Cited by 415
Self-citationPerfection Not Required? Human-AI Partnerships in Code Translation
Weisz, J. D., Muller, M., Houde, S., Richards, J., Ross, S. I., Martinez, F., Agarwal, M., & Talamadupula, K. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450656 · Cited by 129
(2018) · doi:10.1145/3274404 · Cited by 122
Predicting Design Impactful Changes in Modern Code Review: A Large-Scale Empirical Study
Uchoa, A., Barbosa, C., Coutinho, D., Oizumi, W., Assuncao, W. K. G., Vergilio, S. R., Pereira, J. A., Oliveira, A., & Garcia, A. (2021) · 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr52588.2021.00059 · Cited by 42
“Some works investigate the relationship between code review and bug introduction [75], [76], and between code review and design quality [6], [7].”
BackgroundGenerative AI for Pull Request Descriptions: Adoption, Impact, and Developer Interventions
Xiao, T., Hata, H., Treude, C., & Matsumoto, K. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3643773 · Cited by 29
Metadata
- Authors
- McIntosh, S., Kamei, Y., Adams, B., & Hassan, A. E.
- Venue
- Empirical Software Engineering
- Published
- 2015-04-25
- Volume
- 21
- Issue
- 5
- Pages
- 2146-2189
- ISSN
- 1382-3256 (ISSN-L)
- 1573-7616
- OpenAlex
- W2019257047
- Cited by
- 332
- References
- 49
- FWCI
- 60.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.