Impact of Peer Code Review on Peer Impression Formation: A Survey
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Peer code review has been adopted as an effective quality improvement practice by many Open Source Software (OSS) communities. In addition to increasing software quality, there is anecdotal evidence that peer code review has other benefits, including: sharing knowledge, sharing expertise, sharing development techniques, and most importantly building accurate peer impressions between the code review participants. To further investigate the presence of these benefits, we surveyed members of popular OSS communities who were involved with peer code review. We used established scales from Psychology, Information science, and Organizational Behavior to create survey questions. We also enforced multiple reliability and validity measures to ensure higher confidence in the survey results. In this paper, we present a subset of the surveys results focused on better understanding four aspects of peer impression formation: trust, reliability, perception of expertise, and friendship. The results indicate that there is indeed a high level of trust, reliability, perception of expertise, and friendship between OSS peers who have participated in code review for a period of time. Because code review involves examining someone else's code, unsurprisingly, peer code review helped most in building a perception of expertise between code review partners.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Affect and Cognition Based Trust as Foundations for Interpersonal Cooperation in Organizations
McAllister, D. J. (1995) · Academy of Management Journal · doi:10.2307/256727 · Cited by 7,346 · cited 1×
“trust [20], [24], [31], [33], reliability [20], [31], [32], perception of expertise [32], and friendship [3], [32]).”
BackgroundConstructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794
A new scale for the measurement of interpersonal trust1
Rotter, J. B. (1967) · Journal of Personality · doi:10.1111/j.1467-6494.1967.tb01454.x · Cited by 3,503
Rempel, J. K., Holmes, J. G., & Zanna, M. P. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.49.1.95 · Cited by 3,146 · cited 1×
“trust [20], [24], [31], [33], reliability [20], [31], [32], perception of expertise [32], and friendship [3], [32]).”
BackgroundAn empirical study of speed and communication in globally distributed software development
Herbsleb, J. D., & Mockus, A. (2003) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2003.1205177 · Cited by 997 · cited 1×
“Despite the availability of various CMC technologies, distributed projects often do not perform as well as co-located projects, presumably because distributed projects require more time and resources to do the same amount of work [16] and are more likely to fail [27].”
BackgroundFink, A. (2003) · doi:10.4135/9781412986328 · Cited by 701
Raymond, E. S. (1998) · First Monday · doi:10.5210/fm.v3i10.621 · Cited by 290 · cited 1×
“Previous empirical research found that OSS participants are motivated by the prospects of enhancing their reputation and by being identified with a particular OSS community [15], [30].”
BackgroundHolmstrom, H., Conchuir, E., Agerfalk, P., & Fitzgerald, B. (2006) · 2006 IEEE International Conference on Global Software Engineering (ICGSE'06) · doi:10.1109/icgse.2006.261210 · Cited by 14
Research works printed but not linked: 26
- 10.1145/269012.269020 · doi:10.1145/269012.269020
- wiegers, 2002, Peer Reviews in Software A Practical Guide
- herbsleb, 2007, Global software engineering: The future of sociotechnical coordination, 2007 Future of Software Engineering IEEE Computer Society, 188
- hann, 2004, Why developers participate in open source software projects: An empirical investigation, icis, 66
- 10.1037/1089-2699.6.1.38 · doi:10.1037/1089-2699.6.1.38 · Paper page
- 10.1145/1460563.1460674 · DOI · Paper page
- 10.1147/sj.153.0182 · DOI · Paper page
- kenny, 2004, Interpersonal Perception A Social Relations Analysis
- 10.1037/0022-3514.43.6.1306 · doi:10.1037/0022-3514.43.6.1306 · Paper page
- lakhani, 2002, The Boston Consulting Group - Hacker Survey
- litwin, 1995, How to Measure Survey Reliability and Validity, 7, 10.4135/9781483348957 · DOI · Paper page
- mcconnell, 2010, What Does 10x Mean? Measuring Variations in Programmer Productivity ser
- 10.1145/1499224.1499275 · DOI
- moe, 2007, Understanding lacking trust in global software teams: A multi-case study, ser, Product-Focused Software Process Improvement Springer Berlin / Heidelberg, 4589, 20, 10.1007/978-3-540-73460-4_6 · DOI
- moore, 2007, Impression formation, Blackwell Encyclopedia of Psychology, 10.1002/9781405165518.wbeosi025 · doi:10.1002/9781405165518.wbeosi025
- 10.1093/poq/nfl038 · DOI · Paper page
- 10.1177/0265407594113011 · DOI · Paper page
- bosu, 2011, Peer Impressions in Open Source Organizations A Survey
- dictionary, 2012, Oxford Oxford University Press
- 10.1146/annurev.psych.55.090902.141922 · DOI · Paper page
- comrey, 1992, A First Course in Factor Analysis
- cohen, 2006, Best Kept Secrets of Peer Code Review
- robinson, 1991, Measures of Personality and Social Psychological Attitudes, 1
- cohen, 1988, Statistical Power Analysis for the Behavioral Sciences
- devellis, 2011, Scale Development Theory and Applications, 26
- 10.1007/BF02310555 · DOI · Paper page
Cited by
Modern code review: a case study at google
Sadowski, C., Söderberg, E., Church, L., Sipko, M., & Bacchelli, A. (2018) · Proceedings of the 40th International Conference on Software Engineering: Software Engineering in Practice · doi:10.1145/3183519.3183525 · Cited by 280
Exploring the Potential of ChatGPT in Automated Code Refinement: An Empirical Study
Guo, Q., Cao, J., Xie, X., Liu, S., Li, X., Chen, B., & Peng, X. (2023) · arXiv · doi:10.48550/arxiv.2309.08221 · Cited by 140
Code Review Automation: Strengths and Weaknesses of the State of the Art
Tufano, R., Dabić, O., Mastropaolo, A., Ciniselli, M., & Bavota, G. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3348172 · Cited by 48
Exploring the Capabilities of LLMs for Code-Change-Related Tasks
Fan, L., Liu, J., Liu, Z., Lo, D., Xia, X., & Li, S. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3709358 · Cited by 41
“These code-change-related tasks are important for project maintenance but can cost significant efforts and slow down the development process [4, 41].”
On the Use of ChatGPT for Code Review: Do Developers Like Reviews By ChatGPT?
Watanabe, M., Kashiwa, Y., Lin, B., Hirao, T., Yamaguchi, K., & Iida, H. (2024) · Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/3661167.3661183 · Cited by 28
Metadata
- Authors
- Bosu, A., & Carver, J. C.
- Venue
- 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement
- Publisher
- IEEE
- Published
- 2013-10
- Pages
- 133-142
- ISSN
- 1938-6451 (ISSN-L)
- OpenAlex
- W2010321946
- Cited by
- 100
- References
- 9
- FWCI
- 2.68
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.