Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 147 of the 147 references it cites were found in a registry or an index; 9 of the 65 sources its claims cite were checked for support.

The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilot

Open access
Song, Fangchen, Agarwal, Ashish, Wen, Wen · 2024 · SSRN Electronic Journal (preprint)

Abstract

Generative artificial intelligence (AI) facilitates content production and enhances ideation, with potentially important implications for developer productivity and participation in software development. To explore its impact on collaborative open-source software (OSS) development, we investigate the role of GitHub Copilot, a generative AI pair programmer, in OSS development where multiple distributed developers voluntarily collaborate. Using GitHub's proprietary Copilot usage data, combined with public OSS project data obtained from GitHub, we find that Copilot use increases project-level code contributions by 5.9%. This gain is accompanied by a 3.4% increase in developer coding participation and a 2.1% increase in individual code contributions. However, Copilot use is also associated with an 8% increase in coordination time and more code discussions. This reveals an important tradeoff: While AI expands who can contribute and how much they contribute, it slows coordination in collective development efforts. Despite this tension, the overall effect remains positive, resulting in a net increase in the timely merge of code contributions at the project level. Interestingly, we also find heterogeneous effects across developer roles. Peripheral developers exhibit relatively smaller increases in project-level code contributions and larger increases in coordination time than core developers. Together, our findings highlight the dual effects of AI pair programmers on code contributio…

Overview

CoChat Summary

TL;DR

Using proprietary GitHub Copilot usage data and public GitHub project data, this paper finds that Copilot use increases project-level code contributions but also lengthens coordination time in open-source software development. The net effect on timely merged contributions remains positive, with heterogeneous effects across core and peripheral developers.

Key findings

  • Copilot use is associated with a 5.9% increase in project-level code contributions (merged PRs) and an 8% increase in coordination time (average time to merge a PR).
  • Mechanism analyses show a 3.4% increase in developer coding participation, a 2.1% increase in individual code contributions, a 6.5% increase in code discussion volume per merged PR, a 1.7% increase in discussion participation, and a 5.9% increase in discussion intensity per developer.
  • Despite longer coordination time, Copilot use is associated with a 3.5% increase in PRs merged within one day, 4.1% within three days, and 5.1% within ten days.
  • Core developers experience a relatively larger increase in project-level code contributions (core share rises by 0.054, or 6.5%), while peripheral developers experience a larger increase in coordination time (peripheral merge-time ratio rises by 0.085, or 5.4%). Absolute changes: core contributions +6.1%, core coordination time +6.7%; peripheral contributions +5.4%, peripheral coordination time +5.3%.

Methods

  • Project-month panel of GitHub OSS projects from January 2021 to December 2022; final main sample includes 7,637 projects (4,491 treatment, 3,146 control) and 139,329 observations. Treatment is defined as projects where Copilot was supported by local IDEs and used by developers, identified using proprietary GitHub Copilot usage data plus public IDE information.
  • Main estimation uses the Generalized Synthetic Control Method (GSCM) with project and month fixed effects, log-transformed outcomes, and robust standard errors clustered at the project level.
  • Robustness and supplementary analyses include within-IDE analysis, PSM combined with difference-in-differences, instrumental variable estimation, alternative measures, outlier removal, non-AI topic exclusion, workload controls, two-way fixed effects, expanded samples, and LDA text analysis of 5,404,735 merged PR comments.

Limitations

  • The paper states that privacy constraints prevent observing individual-level Copilot usage, limiting direct measurement of heterogeneous AI adoption, role transitions, and spillovers; the observational data also cannot fully capture unobserved developer characteristics such as motivation, ability, or work preferences.
  • The paper states that the dataset does not identify intermediate mechanisms through which AI tools alleviate or exacerbate coordination bottlenecks, and the panel size does not allow assessing long-term effects as developers gain experience.
  • The paper states it does not examine broader social and governance implications, such as authorship transparency, credit assignment, skill erosion, bias, or security vulnerabilities; evident from the design, treatment is measured at the project level and the sample is restricted to active projects disclosing IDE information, so findings may not generalize to all OSS projects or individual Copilot use patterns.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2139/ssrn.4856935

Cites

147 of 147 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

8 Valid · 2 Not valid · 30 Not checked · 223 Own results and interpretations

163 more claims

Create a free account to see all 263 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 28
  • It may state two separate claims as one. 46
  • The quote only partly states this claim. 28

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 59 references

Research works printed but not linked: 8

  1. J Bai, 2009, Panel data models with interactive fixed effects, Econometrica, 77, 1229, 10.3982/ECTA6135 · DOI · Paper page
  2. I-H Hann, 2013, All are not equal: An examination of the economic returns to different forms of participation in open source software communities, Information Systems Research, 24, 520, 10.1287/isre.2013.0474 · DOI · Paper page
  3. J Howison, 2014, Collaboration through open superposition: A theory of the open source way, Mis Quarterly, 38, 29, 10.25300/MISQ/2014/38.1.02 · DOI · Paper page
  4. R Krishnamurthy, 2016, Peripheral developer participation in open source projects: an empirical analysis, ACM Transactions on Management Information Systems (TMIS), 6, 1, 10.1145/2820618 · DOI · Paper page
  5. P K Medappa, 2019, Does superposition influence the success of FLOSS projects? An examination of open-source software development by organizations and individuals, Information Systems Research, 30, 764, 10.1287/isre.2018.0829 · DOI
  6. P Setia, 2012, How peripheral developers contribute to opensource software development, Information Systems Research, 23, 144, 10.1287/isre.1100.0311 · DOI · Paper page
  7. J Tsay, 2014, Let's talk about it: evaluating contributions through discussion in GitHub, Proceedings of the 22nd ACM SIGSOFT international symposium on foundations of software engineering, 144, 10.1145/2635868.2635882 · DOI · Paper page
  8. Y Yu, 2015, Wait for it: Determinants of pull request evaluation latency on github, IEEE/ACM 12th working conference on mining software repositories, 367, 10.1109/MSR.2015.42 · DOI

Cited by

See all 30

Metadata

Authors
Song, F., Agarwal, A., & Wen, W.
Affiliations
The University of Texas at Austin (US)
Corresponding author
Wen, Wen
Venue
SSRN Electronic Journal (preprint)
Publisher
Elsevier BV
Published
2024
ISSN
1047-7047 (ISSN-L)
OpenAlex
W4400488941
Cited by
30
References
59
Citations by year
2026: 24 · 2025: 6
FWCI
213.93
Type
journal article
Language
en
Open access
Locations
  • Information Systems Research (publishedVersion)
  • SSRN Electronic Journal (acceptedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Open Source Software Innovations
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
Keywords
generative AI, GitHub Copilot, open source software development, collaborative software development, code contribution, developer engagement, developer roles, core developers, open source communities, developer productivity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.