The DOI matches its DataCite record; 16 of the 16 references it cites were found in a registry or an index; 2 of the 5 sources its claims cite were checked for support.
The Impact of AI on Developer Productivity: Evidence from GitHub Copilot
Open accessAbstract
Generative AI tools hold promise to increase human productivity. This paper presents results from a controlled experiment with GitHub Copilot, an AI pair programmer. Recruited software developers were asked to implement an HTTP server in JavaScript as quickly as possible. The treatment group, with access to the AI pair programmer, completed the task 55.8% faster than the control group. Observed heterogenous effects show promise for AI pair programmers to help people transition into software development careers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Own method · 6 Own interpretation · 6 Own result · 1 Partly supported · 1 Not checked yet · accuracy not yet measured
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“there has been little research on productivity impacts of AI-powered tools in professional contexts, cf.[Mozannar et al., 2022, Vaithilingam et al., 2022, Ziegler et al., 2022].”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Introduction
What the sources say
- Partly supportedcites Mozannar et al., 2022 sourceExperimental — accuracy not yet measured
The Introduction (no page supplied) says existing evaluations of AI code completion leave insufficient detail about productivity gains and possible inefficiencies. That supports a narrower research gap in AI-assisted programming, but not the broader claim that little research has examined productivity impacts of AI tools across professional contexts. The Background and Related Work section, in fact, describes several productivity studies. (LLM, conf=0.78)
- Not checked — no full text of the sourcecites Vaithilingam et al., 2022 source
- Partly supportedcites Ziegler et al., 2022 sourceExperimental — accuracy not yet measured
The Background section (page unavailable) describes this as the first study, to the authors’ knowledge, linking code-suggestion-tool usage measurements with developer productivity or happiness, and identifies two earlier studies. That supports limited prior research on AI code tools, but not the broader claim about AI-powered tools across professional contexts. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The treatment group, with access to the AI pair programmer, completed the task 55.8% faster than the control group.”
- Also stated in: § Introduction · plain
“the treated group completed the task 55.8% faster (95% confidence interval: 21-89%).”
- Also stated in: § Results · plain
“This represents a 55.8% reduction in completion time.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Introduction · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The p-value for the t-test is 0.0017, and a 95% confidence interval for the improvement is between [21%, 89%].”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This result suggests that Copilot increases average productivity significantly in our experiment population.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Results
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In this way, we accurately measured the timing and completion for each participant.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Study Design
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This result provides indirect evidence that treated group benefited from Copilot during their task as their willingness to pay is significantly higher than the control group.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Results
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Observed heterogenous effects show promise for AI pair programmers to help people transition into software development careers.”
- Also stated in: § Introduction · hedged
“These heterogeneous effects point towards promise for AI-pair programmers in support of expanding access to careers in software development.”
- Also stated in: § Discussion · hedged
“the productivity benefits for novice programmers and programmers of older age point to important possibilities for skill initiatives that support job transitions into software development.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Abstract
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The treatment effect is a linear function of the covariates of interest.
- Also stated in: § Introduction · hedged
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We verify from telemetry after the experiment that all participants from the treated group have configured GitHub Copilot and accepted recommendations other than five who did not finish the sign up and thus started the experiment without the GitHub Copilot.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Study Design
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 6
- The quote only partly states this claim. 1
- Probably not a substantial claim. 7
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On average, participants in both treated and control groups estimated a 35% increase in productivity, which is an underestimation compared with the 55.8% increase in their revealed productivity.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conditioning on completing the task, the average completion time from the treated group is 71.17 minutes and 160.89 minutes for the control group.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one. The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results show that less experienced developers (years of professional coding), developers with heavy coding load (hours of coding per day), and older developers (developers aged between 25 and 44) benefit more from Copilot.”
- Also stated in: § Introduction · plain
“Developers with less programming experience, older programmers, and those who program more hours per day benefited the most.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Results
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: The treatment effect is a linear function of the covariates of interest.
- Also stated in: § Introduction · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We also find that the treated group's success rate is 7 percentage points higher than the control group, but the estimate is not statistically significant, with a 95% confidence interval of [-0.11, 0.25].”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If this result persists in further studies, the productivity benefits for novice programmers and programmers of older age point to important possibilities for skill initiatives that support job transitions into software development.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Discussion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
- The authors state this as an assumption: The treatment effect is a linear function of the covariates of interest.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Once participants signed the contract, they were randomly split into control and treatment groups.”
- Also stated in: § Results · plain
“The 95 developers were randomly assigned into control and treated groups, with 45 in the treated group and 50 in control.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Study Design
plainn = 50- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Also stated in: § Results · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If the results of this study were to be extrapolated to the population level, a 55.8% increase in productivity would imply a significant amount of cost savings in the economy and have a notable impact on GDP growth.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Discussion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Participants could see the tests but were unable to alter them.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Study Design
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The potential productivity impacts of AI have major implications for the labor market and firms, including changes in employment, skills, and firm organization [Raj andSeamans, 2018, Agrawal et al., 2019].”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Introduction
What the sources say
- Not matchedcites Raj andSeamans, 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Agrawal et al., 2019 source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
- Not matched
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Thirty-five developers from both the treated and control groups completed the task and survey.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Productivity benefits may vary across specific tasks and programming languages, so more research is needed to understand how our results generalizes to other tasks.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Discussion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Using a standardized task provides us with precise measures of performance as it is difficult to measure productivity of software developers.”
§ The Impact of AI on Developer Productivity: Evidence from GitHub Copilot > Study Design
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The authors state this as an assumption.
The treatment effect is a linear function of the covariates of interest.
“We assume the treatment effect is a linear function of the covariates of interest.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“While developers consistently report significant productivity gains from these tools, empirical measurements often show more modest improvements.”
From Towards Decoding Developer Cognition in the Age of AI Assistants (2025) · cites this paper as [9]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“human-AI collaboration consistently improves measurable output quality in professional writing contexts”
From How Creative Is AI Writing? Generative and Collaborative AI in Japanese Fiction (2026) · cites this paper as Peng et al. (2023)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GitHub performed such an experiment where 95 participants were split into two groups and asked to write a web server.The study concluded by fnding that task completion was reduced by 55.8% in the Copilot condition [28].”
From Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming (2024) · cites this paper as [28]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Evidence from existing (laboratory) experiments generally suggests significant productivity effects of generative AI tools for software developers.”
From The Productivity Effects of Generative AI: Evidence from a Field Experiment with GitHub Copilot (2024) · cites this paper as Peng et al. 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Peng et al. (2023) hired 95 professional programmers to develop an HTTP server in JavaScript.The group that used GitHub Copilot completed the task 55.8% faster, yet there was no effect on whether the task was completed.”
From The Productivity Effects of Generative AI: Evidence from a Field Experiment with GitHub Copilot (2024) · cites this paper as Peng et al. (2023)
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While our participants reported, and prior work suggests [14,33,38,40], AI tools demonstrably increase short-term productivity through faster task completion and reduced blocked time”
From The Evolution of Information Seeking in Software Development: Understanding the Role and Impact of AI Assistants (2025) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, both Dakhel et al. (2023) and Peng et al. (2023) caution that novice programmers may place undue trust in AI-generated code without fully understanding its broader design or integration implications, increasing the likelihood of downstream quality and integration challenges.”
From AI-Assisted Programming Decreases the Productivity of Experienced Developers by Increasing the Technical Debt and Maintenance Burden (2025) · cites this paper as Peng et al. 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, the introduction of GitHub Copilot leads to higher development activity at both the repository and individual levels, measured by commits and PR”
From AI-Assisted Programming Decreases the Productivity of Experienced Developers by Increasing the Technical Debt and Maintenance Burden (2025) · cites this paper as Peng et al. 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior works have presented mixed results on whether AI helps or hinders coding productivity [Peng et al., 2023, Becker et al., 2025]; our study differs from prior results in that it is designed to study how AI affects skill formation while performing a task requiring new knowledge.”
From How AI Impacts Skill Formation (2026) · cites this paper as Peng et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Software engineering, in particular, has been identified as a profession in which AI tools can be readily applied and AI assistance significantly improves productivity in daily tasks [Peng et al., 2023, Cui et al., 2024].”
From How AI Impacts Skill Formation (2026) · cites this paper as Peng et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AI assistance produces significant productivity gains across professional domains, particularly for novice workers.”
From How AI Impacts Skill Formation (2026) · cites this paper as Peng et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Cui et al. (2024) estimate a 26% productivity gain from GitHub Copilot among software developers, while Peng et al. (2023) report a 58% increase.”
From Still Waters, Rapid Currents: Early Labor Market Transformation under Generative AI (2025) · cites this paper as Peng et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing empirical work on the micro-level effects of generative AI tools tends to find that access to these tools benefits less experienced workers more, compressing performance distributions [22; 23; 10; 24].”
From Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior work suggests that less experienced developers may rely more heavily on AI assistance [9]”
From Towards Decoding Developer Cognition in the Age of AI Assistants (2025) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLM-based code generation shows significant productivity improvements (e.g., GitHub Copilot improves productivity 55.8% (Peng et al., 2023))”
From CodeCRDT: Observation-Driven Coordination for Multi-Agent LLM Code Generation (2025) · cites this paper as Peng et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our findings offer only partial support for the 'productivity gain' hypothesis previously reported in technical writing contexts (Noy and Zhang, 2023; Peng et al. 2023): while human-AI collaboration produces consistently acceptable prose with low variance, it does not demonstrably outperform original human writing in perceived quality”
From How Creative Is AI Writing? Generative and Collaborative AI in Japanese Fiction (2026) · cites this paper as Peng et al. 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Peng et al. (2023) found comparable effects among software developers using GitHub Copilot, who completed entry-level tasks 55% faster than the control group.”
From How Creative Is AI Writing? Generative and Collaborative AI in Japanese Fiction (2026) · cites this paper as Peng et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Dell’Acqua et al. [1] and Peng et al. [2] demonstrated that these tools can streamline research processes, enhance productivity, and allow experts to focus on higher-level analytical tasks.”
From Integrating large language models in biostatistical workflows for clinical and translational research (2025) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior studies show that generative AI can enhance individual developer productivity, measured as the amount of code generated per developer (i.e., intensive margin)”
From The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilot (2024) · cites this paper as Peng et al. 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“while reducing expected costs by lowering the time and effort required to complete development tasks.”
From The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilot (2024) · cites this paper as Peng et al. 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior studies on generative AI generally show that lower skilled individuals benefit more from AI tools because AI reduces task completion costs (e.g., Peng et al. 2023, Cui et al. 2026).”
From The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilot (2024) · cites this paper as Peng et al. 2023
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In fact, a recent study from GitHub, found that Copilot could potentially reduce task completion time by a factor of two [28].”
From Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming (2024) · cites this paper as [28]
The cited source says what the claim attributes to it.
In the citing paper
“For Copilot users, our findings suggest a relatively small increase in average weekly activity; however, there is no statistically significant difference after adopting Copilot, which differs from prior studies (Al-Ahmad et al., 2024; Cui et al., 2024; Peng et al., 2023; Rajbhoj et al., 2024).”
From Developer Productivity With and Without GitHub Copilot: A Longitudinal Mixed-Methods Case Study (2026) · cites this paper as Peng et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Instead, they focus on short-term gains in controlled or semi-controlled settings, either by measuring task completion time (Peng et al., 2023), or by simulating software projects to illustrate how GenAI tools can assist developers during different phases of the development process (Al-Ahmad et al., 2024; Rajbhoj et al., 2024).”
From Developer Productivity With and Without GitHub Copilot: A Longitudinal Mixed-Methods Case Study (2026) · cites this paper as Peng et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“For example, Peng et al. (2023) found that participants with access to GitHub Copilot completed standardized programming tasks 55.8% faster.”
From Developer Productivity With and Without GitHub Copilot: A Longitudinal Mixed-Methods Case Study (2026) · cites this paper as Peng et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“GenAI solutions like GitHub Copilot have been shown to increase the productivity of software developers.”
From AI-Assisted Programming Decreases the Productivity of Experienced Developers by Increasing the Technical Debt and Maintenance Burden (2025) · cites this paper as Peng et al. 2023
The cited source says what the claim attributes to it.
In the citing paper
“Because AI tools can lower the skill barrier for writing code (Dakhel et al. 2023)”
From AI-Assisted Programming Decreases the Productivity of Experienced Developers by Increasing the Technical Debt and Maintenance Burden (2025) · cites this paper as Peng et al. 2023
The cited source says what the claim attributes to it.
In the citing paper
“These maintenance-related concerns are amplified by evidence that less experienced programmers appear to benefit more from the use of Copilot.”
From AI-Assisted Programming Decreases the Productivity of Experienced Developers by Increasing the Technical Debt and Maintenance Burden (2025) · cites this paper as Peng et al. 2023
The cited source says what the claim attributes to it.
In the citing paper
“Controlled experiments measure productivity gains of roughly 56% on isolated coding tasks (Peng et al., 2023)”
From Indie at Scale: How Large Language Models Make Community-Centered Game Development Economically Viable (2026) · cites this paper as Peng et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“GenAI coding assistants have demonstrated considerable potential to enhance developer productivity.”
From The Effects of GitHub Copilot on Computing Students' Programming Effectiveness, Efficiency, and Processes in Brownfield Coding Tasks (2025) · cites this paper as [28]
The cited source says what the claim attributes to it.
In the citing paper
“Cui et al. (2025); Gambacorta, Qiu, Shan, and Rees (2024); Peng, Kalliamvakou, Cihon, and Demirer (2023) document strong productivity increases for software development tasks, again with larger gains among less experienced developers.”
From Labor Market Consequences of Generative AI: Early Evidence from Norway (2026) · cites this paper as Peng, Kalliamvakou, Cihon, and Demirer (2023)
The cited source says what the claim attributes to it.
In the citing paper
“Contrary to previous work finding significant uplift or speedup of AI assistance for coding [Peng et al., 2023, Cui et al., 2024], our results do not show a significant improvement in productivity if we only look at the total completion time across the treatment and control groups.”
From How AI Impacts Skill Formation (2026) · cites this paper as Peng et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“significant productivity gains-often exceeding 15%-documented by RCTs in our study occupations”
From Still Waters, Rapid Currents: Early Labor Market Transformation under Generative AI (2025) · cites this paper as Peng et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“First, our reported time savings are highest precisely in the occupations covered by RCTs, such as customer and IT support (Brynjolfsson, Li and Raymond, 2025), marketing and human resources (Noy and Zhang, 2023), and software development (Peng et al., 2023).”
From Still Waters, Rapid Currents: Early Labor Market Transformation under Generative AI (2025) · cites this paper as Peng et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Peng et al. [10] and Paradis et al. [11] find 56% and 21% speedups on coding tasks when using AI assistance”
From Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (2025) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Frontier AI systems demonstrate impressive capabilities on a wide range of software benchmarks [3; 4; 5; 6; 7; 8; 9] and in experiments measuring AI's impact on developer productivity when completing synthetic tasks [10; 11].”
From Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (2025) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“For example, Peng et al. [10] asks developers to implement a very basic HTTP server in JavaScript to satisfy several automatic test cases that are shown to the developers-this task is a) unrepresentative of most software development work, and b) likely to be similar to a large amount of LLM training data, which may unfairly advantage AI systems relative to humans.”
From Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (2025) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Peng et al. [10] | ↑ 56% faster”
From Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (2025) · cites this paper as Peng et al. [10]
The cited source says what the claim attributes to it.
In the citing paper
“We hypothesize that analogously, AI helps our developers less compared to existing literature [10; 11] because our developers have substantially more experience on their respective repositories (5 years and 1,500 commits on average).”
From Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (2025) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“We note that limited token spend would not explain the difference between our results and other work that find positive speedup for programming tasks [10; 17].”
From Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (2025) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“We hypothesize that analogously to these size and complexity effects within our study, AI broadly helps our developers less compared to existing randomized controlled trials (RCTs) measuring speedup from AI tools because of the overall size and complexity of the repositories included”
From Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (2025) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“In a controlled experiment with 95 professional developers, Peng et.al. [9] found that access to GitHub Copilot led to a 55.8% reduction in task completion time for implementing an HTTP server, with less experienced and older developers benefiting the most.”
From Towards Decoding Developer Cognition in the Age of AI Assistants (2025) · cites this paper as [9]
The cited source says what the claim attributes to it.
In the citing paper
“The 34.9% reduction in task completion time and 26.2% improvement in test pass rates align with previous studies of the impact of GenAI programming assistants on both professional programmers [26, 28] and undergraduate students [13, 32] in greenfield programming scenarios.”
From The Effects of GitHub Copilot on Computing Students' Programming Effectiveness, Efficiency, and Processes in Brownfield Coding Tasks (2025) · cites this paper as [28]
The cited source says what the claim attributes to it.
In the citing paper
“The authors report that the treatment group completed the task 55.8% faster on average.”
From Echoes of AI: Investigating the downstream effects of AI assistants on software maintainability (2026) · cites this paper as Peng et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“GitHub's research (Peng et al. 2023), which reported a 55% improvement.”
From Echoes of AI: Investigating the downstream effects of AI assistants on software maintainability (2026) · cites this paper as Peng et al. 2023
The cited source says what the claim attributes to it.
In the citing paper
“For example, Peng et al. (2023) reported a 55.8% speedup when implementing an HTTP server in JavaScript;”
From Echoes of AI: Investigating the downstream effects of AI assistants on software maintainability (2026) · cites this paper as Peng et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“The early work by Peng et al. (2023) reported that junior developers benefited the most from GitHub Copilot,”
From Echoes of AI: Investigating the downstream effects of AI assistants on software maintainability (2026) · cites this paper as Peng et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“Developers who used Copilot completed a JavaScript-based task 55.8% faster than those who did not have access to the tool”
From How do Copilot Suggestions Impact Developers' Frustration and Productivity? (2025) · cites this paper as Peng et al. [12]
The cited source says what the claim attributes to it.
In the citing paper
“For example, a controlled experiment by Peng et al. (2023) found that GitHub Copilot, a generative AI programming aid, significantly boosted productivity: the group using Copilot completed programming tasks approximately 56% faster than the control group without access to the tool.”
From Large language models at work in China’s labor market (2025) · cites this paper as Peng et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“Other shortcomings include missing nuance or understanding of the impact of AI tools by developer- or task-level contexts (e.g., [13]), limited tool and task complexity in experimental settings (e.g., using GitHub Classroom rather than a more naturalistic developer environment [12]), and small sample sizes (e.g., only 32 participants in [15], 24 participants in [16], or 21 participants in [17]).”
From How Much Does AI Impact Development Speed? an Enterprise-Based Randomized Controlled Trial (2025) · cites this paper as [16]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“their operational and environmental costs pose significant challenges [6, 30].”
From A Transformer-Based Approach for Smart Invocation of Automatic Code Completion (2024) · cites this paper as [30]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Our results are consistent with those of Peng et al. (2023)”
From Echoes of AI: Investigating the downstream effects of AI assistants on software maintainability (2026) · cites this paper as Peng et al. 2023
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Peng et al. [12] showed that Copilot's suggestions are perceived as invasive by experienced developer.”
From How do Copilot Suggestions Impact Developers' Frustration and Productivity? (2025) · cites this paper as [12]
Experimental — accuracy not yet measured
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 2
- [4]4. Athey, S. and Imbens, G. W. (2015). Machine learning methods for estimating heterogeneous causal effects. stat, 1050(5):1-26.
- [24]24. Raj, M. and Seamans, R. (2018). Artificial intelligence, labor, pro- ductivity, and the need for firm-level data. In The economics of artificial intelligence: An agenda, pages 553-565. University of Chicago Press.
Cited by
Sorted by citations
Items 201–300 of 340
Dept, I. M. F. A. A. P. (2024) · IMF Staff Country Reports · doi:10.5089/9798400283833.002 · Cited by 2
Kobelev, S. V., Морозкин, А. А., & Kharitonova, E. A. (2024) · Vocational education and labour market · doi:10.52944/port.2024.59.4.007 · Cited by 2
Generative AI for Smart Contracts in Real Estate Business
Zhao, W., Pobbathi, L., Ramprasath, S., & Patibandla, M. (2024) · International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa63982.2024.00018 · Cited by 2
Ouhnine, I. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-1737-3.ch003 · Cited by 2
Gpt-3.5 Hallucinates Nonexistent Citations: Evidence from EconomicsPreprint
Buchanan, J. A., & Shapoval, O. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4472220 · Cited by 2
Humanity Amplified: The Fusion of Deep Learning and Human Insight to Shape the Future of InnovationPreprint
Bauschard, S., & Quidwai, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4621210 · Cited by 4
Raj, M., & Seamans, R. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4690434 · Cited by 2
Artificial intelligence and the changing demand for skills in Canada
Green, A. J. (2024) · OECD artificial intelligence papers · doi:10.1787/1b20cdb6-en · Cited by 6
Toward a Human–AI Task Tensor: A Taxonomy for Organizing Work in the Age of Generative AIPreprint
Doshi, A. R., & Moore, A. P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5134721 · Cited by 2
Generative AI in Equilibrium: Evidence from a Creative Goods Marketplace
Goldberg, S., & Lam, H. T. (2025) · doi:10.2139/ssrn.5152649 · Cited by 2
AI and the Future of Work in an Aging EconomyPreprint
Pizzinelli, C., & Tavares, M. M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5345347 · Cited by 2
Aydeniz, M. (2026) · Sociology Compass · doi:10.1111/soc4.70230 · Cited by 1
Towards Decoding Developer Cognition in the Age of AI Assistants
Haque, E. A., Brown, C., LaToza, T. D., & Johnson, B. (2025) · arXiv · doi:10.48550/arxiv.2501.02684 · Cited by 1
“[9] found that access to GitHub Copilot led to a 55.8% reduction in task completion time for implementing an HTTP server, with less experienced and older developers benefiting the most.”
InfluentialDoes Few-Shot Learning Help LLM Performance in Code Synthesis?
Xu, D., Xie, T., Xia, B., Li, H., Bai, Y., Sun, Y., & Wang, W. (2024) · arXiv · doi:10.48550/arxiv.2412.02906 · Cited by 3
“In just a few months, LLMs exhibit zero-shot abilities in code completion (Peng et al., 2023), code generation (Roziere et al., 2023; Guo et al., 2024; Dubey et al., 2024), test case generation (Vikram et al., 2023; Lemieux et al., 2023; Schäfer et al., 2023), debugger interaction (Islam et al.,…”
Xu, F., Medappa, P. K., Tunc, M. M., Vroegindeweij, M., & Fransoo, J. C. (2025) · arXiv · doi:10.48550/arxiv.2510.10165 · Cited by 27
To Ban or Not to Ban? How Open Source Projects Govern GenAI Contributions
Yang, W., He, R., & Zhou, M. (2026) · Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3832783.3837448 · Cited by 1
Navigating the Landscape of Generative AI: Investment Trends, Industry Growth, and Economic Effects
Kshetri, N. (2024) · IT Professional · doi:10.1109/mitp.2024.3375569 · Cited by 1
Forsthofer, N., & Kunc, O. (2025) · AIAA SciTech Forum · doi:10.2514/6.2025-1791 · Cited by 1
LLMs as Evaluators: A Novel Approach to Commit Message Quality Assessment
Kumar, A., Sankar, S., Haiduc, S., Das, P. P., & Chakrabarti, P. P. (2025) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1109/icse-nier66352.2025.00028 · Cited by 2
L’appropriation de l’intelligence artificielle générative (IAG) par les salariés en entreprise
Bencherqui, D. B., Chaari, J., Flanchec, A. L., & Servayre, A. M. (2025) · Vie & sciences de l entreprise · doi:10.3917/vse.224.0013 · Cited by 1
Engineering Environmental Legislative-Guided LLM to Support Waste Management Learning
Sun, Q., & Hsiao, I. (2025) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai64502.2025.00066 · Cited by 1
Leveraging the Power of Images: Image Recommendation to Enhance Issue Reports
Tan, X., Gengiti, D., & Nayebi, M. (2025) · Software Practice and Experience · doi:10.1002/spe.70010 · Cited by 1
Thompson, H. A. (2025) · Kyklos · doi:10.1111/kykl.70016 · Cited by 2
Qiao, D., Rui, H., & Qian, X. (2026) · Journal of Management Information Systems · doi:10.1080/07421222.2025.2602400 · Cited by 4
Toward LLM-aware software effort estimation: a conceptual framework
Alaswad, F., Poovammal, E., & Aljaddouh, B. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1772418 · Cited by 1
Artificial Intelligence-Based Digital Transformation
Volpentesta, T. (2026) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80592-096-020261002 · Cited by 1
Houck, B., Lowdermilk, T., Beyer, C., Clarke, S., & Hanrahan, B. (2026) · Queue · doi:10.1145/3807964 · Cited by 14
Brandebusemeyer, C., Zunic, K., Zimmermann, T., Schimmer, T., & Bert Arnrich, A. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3847122 · Cited by 5
Subramanya, S., Krishnan, S., & Azad, N. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10804-5 · Cited by 2
Disruption of the research software landscape through AI software generation
Medina, N. D., & Kornfeld, J. M. R. (2026) · Nature Methods · doi:10.1038/s41592-026-03210-x · Cited by 1
Alakmeh, T., D’Angelo, S., & Fritz, T. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3774748.3787608 · Cited by 1
An Eye for AI: Eye-Tracking the Micro-Interruptions of GenAI Code Suggestions
Alakmeh, T., D’Angelo, S., & Fritz, T. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773132 · Cited by 1
IA GÉNÉRATIVE : RÉVOLUTION OU MENACE POUR LES ENTREPRISES DES SERVICES DU NUMÉRIQUE (ESN) ?
Blangeois, M. (2023) · Management & Data Science · doi:10.36863/mds.a.26672 · Cited by 1
Introducing SpectraFit: An Open-Source Tool for Interactive Spectral Analysis
Hahn, A. W., Zsombor-Pindera, J., Kennepohl, P., & DeBeer, S. (2024) · ACS Omega · doi:10.1021/acsomega.3c09262 · Cited by 1
Gilstrap, C. A., Bačić, D., & Gilstrap, C. M. (2024) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro60963.2024.10569536 · Cited by 1
Abedu, S., Khatoonabadi, S., & Shihab, E. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3796510 · Cited by 4
Velpucharla, T. R. (2025) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit251112219 · Cited by 1
Artificial Intelligence and Innovation
Krzywdzinski, M., Schneiß, D., & Weisenburger, P. (2025) · Springer eBooks · doi:10.1007/978-3-031-25143-6_75-1 · Cited by 1
GPT-3.5 Hallucinates Nonexistent Citations: Evidence from EconomicsPreprint
Buchanan, J. A., & Shapoval, O. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4467968 · Cited by 1
AI-Duction for Organizational Theory Building: (How) can we Overcome Ontological Neglect with AI?
Castelló, I., & White, L. (2023) · Academy of Management Proceedings · doi:10.5465/amproc.2023.18589abstract · Cited by 1
Machines and Superstars: Implications of Technological Change for Top Labor IncomesPreprint
Suh, D. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4640513 · Cited by 1
Randomized Controlled Trials for Microsoft Copilot for SecurityPreprint
Edelman, B. G., Bono, J., Peng, S., Rodriguez, R., & Ho, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4648700 · Cited by 5
Self-citationFang, B., & Lin, P. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4787265 · Cited by 1
Assessing Open Source Software Developer's Opportunity Costs in a Time of Generative AIPreprint
Li, X., Costello, F. J., Kim, K., & Zhang, X. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5100609 · Cited by 4
Labor Market Signals: The Role of Large Language ModelsPreprint
Nejad, K. A., Musillo, G., Wicker, T., & Zaccaria, N. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5185035 · Cited by 1
Predictive AI and Productivity Growth Dynamics: Evidence from French FirmsPreprint
Fontanelli, L., Guerini, M., Miniaci, R., & Secchi, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5219549 · Cited by 1
Artificial Intelligence and Technological Unemployment
Wang, P., & Wong, T.-N. (2025) · National Bureau of Economic Research · doi:10.3386/w33867 · Cited by 2
Co-Intelligent Design of Catalysis Research with Large Language Models: Hype or Reality?Preprint
Balcells, D. (2025) · ChemRxiv · doi:10.26434/chemrxiv-2025-5d76r-v2
Effectiveness of LLM-based AI Assistance for small business productivityPreprint
Sinayev, A., & Courtney, C. (2025) · Research Square · doi:10.21203/rs.3.rs-6481789/v1 · Cited by 1
Preparing for AI in the BPO and ITES Sector in Africa
Caribou, Analytics, G., Scott, C. L., Natabaalo, G., Donner, J., & Beardsley, J. (2025) · doi:10.64329/kptc3442 · Cited by 1
Echoes of AI: Investigating the downstream effects of AI assistants on software maintainability
Borg, M., Hewett, D., Hagatulah, N., Couderc, N., Söderberg, E., Graham, D., Kini, U., & Farley, D. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10889-1 · Cited by 4
AgenticFlict: A Large-Scale Dataset of Merge Conflicts in AI Coding Agent Pull Requests on GitHub
Ogenrwot, D., & Businge, J. (2026) · Proceedings of the 3rd ACM International Conference on AI-Powered Software · doi:10.1145/3805760.3814923
Qarkaxhija, J. (2026) · doi:10.31235/osf.io/m75hn_v1
“In a controlled experiment with 95 professional developers implementing an HTTP server in JavaScript, the group with access to GitHub Copilot completed the task 55.8 % faster than the con-trol group [5].”
InfluentialLi, Z., Li, Z., Guo, Z., Ren, X., & Huang, C. (2025) · arXiv · doi:10.48550/arxiv.2512.07921
“AI-assisted coding tools such as Cursor and Codex have already transformed everyday development practice by automating routine implementation tasks and offering intelligent inline suggestions [3, 4].”
How do Copilot Suggestions Impact Developers' Frustration and Productivity?
Guglielmi, E., Arnoudova, V., Bavota, G., Oliveto, R., & Scalabrino, S. (2025) · arXiv · doi:10.48550/arxiv.2504.06808 · Cited by 1
“Based on empirical evidence from previous exploratory studies [4], [11], [12], in this paper we propose two theories.”
InfluentialCodeCRDT: Observation-Driven Coordination for Multi-Agent LLM Code Generation
Pugachev, S. (2025) · arXiv · doi:10.48550/arxiv.2510.18893 · Cited by 13
“LLM-based code generation shows significant productivity improvements (e.g., GitHub Copilot improves productivity 55.8% (Peng et al., 2023)); multi-agent approaches show promise through role distribution.”
InfluentialHelwig, M. (2026) · arXiv · doi:10.48550/arxiv.2609.05510
“The genre runs from population-scale telemetry [Ziegler 2024; Peng 2023] through org-scale deployment reports (25 months of GenAI telemetry at WhatsApp [WhatsCode 2026], LLM-driven migrations at Google [GoogleMigrate 2025]) to RCTs whose disagreement about productivity [METR-RCT 2025] underlines…”
Labor Market Consequences of Generative AI: Early Evidence from Norway
Facius, D., & Iacono, R. (2026) · CESifo Working Papers · doi:10.65864/8a4auliirt
Why Are AI Agent–Involved Pull Requests (Fix-Related) Remain Unmerged? An Empirical Study
Alam, K., Mondal, S., & Roy, B. (2026) · Proceedings of the 23rd International Conference on Mining Software Repositories · doi:10.1145/3793302.3793611
Experimental Evidence on the Learning Impact of Generative AI
Contractor, Z., & Reyes, G. (2026) · arXiv · doi:10.48550/arxiv.2607.08849
How Creative Is AI Writing? Generative and Collaborative AI in Japanese Fiction
Asano, Y., & Bastos, M. (2026) · Journal of Creative Communications · doi:10.1177/09732586261463934
Ernst Denert Award for Software Engineering 2022
Bodden, E., Felderer, M., Hasselbring, W., Herber, P., Koziolek, H., Lilienthal, C., Matthes, F., Prechelt, L., Rumpe⋆, B., & Schaefer, I. (2024) · Springer eBooks · doi:10.1007/978-3-031-44412-8
Artificial Intelligence Affordances: Implications for EntrepreneurshipPreprint
Chawla, C., & Kim, S.-I. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4478775
Hiterer, D., & McGourty, J. (2023) · Social Science Research Network · doi:10.2139/ssrn.4671381
Design e as Inteligências Artificiais Gerativas: uma revisão sistemática de literatura
Antão, G. A. D. O., de Siqueira, N. M., & Silva, T. B. P. E. (2023) · doi:10.5151/cidiconcic2023-15_649304
Ernst Denert Software Engineering Award 2022
Bodden, E., Felderer, M., Hasselbring, W., Herber, P., Koziolek, H., Lilienthal, C., Matthes, F., Prechelt, L., Rumpe⋆, B., & Schaefer, I. (2024) · Springer eBooks · doi:10.1007/978-3-031-44412-8_1
Wei, J., & Peng, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4776391
Self-citationSzilágyi, R. (2024) · Rendvédelem · doi:10.53793/rv.2024.1.5 · Cited by 1
VADER-SC: A Model Agnostic Tool for Large Scale, AI Driven Automated Source Code Summarization
Horne, D., Pierson, A., Hedary, E., Freddo, G., Trejo, L., Matis, M., & Mask, L. (2023) · Congress in Computer Science, Computer Engineering, and Applied Computing (CSCE) · doi:10.1109/csce60160.2023.00416
Wei, J., & Peng, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4790326
Self-citationA Policy Simulation Experiment on Innovations and OpenAI-Driven Labour Force-Growth Nexus
Adedoyin, F. F., Ogunbiyi, V. O., Adebiyi, A., & Oluokun, E. O. (2024) · Advances in logistics, operations, and management science book series · doi:10.4018/979-8-3693-1198-1.ch006
An Analysis Method for the Impact of GenAI Code Suggestions on Software Engineers’ Thought Processes
Yonekawa, T., Yamano, H., & Sakata, I. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v3i1.31257
AI and Productivity: The Impact of ChatGPT's Release on BloggingPreprint
Kaisen, J., Li, M., & Lu, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4858507
Generative AI and Firm-level Productivity: Evidence from Startup Funding DynamicsPreprint
Heller, D., & Asam, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4877505
Artificial Intelligence, Tasks, Skills, and Wages: Worker-Level Evidence from GermanyPreprint
Koch, M. R., Engberg, E., Lodefalk, M., & Schroeder, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4883794
Who Benefits from AI? Project-level Evidence on Labor Demand, Operations and ProfitabilityPreprint
Yilmaz, E. D., & Peukert, C. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4939276
Ojha, P. R. (2024) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit241051031 · Cited by 1
Aplicativo Móvel para Gestão de Operações em Áreas Agrícolas
Cordeiro, B. E. F., Andrade, J. D. S., Bazzi, C. L., Schenatto, K., & Sobjak, R. (2024) · Congresso Latino-Americano de Software Livre e Tecnologias Abertas (Latinoware) · doi:10.5753/latinoware.2024.245571
Jobs Exposure to Generative AI: Ongoing Study by NASK-PIB and ILO
Troszyński, M. (2024) · Applied Cybersecurity & Internet Governance · doi:10.60097/acig/201152
Preparing Future Engineers: Strategies for Integrating AI Platforms in Higher Education
Kok, C. L., Ho, C. K., Koh, Y. Y., Thanh, N. T. C., & Teo, T. H. (2024) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon61640.2024.10902925
Fisher, M., & Severini, J. (2025) · arXiv.org · doi:10.1093/9780198945215.003.0077 · Cited by 1
El Impacto de las IA Generadoras de Código en el Trabajo de los Programadores
Verastegui, K. R., Ruiz, E. T., & Villanueva, M. T. (2025) · Innovación y software · doi:10.48168/innosoft.s23.a228
Shifting Work Patterns with Generative AIPreprint
Dillon, E. W., Jaffe, S., Immorlica, N., & Stanton, C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5216904
Predicting the Future of Work: Lay Beliefs about Job AutomationPreprint
Abilova, A., Tuk, M. A., Puntoni, S., & Ferecatu, A. (2025) · Research Square · doi:10.21203/rs.3.rs-6464311/v1
Trabajo humano e inteligencia artificial: el desafío de la complementariedad
Llados-Masllorens, J. (2025) · Oikonomics · doi:10.7238/o.n24.2507
When expert advice fails to reduce the productivity gap: Experimental evidence from chess players
Bouacida, E., Foucart, R., & Jalloul, M. (2025) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2025.107124
Huang, H., Meng, J., & He, X. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5341517
The Economics of Bicycles for the MindPreprint
Agrawal, A. K., Gans, J. S., & Avi Goldfarb, B. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5350364
Huang, H., & Meng, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5341505
The Impact of Artificial Intelligence on Programmer Jobs: Threat or Opportunity?
Hananto, A., Hasibuan, N. S., Olivia, S., Tukino, T., & Novalia, E. (2025) · JUSIFO (JURNAL SISTEM INFORMASI) · doi:10.19109/jusifo.v11i1.25082 · Cited by 1
Automation with Generative AI? Evidence from a Teacher Hiring PipelinePreprint
Krenk, U., Yanagizawa-Drott, D., & Awuah, K. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5351335
AI in the Office and the Factory: Evidence from Administrative Software Registry DataPreprint
de Souza, G. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5375463
Zhuchkov, K. N. (2025) · International Journal of Latest Engineering and Management Research (IJLEMR) · doi:10.56581/ijlemr.10.07.21-27
GENERATIVE AI TECHNOLOGIES IN PHOTOGRAPHY AND VIDEO RECORDING OF WEDDING EVENTS
KHARA, S. (2025) · Humanities science current issues · doi:10.24919/2308-4863/87-3-23
Generative AI and Income Growth: Early Evidence on Global Data
Venturini, F. (2025) · Gospodarka Narodowa · doi:10.33119/gn/203715
Designing Human-Centered Code Completion Tools in the Age of Generative AI
Desolda, G., Esposito, A., Greco, F., Tucci, C., Buono, P., & Piccinno, A. (2025) · Biannual Conference of the Italian SIGCHI Chapter (CHItaly) · doi:10.1145/3750069.3755957
Kim, J., & Yim, J. (2025) · Journal of Digital Contents Society · doi:10.9728/dcs.2025.26.10.2683
Song, M.-S., & Bae, H.-Y. (2026) · Journal of Digital Contents Society · doi:10.9728/dcs.2026.27.2.449
Cha, S., Jo, S., Shin, J., & Seo, K. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798616
Maintaining Control States for Initialization-Aware GRPO in Industrial LLM Workflows
Liu, C., Yuan, Z., 范奉媛, Che, L., Qian, Q., Liang, Q., Sun, Z., & Zhang, L. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834459
Metadata
- Authors
- Peng, S., Kalliamvakou, E., Cihon, P., & Demirer, M.
- Affiliations
- Microsoft (United States) (US)
- Massachusetts Institute of Technology (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2302.06590
- OpenAlex
- W4320854981
- Semantic Scholar
- 15abedb29536d50afeeec739a25358255cbda3e8
- Cited by
- 287
- References
- 0
- Citations by year
- 2026: 52 · 2025: 88 · 2024: 96 · 2023: 50
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Computer Science Applications › Open Source Software Innovations
- Keywords
- GitHub Copilot, generative AI, developer productivity, software development, JavaScript, treatment effect heterogeneity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
