CoChat

AgenticFlict: A Large-Scale Dataset of Merge Conflicts in AI Coding Agent Pull Requests on GitHub

Open access
Ogenrwot, Daniel, Businge, John · 2026 · Proceedings of the 3rd ACM International Conference on AI-Powered Software

The DOI matches its Crossref record; 51 of the 70 references it cites were found in a registry or an index, and 6 are not checked yet; 6 of the 28 sources its claims cite were checked for support.

Abstract

Software Engineering 3.0 marks a paradigm shift in software development, in which AI coding agents are no longer just assistive tools but active contributors. While prior empirical studies have examined productivity gains and acceptance patterns in AI-assisted development, the challenges associated with integrating agent-generated contributions remain less understood. In particular, merge conflicts, a fundamental aspect of collaborative software development, remain underexplored in this context. In this paper, we present AgenticFlict, a large-scale dataset of textual merge conflicts in AI coding agent pull requests (Agentic PRs). The dataset comprises 142K+ Agentic PRs collected from 59K+ repositories, of which 107K+ are successfully processed through deterministic merge simulation. Our pipeline identifies 29K+ PRs exhibiting merge conflicts, yielding a conflict rate of 27.67%, and extracts 336K+ fine-grained conflict regions across these instances. Our preliminary exploratory analysis indicates that merge conflicts are both frequent and often substantial in AI-generated contributions, with noticeable variation across agents, emphasizing the need to better understand and manage integration challenges in AI-assisted software development. The dataset, code and supplementary materials are available in zenodo: 10.5281/zenodo.19396916

Verified 2026-10-10 · 6 references not checked yet

Overview

CoChat Summary

TL;DR

AgenticFlict is a large-scale dataset of textual merge conflicts in AI coding agent pull requests on GitHub. Using deterministic merge simulation on 107,026 PRs from 59,412 repositories, the paper finds 29,609 conflicting PRs (27.67%) and 336,380 conflict regions.

Key findings

  • From 142,652 Agentic PRs, the authors successfully simulated merges for 107,026 PRs, a 75.03% success rate; 35,626 PRs were excluded due to missing references or inaccessible repositories.
  • Among successfully simulated PRs, 29,609 had textual merge conflicts, for a conflict rate of 27.67%.
  • Conflicting PRs affected an average of 4.36 files per PR (median 2.00), 11.36 conflict regions per PR, and 540.42 conflicting lines per PR; the dataset contains 336,380 total conflict regions.
  • Conflict rates varied across five AI coding agents: Copilot 15.24%, Cursor 19.75%, Devin 22.85%, Claude_Code 25.93%, and OpenAI_Codex 31.85%. Conflict severity also showed heavy-tailed distributions, and larger PRs had higher conflict rates; for example, median churn of 2 lines corresponded to about 9.9% conflict rate, while median churn of 25 lines corresponded to nearly 30%.

Methods

  • The study builds AgenticFlict from the AIDev dataset: after filtering to open or closed-but-unmerged PRs, it retains 142,652 candidate PRs spanning 59,412 repositories and five AI coding agents.
  • For each PR, the pipeline retrieves GitHub metadata, prepares a local repository clone, and performs deterministic merge simulation with Git (`git merge -no-commit -no-ff <headRefOid>`), using open PR state or reconstructed closure-time base commits for closed unmerged PRs.
  • When merges fail, the authors parse Git conflict markers to extract file-level and region-level conflict metadata, including file paths, line spans, conflict counts, and severity metrics; they also analyze conflict rates by agent and by PR size (code churn).

Limitations

  • The paper states that 35,626 PRs were unrecoverable because of permanently missing references, repository deletion, or access limitations, reducing coverage.
  • It states that the method captures textual conflict markers only, so it does not account for logical inconsistencies or post-merge defects.
  • It states that focusing on open and closed (unmerged) PRs may miss conflicts that occurred and were resolved before merge; this is a stated limitation.
  • Evident from the text: the dataset is built on AIDev and may overrepresent repositories that actively adopt AI tools, so the findings may not generalize to all open-source or industrial settings.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3805760.3814923

Cites

51 of 70 references verified0 citation errors · 13 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

2 Valid · 3 Not valid · 12 Not checked · 47 Own results and interpretations

21 more claims

Create a free account to see all 64 claims and to verify the 7 references still open.

See all claims — free account
  • It may state two separate claims as one. 25
  • Probably not a substantial claim. 17
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 70 references

Cited by

See all 6

Metadata

Authors
Ogenrwot, D., & Businge, J.
Affiliations
University of Nevada, Las Vegas (US)
Venue
Proceedings of the 3rd ACM International Conference on AI-Powered Software
Publisher
ACM
Published
2026-07-05
Pages
323-331
OpenAlex
W7161290748
Cited by
0
References
58
FWCI
0.00
Type
conference paper
Language
en
Open access
Locations
  • ACM International Conference on AI-Powered Software (AIware) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
National Science Foundation (2519136, 2117941)
Topics
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
  • Physical Sciences › Computer Science › Computer Science Applications › Open Source Software Innovations
Keywords
merge conflicts, coding agents, pull requests, GitHub, AI-assisted software development, conflict zones, collaborative software development

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AgenticFlict: A Large-Scale Dataset of Merge Conflicts in AI Coding Agent Pull Requests on GitHub. https://app.cochat.ai/papers/10.1145/3805760.3814923
The paper
Ogenrwot, D., & Businge, J. (2026). AgenticFlict: A Large-Scale Dataset of Merge Conflicts in AI Coding Agent Pull Requests on GitHub. Proceedings of the 3rd ACM International Conference on AI-Powered Software. https://doi.org/10.1145/3805760.3814923

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.