You can contribute if you... An Empirical Framework of AI Contribution Policies in OSS
Open accessAbstract
Artificial intelligence is reshaping open source software (OSS) contribution by lowering the cost of producing code, documentation, issue reports, and review interactions. This creates opportunities for broader participation, but also disrupts how maintainers assess contributor effort, competence, and accountability. In response, OSS projects are beginning to regulate AI-mediated contribution through contribution guidelines and other project documentation. This paper presents an empirical study of these emerging policies. We analyze project policies on AI-mediated contributions by evaluating their underlying rationales, rules, and expectations. Our analysis shows that these policies seek to protect scarce maintainer attention, preserve accountability, sustain meaningful review interactions, address legal and quality concerns, and maintain pathways for newcomer learning. Based on these findings, we introduce the AI Contribution Governance Framework, which organizes recurring concerns and governance mechanisms across projects. The framework helps OSS communities develop AI contribution policies and provides researchers with a vocabulary for studying how AI is changing collaborative software production.
AI snapshot
Written from the paper’s full text.
TL;DR
This paper empirically analyzes how OSS projects govern AI-mediated contributions, coding policies from 209 unique projects and deriving the AI Contribution Governance Framework. It finds projects prohibit, regulate, or permit AI for different rationales—maintainer burden, code quality, legal/IP, learning, community, and ethics—and that regulated policies center on contributor understanding and accountability.
Key findings
- Across 209 unique projects (118 from the HR dataset plus 106 from the MelissaWM dataset, with 15 overlapping), the HR dataset skews permissive: 69% allow AI use, while the MelissaWM dataset is more restrictive, with 36% prohibiting any AI use.
- Among projects prohibiting AI, the dominant rationales are maintainer burden (34 projects, 81%), code quality/correctness (33, 79%), copyright/IP/licensing uncertainty (24, 57%), DCO/authorship certification (15, 36%), community trust/culture (15, 36%), learning/contributor development (14, 34%), ethics/labour/consent/environment (8, 19%), and security (3, 7%). The discussion reports 42 prohibiting projects: 18 prioritize quality, 16 cite legal uncertainty, and 8 reject AI on ethical principles.
- Among projects regulating AI, code quality/contributor understanding (34 projects, 100%) and maintainer burden/review cost (30, 88%) are near-universal; human-human interaction/community dialogue appears in 14 (41%), copyright/IP in 9 (26%), and explicit contributor learning in 12. Projects permitting AI gave no rationale for their stance, focusing only on procedural requirements such as disclosure, testing, understanding, and human-to-human interaction.
- Few policies differentiate contributors: 17 projects (8%) explicitly distinguish new versus regular contributors, with five allowing maintainer exemptions, six using accepted-issue gates, six protecting good-first issues, three applying stricter rules to mentorship-programme contributors, and four relying on implicit trust. Virtually no policy distinguishes bug fixes from new features; DuckDB is the sole project in the 209 set that does so explicitly. An inversion appears in bug reports: projects permissive about AI-mediated code are often strictest about AI-written issue descriptions (NumPy, SciPy, SymPy, Matplotlib, Jellyfin, searxng, and Zulip permit disclosed AI code but prohibit AI-written issue descriptions).
Methods
- The study follows a dual approach inspired by legal positivism and natural law: RQ1 empirically analyzes published OSS contribution guidelines and AI policies, while RQ2 performs an empirically grounded conceptual synthesis to derive the AI Contribution Governance Framework.
- Data combine two sources: the HR dataset from Hora and Robbes’ replication package, containing 118 AI policies from the 1,000 most-starred GitHub repositories meeting criteria of at least 100 commits, non-fork status, and at least one commit in 2026; and the MelissaWM community-curated list of 106 projects. The datasets share 15 projects, yielding 209 unique projects.
- A manual analysis of 12 randomly selected projects until saturation produced an analysis template (Table I), which was transformed into a prompt for Claude Code (Opus 4.7). LLM output was treated as a preliminary baseline, followed by comprehensive manual verification of every case and triangulation with the original dataset authors. RQ2 used iterative author discussion and synthesis, with a design requirement that the framework remain formative rather than prescriptive.
Limitations
- Stated internal validity threats: some policies lacked formal documentation, and consequential statements sometimes appeared in informal channels such as blog posts or public statements (e.g., curl and LadybirdBrowser); many policy texts were brief or sparse, making intent difficult to interpret. The authors used manual verification and triangulation against the original dataset authors’ classifications.
- Stated external validity threat: the results should not be interpreted as estimating the prevalence of AI contribution policies, policy types, or governance mechanisms across all OSS; the sources do not support statistical generalization. The study also focuses only on projects that have adapted their policies, leaving unknown whether non-adapting projects face AI-related governance issues.
- Stated construct validity threat: the conceptual leap from policy evidence to framework construction means some framework dimensions go beyond explicit policy wording, risking a framework that is either too close to the data or too theoretical. The authors mitigate this by separating observed policy mechanisms from inferred governance issues and presenting the framework as an empirically grounded conceptual tool. Evident from the text: LLM-assisted coding produced discrepancies in project categorization, requiring manual reclassification, and the dataset was curated for diversity rather than representativeness.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 87 cited sources checked · 0 supported · 0 flagged
- Findingown data
Projects citing maintainer burden treat it as an existential threat to sustainability.
“Projects citing this reason treat it as an existential threat to sustainability.”
Quote in the paperNot a substantial claim - Findingown data
The HR dataset skews heavily toward AI policies that allow the use of AI (69%).
“with the HR dataset skewing heavily toward AI policies that allow the use of AI (69%)”
Quote in the paperNot a substantial claim - Findingown data
Copyright, IP & licensing uncertainty is the third most frequent reason for prohibiting AI (24 projects, 57%).
“The third most frequent reason refers to Copyright, IP & licensing uncertainty (24 projects & 57%)”
Quote in the paperNot a substantial claim - Findingown data
Code quality & correctness is the second most frequent rationale for prohibiting AI (33 projects, 79%).
“Code quality & correctness (33 projects, 79%) comes second”
Quote in the paperNot a substantial claim - Findingreasoning
Projects with high quality standards see AI as incompatible with their quality culture, not merely inconvenient.
“Projects with high quality standards see AI as incompatible with their quality culture, not merely inconvenient.”
Quote in the paperSubstantial claim
- Findingown data
15 projects (36%) cite DCO/authorship certification as a reason for their AI contribution policy.
“The fourth rational is related to DCO / authorship certification (15 projects, 36%), as the Developer Certificate of Origin (DCO) requires contributors to legally certify they have the right to submit the code under the project's license.”
Quote in the paperNot a substantial claim - Findingown data
The dominant and near-universal rationale for prohibiting AI is maintainer burden (34 projects, 81%).
“The dominant and near-universal rationale is the one we have called Maintainer burden (34 projects, 81%).”
Quote in the paperSubstantial claim - Findingown data
The MelissaWM dataset exhibits a more restrictive stance, featuring 36% that prohibit any AI use.
“while the MelissaWM dataset exhibits a more restrictive stance, featuring a 36% that prohibit any AI use.”
Quote in the paperNot a substantial claim - Findingown data
Learning is framed in the 'regulated' group as an important outcome of understanding and getting integrated in a project.
“Learning is framed in the”
Quote in the paperNot a substantial claim - Findingown data
The results identify the range of governance issues, policy mechanisms, and tensions that appear in current AI contribution policies.
“Instead, the results identify the range of governance issues, policy mechanisms, and tensions that appear in current AI contribution policies.”
Quote in the paperSubstantial claim - Findingown data
14 projects (34%) cite Learning & contributor development as a reason for their AI contribution policy.
“The next most frequent reason given is Learning & contributor development (14 projects, 34%).”
Quote in the paperNot a substantial claim - Findingown data
Several projects that regulate AI express concern that AI bypasses the learning loop, the Contributor learning & development group, which is implicit in most projects but explicit only in 12.
“Several projects that regulate the use of AI express concern that AI bypasses the learning loop, the Contributor learning & development group, which is implicit in most projects but explicit only in 12.”
Quote in the paperSubstantial claim - Findingown data
42 projects prohibit the use of AI.
“A higher level view of the results from RQ1 reveal that 42 projects prohibit the use of AI.”
Quote in the paperSubstantial claim - Findingown data
Many OSS communities are regulating AI-mediated contribution in widely different ways, including restriction and outright bans.
“In this study, we show that many OSS communities are regulating AI-mediated contribution in widely different ways, including restriction and outright bans.”
Quote in the paperSubstantial claim - Findingown data
DuckDB is the sole project in the entire 209 set that draws the line explicitly by name between bug fixes and new features.
“DuckDB is the sole project in the entire 209 set that draws the line explicitly by name.”
Quote in the paperSubstantial claim - Findingown data
Only a small number of projects explicitly distinguish between new and regular contributors (17 projects, 8%).
“Only a small number of projects explicitly distinguish between new and regular contributors (17 projects, 8%),”
Quote in the paperNot a substantial claim - Findingown data
15 projects (36%) cite community trust & culture as a fundamental reason for their AI contribution policy.
“Some projects argue that OSS is a social contract where Community trust & culture (15 projects, 36%) is fundamental.”
Quote in the paperNot a substantial claim - Findingnone given
Virtually no policy distinguishes between a bug fix (including addressing an open issue) and a new feature.
“Virtually no policy distinguishes between a bug fix (including addressing an open issue) and a new feature.”
Quote in the paperNot a substantial claim - Findingnone given
Other OSS AI contribution policies are more philosophical, emphasizing authorship, human participation, community identity, or the broader social and environmental effects of AI.
“Others are more philosophical, emphasizing authorship, human participation, community identity, or the broader social and environmental effects of AI.”
Quote in the paperSubstantial claim - Findingown data
Projects in the Ethics category explicitly oppose using AI tools as a matter of ethical and environmental responsibility, independent of the quality or legality of the output.
“Projects in this category explicitly oppose using AI tools as a matter of ethical and environmental responsibility, independent of the quality or legality of the output.”
Quote in the paperSubstantial claim - Findingown data
Projects that permit AI usage focus, if at all, on procedural requirements for contributing, primarily emphasizing disclosure, testing, understanding, and human-to-human interaction.
“These projects focus, if at all, on procedural requirements for contributing, primarily emphasizing disclosure, testing, understanding, and human-tohuman interaction.”
Quote in the paperSubstantial claim - Findingnone given
Some OSS AI contribution policies are pragmatic, focusing on quality, review burden, maintainability, and legal uncertainty.
“Some policies are pragmatic, focusing on quality, review burden, maintainability, and legal uncertainty.”
Quote in the paperSubstantial claim - Findingown data
Projects tend to address copyright implicitly through their disclosure requirements.
“Projects tend to address copyright implicitly through their disclosure requirements.”
Quote in the paperNot a substantial claim - Findingown data
The objection in regulated projects is not to AI tools per se, but to contributors who use them without being able to explain, defend, or take ownership of the output.
“The objection is not to AI tools per se, but to contributors who use them without being able to explain, defend, or take ownership of the output.”
Quote in the paperSubstantial claim - Findingown data
8 projects (19%) group objections to AI under Ethics: labour exploitation, consent & environment.
“The most politically explicit objections to AI are grouped under Ethics: labour exploitation, consent & environment (8 projects, 19%).”
Quote in the paperNot a substantial claim - Findingreasoning
The rationales behind OSS AI contribution policies differ.
“Their rationales also differ.”
Quote in the paperSubstantial claim - Findingown data
The framing in regulated projects is consistently about the contributor failing to understand, not about the AI being untrustworthy in the abstract.
“The framing is consistently about the contributor failing to understand-not about the AI being untrustworthy in the abstract.”
Quote in the paperSubstantial claim - Findingnone given
Six projects, including LLVM and Firefox, protect good-first issues by reserving them for newcomers.
“Six projects, including LLVM and Firefox, protect good-first issues by reserving them for newcomers.”
Quote in the paperNot a substantial claim - Findingnone given
Three projects, including CPython and CCExtractor, apply stricter rules to mentorship-programme contributors such as GSoC participants.
“Three projects, including CPython and CCExtractor, apply stricter rules to mentorship-programme contributors such as GSoC participants.”
Quote in the paperNot a substantial claim - Findingown data
The results of RQ1 show a wide variety of stances regarding the use of AI, both in terms of the problems projects observe and the mechanisms they use to address them.
“The results of RQ1 show a wide variety of stances regarding the use of AI, both in terms of the problems projects observe and the mechanisms they use to address them.”
Quote in the paperSubstantial claim - Findingreasoning
The most relevant finding is the inversion in the bug report dimension: projects that are permissive about AI-mediated code are often strictest about AI-mediated bug report text.
“The most relevant finding is the inversion in the bug report dimension: projects that are permissive about AI-mediated code are often strictest about AI-mediated bug report text.”
Quote in the paperSubstantial claim - Findingreasoning
A major concern in regulated projects is that AI-mediated contributions may make it harder to tell whether the contributor understands the change and thus whether the submission is worth the required review effort.
“A major concern is that AI-mediated contributions may make it harder to tell whether the contributor understands the change and thus whether the submission is worth the required review effort.”
Quote in the paperSubstantial claim - Findingown data
Four projects, including the Linux Kernel and curl, rely on implicit trust: maintainers acknowledge differentiated expectations in practice, even when these distinctions are not formalized in the official policy.
“Finally, four projects, including the Linux Kernel and curl, rely on implicit trust: maintainers acknowledge differentiated expectations in practice, even when these distinctions are not formalized in the official policy.”
Quote in the paperNot a substantial claim - Premisecitation
OSS communities govern participation through documented rules and norms.
“OSS communities govern participation through documented rules and norms.”
Quote in the paperSubstantial claim0 of 7 sources checked- cites [44]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [45]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [46]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [47]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [48]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [3]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [4]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
AI agents are becoming increasingly capable participants in software engineering workflows.
“AI agents are becoming increasingly capable participants in software engineering workflows [12]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Project positioning regarding AI-mediated contributions is still nascent.
“Furthermore, the mentioned study demonstrates that while the topic is widely debated nowadays within the OSS community, project positioning regarding AI-mediated contributions is still nascent.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Pull requests created with the help of AI are already observable at substantial scale in GitHub repositories.
“Recent empirical work shows that pull requests created with the help of AI are already observable at substantial scale in GitHub repositories [9]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [9]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Studies of AI coding tools identify risks involving quality assurance, code complexity, and tool failure modes.
“studies of AI coding tools identify risks involving quality assurance, code complexity, and tool failure modes [10]- [12].”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [10]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [11]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [12]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Before widespread use of AI-mediated development, creating a contribution usually required an investment in time, effort, and project-specific engagement that many attempts never became submissions.
“Before widespread use of AI-mediated development, creating a contribution usually required an investment in time, effort, and project-specific engagement that many attempts never became submissions.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [6]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
AI can help maintainers in the triage and evaluation of submissions.
“and it can help maintainers in the triage and evaluation of submissions.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [9]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
OSS projects depend on multiple contributor types whose motivations and future trajectories differ.
“Studies of one-time, casual, episodic, and peripheral contributors show that OSS projects depend on multiple contributor types whose motivations and future trajectories differ [36]- [42].”
Quote in the paperSubstantial claim0 of 7 sources checked- cites [36]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [37]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [38]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [39]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [40]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [41]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [42]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Projects that mandate a DCO cannot accept contributions generated by AI that lack proper sign-off.
“Thus, projects that mandate a DCO cannot accept contributions generated by AI that lack proper sign-off.”
Quote in the paperSubstantial claim - Interpretationreasoning
This is especially dangerous for projects under copyleft licenses (GPL, MPL) or those operating at legal/regulatory risk.
“This is especially dangerous for projects under copyleft licenses (GPL, MPL) or those operating at legal/regulatory risk.”
Quote in the paperSubstantial claim - Premisecitation
Hora and Robbes analyzed the 1,000 most-starred GitHub repositories that met specific criteria: a minimum of 100 commits, non-fork status, and at least one commit in 2026.
“They analyzed the 1,000 most-starred GitHub repositories that met specific criteria: a minimum of 100 commits, non-fork status, and at least one commit in 2026.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
As AI-mediated contribution makes external work harder to evaluate and incorporate, projects are beginning to update their contribution policies in different ways.
“As AI-mediated contribution makes external work harder to evaluate and incorporate, projects are beginning to update their contribution policies in different ways.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
The HR dataset is derived from the replication package of Hora and Robbes.
“The HR dataset is derived from the replication package of recent work by Hora and Robbes [13].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
OSS contribution is shaped by a persistent tension between community growth and maintainer capacity.
“OSS contribution is shaped by a persistent tension between community growth and maintainer capacity.”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [14]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [15]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [16]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [17]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Agent-authored or agent-assisted pull requests are now observable on GitHub.
“agent-authored or agentassisted pull requests are now observable on GitHub [9].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [9]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
This Ethics category is a political position that makes AI contributions unacceptable regardless of their technical quality.
“This category is a political position that makes AI contributions unacceptable regardless of their technical quality.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The diversity of OSS AI contribution policies reflects the heterogeneity of OSS: projects serve different purposes, face different constraints, and form different communities.
“This diversity reflects the heterogeneity of OSS: projects serve different purposes, face different constraints, and form different communities.”
Quote in the paperSubstantial claim - Interpretationreasoning
Acceptable AI use depends on how a project defines valuable contribution, acceptable risk, contributor responsibility, and maintainer stewardship.
“Acceptable AI use therefore depends on how a project defines valuable contribution, acceptable risk, contributor responsibility, and maintainer stewardship.”
Quote in the paperSubstantial claim- Rests on an assumption: Every OSS project serves a particular need and user base, which gives it its own priorities and goals that shape its stewardship commitments and contribution policy.
- Interpretationreasoning
A non-existent bug looks identical to a real report until someone spends time trying to reproduce it, consuming valuable maintainer effort.
“A non-existent bug looks identical to a real report until someone spends time trying to reproduce it, consuming valuable maintainer effortfoot_1 .”
Quote in the paperSubstantial claim - Study design and conductown data
The two sources used-policies identified among the 1,000 most-starred GitHub projects and a hand-curated collection of publicly visible OSS AI contribution policies-do not support statistical generalization to all OSS projects.
“Although we combine two complementary sources-one based on policies identified among the 1,000 most-starred GitHub projects and another based on a handcurated collection of publicly visible OSS AI contribution policies-these sources do not support statistical generalization to all OSS projects.”
Quote in the paperSubstantial claim - Study design and conductown data
Many project policies were verified against primary sources such as CONTRIBUTING.md or AI POLICY.md files.
“While many project policies were verified against primary sources like CONTRIBUTING.mdor AI POLICY.mdfiles, others lacked formal documentation.”
Quote in the paperNot a substantial claim - Interpretationnone given
Most OSS projects have not yet adapted their contribution policies to AI.
“However, most OSS projects have not yet adapted their contribution policies to AI, and we do not know whether they are considering doing so, whether they are already managing AI-related problems informally, or whether AI has not yet become a salient governance issue for them.”
Quote in the paperNot a substantial claim - Interpretationreasoning
AI contribution policies should be understood as adaptations to a changed contribution environment.
“AI contribution policies should therefore be understood as adaptations to a changed contribution environment.”
Quote in the paperNot a substantial claim - Study design and conductreasoning
Some framework dimensions go beyond the explicit wording of the policies.
“This means that some framework dimensions go beyond the explicit wording of the policies.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 67
- May combine two claims. 50
- The quote only partly states this claim. 1
Probably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationGhostty states that the rise of agentic programming has eliminated the natural effort-based backpressure that previously limited low-effort contributions.
“For example, Ghostty states that”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing). May combine two claims.
Findingown dataZig states that LLM assistance breaks the relationship between reviewer time and contributor learning completely, and that the time the Zig team spends reviewing work does nothing to help them add new, confident, trustworthy contributors.
“and in Zig we can read”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe analyzed AI contribution policies seek to protect scarce maintainer attention, preserve accountability, sustain meaningful review interactions, address legal and quality concerns, and maintain pathways for newcomer learning.
“Our analysis shows that these policies seek to protect scarce maintainer attention, preserve accountability, sustain meaningful review interactions, address legal and quality concerns, and maintain pathways for newcomer learning.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingnone givenAI models trained on copyrighted code may reproduce verbatim excerpts of license-incompatible material in their output.
“as AI models trained on copyrighted code may reproduce verbatim excerpts of license-incompatible material in their output.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingnone givenAsahi Linux states that there is ample evidence of training material including copyrighted material, and it is not impossible for LLMs to have confidential or leaked material owned by Apple or its vendor partners in their training corpora.
“For instance in Asahi Linux it can be read”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenThe datasets have 15 projects in common, resulting in a total of 209 projects.
“The datasets have 15 projects in common, resulting in a total of 209 projects.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningJellyfin states that pure 'vibe coding' will be rejected, and if the code looks terrible, it will be rejected as such, and contributors must clean up the mess before submitting.
“For example Jellyfin states that”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Findingown dataProjects citing code quality & correctness argue that AI-mediated code is frequently subtly wrong: it passes superficial review, fixes symptoms instead of causes, introduces new bugs, and can only be caught through careful line-by-line reading that defeats the purpose.
“arguing that AI-mediated code is frequently subtly wrong: it passes superficial review, fixes symptoms instead of causes, introduces new bugs, and can only be caught through careful line-by-line reading that defeats the purpose.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningFor security-critical projects in the study (e.g., operating systems, password managers), the security risk from AI-mediated code is unacceptable regardless of quality.
“This is especially an objection for the security-critical projects in our study (e.g., operating systems, password managers); the security risk is unacceptable for them regardless of quality.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThese projects state that OSS contribution is itself a learning process: a pathway through which developers develop expertise, build relationships with maintainers, and eventually become maintainers themselves.
“These projects state that OSS contribution is itself a learning process: a pathway through which developers develop expertise, build relationships with maintainers, and eventually become maintainers themselves.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningSeveral policies state that PR descriptions and review responses must be written by the contributor themselves, while AI generated code is acceptable.
“Several policies state that PR descriptions and review responses must be written by the contributor themselves (while AI generated code is acceptable).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe Ethics objection is grounded in reasons including training data of LLMs obtained without creator consent, reliance on exploited low-wage annotators, exploitation of the commons including OSS, and the cost of AI inference and training in energy, water, and hardware.
“This objection is grounded in several reasons, such as: training data of LLMs is obtained without creator consent; reliance on exploited low-wage annotators; exploitation of the commons, including OSS; and the cost of AI inference and training in terms of vast amounts of quantities of energy, water, and hardware.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataSix projects, including ESLint and go-delve, use an accepted-issue gate to limit contributions to known or pre-discussed work, with substantial overlap between this category and maintainer exemptions.
“Six projects, including ESLint and go-delve, use an accepted-issue gate to limit contributions to known or pre-discussed work, with substantial overlap between this category and maintainer exemptions.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe first part of the study shows wide diversity in how OSS projects address AI-mediated contribution, including complete bans.
“The first part of our study shows the wide diversity in which OSS projects are addressing this (including complete banning).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCode quality/correctness and Contributor understanding required (34 projects, 100%) are rationales present in every project that regulates AI contributions, and the one that distinguishes 'regulated' from 'prohibited' most clearly.
“Code quality/correctness and Contributor understanding required (34 projects, 100%) are rationales present in every project that regulate AI contributions, and the one that distinguishes”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
FindingreasoningDuckDB's logic is that bug fixes have a verifiable ground truth while features require design judgement, which is the most coherent articulation of why contribution type could matter, although the final decision ('may be accepted') puts it at maintainer discretion, not as a rule.
“Its logic, that bug fixes have a verifiable ground truth while features require design judgement, is the most coherent articulation of why contribution type could matter, although the final decision (”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCopyright & IP concern is present in 9 projects (26%) in the regulated group, but it is typically expressed as a responsibility placed on the contributor rather than as a reason to ban AI outright.
“Copyright & IP concern is also present (9 projects, 26%), but it is typically expressed as a responsibility placed on the contributor (”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown data14 projects (41%) in the regulated group cite degradation of Human-human interaction & community dialogue when AI mediates communication.
“A recurring concern in the”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataFive projects, including Ghostty and Polars, allow maintainer exemptions for trusted contributors, meaning strict rules for AI usage apply only to outside contributions; maintainers are exempt and may use AI tools at their discretion as they have proven themselves trustworthy to apply good judgment.
“Five projects, including Ghostty and Polars, allow maintainer exemptions for trusted contributors, which means that the strict rules for AI usage apply only to outside contributions; maintainers are exempt from these rules and may use AI tools at their discretion as they have proven themselves trustworthy to apply good judgment.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataWhere prohibited projects describe a flood that threatens the project's survival, regulated projects more often describe a more specific review asymmetry: AI lowers the cost of producing plausible pull requests, while the cost of evaluating, integrating, and maintaining them remains with maintainers.
“Where prohibited projects describe a flood that threatens the project's survival, regulated projects more often describe a more specific review asymmetry: AI lowers the cost of producing plausible pull requests, while the cost of evaluating, integrating, and maintaining them remains with maintainers.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataUnlike projects that prohibit or regulate AI-mediated contributions, which typically provide a rationale for their stance, we found no such justification in projects that permit AI usage.
“Unlike projects that prohibit or regulate AI-mediated contributions, which typically provide a rationale for their stance, we found no such justification in projects that permit AI usage.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data3 projects (7%) specifically cite Security as a primary concern, noting that AI-mediated code frequently contains subtle vulnerabilities capable of bypassing superficial review processes.
“Finally, three projects (7%) specifically cite Security as a primary concern, noting that AI-mediated code frequently contains subtle vulnerabilities capable of bypassing superficial review processes.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe Maintainer burden & review cost reason (30 projects, 88%) is present in nearly all regulated projects, but it is expressed differently than in the prohibited group, with a more pragmatic rather than alarmed tone.
“The Maintainer burden & review cost reason (30 projects, 88%) is present in nearly all regulated projects, but it is expressed differently than in the prohibited group, with a more pragmatic rather than alarmed tone.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningNumPy, SciPy, SymPy, Matplotlib, Jellyfin, searxng, and Zulip all permit disclosed AI code but prohibit AI-written issue descriptions.
“NumPy, SciPy, SymPy, Matplotlib, Jellyfin, searxng, and Zulip all permit disclosed AI code but prohibit AI-written issue descriptions.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe governance problem for OSS projects is how projects can preserve accountability, maintainability, and community formation while allowing useful forms of AI mediation.
“The governance problem for OSS projects is therefore how projects can preserve accountability, maintainability, and community formation while allowing useful forms of AI mediation.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
PremisecitationThe MelissaWM list is curated specifically around the discussion of how projects manage AI-mediated contributions and adapt their contribution policies accordingly and comes with a rich ideological and rationale diversity, including a list of projects that reject AI-mediated contributions.
“This list is curated specifically around the discussion of how projects manage AI-mediated contributions and adapt their contribution policies accordingly and comes with a rich ideological and rationale diversity, including a list of projects that reject AI-mediated contributions.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [63]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationAI coding systems exhibit recurring engineering pitfalls.
“AI coding systems exhibit recurring engineering pitfalls [11].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [11]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationFent et al. describe how generative AI is disrupting OSS, emphasizing how OSS communities should discuss and address the different aspects of this disruption.
“Fent et al. [5] describe how generative AI is disrupting OSS emphasizing how OSS communities should discuss and address the different aspects of this disruption.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [5]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisecitationOSS projects specify rules for generative AI use in contribution processes.
“They show how OSS projects specify rules for generative AI use in contribution processes.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationContributors may be driven by ideology, learning, reputation, employment, reciprocity, or commitment to a cause.
“Contributors may be driven by ideology, learning, reputation, employment, reciprocity, or commitment to a cause [49]- [54].”
Quote in the paperNot a substantial claim0 of 6 sources checked- cites [49]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [50]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [51]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [52]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [53]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [54]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationEven successful projects operate under constraints: need for heterogeneous contributors, uneven support processes, and ongoing coordination challenges.
“Even successful projects operate under constraints: need for heterogeneous contributors, uneven support processes, and ongoing coordination challenges [7]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [7]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThe two selected data sources are inherently complementary.
“We have selected two distinct data sources to gain a more comprehensive understanding of our research topic, as they are inherently complementary.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationRecent empirical work measured the emerging policy landscape, showing that many AI contribution policies address permission, disclosure, and human-in-the-loop requirements.
“Recent empirical work [13] measured this emerging policy landscape, showing that many AI contribution policies address permission, disclosure, and human-in-the-loop requirements.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisecitationHora and Robbes studied how OSS contribution guidelines address generative AI, focusing on project stances toward AI-generated contributions, disclosure requirements, and human-in-the-loop responsibility.
“Closest to our work, Hora and Robbes studied how OSS contribution guidelines address generative AI, focusing on project stances toward AI-generated contributions, disclosure requirements, and human-in-the-loop responsibility [13].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningThe provenance of generated code is fundamentally unknowable, making it impossible for contributors to honestly certify clean IP.
“The provenance of generated code is fundamentally unknowable, making it impossible for contributors to honestly certify clean IP.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe use of AI lowers the cost of producing contributions, increasing their volume, and weakens the signals that allowed maintainers to distinguish promising newcomers from low-commitment contributors.
“The use of AI lowers the cost of producing contributions, increasing their volume, and weakens the signals that allowed maintainers to distinguish promising newcomers from low-commitment contributors.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe reviewing process enhances knowledge sharing.
“and the reviewing process enhances knowledge sharing [24]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [24]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
Study design and conductown dataThe process of identifying characteristics was performed manually for twelve randomly selected projects until saturation was reached, as no additional characteristics were found.
“This process was performed manually for twelve randomly selected projects until saturation was reached, as no additional characteristics were found.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThrough this analysis, they identified 118 AI policies for AI-mediated contributions.
“Through this analysis, they identified 118 AI policies for AI-mediated contributions.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationCode review outcomes are influenced by developer reputation, trust and security expectations, and the social structure of OSS communities.
“code review outcomes are influenced by developer reputation [2], trust and security expectations [23], and the social structure of OSS communities [1]”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [2]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [23]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [1]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAI coding tools can increase short-term development velocity while introducing longer-term quality costs.
“AI coding tools can increase short-term development velocity while introducing longer-term quality costs [10]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [10]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationProjects depend on new contributors to sustain the community, replace lost knowledge, and develop future maintainers, but each contribution also requires maintainers to evaluate, integrate, and support work under limited time and attention.
“Projects depend on new contributors to sustain the community, replace lost knowledge, and develop future maintainers, but each contribution also requires maintainers to evaluate, integrate, and support work under limited time and attention.”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [14]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [15]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [16]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [17]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationOnly 118 of the 1,000 most active GitHub repositories that were studied have established some policy on this issue, many of which remain notably vague.
“This is evidenced by the fact that only 118 of the 1,000 most active GitHub repositories that were studied have established some policy on this issue, many of which remain notably vague.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisecitationNewcomers face both technical and social barriers when making their first contributions.
“Newcomers face both technical and social barriers when making their first contributions [6], [27], [28]”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [6]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [27]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [28]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMozilla and Wikimedia extend this framing to public-interest and volunteer peer-production contexts, emphasizing accountable AI systems, human judgment, community oversight, transparency, and monitoring.
“Mozilla and Wikimedia extend this framing to publicinterest and volunteer peer-production contexts, emphasizing accountable AI systems, human judgment, community oversight, transparency, and monitoring [59]- [62].”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [59]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [60]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [61]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [62]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationBoth social and technical factors shape contribution evaluation.
“Studies of GitHub pull requests show that both social and technical factors shape contribution evaluation [20]- [22]”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [20]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [21]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [22]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisecitationGenerative AI is changing OSS development.
“As described in [5], generative AI is changing OSS development.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [5]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPrior work has shown that OSS projects fail, become abandoned, or struggle to survive for reasons that include maintainer overload, insufficient contributor retention, and loss of project knowledge.
“Prior work has shown that OSS projects fail, become abandoned, or struggle to survive for reasons that include maintainer overload, insufficient contributor retention, and loss of project knowledge [14]- [17].”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [14]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [15]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [16]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [17]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationProjects have developed mechanisms to help newcomers select appropriate tasks and overcome entry barriers.
“projects have developed mechanisms to help them select appropriate tasks and overcome entry barriers [29], [30].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [29]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [30]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationAI can help contributors understand unfamiliar code, express ideas more clearly, and prepare submissions that would otherwise be difficult or time consuming for them to produce.
“It can help contributors understand unfamiliar code, express ideas more clearly, and prepare submissions that would otherwise be difficult or time consuming for them to produce;”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [9]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPull requests may be abandoned when contributors and maintainers fail to converge on a review outcome.
“while pull requests may be abandoned when contributors and maintainers fail to converge on a review outcome [18].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisecitationRetaining contributors and sustaining participation require active governance work, not merely technical infrastructure.
“Retaining contributors and sustaining participation require active governance work, not merely technical infrastructure [19].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationThe MelissaWM dataset of Contribution Policies comes from the melissawm/open-source-ai-contribution-policies GitHub repository, a community-curated list of 106 projects.
“The MelissaWM dataset of Contribution Policies comes from the melissawm/open-source-ai-contribution-policies GitHub repository [63], a community-curated list of 106 projects.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [63]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMentoring programs such as Google Summer of Code show challenges of onboarding new contributors.
“Mentoring programs such as Google Summer of Code show challenges of onboarding new contributors [32]- [35].”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [32]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [33]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [34]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [35]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningAI eliminates the natural effort-based backpressure that previously limited low-quality submissions, generating large volumes of plausible-looking but broken contributions that consume reviewer time without adding value.
“AI elim- inates the natural effort-based backpressure that previously limited low-quality submissions-generating large volumes of plausible-looking but broken contributions that consume reviewer time without adding value.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductown dataTo ensure consistency of findings, the LLM-generated results were compared with manual analysis across the 12 selected repositories.
“To ensure the consistency of our findings, we compared the LLM-generated results with our manual analysis across the 12 selected repositories.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationLinux Foundation's generative AI guidance connects these concerns to disclosure, provenance, licensing, and human responsibility.
“Its generative AI guidance connects these concerns to disclosure, provenance, licensing, and human responsibility [58].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAI coding-agent adoption may reshape OSS participation by changing the relative share of human and newcomer activity while increasing the need and depth for review.
“Recent empirical work on AI coding-agent adoption further suggests that these tools may reshape OSS participation by changing the relative share of human and newcomer activity while increasing the need and depth for review [55].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [55]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationProjects use these documents to communicate procedures, expectations, and norms for participation.
“Research has shown that projects use these documents to communicate procedures, expectations, and norms for participation [3], [4].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [3]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [4]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationFirst contributions can lead, or fail to lead, to longer-term contributors.
“Recent work further examines how first contributions can lead, or fail to lead, to longer-term contributors [43].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [43]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationLinux Foundation Research identifies maintainer capacity as a central constraint in OSS, emphasizing that project growth must remain aligned with the coordination, review, and community-management work maintainers can sustain.
“Linux Foundation Research identifies maintainer capacity as a central constraint in OSS, emphasizing that project growth must remain aligned with the coordination, review, and community-management work maintainers can sustain [56], [57].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [56]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [57]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningContributors who cannot explain their code cannot grow, cannot respond to feedback, and cannot be trusted with greater responsibility.
“Contributors who cannot explain their code cannot grow, cannot respond to feedback, and cannot be trusted with greater responsibility.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningAs AI increases submission volume and weakens the signals that made review worthwhile, maintainers must devote more attention to triage.
“As AI increases submission volume and weakens the signals that made review worthwhile, maintainers must devote more attention to triage.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The review process can be modeled as a capacity-constrained signaling problem in which review time is an investment under uncertainty.
Classified as probably not a substantial claim.
InterpretationreasoningVariation in AI contribution policies (as observed in RQ1) is expected because projects face different stewardship conditions: every OSS project serves a particular need and user base, with its own priorities and goals.
“Variation in AI contribution policies (as we observed in RQ1) is expected because projects face different stewardship conditions: every OSS project serves a particular need and user base, with its own priorities and goals.”
Quote in the paperSubstantial claim- Rests on an assumption: Every OSS project serves a particular need and user base, which gives it its own priorities and goals that shape its stewardship commitments and contribution policy.
May combine two claims.
InterpretationreasoningThe reason for this inversion is that code can have testability gates that separate correct from incorrect, while a bug report has no equivalent mechanism.
“The reason is that code can have testability gates that separates correct from incorrect; a bug report has no equivalent mechanism.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe authors conducted a manual verification supported by a triangulation process comparing their findings against the original dataset authors' classifications, identifying discrepancies that necessitated reclassification of projects and refinement of their rationales.
“The authors conducted a manual verification supported by a triangulation process to compare their findings against the original dataset authors' classifications, identifying those discrepancies that necessitated the reclassification of projects and the refinement of their underlying rationales.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningWhen a contributor submits AI-mediated code they do not understand, maintainers are effectively reviewing the AI's output, not engaging with a developer.
“When a contributor submits AI-mediated code they do not understand, maintainers are effectively reviewing the AI's output, not engaging with a developer.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningIf AI lowers the cost of submitting work, policies must protect the scarce capacity needed to evaluate and absorb it.
“If AI lowers the cost of submitting work, policies must protect the scarce capacity needed to evaluate and absorb it.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe acceptability principles define the conditions under which AI use remains compatible with project stewardship, the central purpose of the project's contribution policies.
“They define the conditions under which AI use remains compatible with project stewardship, the central purpose of the project's contribution policies.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationown dataWhen a contributor uses AI to draft the code, the PR description and the responses to review comments, the maintainer is no longer talking to a person but to an AI that is impersonating her.
“When a contributor uses AI to draft the code, the PR description and the responses to review comments, the maintainer is no longer talking to a person but to an AI that is impersonating her.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningAI changes the value of contribution signals as they can be generated cheaply using AI.
“AI changes the value of contribution signals as they can be generated cheaply (using AI).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductown dataThe results should not be interpreted as estimating the prevalence of AI contribution policies, policy types, or governance mechanisms across the entire OSS universe.
“A threat to external validity is that our results should not be interpreted as estimating the prevalence of AI contribution policies, policy types, or governance mechanisms across the entire OSS universe.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataMany policy texts were remarkably brief or sparse, making it difficult to interpret their intent.
“In addition, many policy texts were remarkably brief or sparse, making it difficult to interpret their intent.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe first part of the framework identifies the concerns surrounding the governance problem that the review process faces trying to judge and decide whether the expected value of a contribution exceeds the expected upfront cost of its review (this threshold will vary across projects).
“Its first part identifies the concerns surrounding the governance problem that the review process faces trying to judge and decide whether the expected value of a contribution exceeds the expected upfront cost of its review (this threshold will vary across projects).”
Quote in the paperSubstantial claim- The authors state this as an assumption: The review process can be modeled as a capacity-constrained signaling problem in which review time is an investment under uncertainty.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningIf AI weakens traditional signals of effort, understanding, and commitment, policies must require stronger evidence of project fit and human accountability.
“If AI weakens traditional signals of effort, understanding, and commitment, policies must require stronger evidence of project fit and human accountability.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningRegulated is not a soft version of prohibited; it has a distinct and internally consistent logic that sets it apart.
“Another relevant reflection stemming from the results is that”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe acceptability principles provide a way to make project-specific conditions explicit.
“The acceptability principles provide a way to make those projectspecific conditions explicit.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone givenOne common aspect all projects share is that they respond to the same broad challenge: AI can increase the volume of contributions, lower their quality, weaken their alignment with project needs, and place additional strain on the review process and on the maintainers responsible for it.
“One common aspect they all share, however, is that they respond to the same broad challenge: AI can increase the volume of contributions, lower their quality, weaken their alignment with project needs, and place additional strain on the review process and on the maintainers responsible for it.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationnone givenThe projects that are changing their policies in response to AI-mediated contribution are at the forefront of the transition, working out how best to adapt their governance practices.
“The projects that are changing their policies in response to AI-mediated contribution are at the forefront of this transition, as they work out how best to adapt their governance practices.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationown dataAI short-circuits the learning process in OSS contribution.
“AI short-circuits this entirely.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningThe project defines the contribution regime and its boundaries; the contributor remains responsible for the submitted work; and the maintainer preserves stewardship over review and incorporation decisions.
“The project defines the contribution regime and its boundaries; the contributor remains responsible for the submitted work; and the maintainer preserves stewardship over review and incorporation decisions.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenAs the apparent value of the contribution becomes less informative at time of submission, maintainers face a harder allocation problem, which is further strained by an increase in contributions due to AI (including PRs and bug reports).
“As the apparent value of the contribution become less informative at time of submission, maintainers face a harder allocation problem, which is further strained by an increase in contributions due to AI (including PRs and bug reports).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningContributions are a form of communication between humans, and reviewer and author need to be able to have a genuine technical dialogue.
“Contributions are a form of communication between humans-reviewer and author need to be able to have a genuine technical dialogue.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe authors mitigate the construct-validity threat by keeping a clear distinction between observed policy mechanisms and inferred governance issues, and by presenting the framework as an empirically grounded conceptual tool that can be revised.
“We mitigate this by keeping a clear distinction between the policy mechanisms we observed and the governance issues we infer from them, and by presenting the framework as an empirically grounded conceptual tool that can be revised as OSS AI governance evolves.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataSome project policies lacked formal documentation, and in those cases the most consequential statements often appeared in informal channels such as blog posts or public statements.
“In such cases, the most consequential statements often appeared in informal channels, such as blog posts or public statements (e.g., curl and LadybirdBrowser).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningConsequently, regulated policies are defined by conditionality (e.g., 'if you use AI...').
“Consequently, regulated policies are defined by conditionality (e.g., 'if you use AI...').”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe acceptability principles are organized around the three stakeholders of OSS contribution governance: the project, the contributor, and the maintainer.
“The acceptability principles are organized around the three stakeholders of OSS contribution governance: the project, the contributor, and the maintainer.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductreasoningThe main construct-validity threat is the conceptual leap from policy evidence to framework construction.
“The main construction-validity threat is the conceptual leap from policy evidence to framework construction.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationFent et al. provide a roadmap and cite the importance of studying how governance in OSS communities is adapting to the use of AI.
“Fent et al provide a roadmap of [5].The cite the importance of studying how Governance in OSS communities is adapting to the use of AI.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [5]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningDisclosing that AI was used, and how, is useful for transparency, but insufficient as a signal of contributor ownership.
“Disclosing that AI was used, and how, is useful for transparency, but insufficient as a signal of contributor ownership.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThis makes the bar conditional: AI is tolerated if understanding accompanies it, rejected if it does not.
“This makes the bar conditional: AI is tolerated if understanding accompanies it, rejected if it does not.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataThe study covered only OSS projects that had adapted their contribution policies to AI, so it is unknown whether projects that have not adapted are also struggling with AI.
“Because we have studied only projects that have adapted their policies to AI, we do not know if those who have not are also struggling with AI and accept them.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningA policy that filters aggressively may protect maintainers while discouraging future contributors, whereas a policy that remains too open may preserve access while exhausting review capacity.
“Their balance is difficult to achieve: a policy that filters aggressively may protect maintainers while discouraging future contributors, whereas a policy that remains too open may preserve access while exhausting review capacity.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningContributors who use AI to generate code they cannot explain are not developing the skills that make future contributions valuable, and they are consuming maintainer time that would otherwise go to genuine mentorship.
“Contributors who use AI to generate code they cannot explain are not developing the skills that make future contributions valuable, and they are consuming maintainer time that would otherwise go to genuine mentorship.”
Quote in the paperSubstantial claim
The authors state this as an assumption.
The combined corpus maintains a diverse representation of policy approaches toward AI-mediated content in software development.
“We assume that the combined corpus maintains a diverse representation of policy approaches toward AI-mediated content in software development.”
The authors state this as an assumption.
The review process can be modeled as a capacity-constrained signaling problem in which review time is an investment under uncertainty.
“We model the review process as a capacity-constrained signaling problem in which review time is an investment under uncertainty.”
The paper relies on this without support.
Every OSS project serves a particular need and user base, which gives it its own priorities and goals that shape its stewardship commitments and contribution policy.
“Every OSS project serves a particular need and user base, which gives it its own priorities and goals which shape the project's stewardship commitments and, in turn, its contribution policy.”
The paper relies on this without support.
Review effort is justified when it produces at least one of three returns: improving the project directly, protecting the project through stewardship, or developing project capacity.
“Review effort is justified when it produces at least one of three returns: i) it may improve the project directly by integrating a valuable contribution, ii) it may protect the project through stewardship of architecture, maintainability, and direction, or iii) it may also develop project capacity by helping an interested participant become a long-term contributor and potentially, a maintainer.”
The paper relies on this without support.
Before AI-mediated development, the work required to produce a plausible patch and follow through with review acted as a costly signal.
“Before AI-mediated development, the work required to produce a plausible patch and follow through with review acted as a costly signal.”
The paper relies on this without support.
The costly signal had two parts: effort could indicate contribution quality, and for new contributors, effort could indicate contributor potential.
“This signal had two parts.First, effort could indicate contribution quality: the contributor had done enough work to make acceptance plausible.Second, for new contributors, effort could indicate contributor potential: even if the patch was weak, the contributor had shown enough interest to make mentoring potentially worthwhile.”
The authors state this as an assumption.
A contributor chooses whether to submit a change, and a maintainer must decide whether to begin reviewing it and whether to spend scarce review effort to accept or reject it.
“A contributor chooses whether to submit a change, and a maintainer must decide not only whether to begin reviewing it, but also whether to spend scarce review effort to decide whether to accept or reject the contribution.”
The paper relies on this without support.
Contribution policies are living documents shaped by the communities that create them and by the software those communities steward.
“Contribution policies are living documents.They are shaped by the communities that create them and by the software those communities steward.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Learning rationale percentage is overstated
MinorThe paper reports 42 projects that prohibit AI. Fourteen of 42 is 33.3%, which rounds to 33%, not 34%.
Reported 34 · recomputed 33.333333
“The next most frequent reason given is Learning & contributor development (14 projects, 34%).”
The same repository sample is described as most-active and most-starred
MinorThe introduction calls the 1,000 repositories in the cited study the most active, while the dataset description says they were selected as the most starred. These are different selection criteria for the same reported sample of 118 policies.
“only 118 of the 1,000 most active GitHub repositories that were studied have established some policy on this issue”
“They analyzed the 1,000 most-starred GitHub repositories that met specific criteria: a minimum of 100 commits, non-fork status, and at least one commit in 2026.”
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 4
- M. Guizani, A. Chatterjee, B. Trinkenreich, M. E. May, G. J. Noa- Guevara, L. J. Russell, G. G. Cuevas Zambrano, D. Izquierdo-Cortazar, I. Steinmacher, M. A. Gerosa, and A. Sarma, "The long road ahead: Ongoing challenges in contributing to large OSS organizations and what to do," Proceedings of the ACM on Human-Computer Interaction, vol. 5, no. CSCW2, October 2021.
- M. Rashid, P. M. Clarke, and R. V. O'Connor, Exploring Knowledge Loss in Open Source Software (OSS) Projects, ser. Communications in Computer and Information Science. Springer International Publishing, 2017, pp. 481-495. [Online]. Available: http://dx.doi.org/10.1007/ 978-3-319-67383-7 35 · DOI
- H. Frluckaj and J. Howison, Codes of Conduct in Open Source, ser. Equity, Diversity, and Inclusion in Software Engineering. Apress, 2024, pp. 295-308. [Online]. Available: http://dx.doi.org/10.1007/ 978-1-4842-9651-6 17 · DOI · Paper page
- M. A. Rossi, "Decoding the free/open source software puzzle: A survey of theoretical and empirical contributions," in The Economics of Open Source Software Development, J. Bitzer and P. J. H. Schröder, Eds. Elsevier, 2006, pp. 15-55.
Cited by
Sorted by citations
Who Pays the Review Cost? Triage, Fairness, and Accountability in AI-authored Pull Requests
Rahman, M. S., Alam, K., Roy, B., & Roy, C. K. (2026) · arXiv · doi:10.48550/arxiv.2610.11179
Plausible Is Not Enough: Trust and Evidence in AI-Authored Pull Request Review
Rahman, M. S., Alam, K., Roy, B., & Roy, C. K. (2026) · arXiv · doi:10.48550/arxiv.2610.21144
- Authors
- Robles, G., & German, D. M.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2609.07919
- OpenAlex
- W7212041069
- Semantic Scholar
- 6cbd75a343c1c23a2c72351778f932aa844ec8f2
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Open Source Software Innovations
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- open source software, code review, contribution guidelines, software maintainers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-11-02.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-11-02.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review