Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 36 of the 40 references it cites were found in a registry or an index; 5 of the 17 sources its claims cite were checked for support.

The Role of Social Learning and Collective Norm Formation in Fostering Cooperation in LLM Multi-Agent Systems

Open access
Gupta, Prateek, Zhong, Qiankun, Yakura, Hiromu, Eisenmann, Thomas, Rahwan, Iyad · 2026 · Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems

Published version of a preprint

Abstract

A growing body of multi-agent studies with Large Language Models (LLMs) explores how norms and cooperation emerge in mixed-motive scenarios, where pursuing individual gain can undermine the collective good. While prior work has explored these dynamics in both richly contextualized simulations and simplified game-theoretic environments, most LLM systems featuring common-pool resource (CPR) games provide agents with explicit reward functions directly tied to their actions. In contrast, human cooperation often emerges without explicit knowledge of the payoff structure or how individual actions translate into long-run outcomes, relying instead on heuristics, communication, and enforcement. We introduce a CPR simulation framework that removes explicit reward signals and embeds cultural-evolutionary mechanisms: social learning (adopting strategies and beliefs from successful peers) and norm-based punishment, grounded in Ostrom's principles of resource governance. Agents also individually learn from the consequences of harvesting, monitoring, and punishing via environmental feedback, enabling norms to emerge endogenously. We establish the validity of our simulation by reproducing key findings from existing studies on human behavior. Building on this, we examine norm evolution across a 2x2 grid of environmental and social initialisations (resource-rich vs. resource-scarce; altruistic vs. selfish) and benchmark how agentic societies comprised of different LLMs perform under these conditions. Our results reveal systematic model differences in sustaining cooperation and norm formation, positioning the framework as a rigorous testbed for studying emergent norms in mixed-motive LLM societies. Such analysis can inform the design of AI systems deployed in social and organizational contexts, where alignment with cooperative norms is critical for stability, fairness, and effective governance of AI-mediated environments.

Overview

CoChat Summary

TL;DR

The authors introduce a common-pool resource (CPR) simulation framework for LLM multi-agent societies in which the action-to-payoff mapping is latent and cooperation must emerge endogenously through payoff-biased social learning, individual punishment, and a lightweight propose→vote group-norm mechanism grounded in Ostrom's design principles. Validated against agent-based-model baselines from human-behavior studies, the framework reveals systematic model-specific differences in sustaining cooperation and norm formation.

Key findings

  • Removing both alignment channels (social learning and group norms) produced the lowest survival times (T_s = 16.22 vs. 20.98, t(898) = −2.78, p = 0.006), confirming some form of coordination is necessary for stability.
  • Explicit alignment alone (Only Group Decision) sometimes outperformed the full system, particularly under selfish priors (T_s = 38.21 vs. 27.1, t(238) = 3.44, p < 0.001); pure social learning without a shared norm was often unstable (T_s = 17.56 vs. 20.98, t(898) = −1.96, p = 0.050).
  • Two-way ANOVA: in the harsh environment only the model main effect was significant (p = 0.031), with a significant Model × Altruistic ratio interaction (p = 0.012); in the rich environment both model (p < 0.001, η² = 0.28) and society type (p = 0.030) were significant.
  • Model-specific patterns: deepseek-r1 often reached the 50-round cap and survived significantly longer than all other models in the rich environment, while claude-sonnet-4 and gpt-4o plateaued near 30 rounds; norm structure showed provider-family clustering (e.g., claude-sonnet-4 top-right on alignment/homogeneity, Llama variants lower-left), with initialization effects second-order to model effects.

Methods

  • A CPR simulation with N = 10 agents sharing a renewable stock (carrying capacity K = 300) under logistic (Verhulst) regeneration; agents choose effort, consume a fixed amount, may monitor and punish at personal cost, imitate higher-payoff peers via a logit rule, and set a group harvest threshold through a propose→vote procedure (two API calls per agent per round).
  • Agents receive no explicit reward function or payoff table; consequences are inferred from private observations of personal and sampled peer outcomes, with LLM decisions made in-context via dedicated prompts.
  • Framework validated against ABM baselines on three axes (punishment sustains cooperation and declines when removed at t = 15; outcomes vary with punishment strength β and growth rate r; altruistic vs. selfish populations differ), then LLM societies tested across a 2×2 grid (resource-rich r = 0.6 vs. resource-scarce r = 0.2; altruistic vs. selfish initialization), capped at 50 rounds with 10 trials per condition, analyzed via two-way ANOVA and Tukey's HSD post-hoc tests (α = 0.05) with Compact Letter Display.

Limitations

  • Stated: computational constraints limited trials and time horizons, possibly underrepresenting long-term norm evolution; the single-resource CPR setting with a narrow set of governance mechanisms cannot capture multi-resource, cross-group, or layered-norm complexity; reliance on in-context learning introduces sensitivity to prompt design and model biases, limiting reproducibility; closed-source models hinder transparency and independent replication.
  • Evident from the text: the 50-round cap was chosen partly because preliminary runs showed most populations collapse by roughly 50 rounds, so survival-time comparisons are truncated (deepseek-r1 "often reaches the 50-round cap"), which may compress differences among longer-surviving models; the ablation results are context-dependent (e.g., OSL competitive under altruistic priors), so the ranking of mechanisms is not uniform across conditions.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.65109/czdc3237

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

3 Valid · 2 Not valid · 7 Not checked · 80 Own results and interpretations

52 more claims

Create a free account to see all 92 claims and to verify the 4 references still open.

See all claims — free account
  • It may state two separate claims as one. 28
  • Probably not a substantial claim. 12

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 40 references

Research works printed but not linked: 2

  1. [15][15] Ray Hilborn and Carl J Walters. 2013. Quantitative fisheries stock assessment: choice, dynamics and uncertainty . Springer Science & Business Media. -
  2. [19][19] Chen Cecilia Liu. 2025. Cooperative Behaviour in LLMs via Cultural Evolution of Norms and Strategies. In Proceedings of the 1st CoLM Workshop on Social Simulation with LLMs . OpenReview, 1-11. -

Cited by

See all 9

Metadata

Authors
Gupta, P., Zhong, Q., Yakura, H., Eisenmann, T., & Rahwan, I.
Affiliations
Max Planck Institute for Human Development (DE)
Venue
Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems
Published
2026-05-24
ISSN
1548-8403 (ISSN-L)
OpenAlex
W7125906388
Cited by
2
References
40
Citations by year
2026: 2
FWCI
47.57
Type
conference paper
Language
en
Open access
Locations
  • Adaptive Agents and Multi-Agents Systems (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Japan Science and Technology Agency
  • Precursory Research for Embryonic Science and Technology (JPMJPR246B)
Topics
  • Social Sciences › Sociology and Political Science › Evolutionary Game Theory and Cooperation
  • Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Experimental Behavioral Economics Studies
Keywords
cooperation, social learning, norm formation, cultural evolution, emergent norms, natural resource governance, AI alignment, simulation framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Role of Social Learning and Collective Norm Formation in Fostering Cooperation in LLM Multi-Agent Systems. https://app.cochat.ai/papers/10.65109/czdc3237
The paper
Gupta, P., Zhong, Q., Yakura, H., Eisenmann, T., & Rahwan, I. (2026). The Role of Social Learning and Collective Norm Formation in Fostering Cooperation in LLM Multi-Agent Systems. Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems. https://doi.org/10.65109/czdc3237

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.