Cited by 36Social Robot Interaction and HRIExperimental Behavioral Economics StudiesPsychology of Moral and Emotional Judgment

Trust within human-machine collectives depends on the perceived consensus about cooperative norms

Open access
Makovi, Kinga, Sargsyan, Anahit, Li, Wendi, Bonnefon, Jean-François, Rahwan, Talal·2023·Nature Communications

Abstract

With the progress of artificial intelligence and the emergence of global online communities, humans and machines are increasingly participating in mixed collectives in which they can help or hinder each other. Human societies have had thousands of years to consolidate the social norms that promote cooperation; but mixed collectives often struggle to articulate the norms which hold when humans coexist with machines. In five studies involving 7917 individuals, we document the way people treat machines differently than humans in a stylized society of beneficiaries, helpers, punishers, and trustors. We show that a different amount of trust is gained by helpers and punishers when they follow norms over not doing so. We also demonstrate that the trust-gain of norm-followers is associated with trustors' assessment about the consensual nature of cooperative norms over helping and punishing. Lastly, we establish that, under certain conditions, informing trustors about the norm-consensus over helping tends to decrease the differential treatment of both machines and people interacting with them. These results allow us to anticipate how humans may develop cooperative norms for human-machine collectives, specifically, by relying on already extant norms in human-only groups. We also demonstrate that this evolution may be accelerated by making people aware of their emerging consensus.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41467-023-38592-5

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Human behavior tends to become more selfish in human-machine interactions because reciprocation-a vital factor in sustaining prosocial behavior-is not maintained as consistently as in human-human interactions.

    “Human behavior tends to become more selfish in human–machine interactions because reciprocation—a vital factor in sustaining prosocial behavior—is not maintained as consistently as in human–human interactions (49, 50).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. [45]Horne, C. Sociological perspectives on the emergence of norms. In Hechter, M. & Opp, K.-D. (eds.) Social Norms, 394–415 (The Russell Sage Foundation, 2005).

Cited by

Sorted by citations

Authors
Makovi, K., Sargsyan, A., Li, W., Bonnefon, J.-F., & Rahwan, T.
Affiliations
  • New York University Abu Dhabi (AE)
  • Technical University of Munich (DE)
  • Centre National de la Recherche Scientifique (FR)
Corresponding author
Rahwan, Talal
Venue
Nature Communications
Published
2023-05-30
Volume
14
Issue
1
Pages
3108-3108
ISSN
2041-1723 (ISSN-L)
OpenAlex
W4378782864
Cited by
36
References
48
Citations by year
2026: 5 · 2025: 16 · 2024: 10 · 2023: 4 · 2022: 1
FWCI
10.36
Type
journal article
Language
en
Open access
Locations
  • Nature Communications (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • HAL (submittedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Toulouse Capitole Publications (University Toulouse 1 Capitole) (submittedVersion)
Funders
  • New York University Abu Dhabi (Research Enhancement Funds)
  • Agence Nationale de la Recherche (19-PI3A-0004, 17-EURE-0010)
Topics
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Social Sciences › Safety Research › Experimental Behavioral Economics Studies
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Psychology of Moral and Emotional Judgment
Keywords
trust in machines, cooperative norms, helping behavior, punishment, social norms
MeSH terms
Artificial Intelligence, Cooperative Behavior, Humans, Consensus, Trust, Social Norms

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review