People Do Not Feel Guilty About Exploiting Machines
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Guilt and envy play an important role in social interaction. Guilt occurs when individuals cause harm to others or break social norms. Envy occurs when individuals compare themselves unfavorably to others and desire to benefit from the others’ advantage. In both cases, these emotions motivate people to act and change the status quo: following guilt, people try to make amends for the perceived transgression, and following envy, people try to harm envied others. In this article, we present two experiments that study participants’ experience of guilt and envy when engaging in social decision making with machines and humans. The results showed that, though experiencing the same level of envy, people felt considerably less guilt with machines than with humans. These effects occurred both with subjective and behavioral measures of guilt and envy, and in three different economic games: public goods, ultimatum, and dictator game. This poses an important challenge for human-computer interaction because, as shown here, it leads people to systematically exploit machines, when compared to humans. We discuss theoretical and practical implications for the design of human-machine interaction systems that hope to achieve the kind of efficiency -- cooperation, fairness, reciprocity, etc. -- we see in human-human interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Cooperation and Punishment in Public Goods Experiments
Fehr, E., & Gächter, S. (2000) · American Economic Review · doi:10.1257/aer.90.4.980 · Cited by 4,547
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022 · cited 6×
“The results show that people can treat machines in a social manner [Nass and Moon 2000; Nass et al. 1996, 1997, 1999, 2000; Reeves and Nass 1996].”
BackgroundResultInfluentialRunning experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767 · cited 1×
“Previous research shows that studies performed on Mechanical Turk can yield high-quality data, minimize experimental biases, and successfully replicate the results of behavioral studies performed on traditional pools [Paolacci et al. 2010].”
ResultDehumanization: An integrative review
Haslam, N. (2006) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr1003_4 · Cited by 2,919 · cited 1×
“Denying mind to others or perceiving inferior mental ability in others, in turn, is known to lead to discrimination [Haslam 2006], and thus, may explain why people favored humans to machines.”
BackgroundLerner, J. S., Li, Y., Valdesolo, P., & Kassam, K. S. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115043 · Cited by 2,913
Falk, A., & Fischbacher, U. (2006) · Games and Economic Behavior · doi:10.1016/j.geb.2005.03.001 · Cited by 2,416
Gray, H. M., Gray, K., & Wegner, D. M. (2007) · Science · doi:10.1126/science.1134475 · Cited by 2,342 · cited 3×
“These findings are compatible with research that shows that people perceive less mind in machines than in humans [Gray et al. 2007; Waytz et al. 2010].”
BackgroundResultNass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · cited 1×
“…research shows that people are able to make clear distinctions between interacting with computers and the people responsible for programming them [Nass et al. 1994; Study 5] ; and (b) the instructions described the computers as acting on their own behalf and never mentioned the experimenters.”
Dawes, R. M. (1980) · Annual Review of Psychology · doi:10.1146/annurev.ps.31.020180.001125 · Cited by 2,022
Social dilemmas: the anatomy of cooperation
Kollock, P. (1998) · Annual Review of Sociology · doi:10.1146/annurev.soc.24.1.183 · Cited by 1,746 · cited 2×
“In Experiment 1, participants engaged in the public goods game [Kollock 1998].”
BackgroundPreferences, property rights, and anonymity in bargaining games.
Hoffman, E., McCabe, K., Shachat, K., & Smith, V. (1994) · Games and Economic Behavior · doi:10.1006/game.1994.1056 · Cited by 1,674
A neural basis for social cooperation
Rilling, J. K., Gutman, D. A., Zeh, T. R., Pagnoni, G., Berns, G. S., & Kilts, C. D. (2002) · Neuron · doi:10.1016/s0896-6273(02)00755-9 · Cited by 1,451
Do People Mean What They Say? Implications for Subjective Survey Data
Bertrand, M., & Mullainathan, S. (2001) · American Economic Review · doi:10.1257/aer.91.2.67 · Cited by 1,391
Blascovich, J., Loomis, J., Beall, A. C., Swinth, K. R., Hoyt, C. L., & Bailenson, J. N. (2002) · Psychological Inquiry · doi:10.1207/s15327965pli1302_01 · Cited by 1,280
A functional imaging study of cooperation in two-person reciprocal exchange
McCabe, K., Houser, D., Ryan, L., Smith, V., & Trouard, T. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.211415698 · Cited by 984
Causes and consequences of mind perception
Waytz, A., Gray, K., Epley, N., & Wegner, D. M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.006 · Cited by 759 · cited 3×
“These findings are compatible with research that shows that people perceive less mind in machines than in humans [Gray et al. 2007; Waytz et al. 2010].”
BackgroundResultAre Machines Gender Neutral? Gender‐Stereotypic Responses to Computers With Voices
Nass, C., Moon, Y., & Green, N. (1997) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1997.tb00275.x · Cited by 670 · cited 6×
“The results show that people can treat machines in a social manner [Nass and Moon 2000; Nass et al. 1996, 1997, 1999, 2000; Reeves and Nass 1996].”
BackgroundResultInfluentialTangney, J. P. (1990) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.59.1.102 · Cited by 601
Ketelaar, T., & Tung Au, W. (2003) · Cognition and Emotion · doi:10.1080/02699930143000662 · Cited by 482
Creating Rapport with Virtual Agents
Gratch, J., Wang, N., Gerten, J., Fast, E., & Duffy, R. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_12 · Cited by 419 · cited 1×
“Some of the studies supporting this theory show that people build rapport with machines [Gratch et al. 2007], react to emotion expressed by machines [de Melo et al. 2014], demonstrate politeness to machines [Nass et al. 1999], form positive impressions of machines that are perceived as team members…”
BackgroundSelf-citationReading people’s minds from emotion expressions in interdependent decision making.
de Melo, C. M., Carnevale, P. J., Read, S. J., & Gratch, J. (2014) · Journal of Personality and Social Psychology · doi:10.1037/a0034251 · Cited by 260
Self-citationVan Kleef, G. A., De Dreu, C. K. W., & Manstead, A. S. R. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.91.1.124 · Cited by 227 · cited 4×
“Moreover, contrary to prior research [Lim and Reeves 2010; Mandryk et al. 2006; Okita et al. 2007; Ravaja 2009; Sanfey et al. 2003; Van't Wout et al. 2006], this result emphasizes that people do not always experience less emotion with machines than with humans.”
BackgroundInfluential
Cited by
Trusting Intelligent Machines: Deepening Trust Within Socio-Technical Systems
Andras, P., Esterle, L., Guckert, M., Han, T. A., Lewis, P. R., Milanovic, K., Payne, T., Perret, C., Pitt, J., Powers, S. T., et al. (2018) · IEEE Technology and Society Magazine · doi:10.1109/mts.2018.2876107 · Cited by 153
“■ Emotions: Evidence from human-computer interaction studies [25] shows that AI/robots can be trusted more when they are capable of emotional expressions, e.”
BackgroundThe evolution of trust and trustworthiness
Kumar, A., Capraro, V., & Perc, M. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0491 · Cited by 148
Chugunova, M., & Sele, D. (2022) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2022.101897 · Cited by 118
Open Problems in Cooperative AI
Dafoe, A., Hughes, E., Bachrach, Y., Collins, T., McKee, K. R., Leibo, J. Z., Larson, K., & Graepel, T. (2020) · arXiv · doi:10.48550/arxiv.2012.08630 · Cited by 93
von Schenk, A., Klockmann, V., & Köbis, N. (2025) · Perspectives on Psychological Science · doi:10.1177/17456916231194949 · Cited by 30
Metadata
- Authors
- Melo, C. D., Marsella, S., & Gratch, J.
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2016-05-11
- Volume
- 23
- Issue
- 2
- Pages
- 1-17
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2368404818
- Cited by
- 61
- References
- 23
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.