Blaming Humans and Machines: What Shapes People’s Reactions to Algorithmic Harm
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) systems can cause harm to people. This research examines how individuals react to such harm through the lens of blame. Building upon research suggesting that people blame AI systems, we investigated how several factors influence people’s reactive attitudes towards machines, designers, and users. The results of three studies (N = 1,153) indicate differences in how blame is attributed to these actors. Whether AI systems were explainable did not impact blame directed at them, their developers, and their users. Considerations about fairness and harmfulness increased blame towards designers and users but had little to no effect on judgments of AI systems. Instead, what determined people’s reactive attitudes towards machines was whether people thought blaming them would be a suitable response to algorithmic harm. We discuss implications, such as how future decisions about including AI systems in the social and moral spheres will shape laypeople’s reactions to AI-caused harm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 4×
“Decision-making algorithms have been found to discriminate against African American patients and defendants [4, 83].”
BackgroundInfluentialThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Prolific.ac—A subject pool for online experiments
Palan, S., & Schitter, C. (2018) · Journal of Behavioral and Experimental Finance · doi:10.1016/j.jbef.2017.12.004 · Cited by 3,450 · cited 1×
“Hence, we recruited 212 participants through the Prolific crowdsourcing platform [85] to account for attention-check failures, i.e., at least 67 participants per treatment group, assuming a 5% attention-check failure rate.”
MethodBarocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 1×
“Explainability grants a new form of power to developers by allowing them to control what kind of information is made visible to those subjected to algorithmic decision-making [10].”
BackgroundThird-party punishment and social norms
Fehr, E., & Fischbacher, U. (2004) · Evolution and Human Behavior · doi:10.1016/s1090-5138(04)00005-4 · Cited by 2,417
Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859 · cited 1×
“For instance, scholars have investigated public expectations of self-driving cars [7], and recent work has inquired how laypeople react to crashes through the lens of blame [41].”
BackgroundTask-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., & Lehmann, D. R. (2019) · Journal of Marketing Research · doi:10.1177/0022243719851788 · Cited by 1,500 · cited 1×
“AI systems’ decisions are perceived as less fair and trustworthy than identical human decisions in settings that require human skills (i.e., subjective tasks, such as hiring), but not in settings perceived as mechanical (i.e., objective tasks, such as work scheduling) [20, 67].”
BackgroundLee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338 · cited 1×
“AI systems’ decisions are perceived as less fair and trustworthy than identical human decisions in settings that require human skills (i.e., subjective tasks, such as hiring), but not in settings perceived as mechanical (i.e., objective tasks, such as work scheduling) [20, 67].”
BackgroundAcute Myocardial Infarction in Women: A Scientific Statement From the American Heart Association
Mehta, L. S., Beckie, T. M., DeVon, H. A., Grines, C. L., Krumholz, H. M., Johnson, M. N., Lindley, K. J., Vaccarino, V., Wang, T. Y., Watson, K. E., et al. (2016) · Circulation · doi:10.1161/cir.0000000000000351 · Cited by 1,244 · cited 1×
“Coronary heart disease is underdiagnosed and undertreated in women [79], and women are less likely to survive an acute myocardial infarction (commonly known as a heart attack), partially due to the differences in the clinical presentation [110] and the medical treatment they receive [24].”
BackgroundAmazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Dastin, J. (2022) · Ethics of Data and Analytics · doi:10.1201/9781003278290-44 · Cited by 1,165
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
The responsibility gap: Ascribing responsibility for the actions of learning automata
Matthias, A. (2004) · Ethics and Information Technology · doi:10.1007/s10676-004-3422-1 · Cited by 1,101 · cited 1×
“Exploring whom people blame when machines cause harm is significant given the concern that the deployment of autonomous and self-learning systems gives rise to a responsibility gap [77].”
BackgroundMind Perception Is the Essence of Morality
Gray, K., Young, L., & Waytz, A. (2012) · Psychological Inquiry · doi:10.1080/1047840x.2012.651387 · Cited by 1,008 · cited 1×
“Social psychology theories posit that perceived harm is the “essence of morality” [46].”
BackgroundMini Meta‐Analysis of Your Own Studies: Some Arguments on Why and a Primer on How
Goh, J. X., Hall, J. A., & Rosenthal, R. (2016) · Social and Personality Psychology Compass · doi:10.1111/spc3.12267 · Cited by 994
Veale, M., & Zuiderveen Borgesius, F. (2021) · Computer Law Review International · doi:10.9785/cri-2021-220402 · Cited by 805
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757 · cited 1×
“Humans tend to overrely on machines [62] and decision-making algorithms [8], particularly if they are explainable [9] as the ones explored in this research.”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2006.14779 · Cited by 754
Langer, M., Oster, D., Speith, T., Hermanns, H., Kästner, L., Schmidt, E., Sesing, A., & Baum, K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103473 · Cited by 652 · cited 3×
“Explainable machines have a wide range of functions, ranging from ensuring that systems are fair to evaluating whether they do what they are supposed to [65].”
BackgroundMalle, B. F., Guglielmo, S., & Monroe, A. E. (2014) · Psychological Inquiry · doi:10.1080/1047840x.2014.877340 · Cited by 632
How artificial intelligence is changing drug discovery
Fleming, N. (2018) · Nature · doi:10.1038/d41586-018-05267-x · Cited by 546 · cited 1×
“Medicine has received considerable attention from AI research, with algorithms being used to discover new drugs [40], identify patients at risk [83], and many other functions.”
BackgroundFour Responsibility Gaps with Artificial Intelligence: Why they Matter and How to Address them
Santoni de Sio, F., & Mecacci, G. (2021) · Philosophy & Technology · doi:10.1007/s13347-021-00450-x · Cited by 490 · cited 1×
“Blameworthiness is one of the components of the responsibility gap [31], raising the question of whether any actor is a suitable subject of blame when machines cause harm.”
BackgroundBeyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5285 · Cited by 466 · cited 1×
“Humans tend to overrely on machines [62] and decision-making algorithms [8], particularly if they are explainable [9] as the ones explored in this research.”
BackgroundEgocentric interpretations of fairness and interpersonal conflict
Thompson, L., & Loewenstein, G. (1992) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(92)90010-5 · Cited by 463 · cited 1×
“People have different opinions about fairness depending on whether they or others are the subjects of discriminatory decisions [99].”
BackgroundIntroduction matters: Manipulating trust in automation and reliance in automated driving
Körber, M., Baseler, E., & Bengler, K. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2017.07.006 · Cited by 418
First I "like" it, then I hide it: Folk Theories of Social Feeds
Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A., Hamilton, K., & Kirlik, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858494 · Cited by 375
Who should i blame? effects of autonomy and transparency on attributions in human-robot interaction
Kim, T., & Hinds, P. (2006) · ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/roman.2006.314398 · Cited by 217
Brown, A., Chouldechova, A., Putnam-Hornstein, E., Tobin, A., & Vaithianathan, R. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300271 · Cited by 207
Highly automated job interviews: Acceptance under the influence of stakes
Langer, M., König, C. J., & Papathanasiou, M. (2019) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12246 · Cited by 203 · cited 1×
“People exhibit a preference for humans over AI systems in high-stakes scenarios [64] and in settings associated with higher degrees of inherent uncertainty [32], such as investing and medical decision-making.”
BackgroundAlgorithmic discrimination causes less moral outrage than human discrimination
Bigman, Y. E., Wilson, D., Arnestad, M. N., Waytz, A., & Gray, K. (2023) · Journal of Experimental Psychology: General · doi:10.1037/xge0001250 · Cited by 198
Technology with No Human Responsibility?
Johnson, D. G. (2015) · Journal of Business Ethics · doi:10.1007/s10551-014-2180-1 · Cited by 195
Robots, law and the retribution gap
Danaher, J. (2016) · Ethics and Information Technology · doi:10.1007/s10676-016-9403-3 · Cited by 192 · cited 1×
“Scholars argue that blaming AI systems would be morally wrong because they are not appropriate subjects of retributive blame [27].”
BackgroundAre Current Tort Liability Doctrines Adequate for Addressing Injury Caused by AI?
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.160 · Cited by 188 · cited 1×
“, the respondeat superior doctrine, which recent legal scholarship has proposed as a possible liability regime for AI [72, 98].”
BackgroundUser attitudes towards algorithmic opacity and transparency in online reviewing platforms
Eslami, M., Vaccaro, K., Lee, M. K., Elazari Bar On, A., Gilbert, E., & Karahalios, K. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300724 · Cited by 184 · cited 2×
“Our findings are consistent with previous work showing that one’s perceptions of AI impacts how they view and use such systems [15, 35–37].”
BackgroundResultDo people hold a humanoid robot morally accountable for the harm it causes?
Kahn, P. H., Kanda, T., Ishiguro, H., Gill, B. T., Ruckert, J. H., Shen, S., Gary, H. E., Reichert, A. L., Freier, N. G., & Severson, R. L. (2012) · Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction · doi:10.1145/2157689.2157696 · Cited by 178
Legal requirements on explainability in machine learning
Bibal, A., Lognoul, M., de Streel, A., & Frénay, B. (2021) · Artificial Intelligence and Law · doi:10.1007/s10506-020-09270-4 · Cited by 165
Ahmed, S., Nutt, C. T., Eneanya, N. D., Reese, P. P., Sivashanker, K., Morse, M., Sequist, T., & Mendu, M. L. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-020-06280-5 · Cited by 147
The Who in XAI: How AI Background Shapes Perceptions of AI Explanations
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M., & Riedl, M. O. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642474 · Cited by 123 · cited 1×
“Scholars have also observed that technical knowledge about AI affects how people interpret explanations [34].”
BackgroundHuman Decision Making with Machine Assistance: An Experiment on Bailing and Jailing
Grgić-Hlača, N., Engel, C., & Gummadi, K. P. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359280 · Cited by 113 · cited 1×
“Completely delegating decisions to algorithms may be illegal in certain domains, such as bail decisions, in which defendants have the right to be heard by a competent human judge [47].”
BackgroundSelf-citation”Because AI is 100% right and safe”: User Attitudes and Sources of AI Authority in India
Kapania, S., Siy, O., Clapper, G., SP, A. M., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517533 · Cited by 90
Langer, M., Hunsicker, T., Feldkamp, T., König, C. J., & Grgić-Hlača, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517527 · Cited by 55
Self-citationBlaming automated vehicles in difficult situations
Franklin, M., Awad, E., & Lagnado, D. (2021) · iScience · doi:10.1016/j.isci.2021.102252 · Cited by 47 · cited 1×
“For instance, scholars have investigated public expectations of self-driving cars [7], and recent work has inquired how laypeople react to crashes through the lens of blame [41].”
Background
Cited by
Zhang, R., Li, H., Meng, H., Zhan, J., Gan, H., & Lee, Y.-C. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713429 · Cited by 123
“Prior work suggests that user perceptions of AI harms or system failures are shaped by multiple factors, such as personal expectations, cognitive biases, and moral considerations [39, 56].”
Anthis, J. R., Pauketat, J. V. T., Ladak, A., & Manoli, A. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713329 · Cited by 24
“AI is often blamed or held responsible when they cause harm [49, 50, 90–92, 164, 173], though there have been mixed results in studies of whether they are blamed more or less than humans in similar contexts [102, 106, 111].”
Anthis, J. R., Pauketat, J. V. T., Ladak, A., & Manoli, A. (2024) · arXiv · doi:10.48550/arxiv.2407.08867 · Cited by 24
Building, Shifting, & Employing Power: A Taxonomy of Responses From Below to Algorithmic Harm
DeVrio, A., Eslami, M., & Holstein, K. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658958 · Cited by 21
The AI Double Standard: Humans Judge All AIs for the Actions of One
Manoli, A., Pauketat, J. V. T., & Anthis, J. R. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711083 · Cited by 12
Metadata
- Authors
- Lima, G., Grgić-Hlača, N., & Cha, M.
- Venue
- Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2023-04-19
- Pages
- 1-26
- OpenAlex
- W4362679249
- Cited by
- 30
- References
- 42
- FWCI
- 7.74
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.