Rage against the machine: Automation in the moral domain
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
The introduction of ever more capable autonomous systems is moving at a rapid pace. The technological progress will enable us to completely delegate to machines processes that were once a prerogative for humans. Progress in fields like autonomous driving promises huge benefits on both economical and ethical scales. Yet, there is little research that investigates the utilization of machines to perform tasks that are in the moral domain. This study explores whether subjects are willing to delegate tasks that affect third parties to machines as well as how this decision is evaluated by an impartial observer. We examined two possible factors that might coin attitudes regarding machine use—perceived utility of and trust in the automated device. We found that people are hesitant to delegate to a machine and that observers judge such delegations in relatively critical light. Neither perceived utility nor trust, however, can account for this pattern. Alternative explanations that we test in a post-experimental survey also do not find support. We may thus observe an aversion per se against machine use in the moral domain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Preparing a nation for autonomous vehicles: opportunities, barriers and policy recommendations
Fagnant, D. J., & Kockelman, K. (2015) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2015.04.003 · Cited by 3,214
Are we all less risky and more skillful than our fellow drivers?
Svenson, O. (1981) · Acta Psychologica · doi:10.1016/0001-6918(81)90005-6 · Cited by 1,969
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
Trust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
Egocentric biases in availability and attribution.
Ross, M., & Sicoly, F. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.3.322 · Cited by 799
The Perceived Utility of Human and Automated Aids in a Visual Detection Task
Dzindolet, M. T., Pierce, L. G., Beck, H. P., & Dawe, L. A. (2002) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720024494856 · Cited by 386
Ethical Decision Making during Automated Vehicle Crashes
Goodall, N. J. (2014) · Transportation Research Record: Journal of the Transportation Research Board · doi:10.3141/2424-07 · Cited by 292
Autonomous Cars: In Favor of a Mandatory Ethics Setting
Gogoll, J., & Müller, J. F. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-016-9806-x · Cited by 251
Self-citation
Cited by
People are averse to machines making moral decisions.
Bigman, Y. E., & Gray, K. (2018) · Cognition · doi:10.1016/j.cognition.2018.08.003 · Cited by 738
What influences algorithmic decision-making? A systematic literature review on algorithm aversion
Mahmud, H., Islam, A. K. M. N., Ahmed, S. I., & Smolander, K. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121390 · Cited by 601
Algorithmic discrimination causes less moral outrage than human discrimination
Bigman, Y. E., Wilson, D., Arnestad, M. N., Waytz, A., & Gray, K. (2023) · Journal of Experimental Psychology: General · doi:10.1037/xge0001250 · Cited by 198
Chugunova, M., & Sele, D. (2022) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2022.101897 · Cited by 118
Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems
He, G., Kuiper, L., & Gadiraju, U. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581025 · Cited by 107
“phenomenon is called “Algorithm Aversion,” which has been observed across multiple domains, like moral decision making [31], economic bargains [23], medical diagnosis [54], and autonomous driving [14].”
Background
Metadata
- Authors
- Gogoll, J., & Uhl, M.
- Venue
- Journal of Behavioral and Experimental Economics
- Publisher
- Elsevier BV
- Published
- 2018-06
- Volume
- 74
- Pages
- 97-103
- ISSN
- 2214-8043 (ISSN-L)
- OpenAlex
- W2798067689
- Cited by
- 108
- References
- 10
- FWCI
- 3.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.