Invisible Influence: Artificial Intelligence and the Ethics of Adaptive Choice Architectures
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
For several years, scholars have (for good reason) been largely preoccupied with worries about the use of artificial intelligence and machine learning (AI/ML) tools to make decisions about us. Only recently has significant attention turned to a potentially more alarming problem: the use of AI/ML to influence our decision-making. The contexts in which we make decisions--what behavioral economists call our choice architectures--are increasingly technologically-laden. Which is to say: algorithms increasingly determine, in a wide variety of contexts, both the sets of options we choose from and the way those options are framed. Moreover, artificial intelligence and machine learning (AI/ML) makes it possible for those options and their framings--the choice architectures--to be tailored to the individual chooser. They are constructed based on information collected about our individual preferences, interests, aspirations, and vulnerabilities, with the goal of influencing our decisions. At the same time, because we are habituated to these technologies we pay them little notice. They are, as philosophers of technology put it, transparent to us--effectively invisible. I argue that this invisible layer of technological mediation, which structures and influences our decision-making, renders us deeply susceptible to manipulation. Absent a guarantee that these technologies are not being used to manipulate and exploit, individuals will have little reason to trust them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
The Black Box Society: The Secret Algorithms That Control Money and Information
(2016) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/0094306116641409c · Cited by 1,334
Technology and the lifeworld: from garden to earth
(1990) · Choice Reviews Online · doi:10.5860/choice.28-1535 · Cited by 1,281
‘Hypernudge’: big Data as a mode of regulation by design
Yeung, K. (2017) · Information, Communication & Society · doi:10.1080/1369118x.2016.1186713 · Cited by 868 · cited 4×
“tured to match our particular cognitive idiosyncrasies [44].”
BackgroundInfluentialWhat Things Do: Philosophical Reflections on Technology, Agency, and Design
Verbeek, P.-P. (2005) · doi:10.1515/9780271033228 · Cited by 371
Accountability in a computerized society
Nissenbaum, H. (1996) · Science and Engineering Ethics · doi:10.1007/bf02639315 · Cited by 346
Online manipulation: hidden influences in a digital world
Susser, D., Roessler, B., & Nissenbaum, H. F. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3306006 · Cited by 341 · cited 2×
“Rather, these “adaptive choice architectures,” as I call them, work to subtly guide us toward certain ends (Esposti 2014; Yeung 2017; Susser, Roessler, and Nissenbaum 2018).”
BackgroundSelf-citationA Field Guide To Postphenomenology: Robert Rosenberger and Peter-Paul Verbeek
(2015) · Postphenomenological Investigations · doi:10.5040/9781978726208.ch-001 · Cited by 189
When big data meets dataveillance: the hidden side of analytics
Degli Esposti, S. (2014) · Surveillance & Society · doi:10.24908/ss.v12i2.5113 · Cited by 151
Cited by
Kirk, H. R., Vidgen, B., Röttger, P., & Hale, S. A. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00820-y · Cited by 122
Voorveld, H. A. M., Meppelink, C. S., & Boerman, S. C. (2024) · International Journal of Advertising · doi:10.1080/02650487.2023.2264045 · Cited by 62
AI-deploying organizations are key to addressing ‘perfect storm’ of AI risks
Curtis, C., Gillespie, N., & Lockey, S. (2023) · AI and Ethics · doi:10.1007/s43681-022-00163-7 · Cited by 43
“It has also been noted that our habitual use of these devices can lead to unquestioning acceptance [33].”
BackgroundEngström, E., & Strimling, P. (2020) · Technology in Society · doi:10.1016/j.techsoc.2020.101396 · Cited by 34
A Mechanism-Based Approach to Mitigating Harms from Persuasive Generative AI
El-Sayed, S., Akbulut, C., McCroskery, A., Keeling, G., Kenton, Z., Jalan, Z., Marchal, N., Manzini, A., Shevlane, T., Vallor, S., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.15058 · Cited by 10
Self-citation
Metadata
- Authors
- Susser, D.
- Venue
- Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2019-01-27
- Pages
- 403-408
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W2961335886
- Cited by
- 64
- References
- 10
- FWCI
- 5.18
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.