Consumers Object to Algorithms Making Morally Relevant Tradeoffs Because of Algorithms’ Consequentialist Decision Strategies
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Why do consumers embrace some algorithms and find others objectionable? The moral relevance of the domain in which an algorithm operates plays a role. The authors find that consumers believe that algorithms are more likely to use maximization (i.e., attempting to maximize some measured outcome) as a decision‐making strategy than human decision makers (Study 1). Consumers find this consequentialist decision strategy to be objectionable in morally relevant tradeoffs and disapprove of algorithms making morally relevant tradeoffs as a result (Studies 2, 3a, & 3b). Consumers also object to human employees making morally relevant tradeoffs when they are trained to make decisions by maximizing outcomes, consistent with the notion that their objections to algorithmic decision makers stem from concerns about maximization (Study 4). The results provide insight into why consumers object to some consumer relevant algorithms while adopting others.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived organizational support: a review of the literature.
Rhoades, L., & Eisenberger, R. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.4.698 · Cited by 7,592 · cited 1×
“…work on procedural justice shows that people ’ s satisfaction with allocation decisions often depends on the perceived fairness of the decision process in addition to the decision outcomes (Alexander, & Ruderman, 1987; Konovsky, 2000; Lind & Tyler, 1988; Rhoades & Eisenberger, 2002; Tyler, 1988).”
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Self-citationHow the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 2×
“For example, even experts often do not understand exactly how a speci fi c machine learning algorithm arrives at a decision (Burrell, 2016; Kroll et al., 2016), or cannot explain why a machine learning algorithm operates the way that it does (Kroll et al., 2016).”
Algorithm appreciation: People prefer algorithmic to human judgment
Logg, J. M., Minson, J. A., & Moore, D. A. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.005 · Cited by 2,061
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015 · cited 2×
“…of automation (see Castelo et al., 2019; Dietvorst & Bharti, 2020; Diet-vorst, Simmons, & Massey, 2015, 2016; Kim & McGill, 2018; Leung et al., 2018; Longoni et al., 2019; Luo et al., 2019; Mende et al., 2019) by investigating a factor that can help to explain why the acceptability of automation…”
The social dilemma of autonomous vehicles
Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2016) · Science · doi:10.1126/science.aaf2654 · Cited by 1,527
Task-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., & Lehmann, D. R. (2019) · Journal of Marketing Research · doi:10.1177/0022243719851788 · Cited by 1,500 · cited 4×
“Consumers are generally hesitant to use algorithms for tasks that seem subjective (Castelo, Bos, & Lehmann, 2019).”
InfluentialTetlock, P. E., Kristel, O. V., Elson, S. B., Green, M. C., & Lerner, J. S. (2000) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.78.5.853 · Cited by 1,400
Luo, X., Tong, S., Fang, Z., & Qu, Z. (2019) · Marketing Science · doi:10.1287/mksc.2019.1192 · Cited by 1,262
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230
Self-citation
Cited by
The Moral Psychology of Artificial Intelligence
Bonnefon, J.-F., Rahwan, I., & Shariff, A. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-030123-113559 · Cited by 151
Formosa, P., Rogers, W., Griep, Y., Bankins, S., & Richards, D. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107296 · Cited by 129
How Artificial Intelligence Constrains the Human Experience
Valenzuela, A., Puntoni, S., Hoffman, D., Castelo, N., De Freitas, J., Dietvorst, B., Hildebrand, C., Huh, Y. E., Meyer, R., Sweeney, M. E., et al. (2024) · Journal of the Association for Consumer Research · doi:10.1086/730709 · Cited by 81
“As a result, they may object to any algorithm implementation based on maximization in these domains, even when developers may have worked to align it with people ’ s preferences as much as possible (Dietvorst and Bartels 2022).”
BackgroundSelf-citationReducing prejudice with counter‐stereotypical AI
Hermann, E., De Freitas, J., & Puntoni, S. (2025) · Consumer Psychology Review · doi:10.1002/arcp.1102 · Cited by 21
The impact of text topic and assumed human vs. AI authorship on competence and quality assessment
Proksch, S., Schühle, J., Streeb, E., Weymann, F., Luther, T., & Kimmerle, J. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1412710 · Cited by 17
Metadata
- Authors
- Dietvorst, B. J., & Bartels, D. M.
- Venue
- Journal of Consumer Psychology
- Publisher
- Wiley
- Published
- 2021-07-28
- Volume
- 32
- Issue
- 3
- Pages
- 406-424
- ISSN
- 1057-7408 (ISSN-L)
- 1532-7663
- OpenAlex
- W3181173654
- Cited by
- 95
- References
- 19
- FWCI
- 16.07
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Consumers Object to Algorithms Making Morally Relevant Tradeoffs Because of Algorithms’ Consequentialist Decision Strategies. https://app.cochat.ai/papers/10.1002/jcpy.1266
- The paper
- Dietvorst, B. J., & Bartels, D. M. (2022). Consumers Object to Algorithms Making Morally Relevant Tradeoffs Because of Algorithms’ Consequentialist Decision Strategies. Journal of Consumer Psychology. https://doi.org/10.1002/jcpy.1266
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.