Monsters, Metaphors, and Machine Learning
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Machine learning (ML) poses complex challenges for user experience (UX) designers. Typically unpredictable and opaque, it may produce unforeseen outcomes detrimental to particular groups or individuals, yet simultaneously promise amazing breakthroughs in areas as diverse as medical diagnosis and universal translation. This results in a polarized view of ML, which is often manifested through a technology-as-monster metaphor. In this paper, we acknowledge the power and potential of this metaphor by resurfacing historic complexities in human-monster relations. We (re)introduce these liminal and ambiguous creatures, and discuss their relation to ML. We offer a background to designers' use of metaphor, and show how the technology-as-monster metaphor can generatively probe and (re)frame the questions ML poses. We illustrate the effectiveness of this approach through a detailed discussion of an early-stage generative design workshop inquiring into ML approaches to supporting student mental health and well-being.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dilemmas in a general theory of planning
Rittel, H. W. J., & Webber, M. M. (1973) · Policy Sciences · doi:10.1007/bf01405730 · Cited by 16,338 · cited 1×
“Its particular importance to design process and practice came to the fore following the metaphoric turn [109], heralded by Schön e.g. [140] and Rittel & Webber e.g [132].”
BackgroundThe use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217 · cited 2×
“…questions about the design of ML applications to software engineers [42, 172], we should not be surprised if the situation becomes framed around questions of optimization and efficiency [23, 30, 171], rather than consideration for contexts of use [12, 65, 107] and ethical concerns [55, 124].”
BackgroundResultSocial Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · cited 1×
“The metaphor reminds us that social media can have a downside [162, 3, 95], and that ML is a key technology in the development of business practices that have become known as ‘surveillance capitalism’ [179].”
BackgroundCo-creation and the new landscapes of design
Sanders, E. B.-N., & Stappers, P. J. (2008) · CoDesign · doi:10.1080/15710880701875068 · Cited by 5,561
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340 · cited 1×
“The ML models used to generate predictions from these data are typically intentional black-boxes, opaque even to the data scientists and software engineers who design, select and implement them [27].”
MethodA few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 3×
“Today, classification is among the most common tasks undertaken by ML [38], and can tell us much about what might be considered ‘unnatural’ or ‘monstrous’ [13].”
BackgroundFoucault, M. (2005) · doi:10.4324/9780203996645 · Cited by 3,281
Big other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 3,205 · cited 1×
“The metaphor reminds us that social media can have a downside [162, 3, 95], and that ML is a key technology in the development of business practices that have become known as ‘surveillance capitalism’ [179].”
BackgroundBarocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 2×
“Today, classification is among the most common tasks undertaken by ML [38], and can tell us much about what might be considered ‘unnatural’ or ‘monstrous’ [13].”
BackgroundAn empirical comparison of supervised learning algorithms
Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143865 · Cited by 2,780 · cited 2×
“…questions about the design of ML applications to software engineers [42, 172], we should not be surprised if the situation becomes framed around questions of optimization and efficiency [23, 30, 171], rather than consideration for contexts of use [12, 65, 107] and ethical concerns [55, 124].”
BackgroundResultGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“The current upturn in HCI research interest around ML has produced interaction guidelines [4], and new design approaches that attempt to make AI ‘unremarkable’ [174] or address users’ expectations [80].”
BackgroundPRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS
ROSENBLATT, F. (1961) · doi:10.21236/ad0256582 · Cited by 1,691
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 1×
“However, these artifacts may also encourage unrealistic expectations [99], or fail to respond in a way that follows user intent [176].”
BackgroundAlgorithms as culture: Some tactics for the ethnography of algorithmic systems
Seaver, N. (2017) · Big Data & Society · doi:10.1177/2053951717738104 · Cited by 1,010
Friedman, B. (1996) · Interactions · doi:10.1145/242485.242493 · Cited by 966 · cited 3×
“Therefore, designers need to frame and facilitate wider consideration for a system’s users and contexts of use [12, 65, 107], including ethical and societal concerns [55, 124], for example through the conscious and explicit use of metaphor [104, 105].”
BackgroundThe social media disorder scale
van den Eijnden, R. J. J. M., Lemmens, J. S., & Valkenburg, P. M. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.03.038 · Cited by 948 · cited 1×
“The metaphor reminds us that social media can have a downside [162, 3, 95], and that ML is a key technology in the development of business practices that have become known as ‘surveillance capitalism’ [179].”
BackgroundLambrecht, A., & Tucker, C. (2019) · Management Science · doi:10.1287/mnsc.2018.3093 · Cited by 854 · cited 2×
“[86] Anja Lambrecht and Catherine Tucker.”
BackgroundAbdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
Veale, M., & Binns, R. (2017) · Big Data & Society · doi:10.1177/2053951717743530 · Cited by 512
Veale, M., & Binns, R. (2017) · doi:10.31235/osf.io/ustxg · Cited by 512
Algorithms and their others: Algorithmic culture in context
Dourish, P. (2016) · Big Data & Society · doi:10.1177/2053951716665128 · Cited by 481 · cited 3×
“This algorithm is embedded within sociotechnical structures, and moulded by communities of practice [7]; it is intimately tied to particular data, with which it will co-evolve [40]; and it may appear not as a singular technical object, but rather as unstable, multiple, enacted in use [142].”
BackgroundSituating methods in the magic of Big Data and AI
Elish, M. C., & boyd, D. (2018) · Communication Monographs · doi:10.1080/03637751.2017.1375130 · Cited by 409
Toward an Ethics of Algorithms: Convening, Observation, Probability, and Timeliness
Ananny, M. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915606523 · Cited by 395 · cited 2×
“This algorithm is embedded within sociotechnical structures, and moulded by communities of practice [7]; it is intimately tied to particular data, with which it will co-evolve [40]; and it may appear not as a singular technical object, but rather as unstable, multiple, enacted in use [142].”
BackgroundUX Design Innovation: Challenges for Working with Machine Learning as a Design Material
Dove, G., Halskov, K., Forlizzi, J., & Zimmerman, J. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025739 · Cited by 391 · cited 6×
“If, as research suggests, UX designers are typically deferring important questions about the design of ML applications to software engineers [42, 172], we should not be surprised if the situation becomes framed around questions of optimization and efficiency [23, 30, 171], rather than consideration…”
BackgroundResultInfluentialSelf-citationAlgorithms, Governance, and Governmentality: On Governing Academic Writing
Introna, L. D. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915587360 · Cited by 339 · cited 1×
“Similar performative interactions are found in high frequency financial trading [10, 103], and academic writing [75].”
BackgroundRISK, RACE, AND RECIDIVISM: PREDICTIVE BIAS AND DISPARATE IMPACT*
SKEEM, J. L., & LOWENKAMP, C. T. (2016) · Criminology · doi:10.1111/1745-9125.12123 · Cited by 317
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277
Learning from a learning thermostat: lessons for intelligent systems for the home
Yang, R., & Newman, M. W. (2013) · Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing · doi:10.1145/2493432.2493489 · Cited by 268 · cited 1×
“However, these artifacts may also encourage unrealistic expectations [99], or fail to respond in a way that follows user intent [176].”
BackgroundYang, Q., Steinfeld, A., & Zimmerman, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300468 · Cited by 247 · cited 1×
“The current upturn in HCI research interest around ML has produced interaction guidelines [4], and new design approaches that attempt to make AI ‘unremarkable’ [174] or address users’ expectations [80].”
BackgroundInteracting meaningfully with machine learning systems: Three experiments
Stumpf, S., Rajaram, V., Li, L., Wong, W.-K., Burnett, M., Dietterich, T., Sullivan, E., & Herlocker, J. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.03.004 · Cited by 184
Star, S. L., & Bowker, G. C. (2007) · Ethics and Information Technology · doi:10.1007/s10676-007-9141-7 · Cited by 142
Toward human-centered algorithm design
Baumer, E. P. (2017) · Big Data & Society · doi:10.1177/2053951717718854 · Cited by 125 · cited 3×
“Assumptions and biases which may escape notice when design and development are driven and assessed primarily by technical constraints (e.g. because offending results are considered aberrations), typically only enter the picture after an application is publicly released [14].”
BackgroundInfluentialAlgorithms as fetish: Faith and possibility in algorithmic work
Thomas, S. L., Nafus, D., & Sherman, J. (2018) · Big Data & Society · doi:10.1177/2053951717751552 · Cited by 72
Cited by
Dhanorkar, S., Wolf, C. T., Qian, K., Xu, A., Popa, L., & Li, Y. (2021) · Designing Interactive Systems Conference 2021 · doi:10.1145/3461778.3462131 · Cited by 119
How Experienced Designers of Enterprise Applications Engage AI as a Design Material
Yildirim, N., Kass, A., Tung, T., Upton, C., Costello, D., Giusti, R., Lacin, S., Lovic, S., O'Neill, J. M., Meehan, R. O., et al. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517491 · Cited by 71
“There is a growing body of work for providing processes and tools to support practitioners in developing fairer systems [20, 56, 80].”
BackgroundMetaphors in Voice User Interfaces: A Slippery Fish
Desai, S., & Twidale, M. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3609326 · Cited by 42
Benjamin, J. J., Lindley, J., Edwards, E., Rubegni, E., Korjakow, T., Grist, D., & Sharkey, R. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660677 · Cited by 32
Kim, J., & Kim, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642476 · Cited by 30
“These issues include lack of understanding the intersection between AI technology and human needs [47], the tendency to overestimate AI capabilities [30], difficulties in pro-totyping [22], and managing risks, with a special focus on ethics and social impact [14, 69].”
Background
Metadata
- Authors
- Dove, G., & Fayard, A.-L.
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-17
- OpenAlex
- W3030367426
- Cited by
- 59
- References
- 34
- FWCI
- 5.26
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.