The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
The Impossibility of Automating Ambiguity
Abstract
On the one hand, complexity science and enactive and embodied cognitive science approaches emphasize that people, as complex adaptive systems, are ambiguous, indeterminable, and inherently unpredictable. On the other, Machine Learning (ML) systems that claim to predict human behaviour are becoming ubiquitous in all spheres of social life. I contend that ubiquitous Artificial Intelligence (AI) and ML systems are close descendants of the Cartesian and Newtonian worldview in so far as they are tools that fundamentally sort, categorize, and classify the world, and forecast the future. Through the practice of clustering, sorting, and predicting human behaviour and action, these systems impose order, equilibrium, and stability to the active, fluid, messy, and unpredictable nature of human behaviour and the social world at large. Grounded in complexity science and enactive and embodied cognitive science approaches, this article emphasizes why people, embedded in social systems, are indeterminable and unpredictable. When ML systems “pick up” patterns and clusters, this often amounts to identifying historically and socially held norms, conventions, and stereotypes. Machine prediction of social behaviour, I argue, is not only erroneous but also presents real harm to those at the margins of society.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Black Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment.
Brewer, R. M., & Collins, P. H. (1992) · Contemporary Sociology · doi:10.2307/2074808 · Cited by 19,445
Meeting the Universe Halfway: Quantum Physics and the Entanglement of Matter and Meaning
Barad, K. (2006) · doi:10.2307/j.ctv12101zq · Cited by 10,472
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
Clark, A., & Chalmers, D. (1998) · Analysis · doi:10.1093/analys/58.1.7 · Cited by 6,333 · cited 1×
“On a similar note, distributed cognition and extended mind (Clark & Chalmers, 1998) frameworks have challenged the idea that cognition ends at the skull and that the skin marks the contours of the self, fuzzing the traditionally held neat to long-standing problems.”
BackgroundAhmed, S. (2007) · Feminist Theory · doi:10.1177/1464700107078139 · Cited by 2,144 · cited 4×
“However, the argument remains that, so long as classification and predictive systems operate within a white straight ontology (Ahmed, 2007), precise and accurate prediction risks measuring how closely behaviours or actions adhere to socially and historically held stereotypes.”
BackgroundInfluentialParticipatory sense-making: An enactive approach to social cognition
De Jaegher, H., & Di Paolo, E. (2007) · Phenomenology and the Cognitive Sciences · doi:10.1007/s11097-007-9076-9 · Cited by 1,640
The Black Box Society: The Secret Algorithms That Control Money and Information
(2016) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/0094306116641409c · Cited by 1,334
Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Dastin, J. (2022) · Ethics of Data and Analytics · doi:10.1201/9781003278290-44 · Cited by 1,165
Simulation, situated conceptualization, and prediction
Barsalou, L. W. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0319 · Cited by 1,017
Can social interaction constitute social cognition?
De Jaegher, H., Di Paolo, E., & Gallagher, S. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.009 · Cited by 911
Cited by
Rethinking Fairness: An Interdisciplinary Survey of Critiques of Hegemonic ML Fairness Approaches
Weinberg, L. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13196 · Cited by 127
Evidence, ethics and the promise of artificial intelligence in psychiatry
McCradden, M., Hui, K., & Buchman, D. Z. (2023) · Journal of Medical Ethics · doi:10.1136/jme-2022-108447 · Cited by 97
Responsible AI in Africa: Challenges and Opportunities
(2023) · Social and Cultural Studies of Robots and AI · doi:10.1007/978-3-031-08215-3 · Cited by 82
Prabhudesai, S., Yang, L., Asthana, S., Huan, X., Liao, Q. V., & Banovic, N. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584033 · Cited by 82
“For example, despite learning from inherently uncertain knowledge of the world [78], existing ML-based DSS are not transparent about uncertainty in their predictions [14].”
BackgroundResponsible AI in Africa—Challenges and Opportunities
Okolo, C. T., Aruleba, K., & Obaido, G. (2023) · Social and Cultural Studies of Robots and AI · doi:10.1007/978-3-031-08215-3_3 · Cited by 79
Metadata
- Authors
- Birhane, A.
- Venue
- Artificial Life
- Publisher
- MIT Press
- Published
- 2021
- Volume
- 27
- Issue
- 1
- Pages
- 44-61
- ISSN
- 1064-5462 (ISSN-L)
- 1530-9185
- OpenAlex
- W3166488533
- Cited by
- 168
- References
- 23
- FWCI
- 39.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Impossibility of Automating Ambiguity. https://app.cochat.ai/papers/10.1162/artl_a_00336
- The paper
- Birhane, A. (2021). The Impossibility of Automating Ambiguity. Artificial Life. https://doi.org/10.1162/artl_a_00336
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.