The Data-Production Dispositif
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Machine learning (ML) depends on data to train and verify models. Very often, organizations outsource processes related to data work (i.e., generating and annotating data and evaluating outputs) through business process outsourcing (BPO) companies and crowdsourcing platforms. This paper investigates outsourced ML data work in Latin America by studying three platforms in Venezuela and a BPO in Argentina. We lean on the Foucauldian notion of dispositif to define the data-production dispositif as an ensemble of discourses, actions, and objects strategically disposed to (re)produce power/knowledge relations in data and labor. Our dispositif analysis comprises the examination of 210 data work instruction documents, 55 interviews with data workers, managers, and requesters, and participant observation. Our findings show that discourses encoded in instructions reproduce and normalize the worldviews of requesters. Precarious working conditions and economic dependency alienate workers, making them obedient to instructions. Furthermore, discourses and social contexts materialize in artifacts, such as interfaces and performance metrics, limiting workers' agency and normalizing specific ways of interpreting data. We conclude by stressing the importance of counteracting the data-production dispositif by fighting alienation and precarization, and empowering data workers to become assets in the quest for high-quality data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Foucault, M. (1982) · Critical Inquiry · doi:10.1086/448181 · Cited by 8,496
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 1×
“sponds to the voracious demand for more, cheaper, and increasingly differentiated data to feed the growing AI industry [5, 13].”
BackgroundPoell, T., Nieborg, D., & van Dijck, J. (2019) · Internet Policy Review · doi:10.14763/2019.4.1425 · Cited by 823 · cited 1×
“They serve as infrastructures that “facilitate and shape personalised interactions among end-users and complementors, organised through the systematic collection, algorithmic processing, monetisation, and circulation of data” [63].”
BackgroundTurkopticon: interrupting worker invisibility in amazon mechanical turk
Irani, L. C., & Silberman, M. S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470742 · Cited by 798 · cited 1×
“In contrast, other researchers have documented the “practices, politics, and values of workers in the data pipeline” [73, 74] and the sociotechnical organization of data work that privileges speed, scale, and scalability over worker wellbeing [37], low wages [18, 33], dependency [71], and the power asymmetries vis-à-v…”
“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI
Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., & Aroyo, L. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445518 · Cited by 781 · cited 1×
“In contrast, other researchers have documented the “practices, politics, and values of workers in the data pipeline” [73, 74] and the sociotechnical organization of data work that privileges speed, scale, and scalability over worker wellbeing [37], low wages [18, 33], dependency [71], and the power…”
Identifying Mislabeled Training Data
Brodley, C. E., & Friedl, M. A. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.606 · Cited by 612
The cultural work of microwork
Irani, L. (2015) · New Media & Society · doi:10.1177/1461444813511926 · Cited by 568 · cited 3×
“Previous research has highlighted the role of these elements to guarantee a façade where AI is seen as neutral, unbiased, and efficient due to the lack of human intervention — and error — while keeping workers and factors of production hidden from the public lens [10, 30, 37].”
BackgroundA Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk
Hara, K., Adams, A., Milland, K., Savage, S., Callison-Burch, C., & Bigham, J. P. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174023 · Cited by 497 · cited 1×
“…“practices, politics, and values of workers in the data pipeline” [73, 74] and the sociotechnical organization of data work that privileges speed, scale, and scalability over worker wellbeing [37], low wages [18, 33], dependency [71], and the power asymmetries vis-à-vis requesters [38, 52, 53, 72].”
BackgroundWood, A. J., Lehdonvirta, V., & Graham, M. (2018) · New Technology, Work and Employment · doi:10.1111/ntwe.12112 · Cited by 402
Tubaro, P., Casilli, A. A., & Coville, M. (2020) · Big Data & Society · doi:10.1177/2053951720919776 · Cited by 262
(2019) · doi:10.1145/3351095.3372862 · Cited by 167
Between Subjectivity and Imposition: Power Dynamics in Data Annotation for Computer Vision
Miceli, M., Schuessler, M., & Yang, T. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415186 · Cited by 149
Self-citationUnderstanding and Mitigating Worker Biases in the Crowdsourced Collection of Subjective Judgments
Hube, C., Fetahu, B., & Gadiraju, U. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300637 · Cited by 129 · cited 1×
“Some investigations have explored the role of worker subjectivity on datasets [7, 12, 29, 84] and have proposed ways to recognize and address worker bias [3, 28, 36, 84].”
BackgroundBourdieu and Foucault on power and modernity
Cronin, C. (1996) · Philosophy & Social Criticism · doi:10.1177/019145379602200603 · Cited by 123
Embedded reproduction in platform data work
Posada, J. (2022) · Information, Communication & Society · doi:10.1080/1369118x.2022.2049849 · Cited by 89
Self-citationDesigning Ground Truth and the Social Life of Labels
Muller, M., Wolf, C. T., Andres, J., Desmond, M., Joshi, N. N., Ashktorab, Z., Sharma, A., Brimijoin, K., Pan, Q., Duesterwald, E., et al. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445402 · Cited by 83
Lifting the curtain: Strategic visibility of human labour in AI-as-a-Service
Newlands, G. (2021) · Big Data & Society · doi:10.1177/20539517211016026 · Cited by 66
(2022) · doi:10.1145/3491102.3501868 · Cited by 36 · cited 1×
“For example, medical professionals in the case of AI for healthcare [6, 55, 79], education professionals [50], or internet users when answering ReCAPTCHA tests [40].”
BackgroundSecurity as Dispositif: Michel Foucault in the Field of Security
Wichum, R. (2013) · Foucault Studies · doi:10.22439/fs.v0i15.3996 · Cited by 35
Kazimzade, G., & Miceli, M. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375809 · Cited by 16
Self-citationHow annotation styles influence content and preferences
Cheng, J., & Cosley, D. (2013) · Proceedings of the 24th ACM Conference on Hypertext and Social Media · doi:10.1145/2481492.2481519 · Cited by 14 · cited 1×
“Some investigations have explored the role of worker subjectivity on datasets [7, 12, 29, 84] and have proposed ways to recognize and address worker bias [3, 28, 36, 84].”
Background
Cited by
The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice
Delgado, F., Yang, S., Madaio, M., & Yang, Q. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623261 · Cited by 256
Artificial Intelligence in the Colonial Matrix of Power
Muldoon, J., & Wu, B. A. (2023) · Philosophy & Technology · doi:10.1007/s13347-023-00687-8 · Cited by 148
AI Empire: Unraveling the interlocking systems of oppression in generative AI's global order
Tacheva, J., & Ramasubramanian, S. (2023) · Big Data & Society · doi:10.1177/20539517231219241 · Cited by 138
The poverty of ethical AI: impact sourcing and AI supply chains
Muldoon, J., Cant, C., Graham, M., & Ustek Spilda, F. (2025) · AI & SOCIETY · doi:10.1007/s00146-023-01824-9 · Cited by 88
Dahlgren Lindström, A., Methnani, L., Krause, L., Ericson, P., de Rituerto de Troya, Í. M., Coelho Mollo, D., & Dobbe, R. (2025) · Ethics and Information Technology · doi:10.1007/s10676-025-09837-2 · Cited by 54
Metadata
- Authors
- Miceli, M., & Posada, J.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2022-11-07
- Volume
- 6
- Issue
- CSCW2
- Pages
- 1-37
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W4309619003
- Cited by
- 118
- References
- 21
- FWCI
- 30.11
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.