Cited by 262Digital Economy and Work TransformationLegal and Labor StudiesEthics and Social Impacts of AI

The trainer, the verifier, the imitator: Three ways in which human platform workers support artificial intelligence

Open access
Tubaro, Paola, Casilli, Antonio A, Coville, Marion·2020·Big Data & Society

Abstract

This paper sheds light on the role of digital platform labour in the development of today’s artificial intelligence, predicated on data-intensive machine learning algorithms. Focus is on the specific ways in which outsourcing of data tasks to myriad ‘micro-workers’, recruited and managed through specialized platforms, powers virtual assistants, self-driving vehicles and connected objects. Using qualitative data from multiple sources, we show that micro-work performs a variety of functions, between three poles that we label, respectively, ‘artificial intelligence preparation’, ‘artificial intelligence verification’ and ‘artificial intelligence impersonation’. Because of the wide scope of application of micro-work, it is a structural component of contemporary artificial intelligence production processes – not an ephemeral form of support that may vanish once the technology reaches maturity stage. Through the lens of micro-work, we prefigure the policy implications of a future in which data technologies do not replace human workforce but imply its marginalization and precariousness.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/2053951720919776

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. De Stefano V (2016) Introduction to the special issue: crowdsourcing, the gig-economy and the law. Comparative Labor Law & Policy Journal 37(3): 461-470.
  2. Silberman S and Irani L (2016) Operating an employer reputation system: Lessons from Turkopticon, 2008-2015. Comparative Labor Law & Policy Journal 37(3): 505-542.

Cited by

Sorted by citations

Authors
Tubaro, P., Casilli, A. A., & Coville, M.
Affiliations
  • Centre National de la Recherche Scientifique (FR)
  • Télécom Paris (FR)
  • Université de Poitiers (FR)
Corresponding author
Tubaro, Paola
Venue
Big Data & Society
Published
2020-01
Volume
7
Issue
1
Pages
205395172091977
ISSN
2053-9517 (ISSN-L)
OpenAlex
W3018104257
Cited by
262
References
26
Citations by year
2026: 44 · 2025: 61 · 2024: 48 · 2023: 38 · 2022: 45 · 2021: 19 · 2020: 7
FWCI
36.46
Type
journal article
Language
en
Open access
Locations
  • Big Data & Society (publishedVersion, cc-by-nc-nd)
  • RePEc: Research Papers in Economics (submittedVersion)
  • HAL (submittedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • France Stratégie
  • MSH Paris Saclay (17-MA07)
  • Force Ouvrière - Institut de recherches économiques et sociales
Topics
  • Social Sciences › Sociology and Political Science › Digital Economy and Work Transformation
  • Social Sciences › Business, Management and Accounting › Industrial relations › Legal and Labor Studies
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
Keywords
AI development, data annotation, machine learning training data, precarious employment, AI verification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review