Difference and Dependence among Digital Workers: The Case of Amazon Mechanical Turk
Open accessAbstract
Digitally mediated labor can take many forms: valorized and visible, hidden and forgotten, or even disavowed. This article examines one particular digital work system: Amazon Mechanical Turk (AMT). AMT is a system that organizes tens of thousands of workers to do data-processing work; workers might contract with hundreds of employers in a year without ever meeting them. Employers, likewise, can access these workers through computer interfaces without ever interacting with them. I examine the AMT-mediated computational labor relations between technologist employers and the data-processing workers who work for them. In systems such as AMT, some people are employers, entrepreneurs, and programmers, and others simulate computation for them. The subjectivities of valorized workers are dependent on employing and distancing the labor of AMT workers. I take up these relations of dependency and disavowal as symptomatic of emerging forms and stakes of digital work.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Irani and Gray and Suri find that behind the growing capabilities of Artificial Intelligence are millions of human decisions and hours of labor.
“Irani (2015a) and Gray and Suri (2019) also find that behind the growing capabilities of Artificial Intelligence are millions of human decisions and hours of labor.”
From Dependence and precarity in the platform economy (2020) · cites this paper as Irani (2015a)
In “Transforming People into ‘Human Computation’” (page unavailable), Irani describes workers performing data-processing tasks whose outputs feed computer systems; the Conclusion (page unavailable) emphasizes that this labor is kept out of sight. The paper supports the underlying point about human labor behind computational services, but it does not establish millions of decisions or hours of labor, or make a general finding about the growing capabilities of AI. (LLM, conf=0.84)
Experimental — accuracy not yet measuredHuman management remains important even in the most digitized or algorithmically-managed applications.
“Another important finding in this literature is the extent to which human management remains important, even in the most digitized or algorithmically-managed applications.”
From Dependence and precarity in the platform economy (2020) · cites this paper as Irani (2015a)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Terranova, T. (2000) · Social Text · doi:10.1215/01642472-18-2_63-33 · Cited by 1,749 · see citing works
Suchman, L. (1995) · Communications of the ACM · doi:10.1145/223248.223263 · Cited by 991 · see citing works
Flagged first, then by citations
Research works printed but not linked: 11
- Benkler, Yochai. 2006. The Wealth of Networks. New Haven, CT: Yale University Press.
- Blanchette, Jean François. 2011. "A Material History of Bits." Journal of the American Society for Information Science and Technology 62, no. 6: 1042-57.
- Braverman, John. 1998. Labor and Monopoly Capital: The Degradation of Work in the Twenti- eth Century. New York: Monthly Review.
- Castells, Manuel. 2000. The Rise of the Network Society. Sussex: Wiley-Blackwell.
- Downey, Greg. 2014. "Making Media Work: Time, Space, Identity, and Labor in Analysis of Information and Communication Infrastructures." In Media Technologies: Essays on Communication, Materiality, and Society, edited by Tarleton Gillespie, Pablo Bocz- kowski, and Kristen Foot, 141-66. Cambridge, MA: MIT Press.
- Gieryn, Thomas. 1983. "Boundary-Work and the Demarcation of Science from Non-Science: Strains and Interests in Professional Ideologies of Scientists." American Sociological Review 48: 781-95.
- Martin, David, et al. 2014. "Being A Turker." In CSCW '14: Proceedings of the 17th ACM Con- ference on Computer Supported Cooperative Work and Social Computing, Baltimore, Feb- ruary 15-19. New York: ACM.
- Nakamura, Lisa, and Donna Haraway. 2003. "Prospects for a Materialist Informatics: An Interview with Donna Haraway." Electronic Book Review. www.electronicbookreview .com/thread/technocapitalism/interview
- Nakano Glenn, Evelyn. 1985. "Racial Ethnic Women's Labor: The Intersection of Race, Gen- der, and Class Oppression." Review of Radical Political Economics 17, no. 3: 86-108.
- Schmidt, Kjeld. 2011. Cooperative Work and Coordinative Practices. London: Springer.
- Scholz, Trebor. 2012. Digital Labor: The Internet as Playground and Factory. New York: Routledge.
Cited by
Sorted by citations
Algorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732 · see citing works
What Do Platforms Do? Understanding the Gig Economy
Vallas, S., & Schor, J. B. (2020) · Annual Review of Sociology · doi:10.1146/annurev-soc-121919-054857 · Cited by 1,354 · see citing works
van Doorn, N. (2017) · Information, Communication & Society · doi:10.1080/1369118x.2017.1294194 · Cited by 941 · see citing works
Dependence and precarity in the platform economy
Schor, J. B., Attwood-Charles, W., Cansoy, M., Ladegaard, I., & Wengronowitz, R. (2020) · Theory and Society · doi:10.1007/s11186-020-09408-y · Cited by 550 · see citing works
“Shestakofsy’s (2017) ethnography of a matching platform for household services found high complementarity between human and machine functions; Irani (2015a) and Gray and Suri (2019) also find that behind the growing capabilities of Artificial Intelligence aremillions of human decisions and hours of…”
BackgroundRani, U., & Furrer, M. (2021) · Competition & Change · doi:10.1177/1024529420905187 · Cited by 306 · see citing works
Tubaro, P., Casilli, A. A., & Coville, M. (2020) · Big Data & Society · doi:10.1177/2053951720919776 · Cited by 262 · see citing works
The platform as factory: Crowdwork and the hidden labour behind artificial intelligence
Altenried, M. (2020) · Capital & Class · doi:10.1177/0309816819899410 · Cited by 242 · see citing works
Automation: is it really different this time?
Wajcman, J. (2017) · The British Journal of Sociology · doi:10.1111/1468-4446.12239 · Cited by 220 · see citing works
Working Algorithms: Software Automation and the Future of Work
Shestakofsky, B. (2017) · Work and Occupations · doi:10.1177/0730888417726119 · Cited by 186 · see citing works
Gmyrek, P., Berg, J., Bescond, D., & International Labour Organization. Research Department (2023) · doi:10.54394/fhem8239 · Cited by 140 · see citing works
Liable, but not in control? Ensuring meaningful human agency in automated decision-making systems
Wagner, B. (2019) · Policy & Internet · doi:10.1002/poi3.198 · Cited by 136 · see citing works
Micro-work, artificial intelligence and the automotive industry
Tubaro, P., & Casilli, A. A. (2019) · Journal of Industrial and Business Economics · doi:10.1007/s40812-019-00121-1 · Cited by 122 · see citing works
“Boundaryless” in the creative economy: assessing freelancing on Upwork
Popiel, P. (2017) · Critical Studies in Media Communication · doi:10.1080/15295036.2017.1282618 · Cited by 104 · see citing works
Data and its (dis)contents: A survey of dataset development and use in machine learning research
Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100336 · Cited by 548 · see citing works
Manufacturing an Artificial Intelligence Revolution
Katz, Y. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3078224 · Cited by 53 · see citing works
The rise and fall of Electra: emergence and transformation of a global cryptocurrency community
Caliskan, K. (2024) · Review of Social Economy · doi:10.1080/00346764.2022.2039404 · Cited by 7 · see citing works
- Authors
- Irani, L.
- Corresponding author
- Irani, Lilly
- ORCID
- Irani, Lilly
- Venue
- South Atlantic Quarterly
- Publisher
- Duke University Press
- Published
- 2015-01-01
- Volume
- 114
- Issue
- 1
- Pages
- 225-234
- ISSN
- 0038-2876 (ISSN-L)
- 1527-8026
- OpenAlex
- W2100232516
- Cited by
- 367
- References
- 2
- Citations by year
- 2026: 22 · 2025: 52 · 2024: 46 · 2023: 30 · 2022: 50 · 2021: 25 · 2020: 43 · 2019: 34 · 2018: 28 · 2017: 18 · 2016: 13 · 2015: 5
- FWCI
- 70.61
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- South Atlantic Quarterly (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Digital Economy and Work Transformation
- Social Sciences › Business, Management and Accounting › Industrial relations › Legal and Labor Studies
- Social Sciences › Safety Research › Employment, Labor, and Gender Studies
- Keywords
- Amazon Mechanical Turk, digital labor, labor relations, worker subjectivity, dependency, disavowal, platform work
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review