Accounting for Market Frictions and Power Asymmetries in Online Labor Markets
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Amazon Mechanical Turk (AMT) is an online labor market that defines itself as “a marketplace for work that requires human intelligence.” Early advocates and developers of crowdsourcing platforms argued that crowdsourcing tasks are designed so people of any skill level can do this labor online. However, as the popularity of crowdsourcing work has grown, the crowdsourcing literature has identified a peculiar issue: that work quality of workers is not responsive to changes in price. This means that unlike what economic theory would predict, paying crowdworkers higher wages does not lead to higher quality work. This has led some to believe that platforms, like AMT, attract poor quality workers. This article examines different market dynamics that might, unwittingly, contribute to the inefficiencies in the market that generate poor work quality. We argue that the cultural logics and socioeconomic values embedded in AMT's platform design generate a greater amount of market power for requesters (those posting tasks) than for individuals doing tasks for pay (crowdworkers). We attribute the uneven distribution of market power among participants to labor market frictions, primarily characterized by uncompetitive wage posting and incomplete information. Finally, recommendations are made for how to tackle these frictions when contemplating the design of an online labor market.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172 · cited 3×
“Mason and Suri (2012) advocate recruiting a panel of trusted workers to participate in research studies, which has been used to great effect in follow up work (Mason & Watts, 2012; Suri & Watts, 2011; Wang, Suri, & Watts, 2012).”
BackgroundMethodSelf-citationGillespie, T. (2014) · Media Technologies · doi:10.7551/mitpress/9042.003.0013 · Cited by 1,016
Turkopticon: interrupting worker invisibility in amazon mechanical turk
Irani, L. C., & Silberman, M. S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470742 · Cited by 798 · cited 1×
“In response to this information asymmetry researchers Irani and Silberman (2013) developed a browser extension (Turkopticon) 11 that allows crowdworkers to rate requesters and view ratings submitted by fellow workers.”
BackgroundShepherding the crowd yields better work
Dow, S., Kulkarni, A., Klemmer, S., & Hartmann, B. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145355 · Cited by 334
Cooperation and assortativity with dynamic partner updating
Wang, J., Suri, S., & Watts, D. J. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1120867109 · Cited by 198
Self-citationAlgorithmic Authority: The Case of Bitcoin
Lustig, C., & Nardi, B. (2015) · 2015 48th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2015.95 · Cited by 166 · cited 2×
“All of these factors, mediated by the API, shape the labor market supply dynamics of this online labor market.”
BackgroundMethod
Cited by
OECD Employment Outlook 2019: The Future of Work
OECD (2019) · OECD Employment Outlook · doi:10.1787/9ee00155-en · Cited by 821
Flexibility in the gig economy: managing time on three online piecework platforms
Lehdonvirta, V. (2018) · New Technology, Work and Employment · doi:10.1111/ntwe.12102 · Cited by 550
Consumer segmentation within the sharing economy: The case of Airbnb
Lutz, C., & Newlands, G. (2018) · Journal of Business Research · doi:10.1016/j.jbusres.2018.03.019 · Cited by 304
Uber's Drivers: Information Asymmetries and Control in Dynamic Work
Rosenblat, A., & Stark, L. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2686227 · Cited by 300
Boundaryless careers in the gig economy: An oxymoron?
Kost, D., Fieseler, C., & Wong, S. I. (2020) · Human Resource Management Journal · doi:10.1111/1748-8583.12265 · Cited by 272
Metadata
- Authors
- Kingsley, S. C., Gray, M. L., & Suri, S.
- Venue
- Policy & Internet
- Publisher
- Wiley
- Published
- 2015-11-15
- Volume
- 7
- Issue
- 4
- Pages
- 383-400
- ISSN
- 1944-2866 (ISSN-L)
- OpenAlex
- W2272251967
- Cited by
- 70
- References
- 6
- FWCI
- 8.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Accounting for Market Frictions and Power Asymmetries in Online Labor Markets. https://app.cochat.ai/papers/10.1002/poi3.111
- The paper
- Kingsley, S. C., Gray, M. L., & Suri, S. (2015). Accounting for Market Frictions and Power Asymmetries in Online Labor Markets. Policy & Internet. https://doi.org/10.1002/poi3.111
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.