Privacy, Power, and Invisible Labor on Amazon Mechanical Turk
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Tasks on crowdsourcing platforms such as Amazon Mechanical Turk often request workers' personal information, raising privacy risks that may be exacerbated by requester-worker power dynamics. We interviewed 14 workers to understand how they navigate these risks. We found that Turkers' decisions to provide personal information during tasks were based on evaluations of the pay rate, the requester, the purpose, and the perceived sensitivity of the request. Participants also engaged in multiple privacy-protective behaviors, such as abandoning tasks or providing inaccurate data, though there were costs associated with these behaviors, such as wasted time and risk of rejection. Finally, their privacy concerns and practices evolved as they learned about both the platform and worker-designed tools and forums. These findings deepen our understanding of both privacy decision-making and invisible labor in paid crowdsourcing, and emphasize a general need to understand how privacy stances change over time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Information Privacy Concerns, Procedural Fairness, and Impersonal Trust: An Empirical Investigation
Culnan, M. J., & Armstrong, P. K. (1999) · Organization Science · doi:10.1287/orsc.10.1.104 · Cited by 1,870 · cited 1×
“Research on other online contexts, such as social media or online shopping, finds that people engage in a privacy calculus, weighing the benefits of providing their information against the costs to their privacy [5].”
BackgroundLayers of Silence, Arenas of Voice: The Ecology of Visible and Invisible Work
Star, S. L., & Strauss, A. (1999) · Computer Supported Cooperative Work (CSCW) · doi:10.1023/a:1008651105359 · Cited by 1,500
Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M., & Horton, J. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441923 · Cited by 1,034
Turkopticon: interrupting worker invisibility in amazon mechanical turk
Irani, L. C., & Silberman, M. S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470742 · Cited by 798 · cited 1×
“Savvy Turkers vet individual requesters by both writing and checking reviews left by other Turkers on sites such as Turkopticon [13].”
BackgroundA Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk
Hara, K., Adams, A., Milland, K., Savage, S., Callison-Burch, C., & Bigham, J. P. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174023 · Cited by 497 · cited 4×
“Returning HITs is common: through an analysis of 2,676 workers and 3.8 million HITs, Hara et al. found that 12.8% of all HITs were returned [12]—wasted effort that significantly reduced average hourly wages.”
BackgroundMethodInfluentialQualitative Interviewing and Grounded Theory Analysis
Charmaz, K. (2001) · Handbook of Interview Research · doi:10.4135/9781412973588.n39 · Cited by 327
Examining Crowd Work and Gig Work Through The Historical Lens of Piecework
Alkhatib, A., Bernstein, M. S., & Levi, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025974 · Cited by 148 · cited 1×
“The guide was developed based on our research questions and was informed by participant-observation, a valuable practice for crowd work research [1].”
Method
Cited by
Watched, but Moving: Platformization of Beauty Work and Its Gendered Mechanisms of Control
Anjali Anwar, I., Pal, J., & Hui, J. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3432949 · Cited by 77
Privacy, Surveillance, and Power in the Gig Economy
Sannon, S., Sun, B., & Cosley, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502083 · Cited by 61
“Crowdworkers, on the other hand, rarely described privacy concerns arising from the platform because their main interactions are with customers who design the task requirements that cause privacy and surveillance risks [ 64].”
BackgroundInfluentialSelf-citation(2022) · doi:10.1145/3491102.3501957 · Cited by 47
In/Visibility in Social Media Work: The Hidden Labor Behind the Brands
(2022) · doi:10.17645/mac.v10i1.4460 · Cited by 39
Who Broke Amazon Mechanical Turk?: An Analysis of Crowdsourcing Data Quality over Time
Marshall, C. C., Goguladinne, P. S. R., Maheshwari, M., Sathe, A., & Shipman, F. M. (2023) · Proceedings of the 15th ACM Web Science Conference 2023 · doi:10.1145/3578503.3583622 · Cited by 20
Metadata
- Authors
- Sannon, S., & Cosley, D.
- Venue
- Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2019-05-02
- Pages
- 1-12
- OpenAlex
- W2941417947
- Cited by
- 59
- References
- 7
- FWCI
- 23.34
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Privacy, Power, and Invisible Labor on Amazon Mechanical Turk. https://app.cochat.ai/papers/10.1145/3290605.3300512
- The paper
- Sannon, S., & Cosley, D. (2019). Privacy, Power, and Invisible Labor on Amazon Mechanical Turk. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300512
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.