"Our Privacy Needs to be Protected at All Costs": Crowd Workers' Privacy Experiences on Amazon Mechanical Turk
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Crowdsourcing platforms such as Amazon Mechanical Turk (MTurk) are widely used by organizations, researchers, and individuals to outsource a broad range of tasks to crowd workers. Prior research has shown that crowdsourcing can pose privacy risks (e.g., de-anonymization) to crowd workers. However, little is known about the specific privacy issues crowd workers have experienced and how they perceive the state of privacy in crowdsourcing. In this paper, we present results from an online survey of 435 MTurk crowd workers from the US, India, and other countries and areas. Our respondents reported different types of privacy concerns (e.g., data aggregation, profiling, scams), experiences of privacy losses (e.g., phishing, malware, stalking, targeted ads), and privacy expectations on MTurk (e.g., screening tasks). Respondents from multiple countries and areas reported experiences with the same privacy issues, suggesting that these problems may be endemic to the whole MTurk platform. We discuss challenges, high-level principles and concrete suggestions in protecting crowd workers'; privacy on MTurk and in crowdsourcing more broadly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Information Privacy: Measuring Individuals’ Concerns About Organizational Practices1
Smith, H. J., Milberg, S. J., & Burke, S. J. (1996) · MIS Quarterly · doi:10.2307/249477 · Cited by 2,266
Information Privacy Research: an Interdisciplinary Review1
Smith, H. J., Dinev, T., & Xu, H. (2011) · MIS Quarterly · doi:10.2307/41409970 · Cited by 2,013 · cited 1×
“Prior literature on information disclosure has shown that people’s privacy concerns can affect their intention to disclose information (e.g., in online shopping sites) [50].”
BackgroundSolove, D. J. (2006) · University of Pennsylvania Law Review · doi:10.2307/40041279 · Cited by 1,388
Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M., & Horton, J. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441923 · Cited by 1,034 · cited 2×
“The desire to provide and receive quality responses on MTurk motivates greater information disclosure, thus creating additional privacy concerns [30].”
Reliability in content analysis: some common misconceptions and recommendations.
Krippendorff, K. (2004) · Human Communication Research · doi:10.1093/hcr/30.3.411 · Cited by 1,027
Turkopticon: interrupting worker invisibility in amazon mechanical turk
Irani, L. C., & Silberman, M. S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470742 · Cited by 798 · cited 6×
“Crowd workers are often treated as an API call [49], as a computational service [25], or as a commodity [2].”
BackgroundInfluentialPrivacy in electronic commerce and the economics of immediate gratification
Acquisti, A. (2004) · Proceedings of the 5th ACM conference on Electronic commerce · doi:10.1145/988772.988777 · Cited by 561
Understanding User Beliefs About Algorithmic Curation in the Facebook News Feed
Rader, E., & Gray, R. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702174 · Cited by 386 · cited 1×
“Inspired by a prior study [47], before our respondents entered the survey we also emphasized that detailed responses would support our analysis and improve MTurk workers’ future experience.”
ResultSocial transparency in networked information exchange: a theoretical framework
Stuart, H. C., Dabbish, L., Kiesler, S., Kinnaird, P., & Kang, R. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145275 · Cited by 100 · cited 1×
“Social transparency is defined as “the availability of social meta-data surrounding information exchange” [54].”
Background
Cited by
Privacy, Surveillance, and Power in the Gig Economy
Sannon, S., Sun, B., & Cosley, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502083 · Cited by 61
“In crowdwork, many tasks involve sharing personal data [64, 75]; in freelancing, providing personal information could be a post-hoc condition for being paid; in ridesharing, customers have sometimes innocent but sometimes threatening conversations about drivers’ personal lives.”
BackgroundInfluentialSimons, R. N., Gurari, D., & Fleischmann, K. R. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415176 · Cited by 27
Garg, R., Cui, H., & Kapadia, Y. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479495 · Cited by 15
FairPrism: Evaluating Fairness-Related Harms in Text Generation
Fleisig, E., Amstutz, A., Atalla, C., Blodgett, S. L., Daumé III, H., Olteanu, A., Sheng, E., Vann, D., & Wallach, H. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.343 · Cited by 14
“4 Previous work has highlighted limitations of MTurk, sometimes shared by other crowdsourcing platforms, such as demographic imbalance (Hitlin, 2016), lack of privacy (Xia et al., 2017), and prevalence of spam (Gadiraju et al., 2015).”
BackgroundSurvey on Astroturfing Detection and Analysis from an Information Technology Perspective
Chen, T., Liu, J., Wu, Y., Tian, Y., Tong, E., Niu, W., Li, Y., Xiang, Y., & Wang, W. (2021) · Security and Communication Networks · doi:10.1155/2021/3294610 · Cited by 10
“+e crowd workers’ on Amazon Mechanical Turk (MTurk) used to call for “Our Privacy Needs to be protected at All Costs” [66].”
Background
Metadata
- Authors
- Xia, H., Wang, Y., Huang, Y., & Shah, A.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2017-12-06
- Volume
- 1
- Issue
- CSCW
- Pages
- 1-22
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2771736953
- Cited by
- 48
- References
- 10
- FWCI
- 9.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.