The DOI matches its Crossref record.
Responsible research with crowds: pay crowdworkers at least minimum wage
Abstract
High-level guidelines for the treatment of crowdworkers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Researchers and academic associations have called for transparency and ethical practices in outsourcing data work.
“Moreover, researchers and academic associations have called for transparency and ethical practices in outsourcing data work [118].”
From 'The plan is just survival': Data Work in Kenya and the Regime of Entrapment (2026) · cites this paper as [118]
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 10
- 10.1145/1979742.1979606 · DOI
- Berg , J . Income security in the on-demand economy: Findings and policy lessons from a survey of crowdworkers . Comparative Labor Law & Policy Journal 37 , 3 ( 2016 ). Berg, J. Income security in the on-demand economy: Findings and policy lessons from a survey of crowdworkers. Comparative Labor Law & Policy Journal 37, 3 (2016).
- Farrell , D. and Greig , F . Paychecks, paydays, and the online platform economy: Big data on income volatility . JP Morgan Chase Institute , 2016 . Farrell, D. and Greig, F. Paychecks, paydays, and the online platform economy: Big data on income volatility. JP Morgan Chase Institute, 2016.
- Harris , M. Amazon's Mechanical Turk workers protest: 'I am a human being, not an algorithm.' The Guardian (Dec. 3 , 2014 ); http://bit.ly/2EcZvMS. Harris, M. Amazon's Mechanical Turk workers protest: 'I am a human being, not an algorithm.' The Guardian (Dec. 3, 2014); http://bit.ly/2EcZvMS.
- Hitlin , P. Research in the crowdsourcing age, a case study . Pew Research Center , July 2016 . Hitlin, P. Research in the crowdsourcing age, a case study. Pew Research Center, July 2016.
- 10.3758/s13428-014-0483-x · DOI
- 10.1007/s10606-015-9241-6 · DOI
- 10.1126/science.aad6499 · DOI
- Silberman , M. et al. Stop citing Ross et al . 2010 , 'Who are the crowdworkers?'; http://bit.ly/2FkrObs. Silberman, M. et al. Stop citing Ross et al. 2010, 'Who are the crowdworkers?'; http://bit.ly/2FkrObs.
- Vakharia , D. and Lease , M . Beyond Mechanical Turk: An analysis of paid crowd work platforms . In Proceedings of iConference 2015 . ( 2015 ). Vakharia, D. and Lease, M. Beyond Mechanical Turk: An analysis of paid crowd work platforms. In Proceedings of iConference 2015. (2015).
Cited by
Sorted by citations
The Ethics of AI Ethics -- An Evaluation of Guidelines
Hagendorff, T. (2019) · arXiv · doi:10.48550/arxiv.1903.03425 · Cited by 1,907
“Although “clickwork” is a necessary prerequisite for the application of methods of supervised machine learning, it is associated with numerous social problems (Silberman et al. 2018), such as low wages, work conditions and psychological work consequences, which tend to be ignored by the AI community.”
BackgroundThe Ethics of AI Ethics: An Evaluation of Guidelines
Hagendorff, T. (2020) · Minds and Machines · doi:10.1007/s11023-020-09517-8 · Cited by 1,911
“Although “clickwork” is a necessary prerequisite for the application of methods of supervised machine learning, it is associated with numerous social problems (Silberman et al. 2018), such as low wages, work conditions and psychological work consequences, which tend to be ignored by the AI community.”
BackgroundData and its (dis)contents: A survey of dataset development and use in machine learning research
Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100336 · Cited by 548
'The plan is just survival': Data Work in Kenya and the Regime of Entrapment
Kapania, S., Yang, T., Abdelkadir, N. A., Scheuerman, M. K., Miceli, M., Taylor, A. S., & Fox, S. E. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791097 · Cited by 2
Metadata
- Authors
- Silberman, M. S., Tomlinson, B., LaPlante, R., Ross, J., Irani, L., & Zaldivar, A.
- Affiliations
- Industrial Union of Metalworkers (DE)
- University of California, Irvine (US)
- Seattle, WA
- University of Washington (US)
- University of California San Diego (US)
- Venue
- Communications of the ACM
- Published
- 2018-02-21
- Volume
- 61
- Issue
- 3
- Pages
- 39-41
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2788969155
- Cited by
- 109
- References
- 0
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 11 · 2023: 12 · 2022: 22 · 2021: 23 · 2020: 15 · 2019: 9 · 2018: 4
- FWCI
- 16.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Communications of the ACM (publishedVersion)
- Funders
- National Science Foundation (CCF-1442749)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Keywords
- crowdsourcing, crowd workers, research ethics, responsible research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
