The Perpetual Work Life of Crowdworkers: How Tooling Practices Increase Fragmentation in Crowdwork
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Crowdworkers regularly support their work with scripts, extensions, and software to enhance their productivity. Despite their evident significance, little is understood regarding how these tools affect crowdworkers' quality of life and work. In this study, we report findings from an interview study (N=21) aimed at exploring the tooling practices used by full-time crowdworkers on Amazon Mechanical Turk. Our interview data suggests that the tooling utilized by crowdworkers (1) strongly contributes to the fragmentation of microwork by enabling task switching and multitasking behavior; (2) promotes the fragmentation of crowdworkers' work-life boundaries by relying on tooling that encourages a 'work-anywhere' attitude; and (3) aids the fragmentation of social ties within worker communities through limited tooling access. Our findings have implications for building systems that unify crowdworkers' work practice in support of their productivity and well-being.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Whiteside, S. P., & Lynam, D. R. (2001) · Personality and Individual Differences · doi:10.1016/s0191-8869(00)00064-7 · Cited by 4,123 · cited 1×
“Inspired by prior research on individual differences in crowdwork [55] and information work [74], we also administered the 8-item Neuroticism sub-scale of the Big-5 personality scale [77] and the 23-item Perseverance and Urgency sub-scales of the UPPS impulsive behavior scale [101].”
MethodConducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172 · cited 1×
“Online platforms play a significant role in supporting workers both organizationally and independently [76].”
BackgroundGood Gig, Bad Gig: Autonomy and Algorithmic Control in the Global Gig Economy
Wood, A. J., Graham, M., Lehdonvirta, V., & Hjorth, I. (2019) · Work, Employment and Society · doi:10.1177/0950017018785616 · Cited by 2,209
Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M., & Horton, J. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441923 · Cited by 1,034
A diary study of task switching and interruptions
Czerwinski, M., Horvitz, E., & Wilhite, S. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985715 · Cited by 830
Turkopticon: interrupting worker invisibility in amazon mechanical turk
Irani, L. C., & Silberman, M. S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470742 · Cited by 798 · cited 5×
“, TurkOpticon [46]) that maintain community-driven ratings of requesters.”
BackgroundMethodInfluentialMemory for goals: an activation‐based model
Altmann, E. M., & Trafton, J. G. (2002) · Cognitive Science · doi:10.1207/s15516709cog2601_2 · Cited by 795 · cited 1×
“Empirical findings regarding the challenges of resuming interrupted work are well supported by research in cognitive science that suggests task switching produces “attentional residue”, a type of memory footprint from prior tasks that yields sustained impairments on cognition [5, 66].”
Background"Constant, constant, multi-tasking craziness": managing multiple working spheres
González, V. M., & Mark, G. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985707 · Cited by 715
Self-citationThe state of the art in end-user software engineering
Ko, A. J., Abraham, R., Beckwith, L., Blackwell, A., Burnett, M., Erwig, M., Scaffidi, C., Lawrance, J., Lieberman, H., Myers, B., et al. (2011) · ACM Computing Surveys · doi:10.1145/1922649.1922658 · Cited by 633
Bailey, B. P., & Konstan, J. A. (2006) · Computers in Human Behavior · doi:10.1016/j.chb.2005.12.009 · Cited by 600 · cited 1×
“Our findings speak directly to the importance of the systems’ ability to surface the right type of work and the right amount of work at the right time – all of which have been studied in prior information work settings [8, 45, 53, 103].”
BackgroundWork–nonwork boundary management profiles: A person-centered approach
Kossek, E. E., Ruderman, M. N., Braddy, P. W., & Hannum, K. M. (2012) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2012.04.003 · Cited by 594 · cited 11×
“In administering the WLI instrument to crowdworkers, prior research has shown they primarily have strategies that prioritize their nonwork (i.e. family) instead of work [62].”
BackgroundMethodInfluentialFlexibility in the gig economy: managing time on three online piecework platforms
Lehdonvirta, V. (2018) · New Technology, Work and Employment · doi:10.1111/ntwe.12102 · Cited by 550 · cited 1×
“Agency, flexibility, and learning opportunities are valued aspects of crowdwork that extend to the broader gig economy [28, 65, 72, 106].”
BackgroundNo task left behind?: examining the nature of fragmented work
Mark, G., Gonzalez, V. M., & Harris, J. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055017 · Cited by 503
Self-citationA Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk
Hara, K., Adams, A., Milland, K., Savage, S., Callison-Burch, C., & Bigham, J. P. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174023 · Cited by 497
Self-citationDisruption and recovery of computing tasks: field study, analysis, and directions
Iqbal, S. T., & Horvitz, E. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240730 · Cited by 300
TaskTracer: a desktop environment to support multi-tasking knowledge workers
Dragunov, A. N., Dietterich, T. G., Johnsrude, K., McLaughlin, M., Li, L., & Herlocker, J. L. (2005) · Proceedings of the 10th international conference on Intelligent user interfaces · doi:10.1145/1040830.1040855 · Cited by 240
Software developers' perceptions of productivity
Meyer, A. N., Fritz, T., Murphy, G. C., & Zimmermann, T. (2014) · Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering · doi:10.1145/2635868.2635892 · Cited by 224 · cited 1×
“Our approach is heavily inspired by prior studies of information work [79, 103] that share the goal of identifying opportunities for improving peoples’ efficiency in their work [51].”
MethodWork experiences on MTurk: Job satisfaction, turnover, and information sharing
Brawley, A. M., & Pury, C. L. S. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.08.031 · Cited by 188 · cited 1×
“However, studies of work experiences in crowdwork have found that crowdworkers suffer from low job satisfaction [12].”
BackgroundLeadership and fulfillment of the three basic psychological needs at work
Hetland, H., Hetland, J., Schou Andreassen, C., Pallesen, S., & Notelaers, G. (2011) · Career Development International · doi:10.1108/13620431111168903 · Cited by 175
Interrupts: just a minute never is
van Solingen, R., Berghout, E., & van Latum, F. (1998) · IEEE Software · doi:10.1109/52.714843 · Cited by 104
How blocking distractions affects workplace focus and productivity
Mark, G., Iqbal, S., & Czerwinski, M. (2017) · Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers · doi:10.1145/3123024.3124558 · Cited by 68
Self-citationMonotasking or Multitasking: Designing for Crowdworkers' Preferences
Lascau, L., Gould, S. J. J., Cox, A. L., Karmannaya, E., & Brumby, D. P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300649 · Cited by 47
Cited by
“Why lose control?” A Study of Freelancers’ Experiences with Gig Economy Platforms
Carlos Alvarez de la Vega, J., E. Cecchinato, M., & Rooksby, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445305 · Cited by 55
“Notable examples include the investigation of microworkers’ working preferences [45], how they incorporate their work into their lives [40], and the types of tools they use [71].”
Who Broke Amazon Mechanical Turk?: An Analysis of Crowdsourcing Data Quality over Time
Marshall, C. C., Goguladinne, P. S. R., Maheshwari, M., Sathe, A., & Shipman, F. M. (2023) · Proceedings of the 15th ACM Web Science Conference 2023 · doi:10.1145/3578503.3583622 · Cited by 20
"Doing The Work": Therapeutic Labor, Teletherapy, and the Platformization of Mental Health Care
Garofalo, L. (2024) · doi:10.2139/ssrn.4779005 · Cited by 11
Metadata
- Authors
- Williams, A. C., Mark, G., Milland, K., Lank, E., & Law, E.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2019-11-07
- Volume
- 3
- Issue
- CSCW
- Pages
- 1-28
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2988983801
- Cited by
- 62
- References
- 22
- FWCI
- 14.64
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.