Algorithms as co‐workers: Human algorithm role interactions in algorithmic work
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
In algorithmic work, algorithms execute operational and management tasks such as work allocation, task tracking and performance evaluation. Humans and algorithms interact with one another to accomplish work so that the algorithm takes on the role of a co‐worker. Human–algorithm interactions are characterised by problematic issues such as absence of mutually co‐constructed dialogue, lack of transparency regarding how algorithmic outputs are generated, and difficulty of over‐riding algorithmic directive – conditions that create lack of clarity for the human worker. This article examines human–algorithm role interactions in algorithmic work. Drawing on the theoretical framing of organisational roles, we theorise on the algorithm as role sender and the human as the role taker. We explain how the algorithm is a multi‐role sender with entangled roles, while the human as role taker experiences algorithm‐driven role conflict and role ambiguity. Further, while the algorithm records all of the human's task actions, it is ignorant of the human's cognitive reactions – it undergoes what we conceptualise as ‘broken loop learning’. The empirical context of our study is algorithm‐driven taxi driving (in the United States) exemplified by companies such as Uber. We draw from data that include interviews with 15 Uber drivers, a netnographic study of 1700 discussion threads among Uber drivers from two popular online forums, and analysis of Uber's web pages. Implications for IS scholarship, practice and policy are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070 · cited 1×
“Algorithmic work is distinct from augmentation, in which humans use the outputs of algorithms as aids to make decisions, typically in business analytics applications such as legal decisions (Corbett-Davies et al., 2017), mortgage approval (Markus, 2017) and medical diagnosis (Wynants et al., 2020).”
BackgroundAll in a Day's Work: Boundaries and Micro Role Transitions
Ashforth, B. E., Kreiner, G. E., & Fugate, M. (2000) · The Academy of Management Review · doi:10.2307/259305 · Cited by 3,039 · cited 1×
“Consequences of sustained algorithm-driven role conflict and role ambiguity such as depletion of cognitive resources (e.g., Ashforth et al., 2000) should also be considered.”
BackgroundHuman trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 4×
“…in the algorithm such as believing that outputs are not reliable, particularly if the former does not perceive a personal benefit from the algorithm's outputs (Glikson & Woolley, 2020) or feels like they are constantly being tracked and evaluated (Möhlmann et al., 2021; Mohlmann & Zalmanson, 2017).”
BackgroundMethodInfluentialAlgorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732
Rahwan, I., Cebrian, M., Obradovich, N., Bongard, J., Bonnefon, J.-F., Breazeal, C., Crandall, J. W., Christakis, N. A., Couzin, I. D., Jackson, M. O., et al. (2019) · Nature · doi:10.1038/s41586-019-1138-y · Cited by 1,364 · cited 1×
“By suggesting such new design aspects, our study addresses calls for understanding how algorithms should change in response to ongoing human-algorithm interactions (Rahwan et al., 2019).”
BackgroundAlgorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Duggan, J., Sherman, U., Carbery, R., & McDonnell, A. (2020) · Human Resource Management Journal · doi:10.1111/1748-8583.12258 · Cited by 1,050 · cited 2×
“For instance, Deliveroo calculates delivery rates for drivers based on delivery performance such as time taken (Duggan et al., 2020; Woodcock, 2020).”
BackgroundWorking and organizing in the age of the learning algorithm
Faraj, S., Pachidi, S., & Sayegh, K. (2018) · Information and Organization · doi:10.1016/j.infoandorg.2018.02.005 · Cited by 929 · cited 7×
“AI-based algorithms currently work on correlational rather than causal models, a problem for which preliminary technical solutions such as causal inference models are being investigated (Prosperi et al., 2020).”
BackgroundMethodInfluentialWorking with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823
Algorithmic bias: review, synthesis, and future research directions
Kordzadeh, N., & Ghasemaghaei, M. (2022) · European Journal of Information Systems · doi:10.1080/0960085x.2021.1927212 · Cited by 770 · cited 1×
“Work design scholars could also examine how to alleviate the possible lack of fairness (Kordzadeh & Ghasemaghaei, 2021) that can arise from algorithm-driven role conflict and role ambiguity.”
BackgroundAccountability in algorithmic decision making
Diakopoulos, N. (2016) · Communications of the ACM · doi:10.1145/2844110 · Cited by 763
Uberland: How Algorithms Are Rewriting the Rules of Work
Rosenblat, A. (2018) · doi:10.1525/9780520970632 · Cited by 694
Role of fairness, accountability, and transparency in algorithmic affordance
Shin, D., & Park, Y. J. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.04.019 · Cited by 643 · cited 1×
“Moreover, it is not always clear who is responsible for the consequences of not following the algorithm's instructions (Diakopoulos, 2016; Shin & Park, 2019; Zarsky, 2016).”
BackgroundROLE CONFLICT, AMBIGUITY, AND OVERLOAD: A 21-NATION STUDY.
PETERSON, M. F., SMITH, P. B., AKANDE, A., AYESTARAN, S., BOCHNER, S., CALLAN, V., JESUINO, J. C., D'AMORIM, M., FRANCOIS, P.-H., HOFMANN, K., et al. (1995) · Academy of Management Journal · doi:10.5465/256687 · Cited by 570
Algorithmic Management of Work on Online Labor Platforms: When Matching Meets Control
Möhlmann, M., Zalmanson, L., Henfridsson, O., & Gregory, R. W. (2021) · MIS Quarterly · doi:10.25300/misq/2021/15333 · Cited by 554 · cited 4×
“Recent literature depicts algorithms as bosses (Möhlmann et al., 2021) or as prescriptive agents that can take on supervisory roles (Baird & Maruping, 2021).”
BackgroundMethodInfluentialAlgorithms as work designers: How algorithmic management influences the design of jobs
Parent-Rocheleau, X., & Parker, S. K. (2022) · Human Resource Management Review · doi:10.1016/j.hrmr.2021.100838 · Cited by 512
Baird, A., & Maruping, L. M. (2021) · MIS Quarterly · doi:10.25300/misq/2021/15882 · Cited by 512 · cited 4×
“Algorithms ask humans to execute specific tasks based on the computational outputs, through the interface (Baird & Maruping, 2021; Luca et al., 2016).”
BackgroundMethodInfluentialNewell, S., & Marabelli, M. (2015) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2015.02.001 · Cited by 494
Self-citationCausal inference and counterfactual prediction in machine learning for actionable healthcare
Prosperi, M., Guo, Y., Sperrin, M., Koopman, J. S., Min, J. S., He, X., Rich, S., Wang, M., Buchan, I. E., & Bian, J. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0197-y · Cited by 459 · cited 1×
“AI-based algorithms currently work on correlational rather than causal models, a problem for which preliminary technical solutions such as causal inference models are being investigated (Prosperi et al., 2020).”
BackgroundZarsky, T. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915605575 · Cited by 422 · cited 4×
“They may perceive the algorithm to be unfair, inaccurate (Parent-Rocheleau & Parker, 2021) or stifling (Gal et al., 2017; Zarsky, 2016) and yet may be reluctant to over-rule it (Markus, 2017).”
BackgroundInfluentialAlgorithms in practice: Comparing web journalism and criminal justice
Christin, A. (2017) · Big Data & Society · doi:10.1177/2053951717718855 · Cited by 379 · cited 1×
“In addition, humans may try to game the algorithm in attempts to maximise rewards (Christin, 2017) and performance scores (Rahman, 2021).”
BackgroundThe Invisible Cage: Workers’ Reactivity to Opaque Algorithmic Evaluations
Rahman, H. A. (2021) · Administrative Science Quarterly · doi:10.1177/00018392211010118 · Cited by 375 · cited 3×
“…and rewards (Schildt, 2017) with no human involvement or co-constructed dialogue (Gal et al., 2017; Momin & Mishra, 2015) Interaction of the algorithm with the human (Kellogg et al., 2020) communication from the algorithm unclear to the human (Parent-Rocheleau & Parker, 2021; Rahman, 2021).”
BackgroundMethodBreaking the vicious cycle of algorithmic management: A virtue ethics approach to people analytics
Gal, U., Jensen, T. B., & Stein, M.-K. (2020) · Information and Organization · doi:10.1016/j.infoandorg.2020.100301 · Cited by 342
Role conflict and role ambiguity: A critical assessment of construct validity.
King, L. A., & King, D. W. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.1.48 · Cited by 302
Barrett, M., Oborn, E., & Orlikowski, W. (2016) · Information Systems Research · doi:10.1287/isre.2016.0648 · Cited by 269 · cited 1×
“Digital trace data generated on online platforms is increasingly used for the purpose of analysing human perceptions vis-à-vis socio-technical phenomena in IS research (e.g., Barrett et al., 2016; Bauer et al., 2016; Tarafdar & Ray, 2021; Vaast & Levina, 2015).”
MethodSchafheitle, S. D., Weibel, A., Ebert, I. L., Kasper, G., Schank, C., & Leicht-Deobald, U. (2020) · Academy of Management Discoveries · doi:10.5465/amd.2019.0002 · Cited by 61
Research works printed but not linked: 63
- Aho A. V., 1983, Data structures and algorithms
- 10.5465/amr.2016.0002 · DOI
- 10.1287/isre.2016.0649 · DOI
- 10.5465/annals.2014.0076 · DOI · Paper page
- Brynjolfsson E., 2014, The second machine age: Work, progress, and prosperity in a time of brilliant technologies
- 10.1177/1094428116641191 · DOI · Paper page
- 10.1287/orsc.2013.0820 · DOI · Paper page
- 10.4135/9781452231235 · DOI · Paper page
- 10.1111/isj.12308 · DOI
- 10.1111/isj.12284 · DOI
- 10.1111/isj.12370 · DOI · Paper page
- 10.1177/0018726717692852 · DOI · Paper page
- 10.1007/s12599-020-00650-3 · DOI · Paper page
- 10.1037/0021-9010.68.2.320 · DOI · Paper page
- 10.5465/amr.2000.2791608 · doi:10.5465/amr.2000.2791608 · Paper page
- Gal U. Jensen T. B. &Stein M.‐K.(2017).People analytics in the age of big data: An agenda for is research. In Proceedings of ICIS 2017 Seoul South Korea.
- Graen G., 1976, Handbook of industrial and organizational psychology, 1201
- Gray M. L., 2019, Ghost work: How to stop silicon valley from building a new global underclass
- Gross N., 1966, Explorations in role analysis: Studies of the school superintendency role
- 10.1177/1350508414522315 · DOI · Paper page
- 10.1038/550324a · DOI
- Horrocks J. E., 1973, Self and role: A theory of self‐process and role behavior
- Hosanagar K., 2018, We need transparency in algorithms but too much can backfire, Harvard Business Review, Digital Articles
- Ilgen D., 1991, Handbook of industrial and organizational psychology, 165
- 10.1016/0749-5978(85)90020-2 · DOI · Paper page
- 10.1287/isre.2018.0784 · DOI
- Kahn R. L., 1964, Organizational stress: Studies in role conflict and ambiguity
- Katz D., 1978, The social psychology of organizations
- Knuth D., 1997, The art of computer programming
- 10.1509/jmkr.39.1.61.18935 · DOI · Paper page
- Luca M., 2016, Algorithms need managers, too, Harvard Business Review, 94, 96
- 10.1177/0268396220915917 · DOI · Paper page
- 10.1016/j.jsis.2021.101683 · DOI
- 10.1016/j.jsis.2017.08.003 · DOI
- Markus M. L., 2018, Is IT changing the world? Conceptions of causality for information systems theorizing, MIS Quarterly, 42, 1255, 10.25300/MISQ/2018/12903 · DOI
- 10.5465/amj.2007.28225967 · DOI · Paper page
- Martin D. Hanrahan B. V. O'Neill J. &Gupta N.(2014).Being a Turker. In Computer Supported Cooperative Work Conference Baltimore MD. · DOI · Paper page
- McAfee A., 2012, Big data: The management revolution, Harvard Business Review, 90, 61
- McGrath J. E., 1976, Handbook of industrial and organizational psychology, 1351
- Mohlmann M. &Zalmanson L.(2017).Hands on the wheel: Navigating algorithmic management and Uber drivers' autonomy. In International Conference of Information Systems Seoul South Korea.
- Momin W. Y. M., 2015, HR analytics as a strategic workforce planning, International Journal of Applied Research, 1, 258
- 10.2307/256141 · DOI
- Page X. Marabelli M. &Tarafdar M.(2017).Perceived role relationships in human‐algorithm interactions: The context of Uber drivers. In International Conference of Information Systems Seoul South Korea.
- 10.1177/0018726713489998 · DOI
- 10.1287/orsc.14.4.422.17487 · DOI · Paper page
- 10.2307/256687 · doi:10.2307/256687 · Paper page
- 10.5465/amr.2016.0309 · DOI · Paper page
- 10.1080/10630732.2021.2001714 · DOI
- 10.2307/2391486 · DOI · Paper page
- 10.2307/2391718 · DOI · Paper page
- Rosenblat A., 2016, Algorithmic labor and information asymmetries: A case study of Uber's drivers, International Journal of Communication, 10, 3758
- 10.1080/14479338.2016.1252043 · DOI · Paper page
- Sprague R., 2015, Welcome to the machine: Privacy and workplace implications of predictive analytics, Richmond Journal of Law and Technology, 21, 1
- Tarafdar M., 2019, Using AI to enhance business operations, MIT Sloan Management Review, 60, 37
- 10.1287/isre.2021.1013 · DOI
- Taylor M., 2017, Good work: The Taylor review of modern work practices
- 10.1080/03069880600769555 · doi:10.1080/03069880600769555
- 10.1177/014920630002600104 · DOI · Paper page
- 10.1016/j.infoandorg.2015.02.001 · DOI
- 10.1177/001872678103400104 · DOI · Paper page
- 10.2307/258554 · DOI · Paper page
- Woodcock J., 2020, The algorithmic panopticon at Deliveroo: Measurement, precarity, and the illusion of control, Ephemera, 20, 67
- 10.1136/bmj.m1328 · doi:10.1136/bmj.m1328 · Paper page
Cited by
AI literacy and its implications for prompt engineering strategies
Knoth, N., Tolzin, A., Janson, A., & Leimeister, J. M. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100225 · Cited by 368
“…not only for academic productivity and future employment opportunities but also for confident, critical, and safe engagement with emerging tools and technologies, building resilience against their vulnerabilities and risks (Long & Magerko, 2020; Tarafdar et al., 2023; Wienrich & Carolus, 2021).”
BackgroundDigital governance: A conceptual framework and research agenda
Hanisch, M., Goldsby, C. M., Fabian, N. E., & Oehmichen, J. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113777 · Cited by 267
AI Literacy - Towards Measuring Human Competency in Artificial Intelligence
Pinski, M., & Benlian, A. (2023) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2023.021 · Cited by 94
Conceptualizing generative AI as style engines: Application archetypes and implications
Riemer, K., & Peter, S. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102824 · Cited by 63
AI Knowledge: Improving AI Delegation through Human Enablement
Pinski, M., Adam, M., & Benlian, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580794 · Cited by 62
Metadata
- Authors
- Tarafdar, M., Page, X., & Marabelli, M.
- Venue
- Information Systems Journal
- Publisher
- Wiley
- Published
- 2022-05-07
- Volume
- 33
- Issue
- 2
- Pages
- 232-267
- ISSN
- 1350-1917 (ISSN-L)
- 1365-2575
- OpenAlex
- W4229017463
- Cited by
- 132
- References
- 27
- FWCI
- 29.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.