The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Failures of Fairness in Automation Require a Deeper Understanding of Human–ML Augmentation
Abstract
Machine learning (ML) tools reduce the costs of performing repetitive, time-consuming tasks yet run the risk of introducing systematic unfairness into organizational processes. Automated approaches to achieving fairness often fail in complex situations, leading some researchers to suggest that human augmentation of ML tools is necessary. However, our current understanding of human–ML augmentation remains limited. In this paper, we argue that the Information Systems (IS) discipline needs a more sophisticated view of and research into human–ML augmentation. We introduce a typology of augmentation for fairness consisting of four quadrants: reactive oversight, proactive oversight, informed reliance, and supervised reliance. We identify significant intersections with previous IS research and distinct managerial approaches to fairness for each quadrant. Several potential research questions emerge from fundamental differences between ML tools trained on data and traditional IS built with code. IS researchers may discover that the differences of ML tools undermine some of the fundamental assumptions upon which classic IS theories and concepts rest. ML may require massive rethinking of significant portions of the corpus of IS research in light of these differences, representing an exciting frontier for research into human–ML augmentation in the years ahead that IS researchers should embrace. 1
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Task-Technology Fit and Individual Performance
Goodhue, D. L., & Thompson, R. L. (1995) · MIS Quarterly · doi:10.2307/249689 · Cited by 6,006
Orlikowski, W. J. (2000) · Organization Science · doi:10.1287/orsc.11.4.404.14600 · Cited by 4,760
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
10 Sociomateriality: Challenging the Separation of Technology, Work and Organization
Orlikowski, W. J., & Scott, S. V. (2008) · Academy of Management Annals · doi:10.5465/19416520802211644 · Cited by 2,571
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
Leonardi, P. M. (2011) · MIS Quarterly · doi:10.2307/23043493 · Cited by 1,889
MIS problems and failures: A socio- technical perspective
Bostrom, R. P., & Heinen, J. S. (1977) · MIS Quarterly · doi:10.2307/248710 · Cited by 1,329
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
Ethical Implications and Accountability of Algorithms
Martin, K. (2019) · Journal of Business Ethics · doi:10.1007/s10551-018-3921-3 · Cited by 757
Cited by
Dell’Acqua, F., McFowland, E., Mollick, E., Lifshitz, H., Kellogg, K. C., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2026) · Organization Science · doi:10.1287/orsc.2025.21838 · Cited by 1,189
Managing artificial intelligence
Berente, N., Gu, B., Recker, J., & Santhanam, R. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16274 · Cited by 898
Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573321 · Cited by 794
Lebovitz, S., Lifshitz-Assaf, H., & Levina, N. (2022) · Organization Science · doi:10.1287/orsc.2021.1549 · Cited by 632
Can HR adapt to the paradoxes of artificial intelligence?
Charlwood, A., & Guenole, N. (2022) · Human Resource Management Journal · doi:10.1111/1748-8583.12433 · Cited by 271
Expl(AI)ned: The Impact of Explainable Artificial Intelligence on Users’ Information Processing
Bauer, K., von Zahn, M., & Hinz, O. (2023) · Information Systems Research · doi:10.1287/isre.2023.1199 · Cited by 261
Toward AI Governance: Identifying Best Practices and Potential Barriers and Outcomes
Papagiannidis, E., Enholm, I. M., Dremel, C., Mikalef, P., & Krogstie, J. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10251-y · Cited by 191
Risk and the future of AI: Algorithmic bias, data colonialism, and marginalization
Arora, A., Barrett, M., Lee, E., Oborn, E., & Prince, K. (2023) · Information and Organization · doi:10.1016/j.infoandorg.2023.100478 · Cited by 173
“…privacy preservation, dataset augmentation and debiasing datasets (Arora and Arora, 2022) In searching for solutions to the problem of algorithmic bias, the focus has been on examining the fairness of decisions made by algorithms, including proactive and reactive oversight (Teodorescu et al .”
AI Knowledge: Improving AI Delegation through Human Enablement
Pinski, M., Adam, M., & Benlian, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580794 · Cited by 62
“Real-world image-classifcation tasks frequently occur in complex social contexts, necessitating human consideration of asp cts e beyond performance, such as ethical standards, legal requirements, the risks involved, or human preferences [61, 69, 89].”
BackgroundHuman–artificial intelligence collaboration in prediction: a field experiment in the retail industry
Revilla, E., Saenz, M. J., Seifert, M., & Ma, Y. (2023) · Journal of Management Information Systems · doi:10.1080/07421222.2023.2267317 · Cited by 63
“However, despite various calls for further research addressing the specific role of task context in human-AI collaboration, it continues to remain an under-researched topic [9, 26, 61, 69, 74].”
BackgroundMethodKumar, A., Bhattacharyya, S. S., & Krishnamoorthy, B. (2023) · Journal of Enterprise Information Management · doi:10.1108/jeim-09-2022-0307 · Cited by 34
van den Broek, E., Sergeeva, A., & Huysman, M. (2026) · Journal of Management Studies · doi:10.1111/joms.13276 · Cited by 17
High-risk artificial intelligence
Sunyaev, A., Benlian, A., Pfeiffer, J., Jussupow, E., Thiebes, S., Maedche, A., & Gawlitza, J. (2025) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00942-6 · Cited by 16
Metadata
- Authors
- Teodorescu, M. H. M., Morse, L., Awwad, Y., & Kane, G. C.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2021-09-01
- Volume
- 45
- Issue
- 3
- Pages
- 1483-1500
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W3198484931
- Cited by
- 194
- References
- 17
- FWCI
- 35.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.