Human-AI Interaction in Human Resource Management: Understanding Why Employees Resist Algorithmic Evaluation at Workplaces and How to Mitigate Burdens
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Recently, Artificial Intelligence (AI) has been used to enable efficient decision-making in managerial and organizational contexts, ranging from employment to dismissal. However, to avoid employees’ antipathy toward AI, it is important to understand what aspects of AI employees like and/or dislike. In this paper, we aim to identify how employees perceive current human resource (HR) teams and future algorithmic management. Specifically, we explored what factors negatively influence employees’ perceptions of AI making work performance evaluations. Through in-depth interviews with 21 workers, we found that 1) employees feel six types of burdens (i.e., emotional, mental, bias, manipulation, privacy, and social) toward AI's introduction to human resource management (HRM), and that 2) these burdens could be mitigated by incorporating transparency, interpretability, and human intervention to algorithmic decision-making. Based on our findings, we present design efforts to alleviate employees’ burdens. To leverage AI for HRM in fair and trustworthy ways, we call for the HCI community to design human-AI collaboration systems with various HR stakeholders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241 · cited 1×
“Recently, Long and Magerko [52] proposed AI literacy and learner-centered AI in which the theme “education” is close to training and development in HRM [32].”
BackgroundBig other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 3,205 · cited 1×
“, hidden camera [21, 31, 60], ofce access/ID card [55, 72], or internet access/search [60, 92]) have already been an important topic when the technology was frst adopted in workplaces.”
BackgroundTowards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Algorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“” Hence, one stream of CHI research mainly focused on why it is uniquely difcult to design AI and how to solve emerging problems [4, 20, 38, 48, 53, 81, 89].”
BackgroundAdversarial machine learning at scale
Kurakin, A., Goodfellow, I., & Bengio, S. (2016) · arXiv · doi:10.48550/arxiv.1611.01236 · Cited by 2,325
Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
Shneiderman, B. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1741118 · Cited by 1,743 · cited 1×
“Also, as Shneiderman outlined [75], AI in HRM could be seen as a “consequential application,” which is an application of AI that could bring not only benefts but also signifcant harm to people (i.”
BackgroundArtificial Intelligence in Human Resources Management: Challenges and a Path Forward
Tambe, P., Cappelli, P., & Yakubovich, V. (2019) · California Management Review · doi:10.1177/0008125619867910 · Cited by 1,609
Lee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338 · cited 10×
“Moreover, AI is augmenting or even replacing some of the decision-making humans used to make, even in skilled areas (e.g., doctors and judges) [41].”
BackgroundMethodInfluentialDietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230 · cited 1×
“Even if people could make the same mistake as algorithms, people tend to trust algorithms less than humans, which Dietvorst et al. [18] called “algorithm aversion.”
BackgroundInkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
Feeling robots and human zombies: Mind perception and the uncanny valley
Gray, K., & Wegner, D. M. (2012) · Cognition · doi:10.1016/j.cognition.2012.06.007 · Cited by 941 · cited 1×
“Hence, numerous studies [25, 64, 73] have examined people’s perceptions of human-like machines and discovered that people found them spine-tingling, eerie, fearful, and creepy [91].”
BackgroundQuestioning the AI: Informing Design Practices for Explainable AI User Experiences
Liao, Q. V., Gruen, D., & Miller, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376590 · Cited by 925
Mitigating bias in algorithmic hiring: evaluating claims and practices
Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372828 · Cited by 845
Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Datta, A., Sen, S., & Zick, Y. (2016) · 2016 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2016.42 · Cited by 728 · cited 1×
“Finally, privacy is one of the most important but difcult issues to handle [17, 49] when AI is used for data-driven, automatic decision-making [70, 79].”
BackgroundLepri, B., Oliver, N., Letouzé, E., Pentland, A., & Vinck, P. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0279-x · Cited by 709 · cited 2×
“For example, while prior work [37, 43, 47, 74] showed transparency could increase users’ trust in AI, multiple studies warned that too much transparency could erode it [29, 37, 83].”
ResultRole of fairness, accountability, and transparency in algorithmic affordance
Shin, D., & Park, Y. J. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.04.019 · Cited by 643 · cited 2×
“For example, while prior work [37, 43, 47, 74] showed transparency could increase users’ trust in AI, multiple studies warned that too much transparency could erode it [29, 37, 83].”
ResultRe-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design
Yang, Q., Steinfeld, A., Rosé, C., & Zimmerman, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376301 · Cited by 622 · cited 2×
“Researchers in the HCI community [1, 5, 20, 48, 80, 81, 85, 89] have addressed the difculties of discovering unique requirements that can occur when AI is applied to complex settings.”
BackgroundHow Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
Kaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., & Wortman Vaughan, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376219 · Cited by 564 · cited 1×
“In the same vein, although there are studies regarding a “robust/good AI explanation” [3, 19, 33, 59, 61], few studies have addressed a “good explanation of AI in HRM.”
BackgroundVeale, M., Van Kleek, M., & Binns, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174014 · Cited by 490 · cited 3×
“Researchers in the HCI community [1, 5, 20, 48, 80, 81, 85, 89] have addressed the difculties of discovering unique requirements that can occur when AI is applied to complex settings.”
BackgroundMethodShould Machines Express Sympathy and Empathy? Experiments with a Health Advice Chatbot
Liu, B., & Sundar, S. S. (2018) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2018.0110 · Cited by 447
Madaio, M. A., Stark, L., Wortman Vaughan, J., & Wallach, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376445 · Cited by 436 · cited 2×
“[53] proposed AI fairness checklists that organizations could use for quick evaluation.”
BackgroundMarketing AI recruitment: The next phase in job application and selection
van Esch, P., Black, J. S., & Ferolie, J. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.09.009 · Cited by 391
UX Design Innovation: Challenges for Working with Machine Learning as a Design Material
Dove, G., Halskov, K., Forlizzi, J., & Zimmerman, J. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025739 · Cited by 391 · cited 4×
“Researchers in the HCI community [1, 5, 20, 48, 80, 81, 85, 89] have addressed the difculties of discovering unique requirements that can occur when AI is applied to complex settings.”
BackgroundMethodInfluentialMachine Heuristic: When We Trust Computers More than Humans with Our Personal Information
Sundar, S. S., & Kim, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300768 · Cited by 347
Algorithmic Bias: From Discrimination Discovery to Fairness-aware Data Mining
Hajian, S., Bonchi, F., & Castillo, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2945386 · Cited by 334
On the Robustness of Interpretability Methods
Alvarez-Melis, D., & Jaakkola, T. S. (2018) · arXiv · doi:10.48550/arxiv.1806.08049 · Cited by 310
Feeling our way to machine minds: people's emotions when perceiving mind in artificial intelligence
Shank, D. B., Graves, C., Gott, A., Gamez, P., & Rodriguez, S. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.04.001 · Cited by 293 · cited 1×
“Hence, numerous studies [25, 64, 73] have examined people’s perceptions of human-like machines and discovered that people found them spine-tingling, eerie, fearful, and creepy [91].”
BackgroundKocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277
A Qualitative Exploration of Perceptions of Algorithmic Fairness
Woodruff, A., Fox, S. E., Rousso-Schindler, S., & Warshaw, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174230 · Cited by 256
Yang, Q., Steinfeld, A., & Zimmerman, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300468 · Cited by 247 · cited 1×
“Also, we acknowledge that the scenario-based method with hypothetical situations could be less efective for understanding users in comparison with studies conducted based on people’s actual experience or observations [42, 90].”
ResultLee, M. K., & Baykal, S. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998230 · Cited by 182
Corbett, E., & Weber, A. (2016) · Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/2935334.2935386 · Cited by 148 · cited 1×
“Black box characteristics of algorithmic decision-making can make things worse by overwhelming and confusing users due to a lack of information [16, 84] without clear benefts [26].”
BackgroundEmpathy Is All You Need: How a Conversational Agent Should Respond to Verbal Abuse
Chin, H., Molefi, L. W., & Yi, M. Y. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376461 · Cited by 96
Worker-Centered Design: Expanding HCI Methods for Supporting Labor
Fox, S. E., Khovanskaya, V., Crivellaro, C., Salehi, N., Dombrowski, L., Kulkarni, C., Irani, L., & Forlizzi, J. (2020) · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3334480.3375157 · Cited by 79 · cited 1×
“Based on the worker-centered design, the HCI community has long focused on designing AI technologies as tools assisting workers’ tasks and human-AI collaboration [20, 23].”
Method
Cited by
Kinowska, H., & Sienkiewicz, Ł. J. (2023) · Information Technology & People · doi:10.1108/itp-02-2022-0079 · Cited by 147
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Chen, V., Liao, Q. V., Wortman Vaughan, J., & Bansal, G. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610219 · Cited by 220
Artificial intelligence and work: a critical review of recent research from the social sciences
Deranty, J.-P., & Corbin, T. (2024) · AI & SOCIETY · doi:10.1007/s00146-022-01496-x · Cited by 118
“Algorithms are widely used, by companies such as Airbnb (Cheng and Foley 2019), Uber (Möhlmann and Henfridsson 2019; Muller 2019; Amorim and Moda 2020), and Amazon (Park et al. 2021; Chesta 2021) in precisely these ways, to manage, direct, recruit, evaluate, and even terminate workers.”
Park, H., & Ahn, D. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642785 · Cited by 84
“AI is profoundly transforming our work environments [33, 34, 66, 67, 102], reshaping both the nature of work and the skills required.”
BackgroundSelf-citationTowards a Metaverse Workspace: Opportunities, Challenges, and Design Implications
Park, H., Ahn, D., & Lee, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581306 · Cited by 72
“This hypothetical method based on real use cases [40, 46, 66] is known to be effective in acquiring users’ perceptions towards a system that they have not experienced.”
MethodResultSelf-citation
Metadata
- Authors
- Park, H., Ahn, D., Hosanagar, K., & Lee, J.
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-15
- OpenAlex
- W3163792109
- Cited by
- 116
- References
- 39
- FWCI
- 39.66
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.