Perceived algorithmic fairness: An empirical study of transparency and anthropomorphism in algorithmic recruiting
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Despite constant efforts of organisations to ensure a fair and transparent personnel selection process, hiring is still characterised by systematic inequality. The potential of algorithms to produce fair and objective decision outcomes has attracted the attention of academic scholars and practitioners as a conceivable alternative to human decision‐making. However, applicants do not necessarily consider an objective algorithm as fairer than a human decision maker. This study examines the conditions under which applicants perceive algorithms as fair and establishes a theoretical foundation of algorithmic fairness perceptions. We further propose and investigate transparency and anthropomorphism interventions as strategies to actively shape these fairness perceptions. In an online application scenario with eight experimental groups (N = 801), we analyse determinants for algorithmic fairness perceptions and the impact of the proposed interventions. Embedded in a stimulus‐organism‐response framework and drawing from organisational justice theory, our study reveals four justice dimensions (procedural, distributive, interpersonal, informational justice) that determine algorithmic fairness perceptions. The results further show that transparency and anthropomorphism interventions mainly affect dimensions of interpersonal and informational justice, highlighting the importance of algorithmic fairness perceptions as critical determinants for individual choices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“An essential step to achieve this objective is the development and adjustment of algorithmic models in a way that they recommend fair decisions or allocate resources in an unbiased and equitable manner (Dressel & Farid, 2018; Obermeyer et al., 2019).”
BackgroundPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Justice at the millennium: A meta-analytic review of 25 years of organizational justice research.
Colquitt, J. A., Conlon, D. E., Wesson, M. J., Porter, C. O. L. H., & Ng, K. Y. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.425 · Cited by 5,942 · cited 20×
“Hence, to explain a high degree of variance, researchers should include multiple dimensions of justice within one study and investigate them in relation to each other (Colquitt et al., 2001).”
BackgroundMethodResultInfluentialBertrand, M., & Mullainathan, S. (2004) · American Economic Review · doi:10.1257/0002828042002561 · Cited by 4,504
On seeing human: A three-factor theory of anthropomorphism
Epley, N., Waytz, A., & Cacioppo, J. T. (2007) · Psychological Review · doi:10.1037/0033-295x.114.4.864 · Cited by 4,069 · cited 2×
“One particularly promising approach in this domain is the concept of anthropomorphism (Blut et al., 2021; Epley et al., 2007; Waytz et al., 2010), which refers to the attribution of human characteristics, motivations, intentions, or emotions to non-human agents (e.g., robots, chatbots, algorithms).”
BackgroundMachines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022 · cited 4×
“This evidence, along with the notion that individuals have the same requirements for algorithmic and human decision makers (Nass & Moon, 2000), led us to propose the following hypothesis: H4a.”
BackgroundInfluentialValidation of a New General Self-Efficacy Scale
Chen, G., Gully, S. M., & Eden, D. (2001) · Organizational Research Methods · doi:10.1177/109442810141004 · Cited by 3,542 · cited 1×
“The subsequent pages included the self-efficacy scale by Chen et al. (2001) as a filler task, a question regarding the approximate total number of studies the participants had completed so far, and an open-ended question asking them to elaborate on why the respective decision maker should consider…”
BackgroundAlgorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · cited 1×
“Algorithms are, in nature, abstract and, as a result, often impersonal and inaccessible for individuals (Dietvorst et al., 2015).”
BackgroundWhat Should Be Done with Equity Theory?
Leventhal, G. S. (1980) · Social Exchange · doi:10.1007/978-1-4613-3087-5_2 · Cited by 3,010 · cited 1×
“…multiple criteria: consistent application of procedures across people and time, adherence to unbiased, accurate, and correct-able judgements and ethical standards, and the reflection of basic concerns and values of all individuals affected by the decision outcome (Colquitt, 2001; Leventhal, 1980).”
BackgroundHuman trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 1×
“Consequently, increasing an algorithm's transparency has been shown to increase its acceptance, provided this information is comprehensible (Cadario et al., 2021; Castelo et al., 2019; Glikson & Woolley, 2020).”
BackgroundCan we open the black box of AI?
Castelvecchi, D. (2016) · Nature · doi:10.1038/538020a · Cited by 1,773 · cited 1×
“For many years, one of the key characteristics of highly sophisticated algorithms in decision-making was their opaqueness or ‘ black box ’ nature, referring to an incomprehensibility of how their decision was reached (Adadi & Berrada, 2018; Barredo Arrieta et al., 2020; Castelvecchi, 2016).”
BackgroundData quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Situational Variables and Consumer Behavior
Belk, R. W. (1975) · Journal of Consumer Research · doi:10.1086/208627 · Cited by 1,645
Task-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., & Lehmann, D. R. (2019) · Journal of Marketing Research · doi:10.1177/0022243719851788 · Cited by 1,500 · cited 1×
“Consequently, increasing an algorithm's transparency has been shown to increase its acceptance, provided this information is comprehensible (Cadario et al., 2021; Castelo et al., 2019; Glikson & Woolley, 2020).”
BackgroundLee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338
Who Sees Human?: The Stability and Importance of Individual Differences in Anthropomorphism
Waytz, A., Cacioppo, J., & Epley, N. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610369336 · Cited by 1,228
Blut, M., Wang, C., Wünderlich, N. V., & Brock, C. (2021) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-020-00762-y · Cited by 1,194
The Perceived Fairness of Selection Systems: An Organizational Justice Perspective
Gilliland, S. W. (1993) · The Academy of Management Review · doi:10.2307/258595 · Cited by 1,185 · cited 5×
“High fairness perceptions can encourage applicants to recommend the organisation to others, whereas low fairness perceptions generate unfavourable individual responses such as negative worth-of-mouth (Ababneh et al., 2014; Gilliland, 1993).”
BackgroundInfluentialStimulus‐Organism‐Response Reconsidered: An Evolutionary Step in Modeling (Consumer) Behavior
Jacoby, J. (2002) · Journal of Consumer Psychology · doi:10.1207/s15327663jcp1201_05 · Cited by 1,135
The accuracy, fairness, and limits of predicting recidivism
Dressel, J., & Farid, H. (2018) · Science Advances · doi:10.1126/sciadv.aao5580 · Cited by 1,071
Meta-analysis of field experiments shows no change in racial discrimination in hiring over time
Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1706255114 · Cited by 887 · cited 1×
“The inconvenient truth is that such systematic run through multiple societies and industries (Annabi & Lebovitz, 2018; Cheryan & Markus, 2020; Dworkin et al., 2020; Quillian et al., 2017).”
BackgroundApplicant Reactions to Selection Procedures: An Updated Model and Meta‐Analysis
Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004) · Personnel Psychology · doi:10.1111/j.1744-6570.2004.00003.x · Cited by 816 · cited 2×
“…is that applicants, who perceive that organisations implemented a fair recruiting process, are more likely to reciprocate by expressing positive responses, while those who perceive fairness rules to be violated are more likely to express negative responses (Hausknecht, 2004; Schinkel et al., 2016).”
BackgroundData Privacy: Effects on Customer and Firm Performance
Martin, K. D., Borah, A., & Palmatier, R. W. (2017) · Journal of Marketing · doi:10.1509/jm.15.0497 · Cited by 786 · cited 1×
“To measure whether our transparency manipulation led to participants perceiving the underlying reasoning of the algorithmic decision as more transparent, we used an adaptation of the data use transparency scale by Martin et al. (2017).”
MethodAlgorithmic bias: review, synthesis, and future research directions
Kordzadeh, N., & Ghasemaghaei, M. (2022) · European Journal of Information Systems · doi:10.1080/0960085x.2021.1927212 · Cited by 770 · cited 2×
“We suggest that the proposed interventions may influence the perceived algorithmic fairness of individuals (Kordzadeh & Ghasemaghaei, 2022), which lead to individuals' responses such as satisfaction or referral likelihood (Cropanzano et al., 2007).”
BackgroundQiu, L., & Benbasat, I. (2009) · Journal of Management Information Systems · doi:10.2753/mis0742-1222250405 · Cited by 737
Role of fairness, accountability, and transparency in algorithmic affordance
Shin, D., & Park, Y. J. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.04.019 · Cited by 643 · cited 1×
“To strengthen this relationship, individuals need to understand and comprehend the processes that lead to the outcome of an algorithm (Shin & Park, 2019).”
BackgroundHow Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
Almost human: Anthropomorphism increases trust resilience in cognitive agents.
de Visser, E. J., Monfort, S. S., McKendrick, R., Smith, M. A. B., McKnight, P. E., Krueger, F., & Parasuraman, R. (2016) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000092 · Cited by 614 · cited 1×
“This can increase people's acceptance of new technologies (Benlian et al., 2019; Maedche et al., 2019; Pfeuffer et al., 2019), trust in the non-human agent (de Visser et al., 2016), and even render the perception of interactions with the agent as more meaningful and important (Seeger et al., 2021).”
BackgroundA Framework and Guidelines for Context-Specific Theorizing in Information Systems Research
Hong, W., Chan, F. K. Y., Thong, J. Y. L., Chasalow, L. C., & Dhillon, G. (2014) · Information Systems Research · doi:10.1287/isre.2013.0501 · Cited by 609 · cited 1×
“Forth, by drawing on S-O-R, we follow the call of IS research to contextualise established theories, thereby enriching their explanatory and predicative power (Hong et al., 2014).”
MethodNewman, D. T., Fast, N. J., & Harmon, D. J. (2020) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2020.03.008 · Cited by 550 · cited 9×
“Surprisingly, a key study comparing fairness perceptions of human and algorithmic decision makers found that individuals have higher fairness perceptions for humans compared to algorithms (Newman et al., 2020; Yalcin et al., 2022).”
BackgroundResultInfluentialKöchling, A., & Wehner, M. C. (2020) · Business Research · doi:10.1007/s40685-020-00134-w · Cited by 511 · cited 2×
“For algorithmic decisions, fairness perceptions can be detached from an algorithm's actual performance (Köchling & Wehner, 2020), and even if an algorithm were to apply objectively fair criteria, applicants might have contrary perceptions.”
BackgroundMaking sense of recommendations
Yeomans, M., Shah, A., Mullainathan, S., & Kleinberg, J. (2019) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2118 · Cited by 459 · cited 1×
“Multiple scholars have identified the resulting inability of humans to understand the processes underlying an algorithm's output as one of the key obstacles hindering their acceptance (Ajunwa, 2020; Cadario et al., 2021; Yeomans et al., 2019; Zhu et al., 2018).”
BackgroundNewlands, G. (2021) · Organization Studies · doi:10.1177/0170840620937900 · Cited by 439
AI-Based Digital Assistants: Opportunities, Threats, and Research Perspectives
Maedche, A., Legner, C., Benlian, A., Berger, B., Gimpel, H., Hess, T., Hinz, O., Morana, S., & Söllner, M. (2019) · Business & Information Systems Engineering · doi:10.1007/s12599-019-00600-8 · Cited by 432 · cited 1×
“This can increase people's acceptance of new technologies (Benlian et al., 2019; Maedche et al., 2019; Pfeuffer et al., 2019), trust in the non-human agent (de Visser et al., 2016), and even render the perception of interactions with the agent as more meaningful and important (Seeger et al., 2021).”
BackgroundUnderstanding, explaining, and utilizing medical artificial intelligence
Cadario, R., Longoni, C., & Morewedge, C. K. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01146-0 · Cited by 342 · cited 5×
“Consequently, increasing an algorithm's transparency has been shown to increase its acceptance, provided this information is comprehensible (Cadario et al., 2021; Castelo et al., 2019; Glikson & Woolley, 2020).”
BackgroundMethodInfluentialFairness perceptions of algorithmic decision-making: A systematic review of the empirical literature
Starke, C., Baleis, J., Keller, B., & Marcinkowski, F. (2022) · Big Data & Society · doi:10.1177/20539517221115189 · Cited by 316 · cited 3×
“In the context of our theoretical model, additional information on an algorithm's underlying processes should influence procedural, distributive, and informational justice dimensions (Starke et al., 2021).”
BackgroundMethodInfluentialExplaining models: an empirical study of how explanations impact fairness judgment
Dodge, J., Liao, Q. V., Zhang, Y., Bellamy, R. K. E., & Dugan, C. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302310 · Cited by 286 · cited 1×
“This notion is further supported by prior research that obtained empirical evidence for the importance of transparency for algorithmic fairness perceptions (Binns et al., 2018; Dodge et al., 2019; Kizilcec, 2016).”
ResultDesigning fair AI for managing employees in organizations: a review, critique, and design agenda
Robert, L. P., Pierce, C., Marquis, L., Kim, S., & Alahmad, R. (2020) · Human–Computer Interaction · doi:10.1080/07370024.2020.1735391 · Cited by 268
McCarthy, J. M., Bauer, T. N., Truxillo, D. M., Anderson, N. R., Costa, A. C., & Ahmed, S. M. (2017) · Journal of Management · doi:10.1177/0149206316681846 · Cited by 258 · cited 3×
“Central to organisational justice theory is the investigation of individual responses as a consequence of fairness perceptions (McCarthy et al., 2017).”
BackgroundInfluentialExplainable AI for Designers: A Human-Centered Perspective on Mixed-Initiative Co-Creation
Zhu, J., Liapis, A., Risi, S., Bidarra, R., & Youngblood, G. M. (2018) · 2018 IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2018.8490433 · Cited by 255
Texting with Humanlike Conversational Agents: Designing for Anthropomorphism
Seeger, A.-M., University of Mannheim, G., Pfeiffer, J., Justus Liebig University Giessen, G., Heinzl, A., & University of Mannheim, G. (2021) · Journal of the Association for Information Systems · doi:10.17705/1jais.00685 · Cited by 200
Trust violation and repair: The information privacy perspective
Bansal, G., & Zahedi, F. M. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.01.009 · Cited by 141
Ajunwa, I. (2020) · Big Data & Society · doi:10.1177/2053951720938093 · Cited by 72 · cited 1×
“Multiple scholars have identified the resulting inability of humans to understand the processes underlying an algorithm's output as one of the key obstacles hindering their acceptance (Ajunwa, 2020; Cadario et al., 2021; Yeomans et al., 2019; Zhu et al., 2018).”
BackgroundOK computer: Worker perceptions of algorithmic recruitment
Fumagalli, E., Rezaei, S., & Salomons, A. (2022) · Research Policy · doi:10.1016/j.respol.2021.104420 · Cited by 46 · cited 1×
“In contrast, other studies have concluded that an algorithm's ability to generate optimised and fair decisions can lead to higher fairness perceptions for algorithmic compared to human decision makers (Bai et al., 2021; Fumagalli et al., 2022; Lee, 2018).”
Result
Cited by
Al-Busaidi, A. S., Raman, R., Hughes, L., Albashrawi, M. A., Malik, T., Dwivedi, Y. K., Al- Alawi, T., AlRizeiqi, M., Davies, G., Fenwick, M., et al. (2024) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2024.100630 · Cited by 95
van den Broek, E., Sergeeva, A., & Huysman, M. (2026) · Journal of Management Studies · doi:10.1111/joms.13276 · Cited by 17
When Recruiters Meet Algorithms: Advice Taking and Bias in AI‐Assisted Recruitment
Lacroux, A., & Martin Lacroux, C. (2026) · International Journal of Selection and Assessment · doi:10.1111/ijsa.70085
Metadata
- Authors
- Ochmann, J., Michels, L., Tiefenbeck, V., Maier, C., & Laumer, S.
- Venue
- Information Systems Journal
- Publisher
- Wiley
- Published
- 2024-01-15
- Volume
- 34
- Issue
- 2
- Pages
- 384-414
- ISSN
- 1350-1917 (ISSN-L)
- 1365-2575
- OpenAlex
- W4390916974
- Cited by
- 95
- References
- 46
- FWCI
- 38.39
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.