Justice perceptions of artificial intelligence in selection
The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) is increasingly being utilized by organizations in selection decisions. However, research has fallen behind the practice, and one area in need of investigation is how applicants' perceptions of justice are formed in this increased involvement of AI in the hiring process. Accordingly, two studies were conducted to investigate the effects of using AI in selection on justice perceptions. Findings indicated that AI‐based interviewing was generally viewed as less procedurally and interactionally just than traditional human‐based interviewing. Additionally, the effect of interview type on different applicant reaction outcomes was mediated by justice dimensions, particularly two‐way communication. Findings may help organizations regarding how best to utilize AI in selection in order to attract and retain top talent.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532 · cited 1×
“In performing these mediation analyses, we followed the approach outlined by Preacher and Hayes (2008) and tested for the direct and indirect effects directly, instead of following the Baron and Kenny (1986) multi-step approach and testing for complete and partial mediation.”
Preacher, K. J., & Hayes, A. F. (2008) · Behavior Research Methods · doi:10.3758/brm.40.3.879 · Cited by 34,117 · cited 1×
“In performing these mediation analyses, we followed the approach outlined by Preacher and Hayes (2008) and tested for the direct and indirect effects directly, instead of following the Baron and Kenny (1986) multi-step approach and testing for complete and partial mediation.”
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
Organizational Justice: Yesterday, Today, and Tomorrow
Greenberg, J. (1990) · Journal of Management · doi:10.1177/014920639001600208 · Cited by 3,651 · cited 1×
“Other work has further differentiated procedural justice from interactional justice (e.g., Bies, 2005; Greenberg, 1990, 1993), which has two dimensions: the extent to which people are treated with politeness and respect (i.e., interpersonal justice) and the degree to which people are provided with…”
Handbook of Organizational Justice
(2013) · Psychology Press eBooks · doi:10.4324/9780203774847 · Cited by 1,615
Artificial Intelligence in Human Resources Management: Challenges and a Path Forward
Tambe, P., Cappelli, P., & Yakubovich, V. (2019) · California Management Review · doi:10.1177/0008125619867910 · Cited by 1,609
Moral Virtues, Fairness Heuristics, Social Entities, and Other Denizens of Organizational Justice
Cropanzano, R., Byrne, Z. S., Bobocel, D. R., & Rupp, D. E. (2001) · Journal of Vocational Behavior · doi:10.1006/jvbe.2001.1791 · Cited by 1,439
Brockner, J., & Wiesenfeld, B. M. (1996) · Psychological Bulletin · doi:10.1037//0033-2909.120.2.189 · Cited by 1,372
Lee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338 · cited 3×
“Evidence suggests that applicants generally have less favorable reactions to less personal selection procedures (Lee, 2018).”
InfluentialThe Perceived Fairness of Selection Systems: An Organizational Justice Perspective
Gilliland, S. W. (1993) · The Academy of Management Review · doi:10.2307/258595 · Cited by 1,185 · cited 7×
“As a crucial dimension of applicant reactions, the justice perspective (Gilliland, 1993) asserts that fairness perceptions directly influence attitudes and behaviors during the selection process and after the hiring decision, including organizational attractiveness, intention to accept a job offer,…”
InfluentialJustice in the workplace: approaching fairness in human resource management
(1993) · Choice Reviews Online · doi:10.5860/choice.31-0398 · Cited by 868
Measuring Attraction to Organizations
Highhouse, S., Lievens, F., & Sinar, E. F. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164403258403 · Cited by 849 · cited 3×
“Organization attraction (four items; α = .95) and job pursuit intentions (four items; α = .90) were measured using subscales from the Organizational Attraction Scale (OAS; Highhouse, Lievens, & Sinar, 2003).”
InfluentialApplicant Reactions to Selection Procedures: An Updated Model and Meta‐Analysis
Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004) · Personnel Psychology · doi:10.1111/j.1744-6570.2004.00003.x · Cited by 816 · cited 2×
“…intention to accept a job offer, recommending the employer to others, motivation during the selection process, offer acceptance, and job performance (Bauer, Dolen, Maertz, & Campton, 1998; Hausknecht et al., 2004; Konradt, Garbers, Böge, Erdogan, & Bauer, 2017; McCarthy et al., 2013).”
A systematic review of algorithm aversion in augmented decision making
Burton, J. W., Stein, M., & Jensen, T. B. (2020) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2155 · Cited by 814
Gatewood, R. D., Feild, H. S., & Barrick, M. R. (1987) · Cited by 704
The Value of Organizational Reputation in the Recruitment Context: A Brand‐Equity Perspective
Cable, D. M., & Turban, D. B. (2003) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2003.tb01883.x · Cited by 666 · cited 1×
“While an important aspect of applicant attraction involves the employer's reputation and branding (Cable & Turban, 2003), the impression made on the applicant during the recruiting and selection process can influence whether individuals who initially apply will stay in the applicant pool and…”
Ryan, A. (2000) · Journal of Management · doi:10.1016/s0149-2063(00)00041-6 · Cited by 481
APPLICANT REACTIONS TO SELECTION: DEVELOPMENT OF THE SELECTION PROCEDURAL JUSTICE SCALE (SPJS)
BAUER, T. N., TRUXILLO, D. M., SANCHEZ, R. J., CRAIG, J. M., FERRARA, P., & CAMPION, M. A. (2001) · Personnel Psychology · doi:10.1111/j.1744-6570.2001.tb00097.x · Cited by 412 · cited 6×
“Perceptions of procedural justice were measured using 11 items adapted from Bauer et al.'s (2001) Selection Procedural Justice Scale (SPJS).”
InfluentialAI-enabled recruiting: What is it and how should a manager use it?
Black, J. S., & van Esch, P. (2020) · Business Horizons · doi:10.1016/j.bushor.2019.12.001 · Cited by 403 · cited 1×
“…2018; Langer, König, & Papathanasiou, 2019; Lee, 2018; McCarthy et al., 2017) despite the fact that understanding applicant reactions is becoming increasingly important due to AI integration (Black & van Esch, 2020) and the ethical considerations of AI decision making (Leicht-Deobald et al., 2019).”
Explanations: What Factors Enhance Their Perceived Adequacy?
Shapiro, D. L., Buttner, E. H., & Barry, B. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1041 · Cited by 378
The influence of outcomes and procedures on satisfaction with formal leaders.
Tyler, T. R., & Caine, A. (1981) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.41.4.642 · Cited by 360
The Challenges of Algorithm-Based HR Decision-Making for Personal Integrity
Leicht-Deobald, U., Busch, T., Schank, C., Weibel, A., Schafheitle, S., Wildhaber, I., & Kasper, G. (2019) · Journal of Business Ethics · doi:10.1007/s10551-019-04204-w · Cited by 347 · cited 1×
“…2018; Langer, König, & Papathanasiou, 2019; Lee, 2018; McCarthy et al., 2017) despite the fact that understanding applicant reactions is becoming increasingly important due to AI integration (Black & van Esch, 2020) and the ethical considerations of AI decision making (Leicht-Deobald et al., 2019).”
Mechanical versus clinical data combination in selection and admissions decisions: A meta-analysis.
Kuncel, N. R., Klieger, D. M., Connelly, B. S., & Ones, D. S. (2013) · Journal of Applied Psychology · doi:10.1037/a0034156 · Cited by 261
McCarthy, J. M., Bauer, T. N., Truxillo, D. M., Anderson, N. R., Costa, A. C., & Ahmed, S. M. (2017) · Journal of Management · doi:10.1177/0149206316681846 · Cited by 258 · cited 10×
“Applicant reactions models (e.g., McCarthy et al., 2017) generally place justice perceptions in a focal position.”
InfluentialLongitudinal assessment of applicant reactions to employment testing and test outcome feedback.
Bauer, T. N., Maertz, C. P., Dolen, M. R., & Campion, M. A. (1998) · Journal of Applied Psychology · doi:10.1037/0021-9010.83.6.892 · Cited by 256
Employee recruitment and job search: Towards a multi-level integration
Açıkgöz, Y. (2018) · Human Resource Management Review · doi:10.1016/j.hrmr.2018.02.009 · Cited by 232 · cited 1×
“…involves the employer's reputation and branding (Cable & Turban, 2003), the impression made on the applicant during the recruiting and selection process can influence whether individuals who initially apply will stay in the applicant pool and eventually accept a job offer (Acikgoz, 2019).”
Highly automated job interviews: Acceptance under the influence of stakes
Langer, M., König, C. J., & Papathanasiou, M. (2019) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12246 · Cited by 203 · cited 1×
“However, extant research (e.g., Langer et al., 2018, 2019) has yet to fully examine justice perceptions of the use of AI in the selection, as no research has yet examined the entirety of the justice model (Gilliland, 1993) in the context of AI interviews.”
Inductive reasoning: The promise of big data
McAbee, S. T., Landis, R. S., & Burke, M. I. (2016) · Human Resource Management Review · doi:10.1016/j.hrmr.2016.08.005 · Cited by 202
Longitudinal assessment of applicant reactions to employment testing and test outcome feedback.
Bauer, T. N., Maertz, C. P., Jr., Dolen, M. R., & Campion, M. A. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.6.892 · Cited by 198
Primacy Effects in Justice Judgments: Testing Predictions from Fairness Heuristic Theory
Lind, E. A., Kray, L., & Thompson, L. (2001) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2937 · Cited by 188
Examining Applicant Reactions to the Use of Social Networking Websites in Pre-Employment Screening
Stoughton, J. W., Thompson, L. F., & Meade, A. W. (2013) · Journal of Business and Psychology · doi:10.1007/s10869-013-9333-6 · Cited by 179
Sajjadiani, S., Sojourner, A. J., Kammeyer-Mueller, J. D., & Mykerezi, E. (2019) · Journal of Applied Psychology · doi:10.1037/apl0000405 · Cited by 173
Selection fairness information and applicant reactions: A longitudinal field study.
Truxillo, D. M., Bauer, T. N., Campion, M. A., & Paronto, M. E. (2002) · Journal of Applied Psychology · doi:10.1037//0021-9010.87.6.1020 · Cited by 171
Van Iddekinge, C. H., Raymark, P. H., & Roth, P. L. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.3.536 · Cited by 155
Is This How I Will Be Treated? Reducing Uncertainty through Recruitment Interactions
Walker, H. J., Bauer, T. N., Cole, M. S., Bernerth, J. B., Feild, H. S., & Short, J. C. (2012) · Academy of Management Journal · doi:10.5465/amj.2011.0196 · Cited by 153 · cited 1×
“For recruitment efforts to result in successful hires, it is increasingly important to ensure that applicants have favorable reactions to the way they are treated by the organization during the process (Walker et al., 2013).”
Examining digital interviews for personnel selection: Applicant reactions and interviewer ratings
Langer, M., König, C. J., & Krause, K. (2017) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12191 · Cited by 145 · cited 3×
“Similarly, Langer, König, and Krause (2017) found that asynchronous digital interviews were perceived to allow for less two-way communication and provide worse interpersonal treatment compared to live video-conference interviews.”
Justice Expectations and Applicant Perceptions
Bell, B. S., Ryan, A. M., & Wiechmann, D. (2004) · International Journal of Selection and Assessment · doi:10.1111/j.0965-075x.2004.00261.x · Cited by 145
Applicant reactions to face-to-face and technology-mediated interviews: A field investigation.
Chapman, D. S., Uggerslev, K. L., & Webster, J. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.944 · Cited by 143 · cited 3×
“…have unfavorable reactions when AI is used, believing that less personal interaction (i.e., reduced human involvement) signals that the hiring organization does not value them as much as organizations that are willing to spend the time and expense of face-to-face interviews (Chapman et al., 2003).”
Initial investigation into computer scoring of candidate essays for personnel selection.
Campion, M. C., Campion, M. A., Campion, E. D., & Reider, M. H. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000108 · Cited by 130
Langer, M., König, C. J., & Fitili, A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2017.11.036 · Cited by 119 · cited 2×
“However, extant research (e.g., Langer et al., 2018, 2019) has yet to fully examine justice perceptions of the use of AI in the selection, as no research has yet examined the entirety of the justice model (Gilliland, 1993) in the context of AI interviews.”
Sequential testing algorithms for multiple fault diagnosis
Shakeri, M., Raghavan, V., Pattipati, K. R., & Patterson‐Hine, A. (2000) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/3468.823474 · Cited by 115
McCarthy, J. M., Iddekinge, C. H. V., Lievens, F., Kung, M., Sinar, E. F., & Campion, M. A. (2013) · Journal of Applied Psychology · doi:10.1037/a0034089 · Cited by 100 · cited 2×
“…intention to accept a job offer, recommending the employer to others, motivation during the selection process, offer acceptance, and job performance (Bauer, Dolen, Maertz, & Campton, 1998; Hausknecht et al., 2004; Konradt, Garbers, Böge, Erdogan, & Bauer, 2017; McCarthy et al., 2013).”
Dineen, B. R., Noe, R. A., & Wang, C. (2004) · Human Resource Management · doi:10.1002/hrm.20011 · Cited by 99
Ployhart, R. E., & Harold, C. M. (2004) · International Journal of Selection and Assessment · doi:10.1111/j.0965-075x.2004.00266.x · Cited by 89 · cited 1×
“…in this relationship such that when the outcome is unfavorable, individuals attribute the outcome to the process rather than to their own performance (Ababneh et al., 2014; Chan, Schmitt, Jennings, Clause, & Delbridge, 1998; Ployhart & Harold, 2004; Ryan & Ployhart, 2000; Schinkel et al., 2016).”
Ababneh, K. I., Hackett, R. D., & Schat, A. C. H. (2013) · Journal of Business and Psychology · doi:10.1007/s10869-013-9304-y · Cited by 74
A comparative assessment of videoconference and face-to-face employment interviews
J. Sears, G., Zhang, H., H. Wiesner, W., D. Hackett, R., & Yuan, Y. (2013) · Management Decision · doi:10.1108/md-09-2012-0642 · Cited by 73
Applicant Perceptions of Test Fairness: Integrating Justice and Self‐Serving Bias Perspectives
Chan, D. K., Scmitt, N., Jennings, D., Clause, C. S., & Delbridge, K. (1998) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00094 · Cited by 72
Quantifying with words: An investigation of the validity of narrative‐derived performance scores
Speer, A. B. (2018) · Personnel Psychology · doi:10.1111/peps.12263 · Cited by 70
De Cremer, D., Brockner, J., Fishman, A., van Dijke, M., van Olffen, W., & Mayer, D. M. (2010) · Journal of Applied Psychology · doi:10.1037/a0017866 · Cited by 67 · cited 1×
“…and Wiesenfeld (1996) proposed that negative outcomes prompt an information search, which makes individuals more receptive to external cues (e.g., fairness perceptions) that become more influential in determining individuals’ reactions (see also, De Cremer et al., 2010; Tyler & Caine, 1981).”
Konradt, U., Garbers, Y., Böge, M., Erdoğan, B., & Bauer, T. N. (2016) · Group & Organization Management · doi:10.1177/1059601115617665 · Cited by 57
Konradt, U., Warszta, T., & Ellwart, T. (2013) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12026 · Cited by 53
Selection Fairness and Outcomes: A field study of interactive effects on applicant reactions
Schinkel, S., Vianen, A. E. M. V., & van Dierendonck, D. (2013) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12014 · Cited by 51
Schinkel, S., Vianen, A. E. M. V., & Ryan, A. M. (2016) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12134 · Cited by 24 · cited 1×
“…in this relationship such that when the outcome is unfavorable, individuals attribute the outcome to the process rather than to their own performance (Ababneh et al., 2014; Chan, Schmitt, Jennings, Clause, & Delbridge, 1998; Ployhart & Harold, 2004; Ryan & Ployhart, 2000; Schinkel et al., 2016).”
Watch What You Say: Job Applicants’ Justice Perceptions From Initial Organizational Correspondence
Walker, H. J., Helmuth, C. A., Feild, H. S., & Bauer, T. N. (2014) · Human Resource Management · doi:10.1002/hrm.21655 · Cited by 18
APPLICANT REACTIONS TO PRE-EMPLOYMENT APPLICATION BLANKS: A LEGAL AND PROCEDURAL JUSTICE PERSPECTIVE
Wallace, J. C., Page, E. E., & Lippstreu, M. (2005) · Journal of Business and Psychology · doi:10.1007/s10869-005-9007-0 · Cited by 18
Geenen, B., Proost, K., van Dijke, M., Witte, K. D., & von Grumbkow, J. (2012) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12003 · Cited by 11
Cited by
Ethics of AI-enabled recruiting and selection: a review and research agenda
Hunkenschroer, A. L., & Luetge, C. (2022) · Journal of Business Ethics · doi:10.1007/s10551-022-05049-6 · Cited by 447
“Nevertheless, these must be complemented with field studies involving people’s actual experiences in high-stake selection situations to increase the external validity and generalizability of the findings (Acikgoz et al., 2020; Lee, 2018).”
BackgroundLanger, M., & Landers, R. N. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106878 · Cited by 338
Fairness perceptions of algorithmic decision-making: A systematic review of the empirical literature
Starke, C., Baleis, J., Keller, B., & Marcinkowski, F. (2022) · Big Data & Society · doi:10.1177/20539517221115189 · Cited by 316
“We further find that five studies also included interactional fairness, and six studies investigated informational fairness (Acikgoz et al., 2020; Binns et al., 2018; Schoeffer et al., 2021).”
BackgroundMethodInfluentialIs AI recruiting (un) ethical? A human rights perspective on the use of AI for hiring
Hunkenschroer, A. L., & Kriebitz, A. (2023) · AI and Ethics · doi:10.1007/s43681-022-00166-4 · Cited by 111
Schlicker, N., Langer, M., Ötting, S. K., Baum, K., König, C. J., & Wallach, D. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106837 · Cited by 106
Metadata
- Authors
- Acikgoz, Y., Davison, K. H., Compagnone, M., & Laske, M.
- Venue
- International Journal of Selection and Assessment
- Publisher
- Wiley
- Published
- 2020-09-20
- Volume
- 28
- Issue
- 4
- Pages
- 399-416
- ISSN
- 0965-075X (ISSN-L)
- 1468-2389
- OpenAlex
- W3088785240
- Cited by
- 237
- References
- 57
- FWCI
- 18.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.