Recruiters prefer expert recommendations over digital hiring algorithm: a choice-based conjoint study in a pre-employment screening scenario
Abstract
Purpose: This study aims to analyze aspects of decision-making in recruitment. Using a choice-based conjoint (CBC) experiment with typified screening scenarios, it was analyzed what aspects will be more important for recruiters: the recommendation provided by a hiring algorithm or the recommendation of a human co-worker; gender of the candidate and of the recruiter was taken into account. Design/methodology/approach: A total of 135 recruitment professionals (67 female) completed a measure of sex roles and a set of 20 CBC trials on the hiring of a pharmacologist. Findings: Participants were willing to accept a lower algorithm score if the level of the human recommendation was maximum, indicating a preference for the co-worker’s recommendation over that of the hiring algorithm. The biological sex of neither the candidate nor the participant influenced in the decision. Research limitations/implications: Participants were presented with a fictitious scenario that did not involve real choices with real consequences. In a real-life setting, considerably more variables influence hiring decisions. Practical implications: Results show that there are limits on the acceptance of technology based on artificial intelligence in the field of recruitment, which has relevance more broadly for the psychological correlates of the acceptance of the technology. Originality/value: An additional value is the use of a methodological approach (CBC) with high ecological validity that may be useful in other psychological studies of decision-making in management.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Empirical findings on behavioral reliance on algorithmic advice remain inconsistent, with some studies reporting reluctance to use algorithmic decision aids in recruitment and others showing that recruiters continue to follow algorithmic recommendations even when they are inaccurate.
“Empirical findings on behavioral reliance on algorithmic advice remain inconsistent.Some studies report reluctance to use algorithmic decision aids in recruitment contexts (Acikgoz et al. 2020;Langer et al. 2019;Oberst et al. 2020), whereas others show that recruiters continue to follow algorithmic recommendations even when they are inaccurate (Cecil et al. 2024;Lacroux and Martin-Lacroux 2022).”
From When Recruiters Meet Algorithms: Advice Taking and Bias in AI‐Assisted Recruitment (2026) · cites this paper as Oberst et al. 2020
Existing studies often rely on vignette-based designs, samples of students or laypeople rather than professional recruiters, or indirect indicators of influence such as confidence ratings and ranking scores.
“Existing studies often rely on vignette-based designs (Oberst et al. 2020), samples of students (Cecil et al. 2024) or laypeople (Neumann and Kuncel 2025) rather than professional recruiters, or indirect indicators of influence such as confidence ratings and ranking scores.”
From When Recruiters Meet Algorithms: Advice Taking and Bias in AI‐Assisted Recruitment (2026) · cites this paper as Oberst et al. 2020
Cites
Technology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159 · see citing works
The forthcoming artificial intelligence (AI) revolution: Its impact on society and firms
Makridakis, S. (2017) · Futures · doi:10.1016/j.futures.2017.03.006 · Cited by 1,866 · see citing works
Venkatesh, V., Morris, M. G., & Ackerman, P. L. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2896 · Cited by 1,237 · see citing works
Eagly, A. H., Nater, C., Miller, D. I., Kaufmann, M., & Sczesny, S. (2020) · American Psychologist · doi:10.1037/amp0000494 · Cited by 1,136 · see citing works
Brougham, D., & Haar, J. (2018) · Journal of Management & Organization · doi:10.1017/jmo.2016.55 · Cited by 1,117 · see citing works
Gender and attitudes toward technology use: A meta-analysis
Cai, Z., Fan, X., & Du, J. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.11.003 · Cited by 728 · see citing works
Social desirability is the same in offline, online, and paper surveys: A meta-analysis
Dodou, D., & de Winter, J. C. F. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.005 · Cited by 325 · see citing works
Hargittai, E., & Shaw, A. (2015) · Information, Communication & Society · doi:10.1080/1369118x.2014.957711 · Cited by 257 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Lacroux, A., & Martin-Lacroux, C. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.895997 · Cited by 67 · see citing works
“This preference for human recommendations emerges even if the recommendation is strongly subjective (Oberst et al., 2020).”
BackgroundInfluentialCheck the box! How to deal with automation bias in AI-based personnel selection
Kupfer, C., Prassl, R., Fleiß, J., Malin, C., Thalmann, S., & Kubicek, B. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1118723 · Cited by 59 · see citing works
“Organizations use AI-based systems because they expect from them both efficient and impartial recommendations for selection decisions (Oberst et al., 2021; Lacroux and Martin-Lacroux, 2022).”
BackgroundInfluentialAbbas, J., Rehman, S., Aldereai, O., Al‐Sulaiti, K. I., & Shah, S. A. R. (2023) · Human Systems Management · doi:10.3233/hsm-230067 · Cited by 32 · see citing works
People versus machines: introducing the HIRE framework
Will, P., Krpan, D., & Lordan, G. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10193-6 · Cited by 53 · see citing works
“…in this systematic review pertain to perceptions surrounding the use of hiring with AI (Suen et al. 2019; Newman et al. 2020; Lee 2018; Langer et al. 2018, 2019; Kaibel et al. 2019; Kodapanakkal et al. 2020; Oberst et al. 2020; Acikgoz et al. 2020; Noble et al. 2021; Warrenbrand 2021; Bigman 2020).”
BackgroundInfluentialPütten, A. M. R.-V. D., & Sach, A. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1416504 · Cited by 24 · see citing works
Yue, Z., Tuk, M. A., & Klesse, A.-K. (2024) · Journal of the Association for Consumer Research · doi:10.1086/730710 · Cited by 22 · see citing works
“…to utilize healthcare algorithms (Longoni et al. 2019), to rely on algorithms for tasks that seem subjective (Castelo et al. 2019), and are hesitant to trust algorithms for recommending jokes (Yeomans et al. 2019), hedonic products (Longoni and Cian 2022), and job candidates (Oberst et al. 2021).”
MethodThe application of AI in digital HRM – an experiment on human decision-making in personnel selection
Malin, C. D., Fleiß, J., Seeber, I., Kubicek, B., Kupfer, C., & Thalmann, S. (2024) · Business Process Management Journal · doi:10.1108/bpmj-11-2023-0884 · Cited by 21 · see citing works
“Despite the high potential ascribed to AI use in organizations (Bongard, 2019; Oberst et al. , 2021; Langer et al. , 2021), the question of how AI can be successfully integrated into personnel selection is one of the main challenges in the digital transformation of HRM (Prikshat et al. , 2023).”
Tackling the global challenges using data-driven innovations
Akter, S., Sultana, S., Gunasekaran, A., Bandara, R., & Miah, S. (2024) · Annals of Operations Research · doi:10.1007/s10479-024-05875-z · Cited by 17 · see citing works
“Moreover, gender bias in employee selection can be detected and reduced as well with the application of advanced technologies like AI-based digital hiring (Oberst et al., 2021; Palomar et al., 2021).”
Persson, M., & Wallo, A. (2024) · Gender Technology and Development · doi:10.1080/09718524.2024.2406039 · Cited by 13 · see citing works
“…recruiting was unrealized due to persistent challenges in achieving unbiased matching and candidate searching (e.g., Furtmueller et al., 2012; Oberst et al., 2020). as previously mentioned, there is an international trend toward female domination in the hR occupation (scarborough, 2017).…”
Souto‐Otero, M., & Brown, P. (2024) · Journal of Education and Work · doi:10.1080/13639080.2024.2310263 · Cited by 12 · see citing works
“With regard to acceptability, Oberst et al. (2020) found that recruiters prefer expert recommendations over those given by algorithms.”
Same but different - The effect of the unit of measure on the valuation of a unit price
Ohlwein, M. (2022) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2021.102896 · Cited by 8 · see citing works
Mai, L., Köchling, A., & Wehner, M. (2022) · SN Computer Science · doi:10.1007/s42979-022-01137-6 · Cited by 7 · see citing works
Artificial intelligence skepticism in career domains
Adepoju, O. D., Tijani, B., & Karera, S. (2024) · International Journal for Digital Society · doi:10.20533/ijds.2040.2570.2024.0236 · Cited by 6 · see citing works
Practical Perspectives on Fairness In Technology-Aided Personnel Selection
Müller, I., Dill, K., & Mihaljević, H. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757647
“To stimulate deeper and more tangible discussions about algorithm use and fairness issues [38, 52, 67, 84, 106] while protecting sensitive company information, we introduced hypothetical scenarios in the second and third focus groups (see the appendix in Section A for a details).”
Systematic literature review on the digital transformation of the personnel selection process
Baranyi, V. (2025) · German Journal of Human Resource Management Zeitschrift für Personalforschung · doi:10.1177/23970022251363012 · Cited by 7 · see citing works
“…can be increased (Sithambaram and Tajudeen, 2023; Yadav et al., 2023) by freeing up HR professionals from repetitive administrative tasks allowing them to focus on strategic and human-centric activities (Horodyski, 2023b; Islam et al., 2022; Oberst et al., 2021; Pandya and Al Janahi, 2021).”
Cui, M., Chen, Z., & Huang, M. (2025) · Asian Journal Of Social Psychology · doi:10.1111/ajsp.70009 · Cited by 6 · see citing works
Baumler, R., & Piercy, C. W. (2025) · Media Psychology · doi:10.1080/15213269.2025.2546113 · Cited by 2 · see citing works
“Companies are adopting algorithms, AI, and other machines to aid in hiring decisions under the “assumption that hiring recommendations made by this highly advanced technology is both efficient and impartial—at least more so than any human recruiter” (Oberst et al., 2020, p. 627).”
Gender Biases in AI: Building Inclusive Future in Engineering Education
Borges, C., Ferreira, E. P., João, I. M., & Pereira, R. Q. (2025) · 2025 6th International Conference of the Portuguese Society for Engineering Education (CISPEE) · doi:10.1109/cispee64787.2025.11123919 · Cited by 2 · see citing works
When algorithms and human experts contradict, whom do users follow?
Pal, A., Chua, A. Y. K., & Banerjee, S. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2525306 · Cited by 5 · see citing works
“They believe human experts possess specialised skills and can grasp the complexities and nuances of an issue (Oberst et al. 2021).”
Recruiters’ Behaviors Faced with Dual (AI and Human) Recommendations in Personnel Selection
Lacroux, A., & Martin-Lacroux, C. (2023) · Academy of Management Proceedings · doi:10.5465/amproc.2023.14704abstract · Cited by 2 · see citing works
“Drawing from experimental studies of decision making in complex tasks involving human and ADSS experts, we consider that the human expert is generally considered to be more trustworthy than an ADSS (Langer et al., 2022; Oberst et al., 2020; Rieger et al., 2022).”
InfluentialDeschênes, A.-A., Beaudry, C. A., & Yaya, M. S. (2024) · Ad machina · doi:10.1522/radm.no8.1837 · Cited by 1 · see citing works
Digital Frontiers: The new landscape of talent scouting through theoretical models
Oham, C., & Ejike, O. G. (2022) · World Journal of Advanced Research and Reviews · doi:10.30574/wjarr.2022.14.2.0281 · Cited by 1
“There have been calls for greater regulation of AI in recruitment, with suggestions that companies should audit their algorithms regularly to ensure they are not inadvertently discriminating against certain groups (Oberst, De Quintana, Del Cerro, & Chamarro, 2021).”
BackgroundYang, Y. (2024) · Pakistan Journal of Life and Social Sciences (PJLSS) · doi:10.57239/pjlss-2024-22.2.001130 · Cited by 1 · see citing works
“Literature also suggests that AI is increasingly used to conduct pre-employment assessments (Oberst et al., 2021.”
When Recruiters Meet Algorithms: Advice Taking and Bias in AI‐Assisted Recruitment
Lacroux, A., & Martin Lacroux, C. (2026) · International Journal of Selection and Assessment · doi:10.1111/ijsa.70085
The primacy of ethical governance: Unraveling the AI-HRM adoption paradox in an emerging economy
Poo-Udom, A. (2026) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2026.103554 · Cited by 1 · see citing works
AI recruitment and stakeholder concerns: an integrative framework
Ayundyayasti, P., & Wong, R. (2026) · Journal of strategic information systems · doi:10.1016/j.jsis.2026.101985
Stefanov, M. (2025) · Acta Logistica · doi:10.22306/al.v12i4.707
“A recent study further supports this insight, demonstrating that recommendations remain the primary recruitment channel, preferred even over digital algorithms in the digital age [25].”
Yadav, A., & Nigam, A. (2025) · Sachetas · doi:10.55955/430002
“Furthermore, the emerging themes, such as technological change, highlight the need for research into AI-human collaboration to ensure human-centric, inclusive hiring practices (Niehueser W et al., 2020; Wuisan DSS et al., 2023; Oberst U et al., 2021).”
Algorithmic Research on Personalized Resume Recommendation System Based on Network Recruitment
Cao, H. (2024) · Proceedings of the 2024 International Conference on Artificial Intelligence, Digital Media Technology and Interaction Design · doi:10.1145/3726010.3726036
“Given heuristic procedure also uses keyword occurrence frequency or inverse document frequency (IDF), the resulting population is more meaningful and adaptable [8].”
Lacroux, A. (2023) · doi:10.48550/arxiv.2305.08889
“…ceux liés au contrôle de gestion social (HR scorecards) et d’autres chantiers en développement rapide, comme le recrutement prédictif (Ajunwa et al., 2016; Oberst et al., 2020) ou les modèles d’apprentissage supervisé appliqués à l’étude des déterminants de la fidélisation (Atef et al., 2022).”
Uma Maheswari, B. (2024) · International Research Journal of Multidisciplinary Scope · doi:10.47857/irjms.2024.v05i02.0280
“This is then presented to the sample population to determine the preferences of the consumers (35).”
Background
- Authors
- Oberst, U., De Quintana, M., Del Cerro, S., & Chamarro, A.
- Affiliations
- Universitat Ramon Llull (ES)
- ORCID
- Oberst, Ursula
- Venue
- Management Research Review
- Publisher
- Emerald
- Published
- 2020-11-11
- Volume
- 44
- Issue
- 4
- Pages
- 625-641
- ISSN
- 2040-8269 (ISSN-L)
- OpenAlex
- W3104855997
- Cited by
- 32
- References
- 0
- Citations by year
- 2026: 3 · 2025: 9 · 2024: 11 · 2023: 4 · 2022: 5
- FWCI
- 2.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Management Research Review (publishedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Employer Branding and e-HRM
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Keywords
- hiring decisions, hiring algorithms, artificial intelligence in recruitment, pre-employment screening, technology acceptance, gender differences, gender roles, ecological validity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review