Questioning Racial and Gender Bias in AI-based Recommendations: Do Espoused National Cultural Values Matter?
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
One realm of AI, recommender systems have attracted significant research attention due to concerns about its devastating effects to society’s most vulnerable and marginalised communities. Both media press and academic literature provide compelling evidence that AI-based recommendations help to perpetuate and exacerbate racial and gender biases. Yet, there is limited knowledge about the extent to which individuals might question AI-based recommendations when perceived as biased. To address this gap in knowledge, we investigate the effects of espoused national cultural values on AI questionability, by examining how individuals might question AI-based recommendations due to perceived racial or gender bias. Data collected from 387 survey respondents in the United States indicate that individuals with espoused national cultural values associated to collectivism, masculinity and uncertainty avoidance are more likely to question biased AI-based recommendations. This study advances understanding of how cultural values affect AI questionability due to perceived bias and it contributes to current academic discourse about the need to hold AI accountable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dimensionalizing Cultures: The Hofstede Model in Context
Hofstede, G. (2011) · Online Readings in Psychology and Culture · doi:10.9707/2307-0919.1014 · Cited by 7,250
Differences Between Tight and Loose Cultures: A 33-Nation Study
Gelfand, M. J., Raver, J. L., Nishii, L., Leslie, L. M., Lun, J., Lim, B. C., Duan, L., Almaliach, A., Ang, S., Arnadottir, J., et al. (2011) · Science · doi:10.1126/science.1197754 · Cited by 3,252
A Theory of Cultural Values and Some Implications for Work
Schwartz, S. H. (1999) · Applied Psychology · doi:10.1111/j.1464-0597.1999.tb00047.x · Cited by 3,102 · cited 1×
“Though this framework remains the most popular among cultural scholars in the IS field, future research may also test the proposed relationships in this study through the lens of other cultural frameworks (e.g., Schwartz, 1999; Hall & Hall, 1976; House et al., 2004).”
Haenlein, M., & Kaplan, A. (2019) · California Management Review · doi:10.1177/0008125619864925 · Cited by 2,655
Mikalef, P., & Gupta, M. (2021) · Information & Management · doi:10.1016/j.im.2021.103434 · Cited by 1,700
Self-citationA Unified Framework of Five Principles for AI in Society
Floridi, L., & Cowls, J. (2019) · Harvard Data Science Review · doi:10.1162/99608f92.8cd550d1 · Cited by 1,631 · cited 1×
“Even though scholars have also been concerned, albeit recently, with proposing governance mechanisms to prevent AI-related misuses and abuses (Floridi & Cowls, 2019; Zuiderveen Borgesius, 2020), there still are reasons for concern.”
BackgroundBellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovic, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1810.01943 · Cited by 1,581
Marketing Analytics for Data-Rich Environments
Wedel, M., & Kannan, P. K. (2016) · Journal of Marketing · doi:10.1509/jm.15.0413 · Cited by 1,261
Artificial intelligence for sustainability: Challenges, opportunities, and a research agenda
Nishant, R., Kennedy, M., & Corbett, J. (2020) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102104 · Cited by 1,203 · cited 1×
“In the past few years, while the technical aspects of AI and associated capabilities have garnered substantial interest from academics and practitioners (Mikalef & Gupta, 2021), the research focusing on individual behaviors in response to AI-based outcomes remains scarce (Nishant et al., 2020).”
BackgroundThe Role of Espoused National Cultural Values in Technology Acceptance1
Srite, M., & Karahanna, E. (2006) · MIS Quarterly · doi:10.2307/25148745 · Cited by 1,169
Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Dastin, J. (2022) · Ethics of Data and Analytics · doi:10.1201/9781003278290-44 · Cited by 1,165
AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942287 · Cited by 884
Lambrecht, A., & Tucker, C. (2019) · Management Science · doi:10.1287/mnsc.2018.3093 · Cited by 854
Predictably Unequal? The Effects of Machine Learning on Credit Markets
Fuster, A., Goldsmith-Pinkham, P. S., Ramadorai, T., & Walther, A. (2017) · doi:10.2139/ssrn.3072038 · Cited by 769 · cited 2×
“…of STEM (Science, Technology, Engineering, and Mathematics) jobs, which were displayed differently to men and women (Lambrecht & Tucker, 2019), and of financial services, in which AI-enabled credit scoring mechanisms led to higher interest rate loans for minorities (Fuster et al., 2018).”
BackgroundToward a Theory-Based Measurement of Culture
Straub, D., Loch, K., Evaristo, R., Karahanna, E., & Srite, M. (2002) · Journal of Global Information Management · doi:10.4018/jgim.2002010102 · Cited by 572
Measuring price discrimination and steering on e-commerce web sites
Hannak, A., Soeller, G., Lazer, D., Mislove, A., & Wilson, C. (2014) · Proceedings of the 2014 Conference on Internet Measurement Conference · doi:10.1145/2663716.2663744 · Cited by 405 · cited 2×
“Bias in online flight bookings (Hannak et al., 2014) 6 You both regularly write posts on similar topics on the same social network service(for instance, Facebook).”
BackgroundMarketing AI recruitment: The next phase in job application and selection
van Esch, P., Black, J. S., & Ferolie, J. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.09.009 · Cited by 391
Fan, W., Liu, J., Zhu, S., & Pardalos, P. M. (2020) · Annals of Operations Research · doi:10.1007/s10479-018-2818-y · Cited by 346
Web Strategies to Promote Internet Shopping: Is Cultural-Customization NeedeD?1
Sia, C. L., Lim, K. H., Leung, K., Lee, M. K. O., Huang, W. W., & Benbasat, I. (2009) · MIS Quarterly · doi:10.2307/20650306 · Cited by 342
The Ugly Truth About Ourselves and Our Robot Creations: The Problem of Bias and Social Inequity
Howard, A., & Borenstein, J. (2018) · Science and Engineering Ethics · doi:10.1007/s11948-017-9975-2 · Cited by 337
Desouza, K. C., Dawson, G. S., & Chenok, D. (2020) · Business Horizons · doi:10.1016/j.bushor.2019.11.004 · Cited by 271
Strengthening legal protection against discrimination by algorithms and artificial intelligence
Zuiderveen Borgesius, F. J. (2020) · The International Journal of Human Rights · doi:10.1080/13642987.2020.1743976 · Cited by 267 · cited 1×
“Even though scholars have also been concerned, albeit recently, with proposing governance mechanisms to prevent AI-related misuses and abuses (Floridi & Cowls, 2019; Zuiderveen Borgesius, 2020), there still are reasons for concern.”
BackgroundArtificial intelligence as digital agency
Ågerfalk, P. J. (2020) · European Journal of Information Systems · doi:10.1080/0960085x.2020.1721947 · Cited by 217 · cited 1×
“…to differentiate between different kinds of AI and not simply assume that it ought to entail machine learning, which in itself is a multifaceted concept (Ågerfalk, 2020), a detailed elaboration on the specific origins and different angles around this debate is beyond the scope of this study.”
Backgroundvan Esch, P., & Black, J. S. (2019) · Business Horizons · doi:10.1016/j.bushor.2019.07.004 · Cited by 186
Beyond Parity: Fairness Objectives for Collaborative Filtering
Yao, S., & Huang, B. (2017) · arXiv · doi:10.48550/arxiv.1705.08804 · Cited by 169 · cited 1×
“…on the development side, IS researchers have been proposing ways of addressing bias through: special treatments for protected groups by modifying algorithmic learning objectives (Yao & Huang, 2017) or measuring weight deviations between protected and unprotected groups (Ning & Karypis, 2011).”
Dissecting Racial Bias in an Algorithm that Guides Health Decisions for 70 Million People
Obermeyer, Z., & Mullainathan, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287593 · Cited by 124 · cited 2×
“Bias in healthcare space (Gershgorn, 2018) (Obermeyer & Mullainathan, 2019) participants (Mean = 3.71, SE = 0.04) had higher mean AI questionability (race) than that of males (Mean = 3.45, SE = 0.03).”
BackgroundInfluentialSpecifying Formative Constructs in Information Systems Research1
Petter, S., Straub, D., & Rai, A. (2007) · MIS Quarterly · doi:10.2307/25148814 · Cited by 32
Cited by
Likelihood of Questioning AI-Based Recommendations Due to Perceived Racial/Gender Bias
Parra, C. M., Gupta, M., & Dennehy, D. (2022) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2021.3120303 · Cited by 48
Self-citationWang, S. (2025) · Cross-Cultural Research · doi:10.1177/10693971251336803 · Cited by 37
“Additionally, Gupta et al. (2022) found that people in countries with higher levels of uncertainty avoidance are more likely to question AI-based recommendations when they perceive them to be racially or gender biased.”
Chang, T.-S., & Hsiao, W.-H. (2025) · Aslib Journal of Information Management · doi:10.1108/ajim-12-2023-0551 · Cited by 31
A step toward building a unified framework for managing AI bias
Rana, S. A., Azizul, Z. H., & Awan, A. A. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1630 · Cited by 23
Barriers to AI adoption for women in higher education: a systematic review of the Asian context
Kalim, U., Kanwar, A., Sha, J., & Huang, R. (2025) · Smart Learning Environments · doi:10.1186/s40561-025-00390-5 · Cited by 22
Metadata
- Authors
- Gupta, M., Parra, C. M., & Dennehy, D.
- Venue
- Information Systems Frontiers
- Published
- 2021-06-20
- Volume
- 24
- Issue
- 5
- Pages
- 1465-1481
- ISSN
- 1387-3326 (ISSN-L)
- 1572-9419
- OpenAlex
- W3176588943
- Cited by
- 129
- References
- 27
- FWCI
- 19.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.