The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Likelihood of Questioning AI-Based Recommendations Due to Perceived Racial/Gender Bias
Open accessAbstract
Advances in artificial intelligence (AI) are giving rise to a multitude of AI-embedded technologies that are increasingly impacting all aspects of modern society. Yet, there is a paucity of rigorous research that advances understanding of when, and which type of, individuals are more likely to question AI-based recommendations due to perceived racial and gender bias. This study, which is part of a larger research stream contributes to knowledge by using a scenario-based survey that was issued to a sample of 387 U.S. participants. The findings suggest that considering perceived racial and gender bias, human resource (HR) recruitment and financial product/service procurement scenarios exhibit a higher questioning likelihood. Meanwhile, the healthcare scenario presents the lowest questioning likelihood. Furthermore, in the context of this study, U.S. participants tend to be more susceptible to questioning AI-based recommendations due to perceived racial bias rather than gender bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The questionnaire-based healthcare app suffered from racial inequalities as it suggested different diagnoses for different race of people keeping all other parameters identical [101,108].”
From Artificial intelligence bias in medical system designs: a systematic review (2023) · cites this paper as [108]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“In the context of healthcare, an algorithm used to predict healthcare needs was found to exhibit significant racial discrimination as it considered health expenses and costs as a proxy for healthcare needs, without having first controlled for evident inequalities in access to healthcare services [9].”
MethodRunning experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Dastin, J. (2022) · Ethics of Data and Analytics · doi:10.1201/9781003278290-44 · Cited by 1,165
Di Vaio, A., Palladino, R., Hassan, R., & Escobar, O. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2020.08.019 · Cited by 1,096
Does a different view create something new? The effect of employee diversity on innovation
Østergaard, C. R., Timmermans, B., & Kristinsson, K. (2011) · Research Policy · doi:10.1016/j.respol.2010.11.004 · Cited by 1,016
Predictably Unequal? The Effects of Machine Learning on Credit Markets
FUSTER, A., GOLDSMITH‐PINKHAM, P., RAMADORAI, T., & WALTHER, A. (2022) · The Journal of Finance · doi:10.1111/jofi.13090 · Cited by 872
Lambrecht, A., & Tucker, C. (2019) · Management Science · doi:10.1287/mnsc.2018.3093 · Cited by 854
Predictably Unequal? The Effects of Machine Learning on Credit Markets
Fuster, A., Goldsmith-Pinkham, P. S., Ramadorai, T., & Walther, A. (2017) · doi:10.2139/ssrn.3072038 · Cited by 769
Measuring price discrimination and steering on e-commerce web sites
Hannak, A., Soeller, G., Lazer, D., Mislove, A., & Wilson, C. (2014) · Proceedings of the 2014 Conference on Internet Measurement Conference · doi:10.1145/2663716.2663744 · Cited by 405
Gupta, M., Parra, C. M., & Dennehy, D. (2021) · Information Systems Frontiers · doi:10.1007/s10796-021-10156-2 · Cited by 179
Self-citation
Research works printed but not linked: 12
- hamilton, 2019, AI Perpetuating Human Bias in the Lending Space
- 2018, The future of jobs report 2018
- bogle, 2021, Job search system in android environment—Application of intelligent agents, Int J Inf Sci Techn, 2, 1
- brynjolfsson, 2017, The Business of Artificial Intelligence What it Can—And Cannot—Do for an Organization
- manyika, 2019, What Do We Do About the Biases in AI?, 25
- hamilton, 2018, Why it’s totally unsurprising that amazon’s recruitment ai was biased against women
- angwin, 2016, Machine Bias
- 2021, Worldwide Semiannual Artificial Intelligence Tracker
- columbus, 2020, Roundup of Machine Learning Forecasts and Market Estimates 2020
- tate, 2019, Racial Bias in Facial Recognition Software What Travelers Should Know as TSA CBP Expand Programs
- ghaffary, 2019, The Algorithms That Detect Hate Speech Online Are Biased Against Black People
- gershgorn, 2018, If AI Is Going to Be the World’s Doctor it Needs Better Textbooks
Cited by
Fake news on Social Media: the Impact on Society
Olan, F., Jayawickrama, U., Arakpogun, E. O., Suklan, J., & Liu, S. (2024) · Information Systems Frontiers · doi:10.1007/s10796-022-10242-z · Cited by 303
An evaluation of the critical success factors impacting artificial intelligence implementation
Merhi, M. I. (2022) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2022.102545 · Cited by 242
A Confirmation Bias View on Social Media Induced Polarisation During Covid-19
Modgil, S., Singh, R. K., Gupta, S., & Dennehy, D. (2024) · Information Systems Frontiers · doi:10.1007/s10796-021-10222-9 · Cited by 168
Self-citationSecurity of Blockchain and AI-Empowered Smart Healthcare: Application-Based Analysis
Alabdulatif, A., Khalil, I., & Saidur Rahman, M. (2022) · Applied Sciences · doi:10.3390/app122111039 · Cited by 117
“Then, Parra et al. in [31] studied the application of AI algorithms for sustainable development.”
BackgroundA Systematic Literature Review on AI-Based Recommendation Systems and Their Ethical Considerations
Masciari, E., Umair, A., & Ullah, M. H. (2024) · IEEE Access · doi:10.1109/access.2024.3451054 · Cited by 75
Metadata
- Authors
- Parra, C. M., Gupta, M., & Dennehy, D.
- Affiliations
- Florida International University (US)
- Ollscoil na Gaillimhe – University of Galway (IE)
- Venue
- IEEE Transactions on Technology and Society
- Published
- 2022-03
- Volume
- 3
- Issue
- 1
- Pages
- 41-45
- ISSN
- 2637-6415 (ISSN-L)
- OpenAlex
- W3205332925
- Cited by
- 48
- References
- 16
- Citations by year
- 2026: 9 · 2025: 11 · 2024: 14 · 2023: 6 · 2022: 7
- FWCI
- 8.76
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- IEEE Transactions on Technology and Society (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- AI-based recommendation, algorithmic fairness, trust in AI, personnel selection, health care, scenario-based survey
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Likelihood of Questioning AI-Based Recommendations Due to Perceived Racial/Gender Bias. https://app.cochat.ai/papers/10.1109/tts.2021.3120303
- The paper
- Parra, C. M., Gupta, M., & Dennehy, D. (2022). Likelihood of Questioning AI-Based Recommendations Due to Perceived Racial/Gender Bias. IEEE Transactions on Technology and Society. https://doi.org/10.1109/tts.2021.3120303
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
