Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual Differences
Abstract
Algorithmic decision-making systems are increasingly used throughout the public and private sectors to make important decisions or assist humans in making these decisions with real social consequences. While there has been substantial research in recent years to build fair decision-making algorithms, there has been less research seeking to understand the factors that affect people's perceptions of fairness in these systems, which we argue is also important for their broader acceptance. In this research, we conduct an online experiment to better understand perceptions of fairness, focusing on three sets of factors: algorithm outcomes, algorithm development and deployment procedures, and individual differences. We find that people rate the algorithm as more fair when the algorithm predicts in their favor, even surpassing the negative effects of describing algorithms that are very biased against particular demographic groups. We find that this effect is moderated by several variables, including participants' education level, gender, and several aspects of the development procedure. Our findings suggest that systems that evaluate algorithmic fairness through users' feedback must consider the possibility of "outcome favorability" bias.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Previous work where a human supervised each decision made by the algorithmic system found no evidence that this configuration affected fairness perceptions.
“As opposed to some previous work where a human would supervise each decision made by the algorithmic system [103] -the authors did not fnd any evidence of this confguration afecting fairness perceptions-”
From Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability (2023) · cites this paper as [103]
Earlier work found that case-by-case human intervention did not contribute to perceptions of fairness.
“These results resonate with earlier work on the topic [103], where a case-by-case human intervention did not contribute to perceptions of fairness.”
From Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability (2023) · cites this paper as [103]
The design choice to tell the story in the third person with no reference to personal characteristics was made to minimize outcome favourability bias.
“The reason behind this design choice was to minimize, as far as possible, the outcome favourability bias [103].”
From Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability (2023) · cites this paper as [103]
This increased efficiency is likely to increase consumers' evaluations of chatbot-based results as more fair and objective.
“This increased efficiency is likely to increase consumers' evaluations of chatbot-based results as more fair and objective [70,71].”
From Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation (2025) · cites this paper as [71]
The ability of AI chatbots to provide quick, complete, and direct answers to consumer queries is known to increase the perceived objectivity of the search results.
“Furthermore, the ability of AI chatbots to provide quick, complete, and direct answers to consumer queries is known to increase the perceived objectivity of the search results [71].”
From Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation (2025) · cites this paper as [71]
Cites
Advances In Experimental Social Psychology
(2022) · Advances in experimental social psychology · doi:10.1016/s0065-2601(22)x0002-6 · Cited by 22,559 · see citing works
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · see citing works
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,870 · see citing works
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022 · see citing works
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501 · see citing works
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · see citing works
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · see citing works
Hatfield, E. C., Walster, G. W., Berscheid, E., Austin, W. G., Traupmann, J., & Utne, M. K. (1978) · Medical Entomology and Zoology · Cited by 2,387 · see citing works
Network Dissection: Quantifying Interpretability of Deep Visual Representations
Bau, D., Zhou, B., Khosla, A., Oliva, A., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.354 · Cited by 1,389 · see citing works
Lee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338 · see citing works
Rivera, L. A. (2012) · American Sociological Review · doi:10.1177/0003122412463213 · Cited by 1,277 · see citing works
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230 · cited 1× · see citing works
“The aversion to algorithmic decision-making could be mitigated when users contribute to the modification of the algorithms [24].”
BackgroundThe Perceived Fairness of Selection Systems: An Organizational Justice Perspective
Gilliland, S. W. (1993) · The Academy of Management Review · doi:10.2307/258595 · Cited by 1,185 · see citing works
Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Dastin, J. (2022) · Ethics of Data and Analytics · doi:10.1201/9781003278290-44 · Cited by 1,165 · see citing works
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149 · see citing works
Fairness in Criminal Justice Risk Assessments: The State of the Art
Berk, R., Heidari, H., Jabbari, S., Kearns, M., & Roth, A. (2021) · Sociological Methods & Research · doi:10.1177/0049124118782533 · Cited by 988 · see citing works
Social Behavior: Its Elementary Forms.
Ekeh, P. P., & Homans, G. C. (1976) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063864 · Cited by 906 · see citing works
Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823 · see citing works
Social Justice: Outcome and Procedure
Tyler, T. R. (2000) · International Journal of Psychology · doi:10.1080/002075900399411 · Cited by 777 · see citing works
Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777 · see citing works
Lepri, B., Oliver, N., Letouzé, E., Pentland, A., & Vinck, P. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0279-x · Cited by 709 · see citing works
How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615 · see citing works
Society-in-the-loop: programming the algorithmic social contract
Rahwan, I. (2018) · Ethics and Information Technology · doi:10.1007/s10676-017-9430-8 · Cited by 553 · see citing works
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2017) · doi:10.3386/w23180 · Cited by 545 · see citing works
Generating Visual Explanations
Hendricks, L. A., Akata, Z., Rohrbach, M., Donahue, J., Schiele, B., & Darrell, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_1 · Cited by 534 · see citing works
Equity and Justice in Social Behavior
(1982) · Elsevier eBooks · doi:10.1016/c2013-0-10762-3 · Cited by 499 · see citing works
Veale, M., Van Kleek, M., & Binns, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174014 · Cited by 490 · see citing works
Distributive Justice: A Social-Psychological Perspective.
Cook, K. S., & Deutsch, M. (1986) · Administrative Science Quarterly · doi:10.2307/2392976 · Cited by 487 · see citing works
First I "like" it, then I hide it: Folk Theories of Social Feeds
Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A., Hamilton, K., & Kirlik, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858494 · Cited by 375 · see citing works
The Future of Human-in-the-Loop Cyber-Physical Systems
Schirner, G., Deniz Erdogmus, B., Chowdhury, K. R., & Padır, T. (2013) · Computer · doi:10.1109/mc.2013.31 · Cited by 330 · see citing works
DeVito, M. A., Gergle, D., & Birnholtz, J. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025659 · Cited by 311 · see citing works
The justice motive: "Equity" and "parity" among children.
Lerner, M. J. (1974) · Journal of Personality and Social Psychology · doi:10.1037/h0036206 · Cited by 278 · see citing works
Value-Sensitive Algorithm Design: Method, Case Study, and Lessons
Zhu, H., Yu, B., Halfaker, A., & Terveen, L. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274463 · Cited by 220 · see citing works
Self-citation'Too Gay for Facebook': Presenting LGBTQ+ Identity Throughout the Personal Social Media Ecosystem
DeVito, M. A., Walker, A. M., & Birnholtz, J. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274313 · Cited by 219 · see citing works
Grgic-Hlaca, N., Redmiles, E. M., Gummadi, K. P., & Weller, A. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186138 · Cited by 207 · see citing works
Skitka, L. J., Winquist, J. R., & Hutchinson, S. R. (2003) · Social Justice Research · doi:10.1023/a:1026336131206 · Cited by 200 · see citing works
Self-interest and fairness in problems of resource allocation: Allocators versus recipients.
Diekmann, K. A., Samuels, S. M., Ross, L. D., & Bazerman, M. H. (1997) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.72.5.1061 · Cited by 197 · see citing works
Developing the Computer Programming Self-Efficacy Scale for Computer Literacy Education
Tsai, M., Wang, C.-Y., & Hsu, P.-F. (2018) · Journal of Educational Computing Research · doi:10.1177/0735633117746747 · Cited by 190 · see citing works
User attitudes towards algorithmic opacity and transparency in online reviewing platforms
Eslami, M., Vaccaro, K., Lee, M. K., Elazari Bar On, A., Gilbert, E., & Karahalios, K. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300724 · Cited by 184 · see citing works
Lee, M. K., & Baykal, S. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998230 · Cited by 182 · see citing works
The social construction of fairness: social influence and sense making in organizations
Lamertz, K. (2001) · Journal of Organizational Behavior · doi:10.1002/job.128 · Cited by 179 · see citing works
Two Threats to the Common Good: Self-Interested Egoism and Empathy-Induced Altruism
Batson, C. D., Ahmad, N. Y., Yin, J., Bedell, S. J., Johnson, J. W., & Templin, C. M. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/0146167299025001001 · Cited by 148 · see citing works
Self-interest and fairness in problems of resource allocation: Allocators versus recipients.
Diekmann, K. A., Samuels, S. M., Ross, L. D., et al. (1997) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.72.5.1061 · Cited by 148 · see citing works
The Paradox of Automation as Anti-Bias Intervention
Ajunwa, I. (2016) · doi:10.2139/ssrn.2746078 · Cited by 122 · see citing works
Self-interest and fairness: self-serving choices of justice principles
Rodríguez-Lara, I., & Moreno-Garrido, L. (2011) · Experimental Economics · doi:10.1007/s10683-011-9295-3 · Cited by 120 · see citing works
Rutström, E. E., & Williams, M. B. (2000) · Journal of Economic Behavior & Organization · doi:10.1016/s0167-2681(00)00109-8 · Cited by 115 · see citing works
Skitka, L. J. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/0146167299025007003 · Cited by 106 · see citing works
PERCEIVED FAIRNESS OF LAYOFFS AMONG INDIVIDUALS WHO HAVE BEEN LAID OFF: A LONGITUDINAL STUDY
Wanberg, C. R., Gavin, M. B., & Bunce, L. W. (1999) · Personnel Psychology · doi:10.1111/j.1744-6570.1999.tb01813.x · Cited by 104 · see citing works
A Human-Centered Approach to Algorithmic Services
Lee, M. K., Kim, J. T., & Lizarondo, L. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025884 · Cited by 88 · see citing works
But Do They Care About Fairness? The Dynamics of Preferential Treatment and Minority Interest
Nacoste, R. W. (1987) · Basic and Applied Social Psychology · doi:10.1207/s15324834basp0803_1 · Cited by 83 · see citing works
Esarey, J., Salmon, T. C., & Barrilleaux, C. J. (2011) · Economic Inquiry · doi:10.1111/j.1465-7295.2011.00394.x · Cited by 79 · see citing works
van Beest, I., & van Dijk, E. (2007) · European Review of Social Psychology · doi:10.1080/10463280701595354 · Cited by 45 · see citing works
Wilkinson, A., Roberts, J. D., & While, A. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.04.010 · Cited by 36 · see citing works
Moliner, C., Martínez‐Tur, V., Silla, J. M. P., Ramos, J., & Cropanzano, R. (2012) · Stress and Health · doi:10.1002/smi.2421 · Cited by 27 · see citing works
Immigration Policing and Federalism Through the Lens of Technology, Surveillance, and Privacy
Kalhan, A. (2013) · The Knowledge Bank (The Ohio State University) · Cited by 26 · see citing works
Factors in Fairness and Emotion in Online Case Resolution Systems
Hou, Y., Lampe, C. A. C., Bulinski, M., & Prescott, J. J. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025968 · Cited by 19 · see citing works
Society in the Loop Artificial Intelligence
Ito, J. (2016) · Joi Ito's Web · doi:10.31859/20160623.1937 · Cited by 3 · see citing works
Flagged first, then by citations
1 of the 58 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Langer, M., Oster, D., Speith, T., Hermanns, H., Kästner, L., Schmidt, E., Sesing, A., & Baum, K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103473 · Cited by 652 · see citing works
Köbis, N., & Mossink, L. D. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106553 · Cited by 406 · see citing works
Langer, M., & Landers, R. N. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106878 · Cited by 338 · see citing works
Fairness perceptions of algorithmic decision-making: A systematic review of the empirical literature
Starke, C., Baleis, J., Keller, B., & Marcinkowski, F. (2022) · Big Data & Society · doi:10.1177/20539517221115189 · Cited by 316 · see citing works
Kieslich, K., Keller, B., & Starke, C. (2022) · Big Data & Society · doi:10.1177/20539517221092956 · Cited by 232 · see citing works
Sycophantic AI decreases prosocial intentions and promotes dependence
Cheng, M., Lee, C., Khadpe, P., Yu, S., Han, D., & Jurafsky, D. (2026) · Science · doi:10.1126/science.aec8352 · Cited by 185 · see citing works
The Who in XAI: How AI Background Shapes Perceptions of AI Explanations
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M., & Riedl, M. O. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642474 · Cited by 123 · see citing works
Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits
Deng, W. H., Nagireddy, M., Lee, M. S. A., Singh, J., Wu, Z. S., Holstein, K., & Zhu, H. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533113 · Cited by 99 · see citing works
Self-citation”Because AI is 100% right and safe”: User Attitudes and Sources of AI Authority in India
Kapania, S., Siy, O., Clapper, G., SP, A. M., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517533 · Cited by 90 · see citing works
Fairness and Transparency in Recommendation: The Users’ Perspective
Sonboli, N., Smith, J. J., Berenfus, F. C., Burke, R., & Fiesler, C. L. (2021) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3450613.3456835 · Cited by 88 · see citing works
Li, T., Cobb, C., Yang, J., Baviskar, S., Agarwal, Y., Li, B., Bauer, L., & Hong, J. (2021) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2021.101439 · Cited by 87 · see citing works
Effect of Information Presentation on Fairness Perceptions of Machine Learning Predictors
van Berkel, N., Goncalves, J., Russo, D., Hosio, S., & Skov, M. B. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445365 · Cited by 84 · see citing works
Fairness Perceptions of Artificial Intelligence: A Review and Path Forward
Narayanan, D., Nagpal, M., McGuire, J., Schweitzer, S., & Cremer, D. D. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2210890 · Cited by 87 · see citing works
Bridging Machine Learning and Mechanism Design towards Algorithmic Fairness
Finocchiaro, J., Maio, R., Monachou, F., Patro, G. K., Raghavan, M., Stoica, A.-A., & Tsirtsis, S. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445912 · Cited by 83 · see citing works
Addressing Algorithmic Bias in AI-Driven Customer Management
Akter, S., Dwivedi, Y. K., Biswas, K., Michael, K., Bandara, R. J., & Sajib, S. (2021) · Journal of Global Information Management · doi:10.4018/jgim.20211101.oa3 · Cited by 87 · see citing works
Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Making
Lima, G., Grgić-Hlača, N., & Cha, M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445260 · Cited by 79 · see citing works
Yurrita, M., Draws, T., Balayn, A., Murray-Rust, D., Tintarev, N., & Bozzon, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581161 · Cited by 73 · see citing works
Toward involving end-users in interactive human-in-the-loop AI fairness
Nakao, Y., Stumpf, S., Ahmed, S., Naseer, A., & Strappelli, L. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3514258 · Cited by 69 · see citing works
Towards responsible media recommendation
Elahi, M., Jannach, D., Skjærven, L., Knudsen, E., Sjøvaag, H., Tolonen, K., Holmstad, Ø., Pipkin, I., Throndsen, E., Stenbom, A., et al. (2021) · AI and Ethics · doi:10.1007/s43681-021-00107-7 · Cited by 69 · see citing works
Datasheets for Datasets help ML Engineers Notice and Understand Ethical Issues in Training Data
Boyd, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479582 · Cited by 67 · see citing works
Schoeffer, J., Kuehl, N., & Machowski, Y. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533218 · Cited by 67 · see citing works
Pan, C. A., Yakhmi, S., Iyer, T., Strasnick, E., Zhang, A. X., & Bernstein, M. S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512929 · Cited by 67 · see citing works
Tal, A. S., Kuflik, T., & Kliger, D. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2095705 · Cited by 69 · see citing works
Using Explainability to Help Children UnderstandGender Bias in AI
Melsión, G. I., Torre, I., Vidal, E., & Leite, I. (2021) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3459990.3460719 · Cited by 65 · see citing works
Soliciting Stakeholders’ Fairness Notions in Child Maltreatment Predictive Systems
Cheng, H.-F., Stapleton, L., Wang, R., Bullock, P., Chouldechova, A., Wu, Z. S. S., & Zhu, H. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445308 · Cited by 64 · see citing works
Self-citationI agree with the decision, but they didn't deserve this
Kasinidou, M., Kleanthous, S., Barlas, P., & Otterbacher, J. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445931 · Cited by 61 · see citing works
Chiang, C.-W., Lu, Z., Li, Z., & Yin, M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581015 · Cited by 60 · see citing works
Choung, H., Seberger, J. S., & David, P. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2266244 · Cited by 67 · see citing works
Mitigating Bias in Algorithmic Systems—A Fish-eye View
Orphanou, K., Otterbacher, J., Kleanthous, S., Batsuren, K., Giunchiglia, F., Bogina, V., Tal, A. S., Hartman, A., & Kuflik, T. (2022) · ACM Computing Surveys · doi:10.1145/3527152 · Cited by 54 · see citing works
Langer, M., Hunsicker, T., Feldkamp, T., König, C. J., & Grgić-Hlača, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517527 · Cited by 55 · see citing works
The extent of algorithm aversion in decision-making situations with varying gravity
Filiz, I., Judek, J. R., Lorenz, M., & Spiwoks, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0278751 · Cited by 52 · see citing works
A Critical Survey on Fairness Benefits of Explainable AI
Deck, L., Schoeffer, J., De‐Arteaga, M., & Kühl, N. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658990 · Cited by 86 · see citing works
Nakao, Y., Strappelli, L., Stumpf, S., Naseer, A., Regoli, D., & Gamba, G. D. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2067936 · Cited by 55 · see citing works
van Berkel, N., Papachristos, E., Giachanou, A., Hosio, S., & Skov, M. B. (2020) · Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society · doi:10.1145/3419249.3420106 · Cited by 51 · see citing works
Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study
Scharowski, N., Benk, M., Kühne, S. J., Wettstein, L., & Brühlmann, F. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593994 · Cited by 53 · see citing works
How Platform-User Power Relations Shape Algorithmic Accountability
Ramesh, D., Kameswaran, V., Wang, D., & Sambasivan, N. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533237 · Cited by 53 · see citing works
“I Would Like to Design”: Black Girls Analyzing and Ideating Fair and Accountable AI
Solyst, J., Xie, S., Yang, E., Stewart, A., Eslami, M., Hammer, J., & Ogan, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581378 · Cited by 47 · see citing works
Bach, A. K. P., Nørgaard, T. M., Brok, J. C., & van Berkel, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581513 · Cited by 47 · see citing works
OK computer: Worker perceptions of algorithmic recruitment
Fumagalli, E., Rezaei, S., & Salomons, A. (2022) · Research Policy · doi:10.1016/j.respol.2021.104420 · Cited by 46 · see citing works
Jia, C., Boltz, A., Zhang, A., Chen, A., & Lee, M. K. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555096 · Cited by 46 · see citing works
Procedural fairness in algorithmic decision-making: the role of public engagement
Decker, M. C., Wegner, L., & Leicht-Scholten, C. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09811-4 · Cited by 56 · see citing works
Artificial intelligence and labour market matching
Broecke, S. (2023) · OECD social employment and migration working papers · doi:10.1787/2b440821-en · Cited by 64 · see citing works
Moral Machines or Tyranny of the Majority? A Systematic Review on Predictive Bias in Education
Li, L., Sha, L., Li, Y., Raković, M., Rong, J., Joksimovíc, S., Selwyn, N., Gašević, D., & Chen, G. (2023) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3576050.3576119 · Cited by 43 · see citing works
Towards a multi-stakeholder value-based assessment framework for algorithmic systems
Yurrita, M., Murray-Rust, D., Balayn, A., & Bozzon, A. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533118 · Cited by 42 · see citing works
Silva, D. E., Chen, C., & Zhu, Y. (2022) · New Media & Society · doi:10.1177/14614448221098042 · Cited by 46 · see citing works
Zheng, C., Wu, Y., Shi, C., Ma, S., Luo, J., & Ma, X. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581131 · Cited by 41 · see citing works
Salimzadeh, S., He, G., & Gadiraju, U. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641905 · Cited by 41 · see citing works
“Recent studies have explored variables that contribute to the fairness [31, 76, 124, 130] and trustworthiness [34, 48, 80, 139] of AI systems, as well as the impact of assigning different decision-making roles to humans and AI on the reliance on such systems [52, 103, 122, 144].”
BackgroundBalayn, A., Yurrita, M., Yang, J., & Gadiraju, U. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604674 · Cited by 40 · see citing works
Hou, T.-Y., Tseng, Y.-C., & Yuan, C. W. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102775 · Cited by 41 · see citing works
Chuan, C., Sun, R., Tian, S., & Tsai, W. S. (2024) · Telematics and Informatics · doi:10.1016/j.tele.2024.102135 · Cited by 37 · see citing works
Chen, C., & Sundar, S. S. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580805 · Cited by 38 · see citing works
Cai, F., Zhang, J., & Zhang, L. (2024) · Sustainability · doi:10.3390/su16093840 · Cited by 57 · see citing works
What Is Fair? Exploring the Artists’ Perspective on the Fairness of Music Streaming Platforms
Ferraro, A., Serra, X., & Bauer, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85616-8_33 · Cited by 3 · see citing works
Understanding Relations Between Perception of Fairness and Trust in Algorithmic Decision Making
Zhou, J., Verma, S., Mittal, M., & Chen, F. (2021) · 2021 8th International Conference on Behavioral and Social Computing (BESC) · doi:10.1109/besc53957.2021.9635182 · Cited by 36 · see citing works
Dimensions of Diversity in Human Perceptions of Algorithmic Fairness
Grgić-Hlača, N., Lima, G., Weller, A., & Redmiles, E. M. (2022) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3551624.3555306 · Cited by 44 · see citing works
Ghasemaghaei, M., & Kordzadeh, N. (2024) · Information Systems Journal · doi:10.1111/isj.12572 · Cited by 35 · see citing works
Perception of Fairness in Algorithmic Decisions: Future Developers' Perspective
Kleanthous, S., Kasinidou, M., Barlas, P., & Otterbacher, J. (2021) · Patterns · doi:10.1016/j.patter.2021.100380 · Cited by 33 · see citing works
Do Humans Prefer Debiased AI Algorithms? A Case Study in Career Recommendation
Wang, C., Wang, K., Bian, A., Islam, R., Keya, K. N., Foulds, J. R., & Pan, S. (2022) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3490099.3511108 · Cited by 28 · see citing works
Differential Fairness: An Intersectional Framework for Fair AI
Islam, R., Keya, K. N., Pan, S., Sarwate, A. D., & Foulds, J. R. (2023) · Entropy · doi:10.3390/e25040660 · Cited by 27 · see citing works
What’s the Appeal? Perceptions of Review Processes for Algorithmic Decisions
Lyons, H., Wijenayake, S., Miller, T., & Velloso, E. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517606 · Cited by 27 · see citing works
Tal, A. S., Kuflik, T., Kliger, D., & Mancini, A. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2348843 · Cited by 26 · see citing works
Ebrahimi, S., Abdelhalim, E., Hassanein, K., & Head, M. M. (2024) · European Journal of Information Systems · doi:10.1080/0960085x.2024.2395531 · Cited by 26 · see citing works
Schoeffer, J., & Kuehl, N. (2021) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3462204.3481742 · Cited by 24 · see citing works
Kaptchuk, G., Goldstein, D. G., Hargittai, E., Hofman, J. M., & Redmiles, E. M. (2021) · Digital Threats Research and Practice · doi:10.1145/3488307 · Cited by 21 · see citing works
van Berkel, N., Opie, J., Ahmad, O. F., Lovat, L. B., Stoyanov, D. V., & BLANDFORD, A. E. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3480247 · Cited by 22 · see citing works
Choi, D., Lee, U., & Hong, H. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517574 · Cited by 21 · see citing works
Ethical Issues in Near-Future Socially Supportive Smart Assistants for Older Adults
London, A. J., Razin, Y. S., Borenstein, J., Eslami, M., Perkins, R., & Robinette, P. (2023) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2023.3237124 · Cited by 24 · see citing works
Lyons, H., Miller, T., & Velloso, E. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594041 · Cited by 21 · see citing works
Navigating a Black Box: Students’ Experiences and Perceptions of Automated Hiring
Armstrong, L., Everson, J., & Ko, A. J. (2023) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3568813.3600123 · Cited by 26 · see citing works
Tang, X., Lima, G., Jiang, L., Simko, L., & Zou, Y. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710935 · Cited by 17 · see citing works
Knowledge and support for AI in the public sector: a deliberative poll experiment
Arnesen, S., Broderstad, T. S., Fishkin, J. S., Johannesson, M. P., & Siu, A. (2024) · AI & Society · doi:10.1007/s00146-024-02104-w · Cited by 23 · see citing works
Heterogeneity in Algorithm-Assisted Decision-Making: A Case Study in Child Abuse Hotline Screening
Cheng, L., & Chouldechova, A. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555101 · Cited by 23 · see citing works
Integrating Fairness in the Software Design Process: An Interview Study With HCI and ML Experts
Ryan, S., Nadal, C., & Doherty, G. J. (2023) · IEEE Access · doi:10.1109/access.2023.3260639 · Cited by 20 · see citing works
Gaba, A., Kaufman, Z., Cheung, J., Shvakel, M., Hall, K. W., Brun, Y., & Xiong, C. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3327192 · Cited by 21 · see citing works
Heterogeneity in Algorithm-Assisted Decision-Making: A Case Study in Child Abuse Hotline Screening
Cheng, L., & Chouldechova, A. (2022) · arXiv · doi:10.48550/arxiv.2204.05478 · Cited by 20 · see citing works
Algorithmic gender bias: investigating perceptions of discrimination in automated decision-making
Kim, S., Oh, P., & Lee, J. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2306484 · Cited by 21 · see citing works
Fairness and Trust in AI Decision-Making: The Role of Human Involvement and Outcome Favorability
Choung, H., David, P., Mahmud, H., & Norcutt, S. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2576634 · Cited by 19 · see citing works
Claure, H., Kim, S., Kizilcec, R. F., & Jung, M. F. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107628 · Cited by 21 · see citing works
Mok, L., Nanda, S., & Anderson, A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610100 · Cited by 19 · see citing works
User Perception of Fairness-Calibrated Recommendations
Alves, G., Jannach, D., Souza, R., & Manzato, M. G. (2024) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3627043.3659558 · Cited by 22 · see citing works
Robertson, S., & Salehi, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06718 · Cited by 18 · see citing works
Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation
Kim, S., & Priluck, R. (2025) · Journal of Theoretical and Applied Electronic Commerce Research · doi:10.3390/jtaer20020093 · Cited by 20 · see citing works
“Furthermore, the ability of AI chatbots to provide quick, complete, and direct answers to consumer queries is known to increase the perceived objectivity of the search results [71].”
ChatGPT as a Conversational Recommender System: A User-Centric Analysis
Manzoor, A., Ziegler, S. C., Garcia, K. M. P., & Jannach, D. (2024) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3627043.3659574 · Cited by 17 · see citing works
Metricizing the Euclidean Space Toward Desired Distance Relations in Point Clouds
Raß, S., König, S., Ahmad, S., & Goman, M. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3420246 · Cited by 17 · see citing works
Understanding User Perceptions of Trustworthiness in E-Recruitment Systems
Ogunniye, G., Legastelois, B., Rovatsos, M., Dowthwaite, L., Portillo, V., Vallejos, E. P., Zhao, J., & Jirotka, M. D. (2021) · IEEE Internet Computing · doi:10.1109/mic.2021.3115670 · Cited by 16 · see citing works
Jiang, L., Qin, X., Yam, K. C., Dong, X., Liao, W., & Chen, C. (2023) · PLoS ONE · doi:10.1371/journal.pone.0284840 · Cited by 19 · see citing works
Chen, C., & Sundar, S. S. (2024) · Human-Computer Interaction · doi:10.1080/07370024.2024.2392494 · Cited by 17 · see citing works
Kasinidou, M., Kleanthous, S., Orphanou, K., & Otterbacher, J. (2021) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3430665.3456311 · Cited by 19 · see citing works
The Role of Accuracy in Algorithmic Process Fairness Across Multiple Domains
Albach, M., & Wright, J. R. (2021) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3465456.3467620 · Cited by 15 · see citing works
Yu, J. H., Ma, Z., & Zhu, L. (2023) · Information Technology and People · doi:10.1108/itp-04-2022-0271 · Cited by 17 · see citing works
Pareek, S., Schömbs, S., Velloso, E., & Gonçalves, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713468 · Cited by 15 · see citing works
Lünich, M., Keller, B., & Marcinkowski, F. (2023) · Technology Knowledge and Learning · doi:10.1007/s10758-023-09698-y · Cited by 21 · see citing works
Applicants’ Fairness Perception of Human and AI Collaboration in Resume Screening
Ling, B., Dong, B., & Cai, F. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2437235 · Cited by 21 · see citing works
Schoeffer, J., Machowski, Y., & Kühl, N. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.134 · Cited by 16 · see citing works
A Study on Fairness and Trust Perceptions in Automated Decision MakingPreprint
Schoeffer, J., Machowski, Y., & Kuehl, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.04757 · Cited by 31 · see citing works
Paik, S., Novozhilova, E., Mays, K. K., & Katz, J. E. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00235-7 · Cited by 15 · see citing works
Utz, S., Wolfers, L. N., & Göritz, A. S. (2021) · Human-Machine Communication · doi:10.30658/hmc.3.3 · Cited by 12 · see citing works
Impact of Customer Perception of Value Co-Creation for Personalization in Online Shopping
Jensolin Abitha Kumari, J., & Gotmare, P. R. (2022) · International Journal of E-Business Research · doi:10.4018/ijebr.309388 · Cited by 12 · see citing works
Wang, L., & Zhu, H. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533147 · Cited by 13 · see citing works
Self-citationFair Machine Guidance to Enhance Fair Decision Making in Biased People
Yang, M., Arai, H., Yamashita, N., & Baba, Y. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642627 · Cited by 11 · see citing works
- Authors
- Wang, R., Harper, F. M., & Zhu, H.
- Affiliations
- Carnegie Mellon University (US)
- Amazon (United States) (US)
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-14
- OpenAlex
- W3029022080
- Semantic Scholar
- 6d847d92ed6efbcd322549f732c014e9bfb1c45d
- Cited by
- 211
- References
- 58
- Citations by year
- 2026: 30 · 2025: 37 · 2024: 37 · 2023: 34 · 2022: 36 · 2021: 34 · 2020: 3
- FWCI
- 27.75
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- National Science Foundation (IIS-2001851, IIS-2000782, IIS-1939606)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Keywords
- perceived fairness, algorithmic decision-making, algorithmic fairness, algorithmic bias, individual differences, user feedback, educational attainment, gender differences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review