Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability
Open accessThe DOI matches its Crossref record; 111 of the 114 references it cites were found in a registry or an index; 22 of the 48 sources its claims cite were checked for support.
Abstract
Recent research claims that information cues and system attributes of algorithmic decision-making processes affect decision subjects’ fairness perceptions. However, little is still known about how these factors interact. This paper presents a user study (N = 267) investigating the individual and combined effects of explanations, human oversight, and contestability on informational and procedural fairness perceptions for high- and low-stakes decisions in a loan approval scenario. We find that explanations and contestability contribute to informational and procedural fairness perceptions, respectively, but we find no evidence for an effect of human oversight. Our results further show that both informational and procedural fairness perceptions contribute positively to overall fairness perceptions but we do not find an interaction effect between them. A qualitative analysis exposes tensions between information overload and understanding, human involvement and timely decision-making, and accounting for personal circumstances while maintaining procedural consistency. Our results have important design implications for algorithmic decision-making processes that meet decision subjects’ standards of justice.
Overview
CoChat Summary
TL;DR
This preregistered user study (N=267) tests how explanations, human oversight, contestability, and task stakes affect informational, procedural, and overall fairness perceptions in a fictional loan approval scenario. Explanations increased informational fairness and contestability increased procedural fairness, while human oversight and task stakes showed no evidence of effects; informational and procedural fairness independently predicted overall fairness.
Key findings
- Explanations had a main effect on informational fairness perceptions: F(1, 260)=74.21, p<0.001, partial η²=0.22, BF₁₀>1000. Contestability had a main effect on procedural fairness perceptions: F(2, 254)=20.60, p<0.001, partial η²=0.14, BF₁₀>1000.
- No evidence supported effects of human oversight on procedural fairness: F(1, 254)=0.004, p=0.95, BF₀₁=7.43; nor task stakes moderating explanations on informational fairness: F(1, 260)=0.01, p=0.92, BF₀₁=7.44.
- Informational fairness (β=0.27, p<0.001) and procedural fairness (β=0.87, p<0.001) both predicted overall fairness in a regression model (R²=0.46, F(3, 263)=76.02, p<0.001), but their interaction was not significant (β=-0.09, p=0.07).
- Exploratory analyses found contestability mainly improved correctability (F(2, 254)=108.29, p<0.001, partial η²=0.46), yet procedural voice and outcome influence means remained below zero across all contestability conditions; human oversight slightly negatively affected process consistency and lack of bias.
Methods
- Preliminary study (N=58) selected explanation styles and contestation targets; main preregistered online study recruited 279 Prolific participants, with 267 retained after attention checks.
- Main study used a 2×2×3×2 between-subjects design in a fictional loan approval scenario, manipulating explanations (no/with), human oversight (no/with), contestability (no contest / contest initial decision with additional information / contest decision-maker), and task stakes (holiday loan vs. home loan).
- Dependent variables were informational, procedural, and overall fairness perceptions; analyses used multi-way ANOVAs, multiple linear regression, Bonferroni-corrected threshold p<0.0045, Bayesian tests, exploratory sub-element analyses, and reflexive thematic analysis of open-ended responses.
Limitations
- The paper states the between-subjects design may have prevented participants from comparing configurations, potentially diluting task-stakes and human-oversight effects; the scenario was close to the decision boundary; the third-person, one-shot, no-demographics design was chosen to reduce outcome favorability bias but may limit realism; findings are limited to a loan scenario; terminology may affect perceptions; participants were from the Global North with English proficiency, limiting representativeness.
- The paper also notes that using a fairness measurement tool designed for human decision-making may not capture algorithmic-specific concerns, such as the temporal dimension of decision-making, which participants valued in qualitative responses.
- Evident from the text: the study relies on a fictional loan scenario and Prolific sample, so results may not generalize to other decision contexts or populations.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
18 Valid · 1 Not valid · 19 Not checked · 101 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Our results (e.g., Q.13) suggest that providing decision subjects with information that goes beyond outcome explanations could support contestations that are not only limited to post-decision mechanisms but that apply to the system lifecycle as a whole [2].”
§ Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Efects of Explanations, Human Oversight, and Contestability > Implications.
What the sources say
- Partly supportedcites [2] matched to “Tensions in transparent urban AI: designing a smart electric vehicle charge point” (2023) sourceExperimental — accuracy not yet measured
In “Experts believe explanations are actionable by citizens” (page unavailable), the paper describes information about inputs, processes, outcomes, design, and ownership—not just decision outcomes. In the discussion of citizens’ responses (page unavailable), it proposes dialogue with designers, developers, and operators, but says information alone is insufficient without channels for citizens to voice disagreements. It does not establish that providing broader information would support contestation across the system lifecycle as a whole. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, contrary to our expectations, and to suggestions from earlier work [83], we did not fnd evidence that explanations moderate the efect of contestability on procedural fairness, i.e., help participants question structural aspects of the decision-making process such as the factors requested by the bank and how these are used.”
§ Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Efects of Explanations, Human Oversight, and Contestability > 6.1 Leveraging Transparency Beyond Outcome Explanations
What the sources say
- Supportedcites [83] matched to ““There Is Not Enough Information”: On the Effects of Explanations on Perceptions of Informational Fairness and Trustworthiness in Automated Decision-Making” (2022) source
The citing sentence presents the absence of a moderation effect as its authors’ own finding, contrary to suggestions from earlier work [83]; it does not attribute that null finding to this source. In §6.1 (p. 7), the source reports that learning which factors the system used raised participants’ questions about why those factors were considered and how they affected decisions, supporting the earlier-work suggestion. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Including humans in algorithmic decision-making processes costs time [20,29,68]”
§ Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Efects of Explanations, Human Oversight, and Contestability > 6.2 Designing Appropriate Human-AI Confgurations
What the sources say
- Not checked — no full text of the sourcecites [20] matched to “Task-Dependent Algorithm Aversion” (2019) source
- Could not verifycites [29] matched to “Algorithm aversion: People erroneously avoid algorithms after seeing them err.” (2015) sourceExperimental — accuracy not yet measured
The introduction (p. 1) contrasts human review with algorithmic forecasting, and the General Discussion (pp. 10–11) addresses algorithm aversion and forecasting accuracy. Neither addresses whether including humans in algorithmic decision-making costs time; searches for time and human involvement found no passage establishing that point. (LLM, conf=0.76)
- Not checked — no full text of the sourcecites [68] matched to “What’s the Appeal? Perceptions of Review Processes for Algorithmic Decisions” (2022) source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“There is evidence that suggests that decision subjects care about justice-related aspects in algorithmic decisionmaking, as they care in human decision-making [17].”
§ Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Efects of Explanations, Human Oversight, and Contestability > 6.4 Multi-dimensional Measurement of Fairness Perceptions
What the sources say
- Supportedcites [17] matched to “'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions” (2018) source
The Conclusion (p. 10) directly states that people consider justice-related aspects of algorithmic decision-making much as they do in manual decision-making. The claim preserves the paper’s tentative framing by saying the evidence “suggests” this. (LLM, conf=0.94)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Despite our promising fndings, using a tool that was designed for human decision-making to evaluate algorithmic decision-making may not encompass the unique challenges that the inclusion of algorithmic systems bring to existing processes (as it is the case for other felds such as human-agent collaboration [23]).”
§ Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Efects of Explanations, Human Oversight, and Contestability > 6.4 Multi-dimensional Measurement of Fairness Perceptions
What the sources say
- Supportedcites [23] matched to “Designing Human-Agent Collaborations: Commitment, responsiveness, and support” (2022) source
The citation supports the parenthetical analogy to human-agent collaboration, not a claim that Cila evaluated a decision-making tool. In the Discussion, Cila questions how far a framework for human-human collaboration transfers to human-agent collaboration and identifies distinct practical and ethical challenges. (LLM, conf=0.90)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
68 more claims · 2 with their cited sources checked
Create a free account to see all 139 claims and every source verdict.
- Probably not a substantial claim. 56
- It may state two separate claims as one. 19
- The quote only partly states this claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Other explanation methods, such as LIME or Shapley values, are also commonly discussed as potentially fostering contestability (Mulligan, Kluttz, and Kohli 2019;Yurrita et al. 2023).”
From Explainable AI Isn't Enough! Rethinking Algorithmic Contestability (2026) · cites this paper as Yurrita et al. 2023
Experimental — accuracy not yet measured
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971 · cited 2×
“We computed the required sample size using the software G*Power [34] for an ANOVA with main efects and interactions; specifying the default efect size of 0.”
MethodInfluentialAdams, J. S. (1965) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60108-2 · Cited by 10,818 · cited 2×
“, distributive fairness perceptions) [1, 28], the nature of the process that leads to those decisions (i.”
BackgroundThe Social Psychology of Procedural Justice
Lind, E. A., & Tyler, T. R. (1988) · Critical Issues in Social Justice · doi:10.1007/978-1-4899-2115-4 · Cited by 6,585 · cited 2×
“, procedural fairness perceptions) [62, 64, 89], the treatment received by decision subjects (i.”
BackgroundOn the dimensionality of organizational justice: A construct validation of a measure.
Colquitt, J. A. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.386 · Cited by 4,114 · cited 6×
“For instance, the approach suggested by Colquitt [24] does not explicitly include the temporal dimension of the decision-making process as an attribute that contributes to perceptions of procedural fairness.”
BackgroundMethodInfluentialOrganizational Justice: Yesterday, Today, and Tomorrow
Greenberg, J. (1990) · Journal of Management · doi:10.1177/014920639001600208 · Cited by 3,651 · cited 2×
“Studies dealing with procedural fairness in human decision-making processes [39, 89] demonstrated that participants with a strong infuence over the decision-making process were more likely to perceive a negative outcome as fair [47].”
BackgroundDwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501 · cited 1×
“Motivated by concerns about bias and discrimination in algorithmic decision-making [73], recent work has developed fairness-aware algorithmic systems [6, 33, 108] that ensure outcome distribution equity [32, 42].”
BackgroundAlgorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Doyle, T. (2017) · The Information Society · doi:10.1080/01972243.2017.1354593 · Cited by 3,071
What Should Be Done with Equity Theory?
Leventhal, G. S. (1980) · Social Exchange · doi:10.1007/978-1-4613-3087-5_2 · Cited by 3,010 · cited 7×
“, explanations, human oversight, contestability) that we manipulate in our experimental setting have been related to perceptions of informational and procedural fairness in human decision-making [62, 85], we capture perceptions of fairness across those two dimensions.”
BackgroundMethodInfluentialCaldeira, G. A., Thibaut, J., Walker, L., & Nagel, S. S. (1976) · The Western Political Quarterly · doi:10.1177/106591297602900424 · Cited by 2,944
Procedural Justice: A Psychological Analysis
Caldeira, G. A., Thibaut, J., Walker, L., & Nagel, S. S. (1976) · The Western Political Quarterly · doi:10.2307/448155 · Cited by 2,907
Interactional justice : communication criteria of fairness
Bies, R. (1986) · Medical Entomology and Zoology · Cited by 2,761
Deutsch, M. (1975) · Journal of Social Issues · doi:10.1111/j.1540-4560.1975.tb01000.x · Cited by 2,745 · cited 2×
“, distributive fairness perceptions) [1, 28], the nature of the process that leads to those decisions (i.”
BackgroundEquality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · cited 1×
“Motivated by concerns about bias and discrimination in algorithmic decision-making [73], recent work has developed fairness-aware algorithmic systems [6, 33, 108] that ensure outcome distribution equity [32, 42].”
BackgroundA Taxonomy of Organizational Justice Theories
Greenberg, J. (1987) · The Academy of Management Review · doi:10.2307/257990 · Cited by 2,284
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245 · cited 1×
“However, moving towards algorithmic decision-making processes that enhance decision subjects’ feelings of justice requires that empirical studies are part of broader eforts to create methodological tools that consider diferent stakeholders’ (including decision subjects) viewpoints in the design and evaluation processe…”
BackgroundAlgorithm appreciation: People prefer algorithmic to human judgment
Logg, J. M., Minson, J. A., & Moore, D. A. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.005 · Cited by 2,061
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015
Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859
Bayesian Cognitive Modeling: A Practical Course
Lee, M. D., & Wagenmakers, E.-J. (2014) · doi:10.1017/cbo9781139087759 · Cited by 1,795
(2020) · doi:10.7551/mitpress/12255.001.0001 · Cited by 1,706
Task-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., & Lehmann, D. R. (2019) · Journal of Marketing Research · doi:10.1177/0022243719851788 · Cited by 1,500 · cited 3×
“Algorithmic systems were viewed as lacking subjective judgment capabilities for considering individual circumstances (in line with previous studies [20, 58, 70]) (Q.”
BackgroundResultTask-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., Bos, M. W., Lehmann, D. R., & Lehmann, D. R. (2019) · Springer eBooks · doi:10.1007/978-3-031-88067-4_21 · Cited by 1,441
Mitigating Unwanted Biases with Adversarial Learning
Zhang, B. H., Lemoine, B., & Mitchell, M. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278779 · Cited by 1,387 · cited 1×
“Motivated by concerns about bias and discrimination in algorithmic decision-making [73], recent work has developed fairness-aware algorithmic systems [6, 33, 108] that ensure outcome distribution equity [32, 42].”
BackgroundLee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338 · cited 10×
“1 Perceptions of unfairness could, in turn, jeopardize end users’ trust in normatively fair algorithmic decision-making processes and, therefore, be an obstacle for their broader acceptance [31, 58, 72, 96, 103].”
BackgroundInfluentialCounterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
In AI we trust? Perceptions about automated decision-making by artificial intelligence
Araujo, T., Helberger, N., Kruikemeier, S., & de Vreese, C. H. (2020) · AI & SOCIETY · doi:10.1007/s00146-019-00931-w · Cited by 1,038
What is Procedural Justice?: Criteria Used by Citizens to Assess the Fairness of Legal Procedures
Tyler, T. R. (1988) · Law & Society Review · doi:10.2307/3053563 · Cited by 912 · cited 1×
“Drawing from literature in legal and organizational psychology for human decision-making [8, 13, 15, 16, 38, 40, 90] and studies on perceptions of fairness in algorithmic systems [9, 41, 58, 72, 80, 83, 93, 96, 103], we formulated eleven hypotheses (Figure 1).”
Designing Theory-Driven User-Centric Explainable AI
Wang, D., Yang, Q., Abdul, A., & Lim, B. Y. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300831 · Cited by 906 · cited 1×
“For example, these could include videos [93], stories [93], or comics [102, 104].”
BackgroundFranke, T., Attig, C., & Wessel, D. (2019) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1456150 · Cited by 828
Interactional fairness judgments: The influence of causal accounts
Bies, R. J., & Shapiro, D. L. (1987) · Social Justice Research · doi:10.1007/bf01048016 · Cited by 780 · cited 1×
“Drawing from literature in legal and organizational psychology for human decision-making [8, 13, 15, 16, 38, 40, 90] and studies on perceptions of fairness in algorithmic systems [9, 41, 58, 72, 80, 83, 93, 96, 103], we formulated eleven hypotheses (Figure 1).”
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728 · cited 1×
“with algorithmic systems and distilling the efect on trust [75, 81] or trust-related constructs [100] such as reliance [77, 109].”
BackgroundManipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Vaughan, J. W., & Wallach, H. (2018) · arXiv · doi:10.48550/arxiv.1802.07810 · Cited by 711
'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions
Binns, R., Van Kleek, M., Veale, M., Lyngs, U., Zhao, J., & Shadbolt, N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173951 · Cited by 691
Meaningful information and the right to explanation
Selbst, A. D., & Powles, J. (2017) · International Data Privacy Law · doi:10.1093/idpl/ipx022 · Cited by 516 · cited 5×
“Although decision subjects’ right to explanation is not explicitly guaranteed by the GDPR [84], Article 22(3) does explicitly guarantee their right to contest a negative decision [101], for which decision subjects need meaningful (i.”
BackgroundInfluentialActionable Recourse in Linear Classification
Ustun, B., Spangher, A., & Liu, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287566 · Cited by 501
Advances in Experimental Social Psychology, Vol. 19
Fine, G. A., & Berkowitz, L. (1987) · Contemporary Sociology · doi:10.2307/2070758 · Cited by 458
Explanations: What Factors Enhance Their Perceived Adequacy?
Shapiro, D. L., Buttner, E. H., & Barry, B. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1041 · Cited by 378 · cited 3×
“, explanations, human oversight, contestability) that we manipulate in our experimental setting have been related to perceptions of informational and procedural fairness in human decision-making [62, 85], we capture perceptions of fairness across those two dimensions.”
BackgroundInterpretable Counterfactual Explanations Guided by Prototypes
Van Looveren, A., & Klaise, J. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-86520-7_40 · Cited by 346 · cited 1×
“Contestability has, thus, been conceptualized as recourse [48, 91, 98], appeal [99], and as a design principle (i.”
BackgroundA Survey of Algorithmic Recourse: Contrastive Explanations and Consequential Recommendations
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2023) · ACM Computing Surveys · doi:10.1145/3527848 · Cited by 301 · cited 1×
“, [50, 87]), for this preliminary study, we do not limit contestability to recourse and inquire whether participants would question other aspects of the decisionmaking process.”
BackgroundExplaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders
Cheng, H.-F., Wang, R., Zhang, Z., O'Connell, F., Gray, T., Harper, F. M., & Zhu, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300789 · Cited by 292
Explaining models: an empirical study of how explanations impact fairness judgment
Dodge, J., Liao, Q. V., Zhang, Y., Bellamy, R. K. E., & Dugan, C. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302310 · Cited by 286
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012429 · Cited by 284
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277 · cited 1×
“20), suggesting that future explanations should also account for decision subjects’ imaginaries [69] and expectations [54] around algorithmic systems.”
BackgroundAlgorithmic recourse: From counterfactual explanations to interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445899 · Cited by 274
Transcending Boundaries: Improvisation and Disability in Dance
Whatley, S. (2019) · Pure (Coventry University) · doi:10.1093/oxfordhb · Cited by 265
Interactional, Formal, and Distributive Justice in the Workplace: An Exploratory Study
Barling, J., & Phillips, M. (1993) · The Journal of Psychology · doi:10.1080/00223980.1993.9914904 · Cited by 230 · cited 1×
“Drawing from literature in legal and organizational psychology for human decision-making [8, 13, 15, 16, 38, 40, 90] and studies on perceptions of fairness in algorithmic systems [9, 41, 58, 72, 80, 83, 93, 96, 103], we formulated eleven hypotheses (Figure 1).”
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Lee, M. K., Jain, A., Cha, H. J., Ojha, S., & Kusbit, D. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359284 · Cited by 223 · cited 2×
“Further research is necessary to translate those conceptualizations into actual design guidelines [2, 60] and validate designs of contestable algorithmic systems.”
BackgroundWang, R., Harper, F. M., & Zhu, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376813 · Cited by 211
Uncovering and Mitigating Algorithmic Bias through Learned Latent Structure
Amini, A., Soleimany, A. P., Schwarting, W., Bhatia, S. N., & Rus, D. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314243 · Cited by 206
Lee, M. K., & Baykal, S. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998230 · Cited by 182
Srivastava, M., Heidari, H., & Krause, A. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330664 · Cited by 179 · cited 4×
“, [68, 103]) we decided to tell this story in the third person [9, 83, 86] with no reference to the individuals’ personal characteristics.”
BackgroundMethodInfluentialRaji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · arXiv · doi:10.48550/arxiv.2001.00973 · Cited by 179
Jordan, R. (2023) · Technical Communication Quarterly · doi:10.1080/10572252.2022.2130671 · Cited by 178
Contestable AI by Design: Towards a Framework
Alfrink, K., Keller, I., Kortuem, G., & Doorn, N. (2022) · Minds and Machines · doi:10.1007/s11023-022-09611-z · Cited by 169 · cited 2×
“Contestability is said to “surface values” [92] and to be a “form of procedural justice, a way of giving voice to decision subjects, which increases perceptions of fairness” [3].”
BackgroundThe impact of using algorithms for managerial decisions on public employees' procedural justice
Nagtegaal, R. (2021) · Government Information Quarterly · doi:10.1016/j.giq.2020.101536 · Cited by 166 · cited 9×
“are perceived to require human skills [58, 70].”
BackgroundResultInfluentialDesigning for Responsible Trust in AI Systems: A Communication Perspective
Liao, Q. V., & Sundar, S. S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533182 · Cited by 165 · cited 1×
“, information cues [63] such as explanations [17, 30, 71, 83] and system attributes [63] such as human oversight2 [29, 65, 66, 70, 103] or contestability [68, 93] – efectively contribute to decision subjects’ fairness perceptions.”
BackgroundWhen computers take the lead: The automation of leadership
Wesche, J. S., & Sonderegger, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.07.027 · Cited by 157 · cited 1×
“Since algorithmic systems can perform increasingly complex tasks [106], recent research has pointed to opportunities for crafting more reliable and timely decision-making processes with human-artifcial intelligence (AI) collaborations [12, 109].”
BackgroundSaxena, N. A., Huang, K., DeFilippis, E., Radanovic, G., Parkes, D. C., & Liu, Y. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314248 · Cited by 155
Measuring Justice and Fairness
Cropanzano, R. S., Ambrose, M. L., Colquitt, J. A., & Rodell, J. B. (2015) · The Oxford Handbook of Justice in the Workplace · doi:10.1093/oxfordhb/9780199981410.013.8 · Cited by 147
Lee, M. K., & Rich, K. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445570 · Cited by 145 · cited 1×
“Thus, we acknowledge that our study is subject to representativeness limitations [61].”
BackgroundPanigutti, C., Beretta, A., Giannotti, F., & Pedreschi, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502104 · Cited by 126 · cited 1×
“with algorithmic systems and distilling the efect on trust [75, 81] or trust-related constructs [100] such as reliance [77, 109].”
BackgroundSuresh, H., Gomez, S. R., Nam, K. K., & Satyanarayan, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445088 · Cited by 117 · cited 1×
“Such strategies should be adapted to decision subjects’ insight needs [88] and designed in a way that they would understand [11, 52].”
BackgroundThe philosophical basis of algorithmic recourse
Venkatasubramanian, S., & Alfano, M. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372876 · Cited by 114 · cited 2×
“Contesting a decision has been defned as the act of opposing an action; either because the action is perceived as mistaken or simply wrong [4, 99].”
BackgroundDesigning Contestability: Interaction Design, Machine Learning, and Mental Health
Hirsch, T., Merced, K., Narayanan, S., Imel, Z. E., & Atkins, D. C. (2017) · Proceedings of the 2017 Conference on Designing Interactive Systems · doi:10.1145/3064663.3064703 · Cited by 110
Suresh, H., Gomez, S. R., Nam, K. K., & Satyanarayan, A. (2021) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 103
Anik, A. I., & Bunt, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445736 · Cited by 103 · cited 1×
“For instance, previous studies have shown that data-centric explanations [7] have the potential to assist users in assessing fairness.”
ResultFaiRecSys: mitigating algorithmic bias in recommender systems
Edizel, B., Bonchi, F., Hajian, S., Panisson, A., & Tassa, T. (2019) · International Journal of Data Science and Analytics · doi:10.1007/s41060-019-00181-5 · Cited by 102 · cited 1×
“Motivated by concerns about bias and discrimination in algorithmic decision-making [73], recent work has developed fairness-aware algorithmic systems [6, 33, 108] that ensure outcome distribution equity [32, 42].”
BackgroundVaccaro, K., Sandvig, C., & Karahalios, K. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415238 · Cited by 102 · cited 5×
“, [93]) actually contribute to these perceptions.”
BackgroundInfluentialRelationships among pay inequity, perceptions of procedural justice, and organizational citizenship
Aquino, K. F. (1995) · Employee Responsibilities and Rights Journal · doi:10.1007/bf02621253 · Cited by 99 · cited 1×
“Drawing from literature in legal and organizational psychology for human decision-making [8, 13, 15, 16, 38, 40, 90] and studies on perceptions of fairness in algorithmic systems [9, 41, 58, 72, 80, 83, 93, 96, 103], we formulated eleven hypotheses (Figure 1).”
Human intervention in automated decision-making: Toward the construction of contestable systems
Almada, M. (2019) · Proceedings of the Seventeenth International Conference on Artificial Intelligence and Law · doi:10.1145/3322640.3326699 · Cited by 95 · cited 6×
“We echo Almada [5] and suggest that comparative measures of performance of human-controlled and”
BackgroundMethodResultInfluentialJoshi, S. D., Koyejo, S., Vijitbenjaronk, W. D., Kim, B., & Ghosh, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09615 · Cited by 90 · cited 1×
“Contestability has, thus, been conceptualized as recourse [48, 91, 98], appeal [99], and as a design principle (i.”
Background”Because AI is 100% right and safe”: User Attitudes and Sources of AI Authority in India
Kapania, S., Siy, O., Clapper, G., SP, A. M., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517533 · Cited by 90 · cited 4×
“Previous work has shown that cultural and geographical differences play a key role in perceptions towards algorithmic systems [10, 49, 97].”
BackgroundMethodInfluentialYou Complete Me: Human-AI Teams and Complementary Expertise
Zhang, Q., Lee, M. L., & Carter, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517791 · Cited by 85 · cited 3×
“A follow-up study to ours could test perceptions towards human decision-making processes that are advised by algorithmic systems [12, 109] rather than algorithmic decision-making processes that are overseen by humans.”
BackgroundEffect of Information Presentation on Fairness Perceptions of Machine Learning Predictors
van Berkel, N., Goncalves, J., Russo, D., Hosio, S., & Skov, M. B. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445365 · Cited by 84
When Do People Want AI to Make Decisions?
Kramer, M. F., Schaich Borg, J., Conitzer, V., & Sinnott-Armstrong, W. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278752 · Cited by 83 · cited 2×
“[55] showed that preferences towards humans vs.”
BackgroundContestability For Content Moderation
Vaccaro, K., Xiao, Z., Hamilton, K., & Karahalios, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476059 · Cited by 77 · cited 2×
“[94], can help deal with the trade-ofs identifed in our qualitative analysis.”
BackgroundResultAlgorithmic Recourse: from Counterfactual Explanations to Interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2020) · arXiv · doi:10.48550/arxiv.2002.06278 · Cited by 76
Beyond explainability: justifiability and contestability of algorithmic decision systems
Henin, C., & Le Métayer, D. (2022) · AI & SOCIETY · doi:10.1007/s00146-021-01251-8 · Cited by 71 · cited 2×
“These fndings further suggest that contestations might be better designed as dialogues [44, 53], rather than mere appeal processes.”
BackgroundToward involving end-users in interactive human-in-the-loop AI fairness
Nakao, Y., Stumpf, S., Ahmed, S., Naseer, A., & Strappelli, L. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3514258 · Cited by 69
Schoeffer, J., Kuehl, N., & Machowski, Y. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533218 · Cited by 67 · cited 10×
“[83] found that outcome explanations would increase end users’ perceptions of informational fairness, but it would make them question structural aspects of the procedure, just as it was claimed by Greenberg [40] for human decision-making.”
BackgroundMethodResultInfluentialPan, C. A., Yakhmi, S., Iyer, T. P., Strasnick, E., Zhang, A. X., & Bernstein, M. S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512929 · Cited by 66 · cited 5×
“human counterparts [9, 20, 29, 36, 55, 58, 65, 74] rather than comparing fully automated with hybrid confgurations.”
BackgroundInfluentialDesigning Human-Agent Collaborations: Commitment, responsiveness, and support
Cila, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517500 · Cited by 65 · cited 1×
“for other felds such as human-agent collaboration [23]).”
BackgroundLanger, M., Hunsicker, T., Feldkamp, T., König, C. J., & Grgić-Hlača, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517527 · Cited by 55
Contestability in Algorithmic Systems
Vaccaro, K., Karahalios, K., Mulligan, D. K., Kluttz, D., & Hirsch, T. (2019) · Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3311957.3359435 · Cited by 54 · cited 1×
“Contestability is said to “surface values” [92] and to be a “form of procedural justice, a way of giving voice to decision subjects, which increases perceptions of fairness” [3].”
Backgroundvan Berkel, N., Papachristos, E., Giachanou, A., Hosio, S., & Skov, M. B. (2020) · Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society · doi:10.1145/3419249.3420106 · Cited by 51
Perception of Fairness in Algorithmic Decisions: Future Developers' Perspective
Kleanthous, S., Kasinidou, M., Barlas, P., & Otterbacher, J. (2021) · Patterns · doi:10.1016/j.patter.2021.100380 · Cited by 48 · cited 1×
“Such strategies should be adapted to decision subjects’ insight needs [88] and designed in a way that they would understand [11, 52].”
BackgroundOK computer: Worker perceptions of algorithmic recruitment
Fumagalli, E., Rezaei, S., & Salomons, A. (2022) · Research Policy · doi:10.1016/j.respol.2021.104420 · Cited by 46 · cited 2×
“human counterparts [9, 20, 29, 36, 55, 58, 65, 74] rather than comparing fully automated with hybrid confgurations.”
BackgroundData Comics for Reporting Controlled User Studies in Human-Computer Interaction
Wang, Z., Ritchie, J., Zhou, J., Chevalier, F., & Bach, B. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030433 · Cited by 42 · cited 1×
“For example, these could include videos [93], stories [93], or comics [102, 104].”
BackgroundWhat You See Is What You Get? The Impact of Representation Criteria on Human Bias in Hiring
Peng, A., Nushi, B., Kıcıman, E., Inkpen, K., Suri, S., & Kamar, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5281 · Cited by 41 · cited 1×
“For instance, algorithmic systems could access large quantities of data and perform preliminary analyses to produce easily digestible summaries for human experts to make fnal decisions [76].”
BackgroundTowards a multi-stakeholder value-based assessment framework for algorithmic systems
Yurrita, M., Murray-Rust, D., Balayn, A., & Bozzon, A. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533118 · Cited by 39 · cited 1×
“However, moving towards algorithmic decision-making processes that enhance decision subjects’ feelings of justice requires that empirical studies are part of broader eforts to create methodological tools that consider diferent stakeholders’ (including decision subjects) viewpoints in the design and evaluation processe…”
BackgroundSelf-citationUnderstanding Relations Between Perception of Fairness and Trust in Algorithmic Decision Making
Zhou, J., Verma, S., Mittal, M., & Chen, F. (2021) · 2021 8th International Conference on Behavioral and Social Computing (BESC) · doi:10.1109/besc53957.2021.9635182 · Cited by 36
Mulligan, D. K., Kluttz, D., & Kohli, N. (2019) · doi:10.2139/ssrn.3311894 · Cited by 32 · cited 1×
“These fndings further suggest that contestations might be better designed as dialogues [44, 53], rather than mere appeal processes.”
BackgroundWhat’s the Appeal? Perceptions of Review Processes for Algorithmic Decisions
Lyons, H., Wijenayake, S., Miller, T., & Velloso, E. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517606 · Cited by 27 · cited 10×
“, when users are given the right to contest the decision-maker [68]) on users’ procedural fairness perceptions.”
BackgroundResultInfluentialCalibrating Human-AI Collaboration: Impact of Risk, Ambiguity and Transparency on Algorithmic Bias
Schmidt, P., & Biessmann, F. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-57321-8_24 · Cited by 26 · cited 1×
“with algorithmic systems and distilling the efect on trust [75, 81] or trust-related constructs [100] such as reliance [77, 109].”
BackgroundAI beyond Deus ex Machina – Reimagining Intelligence in Future Cities with Urban Experts
Mlynar, J., Bahrami, F., Ourednik, A., Mutzner, N., Verma, H., & Alavi, H. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517502 · Cited by 26 · cited 1×
“20), suggesting that future explanations should also account for decision subjects’ imaginaries [69] and expectations [54] around algorithmic systems.”
BackgroundSarra, C. (2020) · Global Jurist · doi:10.1515/gj-2020-0003 · Cited by 24 · cited 5×
“and counterfactual explanations because these included descriptions of the “how” and a justifcation of the “why” of decisions, as suggested by Sarra [79].”
BackgroundInfluentialSchoeffer, J., & Kuehl, N. (2021) · Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3462204.3481742 · Cited by 24
Understanding Relations Between Perception of Fairness and Trust in Algorithmic Decision Making
Zhou, J.-L., Verma, S., Mittal, M., & Chen, F. (2021) · International Conference on Behavioral, Economic, and Socio-Cultural Computing · doi:10.48550/arxiv.2109.14345 · Cited by 24
A Bird’s Eye View on EU Anti-Discrimination Law: The Impact of the 2000 Equality Directives
Belavusau, U., & Henrard, K. (2019) · German Law Journal · doi:10.1017/glj.2019.53 · Cited by 23 · cited 2×
“in our main study because it is explicitly protected by law [14].”
BackgroundMethodFrom Explanation to Recommendation: Ethical Standards for Algorithmic Recourse
Sullivan, E., & Verreault-Julien, P. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534185 · Cited by 23 · cited 1×
“, [50, 87]), for this preliminary study, we do not limit contestability to recourse and inquire whether participants would question other aspects of the decisionmaking process.”
BackgroundUnderstanding User Perceptions of Trustworthiness in E-Recruitment Systems
Ogunniye, G., Legastelois, B., Rovatsos, M., Dowthwaite, L., Portillo, V., Vallejos, E. P., Zhao, J., & Jirotka, M. D. (2021) · IEEE Internet Computing · doi:10.1109/mic.2021.3115670 · Cited by 20 · cited 4×
“Drawing from literature in legal and organizational psychology for human decision-making [8, 13, 15, 16, 38, 40, 90] and studies on perceptions of fairness in algorithmic systems [9, 41, 58, 72, 80, 83, 93, 96, 103], we formulated eleven hypotheses (Figure 1).”
BackgroundInfluentialDisparate Impact Diminishes Consumer Trust Even for Advantaged Users
Draws, T., Szlávik, Z., Timmermans, B., Tintarev, N., Varshney, K. R., & Hind, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-79460-6_11 · Cited by 18 · cited 1×
“1 Perceptions of unfairness could, in turn, jeopardize end users’ trust in normatively fair algorithmic decision-making processes and, therefore, be an obstacle for their broader acceptance [31, 58, 72, 96, 103].”
BackgroundSelf-citationTensions in transparent urban AI: designing a smart electric vehicle charge point
Alfrink, K., Keller, I., Doorn, N., & Kortuem, G. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01436-9 · Cited by 18 · cited 2×
“Further research is necessary to translate those conceptualizations into actual design guidelines [2, 60] and validate designs of contestable algorithmic systems.”
BackgroundA New Dimension of Organizational Justice: Procedural Voice
Jepsen, D. M., & Rodwell, J. (2009) · Psychological Reports · doi:10.2466/pr0.105.2.411-426 · Cited by 17 · cited 1×
“Studies dealing with procedural fairness in human decision-making processes [39, 89] demonstrated that participants with a strong infuence over the decision-making process were more likely to perceive a negative outcome as fair [47].”
BackgroundSpeed of Decision-Making as a Procedural Justice Principle
Valkeapää, A., & Seppälä, T. (2014) · Social Justice Research · doi:10.1007/s11211-014-0214-6 · Cited by 16 · cited 2×
“Each of these dimensions evokes diferent justice principles and is built upon criteria that have been found to be relevant for that dimension [95].”
BackgroundBoykin, C. M., Dasch, S. T., Rice, V., Lakshminarayanan, V. R., Togun, T. A., & Brown, S. M. (2021) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3465416.3483302 · Cited by 11 · cited 1×
“We echo the need to include lessons from the replication crisis within psychology [18] and advocate for a multi-dimensional approach to measuring perceptions of fairness (i.”
BackgroundGemalmaz, M. A., & Yin, M. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534201 · Cited by 10 · cited 2×
“Previous research has shown that under repeated interactions with algorithmic decisionmaking systems, decision subjects’ fairness perceptions are afected by the favorability of the system towards the group that the decision subjects belong to [37].”
BackgroundCropanzano, R. (2012) · Psychology Press eBooks · doi:10.4324/9781410600301 · Cited by 7
Conceptualising Contestability: Perspectives on Contesting Algorithmic Decisions
Lyons, H., Velloso, E., & Miller, T. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449180 · Cited by 4
Almada, M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3264189 · Cited by 4
Towards Involving End-users in Interactive Human-in-the-loop AI FairnessPreprint
Nakao, Y., Stumpf, S., Ahmed, S., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.10464 · Cited by 4
Research works printed but not linked: 9
- Kars Alfrink, T. Turel, A. I. Keller, N. Doorn, and G. W. Kortuem. 2020. Con- testable City Algorithms. International Conference on Machine Learning Work- shop.
- Simone Bae, Reeva Lederman, and Tingru Cui. 2022. Understanding User Perception of Explainable Algorithmic Decision-Making Systems: A Systematic Literature Review. (2022).
- David Chan. 2011. Perceptions of fairness. Research Collection School of Social Sciences (2011).
- Nina Grgic-Hlaca, Muhammad Bilal Zafar, Krishna P. Gummadi, and Adrian Weller. 2016. The Case for Process Fairness in Learning: Feature Selection for Fair Decision Making. In NIPS SYMPOSIUM ON MACHINE LEARNING AND THE LAW 8.
- 10.5555/3157382.3157469 · doi:10.5555/3157382.3157469
- 10.1093/jcr · doi:10.1093/jcr
- Cathy O'neil. 2016. Weapons of math destruction: How big data increases in- equality and threatens democracy. Broadway Books.
- 10.1093/idpl · doi:10.1093/idpl
- Elizabeth Anne Watkins. 2021. The tension between information justice and security: Perceptions of facial recognition targeting.. In Joint Proceedings of the ACM IUI 2021 Workshops.
Cited by
Deng, W. H., Yildirim, N., Chang, M., Eslami, M., Holstein, K., & Madaio, M. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594037 · Cited by 57
“tools and processes supporting mixed-method evaluation and development for AI fairness could potentially re-shape the quantification culture around AI development that runs the risk of compromising the socio-technical, contested nature of AI fairness [32, 34, 77, 98].”
BackgroundTransparency in AI for emergency management: building trust and accountability
Visave, J. (2025) · AI and Ethics · doi:10.1007/s43681-025-00692-x · Cited by 77
Karusala, N., Upadhyay, S., Veeraraghavan, R., & Gajos, K. Z. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641898 · Cited by 61
“They and other researchers suggest that reflections on how algorithms were designed and why, decision-making flows, and known limitations could support scrutiny and protective action [17, 39, 109, 110].”
BackgroundInfluentialVereschak, O., Alizadeh, F., Bailly, G., & Caramiaux, B. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642018 · Cited by 72
Ghasemaghaei, M., & Kordzadeh, N. (2024) · Information Systems Journal · doi:10.1111/isj.12572 · Cited by 46
“Research across these fields has extensively examined the root causes and potential remedies for unfairness in algorithms, as well as their impacts on fairness perceptions and decision-making, often emphasising individual-level effects of algorithmic outputs (Yurrita et al. 2023).”
Metadata
- Authors
- Yurrita, M., Draws, T., Balayn, A., Murray-Rust, D., Tintarev, N., & Bozzon, A.
- Affiliations
- Delft University of Technology (NL)
- Maastricht University (NL)
- Venue
- Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2023-04-19
- Pages
- 1-21
- OpenAlex
- W4366549927
- Cited by
- 108
- References
- 106
- Citations by year
- 2026: 39 · 2025: 35 · 2024: 28 · 2023: 6
- FWCI
- 12.13
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Research Publications (Maastricht University) (publishedVersion, cc-by)
- Research Repository (Delft University of Technology) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- Funders
- European Commission (HORIZON2020, COVID-19, 101016233, 955990)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- algorithmic decision-making, perceived fairness, algorithmic explanations, human oversight, contestability, informational fairness, procedural justice, lending, high-stakes decisions, information overload
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.