CoChat
Sign Up
PreprintCited by 1Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)AI and HR Technologies

Human-in-the-loop Fairness: Integrating Stakeholder Feedback to Incorporate Fairness Perspectives in Responsible AI

Open access
Taka, Evdoxia, Nakao, Yuri, Sonoda, Ryosuke, Yokota, Takuya, Luo, Lin, Stumpf, Simone·2023·arXiv
DOI 10.48550/arxiv.2312.08064arXiv 2312.08064
Open this paper in CoChat — free accountOpen PDF

Abstract

Fairness is a growing concern for high-risk decision-making using Artificial Intelligence (AI) but ensuring it through purely technical means is challenging: there is no universally accepted fairness measure, fairness is context-dependent, and there might be conflicting perspectives on what is considered fair. Thus, involving stakeholders, often without a background in AI or fairness, is a promising avenue. Research to directly involve stakeholders is in its infancy, and many questions remain on how to support stakeholders to feedback on fairness, and how this feedback can be integrated into AI models. Our work follows an approach where stakeholders can give feedback on specific decision instances and their outcomes with respect to their fairness, and then to retrain an AI model. In order to investigate this approach, we conducted two studies of a complex AI model for credit rating used in loan applications. In study 1, we collected feedback from 58 lay users on loan application decisions, and conducted offline experiments to investigate the effects on accuracy and fairness metrics. In study 2, we deepened this investigation by showing 66 participants the results of their feedback with respect to fairness, and then conducted further offline analyses. Our work contributes two datasets and associated code frameworks to bootstrap further research, highlights the opportunities and challenges of employing lay user feedback for improving AI fairness, and discusses practical implications for developing AI applications that more closely reflect stakeholder views about fairness.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2312.08064

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Participatory fairness approaches aim to uncover concerns that would not be visible to system developers and ensure that the legitimacy of these systems is established among these social groups.

    “By providing formal channels through which stakeholders can contribute, participatory fairness approaches aim to uncover concerns that would not be visible to system developers and ensure that the legitimacy of these systems is established among these social groups.”

    From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [63]

    The Introduction and §5.2 say stakeholder feedback brings diverse fairness perspectives into decisions and can reveal concerns beyond the attributes developers typically measure. The paper does not say that these approaches establish the systems’ legitimacy among social groups; that part of the attributed claim is unsupported. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • Taka et al. developed methods for integrating stakeholder feedback to incorporate fairness perspectives in responsible AI development.

    “Taka et al. developed methods for integrating stakeholder feedback to incorporate fairness perspectives in responsible AI development [63].”

    From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [63]

  • Fairness concerns are rooted in social contexts and cannot be fully specified by system developers in a vacuum.

    “This approach recognizes that fairness concerns are rooted in social contexts and cannot be fully specified by system developers in a vacuum.”

    From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [63]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 83

  1. J Stacy Adams. 1963. Towards an understanding of inequity. The journal of abnormal and social psychology 67, 5 (1963), 422.
  2. Aniya Agarwal, Pranay Lohia, Seema Nagar, Kuntal Dey, and Diptikalyan Saha. 2018. Automated Test Generation to Detect Individual Discrimination in AI Models. arXiv:1809.03260 [cs.AI] · arXiv
  3. Yongsu Ahn and Yu-Ru Lin. 2020. FairSight: Visual Analytics for Fairness in Decision Making. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2020), 1086-1095. https://doi.org/10.1109/TVCG.2019.2934262 · DOI · Paper page
  4. Saleema Amershi, Maya Cakmak, William Bradley Knox, and Todd Kulesza. 2014. Power to the people: The role of humans in interactive machine learning. Ai Magazine 35, 4 (2014), 105-120.
  5. Hadis Anahideh, Abolfazl Asudeh, and Saravanan Thirumuruganathan. 2022. Fair active learning. Expert Systems with Applications 199 (2022), 116981.
  6. Zahra Ashktorab, Benjamin Hoover, Mayank Agarwal, Casey Dugan, Werner Geyer, Hao Bang Yang, and Mikhail Yurochkin. 2023. Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairness. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). https://doi.org/10.1145/3544548.3581227 · DOI
  7. R. K. E. Bellamy, K. Dey, M. Hind, S. C. Hoffman, S. Houde, K. Kannan, P. Lohia, J. Martino, S. Mehta, A. Mojsilović, S. Nagar, K. Natesan Ramamurthy, J. Richards, D. Saha, P. Sattigeri, M. Singh, K. R. Varshney, and Y. Zhang. 2019. AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias. IBM Journal of Research and Development 63, 4/5 (July 2019), 4:1-4:15. https://doi.org/10.1147/JRD.2019.2942287 Conference Name: IBM Journal of Research and Development. · DOI · Paper page
  8. Richard Berk, Hoda Heidari, Shahin Jabbari, Michael Kearns, and Aaron Roth. 2021. Fairness in Criminal Justice Risk Assessments: The State of the Art. Sociological Methods & Research 50, 1 (2021), 3-44. https://doi.org/10.1177/0049124118782533 arXiv:https://doi.org/10.1177/0049124118782533 · DOI · Paper page
  9. Robert J Bies and Debra L Shapiro. 1987. Interactional fairness judgments: The influence of causal accounts. Social justice research 1 (1987), 199-218.
  10. Reuben Binns. 2018. Fairness in Machine Learning: Lessons from Political Philosophy. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, 149-159. https: //proceedings.mlr.press/v81/binns18a.html
  11. Reuben Binns, Max Van Kleek, Michael Veale, Ulrik Lyngs, Jun Zhao, and Nigel Shadbolt. 2018. 'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). https://doi.org/10.1145/3173574.3173951 · DOI · Paper page
  12. Emily Black, Samuel Yeom, and Matt Fredrikson. 2020. FlipTest: fairness testing via optimal transport. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* '20). https://doi.org/10.1145/3351095.3372845 · DOI
  13. A. Cabrera, W. Epperson, F. Hohman, M. Kahng, J. Morgenstern, and D. Chau. 2019. FAIRVIS: Visual Analytics for Discovering Intersectional Bias in Machine Learning. In 2019 IEEE Conference on Visual Analytics Science and Technology (VAST). IEEE Computer Society, Los Alamitos, CA, USA, 46-56. https://doi.org/10.1109/VAST47406.2019.8986948 · DOI · Paper page
  14. Toon Calders, Faisal Kamiran, and Mykola Pechenizkiy. 2009. Building Classifiers with Independency Constraints. In 2009 IEEE International Conference on Data Mining Workshops. 13-18. https://doi.org/10.1109/ICDMW.2009.83 · DOI · Paper page
  15. Joymallya Chakraborty, Suvodeep Majumder, Zhe Yu, and Tim Menzies. 2020. Fairway: a way to build fair ML software. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (Virtual Event, USA) (ESEC/FSE 2020). https://doi.org/10.1145/3368089.3409697 · DOI
  16. Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, California, USA) (KDD '16). https://doi.org/10.1145/2939672.2939785 · DOI · Paper page
  17. Hao-Fei Cheng, Logan Stapleton, Ruiqi Wang, Paige Bullock, Alexandra Chouldechova, Zhiwei Steven Steven Wu, and Haiyi Zhu. 2021. Soliciting Stakeholders' Fairness Notions in Child Maltreatment Predictive Systems. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). https://doi.org/10.1145/3411764.3445308 · DOI
  18. Jason Colquitt, Donald Conlon, Michael Wesson, Christopher Porter, and K. Ng. 2001. Justice at the Millennium: A Meta-Analytic Review of 25 Years of Organizational Justice Research. The Journal of applied psychology 86 (07 2001), 425-45. https://doi.org/10.1037//0021-9010.86.3.425 · DOI · Paper page
  19. Sam Corbett-Davies, Emma Pierson, Avi Feller, Sharad Goel, and Aziz Huq. 2017. Algorithmic Decision Making and the Cost of Fairness. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Halifax, NS, Canada) (KDD '17). https://doi.org/10.1145/3097983.3098095 · DOI · Paper page
  20. David De Cremer, Devesh Narayanan, Mahak Nagpal, Jack McGuire, and Shane Schweitzer. 2024. AI Fairness in Action: A Human-Computer Perspective on AI Fairness in Organizations and Society. International Journal of Human-Computer Interaction 40, 1 (2024), 1-3. https://doi.org/10. 1080/10447318.2023.2273673 arXiv:https://doi.org/10.1080/10447318.2023.2273673 · DOI
  21. John J. Dudley and Per Ola Kristensson. 2018. A Review of User Interface Design for Interactive Machine Learning. ACM Transactions on Interactive Intelligent Systems 8, 2 (2018), 1-37. https://doi.org/10.1145/3185517 · DOI · Paper page
  22. Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. 2012. Fairness through Awareness. In Proceedings of the 3rd Innovations in Theoretical Computer Science Conference (Cambridge, Massachusetts) (ITCS '12). https://doi.org/10.1145/2090236.2090255 · DOI · Paper page
  23. Jerry Alan Fails and Dan R. Olsen. 2003. Interactive machine learning. In Proceedings of the 8th International Conference on Intelligent User Interfaces (Miami, Florida, USA) (IUI '03). https://doi.org/10.1145/604045.604056 · DOI · Paper page
  24. Michael Feldman, Sorelle A. Friedler, John Moeller, Carlos Scheidegger, and Suresh Venkatasubramanian. 2015. Certifying and Removing Disparate Impact. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Sydney, NSW, Australia) (KDD '15). https://doi.org/10.1145/2783258.2783311 · DOI · Paper page
  25. James R. Foulds, Rashidul Islam, Kamrun Naher Keya, and Shimei Pan. 2020. An Intersectional Definition of Fairness. In 2020 IEEE 36th International Conference on Data Engineering (ICDE). 1918-1921. https://doi.org/10.1109/ICDE48307.2020.00203 · DOI · Paper page
  26. Sainyam Galhotra, Yuriy Brun, and Alexandra Meliou. 2017. Fairness testing: testing software for discrimination. In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering (Paderborn, Germany) (ESEC/FSE 2017). https://doi.org/10.1145/3106237.3106277 · DOI · Paper page
  27. Marco Gillies, Rebecca Fiebrink, Atau Tanaka, Jérémie Garcia, Frédéric Bevilacqua, Alexis Heloir, Fabrizio Nunnari, Wendy Mackay, Saleema Amershi, Bongshin Lee, Nicolas d'Alessandro, Joëlle Tilmanne, Todd Kulesza, and Baptiste Caramiaux. 2016. Human-Centred Machine Learning. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA '16). https://doi.org/10.1145/2851581.2856492 · DOI
  28. Moritz Hardt, Eric Price, and Nathan Srebro. 2016. Equality of opportunity in supervised learning. In Proceedings of the 30th International Conference on Neural Information Processing Systems (Barcelona, Spain) (NIPS'16).
  29. Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139-183. https: //doi.org/10.1016/S0166-4115(08)62386-9 · DOI · Paper page
  30. Robert Hoffman, Shane T Mueller, Gary Klein, and Jordan Litman. 2021. Measuring Trust in the XAI Context. https://doi.org/10.31234/osf.io/e3kv9 · DOI
  31. Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé, Miro Dudik, and Hanna Wallach. 2019. Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). https://doi.org/10.1145/3290605.3300830 · DOI · Paper page
  32. Max Hort, Zhenpeng Chen, Jie M. Zhang, Mark Harman, and Federica Sarro. 2024. Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey. ACM J. Responsib. Comput. 1, 2, Article 11 (June 2024), 52 pages. https://doi.org/10.1145/3631326 · DOI
  33. Qinghua Huang, Yongdong Chen, Longzhong Liu, Dacheng Tao, and Xuelong Li. 2019. On combining biclustering mining and AdaBoost for breast tumor classification. IEEE Transactions on Knowledge and Data Engineering 32, 4 (2019), 728-738.
  34. Vasileios Iosifidis, Besnik Fetahu, and Eirini Ntoutsi. 2019. FAE: A Fairness-Aware Ensemble Framework. In 2019 IEEE International Conference on Big Data (Big Data). 1375-1380. https://doi.org/10.1109/BigData47090.2019.9006487 · DOI
  35. Maurice Jakesch, Zana Buçinca, Saleema Amershi, and Alexandra Olteanu. 2022. How Different Groups Prioritize Ethical Values for Responsible AI. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT '22). https: //doi.org/10.1145/3531146.3533097 · DOI · Paper page
  36. Faisal Kamiran and Toon Calders. 2009. Classifying without discriminating. In 2009 2nd International Conference on Computer, Control and Communication. 1-6. https://doi.org/10.1109/IC4.2009.4909197 · DOI · Paper page
  37. Faisal Kamiran and Toon Calders. 2012. Data preprocessing techniques for classification without discrimination. Knowledge and Information Systems 33, 1 (Oct. 2012), 1-33. https://doi.org/10.1007/s10115-011-0463-8 · DOI · Paper page
  38. Faisal Kamiran, Sameen Mansha, Asim Karim, and Xiangliang Zhang. 2018. Exploiting reject option in classification for social discrimination control. Information Sciences 425 (2018), 18-33.
  39. Toshihiro Kamishima, Shotaro Akaho, Hideki Asoh, and Jun Sakuma. 2012. Fairness-Aware Classifier with Prejudice Remover Regularizer. In Machine Learning and Knowledge Discovery in Databases, Peter A. Flach, Tijl De Bie, and Nello Cristianini (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 35-50.
  40. Ashish Kapoor, Bongshin Lee, Desney Tan, and Eric Horvitz. 2010. Interactive optimization for steering machine classification. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '10). https://doi.org/10.1145/1753326.1753529 · DOI
  41. Maria Kasinidou, Styliani Kleanthous, Pınar Barlas, and Jahna Otterbacher. 2021. I agree with the decision, but they didn't deserve this: Future Developers' Perception of Fairness in Algorithmic Decisions. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT '21). https://doi.org/10.1145/3442188.3445931 · DOI
  42. Michael Kearns, Seth Neel, Aaron Roth, and Zhiwei Steven Wu. 2018. Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In Proceedings of the 35th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 80), Jennifer Dy and Andreas Krause (Eds.). PMLR, 2564-2572. https://proceedings.mlr.press/v80/kearns18a.html
  43. Keith Kirkpatrick. 2016. Battling Algorithmic Bias: How Do We Ensure Algorithms Treat Us Fairly? Commun. ACM 59, 10 (Sept. 2016), 16-17. https://doi.org/10.1145/2983270 · DOI
  44. Kenji Kobayashi and Yuri Nakao. 2022. One-vs.-One Mitigation of Intersectional Bias: A General Method for Extending Fairness-Aware Binary Classification. In New Trends in Disruptive Technologies, Tech Ethics and Artificial Intelligence, Juan F. de Paz Santana, Daniel H. de la Iglesia, and Alfonso José López Rivero (Eds.). Springer International Publishing, Cham, 43-54.
  45. Emmanouil Krasanakis, Eleftherios Spyromitros-Xioufis, Symeon Papadopoulos, and Yiannis Kompatsiaris. 2018. Adaptive Sensitive Reweighting to Mitigate Bias in Fairness-aware Classification. In Proceedings of the 2018 World Wide Web Conference (Lyon, France) (WWW '18). https: //doi.org/10.1145/3178876.3186133 · DOI · Paper page
  46. Todd Kulesza, Margaret Burnett, Weng-Keen Wong, and Simone Stumpf. 2015. Principles of Explanatory Debugging to Personalize Interactive Machine Learning. In Proceedings of the 20th International Conference on Intelligent User Interfaces (Atlanta, Georgia, USA) (IUI '15). https: //doi.org/10.1145/2678025.2701399 · DOI · Paper page
  47. Matt Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. 2017. Counterfactual fairness. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS'17).
  48. Min Kyung Lee, Nina Grgić-Hlača, Michael Carl Tschantz, Reuben Binns, Adrian Weller, Michelle Carney, and Kori Inkpen. 2020. Human-Centered Approaches to Fair and Responsible AI. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). https://doi.org/10.1145/3334480.3375158 · DOI
  49. Min Kyung Lee, Anuraag Jain, Hea Jin Cha, Shashank Ojha, and Daniel Kusbit. 2019. Procedural Justice in Algorithmic Fairness: Leveraging Transparency and Outcome Control for Fair Algorithmic Mediation. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 182 (nov 2019), 26 pages. https://doi.org/10.1145/3359284 · DOI
  50. Michelle Seng Ah Lee and Jat Singh. 2021. The Landscape and Gaps in Open Source Fairness Toolkits. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). https://doi.org/10.1145/3411764.3445261 · DOI · Paper page
  51. Mansoureh Maadi, Hadi Akbarzadeh Khorshidi, and Uwe Aickelin. 2021. A review on human-ai interaction in machine learning and insights for medical applications. International journal of environmental research and public health 18, 4 (2021), 2121.
  52. Michael A. Madaio, Luke Stark, Jennifer Wortman Vaughan, and Hanna Wallach. 2020. Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). https://doi.org/10.1145/3313831.3376445 · DOI · Paper page
  53. Krystal Maughan, Ivoline C. Ngong, and Joseph P. Near. 2022. Prediction Sensitivity: Continual Audit of Counterfactual Fairness in Deployed Classifiers. arXiv:2202.04504 [cs.LG] · arXiv
  54. Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2021. A Survey on Bias and Fairness in Machine Learning. ACM Comput. Surv. 54, 6, Article 115 (jul 2021), 35 pages. https://doi.org/10.1145/3457607 · DOI · Paper page
  55. Eduardo Mosqueira-Rey, Elena Hernández-Pereira, David Alonso-Ríos, José Bobes-Bascarán, and Ángel Fernández-Leal. 2022. Human-in-the-loop machine learning: a state of the art. Artificial Intelligence Review (2022). https://doi.org/10.1007/s10462-022-10246-w · DOI
  56. Yuri Nakao, Lorenzo Strappelli, Simone Stumpf, Aisha Naseer, Daniele Regoli, and Giulia Del Gamba. 2023. Towards Responsible AI: A Design Space Exploration of Human-Centered Artificial Intelligence User Interfaces to Investigate Fairness. International Journal of Human-Computer Interaction 39, 9 (2023), 1762-1788. https://doi.org/10.1080/10447318.2022.2067936 arXiv:https://doi.org/10.1080/10447318.2022.2067936 · DOI
  57. Yuri Nakao, Simone Stumpf, Subeida Ahmed, Aisha Naseer, and Lorenzo Strappelli. 2022. Toward Involving End-Users in Interactive Human-in-the- Loop AI Fairness. ACM Trans. Interact. Intell. Syst. 12, 3, Article 18 (jul 2022), 30 pages. https://doi.org/10.1145/3514258 · DOI · Paper page
  58. Yuri Nakao and Takuya Yokota. 2023. Stakeholder-in-the-Loop Fair Decisions: A Framework to Design Decision Support Systems in Public and Private Organizations. In HCI in Business, Government and Organizations: 10th International Conference, HCIBGO 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23-28, 2023, Proceedings, Part I (Copenhagen, Denmark). https://doi.org/10.1007/978- 3-031-35969-9_3 · DOI
  59. Alejandro Noriega-Campero, Michiel A. Bakker, Bernardo Garcia-Bulle, and Alex 'Sandy' Pentland. 2019. Active Fairness in Algorithmic Decision Making. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (Honolulu, HI, USA) (AIES '19). https://doi.org/10.1145/3306618. 3314277 · DOI
  60. Judea Pearl. 1995. Causal diagrams for empirical research. Biometrika 82, 4 (1995), 669-688.
  61. Gonzalo Ramos, Christopher Meek, Patrice Simard, Jina Suh, and Soroush Ghorashi. 2020. Interactive machine teaching: a human-centered approach to building machine-learned models. Human-Computer Interaction 35, 5-6 (2020), 413-451.
  62. John Rawls. 2001. Justice as fairness: A restatement. Harvard University Press.
  63. Lionel P. Robert, Casey Pierce, Liz Marquis, Sangmi Kim, and Rasha Alahmad. 2020. Designing fair AI for managing employees in organizations: a review, critique, and design agenda. Human-Computer Interaction 35, 5-6 (2020), 545-575. https://doi.org/10.1080/07370024.2020.1735391 arXiv:https://doi.org/10.1080/07370024.2020.1735391 · DOI · Paper page
  64. Yusuke Sakata, Yukino Baba, and Hisashi Kashima. 2019. Crownn: Human-in-the-loop Network with Crowd-generated Inputs. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 7555-7559.
  65. Nripsuta Ani Saxena, Karen Huang, Evan DeFilippis, Goran Radanovic, David C. Parkes, and Yang Liu. 2020. How do fairness definitions fare? Testing public attitudes towards three algorithmic definitions of fairness in loan allocations. Artificial Intelligence 283 (2020), 103238. https://doi.org/10.1016/j.artint.2020.103238 · DOI
  66. Ben Shneiderman. 2020. Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy. International Journal of Human-Computer Interaction 36, 6 (2020), 495-504. https://doi.org/10.1080/10447318.2020.1741118 arXiv:https://doi.org/10.1080/10447318.2020.1741118 · DOI · Paper page
  67. Mona Sloane, Emanuel Moss, Olaitan Awomolo, and Laura Forlano. 2022. Participation Is not a Design Fix for Machine Learning. In Proceedings of the 2nd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (Arlington, VA, USA) (EAAMO '22). https: //doi.org/10.1145/3551624.3555285 · DOI · Paper page
  68. Till Speicher, Hoda Heidari, Nina Grgic-Hlaca, Krishna P. Gummadi, Adish Singla, Adrian Weller, and Muhammad Bilal Zafar. 2018. A Unified Approach to Quantifying Algorithmic Unfairness: Measuring Individual &Group Unfairness via Inequality Indices. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (London, United Kingdom) (KDD '18). https://doi.org/10.1145/3219819. 3220046 · DOI · Paper page
  69. Megha Srivastava, Hoda Heidari, and Andreas Krause. 2019. Mathematical Notions vs. Human Perception of Fairness: A Descriptive Approach to Fairness for Machine Learning. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (Anchorage, AK, USA) (KDD '19). https://doi.org/10.1145/3292500.3330664 · DOI · Paper page
  70. Simone Stumpf, Vidya Rajaram, Lida Li, Weng-Keen Wong, Margaret Burnett, Thomas Dietterich, Erin Sullivan, and Jonathan Herlocker. 2009. Interacting meaningfully with machine learning systems: Three experiments. International journal of human-computer studies 67, 8 (2009), 639-662.
  71. Sahil Verma and Julia Rubin. 2018. Fairness definitions explained. In Proceedings of the International Workshop on Software Fairness (Gothenburg, Sweden) (FairWare '18). https://doi.org/10.1145/3194770.3194776 · DOI · Paper page
  72. Hao Wang, Berk Ustun, and Flavio Calmon. 2019. Repairing without Retraining: Avoiding Disparate Impact with Counterfactual Distributions. In Proceedings of the 36th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 97), Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.). PMLR, 6618-6627. https://proceedings.mlr.press/v97/wang19l.html
  73. Qianwen Wang, Zhenhua Xu, Chen Zhu-Tian, Yong Wang, Shixia Liu, and Huamin Qu. 2021. Visual Analysis of Discrimination in Machine Learning. IEEE Transactions on Visualization and Computer Graphics 27, 2 (2021), 1470-1480. https://doi.org/10.1109/TVCG.2020.3030471 · DOI
  74. Hilde Weerts, Miroslav Dudík, Richard Edgar, Adrin Jalali, Roman Lutz, and Michael Madaio. 2023. Fairlearn: Assessing and Improving Fairness of AI Systems. arXiv:2303.16626 [cs.LG] · arXiv
  75. James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Viégas, and Jimbo Wilson. 2019. The what-if tool: Interactive probing of machine learning models. IEEE transactions on visualization and computer graphics 26, 1 (2019), 56-65.
  76. James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Viégas, and Jimbo Wilson. 2020. The What-If Tool: Interactive Probing of Machine Learning Models. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2020), 56-65. https://doi.org/10.1109/TVCG. 2019.2934619 · DOI
  77. Sewall Wright. 1934. The method of path coefficients. The annals of mathematical statistics 5, 3 (1934), 161-215.
  78. Xingjiao Wu, Luwei Xiao, Yixuan Sun, Junhang Zhang, Tianlong Ma, and Liang He. 2022. A survey of human-in-the-loop for machine learning. Future Generation Computer Systems 135 (2022), 364-381. https://doi.org/10.1016/j.future.2022.05.014 · DOI · Paper page
  79. Forest Yang, Moustapha Cisse, and Sanmi Koyejo. 2020. Fairness with overlapping groups. In Proceedings of the 34th International Conference on Neural Information Processing Systems (Vancouver, BC, Canada) (NIPS '20).
  80. Richard Zemel, Yu Wu, Kevin Swersky, Toniann Pitassi, and Cynthia Dwork. 2013. Learning fair representations. In Proceedings of the 30th International Conference on International Conference on Machine Learning -Volume 28 (Atlanta, GA, USA) (ICML'13). JMLR.org, III-325-III-333.
  81. Angie Zhang, Olympia Walker, Kaci Nguyen, Jiajun Dai, Anqing Chen, and Min Kyung Lee. 2023. Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation. Proc. ACM Hum.-Comput. Interact. 7, CSCW1, Article 125 (apr 2023), 32 pages. https://doi.org/10.1145/3579601 · DOI
  82. Wenbin Zhang and Jeremy C. Weiss. 2022. Longitudinal Fairness with Censorship. Proceedings of the AAAI Conference on Artificial Intelligence 36, 11 (Jun. 2022), 12235-12243. https://doi.org/10.1609/aaai.v36i11.21484 · DOI
  83. Yunfeng Zhang, Rachel Bellamy, and Kush Varshney. 2020. Joint Optimization of AI Fairness and Utility: A Human-Centered Approach. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (New York, NY, USA) (AIES '20). https://doi.org/10.1145/3375627.3375862 · DOI

Cited by

Sorted by citations

Authors
Taka, E., Nakao, Y., Sonoda, R., Yokota, T., Luo, L., & Stumpf, S.
Affiliations
  • University of Glasgow (GB)
  • Fujitsu (Japan) (JP)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2312.08064
arXiv
2312.08064
OpenAlex
W4389768570
Cited by
0
References
0
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
Keywords
algorithmic fairness, stakeholder feedback, human-in-the-loop, responsible AI, credit ratings, loan applications, fairness metrics, high-risk decision-making

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review