CoChat
Sign Up
Cited by 98Ethics and Social Impacts of AIPrivacy-Preserving Technologies in DataData Quality and Management

Managing bias and unfairness in data for decision support: a survey of machine learning and data engineering approaches to identify and mitigate bias and unfairness within data management and analytics systems

Open access
Balayn, Agathe, Lofi, Christoph, Houben, Geert-Jan·2021·The VLDB Journal
DOI 10.1007/s00778-021-00671-8
Open this paper in CoChat — free accountOpen PDF

Abstract

The increasing use of data-driven decision support systems in industry and governments is accompanied by the discovery of a plethora of bias and unfairness issues in the outputs of these systems. Multiple computer science communities, and especially machine learning, have started to tackle this problem, often developing algorithmic solutions to mitigate biases to obtain fairer outputs. However, one of the core underlying causes for unfairness is bias in training data which is not fully covered by such approaches. Especially, bias in data is not yet a central topic in data engineering and management research. We survey research on bias and unfairness in several computer science domains, distinguishing between data management publications and other domains. This covers the creation of fairness metrics, fairness identification, and mitigation methods, software engineering approaches and biases in crowdsourcing activities. We identify relevant research gaps and show which data management activities could be repurposed to handle biases and which ones might reinforce such biases. In the second part, we argue for a novel data-centered approach overcoming the limitations of current algorithmic-centered methods. This approach focuses on eliciting and enforcing fairness requirements and constraints on data that systems are trained, validated, and used on. We argue for the need to extend database management systems to handle such constraints and mitigation methods. We discuss the associated future research directions regarding algorithms, formalization, modelling, users, and systems.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s00778-021-00671-8

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 154

  1. Abiteboul, S., Stoyanovich, J.: Transparency, fairness, data pro- tection, neutrality: data management challenges in the face of new regulation. J. Data Inf. Qual. 11(3), 1-9 (2019)
  2. Accinelli, C., Minisi, S., Catania, B.: Coverage-based rewriting for data preparation. In: EDBT/ICDT Workshops (2020)
  3. Aggarwal, A., Lohia, P., Nagar, S., Dey, K., Saha, D.: Black box fairness testing of machine learning models. In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineer- ing Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2019, pp. 625-635. ACM, New York (2019). https://doi.org/10.1145/3338906.3338937 · DOI
  4. Amershi, S., Begel, A., Bird, C., DeLine, R., Gall, H., Kamar, E., Nagappan, N., Nushi, B., Zimmermann, T.: Software engi- neering for machine learning: a case study. In: 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), pp. 291-300. IEEE (2019)
  5. Angell, R., Johnson, B., Brun, Y., Meliou, A.: Themis: automat- ically testing software for discrimination. In: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineer- ing Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2018, pp. 871-875. ACM, New York (2018). https://doi.org/10.1145/3236024.3264590 · DOI
  6. Asudeh, A., Jagadish, H.: Fairly evaluating and scoring items in a data set. Proc. VLDB Endow. 13(12), 3445-3448 (2020)
  7. Asudeh, A., Jagadish, H., Stoyanovich, J.: Towards responsible data-driven decision making in score-based systems. Data Eng. 6, 76 (2019)
  8. Asudeh, A., Jagadish, H.V., Miklau, G., Stoyanovich, J.: On obtaining stable rankings. Proc. VLDB Endow. 12(3), 237-250 (2018). https://doi.org/10.14778/3291264.3291269 · DOI
  9. Asudeh, A., Jagadish, H.V., Stoyanovich, J., Das, G.: Designing fair ranking schemes. In: Proceedings of the 2019 International Conference on Management of Data, SIGMOD'19, pp. 1259- 1276. ACM, New York (2019). https://doi.org/10.1145/3299869. 3300079 · DOI
  10. Asudeh, A., Jin, Z., Jagadish, H.: Assessing and remedying coverage for a given dataset. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE), pp. 554-565. IEEE (2019)
  11. Aydemir, F.B., Dalpiaz, F.: A roadmap for ethics-aware soft- ware engineering. In: Proceedings of the International Workshop on Software Fairness, FairWare@ICSE 2018, Gothenburg, Swe- den, May 29, 2018, pp. 15-21 (2018). https://doi.org/10.1145/ 3194770.3194778 · DOI
  12. Balayn, A., Mavridis, P., Bozzon, A., Timmermans, B., Szlávik, Z.: Characterising and mitigating aggregation-bias in crowd- sourced toxicity annotations (short paper). In: Proceedings of the 1st Workshop on Subjectivity, Ambiguity and Disagreement in Crowdsourcing, and Short Paper Proceedings of the 1st Work- shop on Disentangling the Relation Between Crowdsourcing and Bias Management (SAD 2018 and CrowdBias 2018) co-located the 6th AAAI Conference on Human Computation and Crowd- sourcing (HCOMP 2018), Zürich, Switzerland, July 5, 2018, pp. 67-71 (2018). http://ceur-ws.org/Vol-2276/paper7.pdf
  13. Barabas, C., Virza, M., Dinakar, K., Ito, J., Zittrain, J.: Interven- tions over predictions: reframing the ethical debate for actuarial risk assessment. In: Friedler, S.A., Wilson, C. (Eds.) Proceedings of the 1st Conference on Fairness, Accountability and Trans- parency, Proceedings of Machine Learning Research, vol. 81, pp. 62-76. PMLR, New York (2018). http://proceedings.mlr.press/ v81/barabas18a.html
  14. Barbosa, N.A.M., Chen, M.: Rehumanized crowdsourcing: a labeling framework addressing bias and ethics in machine learn- ing. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI'19, pp. 543:1-543:12. ACM, New York (2019). https://doi.org/10.1145/3290605.3300773 · DOI
  15. Barlas, P., Kleanthous, S., Kyriakou, K., Otterbacher, J.: What makes an image tagger fair? In: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization, UMAP'19, pp. 95-103. ACM, New York (2019). https://doi.org/ 10.1145/3320435.3320442 · DOI
  16. Barocas, S., Hardt, M., Narayanan, A.: Fairness in machine learn- ing. NIPS Tutorial (2017)
  17. Benabbou, N., Chakraborty, M., Zick, Y.: Fairness and diversity in public resource allocation problems. Data Eng. 6, 64 (2019)
  18. Beutel, A., Chen, J., Doshi, T., Qian, H., Wei, L., Wu, Y., Heldt, L., Zhao, Z., Hong, L., Chi, E.H., Goodrow, C.: Fairness in recommendation ranking through pairwise comparisons. In: Pro- ceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4-8, 2019, pp. 2212-2220 (2019). https://doi. org/10.1145/3292500.3330745 · DOI
  19. Binns, R.: Fairness in machine learning: Lessons from political philosophy. In: Friedler, S.A., Wilson, C. (Eds.) Proceedings of the 1st Conference on Fairness, Accountability and Transparency, Proceedings of Machine Learning Research, vol. 81, pp. 149- 159. PMLR, New York (2018). http://proceedings.mlr.press/v81/ binns18a.html
  20. Bird, C., Bachmann, A., Aune, E., Duffy, J., Bernstein, A., Filkov, V., Devanbu, P.: Fair and balanced? Bias in bug-fix datasets. In: Proceedings of the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering, ESEC/FSE'09, pp. 121-130. ACM, New York (2009). https://doi.org/10.1145/ 1595696.1595716 · DOI
  21. Borromeo, R.M., Laurent, T., Toyama, M., Amer-Yahia, S.: Fair- ness and transparency in crowdsourcing. In: Proceedings of the 20th International Conference on Extending Database Technol- ogy, EDBT 2017, Venice, Italy, March 21-24, 2017, pp. 466-469 (2017). https://doi.org/10.5441/002/edbt.2017.46 · DOI
  22. Bourque, P., Fairley, R.E., et al.: Guide to the software engineering body of knowledge (SWEBOK (R)): Version 3.0. IEEE Computer Society Press (2014)
  23. Brun, Y., Meliou, A.: Software fairness. In: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineer- ing Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2018, pp. 754-759. ACM, New York (2018). https://doi.org/10.1145/3236024.3264838 · DOI
  24. Bulletin of the Technical Committee on Data Engineering, IEEE Computer Society: Special Issue on Fairness, Diversity, and Transparency in Data Systems, Vol. 42, No. 3 (2019). http://sites. computer.org/debull/A19sept/A19SEPT-CD.pdf (2020)
  25. Buolamwini, J., Gebru, T.: Gender shades: Intersectional accuracy disparities in commercial gender classification. In: Conference on Fairness, Accountability and Transparency, pp. 77-91 (2018)
  26. Burke, R.: Multisided fairness for recommendation. arXiv preprint arXiv:1707.00093 (2017) · arXiv
  27. Calikli, G., Bener, A., Arslan, B.: An analysis of the effects of company culture, education and experience on confirmation bias levels of software developers and testers. In: Proceedings of the 32Nd ACM/IEEE International Conference on Software Engineering-Volume 2, ICSE'10, pp. 187-190. ACM, New York (2010). https://doi.org/10.1145/1810295.1810326 · DOI
  28. Canetti, R., Cohen, A., Dikkala, N., Ramnarayan, G., Scheffler, S., Smith, A.: From soft classifiers to hard decisions: How fair can we be? In: Proceedings of the Conference on Fairness, Account- ability, and Transparency, pp. 309-318. ACM (2019)
  29. Carter, A.: Cathy o'neil (2016) weapons of Math Destruction: How big Data Increases Inequality and Threatens Democracy, New York, St. Martin's Press And Virginia Eubanks (2018) Automating Inequality: How High-tech Tools Profile, Police, and Punish the Poor, New York, Broadway Books (2018)
  30. Chen, J., Kallus, N., Mao, X., Svacha, G., Udell, M.: Fair- ness under unawareness: assessing disparity when protected class is unobserved. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 339-348. ACM (2019)
  31. Chen, Z., Cheng, P., Chen, L., Lin, X., Shahabi, C.: Fair task assignment in spatial crowdsourcing. Proc. VLDB Endow. 13(12), 2479-2492 (2020). https://doi.org/10.14778/3407790.3407839 · DOI
  32. Cho, J., Roy, S., Adams, R.: Page quality: in search of an unbiased web ranking. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, Baltimore, Maryland, USA, June 14-16, 2005, pp. 551-562 (2005). https://doi.org/10.1145/ 1066157.1066220 · DOI
  33. Chu, X., Ilyas, I.F., Papotti, P.: Holistic data cleaning: putting vio- lations into context. In: 2013 IEEE 29th International Conference on Data Engineering (ICDE), pp. 458-469. IEEE (2013)
  34. Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., Huq, A.: Algo- rithmic decision making and the cost of fairness. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowl- edge Discovery and Data Mining, pp. 797-806. ACM (2017)
  35. Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., Huq, A.: Algorithmic decision making and the cost of fairness. In: Pro- ceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada, August 13-17, 2017, pp. 797-806 (2017). https://doi.org/10. 1145/3097983.3098095 · DOI · Paper page
  36. Coston, A., Ramamurthy, K.N., Wei, D., Varshney, K.R., Speak- man, S., Mustahsan, Z., Chakraborty, S.: Fair transfer learn- ing with missing protected attributes. In: Proceedings of the AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society, Honolulu, HI, USA (2019)
  37. Das, M., Hecht, B., Gergle, D.: The gendered geography of contributions to openstreetmap: complexities in self-focus bias. In: Proceedings of the 2019 CHI Conference on Human Fac- tors in Computing Systems, CHI'19, pp. 563:1-563:14. ACM, New York, NY, USA (2019). https://doi.org/10.1145/3290605. 3300793 · DOI
  38. Dingler, T., Choudhury, A., Kostakos, V.: Biased bots: Conver- sational agents to overcome polarization. In: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wear- able Computers, UbiComp'18, pp. 1664-1668. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3267305.3274189 · DOI
  39. Dinur, I., Nissim, K.: Revealing information while preserving privacy. In: Proceedings of the Twenty-Second ACM SIGMOD- SIGACT-SIGART Symposium on Principles of Database Sys- tems, pp. 202-210 (2003)
  40. Drosou, M., Jagadish, H., Pitoura, E., Stoyanovich, J.: Diversity in big data: a review. Big Data 5(2), 73-84 (2017)
  41. Dulhanty, C., Wong, A.: Auditing imagenet: towards a model- driven framework for annotating demographic attributes of large- scale image datasets. arXiv preprint arXiv:1905.01347 (2019) · arXiv
  42. Dwork, C., Hardt, M., Pitassi, T., Reingold, O., Zemel, R.: Fair- ness through awareness. In: Proceedings of the 3rd Innovations in Theoretical Computer Science Conference, pp. 214-226. ACM (2012)
  43. Elbassuoni, S., Amer-Yahia, S., Atie, C.E., Ghizzawi, A., Oualha, B.: Exploring fairness of ranking in online job marketplaces. In: Advances in Database Technology-22nd International Confer- ence on Extending Database Technology (EDBT 2019), Lisbon, Portugal, March 26-29, 2019, pp. 646-649 (2019). https://doi. org/10.5441/002/edbt.2019.77 · DOI
  44. Faltings, B., Jurca, R., Pu, P., Tran, B.D.: Incentives to counter bias in human computation. In: Proceedings of the Second AAAI Conference on Human Computation and Crowd- sourcing, HCOMP 2014, November 2-4, 2014, Pittsburgh, PA, USA (2014). http://www.aaai.org/ocs/index.php/HCOMP/ HCOMP14/paper/view/8945
  45. Farnadi, G., Babaki, B., Getoor, L.: Fairness in relational domains. In: Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society, AIES'18, p. 108-114. Association for Com- puting Machinery, New York, NY, USA (2018). https://doi.org/ 10.1145/3278721.3278733 · DOI
  46. Farnadi, G., Babaki, B., Getoor, L.: A declarative approach to fairness in relational domains. Data Eng. 6, 36 (2019)
  47. Feldman, M., Friedler, S.A., Moeller, J., Scheidegger, C., Venkata- subramanian, S.: Certifying and removing disparate impact. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, NSW, Aus- tralia, August 10-13, 2015, pp. 259-268 (2015). https://doi.org/ 10.1145/2783258.2783311 · DOI · Paper page
  48. Ferryman, K., Pitcan, M.: Fairness in precision medicine. Data Soc. 5, 63 (2018)
  49. Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J.W., Wal- lach, H., Daumé, H., III, Crawford, K.: Datasheets for Datasets 58. German, D.M., Robles, G., Poo-Caamaño, G., Yang, X., Iida, H., Inoue, K.: "Was my contribution fairly reviewed?": a framework to study the perception of fairness in modern code reviews. In: Proceedings of the 40th International Conference on Software Engineering, ICSE'18, pp. 523-534. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3180155.3180217 · DOI
  50. Geyik, S.C., Ambler, S., Kenthapadi, K.: Fairness-aware ranking in search & recommendation systems with application to linkedin talent search. In: Proceedings of the 25th ACM SIGKDD Interna- tional Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4-8, 2019., pp. 2221-2231 (2019). https://doi.org/10.1145/3292500.3330691 · DOI
  51. Ghizzawi, A., Marinescu, J., Elbassuoni, S., Amer-Yahia, S., Bisson, G.: Fairank: an interactive system to explore fair- ness of ranking in online job marketplaces. In: Advances in Database Technology-22nd International Conference on Extending Database Technology, EDBT 2019, Lisbon, Portugal, March 26-29, 2019, pp. 582-585 (2019). https://doi.org/10.5441/ 002/edbt.2019.61 · DOI
  52. Glymour, B., Herington, J.: Measuring the biases that mat- ter: the ethical and casual foundations for measures of fairness in algorithms. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT*'19, pp. 269-278. ACM, New York, NY, USA (2019). https://doi.org/10.1145/3287560. 3287573 · DOI · Paper page
  53. Grappiolo, C., Martínez, H.P., Yannakakis, G.N.: Validating generic metrics of fairness in game-based resource allocation scenarios with crowdsourced annotations. In: Transactions on Computational Intelligence XIII, pp. 176-200. Springer (2014)
  54. Guan, Y., Asudeh, A., Mayuram, P., Jagadish, H.V., Stoyanovich, J., Miklau, G., Das, G.: Mithraranking: a system for responsi- ble ranking design. In: Proceedings of the 2019 International Conference on Management of Data, SIGMOD'19, pp. 1913- 1916. ACM, New York, NY, USA (2019). https://doi.org/10.1145/ 3299869.3320244 · DOI
  55. Guerra, P.H.C., Veloso, A., Jr., W.M., Almeida, V.A.F.: From bias to opinion: a transfer-learning approach to real-time sentiment analysis. In: Proceedings of the 17th ACM SIGKDD Interna- tional Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA, August 21-24, 2011, pp. 150-158 (2011). https://doi.org/10.1145/2020408.2020438 · DOI
  56. Hajian, S., Bonchi, F., Castillo, C.: Algorithmic bias: From discrimination discovery to fairness-aware data mining. In: Pro- ceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 2125-2126 (2016)
  57. Hajian, S., Domingo-Ferrer, J.: A methodology for direct and indirect discrimination prevention in data mining. IEEE Trans Knowl. Data Eng. 25(7), 1445-1459 (2012)
  58. Hajian, S., Domingo-Ferrer, J., Farràs, O.: Generalization-based privacy preservation and discrimination prevention in data pub- lishing and mining. Data Min. Knowl. Discov. 28(5-6), 1158- 1188 (2014). https://doi.org/10.1007/s10618-014-0346-1 · DOI
  59. Hardt, M., Price, E., Srebro, N., et al.: Equality of opportunity in supervised learning. In: Advances in Neural Information Process- ing Systems, pp. 3315-3323 (2016)
  60. Hernández-González, J., Inza, I., Lozano, J.A.: A note on the behavior of majority voting in multi-class domains with biased annotators. IEEE Trans. Knowl. Data Eng. 31(1), 195-200 (2018)
  61. Herranz, L., Jiang, S., Li, X.: Scene recognition with CNNs: objects, scales and dataset bias. In: Proceedings of the IEEE Con- ference on Computer Vision and Pattern Recognition, pp. 571-579 (2016)
  62. Holstein, K., Wortman Vaughan, J., Daumé III, H., Dudik, M., Wallach, H.: Improving fairness in machine learning systems: What do industry practitioners need? In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI'19, pp. 600:1-600:16. ACM, New York, NY, USA (2019). https://doi.org/10.1145/3290605.3300830 · DOI · Paper page
  63. Holstein, T., Dodig-Crnkovic, G.: Avoiding the intrinsic unfair- ness of the trolley problem. In: Proceedings of the International Workshop on Software Fairness, FairWare'18, pp. 32-37. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3194770. 3194772 · DOI
  64. Hussain, W., Mougouei, D., Whittle, J.: Integrating social values into software design patterns. In: Proceedings of the International Workshop on Software Fairness, FairWare'18, pp. 8-14. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3194770. 3194777 · DOI
  65. Hutchinson, B., Mitchell, M.: 50 years of test (un) fairness: lessons for machine learning. In: Proceedings of the Conference on Fair- ness, Accountability, and Transparency, pp. 49-58. ACM (2019)
  66. Imtiaz, N., Middleton, J., Chakraborty, J., Robson, N., Bai, G., Murphy-Hill, E.R.: Investigating the effects of gender bias on github. In: Proceedings of the 41st International Conference on Software Engineering (ICSE 2019), Montreal, QC, Canada, May 25-31, 2019, pp. 700-711 (2019). https://doi.org/10.1109/ICSE. 2019.00079 · DOI
  67. Jagadish, H., Bonchi, F., Eliassi-Rad, T., Getoor, L., Gummadi, K., Stoyanovich, J.: The responsibility challenge for data. In: Pro- ceedings of the 2019 International Conference on Management of Data, pp. 412-414 (2019)
  68. Jagielski, M., Kearns, M., Mao, J., Oprea, A., Roth, A., Sharifi- Malvajerdi, S., Ullman, J.: Differentially private fair learning. In: International Conference on Machine Learning, pp. 3000-3008 (2019)
  69. Jannach, D., Kamehkhosh, I., Bonnin, G.: Biases in automated music playlist generation: a comparison of next-track recom- mending techniques. In: Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization, UMAP'16, pp. 281-285. ACM, New York, NY, USA (2016). https://doi.org/10. 1145/2930238.2930283 · DOI
  70. Jin, Z., Xu, M., Sun, C., Asudeh, A., Jagadish, H.V.: Mithracover- age: a system for investigating population bias for intersectional fairness. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, SIGMOD'20, p. 2721-2724. Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3318464.3384689 · DOI
  71. Johnson, N., Near, J.P., Song, D.: Towards practical differential privacy for SQL queries. Proc. VLDB Endow. 11(5), 526-539 (2018)
  72. Kamar, E., Kapoor, A., Horvitz, E.: Identifying and accounting for task-dependent bias in crowdsourcing. In: Third AAAI Con- ference on Human Computation and Crowdsourcing (2015)
  73. Kamishima, T., Akaho, S., Asoh, H., Sakuma, J.: Model-based and actual independence for fairness-aware classification. Data Min. Knowl. Discov. 32(1), 258-286 (2018). https://doi.org/10. 1007/s10618-017-0534-x · DOI
  74. Karako, C., Manggala, P.: Using image fairness representations in diversity-based re-ranking for recommendations. In: Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization, UMAP'18, pp. 23-28. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3213586.3226206 · DOI
  75. Khosla, A., Zhou, T., Malisiewicz, T., Efros, A.A., Torralba, A.: Undoing the damage of dataset bias. In: European Conference on Computer Vision, pp. 158-171. Springer (2012)
  76. Kim, J., Ryu, H., Kim, H.: To be biased or not to be: Choos- ing between design fixation and design intentionality. In: CHI'13 Extended Abstracts on Human Factors in Computing Systems, CHI EA'13, pp. 349-354. ACM, New York, NY, USA (2013). https://doi.org/10.1145/2468356.2468418 · DOI
  77. Kobren, A., Saha, B., McCallum, A.: Paper matching with local fairness constraints. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Min- ing (KDD 2019), Anchorage, AK, USA, August 4-8, 2019, pp. 1247-1257 (2019). https://doi.org/10.1145/3292500.3330899 · DOI · Paper page
  78. Koene, A., Dowthwaite, L., Seth, S.: Ieee p7003™ stan- dard for algorithmic bias considerations: work in progress paper. In: Proceedings of the International Workshop on Software Fair- ness, FairWare'18, pp. 38-41. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3194770.3194773 · DOI
  79. Kortylewski, A., Egger, B., Schneider, A., Gerig, T., Morel- Forster, A., Vetter, T.: Analyzing and reducing the damage of dataset bias to face recognition with synthetic data. In: Proceed- ings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2019)
  80. Kuhlman, C., Rundensteiner, E.: Rank aggregation algorithms for fair consensus. Proc. VLDB Endow. 13(12), 2706-2719 (2020) 100.
  81. Kusner, M., Loftus, J., Russell, C., Silva, R.: Counterfactual fair- ness. In: Advances in Neural Information Processing Systems 30 (NIPS 2017) Pre-proceedings, vol. 30 (2017) 101.
  82. Lahoti, P., Gummadi, K.P., Weikum, G.: ifair: learning individu- ally fair data representations for algorithmic decision making. In: 35th IEEE International Conference on Data Engineering (ICDE 2019), Macao, China, April 8-11, 2019, pp. 1334-1345 (2019). https://doi.org/10.1109/ICDE.2019.00121 102. · DOI
  83. Lappas, T., Terzi, E.: Toward a fair review-management system. In: Machine Learning and Knowledge Discovery in Databases- European Conference, ECML PKDD 2011, Athens, Greece, September 5-9, 2011, Proceedings, Part II, pp. 293-309 (2011). https://doi.org/10.1007/978-3-642-23783-6_19 103. · DOI
  84. Lauw, H.W., Lim, E.P., Wang, K.: Bias and controversy in evalu- ation systems. IEEE Trans. Knowl. Data Eng. 20(11), 1490-1504 (2008) 104.
  85. Leavy, S.: Gender bias in artificial intelligence: The need for diver- sity and gender theory in machine learning. In: 2018 IEEE/ACM 1st International Workshop on Gender Equality in Software Engi- neering, GE@ICSE, Gothenburg, Sweden, May 28, 2018, pp. 14-16 (2018). http://ieeexplore.ieee.org/document/8452744 105.
  86. Lee, M.K., Baykal, S.: Algorithmic mediation in group decisions: fairness perceptions of algorithmically mediated vs. discussion- based social division. In: Proceedings of the 2017 ACM Con- ference on Computer Supported Cooperative Work and Social Computing, CSCW'17, pp. 1035-1048. ACM, New York, NY, USA (2017). https://doi.org/10.1145/2998181.2998230 106. · DOI · Paper page
  87. Lee, M.K., Kim, J.T., Lizarondo, L.: A human-centered approach to algorithmic services: Considerations for fair and motivating smart community service management that allocates donations to non-profit organizations. In: Proceedings of the 2017 CHI Con- ference on Human Factors in Computing Systems, CHI'17, pp. 3365-3376. ACM, New York, NY, USA (2017). https://doi.org/ 10.1145/3025453.3025884 107. Leitão, R., Jakobsen, F.: A survey on user-interface design strate- gies to address online bias. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, CHI EA'18, pp. LBW084:1-LBW084:6. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3170427.3188567 108. Li, Y., Li, Y., Vasconcelos, N.: Resound: towards action recogni- tion without representation bias. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 513-528 (2018) 109. · DOI
  88. Li, Y., Shi, C., Zhao, H., Zhuang, F., Wu, B.: Aspect mining with rating bias. In: Machine Learning and Knowledge Discovery in Databases-European Conference, ECML PKDD 2016, Riva del Garda, Italy, September 19-23, 2016, Proceedings, Part II, pp. 458-474 (2016). https://doi.org/10.1007/978-3-319-46227-1_29 110. · DOI
  89. Liao, Q.V., Fu, W.T., Strohmaier, M.: #snowden: understanding biases introduced by behavioral differences of opinion groups on social media. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI'16, pp. 3352- 3363. ACM, New York, NY, USA (2016). https://doi.org/10.1145/ 2858036.2858422 111. Lin, Y., Guan, Y., Asudeh, A., Jagadish, H.: Identifying insuf- ficient data coverage in databases with multiple relations. Proc. VLDB Endow. 13(12), 2229-2242 (2020) 112. · DOI
  90. Luong, B.T., Ruggieri, S., Turini, F.: k-NN as an implementation of situation testing for discrimination discovery and prevention. In: Proceedings of the 17th ACM SIGKDD International Confer- ence on Knowledge Discovery and Data Mining, pp. 502-510. ACM (2011) 113.
  91. Machanavajjhala, A., He, X., Hay, M.: Differential privacy in the wild: a tutorial on current practices & open challenges. In: Proceedings of the 2017 ACM International Conference on Man- agement of Data, pp. 1727-1730 (2017) 114.
  92. Madras, D., Creager, E., Pitassi, T., Zemel, R.: Fairness through causal awareness: learning causal latent-variable models for biased data. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 349-358. ACM (2019) 116.
  93. Margarita Boyarskaya, P.I.: Fair payments in adaptive voting. In: Proceedings of HCOMP 2019 (2019) 117.
  94. Matsushita, Y., Lin, S., Kang, S.B., Shum, H.Y.: Estimating intrin- sic images from image sequences with biased illumination. In: European Conference on Computer Vision, pp. 274-286. Springer (2004) 118.
  95. Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I.D., Gebru, T.: Model cards for model reporting. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 220-229 (2019) 119.
  96. Mookerjee, V.S.: Debiasing training data for inductive expert sys- tem construction. IEEE Trans. Knowl. Data Eng. 13(3), 497-512 (2001) 121.
  97. Morgan, J.S., Lampe, C., Shafiq, M.Z.: Is news sharing on twit- ter ideologically biased? In: Proceedings of the 2013 Conference on Computer Supported Cooperative Work, CSCW'13, pp. 887- 896. ACM, New York, NY, USA (2013). https://doi.org/10.1145/ 2441776.2441877 122. · DOI
  98. Moskovitch, Y., Jagadish, H.: Countata: dataset labeling using pattern counts. Proc. VLDB Endow. 13(12), 2829-2832 (2020) 123.
  99. Mouzannar, H., Ohannessian, M.I., Srebro, N.: From fair decision making to social equality. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 359-368. ACM (2019) 124.
  100. Mouzannar, H., Ohannessian, M.I., Srebro, N.: From fair decision making to social equality. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT*'19, pp. 359- 368. ACM, New York, NY, USA (2019). https://doi.org/10.1145/ 3287560.3287599 125. · DOI
  101. Narwal, V., Salih, M.H., Lopez, J.A., Ortega, A., O'Donovan, J., Höllerer, T., Savage, S.: Automated assistants to identify and prompt action on visual news bias. In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Com- puting Systems, CHI EA'17, pp. 2796-2801. ACM, New York, NY, USA (2017). https://doi.org/10.1145/3027063.3053227 126. Official Journal of the European Union: REGULATION (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95/46/EC (General Data Pro- tection Regulation. https://eur-lex.europa.eu/legal-content/EN/ TXT/PDF/?uri=CELEX:32016R0679 (2020) 127. · DOI · Paper page
  102. Olteanu, A., Kıcıman, E., Castillo, C.: A critical review of online social data: biases, methodological pitfalls, and ethical boundaries. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, WSDM'18, p. 785- 786. Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3159652.3162004 128. · DOI
  103. Orr, L., Balazinska, M., Suciu, D.: Sample debiasing in the themis open world database system. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, pp. 257-268 (2020) 130.
  104. Otterbacher, J.: Crowdsourcing stereotypes: linguistic bias in metadata generated via gwap. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI'15, pp. 1955-1964. ACM, New York, NY, USA (2015). https://doi.org/10.1145/2702123.2702151 131. Otterbacher, J.: Social cues, social biases: stereotypes in annota- tions on people images. In: Sixth AAAI Conference on Human Computation and Crowdsourcing (2018) 132. · DOI
  105. Panda, R., Zhang, J., Li, H., Lee, J.Y., Lu, X., Roy-Chowdhury, A.K.: Contemplating visual emotions: understanding and over- coming dataset bias. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 579-595 (2018) 135.
  106. Park, S., Kang, S., Chung, S., Song, J.: Newscube: delivering mul- tiple aspects of news to mitigate media bias. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI'09, pp. 443-452. ACM, New York, NY, USA (2009). https:// doi.org/10.1145/1518701.1518772 136. · DOI
  107. Pedreshi, D., Ruggieri, S., Turini, F.: Discrimination-aware data mining. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 560- 568. ACM (2008) 138.
  108. Peng, A., Nushi, B., Kiciman, E., Inkpen, K., Suri, S., Kamar, E.: What you see is what you get? the impact of representation criteria on human bias in hiring. In: HCOMP 2019 arxiv: abs/1909.03567 (2019) 139. · arXiv
  109. Peng, A., Nushi, B., Kıcıman, E., Inkpen, K., Suri, S., Kamar, E.: What you see is what you get? the impact of representation criteria on human bias in hiring. In: Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, vol. 7, pp. 125-134 (2019) 140.
  110. Pérez-Suay, A., Laparra, V., Mateo-Garcia, G., Muñoz-Marí, J., Gómez-Chova, L., Camps-Valls, G.: Fair kernel learning. In: Machine Learning and Knowledge Discovery in Databases- European Conference, ECML PKDD 2017, Skopje, Macedonia, September 18-22, 2017, Proceedings, Part I, pp. 339-355 (2017). https://doi.org/10.1007/978-3-319-71249-9_21 141. · DOI
  111. Power, D.J.: Understanding data-driven decision support systems. Inf. Syst. Manag. 25(2), 149-154 (2008) 143.
  112. Quadrianto, N., Sharmanska, V., Thomas, O.: Discovering fair representations in the data domain. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8227-8236 (2019) 144.
  113. Quattrone, G., Capra, L., De Meo, P.: There's no such thing as the perfect map: quantifying bias in spatial crowd-sourcing datasets. In: Proceedings of the 18th ACM Conference on Computer Sup- ported Cooperative Work & Social Computing, CSCW'15, pp. 1021-1032. ACM, New York, NY, USA (2015). https://doi.org/ 10.1145/2675133.2675235 145. · DOI
  114. Rahman, F., Posnett, D., Herraiz, I., Devanbu, P.: Sample size vs. bias in defect prediction. In: Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2013, pp. 147-157. ACM, New York, NY, USA (2013). https:// doi.org/10.1145/2491411.2491418 146. Raji, I.D., Buolamwini, J.: Actionable auditing: Investigating the impact of publicly naming biased performance results of commer- cial AI products. In: AAAI/ACM Conference on AI Ethics and Society, vol. 1 (2019) 147. · DOI
  115. Ramadan, Q., Ahmadian, A.S., Strüber, D., Jürjens, J., Staab, S.: Model-based discrimination analysis: a position paper. In: Pro- ceedings of the International Workshop on Software Fairness, FairWare'18, pp. 22-28. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3194770.3194775 148. Rastogi, A.: Do biases related to geographical location influ- ence work-related decisions in github? In: Proceedings of the 38th International Conference on Software Engineering Compan- ion, ICSE'16, pp. 665-667. ACM, New York, NY, USA (2016). https://doi.org/10.1145/2889160.2891035 149. · DOI
  116. Robertson, R.E., Jiang, S., Joseph, K., Friedland, L., Lazer, D., Wilson, C.: Auditing partisan audience bias within google search. Proc. ACM Hum. Comput. Interact. 2(CSCW), 148:1-148:22 (2018). https://doi.org/10.1145/3274417 150. · DOI · Paper page
  117. Romei, A., Ruggieri, S.: A multidisciplinary survey on discrimi- nation analysis. Knowl. Eng. Rev. 29(5), 582-638 (2014) 151.
  118. Ruggieri, S., Hajian, S., Kamiran, F., Zhang, X.: Anti- discrimination analysis using privacy attack strategies. In: Joint European Conference on Machine Learning and Knowledge Dis- covery in Databases, pp. 694-710. Springer (2014) 152.
  119. Ruggieri, S., Pedreschi, D., Turini, F.: Data mining for discrimi- nation discovery. ACM Trans. Knowl. Discov. Data 4(2), 9 (2010) 153.
  120. Ruggieri, S., Pedreschi, D., Turini, F.: DCUBE: discrimination discovery in databases. In: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD 2010), Indianapolis, IN, USA, June 6-10, 2010, pp. 1127-1130 (2010). https://doi.org/10.1145/1807167.1807298 154. · DOI
  121. Ruggieri, S., Turini, F.: A KDD process for discrimination dis- covery. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 249-253. Springer (2016) 155.
  122. Saleiro, P., Kuester, B., Hinkson, L., London, J., Stevens, A., Anis- feld, A., Rodolfa, K.T., Ghani, R.: Aequitas: a bias and fairness audit toolkit. arXiv preprint arXiv:1811.05577 (2018) 156. · arXiv
  123. Salimi, B., Cole, C., Li, P., Gehrke, J., Suciu, D.: Hypdb: a demon- stration of detecting, explaining and resolving bias in OLAP queries. Proc. VLDB Endow. 11(12), 2062-2065 (2018) 157.
  124. Salimi, B., Gehrke, J., Suciu, D.: Bias in olap queries: detection, explanation, and removal. In: Proceedings of the 2018 Interna- tional Conference on Management of Data, SIGMOD'18, pp. 1021-1035. ACM, New York, NY, USA (2018). https://doi.org/ 10.1145/3183713.3196914 158. · DOI
  125. Salimi, B., Howe, B., Suciu, D.: Data management for causal algorithmic fairness. arXiv preprint arXiv:1908.07924 (2019) 159. · arXiv
  126. Salimi, B., Howe, B., Suciu, D.: Database repair meets algorithmic fairness. SIGMOD Rec. 49(1), 34-41 (2020). https://doi.org/10. 1145/3422648.3422657 160. · DOI
  127. Salimi, B., Parikh, H., Kayali, M., Getoor, L., Roy, S., Suciu, D.: Causal relational learning. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, SIG- MOD'20, p. 241-256. Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3318464. 3389759 161. · DOI
  128. Selbst, A.D., Boyd, D., Friedler, S.A., Venkatasubramanian, S., Vertesi, J.: Fairness and abstraction in sociotechnical systems. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT*'19, pp. 59-68. ACM, New York, NY, USA (2019). https://doi.org/10.1145/3287560.3287598 166. Shankar, S., Halpern, Y., Breck, E., Atwood, J., Wilson, J., Sculley, D.: No classification without representation: assessing geodiver- sity issues in open data sets for the developing world. arXiv preprint arXiv:1711.08536 (2017) 167. · DOI · Paper page
  129. Singh, A., Joachims, T.: Fairness of exposure in rankings. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, London, UK, August 19-23, 2018, pp. 2219-2228 (2018). https://doi.org/ 10.1145/3219819.3220088 168. · DOI
  130. Sinha, S., Agarwal, M., Vatsa, M., Singh, R., Anand, S.: Exploring bias in primate face detection and recognition. In: Proceedings of the European Conference on Computer Vision (ECCV) (2018) 169.
  131. Solomon, J.: Customization bias in decision support systems. In: Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI'14, pp. 3065-3074. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2556288. 2557211 170. · DOI
  132. Sonboli, N., Burke, R.: Localized fairness in recommender sys- tems. In: Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization, UMAP'19 Adjunct, pp. 295-300. ACM, New York, NY, USA (2019). https://doi.org/ 10.1145/3314183.3323845 171. · DOI
  133. Spillane, B., Lawless, S., Wade, V.: Measuring bias in news web- sites, towards a model for personalization. In: Proceedings of the 25th Conference on User Modeling, Adaptation and Personaliza- tion, UMAP'17, pp. 387-388. ACM, New York, NY, USA (2017). https://doi.org/10.1145/3079628.3079647 172. Springer, A., Garcia-Gathright, J., Cramer, H.: Assessing and addressing algorithmic bias-but before we get there... In: 2018 AAAI Spring Symposium Series (2018) 173. · DOI
  134. Srivastava, M., Heidari, H., Krause, A.: Mathematical notions vs. human perception of fairness: a descriptive approach to fairness for machine learning. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Min- ing, KDD 2019, Anchorage, AK, USA, August 4-8, 2019., pp. 2459-2468 (2019). https://doi.org/10.1145/3292500.3330664 174. Stock, P., Cisse, M.: Convnets and imagenet beyond accuracy: understanding mistakes and uncovering biases. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 498-512 (2018) 175. · DOI · Paper page
  135. Stoyanovich, J., Howe, B.: Nutritional labels for data and models. Data Eng. 7, 13 (2019) 176.
  136. Stoyanovich, J., Howe, B., Abiteboul, S., Miklau, G., Sahuguet, A., Weikum, G.: Fides: Towards a platform for responsible data science. In: Proceedings of the 29th International Conference on Scientific and Statistical Database Management, SSDBM'17, pp. 26:1-26:6. ACM, New York, NY, USA (2017). https://doi.org/10. 1145/3085504.3085530 177. · DOI
  137. Stoyanovich, J., Howe, B., Jagadish, H.: Responsible data man- agement. Proc. VLDB Endow 13(12), 3474-3488 (2020) 178.
  138. Stoyanovich, J., Yang, K., Jagadish, H.V.: Online set selection with fairness and diversity constraints. In: Proceedings of the 21th International Conference on Extending Database Technology (EDBT 2018), Vienna, Austria, March 26-29, 2018., pp. 241-252 (2018). https://doi.org/10.5441/002/edbt.2018.22 179. Stratigi, M., Kondylakis, H., Stefanidis, K.: Fairness in group rec- ommendations in the health domain. In: 33rd IEEE International Conference on Data Engineering (ICDE 2017), San Diego, CA, USA, April 19-22, 2017, pp. 1481-1488 (2017). https://doi.org/ 10.1109/ICDE.2017.217 180. · DOI
  139. Sühr, T., Biega, A.J., Zehlike, M., Gummadi, K.P., Chakraborty, A.: Two-sided fairness for repeated matchings in two-sided mar- kets: a case study of a ride-hailing platform. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowl- edge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4-8, 2019, pp. 3082-3092 (2019). https://doi.org/ 10.1145/3292500.3330793 181. · DOI
  140. Sun, C., Asudeh, A., Jagadish, H., Howe, B., Stoyanovich, J.: Mithralabel: Flexible dataset nutritional labels for responsible data science. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 2893-2896 (2019) 182.
  141. Sun, T., Gaut, A., Tang, S., Huang, Y., ElSherief, M., Zhao, J., Mirza, D., Belding, E.M., Chang, K., Wang, W.Y.: Mitigating gender bias in natural language processing: literature review. In: Proceedings of the 57th Conference of the Association for Compu- tational Linguistics, ACL 2019, Florence, Italy, July 28-August 2, 2019, Volume 1: Long Papers, pp. 1630-1640 (2019). https:// www.aclweb.org/anthology/P19-1159/ 183.
  142. Udeshi, S., Arora, P., Chattopadhyay, S.: Automated directed fair- ness testing. In: Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE 2018), pp. 98-108. ACM, New York, NY, USA (2018). https://doi.org/10. 1145/3238147.3238165 187. Vincent, J.: Twitter taught Microsoft's AI Chatbot to be a Racist Asshole in Less than a Day. https://www.theverge.com/2016/3/ 24/11297050/tay-microsoft-chatbot-racist (2020) 188. · DOI
  143. Vandenhof, C.: A hybrid approach to identifying unknown unknowns of predictive models. In: Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 7, 180-187 (2019) 189.
  144. Vorvoreanu, M., Zhang, L., Huang, Y.H., Hilderbrand, C., Steine- Hanson, Z., Burnett, M.: From gender biases to gender-inclusive design: an empirical investigation. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI'19, pp. 53:1-53:14. ACM, New York, NY, USA (2019). https://doi.org/10.1145/3290605.3300283 193. Wang, Y., Redmiles, D.F.: Implicit gender biases in professional software development: an empirical study. In: Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Society (ICSE 2019), Montreal, QC, Canada, May 25-31, 2019, pp. 1-10 (2019). https://doi.org/10.1109/ICSE- SEIS.2019.00009 194. · DOI
  145. Weng, J., Shen, Z., Miao, C., Goh, A., Leung, C.: Credibility: how agents can handle unfair third-party testimonies in computational trust models. IEEE Trans. Knowl. Data Eng. 22(9), 1286-1298 (2009) 195.
  146. Woodruff, A., Fox, S.E., Rousso-Schindler, S., Warshaw, J.: A qualitative exploration of perceptions of algorithmic fairness. In: Proceedings of the 2018 CHI Conference on Human Fac- tors in Computing Systems (CHI'18), pp. 656:1-656:14. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3173574. 3174230 196. Yahav, I., Shehory, O., Schwartz, D.: Comments mining with tf- idf: the inherent bias and its removal. IEEE Trans. Knowl. Data Eng. 31(3), 437-450 (2018) 197. · DOI · Paper page
  147. Yamada, M., Sigal, L., Raptis, M.: No bias left behind: covariate shift adaptation for discriminative 3d pose estimation. In: Euro- pean Conference on Computer Vision, pp. 674-687. Springer (2012) 198.
  148. Yan, A., Howe, B.: Fairness in practice: a survey on equity in urban mobility. Data Eng. 9, 49 (2019) 199.
  149. Yang, K., Gkatzelis, V., Stoyanovich, J.: Balanced ranking with diversity constraints. In: Proceedings of the Twenty-Eighth Inter- national Joint Conference on Artificial Intelligence, IJCAI (2019) 200.
  150. Yang, K., Huang, B., Stoyanovich, J., Schelter, S.: Fairness-aware instrumentation of preprocessing pipelines for machine learning. In: HILDA workshop at SIGMOD (2020) 201.
  151. Yuan, S., Wu, X., Xiang, Y.: A two phase deep learning model for identifying discrimination from tweets. In: Proceedings of the 19th International Conference on Extending Database Technology (EDBT 2016), Bordeaux, France, March 15-16, 2016, pp. 696- 697 (2016). https://doi.org/10.5441/002/edbt.2016.92 206 · DOI
  152. Zhang, J., Wu, X., Sheng, V.S.: Imbalanced multiple noisy label- ing. IEEE Trans. Knowl. Data Eng. 27(2), 489-503 (2014) 207.
  153. Zhang, L., Wu, Y., Wu, X.: Achieving non-discrimination in data release. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada, August 13-17, 2017, pp. 1335-1344 (2017). https:// doi.org/10.1145/3097983.3098167 208. Zhang, L., Wu, Y., Wu, X.: Causal modeling-based discrimination discovery and removal: criteria, bounds, and algorithms. IEEE Trans. Knowl. Data Eng. 8, 17 (2018) 209. · DOI
  154. Zhang, Y., Bellamy, R.K., Kellogg, W.A.: Designing information for remediating cognitive biases in decision-making. In: Proceed- ings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI'15), pp. 2211-2220. ACM, New York, NY, USA (2015). https://doi.org/10.1145/2702123.2702239 210. Zheng, Y., Dave, T., Mishra, N., Kumar, H.: Fairness in reciprocal recommendations: a speed-dating study. In: Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Per- sonalization (UMAP'18), pp. 29-34. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3213586.3226207 211. Zliobaite, I.: Measuring discrimination in algorithmic decision making. Data Min. Knowl. Discov. 31(4), 1060-1089 (2017). https://doi.org/10.1007/s10618-017-0506-1 · DOI · Paper page

Cited by

Sorted by citations

Authors
Balayn, A., Lofi, C., & Houben, G.-J.
Affiliations
Delft University of Technology (NL)
Corresponding author
Balayn, Agathe
ORCID
Balayn, Agathe
Venue
The VLDB Journal
Publisher
Springer Science and Business Media LLC
Published
2021-05-05
Volume
30
Issue
5
Pages
739-768
ISSN
  • 0949-877X (ISSN-L)
  • 1066-8888
DOI
10.1007/s00778-021-00671-8
OpenAlex
W3158735461
Cited by
98
References
21
Citations by year
2026: 16 · 2025: 24 · 2024: 25 · 2023: 17 · 2022: 14 · 2021: 2
FWCI
18.13
Type
journal article
Language
en
Open access
Licence
Locations
  • The VLDB Journal (publishedVersion, cc-by)
  • Research Repository (Delft University of Technology) (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Data Quality and Management
Keywords
training data bias, unfairness, data management, fairness metrics, bias mitigation, database management systems, fairness constraints, data-driven decision support, fairness requirements

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review