50 Years of Test (Un)fairness: Lessons for Machine Learning
The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Quantitative definitions of what is unfair and what is fair have been introduced in multiple disciplines for well over 50 years, including in education, hiring, and machine learning. We trace how the notion of fairness has been defined within the testing communities of education and hiring over the past half century, exploring the cultural and social context in which different fairness definitions have emerged. In some cases, earlier definitions of fairness are similar or identical to definitions of fairness in current machine learning research, and foreshadow current formal work. In other cases, insights into what fairness means and how to measure it have largely gone overlooked. We compare past and current notions of fairness along several dimensions, including the fairness criteria, the focus of the criteria (e.g., a test, a model, or its use), the relationship of fairness to individuals, groups, and subgroups, and the mathematical method for measuring fairness (e.g., classification, regression). This work points the way towards future research and measurement of (un)fairness that builds from our modern understanding of fairness while incorporating insights from the past.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These toolkits have been criticised for offering a 'reductionist understanding of fairness as mathematical conditions' [71, p. 1], and reflect a longer history of attempts to reduce (un)fairness to a metric [72].”
From Putting AI ethics to work: are the tools fit for purpose? (2022) · cites this paper as [72]
In the citing paper
“Speciically, there is a rich set of fairness-related work in a variety of disciplines, often with concepts that are similar or equal to current ML fairness research [147].”
From Fairness in machine learning: A survey (2024) · cites this paper as [147]
Citations
Cites
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
(2018) · Cited by 3,510
Semi-supervised learning using Gaussian fields and harmonic functions
Zhu, X., Zoubin Ghahramani, A., & Lafferty, J. (2003) · Cited by 3,509
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501 · cited 1×
“…A ⊥ R ; it is equivalent when A and R have a bivariate Gaussian • Guion’s definition “people with equal probabilities of success is a special case of Dwork’s [23] individual fairness with the relationship between Y and R (since an ability being measured affects the for the optimal score R ∗”
BackgroundDoyle, T. (2017) · The Information Society · doi:10.1080/01972243.2017.1354593 · Cited by 3,071
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · cited 5×
“bility of success on the job” is a construct that can be meaningfully reasoned about. The fairness literature in both the fields of ML and in testing have also been motivated by causal considerations [32, 41]. Darlington [19] motivate his definition (3) on the basis of a causal relationship between Y and R (since an a…”
BackgroundResultInfluentialFair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · cited 3×
“uality of opportunity [32]. That same year, Linn [43] introduced (but did not advocate for) equal Positive Predictive Value (PPV) as a fairness criterion, recognizable as modern day predictive parity [9].4 Under Cleary and Darlington’s conceptions, bias or (un)fairness is a property of the test itself. This is contrar…”
BackgroundResultMitigating Unwanted Biases with Adversarial Learning
Zhang, B. H., Lemoine, B., & Mitchell, M. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278779 · Cited by 1,387 · cited 1×
“or bias in model features. Instead, one approach adopted in ML fairness has been the use of adversarial methods to mitigate the effects of features with undesirable correlations with subgroups, e.g., [6, 69]. 3.4 Model vs. Model Use Section 2 described how the test literature had competing notions of whether fairness…”
MethodInfluentialSelf-citationAlgorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Research works printed but not linked: 11
- Beutel Alex, 2017, Chi
- Buolamwini Joy, 2018, Conference on Fairness, Accountability and Transparency. 77--91
- James, 2018, Foulds and Shimei Pan
- Friedler Sorelle A, 2016, On the (im) possibility of fairness. arXiv preprint arXiv: 1609.07236 · arXiv
- Hoffmann Anna Lauren, Spaces for the Future
- Jencks Christopher, 1998, Racial bias in testing. The Black-White test score gap 55
- 10.3102/00346543043002139 · doi:10.3102/00346543043002139 · Paper page
- National Council on Measurement in Education NCME (Ed.). 1976. Journal of Education Measurement. 13 1 (1976). National Council on Measurement in Education NCME (Ed.). 1976. Journal of Education Measurement. 13 1 (1976).
- Phillips S E, Fairness in Educational Assessment and Measurement
- Rice Mitchell F, 1994, Race Norming, Validity Generalization, and Employment Testing, Handbook of Public Personnel Administration, 58, 451
- Zwick Rebecca, Fairness in Educational Assessment and Measurement
Cited by
Items 101–200 of 304
Ayobi, A., Hughes, J., Duckworth, C. J., Dylag, J. J., Gordon James, S., Marshall, P., Guy, M., Kumaran, A., Chapman, A., Boniface, M., et al. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581424 · Cited by 26
“As a response, academic institutions, corporations, and government bodies have focused attention on human-centred principles, such as fairness, accountability, trust, and ethics [1, 43, 58, 63].”
BackgroundTorkamaan, H., Tahaei, M., Buijsman, S., Xiao, Z., Wilkinson, D., & Knijnenburg, B. P. (2024) · Human-computer interaction series · doi:10.1007/978-3-031-55109-3_2 · Cited by 41
Adomavičius, G., & Yang, M. (2019) · ACM Transactions on Management Information Systems · doi:10.1145/3519420 · Cited by 37
“2 Although non-exhaustive, Table 1 demonstrates the diversity of fairness objectives (see [95] for additional fairness objectives).”
BackgroundThere is an elephant in the room: towards a critique on the use of fairness in biometrics
Valdivia, A., Corbera-Serrajòrdia, J., & Swianiewicz, A. (2022) · AI and Ethics · doi:10.1007/s43681-022-00249-2 · Cited by 37
Reflexive Design for Fairness and Other Human Values in Formal Models
Fish, B., & Stark, L. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462518 · Cited by 55
Kumar, I. E., Hines, K. E., & Dickerson, J. P. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534154 · Cited by 24
“However, many of the proposed metrics are consistent with a long history of testing for discrimination [52].”
Fairness indicators for systematic assessments of visual feature extractors
Goyal, P., Soriano, A. R., Hazirbas, C., Sagun, L., & Usunier, N. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533074 · Cited by 24
“Without such considerations, relying only on abstract notions of fairness measures fails to address the core problem of the For harmful labels, the lower the hit rate the better; conversely, for non-harmful labels the higher the hit rate the better. developed system [34].”
BackgroundSpeith, T., Crook, B., Mann, S., Schomäcker, A., & Langer, M. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09769-3 · Cited by 34
“Now consider an external auditor, Sam, whose role is to check whether the hiring support system adheres to a particular notion of fairness (e.g., subgroup parity, Hutchinson & Mitchell, 2019).”
Booth, B. M., Hickman, L., Subburaj, S. K., Tay, L., Woo, S. E., & D’Mello, S. K. (2021) · IEEE Signal Processing Magazine · doi:10.1109/msp.2021.3106615 · Cited by 32
“Fairness has no universal definition as it is a social, not psychometric, concept rooted in value judgments [11].”
BackgroundOn the relation of causality- versus correlation-based feature selection on model fairness
Saarela, M. (2024) · ACM Symposium on Applied Computing · doi:10.1145/3605098.3636018 · Cited by 27
“While correlation is a descriptive statistic demanding relatively few assumptions for calculation, establishing independence necessitates the application of inferential statistics, which can generally be quite complex and computationally expensive [22, 42].”
BackgroundBeyond Algorithmic Fairness in Recommender Systems
Elahi, M., Abdollahpouri, H., Mansoury, M., & Torkamaan, H. (2021) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3450614.3461685 · Cited by 25
“In general, the concept of fairness in user decision making is not new and can be traced back to well over 50 years [15].”
BackgroundDinnissen, K., & Bauer, C. (2023) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3565472.3592960 · Cited by 37
Evaluation of Group Fairness Measures in Student Performance Prediction Problems
Quy, T. L., Nguyen, T. H., Friege, G., & Ntoutsi, E. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-23618-1_8 · Cited by 32
“Fairness definitions in education, hiring, and ML in the 50-year history have been discussed in the research of [20].”
BackgroundEmployees’ perceptions of the fairness of AI-based performance prediction features
Majrashi, K. (2025) · Cogent Business & Management · doi:10.1080/23311975.2025.2456111 · Cited by 36
“fairness is a central element in the design and development of trustworthy aI systems that, aiming to mitigate undesirable outcomes (hutchinson & mitchell, 2019).”
Towards Fairness-Aware Disaster Informatics: an Interdisciplinary Perspective
Yang, Y., Zhang, C., Fan, C. H., Mostafavi, A., & Hu, X. (2020) · IEEE Access · doi:10.1109/access.2020.3035714 · Cited by 26
“Fairness issues have attracted researchers’ attention across policy-making, education, and machine learning for several decades [21].”
BackgroundMihaljević, H., Müller, I., Dill, K., Yollu-Tok, A., & von Grafenstein, M. (2023) · AI & Society · doi:10.1007/s00146-023-01726-w · Cited by 31
“…algo-rithm evaluations, many competing (and mutually exclusive) definitions of (un)fairness have been developed that are reminiscent of those developed in the 1960 s and 1970 s for testing university admission or personnel selection processes (Hutchinson and Mitchell 2019; Verma and Rubin 2018).”
The Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603208 · Cited by 20
AdverTiming Matters: Examining User Ad Consumption for Effective Ad Allocations on Social Media
Saha, K., Liu, Y., Vincent, N., Chowdhury, F. A., Neves, L., Shah, N., & Bos, M. W. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445394 · Cited by 28
“As such, this practice has been critiqued in the fairness, accountability, transparency literature as reinforcing (and potentially exacerbating) stereotypes and societal biases [3, 41, 82].”
BackgroundAutomating Procedurally Fair Feature Selection in Machine Learning
Belitz, C., Jiang, L., & Bosch, N. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462585 · Cited by 27
Evaluating Fairness of Automated Scoring in Educational Measurement
Johnson, M., & McCaffrey, D. F. (2023) · Routledge eBooks · doi:10.4324/9781003278658-12 · Cited by 37
In the Name of Fairness: Assessing the Bias in Clinical Record De-identification
Xiao, Y., Lim, S., Pollard, T., & Ghassemi, M. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593982 · Cited by 38
“As shown in Figure 7, unlike other templates (e.g., Template 50), Templates 86 and 67 are notable for having large blocks of medication history that provide little indication for the names that intersperse them.”
BackgroundMethodBeFair: Addressing Fairness in the Banking Sector
Castelnovo, A., Crupi, R., Gamba, G. D., Greco, G., Naseer, A., Regoli, D., & González, B. S. M. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9377894 · Cited by 29
“Habitually, fairness definitions are divided into two main categories depending on the purpose that is considered: individual and group fairness [4].”
BackgroundSelection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603209 · Cited by 22
FFTree: A flexible tree to handle multiple fairness criteria
Castelnovo, A., Cosentini, A., Malandri, L., Mercorio, F., & Mezzanzanica, M. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103099 · Cited by 22
Child-Centred AI Design: Definition, Operation, and Considerations
Wang, G., Sun, K., Atabey, A., Pothong, K., Lin, G. C., Zhao, J., & Yip, J. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3573821 · Cited by 16
“For example, AI systems could create potential biases against certain groups [5, 11], such as children from diferent socioeconomic or ethnic groups who might be impacted disproportionately on psychological or social levels in their formative years [1, 25].”
BackgroundGender Bias in Natural Language Processing and Computer Vision: A Comparative Survey
Bartl, M., Mandal, A., Leavy, S., & Little, S. (2025) · ACM Computing Surveys · doi:10.1145/3700438 · Cited by 48
“” Following Hutchinson and Mitchell [62] and Chouldechova and Roth [32], Czarnowska et al. [35] distinguish between two types of fairness: group fairness and counterfactual, or individual fairness .”
Fairness and bias in AI: a sociotechnical perspective
Mimouni, S. E., & Bouhdadi, M. (2025) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-12-2024-0182 · Cited by 19
Toward A Two-Sided Fairness Framework in Search and Recommendation
Liu, J. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578332 · Cited by 27
Observer Effect in Social Media Use
Saha, K., Gupta, P., Mark, G. J., Kıcıman, E., & Choudhury, M. D. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642078 · Cited by 32
Two Kinds of Discrimination in AI-Based Penal Decision-Making
Hübner, D. (2021) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3468507.3468510 · Cited by 25
“Third, largely analogous debates on different statistical fairness standards and their mutual mathematical incompatibility took place back in the 1960s and 1970s, in discussions on potential bias and discrimination in assessment tests [21].”
BackgroundDrozdowski, P., Rathgeb, C., & Busch, C. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00419 · Cited by 21
“The notion of “fairness” is a very complicated and nuanced topic, spanning across ethical, legal, social, technological, and other disciplines [18].”
BackgroundCastelnovo, A., Malandri, L., Mercorio, F., Mezzanzanica, M., & Cosentini, A. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-93736-2_46 · Cited by 29
Constructing categories: Moving beyond protected classes in algorithmic fairness
Belitz, C., Ocumpaugh, J. L., RITTER, S., Baker, R. S., Fancsali, S. E., & Bosch, N. (2022) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24643 · Cited by 22
“These holistic identity categories can then be used to identify algorithmic fairness via existing measures that compare accuracy across groups or propensity to make a particular algorithmic decision for one group (Hutchinson & Mitchell, 2019).”
BackgroundMethodDeterminants of Public Sector Managers' Intentions to Adopt AI in the Workplace
Majrashi, K. (2024) · International Journal of Public Administration in the Digital Age · doi:10.4018/ijpada.342849 · Cited by 29
“However, there is an agreement that fairness is a critical element in designing and developing trustworthy AI systems (Hutchinson & Mitchell, 2019).”
BackgroundDynamic Fairness-aware Recommendation Through Multi-agent Social Choice
Aird, A., Farastu, P., Sun, J. J., Štefancová, E., All, C., Voida, A., Mattei, N., & Burke, R. (2024) · ACM Transactions on Recommender Systems · doi:10.1145/3690653 · Cited by 30
“Fairness is a complex, multifaceted concept that can and does have different definitions, at different times, to different stakeholders, and these issues must be considered in the context in which the systems are deployed [27, 46].”
Fairer Machine Learning Through Multi-objective Evolutionary Learning
Zhang, Q., Liu, J., Zhang, Z., Wen, J., Mao, B., & Yao, X. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86380-7_10 · Cited by 20
Human Judgement in Algorithmic Loops; Individual Justice and Automated Decision-MakingPreprint
Binns, R. (2019) · SSRN Electronic Journal · doi:10.31228/osf.io/kz4s2 · Cited by 20
Algorithmic Social Injustices: Antecedents and Mitigations
Tanriverdi, H., & Akinyemi, J.-P. O. (2025) · MIS Quarterly · doi:10.25300/misq/2025/18314 · Cited by 17
Unfair! Perceptions of Fairness in Human-Robot Teams
Chang, M. L., Trafton, J. G., McCurry, J. M., & Thomaz, A. L. (2021) · IEEE RO-MAN · doi:10.1109/ro-man50785.2021.9515428 · Cited by 22
“When an algorithm interacts with or considers more than one person, such as ML algorithms that are used to inform the decisions made by humans, fairness comes into play ([1], [2], [3]).”
BackgroundInfluentialArtificial intelligence for response prediction and personalisation in radiation oncology
Zwanenburg, A., Price, G. J., & Löck, S. (2024) · Strahlentherapie und Onkologie · doi:10.1007/s00066-024-02281-z · Cited by 19
“Biases result in AI systems that perform better in certain populations than in others and can lead to reinforcing existing structures of inequality [57, 58].”
Deep Fair Clustering via Maximizing and Minimizing Mutual Information: Theory, Algorithm and Metric
Zeng, P., Li, Y., Hu, P., Peng, D., Lv, J., & Peng, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02297 · Cited by 29
On prediction-modelers and decision-makers: why fairness requires more than a fair prediction model
Scantamburlo, T., Baumann, J., & Heitz, C. (2024) · AI & Society · doi:10.1007/s00146-024-01886-3 · Cited by 29
“Therefore, our general framework does not foresee the provision of training data by the decision-maker as a minimum deliverable. the model [more] than of its use since it does not depend on decision thresholds” (Hutchinson and Mitchell 2019, p. 55).”
Hard Choices and Hard Limits in Artificial Intelligence
Goodman, B. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462539 · Cited by 20
Could a Conversational AI Identify Offensive Language?
da Silva, D. A., Louro, H. D. B., Gonçalves, G. S., Marques, J., Dias, L. A. V., da Cunha, A. M., & Tasinaffo, P. M. (2021) · Information · doi:10.3390/info12100418 · Cited by 15
Respect as a Lens for the Design of AI Systems
Seymour, W., Kleek, M. G. V., Binns, R., & Murray-Rust, D. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534186 · Cited by 22
Application of fairness to healthcare, organizational justice, and finance: A survey
Birzhandi, P., & Cho, Y.-S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119465 · Cited by 23
Studying Multi-dimensional Marginalization of Identity from Decolonial and Postcolonial Perspectives
Das, D. (2023) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3584931.3608920 · Cited by 15
“…in critical algorithm studies, fairness, accountability, and transparency has well-established the possibility of biases in algorithmic systems [24, 42], by designing an experimental study, I will examine how NLP-based automated moderation can exhibit biases toward different intersectional…”
BackgroundInnovative Approaches to Staff Development in Education Using AI
Peddi, S., & Manoharan, G. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-1897-4.ch017 · Cited by 14
A multidomain relational framework to guide institutional AI research and adoption
Straub, V. J., Morgan, D., Hashem, Y., Francis, J., Esnaashari, S., & Bright, J. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604718 · Cited by 18
Auditing the Audits: Lessons for Algorithmic Accountability from Local Law 144's Bias Audits
Gerchick, M. K., Encarnación, R., Tanigawa-Lau, C., Armstrong, L., Gutiérrez, A., & Metaxa, D. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732004 · Cited by 10
“Proposals to address algorithmic discrimination in hiring today often leverage established guidelines related to the use of hiring tools [37, 38, 64].”
Wambsganß, T., Su, X., Swamy, V., Neshaei, S. P., Rietsche, R., & Käser, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.689 · Cited by 38
Zezulka, S., & Genin, K. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659020 · Cited by 30
Saatçi, E. Y. (2025) · International Journal of Economic Behavior and Organization · doi:10.11648/j.ijebo.20251301.14 · Cited by 12
Navigating fairness: practitioners’ understanding, challenges, and strategies in AI/ML development
Pant, A., Hoda, R., Tantithamthavorn, C. K., & Turhan, B. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10650-0 · Cited by 24
Delecraz, S., Eltarr, L., Becuwe, M., Bouxin, H., Boutin, N., & Oullier, O. (2022) · 2022 IEEE/ACM International Workshop on Equitable Data & Technology (FairWare) · doi:10.1145/3524491.3527309 · Cited by 27
The Second Workshop on Child-Centered AI Design (CCAI)
Atabey, A., Wang, G., Johnston, S.-K., Lin, G. C., Wilson, C., Urquhart, L. D., & Zhao, J. (2024) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613905.3636305 · Cited by 9
Discrimination-Aware Process Mining: A Discussion
Pohl, T., Qafari, M. S., & van der Aalst, W. M. P. (2023) · Lecture notes in business information processing · doi:10.1007/978-3-031-27815-0_8 · Cited by 13
Hypergraph Convolutional Network for User-Oriented Fairness in Recommender Systems
Han, Z., Chen, C., Zheng, X., Zhang, L., & Li, Y. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657737 · Cited by 20
Machine Learning Based Method for Deciding Internal Value of Talent
Loyarte, E., & Olaizola, I. G. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2022.2151160 · Cited by 18
“To mitigate the risks posed by human predictive errors (Daniel, Sibony, and Sunstein 2021) and machine bias (Hutchinson and Mitchell 2019), this study is based on existing literature on pay equity and the main data science used or properly prepared as well as the problem statement explained in the…”
MethodTracking and Improving Information in the Service of Fairness
Garg, S., Kim, M. P., & Reingold, O. (2019) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3328526.3329624 · Cited by 16
Fairness in Design: A Tool for Guidance in Ethical Artificial Intelligence Design
Shu, Y., Zhang, J., & Yu, H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77626-8_34 · Cited by 13
Exploiting Transferable Knowledge for Fairness-Aware Image Classification
Hwang, S., Park, S., Lee, P., Jeon, S., Kim, D., & Byun, H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69538-5_2 · Cited by 10
Benbouzid, B. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593974 · Cited by 17
Hahn, T., Ebner‐Priemer, U., & Meyer‐Lindenberg, A. (2018) · SSRN Electronic Journal · doi:10.31219/osf.io/uzehj · Cited by 10
Insights From Insurance for Fair Machine Learning
Fröhlich, C., & Williamson, R. C. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658914 · Cited by 14
Individualized Analytics: Within-Person and Idiographic Analysis
Saqr, M., Ito, H., & López‐Pernas, S. (2025) · Springer eBooks · doi:10.1007/978-3-031-95365-1_18 · Cited by 8
Towards a Socio-Legal Robotics: A Theoretical Framework on Norms and Adaptive Technologies
Larsson, S., Liinason, M., Tanqueray, L., & Castellano, G. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01042-9 · Cited by 15
On the trade-off between ranking effectiveness and fairness
Melucci, M. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122709 · Cited by 9
ABCinML: Anticipatory Bias Correction in Machine Learning Applications
Almuzaini, A. A., Bhatt, C., Pennock, D. M., & Singh, V. K. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533211 · Cited by 38
“Several in-depth surveys cover these and related findings [8, 11, 16, 23, 35, 36, 39, 48].”
BackgroundNot So Fair: The Impact of Presumably Fair Machine Learning Models
Jorgensen, M., Richert, H., Black, E., Criado, N., & Such, J. M. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604699 · Cited by 17
Preserving the Fairness Guarantees of Classifiers in Changing Environments: A Survey
Barrainkua, A., Gordaliza, P., Lozano, J. A., & Quadrianto, N. (2025) · ACM Computing Surveys · doi:10.1145/3637438 · Cited by 22
“Machine Learning (ML) systems are increasingly being used for high-stake decision making in applications where human outcomes are involved, ranging from healthcare [84, 98], education [48], recruitment [26, 47], bank loan provision [38, 46, 59], to criminal incarceration [4, 20].”
Digital Well-Being and AI: Navigating the Intersection Between Technology and Mental Health
Mandal, S., & Hawamdeh, M. M. K. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-9015-3.ch004 · Cited by 8
Pragmatic Fairness: Evaluating ML Fairness Within the Constraints of Industry
Smith, J. J., Madaio, M., Burke, R., & Fiesler, C. L. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732040 · Cited by 21
Fairness Requirement in AI Engineering – A Review on Current Research and Future Directions
Pham, N., Pham-Ngoc, H., & Nguyen‐Duc, A. (2023) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-32436-9_1 · Cited by 10
In-processing User Constrained Dominant Sets for User-Oriented Fairness in Recommender Systems
Han, Z., Chen, C., Zheng, X., Liu, W., Wang, J., Cheng, W., & Li, Y. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3613831 · Cited by 13
Unsupervised Image-to-Image Translation Via Fair Representation of Gender Bias
Hwang, S., & Byun, H. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054129 · Cited by 6
“For that reason, there is a great growing interest in fairness AI [3, 4, 5, 6], and many researchers have suggested that the AI system has to work fairly on different gender, race, etc.”
BackgroundArtificial Intelligence and Concerns About the Future: A Case Study in Norway
Kalimeri, K., & Tjøstheim, I. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50344-4_20 · Cited by 12
Taxonomizing Representational Harms using Speech Act Theory
Corvi, E., Washington, H., Reed, S., Atalla, C., Chouldechova, A., Dow, P. A., Garcia-Gathright, J., Pangakis, N. J., Sheng, E., Vann, D., et al. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.202 · Cited by 6
Social Choice for Heterogeneous Fairness in Recommendation
Aird, A., Štefancová, E., All, C., Voida, A., Homola, M., Mattei, N., & Burke, R. (2024) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3640457.3691706 · Cited by 5
Gorgun, G., & Yildirim‐Erbasli, S. N. (2024) · Journal of Educational Measurement · doi:10.1111/jedm.12420 · Cited by 9
Bias in Federated Learning: Factors, Effects, Mitigations, and Open Issues
Benmalek, M., & Seddiki, A. (2024) · Ingénierie des systèmes d information · doi:10.18280/isi.290605 · Cited by 13
“For instance, FL models trained on text data from globally distributed users may underrepresent low-resource languages [165, 166].”
Fish, B., & Stark, L. (2022) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3551624.3555296 · Cited by 11
Suresh, V., & Ong, D. C. (2022) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii55700.2022.9953865 · Cited by 9
“the dataset will be learnt by the model [1], [2].”
MethodRAI4IoE: Responsible AI for Enabling the Internet of Energy
Xue, M., Nepal, ., Liu, L., Sethuvenkatraman, S., Yuan, X., Rudolph, C., Sun, R., & Eisenhauer, G. (2023) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa58951.2023.00012 · Cited by 9
“With the recent surge of attention on AI fairness, there are numerous surveys on AI fairness [23], [46], [50], [73], [79].”
BackgroundFairness-Aware Model Selection Using Differential Item Functioning
Minatel, D., Parmezan, A. R. S., Cúri, M., & Lopes, A. D. A. (2023) · International Conference on Machine Learning and Applications · doi:10.1109/icmla58977.2023.00298 · Cited by 5
“Much of these discussions encouraged the development of mathematical tools to reduce selection bias, thereby increasing the impartiality of such tests [1].”
BackgroundMecati, M., Vetrò, A., & Torchiano, M. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671443 · Cited by 10
“We contribute to the main corpus of researches on algorithmic bias and fairness by moving the focus from the outcomes of ADM systems (where most of the literature concentrate) to their inputs and processes, as indicated as necessary in several recent studies (.e.g, [14], [15] and [16]).”
MethodMoore, R. J., Smith, R., & Liu, Q. (2020) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3412836.3412840 · Cited by 5
Adomavicius, G., & Yang, M. (2019) · Social Science Research Network · doi:10.2139/ssrn.3446944 · Cited by 3
“Although non-exhaustive, Table 1 already demonstrates the diversity of fairness objectives (see Hutchinson and Mitchell 2019 for some additional fairness objectives).”
The problem of fairness in tools for algorithmic fairness
Sun, X.-Y., Ye, B., & Xia, B.-H. (2024) · AI and Ethics · doi:10.1007/s43681-024-00533-3 · Cited by 4
“To begin with, during the 1960s and 1970s, technical definitions of fairness emerged to address bias in standardized testing [29].”
A Generalized Multi-Detector Combination Approach for Differential Item Functioning Detection
Huang, S., & Ishii, H. (2024) · Applied Psychological Measurement · doi:10.1177/01466216241310602 · Cited by 4
“Given the various interpretations and de fi nitions of DIF, numerous DIF detection methods have been developed (Hutchinson & Mitchell, 2019).”
A fairness scale for real-time recidivism forecasts using a national database of convicted offenders
Verrey, J., Neyroud, P., Sherman, L. W., & Ariel, B. (2025) · Neural Computing and Applications · doi:10.1007/s00521-025-11478-x · Cited by 7
Evaluating the Social Impact of Generative AI Systems
Solaiman, I., Talat, Z., Agnew, W. S., Ahmad, L., Baker, D., Blodgett, S. L., Chen, C., Daumé, H., Dodge, J., Duan, I., et al. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198940272.013.0025 · Cited by 10
“Moverover, as geographic and cultural contexts shift, so do the meaning of different categories [206, 112] and must be interpreted according to their local meaning.”
BackgroundSelf-citationAlbini, E., Rago, A., Baroni, P., & Toni, F. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1099407 · Cited by 4
“Avoiding selectively unfair (biased) systems is receiving a great deal of attention in the literature (see, for instance, Dwork et al., 2012; Heidari et al., 2019; Hutchinson and Mitchell, 2019; Binns, 2020; Räz, 2021), whereas the problem of avoiding uniformly unfair systems (due to ill-founded explanations) is recei…”
BackgroundHistorical Methods for AI Evaluations, Assessments, and Audits
Sandoval, . C. B., & Jing, F. S. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732093 · Cited by 12
“[67] and Fröhlich and Williamson [42], for example, have traced how notions of “fairness” have been historically applied in the fields of education, hiring, and insurance and compared them with current approaches to fairness in ML research, highlighting both continuities and opportunities for…”
Enhancing Individual Fairness through Propensity Score Matching
Karimi, H. R., Khan, M. F. A., Liu, H., Derr, T., & Liu, H. (2022) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa54385.2022.10032333 · Cited by 9
“A comprehensive review of fairness definitions can be found in [23], [24].”
BackgroundMecati, M., Torchiano, M., Vetrò, A., & Martin, J. C. D. (2023) · IEEE Access · doi:10.1109/access.2023.3252370 · Cited by 10
“and processes’’ [26], and by Pitoura ‘‘There is a need to”
Fairness of Machine Learning Algorithms for the Black Community
Kiemde, S. M. A., & Kora, A. D. (2020) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas50296.2020.9462194 · Cited by 6
Detecting Risk of Biased Output with Balance Measures
Mecati, M., Vetrò, A., & Torchiano, M. (2022) · Journal of Data and Information Quality · doi:10.1145/3530787 · Cited by 8
The Societal Impacts of Algorithmic Decision-Making
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195 · Cited by 12
Multinational Enterprises and People Management: Examining the Role of Artificial Intelligence
Kumar, P. (2023) · FOCUS Journal of International Business · doi:10.17492/jpi.focus.v10i2.1022305 · Cited by 6
Metadata
- Authors
- Hutchinson, B., & Mitchell, M.
- ORCID
- Mitchell, Margaret
- Venue
- Proceedings of the Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2019-01-29
- Pages
- 49-58
- OpenAlex
- W4288617757
- Cited by
- 297
- References
- 68
- Citations by year
- 2026: 23 · 2025: 45 · 2024: 38 · 2023: 61 · 2022: 49 · 2021: 45 · 2020: 25 · 2019: 8
- FWCI
- 33.19
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Discrimination and Equality Law
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- test fairness, educational testing, algorithmic fairness, fairness criteria, fairness measurement, subgroup fairness, history of testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.