Quantifying explainable discrimination and removing illegal discrimination in automated decision making
The DOI matches its Crossref record; 34 of the 36 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“If a classification algorithm is planned, specific pre-processing methods can be applied to prevent discrimination, including minimally intrusive data modifications that lead to an unbiased dataset [92,96] with additional techniques involving selective instances relabelling ('massaging'), suppression and reweighing [96,162].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [162]
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 1×
“[10], a synthetic minority oversampling technique (SMOTE) for two-class problems that over-sampled the minority class by creating synthetic examples rather than replicating examples is proposed.”
BackgroundUCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,370
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947 · cited 1×
“[9] also utilize a wrapper [27] approach to determine the percentage of minority class examples to be added to the training set and the percentage to under-sample the majority class examples.”
MethodThe Economics of Discrimination.
Collard, D., & Becker, G. S. (1972) · The Economic Journal · doi:10.2307/2230052 · Cited by 3,573
The interpretation of interaction in contingency tables
Simpson, E. H. (1951) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1951.tb00088.x · Cited by 2,301 · cited 1×
“This case illustrates the Simpson’s paradox [38], in which a relation present in different groups is reversed when the groups are combined.”
BackgroundThe foundations of cost-sensitive learning
Elkan, C. (2001) · Cited by 1,945
The Economics of Discrimination
Becker, G. S. (1971) · doi:10.7208/chicago/9780226041049.001.0001 · Cited by 1,794
Data preprocessing techniques for classification without discrimination
Kamiran, F., & Calders, T. (2012) · Knowledge and Information Systems · doi:10.1007/s10115-011-0463-8 · Cited by 1,305 · cited 6×
“– Local preferential sampling builds upon data preprocessing method due [24,25], where data are resampled with replacement in such a way that the input dataset becomes discrimination-free.”
MethodInfluentialSelf-citationMetaCost: a general method for making classifiers cost-sensitive
Domingos, P. (1999) · Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/312129.312220 · Cited by 1,303 · cited 3×
“Domingos proposes a method named MetaCost [14] for making classifiers costsensitive by wrapping a cost-minimizing procedure around them.”
MethodThree naive Bayes approaches for discrimination-free classification.
Calders, T., & Verwer, S. (2010) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-010-0190-x · Cited by 764 · cited 2×
“The previous works solve the problem by introducing a reverse discrimination either in the training data [6,24] or pushing constraints into the trained classifiers [7,26].”
MethodSelf-citationDiscrimination-aware data mining
Pedreshi, D., Ruggieri, S., & Turini, F. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401959 · Cited by 676 · cited 2×
“In discrimination-aware data mining there are two important directions to work on: discrimination discovery from the given datasets [20,21,32,33,35,36] and the discrimination prevention from the future decision making [7,23–26,47].”
BackgroundMethodBickel, P. J., Hammel, E. A., & O'Connell, J. W. (1975) · Science · doi:10.1126/science.187.4175.398 · Cited by 659 · cited 1×
“We can also report a similar case from the Berkely study [5] where the examination of aggregate data on graduate admissions to the University of California, Berkeley, for fall 1973 shows a clear but misleading pattern of bias against female applicants.”
ResultBuilding Classifiers with Independency Constraints
Calders, T., Kamiran, F., & Pechenizkiy, M. (2009) · 2009 IEEE International Conference on Data Mining Workshops · doi:10.1109/icdmw.2009.83 · Cited by 468 · cited 5×
“Next we investigate to what extent the two existing global techniques [7, 24] remove illegal discrimination.”
BackgroundMethodInfluentialSelf-citationChan, P. K., & Stolfo, S. J. (1998) · Cited by 452
Classifying without discriminating
Kamiran, F., & Calders, T. (2009) · 2009 2nd International Conference on Computer, Control and Communication · doi:10.1109/ic4.2009.4909197 · Cited by 409 · cited 2×
“In discrimination-aware data mining there are two important directions to work on: discrimination discovery from the given datasets [20, 21, 32, 33, 35, 36], and the discrimination prevention from the future decision making [8, 23–26, 47].”
BackgroundResultSelf-citationThe Economics of Discrimination
Dewey, D., & Becker, G. S. (1958) · Southern Economic Journal · doi:10.2307/1055714 · Cited by 384
Discrimination Aware Decision Tree Learning
Kamiran, F., Calders, T., & Pechenizkiy, M. (2010) · 2010 IEEE International Conference on Data Mining · doi:10.1109/icdm.2010.50 · Cited by 303 · cited 3×
“The previous works solve the problem by introducing a reverse discrimination either in the training data [6,24] or pushing constraints into the trained classifiers [7,26].”
BackgroundMethodSelf-citationBoosting support vector machines for imbalanced data sets
Wang, B. X., & Japkowicz, N. (2010) · Knowledge and Information Systems · doi:10.1007/s10115-009-0198-y · Cited by 281 · cited 1×
“In Cost-Sensitive and Utility-Based learning [8,16,31,40,46], it is assumed that not all types of prediction errors are equal and not all examples are as important.”
Backgroundk-NN as an implementation of situation testing for discrimination discovery and prevention
Luong, B. T., Ruggieri, S., & Turini, F. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020488 · Cited by 263 · cited 4×
“There is, however, one big difference: whereas in massaging only the minimal number of objects is changed to remove all discrimination from the dataset, the authors of [30] propose to continue relabeling until all labels are consistent.”
BackgroundInfluentialEllis, E., & Watson, P. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199698462.001.0001 · Cited by 200
Measuring Discrimination in Socially-Sensitive Decision Records
Pedreschi, D., Ruggieri, S., & Turini, F. (2009) · Proceedings of the 2009 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972795.50 · Cited by 174 · cited 2×
“In discrimination-aware data mining there are two important directions to work on: discrimination discovery from the given datasets [20,21,32,33,35,36] and the discrimination prevention from the future decision making [7,23–26,47].”
BackgroundMethodEvaluation of contextual information retrieval effectiveness: overview of issues and research
Tamine-Lechani, L., Boughanem, M., & Daoud, M. (2010) · Knowledge and Information Systems · doi:10.1007/s10115-009-0231-1 · Cited by 160
Handling Conditional Discrimination
liobaite, I., Kamiran, F., & Calders, T. (2011) · 2011 IEEE 11th International Conference on Data Mining · doi:10.1109/icdm.2011.72 · Cited by 125
Self-citationThe Economics of Discrimination
Krueger, A. O. (1963) · Journal of Political Economy · doi:10.1086/258796 · Cited by 122
The Economics of Discrimination against Women: Some New Findings
Sawhill, I. V. (1973) · The Journal of Human Resources · doi:10.2307/144710 · Cited by 98 · cited 1×
“Becher’s work got a lot of attention from the research community and resulted in many critical reviews [12,14,29,34,37] on this book which proposed new directions to study the economic discrimination.”
BackgroundDiscrimination prevention in data mining for intrusion and crime detection
Hajian, S., Domingo-Ferrer, J., & Martinez-Balleste, A. (2011) · 2011 IEEE Symposium on Computational Intelligence in Cyber Security (CICS) · doi:10.1109/cicybs.2011.5949405 · Cited by 67 · cited 3×
“The authors of [20,21] also propose methods similar to local massaging to preprocess the training data in such a way that only potentially non-discriminatory rules can be extracted.”
BackgroundMethodImproving SVM classification on imbalanced time series data sets with ghost points
Köknar-Tezel, S., & Latecki, L. J. (2010) · Knowledge and Information Systems · doi:10.1007/s10115-010-0310-3 · Cited by 63
DCUBE: discrimination discovery in databases
Ruggieri, S., Pedreschi, D., & Turini, F. (2010) · Proceedings of the 2010 ACM SIGMOD International Conference on Management of data · doi:10.1145/1807167.1807298 · Cited by 52 · cited 2×
“In discrimination-aware data mining there are two important directions to work on: discrimination discovery from the given datasets [20,21,32,33,35,36] and the discrimination prevention from the future decision making [7,23–26,47].”
BackgroundRule Protection for Indirect Discrimination Prevention in Data Mining
Hajian, S., Domingo‐Ferrer, J., & Martínez-Ballesté, A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22589-5_20 · Cited by 47
Integrating induction and deduction for finding evidence of discrimination
Ruggieri, S., Pedreschi, D., & Turini, F. (2010) · Artificial Intelligence and Law · doi:10.1007/s10506-010-9089-5 · Cited by 44 · cited 2×
“In discrimination-aware data mining there are two important directions to work on: discrimination discovery from the given datasets [20,21,32,33,35,36] and the discrimination prevention from the future decision making [7,23–26,47].”
BackgroundEuropean Network Against Racism
Caruso, J. D. J. (2009) · Cited by 39
Wrapper-based computation and evaluation of sampling methods for imbalanced datasets
Chawla, N. V., Hall, L., & Joshi, A. (2005) · doi:10.1145/1089827.1089830 · Cited by 33 · cited 1×
“[9] also utilize a wrapper [27] approach to determine the percentage of minority class examples to be added to the training set and the percentage to under-sample the majority class examples.”
MethodLearning decision trees for loss minimization in multi-class problems
Margineantu, D. D., & Dietterich, T. G. (1999) · Cited by 18
Hodges, C. (2009) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716208328287 · Cited by 17
Research works printed but not linked: 3
- Hart M (2005) Subjective decisionmaking and unconscious discrimination. Alabama Law Rev 56:741
- Kamiran F, Calders T (2010) Classification with no discrimination by preferential sampling. In: Proceedings of the 19th annual machine learning conference of Belgium and the Netherlands (BENELEARN’10), pp 1–6
- Reder M (1958) The economics of discrimination. Am Econ Rev 48(3):495–500
Cited by
Fisher, A., Rudin, C., & Dominici, F. (2018) · arXiv · doi:10.48550/arxiv.1801.01489 · Cited by 1,165
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
The Measure and Mismeasure of Fairness
Corbett-Davies, S., Gaebler, J. D., Nilforoshan, H., Shroff, R., & Goel, S. (2018) · arXiv · doi:10.48550/arxiv.1808.00023 · Cited by 444
“…received considerable attention in the machine learning community (Agarwal et al., 2018; Calders and Verwer, 2010; Chouldechova, 2017; Edwards and Storkey, 2015; Feldman et al., 2015; Hardt et al., 2016; Kamiran et al., 2013; Pedreshi et al., 2008; Zafar et al., 2015, 2017; Zemel et al., 2013).”
BackgroundMethodMeasuring discrimination in algorithmic decision making
Žliobaitė, I. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-017-0506-1 · Cited by 272
“Unexplained difference (Kamiran et al. 2013) is measured, as the name suggests, as the overall mean difference minus the differences that can be explained by another legitimate variable.”
BackgroundMethodSelf-citationA survey on datasets for fairness‐aware machine learning
Le Quy, T., Roy, A., Iosifidis, V., Zhang, W., & Ntoutsi, E. (2022) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1452 · Cited by 261
Metadata
- Authors
- Kamiran, F., Žliobaitė, I., & Calders, T.
- Affiliations
- King Abdullah University of Science and Technology (SA)
- Bournemouth University (GB)
- Eindhoven University of Technology (NL)
- Corresponding author
- Kamiran, Faisal
- Venue
- Knowledge and Information Systems
- Published
- 2012-11-18
- Volume
- 35
- Issue
- 3
- Pages
- 613-644
- ISSN
- 0219-1377 (ISSN-L)
- 0219-3116
- OpenAlex
- W2083685419
- Cited by
- 99
- References
- 36
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 15 · 2023: 13 · 2022: 13 · 2021: 17 · 2020: 9 · 2019: 9 · 2018: 6 · 2017: 6 · 2016: 3 · 2014: 2 · 2012: 1
- FWCI
- 2.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Knowledge and Information Systems (publishedVersion)
- TU/e Research Portal (publishedVersion)
- TU/e Research Portal (submittedVersion)
- Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) (submittedVersion)
- King Abdullah University of Science and Technology Repository (King Abdullah University of Science and Technology) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Discrimination and Equality Law
- Keywords
- algorithmic discrimination, automated decision-making, sensitive attributes, gender discrimination, reverse discrimination, algorithmic fairness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.