Cited by 1,387Ethics and Social Impacts of AIPrivacy-Preserving Technologies in DataExplainable Artificial Intelligence (XAI)

Mitigating Unwanted Biases with Adversarial Learning

Open access
Zhang, Brian Hu, Lemoine, Blake, Mitchell, Margaret·2018·Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society

Abstract

Machine learning is a tool for building models that accurately represent input training data. When undesired biases concerning demographic groups are in the training data, well-trained models will reflect those biases. We present a framework for mitigating such biases by including a variable for the group of interest and simultaneously learning a predictor and an adversary. The input to the network X, here text or census data, produces a prediction Y, such as an analogy completion or income bracket, while the adversary tries to model a protected variable Z, here gender or zip code. The objective is to maximize the predictor's ability to predict Y while minimizing the adversary's ability to predict Z. Applied to analogy completion, this method results in accurate predictions that exhibit less evidence of stereotyping Z. When applied to a classification task using the UCI Adult (Census) Dataset, it results in a predictive model that does not lose much accuracy while achieving very close to equality of odds (Hardt, et al., 2016). The method is flexible and applicable to multiple definitions of fairness as well as a wide range of gradient-based learning models, including both regression and classification tasks.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3278721.3278779

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Bias mitigation techniques in the literature are classified into pre-processing, in-processing, and post-processing.

    “Several techniques exist within the literature, classified in the following categories:”

    From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [397]

    The Related Work section describes several debiasing techniques, supporting the claim that techniques exist in the literature. It does not classify them as pre-processing, in-processing, and post-processing; searches for those terms found no such classification in our copy. No page number was available. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Adversarial learning can simultaneously learn a predictor and an adversary that models a protected variable, and by minimizing the adversary capacity to predict this protected variable, accurate predictions can show less stereotyping of the protected variable, almost achieving equality of odds as a fairness notion.

    “Here, adversarial learning [81] can simultaneously learn a predictor and an adversary that models a protected variable, and by minimizing the adversary capacity to predict this protected variable, accurate predictions can show less stereotyping of the protected variable, almost achieving equality of odds as a fairness notion.”
  • Such de-biasing approaches force the model to account for underrepresented groups and achieve better performance when applied to them.

    “Such approaches force the model to account for underrepresented groups and achieve a better performance when applied to them.”

    From Mitigating bias in machine learning for medicine (2021) · cites this paper as [9]

  • Mathematical approaches for de-biasing, such as adversarial de-biasing or oversampling, mitigate the risk of bias at the model development step.

    “Beyond creating diverse datasets for model development, there are mathematical approaches for de-biasing that mitigate the risk of bias at this step, such as adversarial de-biasing9 or oversampling10.”

    From Mitigating bias in machine learning for medicine (2021) · cites this paper as [9]

  • Recent developments in bias detection and mitigation include adopting re-sampling, adversarial learning, and open-source toolkits such as IBM AI Fairness 360 (AIF360) and Aequitas.

    “Recent developments in bias detection and mitigation also include methods such as adopting re-sampling118, adversarial learning119, and open-source toolkits such as IBM AI Fairness 360 (AIF360) (aif360.mybluemix.net) and Aequitas (dsapp.uchicago.edu/projects/aequitas).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; and Bengio, Y. 2014. Generative adversarial nets. In Advances in neural information processing systems, 2672-2680.

Cited by

Sorted by citations

Authors
Zhang, B. H., Lemoine, B., & Mitchell, M.
Affiliations
  • Stanford University (US)
  • Google (United States) (US)
Venue
Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society
Publisher
ACM
Published
2018-12-27
Pages
335-340
ISSN
3065-8365 (ISSN-L)
OpenAlex
W2784397426
Cited by
1,387
References
10
Citations by year
2026: 133 · 2025: 223 · 2024: 210 · 2023: 198 · 2022: 184 · 2021: 208 · 2020: 140 · 2019: 73 · 2018: 18
FWCI
196.47
Type
conference paper
Language
en
Open access
Locations
  • Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Keywords
adversarial learning, algorithmic fairness, protected characteristics, census classification, gender bias, stereotyping

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review