CoChat

Survey on Machine Learning Biases and Mitigation Techniques

Open access

The DOI matches its Crossref record; 90 of the 90 references it cites were found in a registry or an index.

Abstract

Machine learning (ML) has become increasingly prevalent in various domains. However, ML algorithms sometimes give unfair outcomes and discrimination against certain groups. Thereby, bias occurs when our results produce a decision that is systematically incorrect. At various phases of the ML pipeline, such as data collection, pre-processing, model selection, and evaluation, these biases appear. Bias reduction methods for ML have been suggested using a variety of techniques. By changing the data or the model itself, adding more fairness constraints, or both, these methods try to lessen bias. The best technique relies on the particular context and application because each technique has advantages and disadvantages. Therefore, in this paper, we present a comprehensive survey of bias mitigation techniques in machine learning (ML) with a focus on in-depth exploration of methods, including adversarial training. We examine the diverse types of bias that can afflict ML systems, elucidate current research trends, and address future challenges. Our discussion encompasses a detailed analysis of pre-processing, in-processing, and post-processing methods, including their respective pros and cons. Moreover, we go beyond qualitative assessments by quantifying the strategies for bias reduction and providing empirical evidence and performance metrics. This paper serves as an invaluable resource for researchers, practitioners, and policymakers seeking to navigate the intricate landscape of bias in ML, offering both a profound understanding of the issue and actionable insights for responsible and effective bias mitigation.

Overview

Integrity signals

Registry

Crossref · 10.3390/digital4010001

Cites

90 of 90 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 10

  1. Abay, A., Zhou, Y., Baracaldo, N., Rajamoni, S., Chuba, E., and Ludwig, H. (2020). Mitigating bias in federated learning. arXiv.
  2. Krco, N., Laugel, T., Loubes, J.M., and Detyniecki, M. (2023). When Mitigating Bias is Unfair: A Comprehensive Study on the Impact of Bias Mitigation Algorithms. arXiv.
  3. Wang, Z., Zhou, Y., Qiu, M., Haque, I., Brown, L., He, Y., Wang, J., Lo, D., and Zhang, W. (2023). Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking. arXiv.
  4. Chen, Z., Zhang, J.M., Sarro, F., and Harman, M. (2022). A comprehensive empirical study of bias mitigation methods for software fairness. arXiv.
  5. Ranjit, J., Wang, T., Ray, B., and Ordonez, V. (2023). Variation of Gender Biases in Visual Recognition Models Before and After Finetuning. arXiv.
  6. Zhang, G., Li, Y., Wu, Y., Zhang, L., Lin, C., Geng, J., Wang, S., and Fu, J. (2023). CORGI-PM: A Chinese Corpus For Gender Bias Probing and Mitigation. arXiv.
  7. Saxena, N.A., Zhang, W., and Shahabi, C. (2023). Unveiling and Mitigating Bias in Ride-Hailing Pricing for Equitable Policy Making. arXiv.
  8. Li, T., Higgins, J.P., and Deeks, J.J. (2019). Cochrane Handbook for Systematic Reviews of Interventions, Wiley Online Library.
  9. Parraga, O., More, M.D., Oliveira, C.M., Gavenski, N.S., Kupssinskü, L.S., Medronha, A., Moura, L.V., Simões, G.S., and Barros, R.C. (2022). Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Survey. arXiv.
  10. Zhang, Z., Wang, S., and Meng, G. (2023). Advances in Natural Computation, Fuzzy Systems and Knowledge Discovery: Proceedings of the ICNC-FSKD 2022, Fuzhou, China, 30 July–1 August 2022, Springer International Publishing.

Cited by

See all 127

Metadata

Authors
Siddique, S., Haque, M. A., George, R., Gupta, K. D., Gupta, D., & Faruk, M. J. H.
Affiliations
  • Daffodil International University (BD)
  • Clark Atlanta University (US)
  • Wake Forest University (US)
  • New York Institute of Technology (US)
Corresponding author
Siddique, Sunzida
Venue
Digital
Publisher
MDPI AG
Published
2023-12-20
Volume
4
Issue
1
Pages
1-68
ISSN
2673-6470 (ISSN-L)
OpenAlex
W4390033118
Cited by
78
References
89
Citations by year
2026: 25 · 2025: 41 · 2024: 12
FWCI
19.56
Type
journal article
Language
en
Open access
Locations
  • Digital (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Greater South Information System
Funders
  • NSF (2306109, P116Z220008)
  • DOEd (2306109, P116Z220008)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
Keywords
machine learning bias, bias mitigation, algorithmic fairness, discrimination, adversarial training, post-processing, fairness constraints

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.