Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.

Fairness-aware machine learning engineering: how far are we?

Open access
Ferrara, Carmine, Sellitto, Giulia, Ferrucci, Filomena, Palomba, Fabio, De Lucia, Andrea · 2024 · Empirical Software Engineering

Abstract

Machine learning is part of the daily life of people and companies worldwide. Unfortunately, bias in machine learning algorithms risks unfairly influencing the decision-making process and reiterating possible discrimination. While the interest of the software engineering community in software fairness is rapidly increasing, there is still a lack of understanding of various aspects connected to fair machine learning engineering, i.e., the software engineering process involved in developing fairness-critical machine learning systems. Questions connected to the practitioners’ awareness and maturity about fairness, the skills required to deal with the matter, and the best development phase(s) where fairness should be faced more are just some examples of the knowledge gaps currently open. In this paper, we provide insights into how fairness is perceived and managed in practice, to shed light on the instruments and approaches that practitioners might employ to properly handle fairness. We conducted a survey with 117 professionals who shared their knowledge and experience highlighting the relevance of fairness in practice, and the skills and tools required to handle it. The key results of our study show that fairness is still considered a second-class quality aspect in the development of artificial intelligence systems. The building of specific methods and development environments, other than automated validation tools, might help developers to treat fairness throughout the software lifecycle and revert this trend.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10664-023-10402-y

Cites

73 of 73 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Study research method
Fig. 1 Study research methodCC BY · PubMed Central
Fig. 2 Structure of the Survey
Fig. 2 Structure of the SurveyCC BY · PubMed Central
Fig. 3 Well-known fairness-critical application domains
Fig. 3 Well-known fairness-critical application domainsCC BY · PubMed Central
Fig. 4 Practitioners’ opinions on the main categories of fairness notions
Fig. 4 Practitioners’ opinions on the main categories of fairness notionsCC BY · PubMed Central
Fig. 5 Fairness Trade-Offs Relevance By Sectors
Fig. 5 Fairness Trade-Offs Relevance By SectorsCC BY · PubMed Central
Fig. 6 Relevance of fairness at different stages of a typical ML pipeline
Fig. 6 Relevance of fairness at different stages of a typical ML pipelineCC BY · PubMed Central
Fig. 7 Practioners’ degree of experience with specific fairness management tools in an ML project
Fig. 7 Practioners’ degree of experience with specific fairness management tools in an ML projectCC BY · PubMed Central
Fig. 8 Professional roles required to manage fairness at different stages of an ML pipeline
Fig. 8 Professional roles required to manage fairness at different stages of an ML pipelineCC BY · PubMed Central
Fig. 9 Collaborations between professional roles required to manage fairness in a typical ML project
Fig. 9 Collaborations between professional roles required to manage fairness in a typical ML projectCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 69 references

Research works printed but not linked: 8

  1. Calmon FP, Wei D, Vinzamuri B, Ramamurthy KN, Varshney KR (2017) Optimized pre-processing for discrimination prevention. In: Proceedings of the 31st international conference on neural information processing systems, NIPS’17, Curran Associates Inc., Red Hook, NY, USA, pp 3995-4004
  2. Ebert F, Serebrenik A, Treude C, Novielli N, Castor, F (2022) On recruiting experienced github contributors for interviews and surveys on prolific. In: International workshop on recruiting participants for empirical software engineering
  3. Kusner MJ, Loftus J, Russell C, Silva R (2017) Counterfactual fairness. Adv Neural Inf Process Syst 30
  4. Le Quy T, Roy A, Iosifidis V, Zhang W, Ntoutsi E (2022) A survey on datasets for fairness-aware machine learning. Wiley Interdiscip Rev: Data Min Knowl Discov 12(3):e1452
  5. Mehrabi N, Morstatter F, Saxena N, Lerman K, Galstyan A (2021) A survey on bias and fairness in machine learning. ACM Comput. Surv 54(6). https://doi.org/10.1145/3457607 · DOI · Paper page
  6. Nemoto T, Beglar D (2014) Likert-scale questionnaires. In: JALT 2013 conference proceedings, pp 1–8. https://jalt-publications.org/sites/default/files/pdf-article/jalt2013_001.pdf
  7. Rech J, Althoff KD (2004) Artificial intelligence and software engineering: status and future trends. KI 18(3):5–11
  8. Verma S, Rubin J (2018) Fairness definitions explained. In: 2018 IEEE/ACM international workshop on software fairness (FairWare), pp 1–7. https://doi.org/10.23919/FAIRWARE.2018.8452913 · doi:10.23919/fairware.2018.8452913

Cited by

See all 60

Metadata

Authors
Ferrara, C., Sellitto, G., Ferrucci, F., Palomba, F., & De Lucia, A.
Affiliations
University of Salerno (IT)
Corresponding author
Ferrara, Carmine
Venue
Empirical Software Engineering
Published
2023-11-24
Volume
29
Issue
1
Pages
9-9
ISSN
  • 1382-3256 (ISSN-L)
  • 1573-7616
OpenAlex
W4388971801
Cited by
60
References
69
Citations by year
2026: 16 · 2025: 38 · 2024: 6
FWCI
15.01
Type
journal article
Language
en
Open access
Licence
Locations
  • Empirical Software Engineering (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (PZ00P2_186090)
  • Ministero dell’Universitá e della Ricerca (2020W3A5FY)
  • Ministero dell’Istruzione, dell’Universitá e della Ricerca (2022B3BP5S)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
Keywords
algorithmic fairness, algorithmic bias, software development lifecycle

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Fairness-aware machine learning engineering: how far are we? https://app.cochat.ai/papers/10.1007/s10664-023-10402-y
The paper
Ferrara, C., Sellitto, G., Ferrucci, F., Palomba, F., & De Lucia, A. (2024). Fairness-aware machine learning engineering: how far are we? Empirical Software Engineering. https://doi.org/10.1007/s10664-023-10402-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.