CoChat

The ethics of algorithms: key problems and solutions

Open access

The DOI matches its Crossref record; 164 of the 165 references it cites were found in a registry or an index; 14 of the 161 sources its claims cite were checked for support.

Abstract

Research on the ethics of algorithms has grown substantially over the past decade. Alongside the exponential development and application of machine learning algorithms, new ethical problems and solutions relating to their ubiquitous use in society have been proposed. This article builds on a review of the ethics of algorithms published in 2016 (Mittelstadt et al. Big Data Soc 3(2), 2016). The goals are to contribute to the debate on the identification and analysis of the ethical implications of algorithms, to provide an updated analysis of epistemic and normative concerns, and to offer actionable guidance for the governance of the design, development and deployment of algorithms.

Overview

CoChat Summary

TL;DR

This article updates the 2016 Mittelstadt et al. review on the ethics of algorithms, using a systematic literature search to map epistemic and normative concerns and proposed solutions. It argues that the original six-category conceptual map remains useful while extending the analysis to newer topics such as AI for social good.

Key findings

  • The updated systematic review identified 4,891 unique papers; after title/abstract screening, 180 were selected for full review, 62 were rejected as off-topic, leaving 118 articles for full review, with another 37 articles/books reviewed and referenced for additional detail.
  • The 2016 conceptual map remains a fruitful framework, identifying six ethical concerns: inconclusive evidence, inscrutable evidence, misguided evidence, unfair outcomes, transformative effects, and traceability.
  • The paper reports that algorithmic fairness lacks agreement: Wong identifies up to 21 definitions of fairness, often mutually inconsistent, while four prominent definitions are anti-classification, classification parity, calibration, and statistical parity.
  • Proposed solutions discussed include datasheets/documentation, auditing and algorithmic impact assessments, explainability tools, participatory design and Society-in-the-Loop, differential privacy, and responsibility frameworks such as Floridi’s default-and-overridable distributed moral responsibility.

Methods

  • A systematic literature search was performed via keyword queries on four reference repositories (Scopus, Web of Science, PhilPapers, Google Scholar), using keywords for algorithms—‘algorithm’, ‘machine learning’, ‘software’, ‘computer program’—plus ethics-related terms, limited to November 2016–March 2020.
  • The search identified 4,891 unique papers; title/abstract review selected 180 for full review; 62 were rejected as off-topic, leaving 118 articles for full review, plus 37 additional articles/books referenced for specific issues and solutions.
  • The analysis is a systematic search and review (Grant and Booth 2009), organized around the six-category conceptual map from Mittelstadt et al. (2016).

Limitations

  • Stated: the literature search was limited to English-language articles in peer-reviewed journals and conference proceedings; many results were purely technical, especially for “discrimination” and “(transparency OR scrutability OR opacity)”.
  • Stated/evident: the article is an update and review, not new empirical research; its conclusions synthesize the reviewed literature and the authors’ conceptual map.
  • Evident: the authors note the 2016 article is outdated in specific references and details, though they argue the map and six categories have withstood the test of time; coverage ends March 2020, so later literature is not included.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s00146-021-01154-8

Cites

164 of 165 references verified1 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Six types of ethical concerns raised by algorithms (Mittelstadt et al. 2016, 4)
Fig. 1 Six types of ethical concerns raised by algorithms (Mittelstadt et al. 2016, 4)CC-BY · From the PDF

Verification

Claims the paper makes

12 Valid · 1 Not valid · 84 Not checked · 21 Own results and interpretations

51 more claims · 5 with their cited sources checked

Create a free account to see all 118 claims and to verify the 147 references still open.

See all claims — free account
  • It may state two separate claims as one. 40
  • Probably not a substantial claim. 30

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 165 references

Research works printed but not linked: 3

  1. Bambauer J, Zarsky T (2018) The algorithmic game. Notre Dame Law Rev 94(1):1–47
  2. Murgia M (2018) DeepMind’s move to transfer health unit to Google Stirs data fears. Financial Times, New York, p 2018
  3. Richardson R, Schultz J, Crawford K (2019) Dirty data, bad predictions: how civil rights violations impact police data, predictive policing systems, and justice. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3333423. Accessed 24 Aug 2020

Cited by

See all 385

Metadata

Authors
Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., & Floridi, L.
Affiliations
University of Oxford (GB)
Corresponding author
Floridi, Luciano
Venue
AI & SOCIETY
Published
2021-02-20
Volume
37
Issue
1
Pages
215-230
ISSN
  • 0951-5666 (ISSN-L)
  • 1435-5655
OpenAlex
W3129794348
Cited by
384
References
150
Citations by year
2026: 62 · 2025: 93 · 2024: 55 · 2023: 74 · 2022: 75 · 2021: 24
FWCI
71.27
Type
journal article
Language
en
Open access
Licence
Locations
AI & Society (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Law › Digitalization, Law, and Regulation
Keywords
algorithmic ethics, machine learning, algorithmic governance, algorithmic transparency, algorithmic accountability, normative concerns, algorithmic fairness, algorithmic bias, algorithmic decision-making

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The ethics of algorithms: key problems and solutions. https://app.cochat.ai/papers/10.1007/s00146-021-01154-8
The paper
Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., & Floridi, L. (2022). The ethics of algorithms: key problems and solutions. AI & SOCIETY. https://doi.org/10.1007/s00146-021-01154-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.