Cited by 337Ethics and Social Impacts of AIArtificial Intelligence in LawExplainable Artificial Intelligence (XAI)

The Ugly Truth About Ourselves and Our Robot Creations: The Problem of Bias and Social Inequity

Howard, Ayanna, Borenstein, Jason·2018·Science and Engineering Ethics

Abstract

Recently, there has been an upsurge of attention focused on bias and its impact on specialized artificial intelligence (AI) applications. Allegations of racism and sexism have permeated the conversation as stories surface about search engines delivering job postings for well-paying technical jobs to men and not women, or providing arrest mugshots when keywords such as "black teenagers" are entered. Learning algorithms are evolving; they are often created from parsing through large datasets of online information while having truth labels bestowed on them by crowd-sourced masses. These specialized AI algorithms have been liberated from the minds of researchers and startups, and released onto the public. Yet intelligent though they may be, these algorithms maintain some of the same biases that permeate society. They find patterns within datasets that reflect implicit biases and, in so doing, emphasize and reinforce these biases as global truth. This paper describes specific examples of how bias has infused itself into current AI and robotic systems, and how it may affect the future design of such systems. More specifically, we draw attention to how bias may affect the functioning of (1) a robot peacekeeper, (2) a self-driving car, and (3) a medical robot. We conclude with an overview of measures that could be taken to mitigate or halt bias from permeating robotic technology.

Integrity signals

Registry

Crossref · 10.1007/s11948-017-9975-2

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Human-induced bias is intentionally or unintentionally written by the developers because individuals are always influenced by their own moral perceptions and relevant interests, which affects data training.

    “Human-induced bias is intentionally or unintentionally written by the developers because individuals are always influenced by their own moral perceptions and relevant interests, which affects data training”
  • AI systems can encapsulate biases and inequalities that can have societal impact.

    “Various high-profle controversies (e.g.[10,22,112]) have raised concerns over the technology's potential to both perpetuate existing societal inequalities and introduce new types of discrimination [52,67,116].”
  • AI applications released to the public are not free from racial and gender biases.

    “AI applications released to the public are not free from racial and gender biases (Chen, Szolovits & Ghassemi, 2019; Howard & Borenstein, 2018).”

    From Digital ageism: challenges and opportunities in artificial intelligence for older adults (2022) · cites this paper as Howard & Borenstein, 2018

Cites

Flagged first, then by citations

2 of the 26 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Howard, A., & Borenstein, J.
Affiliations
Georgia Institute of Technology (US)
Corresponding author
Borenstein, Jason
Venue
Science and Engineering Ethics
Published
2017-09-21
Volume
24
Issue
5
Pages
1521-1536
ISSN
  • 1353-3452 (ISSN-L)
  • 1471-5546
OpenAlex
W2760062370
Cited by
337
References
26
Citations by year
2026: 29 · 2025: 64 · 2024: 53 · 2023: 59 · 2022: 38 · 2021: 49 · 2020: 27 · 2019: 13 · 2018: 4 · 2017: 1
FWCI
28.19
Type
journal article
Language
en
Open access
closed
Locations
  • Science and Engineering Ethics (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Political Science and International Relations › Artificial Intelligence in Law
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Keywords
algorithmic bias, artificial intelligence, social inequities, implicit bias, racial bias, gender bias, autonomous vehicles, medical robots, bias mitigation, robot ethics
MeSH terms
Algorithms, Artificial Intelligence, Automobiles, Female, Humans, Learning, Male, Prejudice, Robotics, Social Justice, Bias, Biomedical Technology, Racism, Sexism, Datasets as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review