CoChat

Managing Bias in AI

Open access
Roselli, Drew, Matthews, Jeanna, Talagala, Nisha · 2019 · Companion Proceedings of The 2019 World Wide Web Conference

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.

Abstract

Recent awareness of the impacts of bias in AI algorithms raises the risk for companies to deploy such algorithms, especially because the algorithms may not be explainable in the same way that non-AI algorithms are. Even with careful review of the algorithms and data sets, it may not be possible to delete all unwanted bias, particularly because AI systems learn from historical data, which encodes historical biases. In this paper, we propose a set of processes that companies can use to mitigate and manage three general classes of bias: those related to mapping the business intent into the AI implementation, those that arise due to the distribution of samples used for training, and those that are present in individual input samples. While there may be no simple or complete solution to this issue, best practices can be used to reduce the effects of bias on algorithmic outcomes.

Overview

Integrity signals

Registry

Crossref · 10.1145/3308560.3317590

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 25 references

Research works printed but not linked: 11

  1. Kahn , J. ( 2018 ). “ Artificial Intelligence Has Some Explaining to Do ”. Bloomberg Businessweek , 12 Dec 2018. Kahn, J. (2018). “Artificial Intelligence Has Some Explaining to Do”. Bloomberg Businessweek, 12 Dec 2018.
  2. 10.5555/3157382.3157584 · doi:10.5555/3157382.3157584
  3. Angwin , J. , Larson , J , Mattu , S. , and Kirchner , L . ( 2016 ). “ Machine Bias: There's software used across the country to predict future criminals. And it's biased against blacks ”. ProPublica , 23 May 2016. Angwin, J., Larson, J, Mattu, S., and Kirchner, L. (2016). “Machine Bias: There's software used across the country to predict future criminals. And it's biased against blacks”. ProPublica, 23 May 2016.
  4. Hao , K. ( 2019 ). “ This is How AI Bias Really Happens -— and Why It's so Hard to Fix ” . MIT Technology Review , 4 Feb 2019. Hao, K. (2019). “This is How AI Bias Really Happens -— and Why It's so Hard to Fix”. MIT Technology Review, 4 Feb 2019.
  5. Del Balso , M. and Hermann , J . ( 2017 ). “ Meet Michelangelo: Uber's Machine Learning Platform ”. Uber Engineering , 5 Sep 2017. Del Balso, M. and Hermann, J. (2017). “Meet Michelangelo: Uber's Machine Learning Platform”. Uber Engineering, 5 Sep 2017.
  6. Vincent , J. ( 2016 ). “ Twitter taught Microsoft's AI chatbot to be a racist asshole in less than a day ”. The Verge , 24 Mar 2016. Vincent, J. (2016). “Twitter taught Microsoft's AI chatbot to be a racist asshole in less than a day”. The Verge, 24 Mar 2016.
  7. Buolamwini , J. ( 2019 ). “ Aritificial Intelligence Has a Problem with Gender and Racial Bias ”. TIME , 7 Feb 2019. Buolamwini, J. (2019). “Aritificial Intelligence Has a Problem with Gender and Racial Bias”. TIME, 7 Feb 2019.
  8. Ghanta , S. and Talagala N . ( 2018 ). “ MLOps Health: Taking the Pulse of ML in Production ”. ITOpsTimes , 10 July 2018. Ghanta, S. and Talagala N. (2018). “MLOps Health: Taking the Pulse of ML in Production”. ITOpsTimes, 10 July 2018.
  9. ACM US Public Policy Council (USACM) ( 2017 ). Statement on Algorithmic Transparency and Accountability . January 12 , 2017 . https://www.acm.org/binaries/content/assets/public-policy/2017_usacm_statement_algorithms.pdf ACM US Public Policy Council (USACM) (2017). Statement on Algorithmic Transparency and Accountability. January 12, 2017. https://www.acm.org/binaries/content/assets/public-policy/2017_usacm_statement_algorithms.pdf
  10. Reisman , D. , Schultz , J. , Crawford , K. , and Whittaker , M . ( 2018 ). Algorithmic impact assessments: A practical framework for public agency accountability. AI Now institute . Apr. 2018. https://ainowinstitute.org/aiareport2018.pdf Reisman, D., Schultz, J., Crawford, K., and Whittaker, M. (2018). Algorithmic impact assessments: A practical framework for public agency accountability. AI Now institute. Apr. 2018. https://ainowinstitute.org/aiareport2018.pdf
  11. Caplan , R. , Donovan , J. , Hanson , L. , and Matthews , J . ( 2018 ). Algorithmic accountability primer . Data & Society . Apr. 2018. https://datasociety.net/wp-content/uploads/2018/04/Data_Society_Algorithmic_Accountability_Primer_FINAL-4.pdf Caplan, R., Donovan, J., Hanson, L., and Matthews, J. (2018). Algorithmic accountability primer. Data & Society. Apr. 2018. https://datasociety.net/wp-content/uploads/2018/04/Data_Society_Algorithmic_Accountability_Primer_FINAL-4.pdf

Cited by

See all 372

Metadata

Authors
Roselli, D., Matthews, J., & Talagala, N.
Affiliations
  • ParallelM
  • Clarkson University (US)
Venue
Companion Proceedings of The 2019 World Wide Web Conference
Publisher
ACM
Published
2019-05-13
Pages
539-544
OpenAlex
W2946647999
Cited by
237
References
25
Citations by year
2026: 34 · 2025: 61 · 2024: 53 · 2023: 49 · 2022: 24 · 2021: 12 · 2020: 3 · 2019: 1
FWCI
10.43
Type
conference paper
Language
en
Open access
Locations
International World Wide Web Conference (WWW) (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
Keywords
algorithmic bias, bias mitigation, AI governance, historical bias, training data distribution, explainability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Managing Bias in AI. https://app.cochat.ai/papers/10.1145/3308560.3317590
The paper
Roselli, D., Matthews, J., & Talagala, N. (2019). Managing Bias in AI. Companion Proceedings of The 2019 World Wide Web Conference. https://doi.org/10.1145/3308560.3317590

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.