The DOI matches its Crossref record.
Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Abstract
Automation has been key to Amazon&s;s e-commerce dominance, be it inside warehouses or driving pricing decisions. The company&s;s experimental hiring tool used artificial intelligence to give job candidates scores ranging from one to five stars - much like shoppers rate products on Amazon. In effect, Amazon&s;s system taught itself that male candidates were preferable. It penalized resumes that included the word “women&s;s,” as in “women&s;s chess club captain.” And it downgraded graduates of two all-women&s;s colleges, according to people familiar with the matter. Amazon&s;s experiment began at a pivotal moment for the world&s;s largest online retailer. Machine learning was gaining traction in the technology world. The American civil liberties union is currently challenging a law that allows criminal prosecution of researchers and journalists who test hiring websites&s; algorithms for discrimination.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The outcome ended discriminating women in the selection process [33].”
In the citing paper
“The algorithm applied the patterns in selecting individuals from the last 10 years, and it simply replicated that.”
In the citing paper
“In 2014, Amazon started to use an algorithm to select the top five CVs from one hundred applicants.”
In the citing paper
“Although it was removed as soon as the bias was detected, and the company states that it was never in use, it is a good illustration of gender discriminatory outcomes as the case study will demonstrate [33, 91].”
In the citing paper
“The model ended in penalising the word woman and favouring male applicants.”
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Still being checked.
Cited by
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224
Ethics of AI in Education: Towards a Community-Wide Framework
Holmes, W., Porayska-Pomsta, K., Holstein, K., Sutherland, E., Baker, T., Shum, S. B., Santos, O. C., Rodrigo, M. T., Cukurova, M., Bittencourt, I. I., et al. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00239-1 · Cited by 1,437
Artificial Intelligence and Business Value: a Literature Review
Enholm, I. M., Papagiannidis, E., Mikalef, P., & Krogstie, J. (2022) · Information Systems Frontiers · doi:10.1007/s10796-021-10186-w · Cited by 1,046
Aldoseri, A., Al-Khalifa, K. N., & Hamouda, A. M. (2023) · Applied Sciences · doi:10.3390/app13127082 · Cited by 716
Metadata
- Authors
- Dastin, J.
- Corresponding author
- Dastin, Jeffrey
- Venue
- Ethics of Data and Analytics
- Publisher
- Auerbach Publications
- Published
- 2022-03-16
- Pages
- 296-299
- OpenAlex
- W4220820301
- Cited by
- 1,165
- References
- 0
- Citations by year
- 2026: 74 · 2025: 251 · 2024: 194 · 2023: 245 · 2022: 154
- FWCI
- 741.96
- Type
- book chapter
- Language
- en
- Open access
- closed
- Locations
- Auerbach Publications eBooks (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- Amazon, algorithmic discrimination, gender bias, automated hiring, machine learning, women in technology, algorithmic accountability, American Civil Liberties Union, algorithmic auditing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *. https://app.cochat.ai/papers/10.1201/9781003278290-44
- The paper
- Dastin, J. (2022). Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *. Ethics of Data and Analytics. https://doi.org/10.1201/9781003278290-44
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.