The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Discrimination in online ad delivery
Abstract
Google ads, black names and white names, racial discrimination, and click advertising.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The impact of this work is undeniable -leading to voluntary moratoriums [30], and several successful lawsuits [75,79]; nation-wide waves of regulatory action and public outcry [74]; congressional hearings [3]; and the recalls or radical redesigns of the deployed algorithms [12,64,65,88].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [79]
In the citing paper
“This is not to say that algorithmic profiling is not problematic.”
From Artificial intelligence in support of the circular economy: ethical considerations and a path forward (2024) · cites this paper as Sweeney 2013
Citations
Cites
Bertrand, M., & Mullainathan, S. (2004) · American Economic Review · doi:10.1257/0002828042002561 · Cited by 4,504
Pang, B., & Lee, L. (2004) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1218955.1218990 · Cited by 3,376
(2004) · Choice Reviews Online · doi:10.5860/choice.41-2555 · Cited by 1,030
The Causes and Consequences of Distinctively Black Names
Fryer, R. G., & Levitt, S. D. (2004) · The Quarterly Journal of Economics · doi:10.1162/0033553041502180 · Cited by 669
Sweeney, L. (2013) · Queue · doi:10.1145/2460276.2460278 · Cited by 477
Self-citationUniform Guidelines on Employee Selection Procedures
Scheer, T. J. (2007) · Routledge eBooks · doi:10.1081/e-epap2-407 · Cited by 403
Equal Employment Opportunity Commission
(2012) · CQ Press eBooks · doi:10.4135/9781452241067.n3 · Cited by 275
Harris, P. M., & Keller, K. S. (2004) · Journal of Contemporary Criminal Justice · doi:10.1177/1043986204271678 · Cited by 154
The Causes and Consequences of Distinctively Black Names
Fryer, R. G., & Levitt, S. D. (2003) · National Bureau of Economic Research · doi:10.3386/w9938 · Cited by 55
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2011) · arXiv · doi:10.48550/arxiv.1104.3913 · Cited by 55
Research works printed but not linked: 6
- Central Hudson Gas & Electric Corp , v. Public Service Commission of New York. Supreme Court of the United States, 447 U.S. 557 , 1980 . Central Hudson Gas & Electric Corp, v. Public Service Commission of New York. Supreme Court of the United States, 447 U.S. 557, 1980.
- Google . Google announces first quarter 2011 financial results ; http://investor.google.com/earnings/ 2011 /Q1_google_earnings.html. Google. Google announces first quarter 2011 financial results; http://investor.google.com/earnings/2011/Q1_google_earnings.html.
- Panel on Methods for Assessing Discrimination , National Research Council. Measuring racial discrimination . National Academy Press , Washington, DC , 2004 . Panel on Methods for Assessing Discrimination, National Research Council. Measuring racial discrimination. National Academy Press, Washington, DC, 2004.
- Sweeney , L. Discrimination in online ad delivery ( 2013 ). ( For de tails, see full technical report at http://ssrn.com/abstract=2208240. Data, including Web pages and ads, archived at http://foreverdata.org/onlineads). Sweeney, L. Discrimination in online ad delivery (2013). (For details, see full technical report at http://ssrn.com/abstract=2208240. Data, including Web pages and ads, archived at http://foreverdata.org/onlineads).
- U.S. Commission on Civil Rights. Racism in America and how to combat it . Washington, DC , 1970 . U.S. Commission on Civil Rights. Racism in America and how to combat it. Washington, DC, 1970.
- WebShot Command Line Server Edition. Version 1.9.1.1; http://www.websitescreenshots.com/. WebShot Command Line Server Edition. Version 1.9.1.1; http://www.websitescreenshots.com/.
Cited by
Sorted by citations
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567
“This is shown, for example, by profiling algorithms that inadvertently discriminate against marginalised populations (Barocas and Selbst, 2015; Birrer, 2005), as seen in delivery of online advertisements according to perceived ethnicity (Sweeney, 2013).”
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
“Documented cases of automated prejudice range from online advertising (Sweeney, 2013) to criminal sentencing (Angwin et al., 2016).”
BackgroundOn the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615
“A number of online systems have been shown to exhibit various biases, such as racial discrimination and gender bias in the ads presented to users [36, 6].”
Background
Metadata
- Authors
- Sweeney, L.
- Affiliations
- Harvard University (US)
- Corresponding author
- Sweeney, Latanya
- ORCID
- Sweeney, Latanya
- Venue
- Communications of the ACM
- Published
- 2013-05
- Volume
- 56
- Issue
- 5
- Pages
- 44-54
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2095932468
- Cited by
- 783
- References
- 10
- Citations by year
- 2026: 30 · 2025: 53 · 2024: 61 · 2023: 109 · 2022: 78 · 2021: 84 · 2020: 91 · 2019: 82 · 2018: 69 · 2017: 53 · 2016: 37 · 2015: 18 · 2014: 16 · 2013: 2
- FWCI
- 63.66
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Communications of the ACM (publishedVersion)
- Funders
- Division of Computer and Network Systems (CNS-1237235)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Social Sciences › Law › Discrimination and Equality Law
- Keywords
- online advertising, racial discrimination, algorithmic discrimination, Google AdWords, algorithmic fairness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
