Discrimination in online ad delivery

Sweeney, Latanya

doi:10.1145/2447976.2447990

Cited by 783Ethics and Social Impacts of AINames, Identity, and Discrimination ResearchDiscrimination and Equality Law

Discrimination in online ad delivery

Sweeney, Latanya·2013·Communications of the ACM

DOI 10.1145/2447976.2447990

Open this paper in CoChat — free account

Abstract

Google ads, black names and white names, racial discrimination, and click advertising.

Integrity signals

Registry

Crossref · 10.1145/2447976.2447990

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Third-party oversight work has led to voluntary moratoriums, lawsuits, regulatory action, congressional hearings, and recalls or redesigns of deployed algorithms.
“The impact of this work is undeniable -leading to voluntary moratoriums [30], and several successful lawsuits [75,79]; nation-wide waves of regulatory action and public outcry [74]; congressional hearings [3]; and the recalls or radical redesigns of the deployed algorithms [12,64,65,88].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [79]
Algorithmic profiling is problematic.
“This is not to say that algorithmic profiling is not problematic.”
From Artificial intelligence in support of the circular economy: ethical considerations and a path forward (2024) · cites this paper as Sweeney 2013

Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination
Bertrand, M., & Mullainathan, S. (2004) · American Economic Review · doi:10.1257/0002828042002561 · Cited by 4,504 · see citing works
A sentimental education
Pang, B., & Lee, L. (2004) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1218955.1218990 · Cited by 3,317 · see citing works
The social work dictionary
(2004) · Choice Reviews Online · doi:10.5860/choice.41-2555 · Cited by 1,030 · see citing works
The Causes and Consequences of Distinctively Black Names
Fryer, R. G., & Levitt, S. D. (2004) · The Quarterly Journal of Economics · doi:10.1162/0033553041502180 · Cited by 644 · see citing works
Discrimination in Online Ad Delivery: Google ads, black names and white names, racial discrimination, and click advertising
Sweeney, L. (2013) · Queue · doi:10.1145/2460276.2460278 · Cited by 477 · see citing works
Self-citation
Uniform Guidelines on Employee Selection Procedures
Scheer, T. J. (2007) · Routledge eBooks · doi:10.1081/e-epap2-407 · Cited by 403 · see citing works
Equal Employment Opportunity Commission
(2012) · CQ Press eBooks · doi:10.4135/9781452241067.n3 · Cited by 275 · see citing works
Ex-Offenders Need Not Apply
Harris, P. M., & Keller, K. S. (2004) · Journal of Contemporary Criminal Justice · doi:10.1177/1043986204271678 · Cited by 154 · see citing works
The Causes and Consequences of Distinctively Black Names
Fryer, R. G., & Levitt, S. D. (2003) · National Bureau of Economic Research · doi:10.3386/w9938 · Cited by 55 · see citing works
Fairness Through Awareness
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2011) · arXiv · doi:10.48550/arxiv.1104.3913 · Cited by 55 · see citing works

Flagged first, then by citations

Sorted by citations

Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · see citing works
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 3,432 · see citing works
“This is shown, for example, by proﬁling algorithms that inadvertently discriminate against marginalised populations (Barocas and Selbst, 2015; Birrer, 2005), as seen in delivery of online advertisements according to perceived ethnicity (Sweeney, 2013).”
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887 · see citing works
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676 · see citing works
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · see citing works
The economics of privacy
Acquisti, A., Taylor, C., & Wagman, L. (2016) · Journal of Economic Literature · doi:10.1257/jel.54.2.442 · Cited by 1,283 · see citing works
Inherent trade-offs in the fair determination of risk scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2017) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.itcs.2017.43 · Cited by 943 · see citing works
“Second, in a very different domain, researchers have begun to analyze the ways in which different genders and racial groups experience advertising and commercial content on the Internet differently [9, 26].”
Background
Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies
Ferrara, E. (2023) · Sci · doi:10.3390/sci6010003 · Cited by 875 · see citing works
“Discrimination is a key concern when it comes to biased AI systems, as they can perpetuate and even amplify existing inequalities [24].”
Background
Algorithmic bias in education
Baker, R. S., & Hawn, A. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00285-9 · Cited by 993 · see citing works
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1323 · Cited by 829 · see citing works
“Such issues have been demonstrated in various learning systems, including online advertisement systems (Sweeney, 2013), word embedding models (Bolukbasi et al.”
Background
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763 · see citing works
“The researchers should deliberate over not only the beneﬁts of research, but also over the possible types of harms (Barocas et al., 2017), the aﬀected groups, and how to test for adverse impact (Sweeney, 2013).”
Background
Algorithmic Accountability: Journalistic investigation of computational power structures
Diakopoulos, N. (2015) · Digital Journalism · doi:10.1080/21670811.2014.976411 · Cited by 733 · see citing works
Fair, Transparent, and Accountable Algorithmic Decision-making Processes: The Premise, the Proposed Solutions, and the Open Challenges
Lepri, B., Oliver, N., Letouzé, E., Pentland, A., & Vinck, P. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0279-x · Cited by 709 · see citing works
Automated Experiments on Ad Privacy Settings: A Tale of Opacity, Choice, and Discrimination
Datta, A., Tschantz, M. C., & Datta, A. (2015) · Proceedings on Privacy Enhancing Technologies · doi:10.1515/popets-2015-0007 · Cited by 676 · see citing works
Gender bias in coreference resolution: Evaluation and debiasing methods
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2003 · Cited by 684 · see citing works
Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment
Zafar, M. B., Valera, I., Gomez Rodriguez, M., & Gummadi, K. P. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052660 · Cited by 632 · see citing works
"I always assumed that I wasn't really that close to [her]"
Eslami, M., Rickman, A., Vaccaro, K., Aleyasen, A., Vuong, A., Karahalios, K. G., Hamilton, K., & Sandvig, C. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702556 · Cited by 665 · see citing works
Algorithmic Fairness: Choices, Assumptions, and Definitions
Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2021) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042720-125902 · Cited by 687 · see citing works
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785 · see citing works
Where fairness fails: data, algorithms, and the limits of antidiscrimination discourse
Hoffmann, A. L. (2019) · Information, Communication & Society · doi:10.1080/1369118x.2019.1573912 · Cited by 535 · see citing works
Unequal Representation and Gender Stereotypes in Image Search Results for Occupations
Kay, M., Matuszek, C., & Munson, S. A. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702520 · Cited by 509 · see citing works
Citizens Versus the Internet: Confronting Digital Challenges With Cognitive Tools
Kozyreva, A., Lewandowsky, S., & Hertwig, R. (2020) · Psychological Science in the Public Interest · doi:10.1177/1529100620946707 · Cited by 479 · see citing works
Dimensions of artificial intelligence anxiety based on the integrated fear acquisition theory
Li, J., & Huang, J. (2020) · Technology in Society · doi:10.1016/j.techsoc.2020.101410 · Cited by 504 · see citing works
Algorithmic Accountability and Public Reason
Binns, R. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0263-5 · Cited by 457 · see citing works
“Personalised platforms build detailed profiles of their user’s attributes and behaviour, which determine the content they view, the products they see and search results they receive (Tufekci, 2014; Sweeney, 2013).”
Background
Algorithmic bias in data-driven innovation in the age of AI
Akter, S., McCarthy, G., Sajib, S., Michael, K., Dwivedi, Y. K., D’Ambra, J., & Shen, K. N. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102387 · Cited by 440 · see citing works
Fairness testing: testing software for discrimination
Galhotra, S., Brun, Y., & Meliou, A. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106277 · Cited by 405 · see citing works
Critical Race Theory for HCI
Ogbonnaya-Ogburu, I. F., Smith, A. D. R., To, A., & Toyama, K. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376392 · Cited by 404 · see citing works
Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems
Kiritchenko, S., & Mohammad, S. (2018) · Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2005 · Cited by 384 · see citing works
Better, Nicer, Clearer, Fairer: A Critical Assessment of the Movement for Ethical Artificial Intelligence and Machine Learning
Greene, D., Hoffmann, A. L., & Stark, L. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.258 · Cited by 386 · see citing works
Learning Gender-Neutral Word Embeddings
Zhao, J., Zhou, Y., Li, Z., Wang, W., & Chang, K.-W. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1521 · Cited by 376 · see citing works
A snapshot of the frontiers of fairness in machine learning
Chouldechova, A., & Roth, A. (2020) · Communications of the ACM · doi:10.1145/3376898 · Cited by 362 · see citing works
A Comprehensive Survey on Deep Graph Representation Learning
Ju, W., Fang, Z., Gu, Y., Liu, Z., Long, Q., Qiao, Z., Qin, Y., Shen, J., Sun, F., Xiao, Z., et al. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106207 · Cited by 359 · see citing works
How algorithmic confounding in recommendation systems increases homogeneity and decreases utility
Chaney, A. J. B., Stewart, B., & Engelhardt, B. E. (2018) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3240323.3240370 · Cited by 345 · see citing works
Algorithmic Bias: From Discrimination Discovery to Fairness-aware Data Mining
Hajian, S., Bonchi, F., & Castillo, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2945386 · Cited by 334 · see citing works
Gender Bias in Contextualized Word Embeddings
Zhao, J., Wang, T., Yatskar, M., Cotterell, R., Ordóñez, V., & Chang, K.-W. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1064 · Cited by 341 · see citing works
Toward an Ethics of Algorithms: Convening, Observation, Probability, and Timeliness
Ananny, M. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915606523 · Cited by 395 · see citing works
Artificial intelligence, transparency, and public decision-making: Why explanations are key when trying to produce perceived legitimacy
de Fine Licht, K., & de Fine Licht, J. (2020) · AI & SOCIETY · doi:10.1007/s00146-020-00960-w · Cited by 334 · see citing works
“This is often a point of introduction for problems related to bugs and biases, and is well described in the literature (e.g., Sweeney 2013; Datta et al. 2015; O’Neil 2016; Boscoe 2019).”
Background
Inherent Tradeoffs in the Fair Determination of Risk Scores
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603197 · Cited by 347 · see citing works
Bias in Online Freelance Marketplaces: Evidence from TaskRabbit and Fiverr
Hannák, A., Wagner, C., Garcia, D., Mislove, A., Strohmaier, M., & Wilson, C. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998327 · Cited by 286 · see citing works
Discrimination through Optimization
Ali, M., Sapiezynski, P., Bogen, M., Korolova, A., Mislove, A., & Rieke, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359301 · Cited by 268 · see citing works
“Separately, Sweeney [63] and Datta et al.”
The ethnographer and the algorithm: beyond the black box
Christin, A. (2020) · Theory and Society · doi:10.1007/s11186-020-09411-3 · Cited by 327 · see citing works
The Ethics of Artificial Intelligence in Education: Practices, Challenges, and Debates
Holmes, W., & Porayska-Pomsta, K. (2022) · doi:10.4324/9780429329067 · Cited by 258 · see citing works
Adapting computational text analysis to social science (and vice versa)
DiMaggio, P. (2015) · Big Data & Society · doi:10.1177/2053951715602908 · Cited by 231 · see citing works
A Framework for Understanding Unintended Consequences of Machine Learning
Suresh, H., & Guttag, J. V. (2019) · Cited by 229 · see citing works
Algorithmic bias in machine learning-based marketing models
Akter, S., Dwivedi, Y. K., Sajib, S., Biswas, K., Bandara, R. J., & Michael, K. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.01.083 · Cited by 242 · see citing works
Fairness in Decision-Making — The Causal Explanation Formula
Zhang, J., & Bareinboim, E. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11564 · Cited by 202 · see citing works
Digital nationalism: Understanding the role of digital media in the rise of ‘new’ nationalism
Mihelj, S., & Jiménez-Martínez, C. (2020) · Nations and Nationalism · doi:10.1111/nana.12685 · Cited by 174 · see citing works
Fairness in Learning: Classic and Contextual Bandits
Joseph, M., Kearns, M., Morgenstern, J., & Roth, A. (2016) · arXiv · doi:10.48550/arxiv.1605.07139 · Cited by 199 · see citing works
How Algorithms Discriminate Based on Data They Lack: Challenges, Solutions, and Policy Implications
Williams, B. A., Brooks, C., & Shmargad, Y. (2018) · Journal of Information Policy · doi:10.5325/jinfopoli.8.2018.0078 · Cited by 203 · see citing works
What kind of news gatekeepers do we want machines to be? Filter bubbles, fragmentation, and the normative dimensions of algorithmic recommendations
Nechushtai, E., & Lewis, S. C. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.043 · Cited by 237 · see citing works
Integrating Ethics within Machine Learning Courses
Saltz, J., Skirpan, M. W., Fiesler, C. L., Gorelick, M., YEH, T. P., Heckman, R., Dewar, N., & Beard, N. (2019) · ACM Transactions on Computing Education · doi:10.1145/3341164 · Cited by 180 · see citing works
Mathematical Notions vs. Human Perception of Fairness: A Descriptive Approach to Fairness for Machine Learning
Srivastava, M., Heidari, H., & Krause, A. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330664 · Cited by 179 · see citing works
Eliciting Tech Futures Among Black Young Adults: A Case Study of Remote Speculative Co-Design
Harrington, C., & Dillahunt, T. R. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445723 · Cited by 174 · see citing works
Large Language Models can Accurately Predict Searcher Preferences
Thomas, P., Spielman, S., Craswell, N., & Mitra, B. (2024) · Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3626772.3657707 · Cited by 168 · see citing works
Trauma-Informed Computing: Towards Safer Technology Experiences for All
Chen, J. X., McDonald, A., Zou, Y., Tseng, E., Roundy, K., Tamersoy, A., Schaub, F., Ristenpart, T., & Dell, N. L. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517475 · Cited by 169 · see citing works
Unsupervised by any other name: Hidden layers of knowledge production in artificial intelligence on social media
Bechmann, A., & Bowker, G. C. (2019) · Big Data & Society · doi:10.1177/2053951718819569 · Cited by 162 · see citing works
Clarity, surprises, and further questions in the Article 29 Working Party draft guidance on automated decision-making and profiling
Veale, M., & Edwards, L. (2018) · Computer law & security review · doi:10.1016/j.clsr.2017.12.002 · Cited by 163 · see citing works
Personality Research and Assessment in the Era of Machine Learning
Stachl, C., Pargent, F., Hilbert, S., Harari, G. M., Schoedel, R., Vaid, S. S., Gosling, S. D., & Bühner, M. (2020) · European Journal of Personality · doi:10.1002/per.2257 · Cited by 158 · see citing works
Artificial intelligence, firms and consumer behavior: A survey
Abrardi, L., Cambini, C., & Rondi, L. (2019) · Journal of Economic Surveys · doi:10.1111/joes.12455 · Cited by 212 · see citing works
Fairness-Aware Tensor-Based Recommendation
Zhu, Z., Hu, X., & Caverlee, J. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271795 · Cited by 156 · see citing works
How can we manage biases in artificial intelligence systems – A systematic literature review
P．S．, D. V. (2023) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2023.100165 · Cited by 239 · see citing works
Discrimination, artificial intelligence, and algorithmic decision-making
Borgesius, F. Z. (2025) · arXiv · doi:10.48550/arxiv.2510.13465 · Cited by 152 · see citing works
“67 Sweeney 2013.”
On Formalizing Fairness in Prediction with Machine LearningPreprint
Gajane, P., & Pechenizkiy, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.03184 · Cited by 152 · see citing works
Personal data for decisional purposes in the age of analytics: From an individual to a collective dimension of data protection
Mantelero, A. (2016) · Computer law & security review · doi:10.1016/j.clsr.2016.01.014 · Cited by 149 · see citing works
Fairness, Equality, and Power in Algorithmic Decision-Making
Kasy, M., & Abebe, R. (2021) · Conference on Fairness, Accountability and Transparency · doi:10.1145/3442188.3445919 · Cited by 193 · see citing works
Auditing of AI: Legal, Ethical and Technical Approaches
Mökander, J. (2023) · Digital Society · doi:10.1007/s44206-023-00074-y · Cited by 152 · see citing works
“Some researchers have leveraged narrow conceptions of auditing to test for bias and discrimination in online ad delivery (Ali et al., 2019; Sweeney, 2013) and autocomplete algorithms (Robertson et al., 2018), for fairness in image classification systems (Morina et al., 2019), for accuracy in news…”
Background
Preventing undesirable behavior of intelligent machines
Thomas, P. S., da Silva, B. C., Barto, A. G., Giguere, S., Brun, Y., & Brunskill, E. (2019) · Science · doi:10.1126/science.aag3311 · Cited by 142 · see citing works
Fairness in rankings and recommendations: an overview
Pitoura, E., Stefanidis, K., & Koutrika, G. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00697-y · Cited by 150 · see citing works
Towards trustworthy LLMs: a review on debiasing and dehallucinating in large language models
Lin, Z., Guan, S., Zhang, W., Zhang, H., Li, Y., & Zhang, H. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10896-y · Cited by 141 · see citing works
Addressing age-related bias in sentiment analysis,
Diaz, M., Johnson, I., Lazar, A., Piper, A. M., & Gergle, D. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173986 · Cited by 138 · see citing works
Software fairness
Brun, Y., & Meliou, A. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3264838 · Cited by 138 · see citing works
Fairness in Graph Mining: A Survey
Dong, Y., Ma, J., Wang, S., Chen, C., & Li, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3265598 · Cited by 145 · see citing works
A survey on bias in visual datasets
Fabbrizzi, S., Papadopoulos, S., Ntoutsi, E., & Kompatsiaris, I. Y. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103552 · Cited by 142 · see citing works
The Disparate Effects of Strategic Manipulation
Hu, L. J., Immorlica, N., & Vaughan, J. W. (2019) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3287560.3287597 · Cited by 135 · see citing works
Quantifying Search Bias: Investigating Sources of Bias for Political Searches in Social MediaPreprint
Kulshrestha, J., Eslami, M., Messias, J., Zafar, M. B., Ghosh, S., Gummadi, K. P., & Karahalios, K. G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01347 · Cited by 134 · see citing works
Building and Auditing Fair Algorithms: A Case Study in Candidate Screening
Wilson, C., Ghosh, A., Jiang, S., Mislove, A., Baker, L., Szary, J., Trindel, K., & Polli, F. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445928 · Cited by 133 · see citing works
AI Anxiety: a comprehensive analysis of psychological factors and interventions
Kim, J. J. H., Soh, J. Y., Kadkol, S., Solomon, I., Yeh, H., Srivatsa, A. V., Nahass, G. R., Choi, J. Y., Lee, S., Nyugen, T., et al. (2025) · AI and Ethics · doi:10.1007/s43681-025-00686-9 · Cited by 160 · see citing works
Ethical perspectives on recommending digital technology for patients with mental illness
Bauer, M., Glenn, T., Monteith, S., Bauer, R., Whybrow, P. C., & Geddes, J. R. (2017) · International Journal of Bipolar Disorders · doi:10.1186/s40345-017-0073-9 · Cited by 132 · see citing works
Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research
Vaughan, J. W. (2018) · Journal of Machine Learning Research · Cited by 130 · see citing works
Automated Experiments on Ad Privacy Settings: A Tale of Opacity, Choice, and DiscriminationPreprint
Datta, A. J., Tschantz, M. C., & Datta, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.6491 · Cited by 129 · see citing works
Using sensitive personal data may be necessary for avoiding discrimination in data-driven decision models
Žliobaitė, I., & Custers, B. (2016) · Artificial Intelligence and Law · doi:10.1007/s10506-016-9182-5 · Cited by 125 · see citing works
Toward human-centered algorithm design
Baumer, E. P. (2017) · Big Data & Society · doi:10.1177/2053951717718854 · Cited by 125 · see citing works
Controlling Attribute Effect in Linear Regression
Calders, T., Karim, A., Kamiran, F., Ali, W., & Zhang, X.-L. (2013) · 2013 IEEE 13th International Conference on Data Mining · doi:10.1109/icdm.2013.114 · Cited by 162 · see citing works
Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance
Raji, I. D., Xu, P., Honigsberg, C., & Ho, D. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534181 · Cited by 122 · see citing works
Algorithmic Bias? An Empirical Study into Apparent Gender-Based Discrimination in the Display of STEM Career AdsPreprint
Lambrecht, A., & Tucker, C. E. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2852260 · Cited by 122 · see citing works
Large language models that replace human participants can harmfully misportray and flatten identity groups
Wang, A., Morgenstern, J., & Dickerson, J. P. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-00986-z · Cited by 192 · see citing works
Situating Search
Shah, C. S., & Bender, E. M. (2022) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3498366.3505816 · Cited by 125 · see citing works
Discrimination through Optimization: How Facebook's Ad Delivery Can Lead to Biased OutcomesPreprint
Ali, M., Sapieżyński, P., Bogen, M., Korolova, A., Mislove, A. E., & Rieke, A. (2019) · arXiv (Cornell University) · Cited by 116 · see citing works
Racial categories in machine learning
Benthall, S., & Haynes, B. D. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287575 · Cited by 110 · see citing works
Designing Contestability: Interaction Design, Machine Learning, and Mental Health
Hirsch, T., Merced, K., Narayanan, S., Imel, Z. E., & Atkins, D. C. (2017) · Proceedings of the 2017 Conference on Designing Interactive Systems · doi:10.1145/3064663.3064703 · Cited by 110 · see citing works
Selling whiteness? – A critical review of the literature on marketing and racism
Davis, J. F. (2018) · Journal of Marketing Management · doi:10.1080/0267257x.2017.1395902 · Cited by 131 · see citing works
Visual media analysis for Instagram and other online platforms
Rogers, R. (2021) · Big Data & Society · doi:10.1177/20539517211022370 · Cited by 109 · see citing works
Online advertising: Analysis of privacy threats and protection approaches
Estrada-Jiménez, J., Parra‐Arnau, J., Rodríguez-Hoyos, A., & Forné, J. (2016) · Computer Communications · doi:10.1016/j.comcom.2016.12.016 · Cited by 107 · see citing works
Envisioning Communities: A Participatory Approach Towards AI for Social Good
Bondi, E., Xu, L., Acosta-Navas, D., & Killian, J. A. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462612 · Cited by 115 · see citing works
Search bias quantification: investigating political bias in social media and web search
Kulshrestha, J., Eslami, M., Messias, J., Zafar, M. B., Ghosh, S., Gummadi, K. P., & Karahalios, K. G. (2018) · Information Retrieval · doi:10.1007/s10791-018-9341-2 · Cited by 103 · see citing works
Gender differences in participation and reward on Stack Overflow
May, A., Wachs, J., & Hannák, A. (2018) · Empirical Software Engineering · doi:10.1007/s10664-019-09685-x · Cited by 101 · see citing works
Post-userism
Baumer, E. P. S., & Brubaker, J. R. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025740 · Cited by 100 · see citing works
Judgment Call the Game
Ballard, S. A., Chappell, K. M., & Kennedy, K. (2019) · Designing Interactive Systems Conference · doi:10.1145/3322276.3323697 · Cited by 99 · see citing works
FairSquare: probabilistic verification of program fairness
Albarghouthi, A., D'Antoni, L., Drews, S., & Nori, A. V. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3133904 · Cited by 94 · see citing works
The Practice and Promise of Critical Information Literacy: Academic Librarians' Involvement in Critical Library Instruction
Tewell, E. C. (2018) · College & Research Libraries · doi:10.5860/crl.79.1.10 · Cited by 101 · see citing works

Authors: Sweeney, L.
Affiliations: Harvard University (US)
Corresponding author: Sweeney, Latanya
ORCID: Sweeney, Latanya
Venue: Communications of the ACM
Publisher: Association for Computing Machinery (ACM)
Published: 2013-05
Volume: 56
Issue: 5
Pages: 44-54
ISSN: 0001-0782 (ISSN-L)
1557-7317
DOI: 10.1145/2447976.2447990
OpenAlex: W2095932468
Cited by: 783
References: 10
Citations by year: 2026: 30 · 2025: 53 · 2024: 61 · 2023: 109 · 2022: 78 · 2021: 84 · 2020: 91 · 2019: 82 · 2018: 69 · 2017: 53 · 2016: 37 · 2015: 18 · 2014: 16 · 2013: 2
FWCI: 63.66
Type: journal article
Language: en
Open access: closed
Licence: www.acm.org/publications/policies/copyright_policy#Background (vor)
Locations: Communications of the ACM (publishedVersion)
Funders: Division of Computer and Network Systems (CNS-1237235)
Google
Topics: Social Sciences › Safety Research › Ethics and Social Impacts of AI
Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
Social Sciences › Law › Discrimination and Equality Law
Keywords: online advertising, racial discrimination, algorithmic discrimination, Google AdWords, algorithmic fairness

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Discrimination in online ad delivery

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks