The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Unequal Representation and Gender Stereotypes in Image Search Results for Occupations
Abstract
Information environments have the power to affect people's perceptions and behaviors. In this paper, we present the results of studies in which we characterize the gender bias present in image search results for a variety of occupations. We experimentally evaluate the effects of bias in image search results on the images people choose to represent those careers and on people's perceptions of the prevalence of men and women in each occupation. We find evidence for both stereotype exaggeration and systematic underrepresentation of women in search results. We also find that people rate search results higher when they are consistent with stereotypes for a career, and shifting the representation of gender in image search results can shift people's perceptions about real-world distributions. We also discuss tensions between desires for high-quality results and broader societal goals for equality of representation in this space.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Kay, Matuszek and Munson found that “image search results for occupations slightly exaggerate gender stereotypes and portray the minority gender for an occupation less professionally. There is also a slight under-representation of women.””
From Discrimination, artificial intelligence, and algorithmic decision-making (2025) · cites this paper as Kay, Matuszek and Munson 2015
In the citing paper
“In recruitment, algorithmic bias can manifest in gender, race, skin color, and personality.”
From Ethics and discrimination in artificial intelligence-enabled recruitment practices (2023) · cites this paper as Kay et al. (2015)
In the citing paper
“For example, it is well-known that certain users on advertising platforms are more valuable to advertisers than others [48,55,65].”
From Discrimination through Optimization (2019) · cites this paper as [48]
Citations
Cites
(2011) · Cited by 4,430
Stereotype Threat and Women's Math Performance
Spencer, S. J., Steele, C. M., & Quinn, D. M. (1999) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1998.1373 · Cited by 3,435
Heilman, M. E. (2001) · Journal of Social Issues · doi:10.1111/0022-4537.00234 · Cited by 2,482
Social perception and interpersonal behavior: On the self-fulfilling nature of social stereotypes.
Snyder, M., Tanke, E. D., & Berscheid, E. (1977) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.35.9.656 · Cited by 1,374
Gender and the Career Choice Process: The Role of Biased Self‐Assessments
Correll, S. J. (2001) · American Journal of Sociology · doi:10.1086/321299 · Cited by 1,320
Friedman, B., & Nissenbaum, H. (1996) · ACM Transactions on Information Systems · doi:10.1145/230538.230561 · Cited by 1,203 · cited 2×
“Both algorithms and interfaces, however, can be biased in how they represent the world [9,34].”
BackgroundHilton, J. L., & von Hippel, W. (1996) · Annual Review of Psychology · doi:10.1146/annurev.psych.47.1.237 · Cited by 1,118
Constraints into Preferences: Gender, Status, and Emerging Career Aspirations
Correll, S. J. (2004) · American Sociological Review · doi:10.1177/000312240406900106 · Cited by 934
The nonverbal mediation of self-fulfilling prophecies in interracial interaction
Word, C. O., Zanna, M. P., & Cooper, J. (1974) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(74)90059-6 · Cited by 902
Categorically unequal: the American stratification system
(2008) · Choice Reviews Online · doi:10.5860/choice.45-4699 · Cited by 900
Research works printed but not linked: 2
- Executive Office of the President. Big Data: Seizing Opportunities , Preserving Values. May 2014 . Executive Office of the President. Big Data: Seizing Opportunities, Preserving Values. May 2014.
- Hooper B. Porn star appears on cover of Thai math textbook . United Press International . http://upi.com/5031410787947 Hooper B. Porn star appears on cover of Thai math textbook. United Press International. http://upi.com/5031410787947
Cited by
Sorted by citations
Items 401–500 of 507
A Nudez como Estereótipo de Beleza através das Lentes do Instagram
Matos, B. D. S., Benevenuto, F., & da Silva, A. P. C. (2021) · Anais do Brazilian Workshop on Social Network Analysis and Mining (BraSNAM) · doi:10.5753/brasnam.2021.16134 · Cited by 1
Machine Learning Bias in Computer Vision: Why do I have to care?
Laranjeira, C., Mota, V. F., & dos Santos, J. A. (2021) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi54419.2021.00010 · Cited by 1
Exploring Siri’s Content Diversity Using a Crowdsourced Audit
Glaesener, T. (2021) · Journal of Digital Social Research · doi:10.33621/jdsr.v4i1.115 · Cited by 2
Designing XAI from policy perspectives
Ha, T. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-85648-5.00004-9 · Cited by 1
Femvertising Practices in Wellness Tourism: Case of Retreat Centers in the United States
Chhabra, D. (2022) · International Journal of Health Management and Tourism · doi:10.31201/ijhmt.1169298 · Cited by 1
12 Essay Visuelles kommunikatives Gedächtnis: Digitale Verbreitung und partizipative Kultur
Horsti, K. (2022) · De Gruyter eBooks · doi:10.1515/9783110629743-012 · Cited by 1
Fair $k$-Center Problem with Outliers on Massive Data
Yuan, F., Diao, L., Du, D., & Liu, L. (2023) · Tsinghua Science & Technology · doi:10.26599/tst.2023.9010013 · Cited by 1
Carretta, S. A. (2023) · YSEC yearbook of socio-economic constitutions · doi:10.1007/16495_2023_62 · Cited by 1
Baeza-Yates, R. A., & Murgai, L. (2023) · Springer eBooks · doi:10.1007/978-3-031-45304-5_28 · Cited by 2
Measuring Bias in Search Results Through Retrieval List Comparison
Ratz, L., Schedl, M., Kopeinik, S., & Rekabsaz, N. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56069-9_2 · Cited by 1
Srinivasan, H., Schumann, C., Sinha, A., Madras, D., Olanubi, G. O., Beutel, A., Ricco, S., & Chen, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658940 · Cited by 5
Torre, L. E., González, E. E., Casillas, L. R., & Alvarado, J. A. (2024) · Estudios Económicos de El Colegio de México · doi:10.24201/ee.v39i2.455 · Cited by 2
The Right Tool in the Wrong Hands
Spier, S. (2017) · Elsevier eBooks · doi:10.1016/b978-0-08-100567-5.00011-6 · Cited by 1
Fairness and Privacy Violations in Black-Box Personalization Systems: Detection and Defenses
Datta, A. J. (2018) · KiltHub Repository · doi:10.1184/r1/6716627 · Cited by 1
Morton, S., Kmec, J. A., & Taylor, M. E. (2019) · International Journal of Gender, Science, and Technology · Cited by 1
Responsible Integration of Behavioral Science in Computer Science Research and Development
Niedbala, E. M., Ferguson-Walter, K. J., & Lafon, D. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.278 · Cited by 1
CLASSIFYING HUMANS: THE INDIRECT REVERSE OPERATIVITY OF MACHINE VISION
Kronman, L. (2023) · Photographies · doi:10.1080/17540763.2023.2189160 · Cited by 1
Zondi, N., Mkhize, G., Zungu, E., Kumalo, S., Reddy, V., Fawole, A., Mazibuko, G., Dlamini, P., Mhlongo, B., Ntombela, S., et al. (2023) · doi:10.35293/esi.18
Inclusive Recommendations and User Engagement: Experimental Evidence from Pinterest
Kumar, M., Silva, P., Singh, A., & Varmaraja, A. (2024) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3670865.3673635 · Cited by 1
Sayers, A. (2018) · Digital Commons - University of South Florida (University of South Florida) · Cited by 1
Identifying Stereotypes in the Online Perception of Physical Attractiveness
Araújo, C. S., Meira, W., & Almeida, V. A. F. (2016) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.48550/arxiv.1608.02499 · Cited by 1
Machines Learn Appearance Bias in Face Recognition.Preprint
Steed, R., & Caliskan, A. (2020) · arXiv (Cornell University) · Cited by 1
Beyond traditional assumptions in fair machine learningPreprint
Kilbertus, N. (2020) · arXiv (Cornell University) · doi:10.17863/cam.59055 · Cited by 1
Why resampling outperforms reweighting for correcting sampling bias with stochastic descentsPreprint
An, J., Lexing Ying, B., & Zhu, Y. (2021) · arXiv (Cornell University) · Cited by 1
Mitigating Bias in Algorithmic Systems: A Fish-Eye View of Problems and Solutions Across Domains.Preprint
Orphanou, K., Otterbacher, J., Kleanthous, S., Batsuren, K., Giunchiglia, F., Bogina, V., Tal, A. S., Hartman, A., & Kuflik, T. (2021) · arXiv (Cornell University) · Cited by 1
Pairwise Fairness for Ordinal RegressionPreprint
Kleindeßner, M., Samadi, S., Zafar, M. B., Kenthapadi, K., & Russell, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03153 · Cited by 1
Using Artificial Intelligence in the Law Review Submissions ProcessPreprint
Simon, B. M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4113550 · Cited by 1
Shute, V. J., Fulwider, G. C., Liu, Z., & Rahimi, S. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-818630-5.14013-8 · Cited by 4
Partisan Media Sentiment Toward Artificial IntelligencePreprint
Yi, A., Goenka, S., & Pandelaere, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4575244 · Cited by 1
Algorithmic Gender Bias: Investigating Perceptions of Discrimination in Automated Decision-MakingPreprint
Kim, S., Oh, P., & Lee, J. (2024) · doi:10.31234/osf.io/zpqrt · Cited by 1
Wallnau, K. (2018) · doi:10.1145/3195555.3195569
Quantifying & characterizing information diets of social media users
Kulshrestha, J. (2018) · Publications of the UdS (Saarland University) · doi:10.22028/d291-27621
Nardelli, T., & Ziller, J. (2018) · Mediapolis revista de comunicação jornalismo e espaço público · doi:10.14195/2183-6019_7_10
Quantifying Algorithmic Biases over TimePreprint
Singh, V. K., & Singh, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.01671
Reber, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.02018
How Fair is Fairness-aware Representative Ranking and Methods for Fair RankingPreprint
Saxena, A., Fletcher, G., & Pechenizkiy, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01335
Predictive Power at What Cost? Economic and Racial Justice of Data-Driven AlgorithmsPreprint
Jabri, R. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3422535
Auditing for Diversity using Representative ExamplesPreprint
Keswani, V., & Celis, L. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07393
Measuring Gender Stereotype Reinforcement in Information Retrieval Systems.
Fabris, A., Purpura, A., Silvello, G., & Susto, G. A. (2021) · IIR eBooks
Incentives for Item Duplication under Fair Ranking PoliciesPreprint
Nunzio, G. M. D., Fabris, A., Silvello, G., & Susto, G. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.15683
On Symmetries in Multi-dimensional Mechanism Design
Essaidi, M., & Weinberg, S. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-94676-0_4
Constitutional Perspectives on Machine LearningPreprint
Gupta, H. (2017) · doi:10.31235/osf.io/9v8js
An interdisciplinary examination of partisanship in web search
Robertson, R. E. (2021) · Digital Repository Service (Northeastern University) · doi:10.17760/d20413988
Índices de sentimiento e indicadores de actividad económica en México 2016-2021
Torre, L. E., González, E., Casillas, R., & Alvarado, J. (2012) · doi:10.36095/banxico/di.2022.18
Barlas, P., Krahn, M., Kleanthous, S., Kyriakou, K., & Otterbacher, J. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19269
Gender bias in Suchmaschinen: Zu den mimetischen Prozessen der Informationsintermediäre
Dill, K. (2023) · Verlag Julius Klinkhardt eBooks · doi:10.35468/5979-09
Internet Search Output Propagates Climate Change SentimentPreprint
Berkebile-Weinberg, M., Tang, R., Gao, R., & Vlasceanu, M. (2023) · doi:10.31234/osf.io/8qxhn
Applications of Fokker Planck Equations in Machine Learning Algorithms
Zhu, Y. (2023) · SEMA SIMAI Springer series · doi:10.1007/978-3-031-29875-2_10
The White Lotus TV Series Season 2: Deconstructing Italians Stereotypes
Alfarisy, F., & Sirait, Y. H. (2023) · Ethical Lingua Journal of Language Teaching and Literature · doi:10.30605/25409190.622
Auditing Machine Behaviors: Does a diverse crowd result in different social norms?
Christoforou, E., Orphanou, K., Nicolaou, N., Stavrakis, E., & Otterbacher, J. (2023) · International Conference on Behavioral, Economic, and Socio-Cultural Computing · doi:10.1109/besc59560.2023.10386355
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0013
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.002.0004
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.002.0005
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0001
The Animalistic Origins of Privacy
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0002
Privacy, the Public, and the Private
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0004
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0009
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0012
Privacy in the Twenty-First Century
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0014
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0007
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0015
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0011
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0010
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0006
Véliz, C. (2024) · doi:10.1093/oso/9780198870173.003.0008
Lin, Z., & Zhu, S. (2023) · International Conference on Cloud Computing, Big Data Application and Software Engineering (CBASE) · doi:10.1109/cbase60015.2023.10439130
Strong Duality Relations in Nonconvex Risk-Constrained Learning
Kalogerias, D. S., & Pougkakiotis, S. (2024) · Conference on Information Sciences and Systems · doi:10.1109/ciss59072.2024.10480186
Measuring the harms of personalization through advertising
Ali, M. (2023) · Digital Repository Service (Northeastern University) · doi:10.17760/d20620606
A Crowdsourcing Approach for Identifying Potential Stereotypes in the Collected Data
Christoforou, E., Orphanou, K., Kyriacou, M., & Otterbacher, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61281-7_1
RETRACTED: Algorithmic Bias: An Integrative Review and Scope for Future ResearchPreprint
Chaudhary, A. (2024) · Research Square · doi:10.21203/rs.3.rs-4775268/v1 · Cited by 3
RetractedLyon, G. (2025) · Information Communication & Society · doi:10.1080/1369118x.2025.2451401
Fairer Public Benefit in Copyright LawPreprint
Levendowski, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5080208
Kamp, S., & Fish, B. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i17.33949
Automated Data Bias Mitigation Technique for Algorithmic Fairness
Shi, J. M., & Rong, C. (2025) · The European Journal on Artificial Intelligence · doi:10.1177/30504554251328351
Constitutional Perspectives on Machine LearningPreprint
Gupta, H. (2017) · doi:10.31235/osf.io/9v8js_v1
Milanzi, E. B., & Orero, L. O. (2025) · Oxford University Press eBooks · doi:10.1093/9780198945215.003.0038
Santonocito, C. S. (2025) · Critical approaches to discourse analysis across disciplines · doi:10.21827/cadaad.17.1.42412
Damola, F. M., Dayo, U. O., Sheriff, A., Edem, M. E., Daniel, C. S., Ebite, C., & Paul, M. E. (2025) · Global Journal of Educational Research · doi:10.4314/gjedr.v24i2.6
Unveiling Bias in AI-Powered Recommender Systems: An Ethical and Algorithmic Survey
Patil, S., Agarwal, S., & Mohammed, A. S. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-6883-0_30
Unveiling Algorithmic Bias: Gender Disparities in Gaming and Dating Platforms in India
Garg, R., Kalra, R. A., & Rangaswamy, N. (2025) · Indian Journal of Gender Studies · doi:10.1177/09715215251351426
Liu, Y., Lin, A., Peng, S., & Cai, Z. (2026) · Systems · doi:10.3390/systems14030286
Koenig, P. D., & Rone, J. (2026) · Information Communication & Society · doi:10.1080/1369118x.2026.2645876
Zhang, L., Zhao, N., & Wan, J. (2026) · Research Square · doi:10.21203/rs.3.rs-8966332/v1
Fair k -Center Clustering on Massive Social Network Data Streams
Guo, L., Jia, C., & Chen, C. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792450
Escher, N., Yrysov, B., McDermott, A., Chechelnitsky, D., Benyam, H. B., & Banovic, N. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816926
Bandy, J. (2026) · Springer eBooks · doi:10.1007/978-3-032-19438-1_2
Unfairness in Information Retrieval
Mishra, H., & Soundarajan, S. (2026) · SpringerBriefs in intelligent systems · doi:10.1007/978-3-032-24145-0_2
Interpreting algorithmic information cues: User sensemaking of search autocomplete moderation
Jhaver, S. (2026) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.70092
Rohrbach, T., Makhortykh, M., & Sydorova, M. (2026) · Political Communication · doi:10.1080/10584609.2026.2679476
The Influence of Search Engines on Political Opinion Formation
Haak, F., & Pradel, F. (2026) · Springer eBooks · doi:10.1007/978-3-658-49118-5_5
The Language Barrier to Human Rights Information: A Global Analysis of Google Search Results
Terman, R., & Cuppernull, P. (2026) · International Studies Quarterly · doi:10.1093/isq/sqag040
Lai, J., Gong, X., & Zhu, Y. P. (2026) · Systems · doi:10.3390/systems14060661
Metadata
- Authors
- Kay, M., Matuszek, C., & Munson, S. A.
- Affiliations
- University of Washington (US)
- University of Maryland, Baltimore County (US)
- Venue
- Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2015-04-18
- Pages
- 3819-3828
- OpenAlex
- W2149252982
- Cited by
- 509
- References
- 36
- Citations by year
- 2026: 27 · 2025: 36 · 2024: 66 · 2023: 65 · 2022: 64 · 2021: 84 · 2020: 56 · 2019: 41 · 2018: 36 · 2017: 23 · 2016: 10
- FWCI
- 110.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Gender Studies › Media, Gender, and Advertising
- Social Sciences › Psychology › Developmental and Educational Psychology › Science Education and Perceptions
- Keywords
- gender stereotypes, gender bias, image search, occupation, gender representation, underrepresentation of women, search result quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review