Women Also Snowboard: Overcoming Bias in Captioning Models
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A related objective of XAI is highlighting bias in the data a model was exposed to.
“Likewise, a related objective of XAI is highlighting bias in the data a model was exposed to [168, 169].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [168]
Machine learning models, such as those offered by API providers, are prone to exhibiting various kinds of discriminatory behaviours, including different error rates across demographic groups, stereotyping, or minority groups under-representation.
“It is well acknowledged that machine learning models, such as those ofered by the API providers, are prone to exhibiting various kinds of discriminatory behaviours, including diferent error rates across demographic groups [22,126,127], stereotyping [64,163] or minority groups under-representation [134,137].”
From Out of Context: Investigating the Bias and Fairness Concerns of “Artificial Intelligence as a Service” (2023) · cites this paper as [64]
Cites
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · see citing works
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · see citing works
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513 · see citing works
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · see citing works
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · see citing works
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248 · see citing works
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318 · see citing works
Divergence measures based on the Shannon entropy
Lin, J.-H. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.61115 · Cited by 5,877 · see citing works
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228 · see citing works
Self-citationBottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Anderson, P., He, X., Buehler, C., Teney, D., Johnson, M., Gould, S. J., & Zhang, L. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00636 · Cited by 5,117 · see citing works
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902 · see citing works
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501 · see citing works
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · see citing works
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · see citing works
Young, P., Lai, A., Hodosh, M., & Hockenmaier, J. (2014) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00166 · Cited by 2,439 · see citing works
Meteor Universal: Language Specific Translation Evaluation for Any Target Language
Denkowski, M., & Lavie, A. (2014) · WMT@ACL · doi:10.3115/v1/w14-3348 · Cited by 2,108 · see citing works
MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
Xu, J., Mei, T., Yao, T., & Rui, Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.571 · Cited by 1,810 · see citing works
Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission
Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788613 · Cited by 1,685 · see citing works
Mitigating Unwanted Biases with Adversarial Learning
Zhang, B. H., Lemoine, B., & Mitchell, M. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278779 · Cited by 1,387 · see citing works
Simultaneous Deep Transfer Across Domains and Tasks
Tzeng, E., Hoffman, J., Darrell, T., & Saenko, K. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.463 · Cited by 1,203 · see citing works
Self-citationAge and gender classification using convolutional neural networks
Levi, G., & Hassncer, T. (2015) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301352 · Cited by 1,179 · see citing works
Interpretable Explanations of Black Boxes by Meaningful Perturbation
Fong, R. C., & Vedaldi, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.371 · Cited by 1,097 · see citing works
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1323 · Cited by 829 · cited 4× · see citing works
“One common theme is the notion of bias amplification, in which bias is not only learned, but amplified (Bolukbasi et al., 2016; Zhao et al., 2017).”
BackgroundInfluentialAge and Gender Estimation of Unfiltered Faces
Eidinger, E., Enbar, R., & Hassner, T. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2359646 · Cited by 814 · see citing works
Discriminating Gender on Twitter
Burger, J. D., Henderson, J. C., Kim, G., & Zarrella, G. (2011) · Cited by 581 · see citing works
Right for the Right Reasons: Training Differentiable Models by Constraining their Explanations
Ross, A. S., Hughes, M. C., & Doshi-Velez, F. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/371 · Cited by 515 · see citing works
Visualizing Deep Neural Network Decisions: Prediction Difference Analysis
Zintgraf, L. M., Cohen, T. S., Adel, T., & Welling, M. (2017) · arXiv · doi:10.48550/arxiv.1702.04595 · Cited by 487 · see citing works
Contextual Action Recognition with R* CNN
Gkioxari, G., Girshick, R., & Malik, J. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.129 · Cited by 380 · see citing works
Bottom-Up and Top-Down Attention for Image Captioning and VQA.Preprint
Anderson, P., He, X., Buehler, C., Teney, D., Johnson, M., Gould, S. J., & Zhang, L. (2017) · arXiv (Cornell University) · Cited by 252 · see citing works
Top-Down Neural Attention by Excitation Backprop
Zhang, J., Lin, Z., Brandt, J., Shen, X., & Sclaroff, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46493-0_33 · Cited by 246 · see citing works
Reporting bias and knowledge acquisition
Gordon, J., & Durme, B. V. (2013) · Conference on Automated Knowledge Base Construction · doi:10.1145/2509558.2509563 · Cited by 240 · see citing works
Mining the Blogosphere: Age, gender and the varieties of self-expression
Argamon, S., Koppel, M., Pennebaker, J. W., & Schler, J. (2007) · First Monday · doi:10.5210/fm.v12i9.2003 · Cited by 210 · cited 1× · see citing works
“concerned about whether contextual clues in complex scenes bias the production of gendered words during sentence generation. Gender classification has also been studied in natural language processing ([41,42], [43]). Ethical Considerations. Frequently, gender classification is seen as a binary task: data points are labe…”
BackgroundSeeing through the Human Reporting Bias: Visual Classifiers from Noisy Human-Centric Labels
Misra, I., Zitnick, C. L., Mitchell, M., & Girshick, R. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.320 · Cited by 210 · see citing works
Statistical context priming for object detection
Torralba, A. B., & Sinha, P. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937604 · Cited by 172 · see citing works
Top-Down Visual Saliency Guided by Captions
Ramanishka, V., Das, A., Zhang, J., & Saenko, K. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.334 · Cited by 140 · see citing works
Self-citationGender as a Variable in Natural-Language Processing: Ethical Considerations
Larson, B. (2017) · Proceedings of the First ACL Workshop on Ethics in Natural Language Processing · doi:10.18653/v1/w17-1601 · Cited by 111 · see citing works
Buolamwini, J. (2017) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 103 · see citing works
InclusiveFaceNet: Improving Face Attribute Detection with Race and Gender DiversityPreprint
Ryu, H. J., Adam, H., & Mitchell, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.00193 · Cited by 78 · see citing works
Gender and Smile Classification Using Deep Convolutional Neural Networks
Zhang, K., Tan, L., Li, Z., & Qiao, Y. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.97 · Cited by 63 · see citing works
Stereotyping and Bias in the Flickr30K DatasetPreprint
van Miltenburg, E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06083 · Cited by 61 · see citing works
Recycling Privileged Learning and Distribution Matching for Fairness
Quadrianto, N., & Sharmanska, V. (2017) · Spiral (Imperial College London) · Cited by 52 · see citing works
Distribution Matching for Transduction
Quadrianto, N., Petterson, J., & Smola, A. J. (2009) · Cited by 32 · see citing works
Stock, P., & Cissé, M. (2017) · Cited by 31 · see citing works
Detecting Bias in Black-Box Models Using Transparent Model Distillation.Preprint
Tan, S., Caruana, R., Hooker, G., & Lou, Y. (2017) · arXiv (Cornell University) · Cited by 29 · see citing works
Contextual Modulation of Target Saliency
Torralba, A. B. (2001) · Cited by 26 · see citing works
Flagged first, then by citations
3 of the 48 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · see citing works
CLIPScore: A Reference-free Evaluation Metric for Image Captioning
Hessel, J., Holtzman, A., Forbes, M., Le Bras, R., & Choi, Y. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.595 · Cited by 1,232 · see citing works
Language (Technology) is Power: A Critical Survey of “Bias” in NLP
Blodgett, S. L., Barocas, S., Daumé III, H., & Wallach, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.485 · Cited by 1,050 · see citing works
Flamingo: a visual language model for few-shot learning
Alayrac, J.-B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1723 · Cited by 966 · see citing works
“Its ability to additionally handle visual inputs poses specific risks such as gender and racial biases relating to the contents of the input images, similar to a number of visual recognition systems [12, 21, 37, 97, 147].”
BackgroundUnbiased Scene Graph Generation From Biased Training
Tang, K., Niu, Y., Huang, J., Shi, J., & Zhang, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00377 · Cited by 784 · see citing works
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts
Changpinyo, S., Sharma, P. K., Ding, N., & Soricut, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00356 · Cited by 626 · see citing works
A Review on Fairness in Machine Learning
Pessach, D., & Shmueli, E. (2023) · ACM Computing Surveys · doi:10.1145/3494672 · Cited by 598 · see citing works
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785 · see citing works
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569 · see citing works
Kärkkäinen, K., & Joo, J. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00159 · Cited by 546 · see citing works
Mitigating Gender Bias in Natural Language Processing: Literature Review
Sun, T., Gaut, A., Tang, S., Huang, Y., ElSherief, M., Zhao, J., Mirza, D., Belding, E., Chang, K.-W., & Wang, W. Y. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1159 · Cited by 492 · see citing works
Don’t Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases
Clark, C., Yatskar, M., & Zettlemoyer, L. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1418 · Cited by 381 · see citing works
“A related task is preventing models from using particular problematic dataset features, which is often studied from the perspective of fairness (Zhao et al., 2017; Burns et al., 2018).”
BackgroundLearning Not to Learn: Training Deep Neural Networks With Biased Data
Kim, B., Kim, H., Kim, K., Kim, S.-J., & Kim, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00922 · Cited by 360 · see citing works
Wang, T., Zhao, J., Yatskar, M., Chang, K.-W., & Ordóñez, V. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00541 · Cited by 353 · see citing works
Wang, T., Huang, J., Zhang, H., & Sun, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01077 · Cited by 291 · see citing works
Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigation
Wang, Z., Qinami, K., Karakozis, I. C., Genova, K., Nair, P., Hata, K., & Russakovsky, O. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00894 · Cited by 284 · see citing works
The Contribution of Data-Driven Technologies in Achieving the Sustainable Development Goals
Bachmann, N., Tripathi, S., Manuel, B., & Jodlbauer, H. (2022) · Sustainability · doi:10.3390/su14052497 · Cited by 320 · see citing works
Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded
Selvaraju, R. R., Lee, S., Shen, Y., Jin, H., Ghosh, S., Heck, L. P., Batra, D., & Parikh, D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00268 · Cited by 253 · see citing works
Yang, K., Qinami, K., Fei-Fei, L., Deng, J., & Russakovsky, O. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3375709 · Cited by 254 · see citing works
Deep learning as a tool for ecology and evolution
Borowiec, M. L., Dikow, R. B., Frandsen, P. B., McKeeken, A. J., Valentini, G., & White, A. E. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13901 · Cited by 264 · see citing works
RUBi: Reducing Unimodal Biases in Visual Question AnsweringPreprint
Cadène, R., Dancette, C., Ben-younes, H., Cord, M., & Parikh, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.10169 · Cited by 255 · see citing works
Requirements Engineering for Machine Learning: Perspectives from Data Scientists
Vogelsang, A., & Borg, M. (2019) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew.2019.00050 · Cited by 238 · see citing works
REPAIR: Removing Representation Bias by Dataset Resampling
Li, Y., & Vasconcelos, N. M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00980 · Cited by 231 · see citing works
Foundations & Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions
Liang, P. P., Zadeh, A., & Morency, L. (2024) · ACM Computing Surveys · doi:10.1145/3656580 · Cited by 306 · see citing works
Zhou, L., Kalantidis, Y., Chen, X., Corso, J. J., & Rohrbach, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00674 · Cited by 191 · see citing works
Human-Centered Artificial Intelligence for Designing Accessible Cultural Heritage
Pisoni, G., Díaz-Rodríguez, N., Gijlers, H., & Tonolli, L. (2021) · Applied Sciences · doi:10.3390/app11020870 · Cited by 183 · see citing works
CLEVR-XAI: A benchmark dataset for the ground truth evaluation of neural network explanations
Arras, L., Osman, A., & Samek, W. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.11.008 · Cited by 189 · see citing works
Causal Attention for Vision-Language Tasks
Yang, X., Zhang, H., Qi, G., & Cai, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00972 · Cited by 175 · see citing works
Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development
Scheuerman, M. K., Hanna, A., & Denton, R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476058 · Cited by 216 · see citing works
Gender Bias in Machine Translation
Savoldi, B., Gaido, M., Bentivogli, L., Negri, M., & Turchi, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00401 · Cited by 189 · see citing works
Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases
Steed, R., & Caliskan, A. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445932 · Cited by 167 · see citing works
Uddin, M. Z., & Soylu, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-95947-y · Cited by 155 · see citing works
More Grounded Image Captioning by Distilling Image-Text Matching Model
Zhou, Y., Wang, M., Liu, D., Hu, Z., & Zhang, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00483 · Cited by 144 · see citing works
Beyond explaining: Opportunities and challenges of XAI-based model improvement
Weber, L., Lapuschkin, S., Binder, A., & Samek, W. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.11.013 · Cited by 148 · see citing works
Towards trustworthy LLMs: a review on debiasing and dehallucinating in large language models
Lin, Z., Guan, S., Zhang, W., Zhang, H., Li, Y., & Zhang, H. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10896-y · Cited by 141 · see citing works
Interdisciplinary Research in Artificial Intelligence: Challenges and Opportunities
Kusters, R., Misevic, D., Berry, H., Cully, A., Cunff, Y. L., Dandoy, L., Díaz-Rodríguez, N., Ficher, M., Grizou, J., Othmani, A., et al. (2020) · Frontiers in Big Data · doi:10.3389/fdata.2020.577974 · Cited by 132 · see citing works
Deconfounded Image Captioning: A Causal Retrospect
Yang, X., Zhang, H., & Cai, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3121705 · Cited by 130 · see citing works
FairFace: Face Attribute Dataset for Balanced Race, Gender, and AgePreprint
Kärkkäinen, K., & Joo, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.04913 · Cited by 129 · see citing works
Face Recognition: Too Bias, or Not Too Bias?
Robinson, J. P., Livitz, G., Henon, Y., Qin, C., Fu, Y., & Timoner, S. J. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00008 · Cited by 125 · see citing works
Reducing Sentiment Bias in Language Models via Counterfactual Evaluation
Huang, P.-S., Zhang, H., Jiang, R., Stanforth, R., Welbl, J., Rae, J., Maini, V., Yogatama, D., & Kohli, P. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.7 · Cited by 124 · see citing works
Black Box Attacks on Explainable Artificial Intelligence(XAI) methods in Cyber Security
Kuppa, A., & Le-Khac, N.-A. (2020) · 2020 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206780 · Cited by 123 · see citing works
Fair Attribute Classification through Latent Space De-biasing
Ramaswamy, V., Kim, S. S. Y., & Russakovsky, O. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00918 · Cited by 122 · see citing works
Understanding and Mitigating Annotation Bias in Facial Expression Recognition
Chen, Y., & Joo, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01471 · Cited by 120 · see citing works
Explainable Convolutional Neural Networks: A Taxonomy, Review, and Future Directions
Ibrahim, R., & Shafiq, M. O. (2022) · ACM Computing Surveys · doi:10.1145/3563691 · Cited by 123 · see citing works
Muse: Text-To-Image Generation via Masked Generative Transformers
Chang, H., Zhang, H., Barber, J., Maschinot, A., Lezama, J., Jiang, L., Yang, M.-H., Murphy, K., Freeman, W. T., Rubinstein, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2301.00704 · Cited by 157 · see citing works
“…on such datasets simply amplifies these biases and significant additional research is required on how to mitigate such biases, and generate datasets that are free of them: this is a very important topic (Buolamwini & Gebru, 2018; Hendricks et al., 2018) that is out of the scope of this paper.”
BackgroundDetecting Human-Object Interactions via Functional Generalization
Bansal, A., Rambhatla, S. S., Shrivastava, A., & Chellappa, R. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6616 · Cited by 14 · see citing works
Algorithmic fairness datasets: the story so far
Fabris, A., Messina, S., Silvello, G., & Susto, G. A. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00854-z · Cited by 128 · see citing works
Diversity in Faces.Preprint
Merler, M., Ratha, N., Feris, R., & Smith, J. R. (2019) · arXiv (Cornell University) · Cited by 111 · see citing works
Learning What Makes a Difference from Counterfactual Examples and Gradient Supervision
Teney, D., Abbasnedjad, E., & van den Hengel, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_34 · Cited by 106 · see citing works
Multimodal research in vision and language: A review of current and emerging trends
Uppal, S., Bhagat, S., Hazarika, D., Majumder, N., Poria, S., Zimmermann, R., & Zadeh, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.07.009 · Cited by 112 · see citing works
Towards Unsupervised Image Captioning With Shared Multimodal Embeddings
Laina, I., Rupprecht, C., & Navab, N. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00751 · Cited by 111 · see citing works
Pessach, D., & Shmueli, E. (2023) · Springer eBooks · doi:10.1007/978-3-031-24628-9_37 · Cited by 177 · see citing works
Long Short-Term Relation Transformer With Global Gating for Video Captioning
Li, L., Gao, X., Deng, J., Tu, Y., Zha, Z.-J., & Huang, Q. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3158546 · Cited by 99 · see citing works
Balayn, A., Lofi, C., & Houben, G.-J. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00671-8 · Cited by 98 · see citing works
Mitigating face recognition bias via group adaptive classifier
Gong, S., Liu, X., & Jain, A. K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00342 · Cited by 92 · see citing works
Barbosa, N. M., & Chen, M. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300773 · Cited by 90 · see citing works
Explicit Bias Discovery in Visual Question Answering Models
Manjunatha, V., Saini, N., & Davis, L. S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00979 · Cited by 85 · see citing works
Text-Only Training for Image Captioning using Noise-Injected CLIP
Nukrai, D., Mokady, R., & Globerson, A. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.299 · Cited by 89 · see citing works
A Study of Face Obfuscation in ImageNetPreprint
Yang, K., Yau, J., Fei-Fei, L., Deng, J., & Russakovsky, O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.06191 · Cited by 103 · see citing works
Distilling Translations with Visual Awareness
Ive, J., Madhyastha, P., & Specia, L. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1653 · Cited by 85 · see citing works
Roses are Red, Violets are Blue… But Should VQA expect Them To?
Kervadec, C., Antipov, G., Baccouche, M., & Wolf, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00280 · Cited by 84 · see citing works
Reducing Language Biases in Visual Question Answering with Visually-Grounded Question Encoder
Gouthaman, K. V., & Mittal, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58601-0_2 · Cited by 82 · see citing works
Understanding and Evaluating Racial Biases in Image Captioning
Zhao, D., Wang, A., & Russakovsky, O. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01456 · Cited by 84 · see citing works
EnD: Entangling and Disentangling deep representations for bias correction
Tartaglione, E., Barbano, C. A., & Grangetto, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01330 · Cited by 85 · see citing works
Don’t Judge an Object by Its Context: Learning to Overcome Contextual Bias
Singh, K. K., Mahajan, D. K., Grauman, K. L., Lee, Y. J., Feiszli, M., & Ghadiyaram, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01108 · Cited by 80 · see citing works
A causal perspective on dataset bias in machine learning for medical imaging
Jones, C., Castro, D. C., Ribeiro, F. D. S., Oktay, O., McCradden, M. D., & Glocker, B. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00797-8 · Cited by 87 · see citing works
Addressing fairness issues in deep learning-based medical image analysis: a systematic review
Xu, Z., Li, J., Yao, Q., Li, H., Zhao, M., & Zhou, S. K. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01276-5 · Cited by 82 · see citing works
Adversarial Regularization for Visual Question Answering: Strengths, Shortcomings, and Side Effects
Grand, G., & Belinkov, Y. (2019) · doi:10.18653/v1/w19-1801 · Cited by 77 · see citing works
REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasets
Wang, A., Liu, A., Zhang, R., Kleiman, A., Kim, L., Zhao, D., Shirai, I., Narayanan, A., & Russakovsky, O. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01625-5 · Cited by 85 · see citing works
Deep image captioning: A review of methods, trends and future challenges
Xu, L., Tang, Q., Lv, J., Zheng, B., Zeng, X., & Li, W. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126287 · Cited by 78 · see citing works
Are You Looking? Grounding to Multiple Modalities in Vision-and-Language Navigation
Hu, R.-H., Fried, D., Rohrbach, A., Klein, D., Darrell, T., & Saenko, K. (2019) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1655 · Cited by 114 · see citing works
Self-citationREVISE: A Tool for Measuring and Mitigating Bias in Visual Datasets
Wang, A., Narayanan, A., & Russakovsky, O. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58580-8_43 · Cited by 72 · see citing works
Show, Deconfound and Tell: Image Captioning with Causal Inference
Liu, B., Wang, D., Yang, X., Zhou, Y. Z., Yao, R., Shao, Z., & Zhao, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01751 · Cited by 71 · see citing works
Going Beyond XAI: A Systematic Survey for Explanation-Guided Learning
Gao, Y., Gu, S., Jiang, J., Hong, S.-S., Yu, D., & Zhao, L. (2024) · ACM Computing Surveys · doi:10.1145/3644073 · Cited by 71 · see citing works
In Defense of Scene Graphs for Image Captioning
Nguyen, K., Tripathi, S., Du, B., Guha, T., & Nguyen, T. Q. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00144
Unshuffling Data for Improved Generalization in Visual Question Answering
Teney, D., Abbasnejad, E., & van den Hengel, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00145 · Cited by 66 · see citing works
Using Explainability to Help Children UnderstandGender Bias in AI
Melsión, G. I., Torre, I., Vidal, E., & Leite, I. (2021) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3459990.3460719 · Cited by 65 · see citing works
Multiple Adverse Weather Conditions Adaptation for Object Detection via Causal Intervention
Zhang, H., Xiao, L., Cao, X., & Foroosh, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3166765 · Cited by 65 · see citing works
Explainable Artificial Intelligence for Cybersecurity
Sharma, D. K., Mishra, J., Singh, A., Govil, R., Srivastava, G., & Lin, J. C. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.108356 · Cited by 64 · see citing works
Deep Learning for Face Recognition: Pride or Prejudiced?Preprint
Nagpal, S., Singh, M., Singh, R., & Mayank Vatsa, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.01219 · Cited by 63 · see citing works
Mitigating Demographic Bias in Facial Datasets with Style-Based Multi-attribute Transfer
Georgopoulos, M., Oldfield, J. P., Nicolaou, M. A., Panagakis, Y., & Pantić, M. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01448-w · Cited by 63 · see citing works
Perturbation augmentation for fairer NLP
Qian, R., Ross, C., Fernandes, J., Smith, E. M., Kiela, D., & Williams, A. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.646 · Cited by 69 · see citing works
Data and its (dis)contents: A survey of dataset development and use in machine learning research
Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100336 · Cited by 548 · see citing works
Detecting Bias with Generative Counterfactual Face Attribute AugmentationPreprint
Denton, E., Hutchinson, B., Mitchell, M., & Gebru, T. (2019) · arXiv (Cornell University) · Cited by 61 · see citing works
Fairness in Deep Learning: A Survey on Vision and Language Research
Parraga, O., Móre, M. D., Mattjie, C., Gavenski, N. S., Kupssinskü, L. S., Medronha, A., de Moura, L. V., Simões, G. S., & Barros, R. C. (2023) · ACM Computing Surveys · doi:10.1145/3637549 · Cited by 67 · see citing works
Accessible Cultural Heritage through Explainable Artificial Intelligence
Díaz-Rodríguez, N., & Pisoni, G. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3386392.3399276 · Cited by 55 · see citing works
On Scaling Up a Multilingual Vision and Language Model
Chen, X., Djolonga, J., Padlewski, P., Mustafa, B., Changpinyo, S., Wu, J., Riquelme, C., Goodman, S., Wang, X., Tay, Y., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01368 · Cited by 140 · see citing works
RUBi: Reducing Unimodal Biases for Visual Question Answering
(2019) · HAL · Cited by 50 · see citing works
Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search
Wang, J., Liu, Y., & Wang, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.151 · Cited by 64 · see citing works
Knowing What to Learn: A Metric-Oriented Focal Mechanism for Image Captioning
Ji, J., Ma, Y., Sun, X., Zhou, Y., Wu, Y., & Ji, R. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3183434 · Cited by 50 · see citing works
FairPrune: Achieving Fairness Through Pruning for Dermatological Disease Diagnosis
Wu, Y., Zeng, D., Xu, X., Shi, Y., & Hu, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16431-6_70 · Cited by 49 · see citing works
Quantifying Societal Bias Amplification in Image Captioning
Hirota, Y., Nakashima, Y., & García, N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01309 · Cited by 50 · see citing works
SQuINTing at VQA Models: Introspecting VQA Models With Sub-Questions
Selvaraju, R. R., Tendulkar, P., Parikh, D., Horvitz, E., Ribeiro, M. T., Nushi, B., & Kamar, E. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01002 · Cited by 51 · see citing works
Mitigating Gender Bias in Captioning Systems
Tang, R., Du, M., Li, Y., Liu, Z., Zou, N., & Hu, X. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449950 · Cited by 50 · see citing works
Symphony: Composing Interactive Interfaces for Machine Learning
Bäuerle, A., Cabrera, Á. A., Hohman, F., Maher, M., Koski, D., Suau, X., Barik, T., & Moritz, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502102 · Cited by 50 · see citing works
Visual Cluster Grounding for Image Captioning
Jiang, W., Zhu, M., Fang, Y., Shi, G., Zhao, X., & Liu, Y. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3177318 · Cited by 48 · see citing works
Gupta, V. K., Li, Z., Kortylewski, A., Zhang, C., Li, Y., & Yuille, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00502 · Cited by 48 · see citing works
Tutorial on Multimodal Machine Learning: Principles, Challenges, and Open Questions
Liang, P. P., & Morency, L. (2023) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3610661.3617602 · Cited by 48 · see citing works
Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles
Clark, C., Yatskar, M., & Zettlemoyer, L. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.272 · Cited by 48 · see citing works
Evaluating and Mitigating Bias in Image Classifiers: A Causal Perspective Using Counterfactuals
Dash, S., Balasubramanian, V. N., & Sharma, A. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00393 · Cited by 50 · see citing works
- Authors
- Hendricks, L. A., Burns, K., Saenko, K., Darrell, T., & Rohrbach, A.
- Affiliations
- University of California, Berkeley (US)
- Boston University (US)
- Corresponding author
- Hendricks, Lisa Anne
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2018
- Pages
- 793-811
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W2963349562
- Cited by
- 404
- References
- 48
- Citations by year
- 2026: 14 · 2025: 22 · 2024: 48 · 2023: 56 · 2022: 75 · 2021: 80 · 2020: 73 · 2019: 34 · 2018: 2
- FWCI
- 84.59
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Lecture notes in computer science (publishedVersion)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- image captioning, gender bias, bias mitigation, women in media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review