CoChat
Sign Up
Cited by 254Ethics and Social Impacts of AIAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.

Towards fairer datasets: filtering and balancing the distribution of the people subtree in the ImageNet hierarchy

Open access
Yang, Kaiyu, Qinami, Klint, Fei-Fei, Li, Deng, Jia, Russakovsky, Olga·2020·Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
DOI 10.1145/3351095.3375709
Open this paper in CoChat — free accountOpen PDF

Abstract

Computer vision technology is being used by many but remains representative of only a few. People have reported misbehavior of computer vision models, including offensive prediction results and lower performance for underrepresented groups. Current computer vision models are typically developed using datasets consisting of manually annotated images or videos; the data and label distributions in these datasets are critical to the models' behavior. In this paper, we examine ImageNet, a large-scale ontology of images that has spurred the development of many modern computer vision methods. We consider three key factors within the person subtree of ImageNet that may lead to problematic behavior in downstream computer vision technology: (1) the stagnant concept vocabulary of WordNet, (2) the attempt at exhaustive illustration of all categories with images, and (3) the inequality of representation in the images within concepts. We seek to illuminate the root causes of these concerns and take the first steps to mitigate them constructively.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3351095.3375709

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 29

  1. House U.S., 1990, 101st Congress, 2nd Session. 101 H.R. 2273. 1990
  2. House U.S., 1963, 88th Congress, 1st Session. 88 H.R. 6060. 1963
  3. House U.S., 1984, 98th Congress, 2nd Session. 98 H.R. 5490. 1984
  4. Solon Barocas Elizabeth Bradley Vasant Honavar and Foster Provost. 2017. Big data data science and civil rights. arXiv preprint arXiv:1706.03102 (2017). Solon Barocas Elizabeth Bradley Vasant Honavar and Foster Provost. 2017. Big data data science and civil rights. arXiv preprint arXiv:1706.03102 (2017). · arXiv
  5. Buolamwini Joy, 2018, Conference on fairness, accountability and transparency. 77--91
  6. Burns Kaylee, 2018, European Conference on Computer Vision.
  7. L Elisa Celis and Vijay Keswani. 2019. Implicit Diversity in Image Summarization. arXiv preprint arXiv:1901.10265 (2019). L Elisa Celis and Vijay Keswani. 2019. Implicit Diversity in Image Summarization. arXiv preprint arXiv:1901.10265 (2019). · arXiv
  8. Chang Angel X, 2015, Shapenet: An information-rich 3d model repository. arXiv preprint arXiv:1512.03012 · arXiv
  9. Terrance DeVries Ishan Misra Changhan Wang and Laurens van der Maaten. 2019. Does Object Recognition Work for Everyone? arXiv preprint arXiv:1906.02659 (2019). Terrance DeVries Ishan Misra Changhan Wang and Laurens van der Maaten. 2019. Does Object Recognition Work for Everyone? arXiv preprint arXiv:1906.02659 (2019). · arXiv
  10. Chris Dulhanty and Alexander Wong. 2019. Auditing ImageNet: Towards a Model-driven Framework for Annotating Demographic Attributes of Large-Scale Image Datasets. arXiv preprint arXiv:1905.01347 (2019). Chris Dulhanty and Alexander Wong. 2019. Auditing ImageNet: Towards a Model-driven Framework for Annotating Demographic Attributes of Large-Scale Image Datasets. arXiv preprint arXiv:1905.01347 (2019). · arXiv
  11. Harrison Edwards and Amos Storkey. 2016. Censoring representations with an adversary. In ICLR. Harrison Edwards and Amos Storkey. 2016. Censoring representations with an adversary. In ICLR.
  12. Gebru Timnit, 2018, Datasheets for Datasets. In Workshop on Fairness, Accountability, and Transparency in Machine Learning.
  13. Moritz Hardt Eric Price Nati Srebro etal 2016. Equality of opportunity in supervised learning. In Advances in neural information processing systems. 3315--3323. Moritz Hardt Eric Price Nati Srebro et al. 2016. Equality of opportunity in supervised learning. In Advances in neural information processing systems. 3315--3323.
  14. Minyoung Huh Pulkit Agrawal and Alexei A Efros. 2016. What makes ImageNet good for transfer learning? arXiv preprint arXiv:1608.08614 (2016). Minyoung Huh Pulkit Agrawal and Alexei A Efros. 2016. What makes ImageNet good for transfer learning? arXiv preprint arXiv:1608.08614 (2016). · arXiv
  15. Kleinberg Jon, 2017, Proc. 8th Conf. on Innovations in Theoretical Computer Science (ITCS).
  16. Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105. Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.
  17. Alina Kuznetsova Hassan Rom Neil Alldrin Jasper Uijlings Ivan Krasin Jordi Pont-Tuset Shahab Kamali Stefan Popov Matteo Malloci Tom Duerig etal 2018. The Open Images dataset v4: Unified image classification object detection and visual relationship detection at scale. arXiv preprint arXiv:1811.00982 (2018). Alina Kuznetsova Hassan Rom Neil Alldrin Jasper Uijlings Ivan Krasin Jordi Pont-Tuset Shahab Kamali Stefan Popov Matteo Malloci Tom Duerig et al. 2018. The Open Images dataset v4: Unified image classification object detection and visual relationship detection at scale. arXiv preprint arXiv:1811.00982 (2018). · arXiv
  18. David Madras Elliot Creager Toniann Pitassi and Richard Zemel. 2018. Learning adversarially fair and transferable representations. arXiv preprint arXiv:1802.06309 (2018). David Madras Elliot Creager Toniann Pitassi and Richard Zemel. 2018. Learning adversarially fair and transferable representations. arXiv preprint arXiv:1802.06309 (2018). · arXiv
  19. George A Miller. 1998. WordNet: An electronic lexical database. MIT press. George A Miller. 1998. WordNet: An electronic lexical database. MIT press.
  20. Mitchell Margaret, 2018, Model Cards for Model Reporting. In ACM Conference on Fairness, Accountability and Transparency.
  21. Safiya Umoja Noble. 2018. Algorithms of oppression: How search engines reinforce racism. nyu Press. Safiya Umoja Noble. 2018. Algorithms of oppression: How search engines reinforce racism. nyu Press.
  22. Geoff Pleiss Manish Raghavan Felix Wu Jon Kleinberg and Kilian Q Weinberger. 2017. On fairness and calibration. In Advances in Neural Information Processing Systems. 5680--5689. Geoff Pleiss Manish Raghavan Felix Wu Jon Kleinberg and Kilian Q Weinberger. 2017. On fairness and calibration. In Advances in Neural Information Processing Systems. 5680--5689.
  23. Ryu Hee Jung, 2018, Proceedings of FATML.
  24. Shankar Shreya, 2017, NeurIPS workshop: Machine Learning for the Developing World.
  25. Karen Simonyan and Andrew Zisserman. 2014. Two-stream convolutional networks for action recognition in videos. In Advances in neural information processing systems. 568--576. Karen Simonyan and Andrew Zisserman. 2014. Two-stream convolutional networks for action recognition in videos. In Advances in neural information processing systems. 568--576.
  26. Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014). Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014). · arXiv
  27. Welinder P., 2010, Technical Report CNS-TR-2010-001. California Institute of Technology.
  28. Muhammad Bilal Zafar Isabel Valera Manuel Gomez Rodriguez and Krishna P Gummadi. 2015. Fairness constraints: Mechanisms for fair classification. arXiv preprint arXiv:1507.05259 (2015). Muhammad Bilal Zafar Isabel Valera Manuel Gomez Rodriguez and Krishna P Gummadi. 2015. Fairness constraints: Mechanisms for fair classification. arXiv preprint arXiv:1507.05259 (2015). · arXiv
  29. Zemel Rich, 2013, International Conference on Machine Learning. 325--333

Cited by

Sorted by citations

See all 254

Related

See all

Metadata

Authors
Yang, K., Qinami, K., Fei-Fei, L., Deng, J., & Russakovsky, O.
Affiliations
  • Princeton University (US)
  • Stanford University (US)
ORCID
Venue
Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2020-01-27
Pages
547-558
DOI
10.1145/3351095.3375709
OpenAlex
W4288083803
Cited by
254
References
50
Citations by year
2026: 13 · 2025: 37 · 2024: 47 · 2023: 48 · 2022: 58 · 2021: 42 · 2020: 9
FWCI
40.71
Type
conference paper
Language
en
Open access
Licence
www.acm.org/publications/policies/copyright_policy#Background (vor)
Locations
  • ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
Center for Hierarchical Manufacturing, National Science Foundation (1763642)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
ImageNet, underrepresented groups, WordNet, label distribution, data bias

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review