Cited by 257Ethics and Social Impacts of AIAdvanced Neural Network ApplicationsLaw, AI, and Intellectual Property

Large image datasets: A pyrrhic win for computer vision?

Birhane, Abeba, Prabhu, Vinay Uday·2021·2021 IEEE Winter Conference on Applications of Computer Vision (WACV)

Abstract

In this paper we investigate problematic practices and consequences of large scale vision datasets (LSVDs). We examine broad issues such as the question of consent and justice as well as specific concerns such as the inclusion of verifiably pornographic images in datasets. Taking the ImageNet-ILSVRC-2012 dataset as an example, we perform a cross-sectional model-based quantitative census covering factors such as age, gender, NSFW content scoring, class- wise accuracy, human-cardinality-analysis, and the semanticity of the image class information in order to statistically investigate the extent and subtleties of ethical transgressions. We then use the census to help hand-curate a look-up-table of images in the ImageNet-ILSVRC-2012 dataset that fall into the categories of verifiably pornographic: shot in a non-consensual setting (up-skirt), beach voyeuristic, and exposed private parts. We survey the landscape of harm and threats both the society at large and individuals face due to uncritical and ill-considered dataset curation practices. We then propose possible courses of correction and critique their pros and cons. We have duly open-sourced all of the code and the census meta-datasets generated in this endeavor for the computer vision community to build on. By unveiling the severity of the threats, our hope is to motivate the constitution of mandatory Institutional Review Boards (IRB) for large scale dataset curation.

Integrity signals

Registry

Crossref · 10.1109/wacv48630.2021.00158

Cites

64 of 64 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Such audits have revealed the presence of misogyny, pornography and harmful stereotypes.

    “Such audits have revealed the presence of misogyny, pornography and harmful stereotypes [5, 6]”
  • Auditing of Stable Diffusion's underlying datasets has revealed legal challenges and deeply problematic content.

    “This has enabled auditing of the underlying datasets, which has revealed legal challenges [49] and deeply problematic content [4, 5].”
  • Current data collection processes prioritize scale over inclusion, relying on web-scraping and synthetic pipelines that reflect developer biases and the uneven availability of online content.

    “Current data collection processes prioritize scale over inclusion, relying on web-scraping (e.g., [40, 97]) and synthetic pipelines that reflect developer biases and the uneven availability of online content [13, 14, 57, 96].”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Birhane, A., & Prabhu, V. U.
Affiliations
University College Dublin (IE)
Venue
2021 IEEE Winter Conference on Applications of Computer Vision (WACV)
Publisher
IEEE
Published
2021-01
Pages
1536-1546
ISSN
2472-6737 (ISSN-L)
OpenAlex
W3119746452
Cited by
257
References
64
Citations by year
2026: 19 · 2025: 47 · 2024: 54 · 2023: 58 · 2022: 49 · 2021: 29 · 2020: 1
FWCI
42.87
Type
conference paper
Language
en
Open access
closed
Locations
IEEE Winter Conference on Applications of Computer Vision (publishedVersion)
Funders
Science Foundation Ireland
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Law, AI, and Intellectual Property
Keywords
large-scale image databases, consent, justice, data curation, research ethics committees

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review