Cited by 42Domain Adaptation and Few-Shot LearningAdvanced Neural Network ApplicationsAdvanced Image and Video Retrieval Techniques

ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition

Massiceti, Daniela, Zintgraf, Luisa, Bronskill, John, Theodorou, Lida, Harris, Matthew Tobias, Cutrell, Edward, Morrison, Cecily, Hofmann, Katja +1 more·2021·2021 IEEE/CVF International Conference on Computer Vision (ICCV)

Abstract

Object recognition has made great advances in the last decade, but predominately still relies on many high-quality training examples per object category. In contrast, learning new objects from only a few examples could enable many impactful applications from robotics to user personalization. Most few-shot learning research, however, has been driven by benchmark datasets that lack the high variation that these applications will face when deployed in the real-world. To close this gap, we present the ORBIT dataset and benchmark, grounded in the real-world application of teachable object recognizers for people who are blind/low-vision. The dataset contains 3,822 videos of 486 objects recorded by people who are blind/low-vision on their mobile phones. The benchmark reflects a realistic, highly challenging recognition problem, providing a rich playground to drive research in robustness to few-shot, high-variation conditions. We set the benchmark’s first state-of-the-art and show there is massive scope for further innovation, holding the potential to impact a broad range of real-world vision applications including tools for the blind/low-vision community. We release the dataset at https://doi.org/10.25383/city.14294597 and benchmark code at https://github.com/microsoft/ORBIT-Dataset.

Integrity signals

Registry

Crossref · 10.1109/iccv48922.2021.01064

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Prior efforts of disability-first datasets often focus on the data collection process.

    “While prior efforts of disabilityfirst datasets often focus on the data collection process [36, 47, 63, 68, 88, 98], our study represents an important step in centering disabled people and their expertise throughout the AI development pipeline.”
  • In disability contexts, key datasets include ORBIT, StammerTalk, ASL Citizen, and the grassroots Disabled And Here stock image collection.

    “In disability contexts, key datasets include ORBIT [80] -videos and images of objects recorded by people who are blind or low-vision; StammerTalk [74] and ASL Citizen [32] for speech and language impairments; and the grassroots Disabled And Here stock image collection celebrating disabled Black, Indigenous, People of Colour (BIPOC) [6].”

Cites

Flagged first, then by citations

5 of the 55 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Massiceti, D., Zintgraf, L., Bronskill, J., Theodorou, L., Harris, M. T., Cutrell, E., Morrison, C., Hofmann, K., & Stumpf, S.
Affiliations
  • Microsoft (United States) (US)
  • University of Oxford (GB)
  • University of Cambridge (GB)
  • City, University of London (GB)
Venue
2021 IEEE/CVF International Conference on Computer Vision (ICCV)
Publisher
IEEE
Published
2021-10
Pages
10798-10808
OpenAlex
W3200699344
Cited by
33
References
55
Citations by year
2026: 3 · 2025: 6 · 2024: 5 · 2023: 10 · 2022: 7 · 2021: 2
FWCI
2.77
Type
conference paper
Language
en
Open access
closed
Locations
IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
Funders
Microsoft
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
blind and visually impaired users, assistive technology, smartphone video, benchmark dataset

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review