CoChat

A Dataset for Improved RGBD-Based Object Detection and Pose Estimation for Warehouse Pick-and-Place

Open access
Rennie, Colin, Shome, Rahul, Bekris, Kostas E., De Souza, Alberto F. · 2016 · IEEE Robotics and Automation Letters

The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.

Abstract

An important logistics application of robotics involves manipulators that pick-and-place objects placed in warehouse shelves. A critical aspect of this task corresponds to detecting the pose of a known object in the shelf using visual data. Solving this problem can be assisted by the use of an RGBD sensor, which also provides depth information beyond visual data. Nevertheless, it remains a challenging problem since multiple issues need to be addressed, such as low illumination inside shelves, clutter, texture-less and reflective objects as well as the limitations of depth sensors. This letter provides a new rich dataset for advancing the state-of-the-art in RGBD-based 3D object pose estimation, which is focused on the challenges that arise when solving warehouse pick-and-place tasks. The publicly available dataset includes thousands of images and corresponding ground truth data for the objects used during the first Amazon Picking Challenge at different poses and clutter conditions. Each image is accompanied with ground truth information to assist in the evaluation of algorithms for object detection. To show the utility of the dataset, a recent algorithm for RGBD-based pose estimation is evaluated in this letter. Given the measured performance of the algorithm on the dataset, this letter shows how it is possible to devise modifications and improvements to increase the accuracy of pose estimation algorithms. This process can be easily applied to a variety of different methodologies for object pose detection and improve performance in the domain of warehouse pick-and-place.

Overview

Integrity signals

Registry

Crossref · 10.1109/lra.2016.2532924

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Research works printed but not linked: 4

  1. choi, 0, Proc IEEE/RSJ Int Conf Intell Robots Syst (IROS), 3342
  2. lai, 0, Proc AAAI Conf Artif Intell, 1474
  3. muja, 0, Proc IEEE Int Conf Robot Autom (ICRA), 2939
  4. steder, 0, Proc (IEEE/RSJ IROS) Workshop Defin Solv Realistic Percept Prob Pers Robot

Cited by

See all 182

Metadata

Authors
Rennie, C., Shome, R., Bekris, K. E., & De Souza, A. F.
Affiliations
Rutgers, The State University of New Jersey (US)
Venue
IEEE Robotics and Automation Letters
Published
2016-07
Volume
1
Issue
2
Pages
1179-1185
ISSN
  • 2377-3766 (ISSN-L)
  • 2377-3774
OpenAlex
W2221752211
Cited by
182
References
33
Citations by year
2026: 6 · 2025: 15 · 2024: 20 · 2023: 17 · 2022: 17 · 2021: 24 · 2020: 14 · 2019: 24 · 2018: 17 · 2017: 12 · 2016: 16
FWCI
19.32
Type
journal article
Language
en
Open access
Locations
  • IEEE Robotics and Automation Letters (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Rutgers University Community Repository (Rutgers University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
Keywords
RGB-D, 3D object pose estimation, object detection, depth sensing, cluttered scenes, low-light conditions, textureless objects, robotic manipulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.