Cited by 3573D Shape Modeling and AnalysisRobot Manipulation and LearningAdvanced Neural Network Applications

FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects

Wen, Bowen, Yang, Wei, Kautz, Jan, Birchfield, Stan·2024·2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Abstract

We present FoundationPose, a unified foundation model for 6D object pose estimation and tracking, supporting both model-based and model-free setups. Our approach can be instantly applied at test-time to a novel object without finetuning, as long as its CAD model is given, or a small number of reference images are captured. Thanks to the unified framework, the downstream pose estimation modules are the same in both setups, with a neural implicit representation used for efficient novel view synthesis when no CAD model is available. Strong generalizability is achieved via large-scale synthetic training, aided by a large language model (LLM), a novel transformer-based architecture, and contrastive learning formulation. Extensive evaluation on multiple public datasets involving challenging scenarios and objects indicate our unified approach outperforms existing methods specialized for each task by a large margin. In addition, it even achieves comparable results to instance-level methods despite the reduced assumptions. Project page: https://nvlabs.github.io/FoundationPose/

Integrity signals

Registry

Crossref · 10.1109/cvpr52733.2024.01692

Cites

77 of 77 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • FoundationPose demonstrates that ViTs can achieve high precision, but its multi-stage pipeline is not designed for deployment on edge devices.

    “In contrast, FoundationPose [37] demonstrates that ViTs can achieve high precision, but its multi-stage pipeline is not designed for deployment on edge devices.”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Wen, B., Yang, W., Kautz, J., & Birchfield, S.
Affiliations
Nvidia (United Kingdom) (GB)
Venue
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher
IEEE
Published
2024-06-16
Pages
17868-17879
ISSN
1063-6919 (ISSN-L)
OpenAlex
W4402754209
Cited by
353
References
73
Citations by year
2026: 165 · 2025: 161 · 2024: 27
FWCI
98.24
Type
conference paper
Language
en
Open access
closed
Locations
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
Topics
  • Physical Sciences › Engineering › Computational Mechanics › 3D Shape Modeling and Analysis
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
6D pose estimation, foundation models, model-based pose estimation, CAD models, implicit neural representations, novel view synthesis, large language models, contrastive learning, transformer models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review