The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects
Abstract
We present FoundationPose, a unified foundation model for 6D object pose estimation and tracking, supporting both model-based and model-free setups. Our approach can be instantly applied at test-time to a novel object without finetuning, as long as its CAD model is given, or a small number of reference images are captured. Thanks to the unified framework, the downstream pose estimation modules are the same in both setups, with a neural implicit representation used for efficient novel view synthesis when no CAD model is available. Strong generalizability is achieved via large-scale synthetic training, aided by a large language model (LLM), a novel transformer-based architecture, and contrastive learning formulation. Extensive evaluation on multiple public datasets involving challenging scenarios and objects indicate our unified approach outperforms existing methods specialized for each task by a large margin. In addition, it even achieves comparable results to instance-level methods despite the reduced assumptions. Project page: https://nvlabs.github.io/FoundationPose/
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In contrast, FoundationPose [37] demonstrates that ViTs can achieve high precision, but its multi-stage pipeline is not designed for deployment on edge devices.”
From FastPose-ViT: A Vision Transformer for Real-Time Spacecraft Pose Estimation (2026) · cites this paper as [37]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
NeRF: representing scenes as neural radiance fields for view synthesis
Mildenhall, B., Srinivasan, P. P., Tancik, M., Barron, J. T., Ramamoorthi, R., & Ng, R. (2022) · Communications of the ACM · doi:10.1145/3503250 · Cited by 6,852
Instant neural graphics primitives with a multiresolution hash encoding
Müller, T., Evans, A., Schied, C., & Keller, A. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530127 · Cited by 6,584
International Conference on Learning Representations (ICLR 2013)
松尾, 豊. (2013) · 人工知能学会誌 = Journal of Japanese Society for Artificial Intelligence · Cited by 6,286
Flagged first, then by citations
Research works printed but not linked: 2
- Dosovitskiy, An image is worth 16×16 words: Transformers for image recognition at scale
- Hodan, BOP: Benchmark for 6D object pose estimation, 19
Cited by
Sorted by citations
Items 301–357 of 357
Vision-Guided Robotic Bin-Picking of Disordered Workpieces via Image-Matching Pose Estimation
Wunti, A. U., Yu, L., Li, G., & Li, J. (2026) · Applied Sciences · doi:10.3390/app16178594
CAD2Real: CAD-Grounded Skill Primitives and Vision-Language Planning for Precision Assembly
马文龙, Li, C., Wang, L., Hu, C., Yu, D., Shi, Y., & Lou, W. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3730294
Petrović, O., Dohmen, P., Tesic, P., & Herfs, W. (2026) · Procedia CIRP · doi:10.1016/j.procir.2026.03.172
A Multi-Expert VLM Framework for Cognitive Robotic Manipulation in semi-structured Manufacturing
Tesic, P., Petrović, O., & Brecher, C. (2026) · Procedia CIRP · doi:10.1016/j.procir.2026.03.303
Planning and Control for Autonomous Landing of Quadrotor Unmanned Aerial Vehicles With Disturbances
Zhu, X., Fang, T., Zou, B., Ren, W., Gao, Y., Zhu, S., & Li, A. (2026) · Engineering Reports · doi:10.1002/eng2.71000
UF0-6D: Unified Flow-Based Zero-Shot 6D Object Pose Estimation Without Refinement
Guo, Y., Lim, C. H., Feng, Y., & Zhang, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37035-8_20
Geometry-Preserving Image Generation for 6D Object Pose Estimation
Zhang, J., Song, R., Zhang, Z., Li, J., Cao, K., Peng, L., Ferstl, D., & Hu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37369-4_9
XSemanticFlow: Cross Object Semantic Alignment for Zero-Shot Manipulation
Nan, J., Okorn, B., Kitani, K., & Eshed, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37464-6_10
Chen, Q., Zhang, X., Wan, Y., Pan, Z., Wang, K., Cai, Y., Yan, W., Feng, Y., & Chen, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37023-5_33
Reconstructing 3D Human-Object Interaction via a Unified Triplane Space
Chen, Y., & Wang, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37167-6_4
Liu, B., Gong, X., Zhao, Z., Song, Z., & Banerjee, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37592-6_17 · Cited by 7
Next best view selection for object pose estimation based on predicted images at next views
Takaoka, M., Ueda, J., Muragishi, K., & Tasaki, T. (2026) · Advanced Robotics · doi:10.1080/01691864.2026.2726673
WAPR: A Foundation Model for Wide-Angle Refinement in Unseen Object Pose Estimation
Wang, Y., Hu, M., Li, H., Zhou, J., & Luo, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37383-0_13
Enhancing robotic interoperability: An approach for ROS 2-driven system integration
Asif, S. A. S., Bueno, M., Anandan, P. D., Ferreira, P., Zhang, Z., Yao, Y., Hutabarat, W., Ragunathan, G., Tiwari, A., Lohse, N., et al. (2026) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2026.103420
Twin-DAgger: Synergizing Digital Twins and Human Corrections for Efficient Robot Manipulation
Li, J., Zhang, Z., Ding, K., Fei, F., Tang, Y., Liu, J., He, X., Chen, Z., Zhou, G., Ren, J., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37314-4_7
AI-Driven Bin Picking with Low-Cost Stereo Vision: From Perception to Grasp Execution
Dostrašil, D. (2026) · Mechanisms and machine science · doi:10.1007/978-3-032-35974-2_7
RGB-D Semantic-Guided 3D Geometric Estimation for Intelligent Coal Gangue Separation
Sun, Z., Zhou, Z., Sun, T., Wang, S., & Xiao, K. (2026) · Separations · doi:10.3390/separations13090263
Exo2EgoPolicy: Geometry-Aware Policy Transfer from Exocentric Human Demonstrations
Basak, H., Tabatabaee, H., Yang, X., Gayaka, S., Qiao, N., Sun, Y., Kuo, C.-H., Yin, Z., & Sun, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36984-0_6
RGA6D: Regional Geometry-Aware Correspondence Reasoning for Depth-Only Model-Free 6D Pose Estimation
Zhou, Q., Li, Z., Li, Q., & Ding, Y. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3734821
Real-Time 6D Ultrasound Probe Pose Tracking in Freehand Scanning
Son, J., Jung, G., Oh, S.-H., Lee, H., Kim, Y.-M., Kim, S.-Y., Kim, M.-G., Kwon, H., & Bae, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38236-8_38
PICO: Projection-Informed Consistency Optimisation for 6DoF surgical tool pose estimation
Fothergill, L., Valdastri, P., Jones, D., & Sarıkaya, D. (2026) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-026-03802-0
Dynamic-0: Dynamic Neural Networks Applied to a Model-free 6D Detection of Unseen Objects Pipeline
Greco, F. M. (2026) · Journal of Advances in Information Technology · doi:10.12720/jait.17.9.1810-1820
Bayesian Temporal Pose Networks for Uncertainty-Calibrated Laparoscopic Tool Pose Tracking
Choudhry, O., Ali, S., Biyani, C. S., & Jones, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38233-7_4
Efficient grasping of target objects in cluttered scenes
Zha, Y., Wang, Y., Wu, J., & Xiong, Z. (2026) · International Journal of Intelligent Robotics and Applications · doi:10.1007/s41315-026-00595-y
Vision on the Warehouse Floor: Perceptive HRI for Autonomous Forklifts
Jung, M., Hempel, T., Schulz, P., & Al-Hamadi, A. K. (2026) · Robotics · doi:10.3390/robotics15100191
Occluded object pose estimation based on adaptive graph neural network
Lu, X., Yang, H., & Jia, J. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-026-03318-8
A Train Hook-Lifting Rod Recognition System Based on YOLO11m-seg and FoundationPose
Lang, Z., Wu, W., Jiao, H., Li, Q., Zhao, H., Shi, L., & Dong, S. (2026) · International Conference on Mechanical, Electronics and Electrical and Automation Control (METMS) · doi:10.1109/metms70800.2026.11705874
What Truly Matters for Point-Cloud 6D Pose Estimation? A Controlled Empirical Study
Cai, X. (2026) · International Conference on Mechanical, Electronics and Electrical and Automation Control (METMS) · doi:10.1109/metms70800.2026.11706207
Safeguarded Multi-Hypothesis 6D Pose Refinement with Instance-Shared 2D-3D Consistency Scoring
Zheng, S., Liu, C., & Wang, H. (2026) · International Conference on Computer Vision and Data Mining (ICCVDM) · doi:10.1109/iccvdm71812.2026.11709117
Boosting 6D Object Pose Estimation via Monocular Depth Cues
Hao, F., Song, R., Wang, Q., Li, J., Hu, Z., Ferstl, D., & Hu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37531-5_25
Pei, W. W., Wang, E., Miao, Q., Gao, L., Li, X., & Gao, Y. (2026) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case69030.2026.11704514
Embodied Intelligence-Driven Mobile Parallel Robots for Flexible Assembly of High-End Equipment
Cao, W., Lian, B., Li, S., Wang, T., & Sun, T. (2026) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case69030.2026.11704515
Constraint-Induced Stage Transition Detection for Contact-Rich Robotic Assembly
甘, 笑., & Li, M. (2026) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case69030.2026.11704207
Robust Force-Controlled Robotic Insertion Skills for Geometrically Diverse Parts Under Uncertainty
Rios, F. U., Iregui, S., Aertbeliën, E., Decré, W., & Bruyninckx, H. (2026) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case69030.2026.11704117
From Noisy Hands to Stable Grasps: Object-Centric Dexterous Retargeting
Huang, Z., Yan, C.-B., Li, R., Wang, C., Wang, S., & Wang, X. (2026) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case69030.2026.11704338
Ding, J., Liu, Y., Zhang, H., Zhang, H., Perzylo, A., & Beetz, M. (2026) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case69030.2026.11704209
Dual Modal Tactile Driven In-Hand Object Pose Estimation for Multi-Fingered Dexterous Hands
Shao, L., Zhao, H., Li, X., Wang, Z., & Ding, H. (2026) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case69030.2026.11704244
Tamiru, A. M., Cuellar, V.-D. M., Ragot, N., & Duval, F. (2026) · Intelligent Robotics FAIR · doi:10.1145/3831600.3831602
WHOLE: World-Grounded Hand-Object Lifted from Egocentric Videos
Ye, Y., Li, J., Rong, R., & Liu, C. K. (2026) · doi:10.1109/cvprf71909.2026.00338
Revisiting Articulated Parts Perception in Robot Manipulation
Wu, X., Guo, Y., Chen, X., Yang, L., Lu, C., & Li, Y.-L. (2026) · doi:10.1109/cvprf71909.2026.00136
Robust CAD-Guided Zero-Shot Instance Localization as a Front End for 6-D Pose Measurement
Dai, R., Chen, L., Han, Q., Yao, J. S., Xian, K., & Qiu, R. C. (2026) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2026.3738112
Improving 6D Object Pose Estimation via Clustering-Based Multi-View Consensus
Janik, B. Á., & Varga, V. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39388-3_5
Kozlik, M., Wachtler, E., Alamdar, K. G., Cirkvencic, K., Petric, F., & Orsag, M. (2026) · IEEE RO-MAN · doi:10.1109/ro-man72286.2026.11714951
An Empirical Study of Depth Inference Scheduling for Dynamic Anchoring in Mobile AR
Huang, Z., Zhao, Y., & Guo, T. (2026) · ACM Workshop on Mobile Immersive Computing, Networking, and Systems (ImmerCom) · doi:10.1145/3842656.3843833
Hou, Z., He, Z., Yang, C., & Chen, X. (2026) · Electronics · doi:10.3390/electronics15204623
SeeGrasp: Semantic-Empowered Efficient Grasping via Robotic Active Spatial Perception
Yu, Z., & Li, P. (2026) · International Conference on Control, Robotics and Intelligent System (CCRIS) · doi:10.1109/ccris71163.2026.11721756
Generation of Photorealistic 3-D Models for Robot Manipulation
Erich, F., Ferguson, A., Brin, P., Mustafa, A., Hanai, R., Ando, N., Yoshiyasu, Y., & Domae, Y. (2026) · IEEE robotics and automation practice. · doi:10.1109/rap.2026.3742330
A path to common sense robotics—vision, actions & reasoning
Neuberger, B., Scherl, A., Muster, L., Schwaiger, S., Blaha, A., Sturm, F., Pammer, L., Schebek, M., & Kornfellner, E. (2026) · e+i Elektrotechnik und Informationstechnik · doi:10.1007/s00502-026-01456-z
Targetless Thermal-to-CAD Registration for 3D Die Temperature Monitoring via Perspective-$n$-Lines
Janus, J., Kemmetmüller, W., Strommer, S., & Glück, T. (2026) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa68377.2026.11725091
Affordance-Aware Manipulation using Knowledge Graph and Structured Reasoning
Chakraborty, A., Sadhu, A. K., Banerjee, S., & Dasgupta, R. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729691
Hwang, H., Shin, H., Bae, J., Lee, S., & Park, J. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3744364
3D Gaussian Digital Twins for View-Robust 3D Visuomotor Policy Learning on Articulated Objects
Liu, X., Zhang, Y., Zhang, Y., Han, F., Cui, J., Lou, J., Wang, Y., Zhu, Z. D., Ding, R., & Niu, J. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3745009
Zheng, Y., Pan, S., Zhu, Z., Liu, Y., Ge, Y., Zhang, Y., Chen, Z., Xu, C., Yang, X., Jin, Y., et al. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-03056-y
Wang, L., Wang, T., Chen, X., Chen, Y., Lin, Y., Meng, Y., Zhao, R., & Shi, L. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-03089-3
A large scale maritime visual object tracking dataset and benchmark
Bakht, A. B., Din, M. U., Javed, S., & Hussain, I. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.115193
Chen, C., Lai, J., Zhao, W., Wang, H., & Liu, F. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.105401
EventProp6D: Inter-Frame Event-Guided Pose Propagation for RGB-D 6D Object Pose Tracking
Han, Z., Chen, L., Bian, B., & Wu, S. (2026) · Electronics · doi:10.3390/electronics15215038
Metadata
- Authors
- Wen, B., Yang, W., Kautz, J., & Birchfield, S.
- Affiliations
- Nvidia (United Kingdom) (GB)
- Venue
- 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2024-06-16
- Pages
- 17868-17879
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4402754209
- Cited by
- 353
- References
- 73
- Citations by year
- 2026: 165 · 2025: 161 · 2024: 27
- FWCI
- 98.24
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- 6D pose estimation, foundation models, model-based pose estimation, CAD models, implicit neural representations, novel view synthesis, large language models, contrastive learning, transformer models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
