The DOI matches its DataCite record; 61 of the 69 references it cites were found in a registry or an index.
SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities
Open accessAbstract
Understanding and reasoning about spatial relationships is a fundamental capability for Visual Question Answering (VQA) and robotics. While Vision Language Models (VLM) have demonstrated remarkable performance in certain VQA benchmarks, they still lack capabilities in 3D spatial reasoning, such as recognizing quantitative relationships of physical objects like distances or size differences. We hypothesize that VLMs' limited spatial reasoning capability is due to the lack of 3D spatial knowledge in training data and aim to solve this problem by training VLMs with Internet-scale spatial reasoning data. To this end, we present a system to facilitate this approach. We first develop an automatic 3D spatial VQA data generation framework that scales up to 2 billion VQA examples on 10 million real-world images. We then investigate various factors in the training recipe, including data quality, training pipeline, and VLM architecture. Our work features the first internet-scale 3D spatial reasoning dataset in metric space. By training a VLM on such data, we significantly enhance its ability on both qualitative and quantitative spatial VQA. Finally, we demonstrate that this VLM unlocks novel downstream applications in chain-of-thought spatial reasoning and robotics due to its quantitative estimation capability. Project website: https://spatial-vlm.github.io/
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our results (Table 2, Fig. 5) show that our instruction-tuned model achieves much higher precision than baselines using in-context learning [17, 22].”
From RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics (2024) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“SpatialVLM [22] took a step forward to predict spatial relations in metric space, but we show that ROBOPOINT can achieve better performance on real-world spatial reasoning tasks by locating affordances as points.”
From RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics (2024) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00371 · Cited by 11,953
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Self-citationSimultaneous localization and mapping: part I
Durrant-Whyte, H., & Bailey, T. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1638022 · Cited by 4,199
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590
Liu, H., Li, C., Wu, Q., & Lee, Y. J. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1516 · Cited by 2,428
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
Goyal, Y., Khot, T., Summers-Stay, D., Batra, D., & Parikh, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.670 · Cited by 2,287
Research works printed but not linked: 8
- Rohan Anil, Andrew M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, et al. Palm 2 technical report. arXiv preprint arXiv:2305.10403, 2023. · arXiv
- Anonymous. Flexcap: Generating rich, localized, and flexible captions in images. In Submitted to The Twelfth International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=7Phicg0WAg. under review.
- Liangyu Chen, Bo Li, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, and Ziwei Liu. Language models are visual reasoning coordinators. In ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation Models, 2023.
- Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, et al. A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd, volume 96, pages 226-231, 1996.
- Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. Mask r-cnn. In Proceedings of the IEEE international conference on computer vision, pages 2961-2969, 2017.
- Parsa Mahmoudieh, Deepak Pathak, and Trevor Darrell. Zero-shot reward specification via grounded natural language. In International Conference on Machine Learning, pages 14743-14752. PMLR, 2022.
- Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, pages 8748-8763. PMLR, 2021.
- Jesse Thomason, Mohit Shridhar, Yonatan Bisk, Chris Paxton, and Luke Zettlemoyer. Language grounding with 3d objects. In Conference on Robot Learning, pages 1691-1701. PMLR, 2022.
Cited by
Sorted by citations
Items 101–200 of 454
Spatial-TTT: Streaming Visual-based Spatial Intelligence with Test-Time Training
Liu, F., Wu, D., Chi, J., Cai, Y., Hung, Y., Yu, X., Li, H., Hu, H., Rao, Y., & Duan, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36839-3_19 · Cited by 12
Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding
Wu, X., Liang, D., Feng, T., Xia, K., Zhang, Y., Li, X., Tan, X., & Bai, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37235-2_15 · Cited by 12
Phantom of Latent for Large Language and Vision ModelsPreprint
Lee, B., Chung, S., Kim, C. W., Park, B., & Ro, Y. M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.14713 · Cited by 12
Lian, S., Wu, C., Yang, L. T., Yuan, H., Yu, B., Zhang, L., & Chen, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.24473 · Cited by 12
The Power of Context: How Multimodality Improves Image Super-Resolution
Mei, K., Talebi, H., Ardakani, M., Patel, V. M., Milanfar, P., & Delbracio, M. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02155 · Cited by 11
Sustainability assessment using multimodal artificial intelligence agents
Zhang, Z., Metzger, A. L., Mei, Y., Hähnlein, F., Englhardt, Z., Cheng, T., Abowd, G. D., Patel, S., Schulz, A., & Iyer, V. (2026) · Nature Electronics · doi:10.1038/s41928-026-01653-w · Cited by 11
Ji, B., Agrawal, S., Tang, Q., & Wu, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.13362 · Cited by 11
Spatial Policy: Guiding Visuomotor Robotic Manipulation with Spatial-Aware Modeling and ReasoningPreprint
Liu, Y., Liu, Y., Meng, Y., Zhang, J., Zhou, Y., Li, Y., Jiang, J., Ji, K., Ge, S., Wang, Z., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.15874 · Cited by 11
Wardle, G., & Sušnjak, T. (2025) · Big Data and Cognitive Computing · doi:10.3390/bdcc9060149 · Cited by 10
Self-Enhancing Video Data Management System for Compositional Events with Large Language Models
Zhang, E., Sullivan, N., Haynes, B. M., Krishna, R., & Bałazińska, M. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3725352 · Cited by 10
Han, B., Yun, W., Seo, B.-S., & Kim, J. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128120 · Cited by 10
Embodied Robot Manipulation in the Era of Foundation Models: Planning and Learning Perspectives
Bai, S., Song, W., Chen, J., Ji, Y., Zhong, Z., Yang, J., Zhao, H., Zhou, W., Li, Z., Ding, P., et al. (2026) · IEEE Transactions on Robotics · doi:10.1109/tro.2026.3734032 · Cited by 10
Self-citationAgentVLN: Towards Agentic Vision-and-Language Navigation
Xin, Z., Li, W., Jiang, Y., Huang, Z., Wang, B., Li, P., Zhu, J., Qin, J., & Huang, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37167-6_7 · Cited by 10
Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes
Wei, Z., Jiang, B., Han, X., Li, J., Yu, X., Liu, Y., Li, G., Han, Z., & Jiao, J. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02980-3 · Cited by 10
Robotic-CLIP: Fine-Tuning CLIP on Action Data for Robotic Applications
Nguyen, N. T., Vu, M. N., Ta, T. D., Huang, B., Vo, T., Le, N., & Nguyen, A. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127829 · Cited by 10
Enabling Waypoint Generation for Collaborative Robots using LLMs and Mixed RealityPreprint
Fang, C. M., Zieliński, K., Maes, P., Paradiso, J. A., Blumberg, B. M., & Kjærgaard, M. B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.09308 · Cited by 10
Embodied AI Through Cloud-Fog Computing: A Framework for Everywhere Intelligence
Hu, D., Lan, D., Liu, Y., Ning, J., Wang, J., Yang, Y., & Pang, Z. (2024) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie54533.2024.10595837 · Cited by 9
SpatialCLIP: Learning 3D-aware Image Representations from Spatially Discriminative Language
Wang, Z., Zhou, S., He, S., Huang, H., Yang, L., Zhang, Z., Cheng, X., Ji, S., Jin, T., Zhao, H., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02761 · Cited by 9
Xie, Y., Xu, R., He, T., Hwan, J.-J., Luo, K. Z., Ji, J., Lin, H., Chen, L., Lu, Y., Leng, Z., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00159 · Cited by 9
Placeit3d: Language-Guided Object Placement in Real 3D Scenes
Abdelreheem, A., Aleotti, F., Watson, J., Qureshi, Z., Eldesokey, A., Wonka, P., Brostow, G., Vicente, S., & Garcia-Hernando, G. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00626 · Cited by 9
ToSA: Token Merging with Spatial Awareness
Huang, H.-W., Chai, W., Chen, K.-M., Yang, C.-Y., & Hwang, J. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11245824 · Cited by 9
Wu, K., Xu, S., Chen, H., Wang, C., Li, Z., Wang, Y., & Zhong, F. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246600 · Cited by 9
Learning the RoPEs: Better 2D and 3D Position Encodings with STRINGPreprint
Schenck, C., Reid, I., Jacob, M. G., Bewley, A., Ainslie, J., Rendleman, D., Jain, D., Sharma, M. K., Dubey, A., Wahid, A., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.02562 · Cited by 9
LangLoc: Language-Driven Localization via Formatted Spatial Description Generation
Shi, W., Chen, C., Li, K., Xiong, Y., Cao, X., & Zhou, Z. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3546853 · Cited by 7
Shopfloor layout generation method based on large language models
Hu, Y., Sun, Y., Wen, X., Wang, S., & Bao, J. (2025) · International Journal of Computer Integrated Manufacturing · doi:10.1080/0951192x.2025.2482258 · Cited by 8
3D Part Segmentation via Geometric Aggregation of 2D Visual Features
Garosi, M., Tedoldi, R., Boscaini, D., Mancini, M., Sebe, N., & Poiesi, F. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00322 · Cited by 8
Liu, H., Wan, W., Yu, X., Li, M., Zhang, J., Zhao, B., Chen, Z., Wang, Z., Zhang, Z., & Wang, H. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128467 · Cited by 8
MonoSR: Open-Vocabulary Spatial Reasoning on Monocular Images
Wang, Q., He, J., Pan, Y., Yeo, S. Y., Yang, X., & Li, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37010-5_2 · Cited by 8
VIEW2SPACE: Studying Multi-view Visual Reasoning from Sparse Observations
Ke, F., Cai, Z., Li, B., Chen, L., Lin, B., Wang, W., Haghighi, P. D., Haffari, G., & Rezatofighi, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37531-5_29 · Cited by 8
OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligence
Liu, J., Sun, H., Li, W., Zhang, Y., Yang, R., Zhu, Z., Yang, Y., Zheng, S., Jiang, N., Jiang, J., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37467-7_16 · Cited by 8
Learning 4D Embodied World Models
Zhen, H., Sun, Q., Zhang, H., Li, J., Zhou, S., Du, Y., & Gan, C. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00507 · Cited by 8
Naver: a Neuro-Symbolic Compositional Automaton for Visual Grounding with Explicit Logic Reasoning
Cai, Z., Ke, F., Jahangard, S., de la Banda, M. G., Haffari, R., Stuckey, P. J., & Rezatofighi, H. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02232 · Cited by 8
Task-Oriented Robotic Manipulation with Vision Language Models
Guran, N. B., Ren, H., Deng, J., & Xie, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-07343-3_49 · Cited by 8
Understanding Depth and Height Perception in Large Visual-Language Models
Azad, S., Jain, Y., Garg, R., Rawat, Y. S., & Vineet, V. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00346 · Cited by 8
Foundation Models to the Rescue: Deadlock Resolution in Connected Multi-Robot SystemsPreprint
Garg, K., Zhang, S.-Y., Arkin, J., & Fan, C. (2024) · arXiv.org · doi:10.48550/arxiv.2404.06413 · Cited by 7
RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics
Yuan, W., Duan, J., Blukis, V., Pumacay, W., Krishna, R., Murali, A., Mousavian, A., & Fox, D. (2024) · arXiv · doi:10.48550/arxiv.2406.10721 · Cited by 7
Xu, M., Wu, M., Zhao, Y., Li, J. C. L., & Ou, W. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00620 · Cited by 7
Benchmarking the ancient books capability of multimodal large language models
Wang, D., & Zhu, D. (2025) · npj Heritage Science · doi:10.1038/s40494-025-01897-3 · Cited by 7
You, J., Li, P., Jiang, Z., Huang, Z., Gan, R., Shi, H., & Ran, B. (2026) · Accident Analysis & Prevention · doi:10.1016/j.aap.2026.108748 · Cited by 7
RoboStream: Weaving Spatio-Temporal Reasoning with Memory in Vision-Language Models for Robotics
Huang, Y., Wu, J., Bu, W., Xiong, Z., Jiang, G., Li, Y., Ji, K., Xie, S., Huang, Y., Wu, C., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37252-9_3 · Cited by 7
Cambrian-P: Pose-Grounded Video Understanding
Yang, J., Zhao, Z., Pan, X., Yang, S., Zhang, J., Xu, H., Li, S.-W. D., & Xie, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37252-9_18 · Cited by 7
Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models
Zhang, J., Zhang, M., Peng, Y., Liu, H., Wang, C., Long, Y., Huang, H., Li, D., Duan, N., Shen, H., et al. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836261 · Cited by 7
SysNav: Multi-Level Systematic Cooperation Enables Real-World, Cross-Embodiment Object Navigation
Zhu, H., Li, Z., Liu, Z., Guo, K., Lin, Z., Cai, Y., Chen, G., Lv, C., Wang, W., Oh, J., et al. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3713730 · Cited by 7
LEGO Co-builder: Exploring Fine-Grained Vision-Language Modeling for Multimodal Assembly Assistants
Huang, H., Su, Y., Sun, X., Ahsan, M., Aliannejadi, M., Viola, I., Ren, Z., Yu, C., Lisowska, A., Belopolsky, A. V., et al. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831119 · Cited by 7
MotIF: Motion Instruction Fine-Tuning
Hwang, M., Hejna, J., Sadigh, D., & Bisk, Y. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3527290 · Cited by 7
Self-citationMLLM-Search: A Zero-Shot Approach to Finding People Using Multimodal Large Language Models
Fung, A., Tan, A. H., Wang, H., Benhabib, B., & Nejat, G. (2025) · Robotics · doi:10.3390/robotics14080102 · Cited by 7
Semantic Enhancement for Object SLAM with Heterogeneous Multimodal Large Language Model Agents
Hong, J., Choi, R., & Leonard, J. J. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246672 · Cited by 7
Zhang, M., Fu, X., Hao, J., Han, P., Zhang, H., Shi, L., Tang, H., & Zheng, Y. (2024) · arXiv · doi:10.48550/arxiv.2407.05047 · Cited by 6
CCD: Mitigating Hallucinations in Radiology MLLMs via Clinical Contrastive Decoding
Zhang, X., Meng, Z., Lever, J., & Ho, E. S. L. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1755 · Cited by 6
Tang, Y., Zhang, L., Zhang, S., Zhao, Y., & Hao, X. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3758209 · Cited by 6
Embodied intelligence for robot manipulation: development and challenges
Song, H., Wang, L., Qiao, X., Chen, Y., Sun, D. M., & Sun, Z. (2025) · Vicinagearth. · doi:10.1007/s44336-025-00020-1 · Cited by 8
Vision-Language Memory for Spatial Reasoning
Liu, Z., Du, Y., Fu, T., Su, S., Ho, C., & Wang, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37356-4_17 · Cited by 6
Li, C., Yin, Y., Ye, H.-L., Zheng, P., & Gupta, S. K. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3605990 · Cited by 6
Hu, X., Qin, K., Duan, G., Li, M., Li, Y.-F., & He, T. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01444 · Cited by 6
Intelligence of Things: a spatial context-aware control system for smart devices
Kalivarathan, S., Mohamed, M., Ravikumar, A., & Sriraman, H. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3546 · Cited by 6
Spatial Task-Explicity Matters in Prompting Large Multimodal Models for Spatial Planning
Majić, I., Wang, Z., Janowicz, K., & Karimi, M. (2024) · ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery (GeoAI) · doi:10.1145/3687123.3698293 · Cited by 6
Zhang, Y., Ma, R., Zhang, X., & Li, Y. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714536 · Cited by 6
Spatial 3D-LLM : Exploring Spatial Awareness in 3D Vision-Language Models
Wang, X., Li, Z., Xu, Y., Qi, J., Yang, Z., Ma, R., Liu, X., & Zhang, C. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11208990 · Cited by 6
Muturi, T., Kyem, B. A., Asamoah, J. K., Owor, N. J., Dyzinela, R., Danyo, A., Adu-Gyamfi, Y. O., & Aboah, A. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00557 · Cited by 6
Zeng, Y., Wu, H., Nie, W., Chen, G., Zheng, X., Shen, Y., Peng, J., Tian, Y., & Ji, R. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02260 · Cited by 6
Seeing is Not Reasoning: MVPBench for Graph-based Evaluation of Multi-path Visual Physical CoTPreprint
Dong, Z., Yi, J., Zheng, Z., Han, H., Zheng, X., Wang, A. J., Liu, F., & Li, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.24182 · Cited by 6
Planning with the ViewsPreprint
Wang, K., Li, L., Yang, Z., Chen, S., Wang, Z., Fei-Fei, L., Wu, J., Guibas, L. J., Wang, L., & Li, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.29563 · Cited by 6
Self-citationHoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial MemoryPreprint
Zhou, X., Liu, L., Xiao, T.-Y., Feng, W., Fu, F., Meng, X., Wang, X.-J., Han, J., Yu, B., Du, Y., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.23565 · Cited by 5
AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulation
Duan, J., Pumacay, W., Kumar, N., Wang, Y. R., Tian, S., Yuan, W., Krishna, R., Fox, D., Mandlekar, A., & Guo, Y. (2024) · arXiv · doi:10.48550/arxiv.2410.00371 · Cited by 5
Magay, A., Tripathi, D., Yu, H., & Fang, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92591-7_20 · Cited by 5
M3DMap: Object-Aware Multimodal 3D Mapping for Dynamic Environments
Yudin, D. A. (2025) · Optical Memory and Neural Networks · doi:10.3103/s1060992x25700092 · Cited by 5
ExCap3d: Expressive 3D Scene Understanding via Object Captioning with Varying Detail
Yeshwanth, C., Rozenberszki, D., & Dai, A. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02015 · Cited by 5
Liu, C., Wei, Z., Liao, H., & Dong, W. (2026) · Transactions in GIS · doi:10.1111/tgis.70189 · Cited by 5
Nguyễn, T. P., Nguyen, H., Nguyen, S. H., & Ngo, H. Q. T. (2026) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-026-11170-9 · Cited by 5
OmniSch: A Multimodal PCB Schematic Benchmark for Structured Diagram Visual Reasoning
Lu, T., Lin, K., Tian, Y., Wang, Y., Wang, Y., Khatri, S., Kartik, A., Wang, Y., Rane, A. S., Wang, Y., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37044-0_38 · Cited by 5
Text-Guided 6D Object Pose Rearrangement via Closed-Loop VLM Agents
Baik, S., Kim, G., Choi, M., & Joo, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37135-5_21 · Cited by 5
Towards Scalable Spatial Intelligence Via 2D-To-3D Data Lifting
Miao, X., Duan, H., Qian, Q., Wang, J., Long, Y., Shao, L., Zhao, D., Xu, R., & Zhang, G. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00096 · Cited by 6
Bio-inspired cognitive navigation for robots
Hao, Z., Guo, B., Ding, Y., Li, L., Liu, S., Gao, T., Liu, S., & Yu, Z. (2026) · Nature Reviews Electrical Engineering · doi:10.1038/s44287-026-00294-7 · Cited by 5
Tanabe, H., & Yanai, . (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-2071-5_26 · Cited by 5
3DAxisPrompt: Promoting the 3D grounding and reasoning in GPT-4o
Liu, D., Wang, C., Gao, P., Zhang, R., Ma, X., Meng, Y., & Wang, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130072 · Cited by 5
Tian, Y., Lin, F., Zhang, X., Ge, J., Wang, Y., Dai, X., Lv, Y., & Wang, F. (2024) · IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI) · doi:10.1109/soli63266.2024.10956119 · Cited by 5
Zhou, H., Meng, Z., & Chen, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-02899-0_5 · Cited by 5
Enhancing Visual Planning with Auxiliary Tasks and Multi-token Prediction
Zhang, C., Song, Y., Desai, R., Iuzzolino, M. L., Tighe, J., Bertasius, G., & Kottur, S. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00408 · Cited by 5
LLaVA-VSD: Large Language-and-Vision Assistant for Visual Spatial Description
Jin, Y., Li, J., Zhang, J., Hu, J., Gan, Z., Tan, X., Liu, Y., Wang, Y., Wang, C., & Ma, L. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3688992 · Cited by 5
TR-LLM: Integrating Trajectory Data for Scene-Aware LLM-Based Human Action Prediction
Takeyama, K., Liu, Y., & Sra, M. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246714 · Cited by 5
Multimodal Language Models Cannot Spot Spatial InconsistenciesPreprint
Khangaonkar, O., Jamali‐Rad, H., & Pirsiavash, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.00799 · Cited by 5
PanoWorld: Towards Spatial Supersensing in 360$^\circ$ Panorama WorldPreprint
Wang, C., Lin, X., Liu, J., Liu, Y., Wang, Z., Qi, D., Yan, Y., & Chen, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.13169 · Cited by 5
Wang, R., Guo, M., Zhang, Y., Chen, J., Wei, Y., & Zhu, L. (2025) · Buildings · doi:10.3390/buildings15162827 · Cited by 4
Wang, C., Xia, F., Yu, W.-H., Zhang, T., Zhang, R.-H., Liu, C. K., Li, F.-F., Tan, J., & Liang, J. (2025) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra55743.2025.11128270 · Cited by 10
Self-citationXia, L., Chen, H., Pang, J., Liu, S., Zheng, P., & Ansari, F. (2025) · IEEE/ASME International Conference on Advanced Intelligent Mechatronics · doi:10.1109/aim64088.2025.11175780 · Cited by 4
Tasnim, N., Nichols, K., Yan, Y., Ikechukwu, N., Zou, E. X., Ghadiyaram, D., & Plummer, B. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37350-2_32 · Cited by 4
AdjustAR: AI-Driven In-Situ Adjustment of Site-Specific Augmented Reality Content
Numan, N., Brummelen, J. V., Lu, Z., & Steed, A. J. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746058.3758362 · Cited by 4
Xue, Q., Wang, H., Liu, W., Wang, H., Wu, Y., & Gao, W. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37255-0_28 · Cited by 4
Scaling Spatial Reasoning in MLLMS Through Programmatic Data Synthesis
Zhi, H., Huang, J., Xu, W., Xu, Y., Huang, Y., Zhang, W., Jiang, B., Deng, S., Zhu, L., Li, F., et al. (2026) · doi:10.1109/cvprf71909.2026.00884 · Cited by 4
Kadokawa, Y., Frey, J., Miki, T., Matsubara, T., & Hutter, M. (2026) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2026.3650847 · Cited by 4
3D-GENERALIST: Vision-Language-Action Models for Crafting 3D Worlds
Sun, F.-Y., Wu, S., Jacobsen, C., Yim, T., Zou, H., Zook, A., Li, S., Chou, Y., Can, E., Wu, X., et al. (2026) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv69130.2026.00177 · Cited by 4
LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video
Lang, S., Liu, J., He, H., Sun, P., Chen, Y., Liu, T., Yang, L., Guo, L., & Zhang, H. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.227 · Cited by 4
Yang, J., Fu, C., Shah, D., Sadigh, D., Xia, F., & Zhang, T. (2025) · Robotics: Science and Systems · doi:10.15607/rss.2025.xxi.155 · Cited by 4
Self-citationCalliReader: Contextualizing Chinese Calligraphy via an Embedding-Aligned Vision-Language Model
Luo, Y., Tang, J., Huang, C., Hao, F., & Lian, Z. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02138 · Cited by 6
Symbolic representation of objects relative poses for robotic manipulation tasks
Zappa, I., Vignali, S., Zanchettin, A. M., & Rocco, P. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112882 · Cited by 4
Free-form language-based robotic reasoning and grasping
Jiao, R., Fasoli, A., Giuliari, F., Bortolon, M., Povoli, S., Mei, G., Wang, Y., & Poiesi, F. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246686 · Cited by 4
SmolRGPT: Efficient Spatial Reasoning for Warehouse Environments with 600M Parameters
Traoré, A., Hervet, É., & Couturier, A. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00556 · Cited by 4
Domain-Conditioned Scene Graphs for State-Grounded Task Planning
Herzog, J., Liu, J., & Wang, Y. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247213 · Cited by 4
Efficient Navigation in Unknown Indoor Environments with Vision-Language ModelsPreprint
Schwartz, D., Kondo, K., & How, J. P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.04991 · Cited by 4
Metadata
- Authors
- Chen, B., Xu, Z., Kirmani, S., Ichter, B., Driess, D., Florence, P., Sadigh, D., Guibas, L., & Xia, F.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- Pages
- 14455-14465
- ISSN
- 1063-6919 (ISSN-L)
- arXiv
- 2401.12168
- OpenAlex
- W4402716288
- Cited by
- 269
- References
- 69
- Citations by year
- 2026: 122 · 2025: 127 · 2024: 20
- FWCI
- 55.53
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- vision-language models, spatial reasoning, 3D spatial reasoning, visual question answering, qualitative spatial reasoning, automatic data generation, metric spaces, chain-of-thought reasoning, robotics, distance estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
