The DOI matches its DataCite record; 61 of the 69 references it cites were found in a registry or an index.
SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities
Open accessAbstract
Understanding and reasoning about spatial relationships is a fundamental capability for Visual Question Answering (VQA) and robotics. While Vision Language Models (VLM) have demonstrated remarkable performance in certain VQA benchmarks, they still lack capabilities in 3D spatial reasoning, such as recognizing quantitative relationships of physical objects like distances or size differences. We hypothesize that VLMs' limited spatial reasoning capability is due to the lack of 3D spatial knowledge in training data and aim to solve this problem by training VLMs with Internet-scale spatial reasoning data. To this end, we present a system to facilitate this approach. We first develop an automatic 3D spatial VQA data generation framework that scales up to 2 billion VQA examples on 10 million real-world images. We then investigate various factors in the training recipe, including data quality, training pipeline, and VLM architecture. Our work features the first internet-scale 3D spatial reasoning dataset in metric space. By training a VLM on such data, we significantly enhance its ability on both qualitative and quantitative spatial VQA. Finally, we demonstrate that this VLM unlocks novel downstream applications in chain-of-thought spatial reasoning and robotics due to its quantitative estimation capability. Project website: https://spatial-vlm.github.io/
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our results (Table 2, Fig. 5) show that our instruction-tuned model achieves much higher precision than baselines using in-context learning [17, 22].”
From RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics (2024) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“SpatialVLM [22] took a step forward to predict spatial relations in metric space, but we show that ROBOPOINT can achieve better performance on real-world spatial reasoning tasks by locating affordances as points.”
From RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics (2024) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00371 · Cited by 11,953
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Self-citationSimultaneous localization and mapping: part I
Durrant-Whyte, H., & Bailey, T. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1638022 · Cited by 4,199
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590
Liu, H., Li, C., Wu, Q., & Lee, Y. J. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1516 · Cited by 2,428
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
Goyal, Y., Khot, T., Summers-Stay, D., Batra, D., & Parikh, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.670 · Cited by 2,287
Research works printed but not linked: 8
- Rohan Anil, Andrew M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, et al. Palm 2 technical report. arXiv preprint arXiv:2305.10403, 2023. · arXiv
- Anonymous. Flexcap: Generating rich, localized, and flexible captions in images. In Submitted to The Twelfth International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=7Phicg0WAg. under review.
- Liangyu Chen, Bo Li, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, and Ziwei Liu. Language models are visual reasoning coordinators. In ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation Models, 2023.
- Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, et al. A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd, volume 96, pages 226-231, 1996.
- Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. Mask r-cnn. In Proceedings of the IEEE international conference on computer vision, pages 2961-2969, 2017.
- Parsa Mahmoudieh, Deepak Pathak, and Trevor Darrell. Zero-shot reward specification via grounded natural language. In International Conference on Machine Learning, pages 14743-14752. PMLR, 2022.
- Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, pages 8748-8763. PMLR, 2021.
- Jesse Thomason, Mohit Shridhar, Yonatan Bisk, Chris Paxton, and Luke Zettlemoyer. Language grounding with 3d objects. In Conference on Robot Learning, pages 1691-1701. PMLR, 2022.
Cited by
Sorted by citations
Items 201–300 of 454
SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot NavigationPreprint
Munje, M. J., Tang, C., Liu, S., Hu, Z., Zhu, Y., Cui, J., Warnell, G., Biswas, J., & Stone, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.08757 · Cited by 4
Kong, F., Duan, J., Xu, K., Guo, Z., Zhu, X., & Shi, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.20174 · Cited by 4
SOLE-R1: Video-Language Reasoning as the Sole Reward for On-Robot Reinforcement LearningPreprint
Schroeder, P., Weng, T., Schmeckpeper, K., Rosen, E., Hart, S., & Bíža, O. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.28730 · Cited by 4
Chen, Z., Chambara, N., Liu, S. Y. W., Chow, T. C. M., Lai, C. M. S., & Ying, M. T. C. (2025) · Diagnostics · doi:10.3390/diagnostics15202617 · Cited by 3
Kong, Y., Song, D., Liang, J., Manocha, D., Yao, Z., & Xiao, X. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11245987 · Cited by 3
Chao, X., Jiang, J., Ma, W., Li, Y., Nie, J., Erċışlı, S., & Muhammad, G. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3641637 · Cited by 3
Spatial Multimodal Knowledge-Driven 3D Scene Graph Prediction With Vision-Language Model
Hou, H. S., Feng, M., Wu, Z., Guo, Y., Wang, Y., & Mian, A. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3664122 · Cited by 3
MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model
Lee, Y., Jang, S., Cho, Y., Lee, S., Lee, Y.-J., & Hwang, S. J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37447-9_32 · Cited by 3
3D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing
Zhen, H., Li, X., Zhao, Y., Zhang, H., Liu, S., Mo, K., Gan, C., & Radhakrishnan, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37135-5_29 · Cited by 3
SMART: When is It Actually Worth Expanding a Speculative Tree?
Wang, L., & Zhou, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37627-5_13 · Cited by 3
Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Models
Yang, Y., Lin, M., Martín-Martín, R., Labrie, M., Gayaka, S., Kuo, C.-H., & Carlone, L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37271-0_2 · Cited by 3
Towards Spatial Supersensing in the Wild
Gu, T., Xin, T., Zhang, K., Yang, B., Chua, K.-C., Li, P., Zhang, X., Chen, Y., Zhao, Q., Xie, Q., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37174-4_25 · Cited by 3
Martin, E., Hasegawa, S., Solis, J., Macq, B. M. M., Ronsse, R., Ricardez, G. A. G., Hafi, L. E., & Taniguchi, T. (2025) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii59315.2025.10871045 · Cited by 3
Training-Free Generation of Temporally Consistent Rewards from VLMs
Zhao, Y., Yuan, J., Xu, Z., Hao, X., Zhang, X., Wu, K., Che, Z., Liu, C. H., & Tang, J. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00762 · Cited by 3
Self-citationRAU: Reference-Based Anatomical Understanding with Vision Language Models
Li, Y., Liu, Y., Guo, J., Zhao, L., Zhang, Z., Chen, X., Mailhé, B., Mukherjee, A., Chen, T., & Sun, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37041-9_19 · Cited by 3
GACO-CAD: Geometry-Augmented and Conciseness-Optimized CAD Model Generation from Single ImagePreprint
Wang, Y., Zhang, X., & Du, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.17157 · Cited by 3
Huang, R., Ma, X., Kong, R., Yuan, Z., & Zhang, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.00821 · Cited by 3
Rezaei, P., Marioriyad, A., Baghshah, M. S., & Rohban, M. H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.23418 · Cited by 3
GRAID: Enhancing Spatial Reasoning of VLMs Through High-Fidelity Data GenerationPreprint
Elmaaroufi, K., Lai, L., Svegliato, J., Bai, Y., Seshia, S. A., & Zaharia, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.22118 · Cited by 3
From Perception to Action: Spatial AI Agents and World ModelsPreprint
Felicia, G., Bryant, N., Putra, H., Gazali, A., Lobo, E., & Rojas, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.01644 · Cited by 3
Latent State Design for World Models under Sufficiency ConstraintsPreprint
Kim, K. W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.01694 · Cited by 3
LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded DialoguePreprint
Li, C., Xu, Y., Feng, J., & Ding, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.19390 · Cited by 3
Text‐Guided Interactive Scene Synthesis with Scene Prior Guidance
Fang, S., Yang, H., Mooney, R. J., & Huang, Q. (2025) · Computer Graphics Forum · doi:10.1111/cgf.70039 · Cited by 2
Wang, C., Zhang, L., & Zhou, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113711 · Cited by 2
V-PRUNE: Semantic-Aware Patch Pruning Before Tokenization in Vision–Language Model Inference
Seo, H., & Choi, Y. S. (2025) · Applied Sciences · doi:10.3390/app15179463 · Cited by 2
HamlAbadi, K. G., Vahdati, M., Dong, H., & Saddik, A. E. (2025) · doi:10.1145/3728487.3759232 · Cited by 2
Uni-Sight: An E2E Vision-Language-Action System Unifying Multi-View Alignment and Multi-Modal Fusion
Li, D., He, S., Tian, J., Zhang, Y., Xie, W., Cao, M., Donglai, L., Li, Z., Hui, T., Huang, R., et al. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754495 · Cited by 2
Song, Z., Yang, J., Fang, L., Ali, M. U., Kumar, G., Bashir, A. K., Alturki, N. M., Por, L. Y., & Lee, S. W. (2026) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2026.3655159 · Cited by 2
Jia, L., Alva, K. S., Li, H., Hager, W., Romero, L., Butler, T. A., & Lewis, M. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2622580 · Cited by 2
Huang, H.-W., Kim, P.-K., Cheng, J.-H., Chen, K.-M., Yang, C.-Y., Alattar, B., Lin, Y.-R., Kim, S., Kim, K., Huang, C.-I., et al. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00550 · Cited by 2
TNavRL: Cross-Modal Transformer for Humanoid Visual Navigation
Huang, F., Mou, H., & Li, Q. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3669788 · Cited by 2
ViewFusion: Structured Spatial Thinking Chains for Multi-view Reasoning
Tao, X., Wang, Y., Cai, Y., Song, Y., & Tang, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37447-9_8 · Cited by 2
Towards LLM-powered Assistive Drone for Blind and Low Vision Users
Wei, Y., Adam, I. T. B., Wu, H., Messerschmidt, M. A., Ooi, W. T., Jouffrais, C., & Nanayakkara, S. C. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791343 · Cited by 2
AI-generated AR Reassembly Guidance from Disassembly Videos to Scaffold Everyday Repair
Deng, W., Yao, Z., Kang, X., Sun, Q., Wu, X., He, S., Xiang, C., & Mi, H. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790494 · Cited by 2
FineG-RAG: Fine-Grained Retrieval-Augmented Generation for Multimodal Large Language Models
Jin, L., Lin, C., Xiang, X., Sun, Y., Li, Z., & Tang, J. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3686876 · Cited by 2
A retrieval-augmented framework enabling VLM spatial awareness for object-centric robot manipulation
Chen, K., Li, C., Tu, C., Pan, J., Ma, Y., Chen, W., Zhou, Z., Xu, X., James, S., Fu, C., et al. (2026) · Science Robotics · doi:10.1126/scirobotics.aea2092 · Cited by 2
Passing the Driving Knowledge Test
Wei, M., Liu, W., & Ohn-Bar, E. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00786 · Cited by 2
FAST-EQA: Efficient Embodied Question Answering with Global and Local Region Relevancy
Zhang, H., Savaliya, N., Siddiqui, F., & Sachdeva, E. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00167 · Cited by 2
SpaceEra++: A Unified Framework Toward 3D Spatial Reasoning in Video
Guan, W., ZHANG, H., Liu, M., Xiang, Q., Wang, Y., & Nie, L. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3692302 · Cited by 2
Why Far Looks Up: Probing Spatial Representation in Vision-Language Models
Min, C., Jung, J., Lee, D., Jeon, H., Su, Y., Tremblay, J., Song, C. H., & Park, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37167-6_2 · Cited by 2
DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding
Zhang, Z., Huang, H., Tu, Z., & Yang, M.-H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37095-2_5 · Cited by 2
VISOR: A Vision-Language Model-Based Test Oracle for Testing Robots
Saurabh, P., Valle, P., Arrieta, A., Ali, S., & Arcaini, P. (2026) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1145/3805760.3814910 · Cited by 2
Choi, J., Lee, J. W., You, S., & Lee, J. (2026) · doi:10.1109/cvprf71909.2026.00910 · Cited by 2
Counterfactual Segmentation Reasoning: Diagnosing and Mitigating Pixel-Grounding Hallucination
Li, X., Juvekar, A. S., Zhang, J., Liu, X., Wahed, M., Nguyen, K. A., Shen, Y., Yu, T., & Lourentzou, I. (2026) · doi:10.1109/cvprf71909.2026.00715 · Cited by 2
AdvDreamer Unveils: Are Vision-Language Models Truly Ready for Real-World 3D Variations?
Ruan, S., Liu, H., Huang, Y., Wang, X., Kang, C., Su, H., Dong, Y., & Wei, X. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00740 · Cited by 2
Contrastive Learning of Image Representations Guided by Spatial Relations
Servant, L., Clément, M., Wendling, L., & Kurtz, C. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00213 · Cited by 2
Waite, J. R., Hasan, M. Z., Liu, Q., Jiang, Z., Hegde, C., & Sarkar, S. (2025) · ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) · doi:10.1145/3716550.3722033 · Cited by 2
Advancements in 3D vision understanding using multimodal large language models
Feng, M., Shen, J., Wu, Z., Peng, W., Zhong, H., Guo, Y., Shu, X., Zhang, H., Weisheng, D., & Wang, Y. (2025) · Journal of Image and Graphics · doi:10.11834/jig.240588 · Cited by 2
Monitoring Safety Properties for Autonomous Driving Systems with Vision-Language Models
Toledo, F., Elbaum, S. G., Gopinath, D., Kaur, R., Mangal, R., Păsăreanu, C. S., Roy, A., & Jha, S. (2025) · IEEE Engineering Reliable Autonomous Systems (ERAS) · doi:10.1109/eras63351.2025.11135768 · Cited by 2
Multimodal and Multi-task Fusion for Spatial Reasoning
Dang, V. T. A., & Le, T.-S. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00565 · Cited by 2
SeMv-3D: Toward Concurrency of Semantic and Multi-View Consistency in General Text-to-3D Generation
Cai, X., Zeng, P., Gao, L., Su, S., Shen, H. T., & Song, J. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3671597 · Cited by 2
A framework of large language model commander agent for spatial reasoning in combat simulation
Chen, Y.-B., Ping, Y., Shuhang, Z., & Jojo, C. (2026) · Scientific Reports · doi:10.1038/s41598-026-43365-3 · Cited by 2
RoboGolf: Mastering Real-World Minigolf with a Reflective Multi-Modality Vision-Language ModelPreprint
Zhou, H., Ji, T., Sommerhalder, L., Goerner, M., Hendrich, N., Zhang, J., Sun, F., & Xu, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.10157 · Cited by 2
DegustaBot: Zero-Shot Visual Preference Estimation for Personalized Multi-Object RearrangementPreprint
Newman, B. A., Gupta, P., Kitani, K., Bisk, Y., Admoni, H., & Paxton, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.08876 · Cited by 2
Towards Spatio-Temporal World Scene Graph Generation from Monocular VideosPreprint
Peddi, R., Saurabh, Shanmugam, S., Pallapothula, L., Yu, X., Singla, P., & Gogate, V. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.13185 · Cited by 2
GeoAlign: Beyond Semantics with State-Guided Spatial Alignment in VLA ModelsPreprint
Chen, Y., Cao, Z., Peng, X., Zheng, Y., Si, X., Li, Y., Yan, L., Zhu, K., Chen, X., Fu, S., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.03240 · Cited by 2
JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw PuzzlesPreprint
Li, S., Yang, W., Zhong, J., Li, J., Yang, J., Qin, Y., Rossi, R., Dernoncourt, F., Zimmermann, R., Wang, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.27670 · Cited by 2
When Memory Lies: An Empirical Study of Spatial Memory Staleness in VLM AgentsPreprint
Sun, Y., & Zhang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.04574 · Cited by 2
Anarossi, E., Kwon, Y., Tahara, H., Tanaka, S., Shirai, K., Hamaya, M., Beltran-Hernandez, C. C., Hashimoto, A., & Matsubara, T. (2025) · IEEE Access · doi:10.1109/access.2025.3588975 · Cited by 1
SPIN-SGG: spatial integration for open-vocabulary scene graph generation
Liang, N., Yang, X., Wang, S., Liu, Y., & Xia, Y. (2025) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-025-00203-2 · Cited by 1
VisiQuest:Video-Question Answering with Advanced Vision-Language AI
Praneeth, S., Kumar, R. P., & Pallavi, G. (2025) · International Conference on Computing Technologies (ICOCT) · doi:10.1109/icoct64433.2025.11118375 · Cited by 1
VAP-Diffusion: Enriching Descriptions with MLLMs for Enhanced Medical Image Generation
Huang, P., Fu, J., Guo, B., Li, Z., Wang, Y., & Guo, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05141-7_60 · Cited by 1
Zhu, Z., Zheng, Y., Pan, S., Jin, Y., & Mu, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00837 · Cited by 1
Spatial Reasoner: A 3D Inference Pipeline for XR Applications
Hasler, S., & Ackermann, P. (2025) · 2025 International Conference on Intelligent Computing and Virtual & Augmented Reality Simulations (ICVARS) · doi:10.1109/icvars66454.2025.11198690 · Cited by 1
Shopfloor-Integrated Manufacturing Operation Planning through Agents
Gerdes, H., Reisch, R. T., & Burschka, D. (2025) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa65518.2025.11205809 · Cited by 1
HouseTour: A Virtual Real Estate A(I)gent
Çelen, A., Pollefeys, M., Baráth, D., & Armeni, I. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01650 · Cited by 1
FashionLIP: Automated Fashion Image Captioning Using Cascaded Contrastive Learning
Hegde, A., Kuppala, Y., & Ma, M. (2025) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr67560.2025.00024 · Cited by 1
Enhancing Spatial Reasoning in Multimodal Vision-Language Models via Depth-Aware Feature Integration
Tsuji, H. (2025) · ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD) · doi:10.1109/snpd65828.2025.11254066 · Cited by 1
Li, Z., Kong, X., Su, J., Ma, Z., Li, M., Li, S., Zhang, Y., Yu, R., Xu, T., Zhao, D., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37092-1_30 · Cited by 1
Beyond Description: Cognitively Benchmarking Fine-Grained Action for Embodied Agents
Liu, D., Xu, C., Chen, W., Zhang, S., Wang, J., Deng, J., Sun, B., & Liu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37010-5_21 · Cited by 1
Planes, Not A380: How Prompting, Context, and Granularity Shape VLM Performance in Aerial Imagery
Ouerghemi, N., Tomoiagă, C., & Detyniecki, M. (2025) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2025.3649701 · Cited by 1
Spatial-ViLT: Enhancing Visual Spatial Reasoning Through Multi-task Learning
Islam, C. M., Mamo, O., Chacko, S. J., Liu, X., & Yu, W. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-14495-9_4 · Cited by 1
ST-BiBench: Benchmarking Multi-Stream Multimodal Coordination in Bimanual Embodied Tasks for MLLMs
Wu, X., Liang, Z., Ma, Y., Hu, M., Qin, Z., & Li, X. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836297 · Cited by 1
Ly, V.-T., Truong, H. M., & Nguyen, X.-H. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00577 · Cited by 1
From 2D to XR: enhancing object placement in design simulations through spatial relations
Bazargani, J. S., Sadeghi-Niaraki, A., & Choi, S.-M. (2026) · Virtual Reality · doi:10.1007/s10055-026-01327-0 · Cited by 1
Song, Z., Jiang, B., Wang, X., Sun, Y., Yu, R., & Li, T. (2026) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2026.3675515 · Cited by 1
CoME-VL: Scaling Complementary Multi-Encoder Vision-Language Learning
Deria, A., Kumar, K., He, X., Razzak, I., Cholakkal, H., Khan, F. S., & Khan, S. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836231 · Cited by 1
Tang, Q., Wang, Z., Lin, J., Li, Z., de Salvo, B., & Zhang, S. Q. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37235-2_9 · Cited by 1
Claramunt, C., Sloover, L. D., & de Weghe, N. V. (2026) · Computational Urban Science · doi:10.1007/s43762-026-00264-7 · Cited by 1
Auto-Controlled Image Perception in MLLMs via Visual Perception Tokens
Yu, R., Ma, X., & Wang, X. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02026 · Cited by 1
Chen, J., Shen, W., Wei, Z., Sun, L., & Zhang, H. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01898 · Cited by 1
Hao, X., Tang, Y., Zhang, L., Chen, L., Zhou, W., Han, J., Ding, W., & Zhang, X.-P. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3698366 · Cited by 1
Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Task
Liu, Y., Kotseruba, I., & Tsotsos, J. K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37020-4_35 · Cited by 1
Bioinspired multimodal robotics
Ren, Z., Duo, Y., Xu, H., Zhang, Y., Liu, X., Paik, J. K., Ijspeert, A. J., & Wen, L. (2026) · Science Robotics · doi:10.1126/scirobotics.aea7639 · Cited by 1
Fong, T. L., Hu, H., Zeng, H., Abbasi, P., & Murphy, T. H. (2026) · Neurophotonics · doi:10.1117/1.nph.13.3.036601 · Cited by 1
Grounding Robot Generalization in Training Data via Retrieval-Augmented VLMs
Gao, J., Sadigh, D., Huang, S., & Shah, D. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3726331 · Cited by 1
Self-citationMetric-Bench: Exploring In-Context Spatial Metric Reasoning in VLMs for Indoor Scenes
Xi, Y., Zhang, H., Zhu, M., Zhong, H., Du, Z., Zhao, H., Jing, C., Yin, Y., Qin, B., Yang, Y., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37429-5_17 · Cited by 1
Beyond Recognition: Evaluating Visual Perspective Taking in Vision Language Models
Góral, G., Ziarko, A., Miłoś, P., Nauman, M., Wołczyk, M., & Kosinski, M. (2026) · doi:10.1109/cvprf71909.2026.00170 · Cited by 1
Ma, W., Sun, S., Yu, T., Wang, R., Chua, T., & Bian, J. (2026) · doi:10.1109/cvprf71909.2026.00856 · Cited by 1
Low-Cost 3D Authoring via Guided Diffusion in GUI-Driven Pipeline
Hu, X. (2025) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat66811.2025.11181952 · Cited by 1
MARS2 2025 Challenge on Multimodal Reasoning: Datasets, Methods, Results, Discussion, and Outlook
Xu, P., Xiong, S., Zhang, J., Chen, Y., Zhou, B., Loy, C. C., Clifton, D. A., Lee, K. M., Gool, L. V., He, R., et al. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00681 · Cited by 1
Ro, J., Kim, N., & Yoon, Y. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00677 · Cited by 1
Game On: Towards Language Models as RL ExperimentersPreprint
Zhang, J., Lampe, T., Abdolmaleki, A., Springenberg, J. T., & Riedmiller, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.03402 · Cited by 1
Hoehing, N., Maniparambil, M., Rushe, E., O'Connor, N. E., & Ventresque, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.02175 · Cited by 1
Semantic Deception: When Reasoning Models Can't Compute an AdditionPreprint
de Leeuw, N., Nahon, M., Reymond, M., Chatila, R., & Khamassi, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.20812 · Cited by 1
MM-THEBench: Do Reasoning MLLMs Think Reasonably?Preprint
Huang, Z., Yao, Z., Qi, J., Tu, S., Ma, J., Liu, J., Liu, W., Che, X., Hou, L., & Li, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.22735 · Cited by 1
Akasaka, M., & Han, S. C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.21619 · Cited by 1
Sidhu, R., & Hockenmaier, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.17333 · Cited by 1
OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RLPreprint
Jie, H., Yaoyuan, Y., Wei, X., Wang, K., Yan, H., Heng, Z., & Chen, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.17706 · Cited by 1
Exploring Spatial Intelligence from a Generative PerspectivePreprint
Zhu, M., Jiang, S., Zheng, H., Luo, Z., Zhong, H., Li, A., Wang, K., Rong, J., Liu, Y., Chen, H., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.20570 · Cited by 1
Metadata
- Authors
- Chen, B., Xu, Z., Kirmani, S., Ichter, B., Driess, D., Florence, P., Sadigh, D., Guibas, L., & Xia, F.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- Pages
- 14455-14465
- ISSN
- 1063-6919 (ISSN-L)
- arXiv
- 2401.12168
- OpenAlex
- W4402716288
- Cited by
- 269
- References
- 69
- Citations by year
- 2026: 122 · 2025: 127 · 2024: 20
- FWCI
- 55.53
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- vision-language models, spatial reasoning, 3D spatial reasoning, visual question answering, qualitative spatial reasoning, automatic data generation, metric spaces, chain-of-thought reasoning, robotics, distance estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
