Prioritized Semantic Learning for Zero-Shot Instance Navigation
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While they streamline the decision-making process, they must simultaneously learn spatial memory tracking and action planning, necessitating extensive trajectory data or expert demonstrations for effective training.”
From Brain-inspired spatial intelligence for embodied agents (2026) · cites this paper as [50]
In the citing paper
“Despite their strong performance in simulated environments, these methods are highly susceptible to data distribution shifts between training and testing environments, severely impairing their generalization to real-world physical deployments.”
From Brain-inspired spatial intelligence for embodied agents (2026) · cites this paper as [50]
In the citing paper
“DAgRL 49 and PSL 50 integrate pre-trained vision-language encoders with historical action embeddings or contrastive learning to align visual observations with textual goals.”
From Brain-inspired spatial intelligence for embodied agents (2026) · cites this paper as [50]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
Jia, C., Yang, Y., Xia, Y., Chen, Y.-T., Parekh, Z., Pham, H., Le, Q. V., Sung, Y., Li, Z., & Duerig, T. (2021) · arXiv · doi:10.48550/arxiv.2102.05918 · Cited by 1,977
Matterport3D: Learning from RGB-D Data in Indoor Environments
Chang, A., Dai, A., Funkhouser, T., Halber, M., Niebner, M., Savva, M., Song, S., Zeng, A., & Zhang, Y. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00081 · Cited by 1,858
Improved Baselines with Visual Instruction Tuning
Liu, H., Li, C., Li, Y., & Lee, Y. J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02484 · Cited by 1,748
Improved Baselines with Visual Instruction Tuning
Liu, H., Li, C., Li, Y., & Lee, Y. J. (2023) · arXiv · doi:10.48550/arxiv.2310.03744 · Cited by 1,733
Target-driven visual navigation in indoor scenes using deep reinforcement learning
Zhu, Y., Mottaghi, R., Kolve, E., Lim, J. J., Gupta, A., Fei-Fei, L., & Farhadi, A. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989381 · Cited by 1,533
Habitat: A Platform for Embodied AI Research
Savva, M., Kadian, A., Maksymets, O., Zhao, Y., Wijmans, E., Jain, B., Straub, J., Liu, J., Koltun, V., Malik, J., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00943 · Cited by 1,237
VisualBERT: A Simple and Performant Baseline for Vision and Language
Li, L. H., Yatskar, M., Yin, D., Hsieh, C.-J., & Chang, K.-W. (2019) · arXiv · doi:10.48550/arxiv.1908.03557 · Cited by 1,198
Anderson, P., Wu, Q., Teney, D., Bruce, J., Johnson, M., Sunderhauf, N., Reid, I., Gould, S., & van den Hengel, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00387 · Cited by 1,187
Research works printed but not linked: 29
- Chen, P., et al.: $$A^2$$ NAV: action-aware zero-shot robot navigation by exploiting vision-and-language ability of foundation models. arXiv preprint arXiv:2308.07997 (2023) · arXiv
- Gadre, S.Y., Wortsman, M., Ilharco, G., Schmidt, L., Song, S.: CLIP on wheels: zero-shot object navigation as object localization and exploration. CoRR abs/2203.10421 (2022) · arXiv
- Gan, C., et al.: Threedworld: a platform for interactive multi-modal physical simulation. arXiv preprint arXiv:2007.04954 (2020) · arXiv
- Gao, P., et al.: Llama-adapter v2: parameter-efficient visual instruction model. arXiv preprint arXiv:2304.15010 (2023) · arXiv
- Kim, N., Kwon, O., Yoo, H., Choi, Y., Park, J., Oh, S.: Topological semantic graph memory for image-goal navigation. In: Conference on Robot Learning, pp. 393–402. PMLR (2023)
- Krantz, J., Lee, S., Malik, J., Batra, D., Chaplot, D.S.: Instance-specific image goal navigation: training embodied agents to find object instances. arXiv preprint arXiv:2211.15876 (2022) · arXiv
- Li, C., et al.: iGibson 2.0: object-centric simulation for robot learning of everyday household tasks. In: Conference on Robot Learning, vol. 164, pp. 455–465 (2021). arXiv preprint arXiv:2108.03272 (2021) · arXiv
- Li, C., et al.: BEHAVIOR-1K: a benchmark for embodied AI with 1, 000 everyday activities and realistic simulation. In: Conference on Robot Learning, vol. 205, pp. 80–93 (2022)
- Li, C., et al.: Behavior-1k: a benchmark for embodied ai with 1,000 everyday activities and realistic simulation. In: Conference on Robot Learning, pp. 80–93. PMLR (2023)
- Li, J., Selvaraju, R., Gotmare, A., Joty, S., Xiong, C., Hoi, S.C.H.: Align before fuse: vision and language representation learning with momentum distillation. In: Proceedings of the International Conference on Neural Information Processing Systems, vol. 34, pp. 9694–9705 (2021)
- Li, W., Zhu, L., Wen, L., Yang, Y.: Decap: decoding clip latents for zero-shot captioning via text-only training. arXiv preprint arXiv:2303.03032 (2023) · arXiv
- Liang, V.W., Zhang, Y., Kwon, Y., Yeung, S., Zou, J.Y.: Mind the gap: understanding the modality gap in multi-modal contrastive representation learning. In: Proceedings of the International Conference on Neural Information Processing Systems, vol. 35, pp. 17612–17625 (2022)
- Liu, H., Li, C., Wu, Q., Lee, Y.J.: Visual instruction tuning. arXiv preprint arXiv:2304.08485 (2023) · arXiv
- Ma, S., et al.: A simple knowledge distillation framework for open-world object detection. arXiv preprint arXiv:2312.08653 (2023) · arXiv
- Majumdar, A., Aggarwal, G., Devnani, B., Hoffman, J., Batra, D.: ZSON: zero-shot object-goal navigation using multimodal goal embeddings. In: Proceedings of the International Conference on Neural Information Processing Systems (2022)
- Majumdar, A., Xia, F., Batra, D., Guibas, L., et al.: Findthis: language-driven object disambiguation in indoor environments. In: Conference on Robot Learning (2023)
- OpenAI: GPT-4 technical report. CoRR abs/2303.08774 (2023) · arXiv
- Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017) · arXiv
- Srivastava, S., et al.: Behavior: benchmark for everyday household activities in virtual, interactive, and ecological environments. In: Conference on Robot Learning, pp. 477–490. PMLR (2022)
- Szot, A., et al.: Habitat 2.0: training home assistants to rearrange their habitat. In: Proceedings of the International Conference on Neural Information Processing Systems (2021)
- Thomason, J., Murray, M., Cakmak, M., Zettlemoyer, L.: Vision-and-dialog navigation. In: Conference on Robot Learning, pp. 394–406. PMLR (2020)
- Udandarao, V., Burg, M.F., Albanie, S., Bethge, M.: Visual data-type understanding does not emerge from scaling vision-language models. In: Proceedings of the International Conference on Learning Representations (2023)
- Wijmans, E., et al.: DD-PPO: learning near-perfect pointgoal navigators from 2.5 billion frames. In: Proceedings of the International Conference on Learning Representations (2020)
- Wu, Y., Wu, Y., Gkioxari, G., Tian, Y.: Building generalizable agents with a realistic and rich 3D environment. arXiv preprint arXiv:1801.02209 (2018) · arXiv
- Xinyu, S., Peihao, C., Jugang, F., Thomas, H.L., Jian, C., Mingkui, T.: FGPrompt: fine-grained goal prompting for image-goal navigation. In: Proceedings of the International Conference on Neural Information Processing Systems (2023)
- Yadav, K., et al.: OVRL-V2: a simple state-of-art baseline for imagenav and objectnav. arXiv preprint arXiv:2303.07798 (2023) · arXiv
- Yamauchi, B.: A frontier-based approach for autonomous exploration. In: Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation, CIRA 1997, pp. 146–151. IEEE (1997)
- Yenamandra, S., et al.: Homerobot: open-vocabulary mobile manipulation. arXiv preprint arXiv:2306.11565 (2023) · arXiv
- Zhang, R., et al.: Llama-adapter: efficient fine-tuning of language models with zero-init attention. arXiv preprint arXiv:2303.16199 (2023) · arXiv
Cited by
UniGoal: Towards Universal Zero-shot Goal-oriented Navigation
Yin, H. H., Xu, X., Zhao, L., Wang, Z., Zhou, J., & Lu, J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01775 · Cited by 130
WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation
Nie, D., Guo, X., Duan, Y., Zhang, R., & Chen, L. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246684 · Cited by 97
Taioli, F., Zorzi, E., Franchi, G., Castellini, A., Farinelli, A., Cristani, M., & Wang, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01745 · Cited by 25
REGNav: Room Expert Guided Image-Goal Navigation
Li, P., Wu, K., Fu, J., & Zhou, S. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i5.32514 · Cited by 21
ImagineNav++: Prompting Vision-Language Models as Embodied Navigator Through Scene Imagination
Wang, T., Zhao, X., Cai, W., & Sun, C. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3688692 · Cited by 13
Metadata
- Authors
- Sun, X., Liu, L., Zhi, H., Qiu, R., & Liang, J.
- Affiliations
- The Hong Kong University of Science and Technology (Guangzhou) (CN)
- Tencent (China) (CN)
- Hong Kong University of Science and Technology (HK)
- Corresponding author
- Liang, Junwei
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer Nature Switzerland
- Published
- 2024-11-28
- Pages
- 161-178
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W4404770192
- Cited by
- 12
- References
- 36
- Citations by year
- 2026: 5 · 2025: 7
- FWCI
- 3.46
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Lecture notes in computer science (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- vision-language models, semantic alignment, HM3D, object navigation, robot navigation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Prioritized Semantic Learning for Zero-Shot Instance Navigation. https://app.cochat.ai/papers/10.1007/978-3-031-73254-6_10
- The paper
- Sun, X., Liu, L., Zhi, H., Qiu, R., & Liang, J. (2025). Prioritized Semantic Learning for Zero-Shot Instance Navigation. Lecture Notes in Computer Science. https://doi.org/10.1007/978-3-031-73254-6_10
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.