The DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.
VLN↻BERT: A Recurrent Vision-and-Language BERT for Navigation
Abstract
Accuracy of many visiolinguistic tasks has benefited significantly from the application of vision-and-language (V&L) BERT. However, its application for the task of vision-and-language navigation (VLN) remains limited. One reason for this is the difficulty adapting the BERT architecture to the partially observable Markov decision process present in VLN, requiring history-dependent attention and decision making. In this paper we propose a recurrent BERT model that is time-aware for use in VLN. Specifically, we equip the BERT model with a recurrent function that maintains cross-modal state information for the agent. Through extensive experiments on R2R and REVERIE we demonstrate that our model can replace more complex encoder-decoder models to achieve state-of-the-art results. Moreover, our approach can be generalised to other transformer-based architectures, supports pre-training, and is capable of solving navigation and referring expression tasks simultaneously.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While VLMbench [290] is well-suited for evaluating visionlanguage models (VLMs) such as CLIP and GPT-4V, its task set is relatively small (only 8 tasks), potentially limiting its comprehensiveness in benchmarking generalizable policies.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [290]
In the citing paper
“Unlike VLMbench [290] and Gem-Bench [289], which primarily evaluate vision-language models (VLMs) in robotic control, VIMA [291] further integrates multi-modal task execution and precise instruction following, making it distinct in its benchmarking approach.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [290]
In the citing paper
“FSN passes on the messages through a small number of bottleneck latents, thus requiring the model to purify the most necessary information from each modality for crossmodal sharing.”
From Multimodal learning with transformers: A survey (2023) · cites this paper as [175]
In the citing paper
“This strategy uses the fusion bottleneck as a bridge, and not only improves fusion performance, but also reduces computational cost.”
From Multimodal learning with transformers: A survey (2023) · cites this paper as [175]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Layer NormalizationPreprint
Ba, J., Kiros, J., & Hinton, G. E. (2016) · arXiv.org · doi:10.48550/arxiv.1607.06450 · Cited by 13,762
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Research works printed but not linked: 2
- loshchilov, 2018, Decoupled weight de-cay regularization, International Conference on Learning Representations
- aliakbarian, 2018, Viena2: A driving anticipation dataset, Asian Conference on Computer Vision, 449
Cited by
Sorted by citations
Multimodal learning with transformers: A survey
Xu, P., Zhu, X., & Clifton, D. A. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3275156 · Cited by 1,072
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models
Song, C. H., Sadler, B. M., Wu, J., Chao, W.-L., Washington, C., & Su, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00280 · Cited by 435
“Recent work [11,16,21,23] employs BERT and its variants [7,20] to get better language understanding.”
MethodA Comprehensive Review of Recent Research Trends on Unmanned Aerial Vehicles (UAVs)
Telli, K., Kraa, O., Himeur, Y., Ouamane, A., Boumehraz, M., Atalla, S., & Mansoor, W. (2023) · Systems · doi:10.3390/systems11080400 · Cited by 390
Diffusion-based Generation, Optimization, and Planning in 3D Scenes
Huang, S., Wang, Z., Li, P., Jia, B., Liu, T., Zhu, Y., Liang, W., & Zhu, S.-C. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01607 · Cited by 192
Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation
Chen, S., Guhur, P.-L., Tapaswi, M., Schmid, C., & Laptev, I. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01604 · Cited by 228
Vision-Language Pre-Training: Basics, Recent Advances, and Future Trends
Gan, Z., Li, L., Li, C., Wang, L., Liu, Z., & Gao, J. (2022) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000105 · Cited by 155
Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions
Gu, J., Stefani, E., Wu, Q., Thomason, J., & Wang, X. E. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.524 · Cited by 169
Self-citationETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments
An, D., Wang, H., Wang, W., Wang, Z., Huang, Y., He, K., & Wang, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3386695 · Cited by 103
HOP: History-and-Order Aware Pretraining for Vision-and-Language Navigation
Qiao, Y., Qi, Y., Hong, Y., Yu, Z., Wang, P., & Wu, Q. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01498 · Cited by 82
Self-citationCross-modal Map Learning for Vision and Language Navigation
Georgakis, G., Schmeckpeper, K., Wanchoo, K., Dan, S., Miltsakaki, E., Roth, D., & Daniilidis, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01502 · Cited by 94
On Transforming Reinforcement Learning With Transformers: The Development Trajectory
Hu, S., Shen, L., Zhang, Y., Chen, Y., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3408271 · Cited by 96
GridMM: Grid Memory Map for Vision-and-Language Navigation
Wang, Z., Li, X., Yang, J., Liu, Y., & Jiang, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01432 · Cited by 93
VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View
Schumann, R., Zhu, W., Feng, W., Fu, T.-J., Riezler, S., & Wang, W. Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29858 · Cited by 91
EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual Grounding
Wu, Y., Cheng, X., Zhang, R., Cheng, Z., & Zhang, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01843 · Cited by 83
Bird’s-Eye-View Scene Graph for Vision-Language Navigation
Liu, R., Wang, X., Wang, W., & Yang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01007 · Cited by 80
Towards Learning a Generalist Model for Embodied Navigation
Zheng, D., Huang, S., Zhao, L., Zhong, Y., & Wang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01293 · Cited by 106
Discuss Before Moving: Visual Language Navigation via Multi-expert Discussions
Long, Y., Li, X., Cai, W., & Dong, H. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611565 · Cited by 115
Scaling Data Generation in Vision-and-Language Navigation
Wang, Z., Li, J., Hong, Y., Wang, Y., Wu, Q., Bansal, M., Gould, S., Tan, H., & Qiao, Y. (2023) · arXiv · doi:10.48550/arxiv.2307.15644 · Cited by 64
Self-citationNavgpt-2: Unleashing navigational reasoning capability for large vision-language models
Zhou, G., Hong, Y., Wang, Z., Wang, X. E., & Wu, Q. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72667-5_15 · Cited by 63
Self-citationVision-language navigation: a survey and taxonomy
Wu, W., Chang, T., Li, X., Yin, Q., & Hu, Y. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-09217-1 · Cited by 78
KERM: Knowledge Enhanced Reasoning for Vision-and-Language Navigation
Li, X., Wang, Z., Yang, J., Wang, Y., & Jiang, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00254 · Cited by 70
A survey of transformer-based multimodal pre-trained modals
Han, X., Wang, Y.-T., Feng, J.-L., Deng, C., Chen, Z.-H., Huang, Y.-A., Su, H., Hu, L., & Hu, P.-W. (2023) · Neurocomputing · doi:10.1016/j.neucom.2022.09.136 · Cited by 59
Scaling Data Generation in Vision-and-Language Navigation
Wang, Z., Li, J., Hong, Y., Wang, Y., Wu, Q., Bansal, M., Gould, S., Tan, H., & Qiao, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01103 · Cited by 64
“Compared to previous approaches of addressing data scarcity by augmenting agent’s observations [47, 74] or employing large visionlinguistic models pre-trained with image-text data from the web [27, 31, 54, 71, 72], utilizing additional traversable environments allows the agents to learn from in-domain visual-language…”
Self-citationWang, H., Liang, W. G., Shen, J., Gool, L. V., & Wang, W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01503 · Cited by 57
Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environments
Krantz, J., & Lee, S. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19842-7_34 · Cited by 56
NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoning
Lin, B., Nie, Y., Wei, Z., Chen, J., Ma, S., Han, J., Xu, H., Chang, X., & Liang, X. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3554559 · Cited by 111
Computer Vision Meets Educational Robotics
Sophokleous, A., Christodoulou, P., Doitsidis, L., & Chatzichristofis, S. A. (2021) · Electronics · doi:10.3390/electronics10060730 · Cited by 66
SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding
Jia, B., Chen, Y., Yu, H., Wang, Y., Niu, X., Liu, T., Li, Q., & Huang, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72673-6_16 · Cited by 89
Deng, H. F., Ou, Z., Zhang, G., Deng, Y., & Tian, M. (2021) · Sensors · doi:10.3390/s21113851 · Cited by 54
Prompt-Based Learning for Unpaired Image Captioning
Zhu, P., Wang, X., Zhu, L., Sun, Z., Zheng, W., Wang, Y., & Chen, C. W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3265842 · Cited by 57
ADAPT: Vision-Language Navigation with Modality-Aligned Action Prompts
Lin, B., Zhu, Y., Chen, Z., Liang, X., Liu, J., & Liang, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01496 · Cited by 59
Dreamwalker: Mental Planning for Continuous Vision-Language Navigation
Wang, H., Liang, W. G., Gool, L. V., & Wang, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00998 · Cited by 64
MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model
Ji, Y., Wang, J., Gong, Y., Zhang, L., Zhu, Y., Wang, H., Zhang, J., Sakai, T., & Yang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02228 · Cited by 59
Vision-and-Language Navigation via Causal Learning
Wang, L., He, Z., Dang, R., Shen, M., Liu, C., & Chen, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01248 · Cited by 68
Vision-and-Language Pretrained Models: A Survey
Long, S., Cao, F., Han, S. C., & Yang, H. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/773 · Cited by 66
Housekeep: Tidying Virtual Households Using Commonsense Reasoning
Kant, Y., Ramachandran, A., Yenamandra, S., Gilitschenski, I., Batra, D., Szot, A., & Agrawal, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19842-7_21 · Cited by 57
Adaptive Zone-aware Hierarchical Planner for Vision-Language Navigation
Gao, C., Peng, X., Yan, M., Wang, H., Yang, L., Ren, H., Li, H., & Liu, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01432 · Cited by 53
Learning Navigational Visual Representations with Semantic Map Supervision
Hong, Y., Zhou, Y., Zhang, R., Dernoncourt, F., Bui, T., Gould, S., & Tan, H. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00284 · Cited by 42
Self-citationVolumetric Environment Representation for Vision-Language Navigation
Liu, R., Wang, W., & Yang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01544 · Cited by 56
Multimodal fusion and vision–language models: A survey for robot vision
Han, X., Chen, S., Fu, Z., Feng, Z., Fan, L., An, D., Wang, C., Guo, L., Meng, W., Zhang, X., et al. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103652 · Cited by 105
Layout-based Causal Inference for Object Navigation
Zhang, S., Song, X., Li, W., Bai, Y., Yu, X., & Jiang, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01039 · Cited by 41
LANA: A Language-Capable Navigator for Instruction Following and Generation
Wang, X., Wang, W., Shao, J., & Yang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01826 · Cited by 49
Kamath, A., Anderson, P., Wang, S., Koh, J. Y., Ku, A., Waters, A., Yang, Y., Baldridge, J., & Parekh, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01041 · Cited by 39
Wang, L., He, Z., Dang, R., Chen, H., Liu, C., & Chen, Q. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3233554 · Cited by 38
March in Chat: Interactive Prompting for Remote Embodied Referring Expression
Qiao, Y., Qi, Y., Zheng, Y., Liu, J., & Wu, Q. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01444 · Cited by 47
Self-citationLearning from Unlabeled 3D Environments for Vision-and-Language Navigation
Chen, S., Guhur, P.-L., Tapaswi, M., Schmid, C., & Laptev, I. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19842-7_37 · Cited by 35
Embodied navigation with multi-modal information: A survey from tasks to methodology
Wu, Y., Zhang, P., Gu, M., Zheng, J., & Bai, X. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102532 · Cited by 34
Multimodal Transformer with Variable-Length Memory for Vision-and-Language Navigation
Lin, C., Jiang, Y., Cai, J., Qu, L., Haffari, G., & Yuan, Z. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20059-5_22 · Cited by 36
Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matching
Chu, M., Zheng, Z., Ji, W., Wang, T., & Chua, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73247-8_13 · Cited by 46
Several Categories of Large Language Models (LLMs): A Short Survey
Pahune, S. A., & Chandrasekharan, M. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.54677 · Cited by 54
Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework
Zu, W., Song, W., Chen, R., Guo, Z., Sun, F., Tian, Z., Pan, W., & Wang, J. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611462 · Cited by 31
Learning Vision-and-Language Navigation from YouTube Videos
Lin, K., Chen, P., Huang, D.-W., Li, T. H., Tan, M., & Gan, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00764 · Cited by 37
Yue, L., Zhou, D., Xie, L., Zhang, F., Yan, Y., & Yin, E. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3387171 · Cited by 27
Improving Vision-and-Language Navigation by Generating Future-View Image Semantics
Li, J., & Bansal, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01040 · Cited by 39
Room-Object Entity Prompting and Reasoning for Embodied Referring Expression
Gao, C., Liu, S., Chen, J., Wang, L., Wu, Q., Li, B. H., & Tian, Q. C. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3326851 · Cited by 30
Self-citationShen, K., & Kejriwal, M. (2023) · Expert Systems · doi:10.1111/exsy.13243 · Cited by 25
Memory-Adaptive Vision-and-Language Navigation
He, K., Jing, Y., Huang, Y., Lu, Z., An, D. U., & Wang, L. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110511 · Cited by 27
Visual-Language Navigation Pretraining via Prompt-based Environmental Self-exploration
Liang, X., Zhu, F., Lingling, L., Xu, H., & Liang, X. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.332 · Cited by 33
Classification of Arabic Poetry Emotions Using Deep Learning
Shahriar, S., Roken, N. A., & Zualkernan, I. A. (2023) · Computers · doi:10.3390/computers12050089 · Cited by 23
Probabilistic Prompt Learning for Dense Prediction
Kwon, H., Song, T., Jeong, S., Kim, J., Jang, J., & Sohn, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00654 · Cited by 26
Self-Supervised 3-D Semantic Representation Learning for Vision-and-Language Navigation
Tan, S., Sima, K., Wang, D., Ge, M., Guo, D., & Liu, H. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3395633 · Cited by 27
Hwang, M., Jeong, J., Kim, M., Oh, Y., & Oh, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00646 · Cited by 26
Huo, J., Sun, Q., Jiang, B., Lin, H., & Fu, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02223 · Cited by 30
Correctable Landmark Discovery via Large Models for Vision-Language Navigation
Lin, B., Nie, Y., Wei, Z., Zhu, Y., Xu, H., Ma, S., Liu, J., & Liang, X. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3407759 · Cited by 29
Tem-adapter: Adapting Image-Text Pretraining for Video Question Answer
Chen, G., Liu, X., Wang, G., Zhang, K., Torr, P. H. S., Zhang, X.-P. S., & Tang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01282 · Cited by 28
Augmented Commonsense Knowledge for Remote Object Grounding
Mohammadi, B., Hong, Y., Qi, Y., Wu, Q., Pan, S., & Shi, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28223 · Cited by 24
Self-citationA Dual Semantic-Aware Recurrent Global-Adaptive Network for Vision-and-Language Navigation
Wang, L., He, Z., Tang, J., Dang, R., Wang, N., Liu, C., & Chen, Q. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/164 · Cited by 32
VLN-PETL: Parameter-Efficient Transfer Learning for Vision-and-Language Navigation
Qiao, Y., Zheng, Y. H., & Wu, Q. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01416 · Cited by 27
Self-citationSpectral Prompt Tuning: Unveiling Unseen Classes for Zero-Shot Semantic Segmentation
Xu, W., Xu, R., Wang, C., Xu, S., Guo, L., Zhang, M., & Zhang, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28456 · Cited by 20
Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigation
Cui, Y., Xie, L., Zhang, Y., Zhang, M., Yan, Y., & Yin, E. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01106 · Cited by 28
UAV Swarm Objectives: A Critical Analysis and Comprehensive Review
Kumar, P. A., Manoj, N., Sudheer, N., Bhat, P. P., Arya, A., & Sharma, R. (2024) · SN Computer Science · doi:10.1007/s42979-024-03156-x · Cited by 18
Boosting Efficient Reinforcement Learning for Vision-and-Language Navigation With Open-Sourced LLM
Wang, J., Wang, T., Cai, W., Xu, L., & Sun, C. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3511402 · Cited by 22
Echo-Enhanced Embodied Visual Navigation
Yu, Y., Cao, L., Sun, F., Yang, C., Lai, H., & Huang, W. (2023) · Neural Computation · doi:10.1162/neco_a_01579 · Cited by 18
Vision-and-Language Navigation via Latent Semantic Alignment Learning
Wu, S., Fu, X., Wu, F. H., & Zha, Z.-J. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3358112 · Cited by 19
Enhancing Vision and Language Navigation With Prompt-Based Scene Knowledge
Zhan, Z., Qin, J., Zhuo, W., & Tan, G. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3401451 · Cited by 17
Hu, Y., Zhou, Y., Zhu, Z., Yang, X., Zhang, H., Bian, K., & Han, H. W. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114190 · Cited by 20
Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments
Chen, K., An, D. U., Huang, Y., Xu, R., Su, Y., Ling, Y., Reid, I. D., & Wang, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3594204 · Cited by 41
Cross-Modality Pyramid Alignment for Visual Intention Understanding
Ye, M., Shi, Q., Su, K., & Du, B. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3261743 · Cited by 19
ESceme: Vision-and-Language Navigation with Episodic Scene Memory
Zheng, Q., Liu, D., Wang, C., Zhang, J., Wang, D., & Tao, D. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02159-8 · Cited by 23
PASTS: Progress-aware spatio-temporal transformer speaker for vision-and-language navigation
Wang, L., Liu, C., He, Z., Li, S., Yan, Q., Chen, H., & Chen, Q. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107487 · Cited by 22
Deep Learning for Embodied Vision Navigation: A SurveyPreprint
Zhu, F., Zhu, Y., Lee, V. C., Liang, X., & Chang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04097 · Cited by 30
Watson, E. ‘., Viana, T., & Zhang, S. (2023) · AI · doi:10.3390/ai4010007 · Cited by 18
VLN-Trans: Translator for the Vision and Language Navigation Agent
Zhang, Y., & Kordjamshidi, P. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.737 · Cited by 23
WebVLN: Vision-and-Language Navigation on Websites
Chen, Q., Pitawela, D., Zhao, C. K., Zhou, G., Chen, H., & Wu, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i2.27878 · Cited by 20
Self-citationQuestion-conditioned debiasing with focal visual context fusion for visual question answering
Liu, J., Wang, G., Fan, C., Zhou, F., & Xu, H. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110879 · Cited by 13
Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigation
Chen, J., Wang, W., Liu, S., Li, H., & Yang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01009 · Cited by 16
Aggregating Global and Local Representations via Hybrid Transformer for Video Deraining
Mao, D., Gao, S., Li, Z., Dai, H., Zhang, Y., & Zhou, Y. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3372944 · Cited by 13
DAP: Domain-Aware Prompt Learning for Vision-and-Language Navigation
Liu, T., Hu, Y., Wu, W., Wang, Y.-K., Xu, K., & Yin, Q. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446504 · Cited by 14
Wang, S., Zhou, D., Xie, L., Xu, C., Yan, Y., & Yin, E. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107320 · Cited by 11
To Boost Zero-Shot Generalization for Embodied Reasoning With Vision-Language Pre-Training
Su, K., Zhang, X., Zhang, S., Zhu, J., & Zhang, B. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3459800 · Cited by 12
Video Dialog as Conversation About Objects Living in Space-Time
Pham, H.-A., Le, T. M., Le, V., Phuong, T. M., & Tran, T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19842-7_41 · Cited by 11
MLNet: a multi-level multimodal named entity recognition architecture
Zhai, H., Lv, X., Hou, Z., Tong, X., & Bu, F. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2023.1181143 · Cited by 10
Enhancing Scene Understanding for Vision-and-Language Navigation by Knowledge Awareness
Gao, F., Tang, J., Wang, J., Li, S., & Yu, J. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3483042 · Cited by 11
Adaptive Cross-Modal Experts Network with Uncertainty-Driven Fusion for Vision–Language Navigation
Wu, J., Wu, C., Shen, X., & Wang, L. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112735 · Cited by 14
Source-Free Elastic Model Adaptation for Vision-and-Language Navigation
Tan, M., Chen, P., Zhi, H., Mai, J., Rosman, B., Ji, D., & Zeng, R. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3535356 · Cited by 11
A Dehazing Method for UAV Remote Sensing Based on Global and Local Feature Collaboration
Li, C., Zhou, S., Wu, T., Shi, J., & Guo, F. (2025) · Remote Sensing · doi:10.3390/rs17101688 · Cited by 10
Learning Disentanglement with Decoupled Labels for Vision-Language Navigation
Cheng, W., Dong, X., Khan, S. H., & Shen, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20059-5_18 · Cited by 11
Tina: Think, Interaction, and Action Framework for Zero-Shot Vision Language Navigation
Li, D., Chen, W., & Lin, X. A. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687470 · Cited by 14
Wen, S., Gong, S., Zhang, Z., Yu, F. R., & Wang, Z. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112610 · Cited by 10
Enhancing Large Language Models with RAG for Visual Language Navigation in Continuous Environments
Bao, X., Lv, Z., & Wu, B. (2025) · Electronics · doi:10.3390/electronics14050909 · Cited by 10
Metadata
- Authors
- Hong, Y., Wu, Q., Qi, Y., Rodriguez-Opazo, C., & Gould, S.
- Affiliations
- Australian National University (AU)
- Australian Centre for Robotic Vision (AU)
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 1643-1653
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3172675210
- Cited by
- 264
- References
- 69
- Citations by year
- 2026: 46 · 2025: 60 · 2024: 63 · 2023: 62 · 2022: 27 · 2021: 6
- FWCI
- 12.92
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- vision-and-language navigation, partially observable Markov decision processes, pre-training, transformer models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
