Envedit: Environment Editing for Vision-and-Language Navigation
Open accessAbstract
In Vision-and-Language Navigation (VLN), an agent needs to navigate through the environment based on nat-ural language instructions. Due to limited available data for agent training and finite diversity in navigation environments, it is challenging for the agent to generalize to new, unseen environments. To address this problem, we propose Envedit, a data augmentation method that cre-ates new environments by editing existing environments, which are used to train a more generalizable agent. Our augmented environments can differ from the seen environ-ments in three diverse aspects: style, object appearance, and object classes. Training on these edit-augmented environments prevents the agent from overfitting to existing en-vironments and helps generalize better to new, unseen en-vironments. Empirically, on both the Room-to-Room and the multi-lingual Room-Across-Room datasets, we show that our proposed Envedit method gets significant im-provements in all metrics on both pre-trained and non-pre-trained VLN agents, and achieves the new state-of-the-art on the test leaderboard. We further ensemble the VLN agents augmented on different edited environments and show that these edit methods are complementary.11Code and data are available at https://github.com/jialuli-luka/EnvEdit.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
KitchenShift is useful for benchmarking imitation learning and reinforcement learning but does not support real-world reproducibility; its domain shift testing provides insight into real-world uncertainty modeling.
“KitchenShift [292] is particularly useful for benchmarking imitation learning (IL) and reinforcement learn-ing (RL) strategies, but like RLBench [288], it does not support real-world reproducibility, though its domain shift testing provides insight into real-world uncertainty modeling.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [292]
Isaac Sim provides high-fidelity physics, is ideal for reinforcement learning, imitation learning, and robotic vision, and is used in KitchenShift and GenSim2.
“It provides high-fidelity physics simulation, making it ideal for reinforcement learning (RL), imitation learning (IL), and robotic vision tasks, and is widely used in KitchenShift [292] and GenSim2 [295] benchmarks.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [292]
KitchenShift focuses on robot generalization under environmental domain shifts in a simulated kitchen, introducing shifts in object materials, lighting, and camera angles to evaluate policy robustness.
“In contrast, KitchenShift [292] focuses on robot generalization under environmental domain shifts, simulating a kitchen environment where the robot interacts with various objects, such as opening an oven, moving utensils, and mixing liquids.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [292]
Applying CLIP ViT-H/14 and EnvEdit to our approach leads to 80% SR.
“we also experiment with applying a more powerful visual encoder, CLIP ViT-H/14 [64], and the image augmentation method EnvEdit [47] to our approach, leading to a remarkable 80% SR”
From Scaling Data Generation in Vision-and-Language Navigation (2023) · cites this paper as [47]
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,119 · see citing works
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · see citing works
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., & Catanzaro, B. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00917 · Cited by 4,514 · see citing works
Semantic Image Synthesis With Spatially-Adaptive Normalization
Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974 · see citing works
The Effectiveness of Data Augmentation in Image Classification using Deep Learning
Perez, L., & Wang, J. (2017) · arXiv · doi:10.48550/arxiv.1712.04621 · Cited by 2,499 · see citing works
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
Lu, J., Batra, D., Parikh, D., & Lee, S. (2019) · arXiv · doi:10.48550/arxiv.1908.02265 · Cited by 2,109 · see citing works
Matterport3D: Learning from RGB-D Data in Indoor Environments
Chang, A., Dai, A., Funkhouser, T., Halber, M., Niebner, M., Savva, M., Song, S., Zeng, A., & Zhang, Y. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00081 · Cited by 1,858 · see citing works
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Li, X., Yin, X. P., Li, C., Zhang, P., Hu, X., Zhang, L., Wang, L., Hu, H., Li, D., Wei, F., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58577-8_8 · Cited by 1,736 · see citing works
Geirhos, R., Rubisch, P., Michaelis, C., Bethge, M., Wichmann, F. A., & Brendel, W. (2018) · arXiv · doi:10.48550/arxiv.1811.12231 · Cited by 1,490 · see citing works
Anderson, P., Wu, Q., Teney, D., Bruce, J., Johnson, M., Sunderhauf, N., Reid, I., Gould, S., & van den Hengel, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00387 · Cited by 1,187 · see citing works
A Learned Representation For Artistic StylePreprint
Dumoulin, V., Shlens, J., & Kudlur, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.07629 · Cited by 1,033 · see citing works
Shin, H.-C., Tenenholtz, N., Rogers, J. K., Schwarz, C. G., Senjem, M. L., Gunter, J. L., Andriole, K. P., & Michalski, M. H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00536-8_1 · Cited by 695 · see citing works
On evaluation of embodied navigation agents
(2018) · doi:10.48550/arxiv.1807.06757 · Cited by 622 · see citing works
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
Shridhar, M., Thomason, J., Gordon, D., Bisk, Y., Han, W., Mottaghi, R., Zettlemoyer, L., & Fox, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01075 · Cited by 540 · see citing works
SDEdit: Guided Image Synthesis and Editing with Stochastic Differential EquationsPreprint
Meng, C., He, Y., Song, Y., Song, J., Wu, J., Zhu, J.-Y., & Ermon, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01073 · Cited by 528 · see citing works
Wang, X., Huang, Q., Celikyilmaz, A., Gao, J., Shen, D., Wang, Y.-F., Wang, W. Y., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00679 · Cited by 522 · see citing works
TOUCHDOWN: Natural Language Navigation and Spatial Reasoning in Visual Street Environments
Chen, H., Suhr, A., Misra, D. K., Snavely, N., & Artzi, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01282 · Cited by 348 · see citing works
GAN Augmentation: Augmenting Training Data using Generative Adversarial NetworksPreprint
Bowles, C. T., Chen, L., Guerrero, R., Bentley, P., Gunn, R. N., Hammers, A., Dickie, D. A., Hernández, M. D. C. V., Wardlaw, J. M., & Rueckert, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.10863 · Cited by 347 · see citing works
Data Augmentation by Pairing Samples for Images ClassificationPreprint
Inoue, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.02929 · Cited by 330 · see citing works
Exploring the structure of a real-time, arbitrary neural artistic stylization network
Ghiasi, G., Lee, H., Kudlur, M., Dumoulin, V., & Shlens, J. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.114 · Cited by 306 · see citing works
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout
Tan, H., Yu, L., & Bansal, M. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1268 · Cited by 293 · see citing works
Self-citationSpeaker-Follower Models for Vision-and-Language Navigation
Fried, D., Hu, R., Cirik, V., Rohrbach, A., Andreas, J., Morency, L.-P., Berg-Kirkpatrick, T., Saenko, K., Klein, D., & Darrell, T. (2018) · arXiv · doi:10.48550/arxiv.1806.02724 · Cited by 291 · see citing works
ManiGAN: Text-Guided Image Manipulation
Li, B., Qi, X., Lukasiewicz, T., & Torr, P. H. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00790 · Cited by 287 · see citing works
Semantic Image Synthesis via Adversarial Learning
Dong, H., Yu, S., Wu, C., & Guo, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.608 · Cited by 276 · see citing works
Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Grounding
Ku, A., Anderson, P., Patel, R., Ie, E., & Baldridge, J. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.356 · Cited by 274 · see citing works
How Much Can CLIP Benefit Vision-and-Language Tasks?Preprint
Shen, S., Li, L. H., Tan, H. X., Bansal, M., Rohrbach, A., Chang, K.-W., Yao, Z., & Keutzer, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06383 · Cited by 272 · see citing works
Self-citationVision-language navigation with self-supervised auxiliary reasoning tasks
Zhu, F., Zhu, Y., Chang, X., & Liang, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01003 · Cited by 223 · see citing works
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web
Majumdar, A., Shrivastava, A., Lee, S., Anderson, P., Parikh, D., & Batra, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58539-6_16 · Cited by 201 · see citing works
Self-Monitoring Navigation Agent via Auxiliary Progress Estimation
Ma, C.-Y., Lu, J., Wu, Z., AlRegib, G., Kira, Z., Socher, R., & Xiong, C. (2019) · arXiv · doi:10.48550/arxiv.1901.03035 · Cited by 200 · see citing works
Emotion Classification with Data Augmentation Using Generative Adversarial Networks
Zhu, X., Liu, Y., Li, J., Wan, T., & Qin, Z. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93040-4_28 · Cited by 197 · see citing works
Self-citationThomason, J., Murray, M., Cakmak, M., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1907.04957 · Cited by 173 · see citing works
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation
Jain, V., Magalhaes, G., Ku, A., Vaswani, A., Ie, E., & Baldridge, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1181 · Cited by 165 · see citing works
Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural LanguagePreprint
Nam, S., Kim, Y., & Kim, S. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11919 · Cited by 164 · see citing works
Forward Noise Adjustment Scheme for Data Augmentation
Moreno-Barea, F. J., Strazzera, F., Jerez, J. M., Urda, D., & Franco, L. (2018) · 2018 IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2018.8628917 · Cited by 158 · see citing works
Style Augmentation: Data Augmentation via Style Randomization
Jackson, P. T., Atapour–Abarghouei, A., Bonner, S., Breckon, T. P., & Obara, B. (2018) · Durham Research Online (Durham University) · doi:10.48550/arxiv.1809.05375 · Cited by 149 · see citing works
Mapping Instructions to Actions in 3D Environments with Visual Goal Prediction
Misra, D. K., Bennett, A., Blukis, V., Niklasson, E., Shatkhin, M., & Artzi, Y. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1287 · Cited by 147 · see citing works
Language-Based Image Editing with Recurrent Attentive Models
Chen, J., Shen, Y., Gao, J., Liu, J., & Liu, X. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00909 · Cited by 144 · see citing works
Airbert: In-domain Pretraining for Vision-and-Language Navigation
Guhur, P.-L., Tapaswi, M., Chen, S., Laptev, I., & Schmid, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00166 · Cited by 139 · see citing works
SOON: Scenario Oriented Object Navigation with Graph-based Exploration
Zhu, F., Liang, X., Zhu, Y., Yu, Q., Chang, X., & Liang, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01250 · Cited by 136 · see citing works
History Aware Multimodal Transformer for Vision-and-Language NavigationPreprint
Chen, S., Guhur, P.-L., Schmid, C., & Laptev, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13309 · Cited by 124 · see citing works
Nguyen, K., & Daumé III, H. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1063 · Cited by 115 · see citing works
Language and Visual Entity Relationship Graph for Agent NavigationPreprint
Hong, Y., Rodríguez-Opazo, C., Qi, Y., Wu, Q., & Gould, S. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.09304 · Cited by 97 · see citing works
Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instruction
El-Nouby, A., Sharma, S., Schulz, H., Hjelm, D., Asri, L. E., Kahou, S. E., Bengio, Y., & Taylor, G. W. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01040 · Cited by 93 · see citing works
Transferable Representation Learning in Vision-and-Language Navigation
Huang, H., Jain, V., Mehta, H., Ku, A., Magalhaes, G., Baldridge, J., & Ie, E. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00750 · Cited by 82 · see citing works
Vision-Language Navigation with Random Environmental Mixup
Liu, C., Zhu, F., Chang, X., Liang, X., Ge, Z., & Shen, Y.-D. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00167 · Cited by 80 · see citing works
Sequential Attention GAN for Interactive Image Editing
Cheng, Y., Gan, Z., Li, Y., Liu, J., & Gao, J. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413551 · Cited by 78 · see citing works
Pathdreamer: A World Model for Indoor Navigation
Koh, J. Y., Lee, H., Yang, Y., Baldridge, J., & Anderson, P. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01447 · Cited by 64 · see citing works
Liu, Y., Nadai, M. D., Cai, D., Li, H., Alameda-Pineda, X., Sebe, N., & Lepri, B. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413505 · Cited by 62 · see citing works
BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps
Zhu, W., Hu, H., Chen, J., Deng, Z., Jain, V., Ie, E., & Sha, F. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.229 · Cited by 60 · see citing works
General Evaluation for Instruction Conditioned Navigation using Dynamic Time WarpingPreprint
Ilharco, G., Jain, V., Ku, A., Ie, E., & Baldridge, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.05446 · Cited by 56 · see citing works
Environment-Agnostic Multitask Learning for Natural Language Grounded Navigation
Wang, X. E., Jain, V., Ie, E., Wang, W. Y., Kozareva, Z., & Ravi, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58586-0_25 · Cited by 54 · see citing works
Diagnosing the Environment Bias in Vision-and-Language Navigation
Zhang, Y., Tan, H., & Bansal, M. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/124 · Cited by 51 · see citing works
Self-citationSTaDA: Style Transfer as Data Augmentation
Zheng, X., Chalasani, T., Ghosal, K., Lutz, S., & Smolic, A. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007353401070114 · Cited by 47 · see citing works
On the Evaluation of Vision-and-Language Navigation Instructions
Zhao, M., Anderson, P., Jain, V., Wang, S., Ku, A., Baldridge, J., & Ie, E. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.111 · Cited by 45 · see citing works
A Recurrent Vision-and-Language BERT for NavigationPreprint
Hong, Y., Wu, Q., Qi, Y., Rodríguez-Opazo, C., & Gould, S. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.13922 · Cited by 38 · see citing works
Multimodal attention networks for low-level vision-and-language navigation
Landi, F., Baraldi, L., Cornia, M., Corsini, M., & Cucchiara, R. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103255 · Cited by 37 · see citing works
Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation
Zhu, W., Wang, X. E., Fu, T.-J., Yan, A., Narayana, P., Sone, K., Basu, S., & Wang, W. Y. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.103 · Cited by 32 · see citing works
SOAT: A Scene- and Object-Aware Transformer for Vision-and-Language NavigationPreprint
Moudgil, A., Majumdar, A., Agrawal, H., Lee, S., & Batra, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14143 · Cited by 30 · see citing works
Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Information
Li, J., Tan, H. X., & Bansal, M. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.82 · Cited by 26 · see citing works
Self-citationSTaDA: Style Transfer as Data Augmentation
Xu, Z., Chalasani, T., Ghosal, K., Lutz, S., & Smolić, A. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007353400002108 · Cited by 25 · see citing works
Grounding Language to Landmarks in Arbitrary Outdoor Environments
Berg, M., Bayazit, D., Mathew, R., Rotter-Aboyoun, A., Pavlick, E., & Tellex, S. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197068 · Cited by 16 · see citing works
NDH-Full: Learning and Evaluating Navigational Agents on Full-Length Dialogue
Kim, H., Li, J., & Bansal, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.518 · Cited by 12 · see citing works
Self-citationInteractive Image Manipulation with Natural Language Instruction CommandsPreprint
Shinagawa, S., Yoshino, K., Sakti, S., Suzuki, Y., & Nakamura, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08645 · Cited by 9 · see citing works
Learning to Follow Directions in Street View
Hermann, K. M., Malinowski, M., Mirowski, P., Banki-Horvath, A., Anderson, K., & Hadsell, R. T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6849 · Cited by 6 · see citing works
Flagged first, then by citations
4 of the 72 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models
Zhou, G., Hong, Y., & Wu, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28597 · Cited by 327 · see citing works
Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions
Gu, J., Stefani, E., Wu, Q., Thomason, J., & Wang, X. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2022.acl-long.524 · Cited by 216 · see citing works
ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments
An, D., Wang, H., Wang, W., Wang, Z., Huang, Y., He, K., & Wang, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3386695 · Cited by 103 · see citing works
GridMM: Grid Memory Map for Vision-and-Language Navigation
Wang, Z., Li, X., Yang, J., Liu, Y., & Jiang, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01432 · Cited by 93 · see citing works
VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View
Schumann, R., Zhu, W., Feng, W., Fu, T.-J., Riezler, S., & Wang, W. Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29858 · Cited by 78 · see citing works
Bird’s-Eye-View Scene Graph for Vision-Language Navigation
Liu, R., Wang, X., Wang, W., & Yang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01007 · Cited by 69 · see citing works
Discuss Before Moving: Visual Language Navigation via Multi-expert Discussions
Long, Y., Li, X., Cai, W., & Dong, H. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611565 · Cited by 73 · see citing works
Scaling Data Generation in Vision-and-Language Navigation
Wang, Z., Li, J., Hong, Y., Wang, Y., Wu, Q., Bansal, M., Gould, S., Tan, H., & Qiao, Y. (2023) · arXiv · doi:10.48550/arxiv.2307.15644 · Cited by 64 · see citing works
Self-citationNavgpt-2: Unleashing navigational reasoning capability for large vision-language models
Zhou, G., Hong, Y., Wang, Z., Wang, X. E., & Wu, Q. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72667-5_15 · Cited by 63 · see citing works
Scaling Data Generation in Vision-and-Language Navigation
Wang, Z., Li, J., Hong, Y., Wang, Y., Wu, Q., Bansal, M., Gould, S., Tan, H., & Qiao, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01103 · Cited by 64 · see citing works
“Compared to previous approaches of addressing data scarcity by augmenting agent’s observations [47, 74] or employing large visionlinguistic models pre-trained with image-text data from the web [27, 31, 54, 71, 72], utilizing additional traversable environments allows the agents to learn from in-domain visual-language…”
MethodSelf-citationVision-and-Language Navigation via Causal Learning
Wang, L., He, Z., Dang, R., Shen, M., Liu, C., & Chen, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01248 · Cited by 67 · see citing works
Adaptive Zone-aware Hierarchical Planner for Vision-Language Navigation
Gao, C., Peng, X., Yan, M., Wang, H., Yang, L., Ren, H., Li, H., & Liu, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01432 · Cited by 43 · see citing works
Learning Navigational Visual Representations with Semantic Map Supervision
Hong, Y., Zhou, Y., Zhang, R., Dernoncourt, F., Bui, T., Gould, S., & Tan, H. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00284 · Cited by 42 · see citing works
Self-citationVolumetric Environment Representation for Vision-Language Navigation
Liu, R., Wang, W., & Yang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01544 · Cited by 55 · see citing works
Multimodal fusion and vision–language models: A survey for robot vision
Han, X., Chen, S., Fu, Z., Feng, Z., Fan, L., An, D., Wang, C., Guo, L., Meng, W., Zhang, X., et al. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103652 · Cited by 41 · see citing works
“(2) Modality-Specific Encoders, which designs special encoders for different modalities, using Transformer for text, CNN for image, RNN for audio, etc., and then performs feature alignment through Cross-modal Attention [325, 326].”
Kamath, A., Anderson, P., Wang, S., Koh, J. Y., Ku, A., Waters, A., Yang, Y., Baldridge, J., & Parekh, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01041 · Cited by 39 · see citing works
Wang, L., He, Z., Dang, R., Chen, H., Liu, C., & Chen, Q. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3233554 · Cited by 36 · see citing works
Learning from Unlabeled 3D Environments for Vision-and-Language Navigation
Chen, S., Guhur, P.-L., Tapaswi, M., Schmid, C., & Laptev, I. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19842-7_37 · Cited by 35 · see citing works
Embodied navigation with multi-modal information: A survey from tasks to methodology
Wu, Y., Zhang, P., Gu, M., Zheng, J., & Bai, X. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102532 · Cited by 34 · see citing works
Learning Vision-and-Language Navigation from YouTube Videos
Lin, K., Chen, P., Huang, D.-W., Li, T. H., Tan, M., & Gan, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00764 · Cited by 30 · see citing works
Improving Vision-and-Language Navigation by Generating Future-View Image Semantics
Li, J., & Bansal, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01040 · Cited by 28 · see citing works
Self-citationMemory-Adaptive Vision-and-Language Navigation
He, K., Jing, Y., Huang, Y., Lu, Z., An, D. U., & Wang, L. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110511 · Cited by 26 · see citing works
Self-Supervised 3-D Semantic Representation Learning for Vision-and-Language Navigation
Tan, S., Sima, K., Wang, D., Ge, M., Guo, D., & Liu, H. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3395633 · Cited by 24 · see citing works
A Dual Semantic-Aware Recurrent Global-Adaptive Network for Vision-and-Language Navigation
Wang, L., He, Z., Tang, J., Dang, R., Wang, N., Liu, C., & Chen, Q. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/164 · Cited by 24 · see citing works
VLN-PETL: Parameter-Efficient Transfer Learning for Vision-and-Language Navigation
Qiao, Y., Zheng, Y. H., & Wu, Q. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01416 · Cited by 20 · see citing works
Zhao, C. K., Qi, Y., & Wu, Q. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611736 · Cited by 18 · see citing works
Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigation
Cui, Y., Xie, L., Zhang, Y., Zhang, M., Yan, Y., & Yin, E. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01106 · Cited by 19 · see citing works
Boosting Efficient Reinforcement Learning for Vision-and-Language Navigation With Open-Sourced LLM
Wang, J., Wang, T., Cai, W., Xu, L., & Sun, C. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3511402 · Cited by 19 · see citing works
Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments
Chen, K., An, D. U., Huang, Y., Xu, R., Su, Y., Ling, Y., Reid, I. D., & Wang, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3594204 · Cited by 41 · see citing works
Qiao, Y., Lyu, W., Wang, H. Z., Wang, Z., Li, Z., Zhang, Y., Tan, M., & Wu, Q. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127584 · Cited by 38 · see citing works
ESceme: Vision-and-Language Navigation with Episodic Scene Memory
Zheng, Q., Liu, D., Wang, C., Zhang, J., Wang, D., & Tao, D. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02159-8 · Cited by 15 · see citing works
PASTS: Progress-aware spatio-temporal transformer speaker for vision-and-language navigation
Wang, L., Liu, C., He, Z., Li, S., Yan, Q., Chen, H., & Chen, Q. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107487 · Cited by 16 · see citing works
VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation
Li, J., Padmakumar, A., Sukhatme, G. S., & Bansal, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29813 · Cited by 15 · see citing works
Self-citationTowards real-time embodied AI agent: a bionic visual encoding framework for mobile robotics
Hou, X.-Y., Guan, Y.-J., Han, T., & Wang, C. (2024) · International Journal of Intelligent Robotics and Applications · doi:10.1007/s41315-024-00363-w · Cited by 14 · see citing works
Wang, S., Zhou, D., Xie, L., Xu, C., Yan, Y., & Yin, E. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107320 · Cited by 11 · see citing works
Wang, J., Wang, T., Xu, L., He, Z., & Sun, C. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3398300 · Cited by 8 · see citing works
LLM as Copilot for Coarse-Grained Vision-and-Language Navigation
Qiao, Y., Liu, Q., Liu, J., Liu, J., & Wu, Q. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72652-1_27 · Cited by 12 · see citing works
3D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigation
Gao, J., Liu, R., & Wang, W. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00864 · Cited by 7 · see citing works
Behavioral Analysis of Vision-and-Language Navigation Agents
Yang, Z., Majumdar, A., & Lee, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00253 · Cited by 7 · see citing works
Navigating Beyond Instructions: Vision-and-Language Navigation in Obstructed Environments
Hong, H., Wang, S., Huang, Z. H., Wu, Q., & Liu, J. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681640 · Cited by 10 · see citing works
PRET: Planning with Directed Fidelity Trajectory for Vision and Language Navigation
Lu, R., Meng, J., & Zheng, W. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72848-8_5 · Cited by 6 · see citing works
MossVLN: Memory-Observation Synergistic System for Continuous Vision-Language Navigation
Yu, T., Wu, Y., Cui, Q., Huang, Q., & Yu, J. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3586105 · Cited by 7 · see citing works
Incorporating External Knowledge Reasoning for Vision-and-Language Navigation with Assistant’s Help
Li, X., Zhang, Y., Yuan, W., & Luo, J. (2022) · Applied Sciences · doi:10.3390/app12147053 · Cited by 6 · see citing works
Multiple Visual Features in Topological Map for Vision-and-Language Navigation
Liu, R., Kong, P., & Zhang, W. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10803061 · Cited by 5 · see citing works
Visual and Textual Commonsense-Enhanced Layout Learning for Vision-and-Language Navigation
Gao, F., Shi, L., Tang, J., Wang, J., Li, S., Ma, S., & Yu, J. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3604018 · Cited by 6 · see citing works
Wang, L., Tang, J., He, Z., Dang, R., Liu, C., & Chen, Q. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801563 · Cited by 5 · see citing works
GroundingMate: Aiding Object Grounding for Goal-Oriented Vision-and-Language Navigation
Liu, Q., Zhang, S., Qiao, Y., Zhu, J., Li, X., Guo, L., Wang, Q., He, X., Wu, Q., & Liu, J. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00180 · Cited by 6 · see citing works
DOPE: Dual Object Perception-Enhancement Network for Vision-and-Language Navigation
Yu, Y., & Yang, D. (2025) · International Conference on Multimedia Retrieval · doi:10.1145/3731715.3733315 · Cited by 4 · see citing works
CLEAR: Improving Vision-Language Navigation with Cross-Lingual, Environment-Agnostic Representations
Li, J., Tan, H., & Bansal, M. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.48 · Cited by 5 · see citing works
Self-citationmonoVLN: Bridging the Observation Gap between Monocular and Panoramic Vision and Language Navigation
Lu, R., Zhou, Y., Cheng, H., Meng, J., & Zheng, W.-S. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00884 · Cited by 3 · see citing works
Zhang, J., & Ma, K. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801689 · Cited by 5 · see citing works
ULN: Towards Underspecified Vision-and-Language Navigation
Feng, W., Fu, T.-J., Lu, Y., & Wang, W. Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.429 · Cited by 3 · see citing works
Narrowing the Gap between Vision and Action in Navigation
Zhang, Y., & Kordjamshidi, P. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681150 · Cited by 4 · see citing works
REGNav: Room Expert Guided Image-Goal Navigation
Li, P., Wu, K., Fu, J., & Zhou, S. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i5.32514 · Cited by 5 · see citing works
Kong, P., Liu, R., Xie, Z., & Pang, Z. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127961 · Cited by 2 · see citing works
A comprehensive review of recent advancements in vision-and-language navigation
Khan, J. T., Aafaq, N., Ali, Q., & Mohsin, M. (2026) · Discover Computing · doi:10.1007/s10791-026-09977-z · Cited by 4 · see citing works
Tree-Structured Trajectory Encoding for Vision-and-Language Navigation
Zhou, X., & Mu, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25494 · Cited by 1 · see citing works
GMM-searcher: efficient object search in large-scale scenes using large language models
Zheng, L., Mei, R., Zou, B., Zhao, Z., Wei, M., & Siliu, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-00788-8 · Cited by 1 · see citing works
History-Guided Prompt Generation for Vision-and-Language Navigation
Guo, W. Q., Wang, Z., Hu, Y., & Gao, J. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3613147 · Cited by 1 · see citing works
Liu, R., Wu, S., Lin, D., & Zhang, W. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247004 · Cited by 2 · see citing works
Observation-Graph Interaction and Key-Detail Guidance for Vision and Language Navigation
Xie, Y., Ou, B., Ma, F., & Liu, Y. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247072 · Cited by 1 · see citing works
MVL-Loc: Leveraging Vision-Language Model for Generalizable Multi-Scene Camera Relocalization
Xiao, Z., Yang, S., Ji, S., Yin, J., Wen, Z., & Wu, W. (2025) · Applied Sciences · doi:10.3390/app152312642 · Cited by 1 · see citing works
FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Tasks
Zhang, S., Qiao, Y., Wang, Q., Guo, L., Wei, Z., & Liu, J. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3581809 · Cited by 1 · see citing works
ThinkMatter: Panoramic-Aware Instructional Semantics for Monocular Vision-and-Language Navigation
Dai, G., Wang, S., Zhao, H., Zhu, B., Sun, Q., & Shu, X. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3652003 · Cited by 1 · see citing works
Fine-Grained Alignment Supervision Matters in Vision-and-Language Navigation
He, K., Huang, Y., Jing, Y., Wu, Q., & Wang, L. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3658949 · Cited by 1 · see citing works
Yuan, Z., Tang, P., Sang, X., Zhang, F., & Zhang, Z. (2024) · The Visual Computer · doi:10.1007/s00371-024-03469-1 · Cited by 1 · see citing works
CLIP feature-based randomized control using images and text for multiple tasks and robots
Shibata, K., Deguchi, H., & Taguchi, S. (2024) · Advanced Robotics · doi:10.1080/01691864.2024.2379381 · Cited by 2 · see citing works
Model Adaptation for Time Constrained Embodied Control
Song, J., Yoo, M., & Woo, H. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52733.2024.01561
RewardVLN: AnImproved Agent Navigation Based On Visual-Instruction Alignment*
Liu, R., Kong, P., Wu, S., & Zhang, W. (2024) · International Conference on Advanced Robotics and Mechatronics (ICARM) · doi:10.1109/icarm62033.2024.10715935
Pandey, A., & Parihar, A. S. (2025) · International Conference on Inventive Computing and Informatics (ICICI) · doi:10.1109/icici65870.2025.11069974
Landmark-Guided Knowledge for Vision-and-Language Navigation
Yang, D., Zhu, M., & Yu, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9856-1_35
Wu, S., Liu, R., Xie, Z., & Pang, Z. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127282
Process Adaptive Learning for Visual-Language Navigation
Gao, C., Zhang, B., & Han, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04555-3_14
Language-Conditioned Waypoint Predictor for Continuous Vision-and-Language Navigation
Wang, Z., Qi, Y., An, D. U., Xu, Y., Li, H., & Zhang, Z. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209085
Vision-Language Navigation with Continual Learning for Unseen Environments
Li, Z., Lu, Y., Shang, D., Tu, Z., & Qiao, H. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246709
SDA-LLM: Spatial DisAmbiguation via Multi-turn Vision-Language Dialogues for Robot Navigation
Chen, K.-L., Wei, T.-T., Lee, M.-L., Yeh, L.-T., Kao, E., Tseng, Y., & Chen, J. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246115
Error-Driven Scene Editing for 3D Grounding in Large Language Models
Zhang, Y., Wang, Z., Lin, H., Li, J., Yang, J., Bitton, Y., Szpektor, I., & Bansal, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37029-7_24
Self-citationSPENav: Dynamic Object Filtering With Spatial Perception Enhancement for Vision-Language Navigation
Yuan, S., Zhang, H., Liu, L., Zhu, L., & Dong, X. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3651320
Yang, Y., Wang, T., Pan, M., Zhang, Y., Yue, Y., & Fu, M. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-4852-4
Enhancing Memory Ability of LLM Agent for Vision-and-Language Navigation
Bao, Y., Wang, J., & Wang, T. (2025) · China Automation Congress (CAC) · doi:10.1109/cac67268.2025.11486783
Gao, P., Wang, P., Wang, F., Fujita, H., & Aljuaid, H. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00549-1
Xi, Y., Liu, S., Pang, B. J., Zhou, T., Song, Y. H., Yuan, X., & Xu, Q. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3703976
Hierarchical Task Reasoning for Aerial Vision-and-Language Navigation
Zhou, L., Xue, R., & Luo, X. (2026) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2026.3709109
Wang, L., Sheng, K., He, Z., Li, J., Qin, Y., Dai, H., Wang, X. F., Yang, J., Yan, Q., Liu, C., et al. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3711284
Self-citationDCSEN: Dual Channel Semantic Enhancement for Vision-and-Language Navigation
Li, H., Liu, L., Dong, X., Zhu, L., Chang, X., & Zhang, H. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3714818
Yao, X., Gao, J., & Xu, C. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3728426
Yan, Y., Li, P., & Yin, J. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.117088
Trajectory-Diversity-Driven Robust Vision-And-Language Navigation
Li, J., Wan, C., Dong, S., Ding, C., Wang, Q., Ma, Z., & Gong, Y. (2026) · doi:10.1109/cvprf71909.2026.00877
Self-citation
- Authors
- Li, J., Tan, H., & Bansal, M.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 15386-15396
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4312434279
- Cited by
- 87
- References
- 72
- Citations by year
- 2026: 14 · 2025: 26 · 2024: 26 · 2023: 16 · 2022: 5
- FWCI
- 6.62
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1846185, CAREER)
- Defense Advanced Research Projects Agency (FA8750-19-2-1004, FA8750)
- Office of Naval Research (N000141812871)
- Army Research Office (W911NF2110220)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Automotive Engineering › Spatial Cognition and Navigation
- Keywords
- vision-and-language navigation, data augmentation, generalization to unseen environments, overfitting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review