CoChat

Transformer Memory for Interactive Visual Navigation in Cluttered Environments

Li, Weiyuan, Hong, Ruoxin, Shen, Jiwei, Yuan, Liang, Lu, Yue · 2023 · IEEE Robotics and Automation Letters

The DOI matches its Crossref record; 27 of the 31 references it cites were found in a registry or an index.

Abstract

Substantial progress has been achieved in embodied visual navigation based on reinforcement learning (RL). These studies presume that the environment is stationary where all the obstacles are static. However, in real cluttered scenes, interactable objects (e.g. shoes and boxes) blocking the way of robots makes the environment non-stationary. Accordingly, the ego-centric visual agent will easily get stuck in the dilemma of finding the next waypoint as it struggles to decide whether to push the obstacles ahead. To handle the predicament, we formulate this interactive visual navigation as Partial Observed Markov Decision Process (POMDP). As the transformer encoder has demonstrated its superior ability to capture the spatial-temporal dependencies in natural language processing. We propose a transformer-based memory to empower the agents utilizing the historical interactive information. However, directly leveraging the transformer architecture in the RL settings is highly unstable. We further propose a surrogate objective to predict the next waypoint as the auxiliary task, which facilitates the representation learning and bootstraps the RL. We demonstrate our method in the iGibson environment and experimental results show a significant improvement over the interactive Gibson benchmark and the related recurrent RL policy both in the validation seen scenes and the test unseen scenes.

Overview

Integrity signals

Registry

Crossref · 10.1109/lra.2023.3241803

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 27 references

Cited by

See all 26

Metadata

Authors
Li, W., Hong, R., Shen, J., Yuan, L., & Lu, Y.
Affiliations
  • East China Normal University (CN)
  • Beijing University of Chemical Technology (CN)
Venue
IEEE Robotics and Automation Letters
Published
2023-03
Volume
8
Issue
3
Pages
1731-1738
ISSN
  • 2377-3766 (ISSN-L)
  • 2377-3774
OpenAlex
W4319990479
Cited by
26
References
31
Citations by year
2026: 3 · 2025: 10 · 2024: 9 · 2023: 4
FWCI
1.85
Type
journal article
Language
en
Open access
closed
Locations
IEEE Robotics and Automation Letters (publishedVersion)
Funders
  • Science and Technology Commission of Shanghai Municipality (22DZ2229004)
  • Shanghai Trusted Industry Internet Software Collaborative Innovation Center
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
Keywords
cluttered environments, non-stationary environments, auxiliary tasks, representation learning, embodied agents

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Transformer Memory for Interactive Visual Navigation in Cluttered Environments. https://app.cochat.ai/papers/10.1109/lra.2023.3241803
The paper
Li, W., Hong, R., Shen, J., Yuan, L., & Lu, Y. (2023). Transformer Memory for Interactive Visual Navigation in Cluttered Environments. IEEE Robotics and Automation Letters. https://doi.org/10.1109/lra.2023.3241803

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.