Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index; 7 of the 16 sources its claims cite were checked for support.

NavFormer: A Transformer Architecture for Robot Target-Driven Navigation in Unknown and Dynamic Environments

Open access
Wang, Haitong, Tan, Aaron Hao, Nejat, Goldie · 2024 · IEEE Robotics and Automation Letters

Abstract

In unknown cluttered and dynamic environments such as disaster scenes, mobile robots need to perform target-driven navigation in order to find people or objects of interest, where the only information provided about these targets are images of the individual targets. In this letter, we introduce NavFormer, a novel end-to-end transformer architecture developed for robot target-driven navigation in unknown and dynamic environments. NavFormer leverages the strengths of both 1) transformers for sequential data processing and 2) self-supervised learning (SSL) for visual representation to reason about spatial layouts and to perform collision-avoidance in dynamic settings. The architecture uniquely combines dual-visual encoders consisting of a static encoder for extracting invariant environment features for spatial reasoning, and a general encoder for dynamic obstacle avoidance. The primary robot navigation task is decomposed into two sub-tasks for training: single robot exploration and multi-robot collision avoidance. We perform cross-task training to enable the transfer of learned skills to the complex primary navigation task. Simulated experiments demonstrate that NavFormer can effectively navigate a mobile robot in diverse unknown environments, outperforming existing state-of-the-art methods. A comprehensive ablation study is performed to evaluate the impact of the main design choices of NavFormer. Furthermore, real-world experiments validate the generalizability of NavFormer.

Overview

CoChat Summary

TL;DR

NavFormer is an end-to-end transformer architecture for robot target-driven navigation in unknown and dynamic environments, combining dual visual encoders trained with self-supervised learning and a GPT-2-based causal transformer trained with offline reinforcement learning. It outperformed several state-of-the-art learning methods in simulated unseen mazes, photorealistic environments, and unseen dynamic-obstacle tests, and generalized to real-world office trials.

Key findings

  • In unseen 3D maze environments, NavFormer consistently achieved higher success rate (SR) and SPL and lower collision rate (CR) than VRW, DSAC, MA-TDN, and DT across all tested environment sizes and robot counts; for example, with 2 robots in one setup it reached SR 80.83%, SPL 0.562, and CR 0.228.
  • In unseen photorealistic environments, NavFormer achieved SR 36.67%, SPL 0.269, and CR 0.412, outperforming VRW, DSAC, MA-TDN, and DT, though FCA—an upper-bound method using extra map and ground-truth state information—reached SR 82.22%, SPL 0.612, and CR 0.092.
  • With unseen dynamic obstacles, NavFormer’s SR decreased from 48.89% (seen dynamic obstacles) to 41.67% (unseen), with SPL 0.322 and CR 0.301, but it still outperformed the other SOTA learning methods.
  • Ablation showed the full NavFormer achieved SR 48.89%, SPL 0.378, and CR 0.223, while removing SSL, target hidden state concatenation, exploration trajectories, or either encoder reduced performance; replacing the dual encoders with ResNet18 gave the lowest result (SR 7.92%, SPL 0.080, CR 0.765).
  • Real-world office experiments yielded SR 63.33%, SPL 0.406, and CR 0.229.

Methods

  • NavFormer uses a multi-modal input sequence of target image and robot trajectory, dual visual encoders (a static encoder for invariant environment features and a general encoder for static/dynamic obstacle features) trained with BYOL self-supervised learning, and a GPT-2-based causal transformer navigation network trained with the Decision Transformer offline RL method.
  • Training uses cross-task learning on two sub-tasks: single-robot exploration and multi-robot collision avoidance. Datasets included 3,496 exploration trajectories (342,954 timesteps), 7,467 collision-avoidance trajectories (469,378 timesteps), and 98,000 image pairs across 1,000 environments for representation learning.
  • Simulated experiments used Gazebo with 54 new 3D mazes, 2/4/6 Jackal robots, and 60 trials per setup; photorealistic tests used three environments with 30 trials each; unseen dynamic-obstacle tests used 60 trials per scenario; ablation used 60 trials in six 12.5 m × 12.5 m mazes with 4 Jackal robots; real-world tests used a 9.0 m × 10.0 m office with two Jackal robots and 15 trials.

Limitations

  • The paper states that FCA outperformed NavFormer because FCA uses additional information unavailable to NavFormer and other learning methods, including point clouds, maps, other robots’ states, and specific target locations.
  • The paper states that NavFormer’s performance decreased in unseen out-of-distribution photorealistic environments and with unseen dynamic obstacles, and future work will expand the architecture with object recognition backbones for common objects and different dynamic obstacles.
  • Evident from the text: training used only Jackal robots as dynamic obstacles, real-world validation was limited to one office environment with two robots and 15 trials, and target objects were restricted to geometric shapes and colors.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/lra.2024.3412638

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Image 1
From the PDF
Image 2
From the PDF
Fig. 2 BYOL procedure for the static and general encoder.
Fig. 2 BYOL procedure for the static and general encoder.From the PDF
Fig. 4 Photorealistic environments with three jackal robots and eight target objects: (a) a bookstore, (b) a two-room cafe, and (c) a single floor house with multiple rooms.
Fig. 4 Photorealistic environments with three jackal robots and eight target objects: (a) a bookstore, (b) a two-room cafe, and (c) a single floor house with multiple rooms.From the PDF
Fig. 3 Robot environments: (a) 7.5 m × 7.5 m with 2 robots, (b) 12.5 m × 12.5 m with 4 robots, (c) 17.5 m × 17.5 m with 6 robots, and (d) a mobile robot and a target object.
Fig. 3 Robot environments: (a) 7.5 m × 7.5 m with 2 robots, (b) 12.5 m × 12.5 m with 4 robots, (c) 17.5 m × 17.5 m with 6 robots, and (d) a mobile robot and a target object.From the PDF
Fig. 5 Top view of the real-world office environment with two mobile robots and eight target objects with zoomed in views of the different regions.
Fig. 5 Top view of the real-world office environment with two mobile robots and eight target objects with zoomed in views of the different regions.From the PDF

Verification

Claims the paper makes

6 Valid · 0 Not valid · 5 Not checked · 43 Own results and interpretations

29 more claims

Create a free account to see all 54 claims and to verify the 1 reference still open.

See all claims — free account
  • It may state two separate claims as one. 18
  • The quote only partly states this claim. 1
  • Probably not a substantial claim. 3

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 40 references

Research works printed but not linked: 1

  1. 10.5555/3495724.3497510 · doi:10.5555/3495724.3497510

Cited by

See all 40

Metadata

Authors
Wang, H., Tan, A. H., & Nejat, G.
Affiliations
University of Toronto (CA)
Venue
IEEE Robotics and Automation Letters
Published
2024-08
Volume
9
Issue
8
Pages
6808-6815
ISSN
  • 2377-3766 (ISSN-L)
  • 2377-3774
OpenAlex
W4391800510
Cited by
40
References
40
Citations by year
2026: 13 · 2025: 21 · 2024: 6
FWCI
5.93
Type
journal article
Language
en
Open access
Locations
  • IEEE Robotics and Automation Letters (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Natural Sciences and Engineering Research Council of Canada
  • Canada Research Chairs
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
Keywords
transformer models, dynamic obstacle avoidance, multi-robot collision avoidance, dynamic environments, disaster search and rescue, mobile robot navigation, spatial reasoning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: NavFormer: A Transformer Architecture for Robot Target-Driven Navigation in Unknown and Dynamic Environments. https://app.cochat.ai/papers/10.1109/lra.2024.3412638
The paper
Wang, H., Tan, A. H., & Nejat, G. (2024). NavFormer: A Transformer Architecture for Robot Target-Driven Navigation in Unknown and Dynamic Environments. IEEE Robotics and Automation Letters. https://doi.org/10.1109/lra.2024.3412638

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.