CoChat

Bio-Inspired Collision Avoidance in Swarm Systems via Deep Reinforcement Learning

Open access
Na, Seongin, Niu, Hanlin, Lennox, Barry, Arvin, Farshad · 2022 · IEEE Transactions on Vehicular Technology

The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.

Abstract

Autonomous vehicles have been highlighted as a major growth area for future transportation systems and the deployment of large numbers of these vehicles is expected when safety and legal challenges are overcome. To meet the necessary safety standards, effective collision avoidance technologies are required to ensure that the number of accidents are kept to a minimum. As large numbers of autonomous vehicles, operating together on roads, can be regarded as a swarm system, we propose a bio-inspired collision avoidance strategy using virtual pheromones; an approach that has evolved effectively in nature over many millions of years. Previous research using virtual pheromones showed the potential of pheromone-based systems to maneuver a swarm of robots. However, designing an individual controller to maximise the performance of the entire swarm is a major challenge. In this paper, we propose a novel deep reinforcement learning (DRL) based approach that is able to train a controller that introduces collision avoidance behaviour. To accelerate training, we propose a novel sampling strategy calledHighlight Experience Replayand integrate it with a Deep Deterministic Policy Gradient algorithm with noise added to the weights and biases of the artificial neural network to improve exploration. To evaluate the performance of the proposed DRL-based controller, we applied it to navigation and collision avoidance tasks in three different traffic scenarios. The experimental results showed that the proposed DRL-based controller outperformed the manually-tuned controller in terms of stability, effectiveness, robustness and ease of tuning process. Furthermore, the proposed Highlight Experience Replay method outperformed than the popular Prioritized Experience Replay sampling strategy by taking 27% of training time average over three stages.

Overview

Integrity signals

Registry

Crossref · 10.1109/tvt.2022.3145346

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

The text we found for this paper looks like another document, so its claims and self-check weren’t run. The registry and citation checks still apply.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The text we found for this paper looks like another document, so the self-check wasn’t run.

Citations

Cites

Show all 58 references

Research works printed but not linked: 1

  1. 10.1109/mci.2006.329691 · doi:10.1109/mci.2006.329691 · Paper page

Cited by

See all 64

Metadata

Authors
Na, S., Niu, H., Lennox, B., & Arvin, F.
Affiliations
University of Manchester (GB)
Venue
IEEE Transactions on Vehicular Technology
Published
2022-03
Volume
71
Issue
3
Pages
2511-2526
ISSN
  • 0018-9545 (ISSN-L)
  • 1939-9359
OpenAlex
W4210530701
Cited by
64
References
59
Citations by year
2026: 4 · 2025: 19 · 2024: 12 · 2023: 25 · 2022: 4
FWCI
4.94
Type
journal article
Language
en
Locations
  • IEEE Transactions on Vehicular Technology (publishedVersion)
  • Research Explorer (The University of Manchester) (acceptedVersion, other-oa)
  • Durham Research Online (Durham University) (submittedVersion)
  • Durham Research Online (Durham University) (submittedVersion, cc-by)
Funders
  • EU H2020-FET-OPEN RoboRoyale Project (964492)
  • Engineering and Physical Sciences Research Council (EP/R026084/1, EP/P01366X/1)
  • University of Manchester
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Engineering › Control and Systems Engineering › Traffic control and management
Keywords
collision avoidance, autonomous vehicles, swarm systems, virtual pheromones, bio-inspired control, deep reinforcement learning, deep deterministic policy gradient, exploration noise, traffic scenarios, vehicle navigation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Bio-Inspired Collision Avoidance in Swarm Systems via Deep Reinforcement Learning. https://app.cochat.ai/papers/10.1109/tvt.2022.3145346
The paper
Na, S., Niu, H., Lennox, B., & Arvin, F. (2022). Bio-Inspired Collision Avoidance in Swarm Systems via Deep Reinforcement Learning. IEEE Transactions on Vehicular Technology. https://doi.org/10.1109/tvt.2022.3145346

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.