The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Collision avoidance for an unmanned surface vehicle using deep reinforcement learning
Abstract
In this paper, a deep reinforcement learning (DRL)-based collision avoidance method is proposed for an unmanned surface vehicle (USV). This approach is applicable to the decision-making stage of collision avoidance, which determines whether the avoidance is necessary, and if so, determines the direction of the avoidance maneuver. To utilize the visual recognition capability of deep neural networks as a tool for analyzing the complex and ambiguous situations that are typically encountered, a grid map representation of the ship encounter situation was suggested. For the composition of the DRL network, we proposed a neural network architecture and semi-Markov decision process model that was specially designed for the USV collision avoidance problem. The proposed DRL network was trained through repeated simulations of collision avoidance. After the training process, the DRL network was implemented in collision avoidance experiments and simulations to evaluate its situation recognition and collision avoidance capability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119
Target-driven visual navigation in indoor scenes using deep reinforcement learning
Zhu, Y., Mottaghi, R., Kolve, E., Lim, J. J., Gupta, A., Fei-Fei, L., & Farhadi, A. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989381 · Cited by 1,533
Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates
Gu, S., Holly, E., Lillicrap, T., & Levine, S. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989385 · Cited by 1,424
2018 IEEE International Conference on Robotics and Automation (ICRA)
(2018) · doi:10.1109/icra36916.2018 · Cited by 1,340
Tai, L., Paolo, G., & Liu, M. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202134 · Cited by 834
Vector Field Path Following for Miniature Air Vehicles
Nelson, D. R., Barber, D. B., McLain, T. W., et al. (2007) · IEEE Transactions on Robotics · doi:10.1109/tro.2007.898976 · Cited by 650
Campbell, S., Naeem, W., & Irwin, G. W. (2012) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2012.09.008 · Cited by 478
A Statistical Study of Ship Domains
Goodwin, E. M. (1975) · Journal of Navigation · doi:10.1017/s0373463300041230 · Cited by 454
2016 IEEE International Conference on Robotics and Automation (ICRA)
(2016) · doi:10.1109/icra33126.2016 · Cited by 446
(1992) · Springer eBooks · doi:10.1007/978-1-4615-3618-5 · Cited by 331
Self-Supervised Deep Reinforcement Learning with Generalized Computation Graphs for Robot Navigation
Kahn, G., Villaflor, A., Ding, B., Abbeel, P., & Levine, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460655 · Cited by 308
Introduction: The Challenge of Reinforcement Learning
Sutton, R. S. (1992) · Machine Learning · doi:10.1007/bf00992695 · Cited by 195
A study on the collision avoidance of a ship using neural networks and fuzzy logic
Ahn, J.-H., Rhee, K.-P., & You, Y.-J. (2012) · Applied Ocean Research · doi:10.1016/j.apor.2012.05.008 · Cited by 172
2018 International Conference on Unmanned Aircraft Systems (ICUAS)
(2018) · doi:10.1109/icuas43076.2018 · Cited by 149
Dynamic model identification of unmanned surface vehicles using deep learning network
Woo, J., Park, J., Yu, C.-W., & Kim, N. (2018) · Applied Ocean Research · doi:10.1016/j.apor.2018.06.011 · Cited by 147
Self-citationCasalino, G., Turetta, A., & Simetti, E. (2009) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceanse.2009.5278104 · Cited by 108
Toward End-to-End Control for UAV Autonomous Landing via Deep Reinforcement Learning
Polvara, R., Patacchiola, M., Sharma, S. K., Wan, J., Manning, A. J., Sutton, R., & Cangelosi, A. (2018) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2018.8453449 · Cited by 100
Radar based collision detection developments on USV ROAZ II
Almeida, C., Franco, T., Ferreira, H., Martins, A., Santos, R. F. C., Almeida, J. M., Carvalho, J. P., & Silva, E. (2009) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceanse.2009.5278238 · Cited by 71
Polvara, R., Sharma, S. K., Wan, J., Manning, A. J., & Sutton, R. (2019) · Robotica · doi:10.1017/s0263574719000316 · Cited by 51
Vision-Based Obstacle Collision Risk Estimation of an Unmanned Surface Vehicle
Woo, J., & Kim, N. (2015) · Journal of Institute of Control Robotics and Systems · doi:10.5302/j.icros.2015.15.0161 · Cited by 3
Self-citation
Cited by
Deep reinforcement learning based mobile robot navigation: A review
Zhu, K., & Zhang, T. (2021) · Tsinghua Science and Technology · doi:10.26599/tst.2021.9010012 · Cited by 499
Li, L., Wu, D., Huang, Y., & Yuan, Z.-M. (2021) · Applied Ocean Research · doi:10.1016/j.apor.2021.102759 · Cited by 323
Deep reinforcement learning-based controller for path following of an unmanned surface vehicle
Woo, J., Yu, C., & Kim, N. (2019) · Ocean Engineering · doi:10.1016/j.oceaneng.2019.04.099 · Cited by 246
Self-citationSurvey of deep learning for autonomous surface vehicles in marine environments
Qiao, Y., Yin, J., Wang, W., Duarte, F., Yang, J., & Ratti, C. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3235911 · Cited by 192
Dynamic robotic tracking of underwater targets using reinforcement learning
Masmitja, I., Martin, M., O’Reilly, T., Kieft, B., Palomeras, N., Navarro, J., & Katija, K. (2023) · Science Robotics · doi:10.1126/scirobotics.ade7811 · Cited by 96
Metadata
- Authors
- Woo, J., & Kim, N.
- Venue
- Ocean Engineering
- Publisher
- Elsevier BV
- Published
- 2020-03
- Volume
- 199
- Pages
- 107001
- ISSN
- 0029-8018 (ISSN-L)
- OpenAlex
- W3005337831
- Cited by
- 264
- References
- 24
- FWCI
- 19.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.